Re: Backup from cwRsync 2.0.3 on Windows 2003 to Linux Server hangs on binary files?

17 posts / 0 new
Last post
itefix
Offline
Last seen: 1 week 6 days ago
Joined: 01.05.2008 - 21:33
Re: Backup from cwRsync 2.0.3 on Windows 2003 to Linux Server hangs on binary files?

It seems that problems are installation-specific. To be able to help you and recommend something useful, I need to know exact configuration you use at both sides.

itefix
Offline
Last seen: 1 week 6 days ago
Joined: 01.05.2008 - 21:33
Re: Backup from cwRsync 2.0.3 on Windows 2003 to Linux Server ha

Some more information:

I am also connecting to the windows server through ssh.   My linux server has the following versions:

rsync  version 2.5.7  protocol version 26
OpenSSH_3.6.1p2, SSH protocols 1.5/2.0, OpenSSL 0x0090701f

Do you have a download of just the ssh components that I should try?

Thanks!

itefix
Offline
Last seen: 1 week 6 days ago
Joined: 01.05.2008 - 21:33
Re: Backup from cwRsync 2.0.3 on Windows 2003 to Linux Server ha

After putting the original cygwin1.dll back, I tried the rsync replacement that you recommended in the other XP thread.  I am connecting to the Windows 2000 Server from a Linux server and it hangs at the same time each attempt.  It almost looks like a total bytes transferred problem.  Replacing the rsync.exe did not fix the hanging problem.  Any other ideas or should I just install 2.0.1?

Kevin

itefix
Offline
Last seen: 1 week 6 days ago
Joined: 01.05.2008 - 21:33
Backup from cwRsync 2.0.3 on Windows 2003 to Linux Server hangs

Hello,
I'm running cwRsync 2.0.3 on Windows 2003 Server. I am attempting to backup /cygdrive/c/inetpub/wwwroot/* to a remote Linux server running OpenSSH + Rsync.

Authentication works great, and the transfer starts. The full file structure is created on the remote Linux server, then file transfers start.

However, it seems when a binary (or large?) file is encountered, the transfer freezes. Here is output from the rsync command I have in cwrsync.cmd:

C:\Program Files\cwRsync>rsync -v -r /cygdrive/c/inetpub/wwwroot/* backup@remote-linuxserver:/home/backup/win2003server
building file list ... done
aspnet_client/system_web/1_1_4322/SmartNav.htm
aspnet_client/system_web/1_1_4322/smartnav.js
aspnet_client/system_web/1_1_4322/webuivalidation.js
site1/Photo.jpg

At this point, cwrsync hangs. On the remote server, the full file structure is created, the first two files are there, but then the webuivalidation.js file has a strange filename. The remote directory structure on the Linux server looks like this:

# ls -al /home/backup/win2003server/aspnet_client/system_web/1_1_4322/
total 24
drwxr-xr-x 2 backup backup 4096 Aug 29 13:07 .
drwxr-xr-x 3 backup backup 4096 Aug 29 12:42 ..
-rw-r--r-- 1 backup backup 15 Aug 29 13:07 SmartNav.htm
-rw-r--r-- 1 backup backup 9427 Aug 29 13:07 smartnav.js
-rw------- 1 backup backup 0 Aug 29 13:07 .webuivalidation.js.Wc0ybh

site1/Photo.jpg doesn't exist at all. webuivalidation.is about 15k, the other two files that transferred successfully are about 10k. photo.jpg is about 275k.

Any tips on how I could diagnose what's going wrong? There's nothing meaningful in the logs on the Linux server, I just see this in /var/log/secure:

Aug 29 13:07:11 fmdfile01 sshd: Accepted publickey for backup from ::ffff:192.168.0.10 port 4224 ssh2

At first, the transfer was hanging on a large zip file (8mb) in C:\inetpub\wwwroot. I added /*.zip to a file that I specified with --exclude-from on the rsync commandline, so that it would skip that zip file, but then rsync promptly hung on the jpg file, which is what leads me to believe this is a problem with transferring files > 10K in size, or with transferring binary files.

rsync is being run as Administrator, so permissions shouldn't be an issue.

Thanks,
Drel

itefix
Offline
Last seen: 1 week 6 days ago
Joined: 01.05.2008 - 21:33
Re: Backup from cwRsync 2.0.3 on Windows 2003 to Linux Server ha

Which Rsync version do you run on Linux side ?

itefix
Offline
Last seen: 1 week 6 days ago
Joined: 01.05.2008 - 21:33
Re: Backup from cwRsync 2.0.3 on Windows 2003 to Linux Server ha

The Linux server side has rsync-2.6.4 installed, openssh-3.9p1.

Thanks for the reply, I hope we can get this working! :)

Drel

itefix
Offline
Last seen: 1 week 6 days ago
Joined: 01.05.2008 - 21:33
Re: Backup from cwRsync 2.0.3 on Windows 2003 to Linux Server ha

The Linux server side has rsync-2.6.4 installed,

By the way, I just upgraded to rsync 2.6.6 on the Linux server, but unfortunately see the same problem.

Drel

itefix
Offline
Last seen: 1 week 6 days ago
Joined: 01.05.2008 - 21:33
Re: Backup from cwRsync 2.0.3 on Windows 2003 to Linux Server ha

I don't get it :-) Where do you specify your private key to trigger PKA ?

itefix
Offline
Last seen: 1 week 6 days ago
Joined: 01.05.2008 - 21:33
Re: Backup from cwRsync 2.0.3 on Windows 2003 to Linux Server ha

I don't get it :-) Where do you specify your private key to trigger PKA ?

Private key lives in C:\Documents and Settings\Administrator\.ssh; this is used when connecting to the linuxserver.  It appears to "just work".

Drel

itefix
Offline
Last seen: 1 week 6 days ago
Joined: 01.05.2008 - 21:33
Re: Backup from cwRsync 2.0.3 on Windows 2003 to Linux Server ha

Eeeenteresting -- I was browsing through the forum and encountered the topic titled "Rsync stalls after two files"; like that user, I am also running Windows 2003 SP1 as the client OS.

I downloaded and installed cwRsync 2.0.1, and it works great.  Must be a problem with 2.0.3 (I didn't try 2.0.2)?

itefix
Offline
Last seen: 1 week 6 days ago
Joined: 01.05.2008 - 21:33
Re: Backup from cwRsync 2.0.3 on Windows 2003 to Linux Server ha

I wonder if you can install cwrsync 2.0.3 again and replace cygwin1.dll (1.5.18) with the version packaged with cwrsync 2.0.1 (1.5.17), after having services stopped.

A copy of 1.5.17 can be downloaded here.

Fingerprints:

MD5 - 3e998be0964356326b46b2e6f48a0106 *cygwin1-1517.zip
SHA1 - 5a8401799ae81c1a0ea730842131893411d69137 *cygwin1-1517.zip

Thanks in advance.

itefix
Offline
Last seen: 1 week 6 days ago
Joined: 01.05.2008 - 21:33
Re: Backup from cwRsync 2.0.3 on Windows 2003 to Linux Server ha

I wonder if you can install cwrsync 2.0.3 again and replace cygwin1.dll (1.5.18) with the version packaged with cwrsync 2.0.1 (1.5.17), after having services stopped.

Sure, I'll give this a try; I have one more Windows Server 2003 SP1 box to set cwRsync on, I'll experiment with that one.

Which services would you like me to stop? I'm using the cwRsync client installer, rather than the server installer.

itefix
Offline
Last seen: 1 week 6 days ago
Joined: 01.05.2008 - 21:33
Re: Backup from cwRsync 2.0.3 on Windows 2003 to Linux Server ha

Sure, I'll give this a try; I have one more Windows Server 2003 SP1 box to set cwRsync on, I'll experiment with that one.
OK, how's this for bizarre; cwRsync 2.0.3 worked fine on the other box, also running Windows Server 2003 Web Edition SP1. Both have identical hardware and are configured with IIS 6, ASP.Net 1.1, IIS FTP Server, MySQL 4.1, Mozilla Firefox 1.0.6 and are fully patched using Microsoft Update.

The server that did NOT work with cwRsync 2.0.3 also had MySQL Administrator 1.0, MSDE (Microsoft SQL Server Desktop Edition), Microsoft SQL Web Data Administrator, ActiveState ActivePerl 5.8.6 Build 811, and a freeware program named Search and Replace 98 installed.

I did not try replacing the cygwin DLL on the second Windows Server 2003 box as you asked since the rsync worked great on the first try.

Drel

itefix
Offline
Last seen: 1 week 6 days ago
Joined: 01.05.2008 - 21:33
Re: Backup from cwRsync 2.0.3 on Windows 2003 to Linux Server ha

I had the same problem on my win 2000 server with 2.0.2 and 2.0.3, so I tried replacing the cygwin1.dll file, but now nothing works.  If I try my bash shell I get:  The Procedure Entry point strtoimax could not be located in the dynamic link library cygwin1.dll.

itefix
Offline
Last seen: 1 week 6 days ago
Joined: 01.05.2008 - 21:33
Re: Backup from cwRsync 2.0.3 on Windows 2003 to Linux Server ha

I have updated cwRsync 2.0.3 packages with a newly compiled rsync 2.6.6, which seems to solve hang problems.
Download 2.0.3a packages from Link Manager at right side and check if your problems disappear.

This topis is locked. Feel free to open a new topis if you still experience same problems.

itefix
Offline
Last seen: 1 week 6 days ago
Joined: 01.05.2008 - 21:33
Re: Backup from cwRsync 2.0.3 on Windows 2003 to Linux Server ha

I see the same behaviour using 2.0.3 client and server between a variety of windows machines (XP and 2003 server). A shallow transfer (e.g. big files but no recursion) works fine, however transfers with the -r flag stall on the first large file after the directory structure has been created. Replacing the client with 2.0.1 and leaving the server on 2.0.3 resolves the problem.

itefix
Offline
Last seen: 1 week 6 days ago
Joined: 01.05.2008 - 21:33
Re: Backup from cwRsync 2.0.3 on Windows 2003 to Linux Server ha

I see the same behaviour using 2.0.3 client and server between a variety of windows machines (XP and 2003 server). A shallow transfer (e.g. big files but no recursion) works fine, however transfers with the -r flag stall on the first large file after the directory structure has been created. Replacing the client with 2.0.1 and leaving the server on 2.0.3 resolves the problem.

That's interesting! Is ssh involved ? Command syntax you use at client side ?

Topic locked

Release announcements