error in rsync protocol on large file

[Granzow, Doug (NCI)]

An update on this problem...  I get the error below (and the error I
reported previously) when running rsync 2.5.2 compiled from source.  I saw
different behavior when I used the rsync 2.5.2 binary compiled on Solaris
2.5.1 by Dave Dykstra.  That binary complained of "Value too large for
defined data type" whenever it encountered a large file (over 2GB), but did
not exit.  The impression I got was that the Solaris 2.5.1 binary did not
support or even try to support files over 2 GB, where the binary compiled on
Solaris 7 or 8 *thinks* it can support large files but fails, since it exits
as soon as it encounters the large file.

So the problem still remains:  rsync is dying when it encounters a large
file.  One person suggested using --exclude, but this only matches against
file names, not file sizes.  (I can't do "--exclude=size>2GB" for example.)

Questions I still have:

- Is rsync supposed to support files >2GB on Solaris 7 and Solaris 8?

- If so, what is causing the errors I am seeing?  Is there something I can
do at compile time?

- If not, is there a way for it to skip large files gracefully so that at
least the rsync process completes?

leelab/NCBI_Data_old/GenBank/htg
write failed on leelab/NCBI_Data_old/GenBank/htg : Error 0
rsync error: error in file IO (code 11) at receiver.c(243)

Received signal 16. (no core)
rsync: connection unexpectedly closed (23123514 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(140)


> -----Original Message-----
> From: Granzow, Doug (NCI) 
> Sent: Monday, February 11, 2002 11:08 AM
> To: 'rsync at lists.samba.org'
> Subject: error in rsync protocol on large file
> 
> 
> I'm trying to rsync a filesystem from a Solaris 7 server to a 
> Solaris 8
> server.  I keep getting the following message when rsync 
> attempts to update
> a particular file:
> 
> write failed on leelab/NCBI_Data/GenBank/htg : Error 0
> rsync error: error in file IO (code 11) at receiver.c(243)
> 
> Received signal 16. (no core)
> rsync: connection unexpectedly closed (22672537 bytes read so far)
> rsync error: error in rsync protocol data stream (code 12) at 
> io.c(140)
> 
> The file it is getting the error on is very large:
> 
> -rw-rw-r--   1 leema    staff    4633417879 Apr 30  2001 htg
> 
> # rsync --version
> rsync  version 2.5.2  protocol version 26
> Copyright (C) 1996-2002 by Andrew Tridgell and others
> <http://rsync.samba.org/>
> Capabilities: 64-bit files, socketpairs, hard links, 
> symlinks, batchfiles,
> no IPv6,
>               64-bit system inums, 64-bit internal inums
> 
> Does rsync simply not handle files this large?  Is there something in
> config.h I can change to support large files (I see "#undef 
> _LARGE_FILES"
> but the comment above it indicates it is only for AIX)?  If I 
> can't get
> rsync to copy large files, is there a way to get it to skip 
> them, so that
> the rest of the files do get synced?
> 
> Thanks
> Doug
>