Unable to rsync files of size 30 GB

Nitin Agarwal nitin.agarwal at Timesgroup.com
Tue Oct 14 22:05:45 EST 2003


Hi,
I m using rsync on AIX 4.3 for backing up a huge database. Rsync gives error on bringing files
greater than 2 GB. I tried the 64 bit version of Rsync 2.5.6 (on 64bit file system) also, but it
didnt worked.

Command i m giving is:
rsync -avz --ignore-errors 10.10.10.10::backup /backupdir

OUTPUT IS AS FOLLOWS (with error message)
receiving file list ... done
./
1
ABC.0.db2abc.NODE0000.CATN0000.20031012072506.001
write failed on ABC.0.db2abc.NODE0000.CATN0000.20031012072506.001 : Error 0
rsync error: error in file IO (code 11) at receiver.c(243)
rsync: connection unexpectedly closed (182 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(165)

I repeated command 2-3 times (to check for any network errors) and it always gave the error after
bringing approximately 2 GB of data.
The file size is 13GB.

Machines on which i m running this command are RS 6000 with PowerPC Power 3 processors (4 CPU @ 350
MHz each) Memory is 2.5 GB (approx,.)

Please help
Thanks in advance
Nitin Agarwal

jw schultz wrote:

> On Mon, Oct 13, 2003 at 02:34:00PM +0100, Andy Henson wrote:
> > Rsync maps files into memory, so it cannot handle files larger than the
> > program's address space.  On 32 bit machines this is likely to be less
> > than 2GB.
> >
> > You don't say what processor you are running on?  Can it map files of
> > bigger than 2GB into memory?
>
> Not true.  It uses a rolling mapping that is actually done
> by read not mmap for portability reasons.
>
> The most likely cause of his problems is an incorrect build
> but since the error messages, version number and
> command-lines were not provided i have no way to know why he
> is having this problem.
>
> --
> ________________________________________________________________
>         J.W. Schultz            Pegasystems Technologies
>         email address:          jw at pegasys.ws
>
>                 Remember Cernan and Schmitt
> --
> To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
> Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
>
> ---NOTICE--------------------------------------------------------------------------------------
> This E-mail (including the attachment/(s) if any ) has been scanned for viruses and dangerous
> content before delivering to your Mailbox. For more information please contact Technical
> Support Cell - Mumbai. mumbai_admin at timesgroup.com
> -----------------------------------------------------------------------------------------------




More information about the rsync mailing list