HP-UX 11i and largefiles on rsync 2.6.2

Don Malloy nixuser23 at hotmail.com
Tue Jul 20 20:49:24 GMT 2004


I just tried the build from the nightly tar file: 
rsync-HEAD-20040720-1929GMT.tar.gz

It failed at 2144075776 bytes each time I tried. I've attached the tail from 
the tusc again. Here it the output of the rsync:

server2 # /tmp/rsync -avvvvv --progress --stats file1.db /var/opt/ignite
cmd= machine= user= path=/var/opt/ignite
cmd=. /var/opt/ignite
(Client) Protocol versions: remote=28, negotiated=28
(Server) Protocol versions: remote=28, negotiated=28
building file list ...
[sender] make_file(file1.db,*,2)
[sender] expand file_list to 131072 bytes, did move
1 file to consider
[sender] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232 uid=0 gid=3
send_file_list done
file list sent
send_files starting
server_recv(2) starting pid=18366
recv_file_name(file1.db)
received 1 names
gid 3(sys) maps to 3
[receiver] i=0 <NULL> <NULL> file1.db mode=0100640 len=4304863232 uid=0 
gid=3
recv_file_list done
get_local_name count=1 /var/opt/ignite
recv_files(1) starting
generator starting pid=18366 count=1
delta-transmission disabled for local transfer or --whole-file
recv_generator(file1.db,0)
send_files(0, file1.db)
count=0 n=0 rem=0
send_files mapped file1.db of size 4304863232
calling match_sums file1.db
file1.db
2144075776  49%    4.62MB/s    0:07:36    <-- press CTRL-C after it gets 
stuck here.
_exit_cleanup(code=20, file=rsync.c, line=229): entered
rsync error: received SIGUSR1 or SIGINT (code 20) at rsync.c(229)
_exit_cleanup(code=20, file=rsync.c, line=229): about to call exit(20)
rsync: writefd_unbuffered failed to write 60 bytes: phase "unknown": Broken 
pipe (32)
_exit_cleanup(code=12, file=io.c, line=900): entered
rsync error: error in rsync protocol data stream (code 12) at io.c(900)
_exit_cleanup(code=12, file=io.c, line=900): about to call exit(12)

---------------------------------------------------------------------------
>From: Wayne Davison <wayned at samba.org>
>To: Don Malloy <nixuser23 at hotmail.com>
>CC: rsync at lists.samba.org
>Subject: Re: HP-UX 11i and largefiles on rsync 2.6.2
>Date: Tue, 20 Jul 2004 12:30:27 -0700
>
>On Mon, Jul 19, 2004 at 01:13:55PM -0400, Don Malloy wrote:
> > Interestingly enough, now it stops dead when it hits 2146631680 bytes
> > transferred. [...] Any ideas?
>
>I haven't been able to duplicate the problem you're seeing using the cvs
>version of rsync.  I'll try a patched 2.6.2 next.  You may wish to try
>downloading the latest nightly tar file from the rsync web site and
>trying that.
>
>..wayne..

_________________________________________________________________
Designer Mail isn't just fun to send, it's fun to receive. Use special 
stationery, fonts and colors. 
http://join.msn.com/?pgmarket=en-ca&page=byoa/prem&xAPID=1994&DI=1034&SU=http://hotmail.com/enca&HL=Market_MSNIS_Taglines 
  Start enjoying all the benefits of MSN® Premium right now and get the 
first two months FREE*.
-------------- next part --------------
0x7f7f2f88, 0x7f7f3088, NULL, 0x7f7f3188) 
.......................................................... = 1
                              nfds: 7
                           readfds: 0
                          writefds: EMPTY
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356167.325390 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) 
................................................................ = 1
                              nfds: 6
                           readfds: NULL
                          writefds: 5
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356167.325611 write(5, "> c0b c1\0c9\f\0> e7d3R 9be811\0".., 17676) 
........................................................ = 8184
1090356167.325906 read(0, "86p 86b1bff5h ad` eee3d3bff406W ".., 8184) 
.......................................................... = 8184
1090356167.326197 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356167.326356 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356167.326519 select(7, 0x7f7f2f88, 0x7f7f3088, NULL, 0x7f7f3188) 
.......................................................... = 1
                              nfds: 7
                           readfds: 0
                          writefds: EMPTY
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356167.326748 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) 
................................................................ = 1
                              nfds: 6
                           readfds: NULL
                          writefds: 5
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356167.326965 write(5, "5 bb/ 13\0\0\0\0\0\0\0\0\0\0\0\0".., 9492) 
......................................................... = 8184
1090356167.327257 read(0, "bfebb2aefb? 8f, bfb4@ 17b4df\a5 ".., 8184) 
.......................................................... = 8184
1090356167.327541 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356167.327699 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356167.327862 select(7, 0x7f7f2f88, 0x7f7f3088, NULL, 0x7f7f3188) 
.......................................................... = 1
                              nfds: 7
                           readfds: 0
                          writefds: EMPTY
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356167.328104 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) 
................................................................ = 1
                              nfds: 6
                           readfds: NULL
                          writefds: 5
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356167.328300 write(5, "\0\0\0\0\0\0\0\0fffffffe\0\0\0\0".., 1308) 
......................................................... = 1308
1090356167.331093 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) 
................................................................ = 1
                              nfds: 6
                           readfds: NULL
                          writefds: 5
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356167.331297 write(5, "\080\0\0", 4) 
...................................................................................... 
= 4
1090356167.331465 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) 
................................................................ = 1
                              nfds: 6
                           readfds: NULL
                          writefds: 5
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356167.331667 write(5, "\0\0\0c4\0\0\0\0? ef= 1ed819e310".., 32768) 
........................................................ = 6872
1090356167.331961 read(0, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0".., 8184) 
.......................................................... = 8184
1090356167.332272 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356167.334242 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356167.334406 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356167.334601 select(7, 0x7f7f2f88, 0x7f7f3088, NULL, 0x7f7f3188) 
.......................................................... = 1
                              nfds: 7
                           readfds: 0
                          writefds: EMPTY
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356167.334832 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) 
................................................................ = 1
                              nfds: 6
                           readfds: NULL
                          writefds: 5
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356167.335036 write(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0".., 25896) 
........................................................ = 8184
1090356167.335324 read(0, "? d2deY b2849810@ ! 14O L \a1ad6".., 8184) 
.......................................................... = 8184
1090356167.335614 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356167.335770 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356167.335933 select(7, 0x7f7f2f88, 0x7f7f3088, NULL, 0x7f7f3188) 
.......................................................... = 1
                              nfds: 7
                           readfds: 0
                          writefds: EMPTY
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356167.336157 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) 
................................................................ = 1
                              nfds: 6
                           readfds: NULL
                          writefds: 5
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356167.336364 write(5, "@ M @ e o 94a4p c0\n9d06j 869 y ".., 17712) 
........................................................ = 8184
1090356167.336656 read(0, "> e38afa1915b3a0> f9S 1 83" H \0".., 8184) 
.......................................................... = 8184
1090356167.336941 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356167.337098 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356167.337260 select(7, 0x7f7f2f88, 0x7f7f3088, NULL, 0x7f7f3188) 
.......................................................... = 1
                              nfds: 7
                           readfds: 0
                          writefds: EMPTY
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356167.337484 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) 
................................................................ = 1
                              nfds: 6
                           readfds: NULL
                          writefds: 5
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356167.337690 write(5, "bf\0ab92dcb2\b\0bf\af0ffv N 8 \0".., 9528) 
......................................................... = 8184
1090356167.337985 read(0, "\0\0\0\0\0\0\0\0\0\0\0\0c014% c9".., 8184) 
.......................................................... = 8184
1090356167.338267 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356167.338425 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356167.338588 select(7, 0x7f7f2f88, 0x7f7f3088, NULL, 0x7f7f3188) 
.......................................................... = 1
                              nfds: 7
                           readfds: 0
                          writefds: EMPTY
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356167.338812 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) 
................................................................ = 1
                              nfds: 6
                           readfds: NULL
                          writefds: 5
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356167.339003 write(5, "\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0".., 1344) 
......................................................... = 1344
1090356167.340928 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) 
................................................................ = 1
                              nfds: 6
                           readfds: NULL
                          writefds: 5
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356167.341119 write(5, "\080\0\0", 4) 
...................................................................................... 
= 4
1090356167.341285 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) 
................................................................ = 1
                              nfds: 6
                           readfds: NULL
                          writefds: 5
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356167.341487 write(5, "? 3 3 0117a2f297bf17bedbee8a) 18".., 32768) 
........................................................ = 6836
1090356167.341785 read(0, "@ G d3K | bb06h @ D c3d3V cbbf9c".., 8184) 
.......................................................... = 8184
1090356167.342084 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356167.345658 write(1, "\0\0\0D \0\0\0\0@ 6 \0\0\0\0\0\0".., 262144) 
....................................................... = 262143
1090356167.346003 write(1, "18", 1) 
............................................................................................ 
ERR#27 EFBIG
1090356167.365258 open("/usr/lib/nls/msg/C/strerror.cat", O_RDONLY, 0177777) 
................................................... = 5
1090356167.365464 fstat(5, 0x7f7f3f90) 
......................................................................................... 
= 0
                            st_dev: 64 0x000007
                            st_ino: 28982
                           st_mode: S_IFREG|0444
                          st_nlink: 2
                           st_rdev: 0
                           st_size: 7140
                        st_blksize: 8192
                         st_blocks: 8
                            st_uid: 2
                            st_gid: 2
                          st_atime: Tue Jul 20 16:22:00 2004
                          st_mtime: Tue Nov 14 03:00:00 2000
                          st_ctime: Mon Jun 28 16:35:54 2004
1090356167.365758 fcntl(5, F_SETFD, 1) 
......................................................................................... 
= 0
1090356167.365936 lseek(5, 0, SEEK_SET) 
........................................................................................ 
= 0
1090356167.369995 read(5, "m s g c a t 0 1 \0\0\0f9\001\001".., 1212) 
.......................................................... = 1212
1090356167.370242 lseek(5, 3443, SEEK_SET) 
..................................................................................... 
= 3443
1090356167.370398 read(5, "F i l e   t o o   l a r g e ", 14) 
.................................................................. = 14
1090356167.370592 close(5) 
..................................................................................................... 
= 0
1090356167.370763 brk(0x404f6000) 
.............................................................................................. 
= 0
1090356167.371169 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356167.371343 sigvec(SIGUSR1, 0x7f7f2ae0, 0x7f7f2af0) 
...................................................................... = 0
                    vec.sv_handler: 0x1
                       vec.sv_mask: EMPTY SET
                      vec.sv_flags: SV_RESETHAND
                   ovec.sv_handler: 0x40004dfa
                      ovec.sv_mask: EMPTY SET
                     ovec.sv_flags: SV_RESETHAND
1090356167.371556 sigvec(SIGUSR2, 0x7f7f2ae0, 0x7f7f2af0) 
...................................................................... = 0
                    vec.sv_handler: 0x1
                       vec.sv_mask: EMPTY SET
                      vec.sv_flags: SV_RESETHAND
                   ovec.sv_handler: 0x40004e02
                      ovec.sv_mask: EMPTY SET
                     ovec.sv_flags: SV_RESETHAND
1090356167.371770 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356167.371928 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356169.380105 select(7, NULL, 0x7f7f2b30, NULL, 0x7f7f2b28) 
................................................................ [sleeping]
                              nfds: 7
                           readfds: NULL
                          writefds: 6
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356219.279374 select(2, NULL, 0x7f7f3e20, NULL, 0x7f7f402c) 
................................................................ = 0
                              nfds: 2
                           readfds: NULL
                          writefds: EMPTY
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356221.289416 select(2, NULL, 0x7f7f3e20, NULL, 0x7f7f402c) 
................................................................ [sleeping]
                              nfds: 2
                           readfds: NULL
                          writefds: 1
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356227.341296 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) 
................................................................ = 0
                              nfds: 6
                           readfds: NULL
                          writefds: EMPTY
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356227.369226 select(7, NULL, 0x7f7f2b30, NULL, 0x7f7f2b28) 
................................................................ = 0
                              nfds: 7
                           readfds: NULL
                          writefds: EMPTY
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356227.369451 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356229.380243 select(7, NULL, 0x7f7f2b30, NULL, 0x7f7f2b28) 
................................................................ [sleeping]
                              nfds: 7
                           readfds: NULL
                          writefds: 6
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356279.279880 select(2, NULL, 0x7f7f3e20, NULL, 0x7f7f402c) 
................................................................ = 0
                              nfds: 2
                           readfds: NULL
                          writefds: EMPTY
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356281.288756 select(2, NULL, 0x7f7f3e20, NULL, 0x7f7f402c) 
................................................................ [sleeping]
                              nfds: 2
                           readfds: NULL
                          writefds: 1
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356287.338591 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) 
................................................................ = 0
                              nfds: 6
                           readfds: NULL
                          writefds: EMPTY
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356287.368558 select(7, NULL, 0x7f7f2b30, NULL, 0x7f7f2b28) 
................................................................ = 0
                              nfds: 7
                           readfds: NULL
                          writefds: EMPTY
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356287.368785 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
1090356289.378649 select(7, NULL, 0x7f7f2b30, NULL, 0x7f7f2b28) 
................................................................ [sleeping]
                              nfds: 7
                           readfds: NULL
                          writefds: 6
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356339.278047 select(2, NULL, 0x7f7f3e20, NULL, 0x7f7f402c) 
................................................................ = 0
                              nfds: 2
                           readfds: NULL
                          writefds: EMPTY
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356341.288098 select(2, NULL, 0x7f7f3e20, NULL, 0x7f7f402c) 
................................................................ [sleeping]
                              nfds: 2
                           readfds: NULL
                          writefds: 1
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356347.337933 select(6, NULL, 0x7f7f0e60, NULL, 0x7f7f106c) 
................................................................ = 0
                              nfds: 6
                           readfds: NULL
                          writefds: EMPTY
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356347.367891 select(7, NULL, 0x7f7f2b30, NULL, 0x7f7f2b28) 
................................................................ = 0
                              nfds: 7
                           readfds: NULL
                          writefds: EMPTY
                          errorfds: NULL
                    timeout.tv_sec: 60
                   timeout.tv_usec: 0
1090356347.368116 write(6, "1c\0\0\td a t a   r e c v   3 2 ".., 32) 
........................................................... ERR#11 EAGAIN
( Terminating process 18585 ("/tmp/rsync -avvvvv file1.db /var/opt/ignite") 
)



More information about the rsync mailing list