HP-UX 11i and largefiles on rsync 2.6.2

Thu Jul 22 20:27:57 GMT 2004

I started rsync as follows:

server2 # ./rsync  -a --progress --stats file1.db /var/opt/ignite
building file list ...
1 file to consider
file1.db
1951039488  45%    4.40MB/s    0:08:420:14:56
rsync: writefd_unbuffered failed to write 32768 bytes: phase "unknown": 
Broken pipe (32)
rsync error: error in rsync protocol data stream (code 12) at io.c(900)

There are always 3 rsync processes running during a sync.

Attaching to the first one stopped the transfer after a breakpoint was set. 
Attaching to the second one yeilded more results.

server2 # ./gdb ./rsync 14039
HP gdb 2.1
Copyright 1986 - 1999 Free Software Foundation, Inc.
Hewlett-Packard Wildebeest 2.1 (based on GDB 5.0-hpwdb-20000630)
Wildebeest is free software, covered by the GNU General Public License, and
you are welcome to change it and/or distribute copies of it under certain
conditions.  Type "show copying" to see the conditions.  There is
absolutely no warranty for Wildebeest.  Type "show warranty" for details.
Wildebeest was built for PA-RISC 1.1 or 2.0 (narrow), HP-UX 11.00.
..
/archive1/14039: No such file or directory.
Attaching to program: /archive1/./rsync, process 14039
Reading symbols from /usr/lib/libc.2...done.
Reading symbols from /usr/lib/libdld.2...done.

warning: reading `r3' register: No data
0xc020ccd0 in _select_sys () from /usr/lib/libc.2
(gdb) break  exit_cleanup
Breakpoint 1 (deferred) at "exit_cleanup" ("exit_cleanup" was not found).
Breakpoint deferred until a shared library containing "exit_cleanup" is 
loaded.
(gdb) bt
#0  0xc020ccd0 in _select_sys () from /usr/lib/libc.2
#1  0xc0218198 in select () from /usr/lib/libc.2
#2  0x2341c in writefd_unbuffered (fd=4, buf=0x40083238 "", len=32768) at 
io.c:863
#3  0x2398c in writefd (fd=4, buf=0x40083238 "", len=32768) at io.c:972
#4  0x23d58 in write_buf (f=4, buf=0x40083238 "", len=32768) at io.c:1034
#5  0x25fb0 in simple_send_token (f=4, token=-2, buf=0x4000af10, 
offset=136511488, n=32768) at token.c:104
#6  0x26db4 in send_token (f=4, token=-2, buf=0x4000af10, offset=136511488, 
n=32768, toklen=0) at token.c:472
#7  0x152c0 in matched (f=4, s=0x4000aee8, buf=0x4000af10, offset=136544256, 
i=-2) at match.c:113
#8  0x16248 in match_sums (f=4, s=0x4000aee8, buf=0x4000af10, 
len=4304863232) at match.c:345
#9  0xc280 in send_files (flist=0x4000bef0, f_out=4, f_in=5) at sender.c:232
#10 0x12b10 in client_run (f_in=5, f_out=4, pid=14040, argc=1, 
argv=0x4000aa00) at main.c:666
#11 0x136d0 in start_client (argc=1, argv=0x4000aa00) at main.c:924
#12 0x13c74 in main (argc=2, argv=0x4000aa00) at main.c:1110
(gdb) quit
The program is running.  Quit anyway (and detach it)? (y or n) y
Detaching from program: /archive1/./rsync, process 14039
server2 #  ps -ef | grep rsync
    root 14040 14039  0 16:16:10 pts/td    0:00 ./rsync -a --progress 
--stats file1.db /var/opt/ignite
    root 14041 14040 123 16:16:10 pts/td    0:17 ./rsync -a --progress 
--stats file1.db /var/opt/ignite
    root 14039 13021 121 16:16:10 pts/td    0:17 ./rsync -a --progress 
--stats file1.db /var/opt/ignite
server2 # ./gdb ./rsync 14040
HP gdb 2.1
Copyright 1986 - 1999 Free Software Foundation, Inc.
Hewlett-Packard Wildebeest 2.1 (based on GDB 5.0-hpwdb-20000630)
Wildebeest is free software, covered by the GNU General Public License, and
you are welcome to change it and/or distribute copies of it under certain
conditions.  Type "show copying" to see the conditions.  There is
absolutely no warranty for Wildebeest.  Type "show warranty" for details.
Wildebeest was built for PA-RISC 1.1 or 2.0 (narrow), HP-UX 11.00.
..
/archive1/14040: No such file or directory.
Attaching to program: /archive1/./rsync, process 14040
Reading symbols from /usr/lib/libc.2...done.
Reading symbols from /usr/lib/libdld.2...done.

warning: reading `r3' register: No data
0xc020ccd0 in _select_sys () from /usr/lib/libc.2
(gdb)  break  exit_cleanup
Breakpoint 1 (deferred) at "exit_cleanup" ("exit_cleanup" was not found).
Breakpoint deferred until a shared library containing "exit_cleanup" is 
loaded.
(gdb)  bt
#0  0xc020ccd0 in _select_sys () from /usr/lib/libc.2
#1  0xc0218198 in select () from /usr/lib/libc.2
#2  0x2202c in read_timeout (fd=4, buf=0x7f7f1d00 "", len=4) at io.c:421
#3  0x22984 in read_loop (fd=4, buf=0x7f7f1d00 "", len=4) at io.c:619
#4  0x217f0 in read_msg_fd () at io.c:220
#5  0x21c50 in get_redo_num () at io.c:308
#6  0x8c64 in generate_files (f_out=1, flist=0x4000bef0, local_name=0x0) at 
generator.c:588
#7  0x123d8 in do_recv (f_in=0, f_out=1, flist=0x4000bef0, local_name=0x0) 
at main.c:502
#8  0x12738 in do_server_recv (f_in=0, f_out=1, argc=1, argv=0x7f7f06d4) at 
main.c:578
#9  0x12898 in start_server (f_in=0, f_out=1, argc=2, argv=0x7f7f06d0) at 
main.c:609
#10 0x12790 in child_main (argc=2, argv=0x7f7f06d0) at main.c:585
#11 0x2e0c8 in local_child (argc=2, argv=0x7f7f06d0, f_in=0x7f7f0668, 
f_out=0x7f7f066c,
    child_main=0x40004df2 <child_main>) at pipe.c:153
#12 0x11b7c in do_cmd (cmd=0x0, machine=0x0, user=0x0, path=0x4000aed0 
"/var/opt/ignite", f_in=0x7f7f0668,
    f_out=0x7f7f066c) at main.c:319
#13 0x13664 in start_client (argc=1, argv=0x4000aa00) at main.c:911
#14 0x13c74 in main (argc=2, argv=0x4000aa00) at main.c:1110

Is that what you were looking for?

Don

--------------------
>From: Wayne Davison <wayned at samba.org>
>To: Don Malloy <nixuser23 at hotmail.com>
>CC: rsync at lists.samba.org
>Subject: Re: HP-UX 11i and largefiles on rsync 2.6.2
>Date: Thu, 22 Jul 2004 09:17:29 -0700
>
>On Wed, Jul 21, 2004 at 02:21:27PM -0400, Don Malloy wrote:
> > Hopefully this is of more help to you.
>
>Unfortunately I haven't been able to get rsync to fail in the update of
>a large file, and the system call trace you provided didn't tell me
>anything helpful in narrowing down what is going wrong.  Could you
>attach a debugger to the halting rsync while it is running, tell it to
>continue, and get a backtrace of where it dies?  (e.g.  "gdb rsync 1234"
>where the 1234 is the process id, set a breakpoint on "exit_cleanup",
>tell it to continue and note the output of "bt").
>
>..wayne..

_________________________________________________________________
MSN Premium helps eliminate e-mail viruses. Get 2 months FREE*  
http://join.msn.com/?pgmarket=en-ca&page=byoa/prem&xAPID=1994&DI=1034&SU=http://hotmail.com/enca&HL=Market_MSNIS_Taglines