timeout error in rsync-2.5.5
Alberto Accomazzi
aaccomazzi at cfa.harvard.edu
Mon May 6 09:51:01 EST 2002
Dave,
I understand how the timeout works. The problem here is that the traversing
of the directory tree on the client side does indeed take more than 1 hour,
during which no bytes are exchanged on the wire between client and server.
So I do know for a fact that the read call on the server side needs a very
long timeout because the client has to traverse a directory tree of 1.5
million files stored on a slow external drive. The question is why does
the server process give up after 66 minutes or so even though the timeout
has been set to 5 hourse (see the system call). The client machine is
now behind a firewall which I guess complicates things a bit, but from what
I can tell there is nothing on the LAN that forces the connection to be
dropped; I have checked the firewall settings to no avail.
Anyone other ideas?
-- Alberto
P.S. Sorry, but neither one of the machines can be accessed from the
outside.
In message <20020503214117.GE10314 at lucent.com>, Dave Dykstra writes:
> You shouldn't need to have such a long timeout. The timeout is not over
> the whole length of the run, only the time since the last data was
> transferred. It's a mystery to me why it quits after 66 minutes rather
> than 5 hours, but the real question is why it stops transferring data for
> so long. Perhaps something went wrong with the network. I can't connect
> to that server to try it, perhaps it is behind a firewall.
>
> - Dave Dykstra
>
> On Tue, Apr 16, 2002 at 12:36:03PM -0400, Alberto Accomazzi wrote:
> >
> > Dear all,
> >
> > I've been trying to track down a problem with timeouts when pulling data from
> > an rsync daemon and I have now run out of any useful ideas.
> > The problem manifests itself when I try to transfer a large directory tree
> > on a slow client machine. What happens then is that the client rsync process
> > successfully receives the list of files from the server, then begins checking
> > the local directory tree, taking its sweet time. Since I know that the process
> > is quite slow, I invoke rsync with a timeout of 5 hours to avoid dropping the
> > connection. Howerver, after a little over 1 hour (usually 66 minutes or so),
> > the server process simply gives up.
> >
> > I have verified the problem under rsync versions 2.3.2, and 2.4.6 and up
> > (including 2.5.5), testing a few different combinations of client/server
> > versions (althoug the client is always a linux box and the server always
> > a solaris box). It looks to me as if something kicks the server out of
> > the select() call at line 202 of io.c (read_timeout) despite the timeout
> > being correctly set to 18000 seconds. Can anybody think of what the
> > problem may be? See all the details below.
> >
> > Thanks,
> >
> > -- Alberto
> >
> >
> >
> > CLIENT:
> >
> > [ads at ads-pc ~]$ rsync --version
> > rsync version 2.5.5 protocol version 26
> > Copyright (C) 1996-2002 by Andrew Tridgell and others
> > <http://rsync.samba.org/>
> > Capabilities: 64-bit files, socketpairs, hard links, symlinks, batchfiles,
> > IPv6, 64-bit system inums, 64-bit internal inums
> >
> > rsync comes with ABSOLUTELY NO WARRANTY. This is free software, and you
> > are welcome to redistribute it under certain conditions. See the GNU
> > General Public Licence for details.
> >
> > [ads at ads-pc ~]$ rsync -ptv --compress --suffix .old --timeout 18000 -r --de
lete rsync://adsfore.harvard.edu:1873/text-4097/. /mnt/fwhd0/abstracts/phy/text
/
> > receiving file list ... done
> > rsync: read error: Connection reset by peer
> > rsync error: error in rsync protocol data stream (code 12) at io.c(162)
> > rsync: connection unexpectedly closed (17798963 bytes read so far)
> > rsync error: error in rsync protocol data stream (code 12) at io.c(150)
> >
> >
> > SERVER:
> >
> > adsfore-15: /proj/ads/soft/utils/src/rsync-2.5.5/rsync --version
> > rsync version 2.5.5 protocol version 26
> > Copyright (C) 1996-2002 by Andrew Tridgell and others
> > <http://rsync.samba.org/>
> > Capabilities: 64-bit files, socketpairs, hard links, symlinks, batchfiles,
> > no IPv6, 64-bit system inums, 64-bit internal inums
> >
> > rsync comes with ABSOLUTELY NO WARRANTY. This is free software, and you
> > are welcome to redistribute it under certain conditions. See the GNU
> > General Public Licence for details.
> >
> > from the log file:
> >
> > 2002/04/16 08:52:48 [18996] rsyncd version 2.5.5 starting, listening on por
t 1873
> > 2002/04/16 09:39:01 [988] rsync on text-4097/. from ads-pc (131.142.43.117)
> > 2002/04/16 10:51:36 [988] rsync: read error: Connection timed out
> > 2002/04/16 10:51:36 [988] rsync error: error in rsync protocol data stream
(code 12) at io.c(162)
> >
> > from a truss:
> >
> > adsfore-14: truss -d -p 988
> > Base time stamp: 1018964639.2848 [ Tue Apr 16 09:43:59 EDT 2002 ]
> > poll(0xFFBE4E90, 1, 18000000) (sleeping...)
> > 4057.4093 poll(0xFFBE4E90, 1, 18000000) = 1
> > 4057.4098 read(3, 0xFFBE5500, 4) Err#145 ETI
MEDOUT
> > 4057.4103 time() = 101896869
6
> > 4057.4106 getpid() = 988 [1899
6]
> > 4057.4229 write(4, " 2 0 0 2 / 0 4 / 1 6 1".., 66) = 66
> > 4057.4345 sigaction(SIGUSR1, 0xFFBE4D20, 0xFFBE4DA0) = 0
> > 4057.4347 sigaction(SIGUSR2, 0xFFBE4D20, 0xFFBE4DA0) = 0
> > 4057.4349 time() = 101896869
6
> > 4057.4350 getpid() = 988 [1899
6]
> > 4057.4352 write(4, " 2 0 0 2 / 0 4 / 1 6 1".., 98) = 98
> > 4057.4357 llseek(0, 0, SEEK_CUR) = 0
> > 4057.4359 _exit(12)
> >
> >
> > ***************************************************************************
*
> > Alberto Accomazzi mailto:aaccomazzi at cfa.harvard.ed
u
> > NASA Astrophysics Data System http://adsabs.harvard.ed
u
> > Harvard-Smithsonian Center for Astrophysics http://cfawww.harvard.ed
u
> > 60 Garden Street, MS 83, Cambridge, MA 02138 USA
> > ***************************************************************************
*
> >
> > --
> > To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/r
sync
> > Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
****************************************************************************
Alberto Accomazzi mailto:aaccomazzi at cfa.harvard.edu
NASA Astrophysics Data System http://adsabs.harvard.edu
Harvard-Smithsonian Center for Astrophysics http://cfawww.harvard.edu
60 Garden Street, MS 83, Cambridge, MA 02138 USA
****************************************************************************
More information about the rsync
mailing list