full upload happening even though only a timestamp has changed
jw schultz
jw at pegasys.ws
Tue Apr 22 12:25:35 EST 2003
On Tue, Apr 22, 2003 at 12:18:28PM +1000, Donovan Baarda wrote:
> On Tue, 2003-04-22 at 11:32, Tom Goulet wrote:
> > > There is a known problem with files of this size where block
> > > checksums fail on the first pass. When that happens there is
> > > a message that would look something like "redoing
> > > filename(1524)" in stdout. It is possible you are
> > > encountering this problem and -P is hiding it. Try
> [...]
> > I had run the touch command on the Knoppix ISO file like I did in the
> > original post in this thread. Rsync is definitely uploading the Knoppix
> > ISO again:
> > -rw------- 1 tomg users 146636800 Apr 21 19:20 .KNOPPIX_V3.2-2003-04-18-EN.iso.FFb9TM
> > -rw-r--r-- 1 tomg users 729716736 Apr 21 18:33 KNOPPIX_V3.2-2003-04-18-EN.iso
> >
> > So, are you convinced I have found a bug yet?
>
> No... this does not mean it is "downloading" it again, just that it is
> "rsyncing it again". Usually this means it is just getting a list of
> "block not changed" commands from upstream and copying the file.
>
> However, from the "wrote 731164664 bytes" it looks like you might have
> hit the known problem jw mentioned. The workaround for this is to use a
> sufficiently large block size. Try using -B 65536.
>
> BTW, how fast is the connection? 700M in 11 minutes is pretty fast. 10M
> ethernet?
It looks like something is off. I looked at his -vv stdout
and it doesn't have the "redo" message but the stats
| total: matches=0 tag_hits=0 false_alarms=0 data=729716736
| wrote 731164664 bytes read 36 bytes 1027638.37 bytes/sec
| total size is 5240249974 speedup is 7.17
i think indicate something is off.
--
________________________________________________________________
J.W. Schultz Pegasystems Technologies
email address: jw at pegasys.ws
Remember Cernan and Schmitt
More information about the rsync
mailing list