Is rsync copying over the entire file? Sent bytes matches actual file size.

Administrator Administrator at letterpart.com
Wed Oct 29 09:45:21 GMT 2008


Hi,

I am testing rsync and it looks as though it is copying over the entire
file which doesn't sound right.

System: Windows 2003

Rsync.exe
cygpopt-0.dll
cygwin1.dll

I have just tested rsync with a 571Mb zip file containing our Backup
Exec installation source.

The command I am running is:

rsync -avp --delete --progress --stats /cygdrive/c/rsync_test/
"/cygdrive/Y/" > rsync_log.txt

First I copied the file BackUpExec-11D.7170_32BIT_VERSION.zip into both
source and target and ran an rsysnc (I didn't have the progress or stats
switches on the first run).

This is what my log shows:

building file list ... 
 0 files...
2 files to consider
./

Number of files: 2
Number of files transferred: 0
Total file size: 584742597 bytes
Total transferred file size: 0 bytes
Literal data: 0 bytes
Matched data: 0 bytes
File list size: 118
File list generation time: 0.002 seconds File list transfer time: 0.000
seconds Total bytes sent: 146 Total bytes received: 32

sent 146 bytes  received 32 bytes  356.00 bytes/sec total size is
584742597  speedup is 3285070.77



Then I opened up the zip and added a few extra words to a css file and
then ran another rsync.

This is the output I received (with the progress and stas switches).

building file list ... 
 0 files...
2 files to consider
./
BackUpExec-11D.7170_32BIT_VERSION.zip
       32768   0%    0.00kB/s    0:00:00
    16482304   2%   15.67MB/s    0:00:35
    32735232   5%   15.59MB/s    0:00:34
    50429952   8%   16.02MB/s    0:00:32
    66846720  11%   15.93MB/s    0:00:31
    81887232  14%   15.59MB/s    0:00:31
    98074624  16%   15.57MB/s    0:00:30
   110133248  18%   14.14MB/s    0:00:32
   118128640  20%   12.14MB/s    0:00:37
   135299072  23%   12.64MB/s    0:00:34
   149061632  25%   12.07MB/s    0:00:35
   164102144  28%   12.85MB/s    0:00:31
   181764096  31%   15.16MB/s    0:00:25
   198770688  33%   15.12MB/s    0:00:24
   216334336  36%   16.02MB/s    0:00:22
   235372544  40%   16.98MB/s    0:00:20
   244023296  41%   14.83MB/s    0:00:22
   263716864  45%   15.48MB/s    0:00:20
   280264704  47%   15.24MB/s    0:00:19
   297828352  50%   14.79MB/s    0:00:18
   316997632  54%   17.28MB/s    0:00:15
   333611008  57%   16.53MB/s    0:00:14
   349667328  59%   16.42MB/s    0:00:13
   364249088  62%   15.82MB/s    0:00:13
   381976576  65%   15.47MB/s    0:00:12
   394887168  67%   14.59MB/s    0:00:12
   413597696  70%   15.22MB/s    0:00:10
   429490176  73%   15.54MB/s    0:00:09
   446267392  76%   15.31MB/s    0:00:08
   464551936  79%   16.59MB/s    0:00:07
   476577792  81%   15.00MB/s    0:00:07
   495681536  84%   15.77MB/s    0:00:05
   511803392  87%   15.62MB/s    0:00:04
   529793024  90%   15.55MB/s    0:00:03
   546209792  93%   16.60MB/s    0:00:02
   563937280  96%   16.27MB/s    0:00:01
   581697536  99%   16.66MB/s    0:00:00
   584742598 100%   15.39MB/s    0:00:36  (1, 100.0% of 2)


   
Number of files: 2
Number of files transferred: 1
Total file size: 584742598 bytes
Total transferred file size: 584742598 bytes
Literal data: 584742598 bytes
Matched data: 0 bytes
File list size: 118
File list generation time: 0.002 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 584814160
Total bytes received: 48
sent 584814160 bytes  
received 48 bytes  
15595045.55 bytes/sec
total size is 584742598  



This looks to me as though it is transferring the entire file as the
sent bytes is 584814160 and I am now confused as it should have only
transferred the changes in the zip file, although it does say that it
only received 48 bytes.

Am I reading this wrong?

Thanks for your help.




More information about the rsync mailing list