rsycing very small files

[Eberhard Moenkeberg]

Hi,

On Sat, 28 Feb 2009, lewis butler wrote:
> On 27-Feb-2009, at 21:16, Daniel.Li wrote:
> > On Fri, 2009-02-27 at 08:20 -0500, Mag Gam wrote:

> > >it works. But takes hours to do it. Was wondering if there was a faster way
> >
> >How much speed do u get to backup these files? Average?
> 
> I would thing that rsync 3.x would make a large difference on the speed.  Are
> you using 2.6.9 or something?

Even with rsync-2.6.8 (SUSE SLES10) I see:

Number of files: 5599821
Number of files transferred: 1164
Total file size: 4409434193460 bytes
Total transferred file size: 2062944264 bytes
Literal data: 1729055258 bytes
Matched data: 333889006 bytes
File list size: 180403610
File list generation time: 2121.930 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 2083653
Total bytes received: 1910410098

sent 2083653 bytes  received 1910410098 bytes  279175.79 bytes/sec
total size is 4409434193460  speedup is 2305.59
==== end   ======== RC=0 ============ 090228.2127 090228.2331

with a duration of 2 hours 4 minutes.


Viele Grüße
Eberhard Mönkeberg (emoenke at gwdg.de, em at kki.org)

-- 
Eberhard Mönkeberg
Arbeitsgruppe IT-Infrastruktur
E-Mail: emoenke at gwdg.de      Tel.: +49 (0)551 201-1551
-------------------------------------------------------------------------
Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen (GWDG)
Am Fassberg 11, 37077 Göttingen
URL:    http://www.gwdg.de             E-Mail: gwdg at gwdg.de
Tel.:   +49 (0)551 201-1510            Fax:    +49 (0)551 201-2150
Geschäftsführer:           Prof. Dr. Bernhard Neumair
Aufsichtsratsvorsitzender: Dipl.-Kfm. Markus Hoppe
Sitz der Gesellschaft:     Göttingen
Registergericht:           Göttingen  Handelsregister-Nr. B 598
-------------------------------------------------------------------------