rsync of big image files from virtual hosts takes lot of time
bernd.lentes at helmholtz-muenchen.de
Sun Oct 21 12:35:53 UTC 2018
----- Am 20. Okt 2018 um 20:05 schrieb rsync ML rsync at lists.samba.org:
> I don't see any --stats output. It will tell you exactly how much data
> was involved.
> A local copy means that rsync isn't networking. Rsync speeds things up
> by running on 2 separate computers and communicating using the rsync
> protocol. If you are running rsync on a single computer with the source
> being a mounted SAN volume and the target being a mounted cifs share
> then as far as rsync is concerned that is a local copy.
> So, either get the cifs server to speak rsync (either over ssh or with
> rsyncd) or just use cp. Only copying the changes isn't all that helpful
> when rsync has to read the whole target file over the network just to
> find out what is different about it. That is why --whole-file is
> implied when rsync isn't networking.
> On 10/20/2018 02:00 PM, Lentes, Bernd via rsync wrote:
This is the output with --stats for a 50GB image.
Appended also the output from time.
You see it's horrible slow.
I will try cp.
Literal data: 187,432,960 bytes
Matched data: 53,499,658,240 bytes
File list size: 0
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 189,111,658
Total bytes received: 3,277,035
sent 189,111,658 bytes received 3,277,035 bytes 6,493.15 bytes/sec
total size is 53,687,091,200 speedup is 279.06
Helmholtz Zentrum Muenchen
Deutsches Forschungszentrum fuer Gesundheit und Umwelt (GmbH)
Ingolstaedter Landstr. 1
Stellv.Aufsichtsratsvorsitzender: MinDirig. Dr. Manfred Wolter
Geschaeftsfuehrer: Prof. Dr. med. Dr. h.c. Matthias Tschoep, Heinrich Bassler, Dr. rer. nat. Alfons Enhsen
Registergericht: Amtsgericht Muenchen HRB 6466
USt-IdNr: DE 129521671
More information about the rsync