Speeding up rsync

hancooper hancooper at protonmail.com
Tue Aug 24 21:12:35 UTC 2021


‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
On Tuesday, August 24, 2021 8:25 PM, Kevin Korb via rsync <rsync at lists.samba.org> wrote:

> In my experience backing up multiple hosts to a single host can speed
> things up. Especially if using rsync over ssh with multiple CPUs on the
> single host. You would need to do some experimentation to determine the
> best number for your hardware and network. Also, if you exceed that
> number you can put more stress on the backup machine lessening the
> impact to the hosts being backed up.
>
> On 8/24/21 3:58 PM, hancooper via rsync wrote:
>
> > It makes sense to we to run multiple rsync commands to speed up a backup.
> > At work, some have argued that if I sync the data all to the same host,
> > there is no advantage
> > in parallelization.   Whether you sync 3x 1G in parallel or 1x 3G makes
> > no noticeable difference.
> > Speed in general does not increase by increasing the number of sync
> > processes.
> > However, if one want to sync to multiple hosts, the effort may be
> > worthwhile.
> > What is the current advice about speeding up data transfer ?
>
> --
> Kevin Korb Phone: (407) 252-6853


Hi Kevin.  What about a single host to another with multiple CPU's ?



More information about the rsync mailing list