Very surprising behaviour with --files-from

Steven Levine steve53 at
Fri Dec 10 14:40:04 MST 2010

In <20101210171139.GD27025 at>, on 12/10/10
   at 09:11 AM, Robin Lee Powell <rlpowell at> said:


>$ rsync -i -aPv --ignore-existing --files-from=/tmp/list /backups/
>ut00-s00010:/backups/ building file list ...
>3937 files to consider

>That's not such a big deal, but the list I'm *actually* using has twenty
>*million* files in it.  At a couple hundred files a second, if it's going
>to check 4 times the number of files, that's a *huge* time waste.  What's
>going on?

I'm not quite sure what's going on either.  What I recommend is cut your
list down to 1 file and use

  rsync -ii -aPv --ignore-existing --files-from=/tmp/list \
        /backups/ ut00-s00010:/backups

If this does not answer the question add one more -v.


"Steven Levine" <steve53 at>  eCS/Warp/DIY etc.

More information about the rsync mailing list