synchronizing 4617 files (out of 1538823)

Jon Drukman jsd at cluttered.com
Sat Aug 9 04:30:22 EST 2003


i have a list of files relative to a docroot that need to be synchronized.
example:

pc/action/apocalyptica/wrapper_gslive.html
pc/action/apocalyptica/wrapper_gslive_ice.html
pc/action/apocalyptica/wrapper_ice.html
pc/rpg/darkageofcamelot/buyit_unit.html
pc/rpg/darkageofcamelot/buyit_unit_ice.html

the actual docroot has 1538823 files.  building the file list takes a very
long time.  i would like rsync to only consider the 4617 files listed in the
file.

i've tried:

rsync -Re ssh --include-from=/tmp/paths.txt docroot ww1:/var/httpd/htdocs

it says "skipping directory docroot" and nothing happens.

i tried this:

rsync -Re ssh `cat /tmp/paths.txt` ww1:/var/httpd/htdocs

it returned:

/usr/bin/rsync: Argument list too long.

the only way i got it to work was to do this:

rsync -ave ssh --include '*/' --include-from=/tmp/paths.txt --exclude '*'
docroot ww1:/var/httpd/htdocs

this takes a very very long time to run.

is there a fast way to do this?

-jsd-






More information about the rsync mailing list