Long time needed for "Building file list" Any suggestions ?
ml-it-rsync at epigenomics.com
Wed Jul 7 13:00:50 GMT 2004
On Mon, 22 Mar 2004 12:42:58 +0000 (UTC),
"Hergaarden, Marcel" <Marcel.Hergaarden at Getronics.com> wrote:
> It takes about 2 hours to create only the file list.
We have a similar problem as we are running dirvish to produce nightly
live backups. The file list building process takes too long.
I have noticed that building the file list is not done in parallel on
the remote host and the local host. Wouldn't that be an option to speed
up the process?
Build the file list in parallel on the source side and the destination
side (there are already two rsync processes running anyway) and compare
the outcome when both have finished. This could easily reduce the time
needed before actually syncing by a factor of 2.
Are there any ideas in this direction?
Manager Epigenomics AG
Information Systems www.epigenomics.com Kastanienallee 24
+493024345330 10435 Berlin
BOFH excuse #117:
the printer thinks its a router.
More information about the rsync