how to migrate 40T data and 180M files

Jan-Benedict Glaw jbglaw at
Tue Aug 11 03:31:02 MDT 2009

On Tue, 2009-08-11 10:58:15 +0200, Michal Suchanek <hramrach at> wrote:
> 2009/8/11 Jan-Benedict Glaw <jbglaw at>:
> > On Tue, 2009-08-11 16:14:33 +0800, Ming Gao <gaomingcn at> wrote:
> > > I need to migrate 40T data and 180M files from one storage device to another
> > > one, both source and destination will be NFS and mounted to a local suse
> > > linux box.
> >
> > There are no specific risks these days I think, but it sounds like
> > this is a task like "copy over anything", so it's merely mount both
> > filesystems and use two `tar' instances with a pipe in between...
> >
> .. except it will take forever and is not restartable.

In a copy-once scenario, you can only saturate your bandwidth once.
Rsync cannot really make it faster.

> I'm not sure that the possibility to restart the rsync run after, say,
> a network outage is really an advantage, though. Finding out what's
> already transferred and transferring the rest takes about the same
> time as doing a full transfer.

That's indeed the question.  Rsync is a really good program to
synchronize files, but it's not a /better/ backup program. (Though it
is as good as others.)


      Jan-Benedict Glaw      jbglaw at              +49-172-7608481
Signature of: 23:53 <@jbglaw> So, ich kletter' jetzt mal ins Bett.
the second  : 23:57 <@jever2> .oO( kletter ..., hat er noch Gitter vorm Bett, wie früher meine Kinder?)
              00:00 <@jbglaw> jever2: *patsch*
              00:01 <@jever2> *aua*, wofür, Gedanken sind frei!
              00:02 <@jbglaw> Nee, freie Gedanken, die sind seit 1984 doch aus!
              00:03 <@jever2> 1984? ich bin erst seit 1985 verheiratet!
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 197 bytes
Desc: Digital signature
URL: <>

More information about the rsync mailing list