Rsync mirroring interacting with compression

James McNeill james at
Thu Nov 28 10:47:29 EST 2002

| Is there a more rsync-friendly compression available?

The nature of compressed files (IME) is that because they work with so many
patterns, small alterations can cause either small changes, or large
changes, unpredicably to the final zipped output.

One way to make a rsync friendly archive file is this:

tar the files into an archive
tar the archive into smaller chunks of equal size**
gzip the chunks individually
tar the zipped chunks back together

** by changing the no. of chunks you will be able to vary the usefulness of
the file. ie. smaller chunks = bigger file (worse compression) but better
and vice versa.

If bandwidth is the biggest concern, why not copy the file uncompressed and
recompress it after rsync has done it's thing. ie. will only copy changes.


More information about the linux mailing list