rsync efficiency

Marcelo Leal diversos at posix.brte.com.br
Fri Sep 19 19:40:05 GMT 2008


 Hello all,
 I have a doubt that i think you hackers of rsync has the answer. ;-)
 I have make this post on my blog:
 http://www.posix.brte.com.br/blog/?p=312
 to start a serie about the copy-on-write semantics of ZFS. In my test
"VI" did rewrite the whole file just for change 3 bytes, so the whole
file was reallocated.
 What i want to know from you is about the techniques used by rsync
(and about other softwares that you know), for change a few bytes in
the middle of a big file. Can be a simple question for you, but i
really think how rsync can change 18k inside a 1gb file, without
rewrite the whole file (or a lot of indirect blocks).
 If we are talking about a SO without copy-on-write filesystem, maybe
we can rewrite just that block (??), but in ZFS for example, if we
have a 128K block, and we need to add 10k, that change will propagate
to the whole tree of blocks, right?
 And i think rsync like many softwares, create a temporary file on the
destination, and the whole file is rewriten locally, just the changes
over the wire. Is that right?
 The question is: There is a efficient/safe way to change 10k of data
in a 1gb file, whithout a lot of rewrites? rsync uses some technique
for that, or is totally dependent on the filesystem?

 Thanks a lot!

-- 

[http://www.posix.brte.com.br/blog]
--------==== pOSix rules ====-------


More information about the rsync mailing list