Cache file list in daemon mode?

Peter Scott Peter at PSDT.com
Fri Aug 3 13:28:38 MDT 2012


On 8/2/2012 7:30 PM, Jason Haar wrote:
> So what you're really saying is gluster is quite slow at doing recursive
> directory listings, so how about just using "find" on the real backend
> bricks to find the files that have changed since last run, merge those
> listings together (to get rid of dupes) and then get rsync to just
> update those against the gluster service?
>
Yes, that's pretty much the solution we're converging on.  It's probably 
20 lines max*, most of which is anticipating race conditions, but I'm 
congenitally lazy* and thought I might not be the first person with 
these requirements - not getting as specific as Gluster, for sure, but 
still with enough files and slowness on the target to raise the question 
of why not operate in some sort of incremental mode.  I dislike having 
to think of every possible race condition.

* = Perl



More information about the rsync mailing list