Huge directory tree: Get files to sync via tools like sysdig
ben.rubson at gmail.com
Thu Feb 9 15:21:37 UTC 2017
> On 09 Feb 2017, at 16:10, Thomas Güttler <guettliml at thomas-guettler.de> wrote:
> Am 09.02.2017 um 11:05 schrieb Ben RUBSON:
>>> On 09 Feb 2017, at 10:05, Thomas Güttler <guettliml at thomas-guettler.de> wrote:
>>> we have a huge directory tree.
>>> * 17M files (number of files)
>>> * 2.2TBytes of data.
>>> * Only 0.1% changes per day
>>> Current pain: rsyncs directory tree traversal needs to long to discover the changed files.
>> On which type of FS is this directory ?
Any way to prefer snapshots in your backup strategy ?
Or to use a ZFS ready OS to benefit from a SSD cache (which would store your metadata) ?
More information about the rsync