[Bug 13913] New: sync a folder with large amount of files

samba-bugs at samba.org samba-bugs at samba.org
Thu Apr 25 12:43:56 UTC 2019


https://bugzilla.samba.org/show_bug.cgi?id=13913

            Bug ID: 13913
           Summary: sync a folder with large amount of files
           Product: rsync
           Version: 3.1.3
          Hardware: All
                OS: All
            Status: NEW
          Severity: normal
          Priority: P5
         Component: core
          Assignee: wayne at opencoder.net
          Reporter: bugzilla.samba.org at jfa.knudsen.ovh
        QA Contact: rsync-qa at samba.org

I tried to rsync a folder with 323,187 files in it.
I sync from osx to linux (NAS Synology). Both side is rsync v3.1.2 compiled by
myself. On the NAS, original rsync is 3.0.9.

Rsync 3.1.2 hangs at around 295,000 files.
If I use exclusion to go under that number, it works.
If I add --protocol=30, it doesn't work.
If I add --delay-updates, it works.
If I use the original Synology rsync (not using rsync-path), it works (without
--delay-updates).
If I increase ulimit on linux (sudo sysctl -w fs.file-max=25000), it doesn't
work.

NOTE : when I say it hangs after 295,000 files, I mean : I executed rsync with
-v -v -v and then I got approx 295,000 lines of :
[sender] make_file(bands/8725,*,2)
[sender] make_file(bands/8726,*,2)
[sender] make_file(bands/8727,*,2)
[sender] make_file(bands/8728,*,2)
If I exclude files starting with 8, I got the same number of files. It just
stops at :
[sender] make_file(bands/9729,*,2)
[sender] make_file(bands/972a,*,2)
[sender] make_file(bands/972b,*,2)
[sender] make_file(bands/972c,*,2)

What really puzzles me is that it works with Synology rsync 3.0.9.
Did I miss something when I compiled rsync on my linux ?

-- 
You are receiving this mail because:
You are the QA Contact for the bug.



More information about the rsync mailing list