[Bug 13433] New: out_of_memory in receive_sums on large files

samba-bugs at samba.org samba-bugs at samba.org
Fri May 11 16:27:55 UTC 2018


https://bugzilla.samba.org/show_bug.cgi?id=13433

            Bug ID: 13433
           Summary: out_of_memory in receive_sums on large files
           Product: rsync
           Version: 3.1.3
          Hardware: All
                OS: All
            Status: NEW
          Severity: normal
          Priority: P5
         Component: core
          Assignee: wayned at samba.org
          Reporter: toasty at dragondata.com
        QA Contact: rsync-qa at samba.org

I'm attempting to rsync a 4TB file. It fails with:

generating and sending sums for 0
count=33554432 rem=0 blength=131072 s2length=6 flength=4398046511104
chunk[0] offset=0 len=131072 sum1=8d15ed6f
chunk[1] offset=131072 len=131072 sum1=3d66e7f7
[omitted]
chunk[6550] offset=858521600 len=131072 sum1=d70deab6
chunk[6551] offset=858652672 len=131072 sum1=657e34df
send_files(0, /bay3/b.tc)
count=33554432 n=131072 rem=0
ERROR: out of memory in receive_sums [sender]
[sender] _exit_cleanup(code=22, file=util2.c, line=105): entered
rsync error: error allocating core memory buffers (code 22) at util2.c(105)
[sender=3.1.3]

This is getting called:

92              if (!(s->sums = new_array(struct sum_buf, s->count)))
93                      out_of_memory("receive_sums");

And the size of a sum_buf(40 bytes) * the number of sums (33554432) exceeds
MALLOC_MAX.

How is this supposed to work/why is it breaking here, when I'm pretty sure I've
transferred files bigger than this before?

-- 
You are receiving this mail because:
You are the QA Contact for the bug.



More information about the rsync mailing list