[Bug 11378] Please add a '--line-buffered' option to rsync to make logging/output more friendly with pipes/syslog/CI systems/etc.

samba-bugs at samba.org samba-bugs at samba.org
Sat Jul 4 17:56:25 UTC 2015


https://bugzilla.samba.org/show_bug.cgi?id=11378

Nathan Neulinger <nneul at neulinger.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|RESOLVED                    |REOPENED
         Resolution|WORKSFORME                  |---

--- Comment #2 from Nathan Neulinger <nneul at neulinger.org> ---
Perhaps the naming is not correct on my suggested option (and I'll admit, I
completely missed the outbuf option) - unfortunately, outbuf doesn't actually
solve the problem. 

The goal is to get incremental progress output while running rsync through a
build system or similar.

As near as I can tell, with outbuf, it still writes out a "single line" into
the output stream, so you get result like this:

custom.iso
^M         32,768   0%    0.00kB/s    0:00:00  ^M    264,765,440  29% 
252.47MB/s    0:00:02  ^M    508,592,128  57%  242.62MB/s    0:00:01  ^M   
778,338,304  87%  247.58MB/s    0:00:00  ^M    890,107,904 100%  250.03MB/s   
0:00:03 (xfr#1, to-chk=0/1)


Which doesn't mesh nicely with build tools, or simple stuff like:

   rsync ..... | logger -t nightly-sync

Which results in a mess like:

...
Jul  4 12:52:59 skyhawk rsync-test: sending incremental file list
Jul  4 12:52:59 skyhawk rsync-test: custom.iso
Jul  4 12:53:01 skyhawk CROND[13401]: (nneul) CMD (/local/thermo/grab-status.pl
>> /local/thermo/status.log 2>&1)
     17,764,896   1%  597.84kB/s    0:24:20  0%    0.00kB/s    0:00:00  
     33,587,200   3%  641.25kB/s    0:22:16  %  613.17kB/s    0:23:42  
Jul  4 12:54:01 skyhawk CROND[13448]: (nneul) CMD (/local/thermo/grab-status.pl
>> /local/thermo/status.log 2>&1)
...


Instead of (output with my suggested patch):

Jul  4 12:54:46 skyhawk rsync-test: custom.iso
Jul  4 12:54:46 skyhawk rsync-test: 32,768   0%    0.00kB/s    0:00:00 (xfr#1,
to-chk=0/1)
Jul  4 12:54:47 skyhawk rsync-test: 2,818,048   0%    2.31MB/s    0:00:01
(xfr#1, to-chk=0/1)
Jul  4 12:54:48 skyhawk rsync-test: 3,538,944   0%    1.56MB/s    0:00:02
(xfr#1, to-chk=0/1)
Jul  4 12:54:49 skyhawk rsync-test: 4,128,768   0%    1.24MB/s    0:00:03
(xfr#1, to-chk=0/1)
Jul  4 12:54:50 skyhawk rsync-test: 4,784,128   0%    1.06MB/s    0:00:04
(xfr#1, to-chk=0/1)
Jul  4 12:54:51 skyhawk rsync-test: 5,439,488   0% 1003.42kB/s    0:00:05
(xfr#1, to-chk=0/1)
Jul  4 12:54:52 skyhawk rsync-test: 6,094,848   0%  945.38kB/s    0:00:06
(xfr#1, to-chk=0/1)


Perhaps "line-progress" or something?

-- 
You are receiving this mail because:
You are the QA Contact for the bug.


More information about the rsync mailing list