DO NOT REPLY [Bug 5695] New: rsync local timeout
samba-bugs at samba.org
samba-bugs at samba.org
Sat Aug 16 13:09:12 GMT 2008
https://bugzilla.samba.org/show_bug.cgi?id=5695
Summary: rsync local timeout
Product: rsync
Version: 3.0.3
Platform: x86
OS/Version: Linux
Status: NEW
Severity: normal
Priority: P3
Component: core
AssignedTo: wayned at samba.org
ReportedBy: gabriele.tozzi at gmail.com
QAContact: rsync-qa at samba.org
Hello,
first of all, thank you for developing, maintaining and letting us use for free
this great software.
I'm using rsync to sync two local directories. Some subdirectories in the
source dir contains a lot of small files (maildirs) and rsync takes a very long
time to read all of them and decide if they need to be synced or not. During
this process, rsync looks like it's stuck (but it isn't, as strace shows) and
--timeout is hitten and process is terminated giving a timeout error.
---------------
Example:
/mnt/dati2/dati is the source dir
/mnt/extra/Backups is the destination dir
I invoke rsync with:
# strace -f /usr/bin/rsync --timeout=600 -v -a -x --timeout=300 --numeric-ids
--delete --delete-excluded /mnt/dati2/dati /mnt/extra/Backups > /tmp/rsync.out
2> /tmp/rsync.err
rsync.out contains:
sending incremental file list
dati/Documenti/Gabriele/Maildir/.Bozze/tmp/
rsync.err cointains 119Mb of data, I'm trying to strip most significant part
(last 100 lines):
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196954597.M629924P20705V0000000000000906I00053A8C_3331.transylvania,S=5064:2,S",
{st_mode=S_IFREG|0644, st_size=5064, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196953847.M191213P20668V0000000000000906I0001C424_5433.transylvania,S=2406:2,S",
{st_mode=S_IFREG|0644, st_size=2406, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196955722.M25482P20750V0000000000000906I0006A649_3392.transylvania,S=2981:2,S",
{st_mode=S_IFREG|0644, st_size=2981, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196953893.M65320P20671V0000000000000906I0001DB24_2553.transylvania,S=2262:2,S",
{st_mode=S_IFREG|0644, st_size=2262, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196954963.M426924P20740V0000000000000906I0005B082_1068.transylvania,S=3147:2,S",
{st_mode=S_IFREG|0644, st_size=3147, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196955769.M801345P20745V0000000000000906I0006C64F_3774.transylvania,S=2584:2,S",
{st_mode=S_IFREG|0644, st_size=2584, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196955469.M175771P20747V0000000000000906I00065223_2466.transylvania,S=8259:2,S",
{st_mode=S_IFREG|0644, st_size=8259, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196955858.M750831P20753V0000000000000906I0006F97A_4320.transylvania,S=8297:2,S",
{st_mode=S_IFREG|0644, st_size=8297, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196954574.M965820P20714V0000000000000906I0005292F_2422.transylvania,S=2494:2,S",
{st_mode=S_IFREG|0644, st_size=2494, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196954364.M641287P20705V0000000000000906I00012BDB_910.transylvania,S=5289:2,S",
{st_mode=S_IFREG|0644, st_size=5289, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196954919.M425335P20731V0000000000000906I0005A49E_1486.transylvania,S=5399:2,S",
{st_mode=S_IFREG|0644, st_size=5399, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196955838.M714021P20760V0000000000000906I0006ED69_2610.transylvania,S=5909:2,S",
{st_mode=S_IFREG|0644, st_size=5909, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196955558.M610334P20745V0000000000000906I00066F8E_2761.transylvania,S=2243:2,S",
{st_mode=S_IFREG|0644, st_size=2243, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196955769.M860881P20740V0000000000000906I0006C65E_5168.transylvania,S=4672:2,S",
{st_mode=S_IFREG|0644, st_size=4672, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196955440.M467314P20726V0000000000000906I0006499B_3879.transylvania,S=4836:2,S",
{st_mode=S_IFREG|0644, st_size=4836, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196954550.M692809P20697V0000000000000906I00051339_6429.transylvania,S=8518:2,S",
{st_mode=S_IFREG|0644, st_size=8518, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196955803.M578489P20731V0000000000000906I0006D695_5350.transylvania,S=4031:2,S",
{st_mode=S_IFREG|0644, st_size=4031, ...}) = 0
[pid 3083] getdents64(0, /* 19 entries */, 2048) = 1976
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196954096.M756473P20685V0000000000000906I00046C56_872.transylvania,S=3728:2,S",
{st_mode=S_IFREG|0644, st_size=3728, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196955738.M529606P20747V0000000000000906I0006B37B_3549.transylvania,S=26487:2,S",
{st_mode=S_IFREG|0644, st_size=26487, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196954763.M460840P20717V0000000000000906I000583B6_5062.transylvania,S=5224:2,S",
{st_mode=S_IFREG|0644, st_size=5224, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196954544.M508824P20717V0000000000000906I00051139_1327.transylvania,S=4454:2,S",
{st_mode=S_IFREG|0644, st_size=4454, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196954833.M295279P20717V0000000000000906I00058AF8_5515.transylvania,S=2667:2,S",
{st_mode=S_IFREG|0644, st_size=2667, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196954799.M638564P20726V0000000000000906I0001B85D_1606.transylvania,S=2622:2,S",
{st_mode=S_IFREG|0644, st_size=2622, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196955095.M398304P20750V0000000000000906I0005D73A_414.transylvania,S=4993:2,S",
{st_mode=S_IFREG|0644, st_size=4993, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196956051.M797185P20775V0000000000000906I00075912_4096.transylvania,S=4544:2,S",
{st_mode=S_IFREG|0644, st_size=4544, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196954776.M833797P20736V0000000000000906I00058958_142.transylvania,S=8657:2,S",
{st_mode=S_IFREG|0644, st_size=8657, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196953672.M688315P20639V0000000000000906I000157EC_1473.transylvania,S=16412:2,S",
{st_mode=S_IFREG|0644, st_size=16412, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196955217.M550481P20747V0000000000000906I0005FC5F_1440.transylvania,S=3213:2,S",
{st_mode=S_IFREG|0644, st_size=3213, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196954409.M947381P20705V0000000000000906I00019D11_1281.transylvania,S=2300:2,S",
{st_mode=S_IFREG|0644, st_size=2300, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196955123.M402452P20721V0000000000000906I0005DED8_4614.transylvania,S=23271:2,S",
{st_mode=S_IFREG|0644, st_size=23271, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196954501.M349740P20705V0000000000000906I0004FA9C_2061.transylvania,S=3494:2,S",
{st_mode=S_IFREG|0644, st_size=3494, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196953618.M462574P20411V0000000000000906I000135F1_2651.transylvania,S=5902:2,S",
{st_mode=S_IFREG|0644, st_size=5902, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196953603.M741820P20411V0000000000000906I00012BB5_1051.transylvania,S=4076:2,S",
{st_mode=S_IFREG|0644, st_size=4076, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196954081.M114612P20682V0000000000000906I00045CD5_4011.transylvania,S=5310:2,S",
{st_mode=S_IFREG|0644, st_size=5310, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196956071.M395246P20753V0000000000000906I00075EA1_5778.transylvania,S=2472:2,S",
{st_mode=S_IFREG|0644, st_size=2472, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196954760.M805379P20721V0000000000000906I0005828E_3062.transylvania,S=4084:2,S",
{st_mode=S_IFREG|0644, st_size=4084, ...}) = 0
[pid 3083] getdents64(0, /* 19 entries */, 2048) = 1976
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196953650.M866107P20411V0000000000000906I00014C6A_6172.transylvania,S=2198:2,S",
{st_mode=S_IFREG|0644, st_size=2198, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196956524.M753914P20775V0000000000000906I0007AD29_6380.transylvania,S=3413:2,S",
{st_mode=S_IFREG|0644, st_size=3413, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196954540.M610753P20710V0000000000000906I00050FF7_2489.transylvania,S=5602:2,S",
{st_mode=S_IFREG|0644, st_size=5602, ...}) = 0
[pid 3083]
lstat64("dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/1196954257.M71986P20697V0000000000000906I0004CA93_2163.transylvania,S=3982:2,S",
<unfinished ...>
[pid 3082] <... select resumed> ) = 0 (Timeout)
[pid 3082] time(NULL) = 1218891337
[pid 3082] write(2, "io timeout after 300 seconds -- e"..., 39io timeout after
300 seconds -- exiting) = 39
[pid 3082] write(2, "\n"..., 1
) = 1
[pid 3082] rt_sigaction(SIGUSR1, {SIG_IGN}, NULL, 8) = 0
[pid 3082] rt_sigaction(SIGUSR2, {SIG_IGN}, NULL, 8) = 0
[pid 3082] waitpid(3083, 0xbfff4cac, WNOHANG) = 0
[pid 3082] getpid() = 3082
[pid 3082] kill(3083, SIGUSR1) = 0
[pid 3082] write(2, "rsync error: timeout in data send"..., 79rsync error:
timeout in data send/receive (code 30) at io.c(239) [sender=3.0.3]) = 79
[pid 3082] write(2, "\n"..., 1
) = 1
[pid 3082] exit_group(30) = ?
[pid 3083] <... lstat64 resumed> {st_mode=S_IFREG|0644, st_size=3982, ...}) =
0
[pid 3083] --- SIGUSR1 (User defined signal 1) @ 0 (0) ---
[pid 3084] <... select resumed> ) = 0 (Timeout)
[pid 3083] rt_sigaction(SIGUSR1, {SIG_IGN}, <unfinished ...>
[pid 3084] time( <unfinished ...>
[pid 3083] <... rt_sigaction resumed> NULL, 8) = 0
[pid 3084] <... time resumed> NULL) = 1218891337
[pid 3083] rt_sigaction(SIGUSR2, {SIG_IGN}, <unfinished ...>
[pid 3084] rt_sigaction(SIGUSR1, {SIG_IGN}, <unfinished ...>
[pid 3083] <... rt_sigaction resumed> NULL, 8) = 0
[pid 3084] <... rt_sigaction resumed> NULL, 8) = 0
[pid 3083] kill(3084, SIGUSR1 <unfinished ...>
[pid 3084] rt_sigaction(SIGUSR2, {SIG_IGN}, <unfinished ...>
[pid 3083] <... kill resumed> ) = 0
[pid 3084] <... rt_sigaction resumed> NULL, 8) = 0
[pid 3083] select(4, [3], [1], [1], {60, 0}) = 1 (out [1], left {60, 0})
[pid 3083] write(1, "J\0\0\nrsync error: received SIGUSR1"..., 78) = -1 EPIPE
(Broken pipe)
[pid 3083] --- SIGPIPE (Broken pipe) @ 0 (0) ---
[pid 3083] write(2, "rsync: writefd_unbuffered failed "..., 80rsync:
writefd_unbuffered failed to write 78 bytes [generator]: Broken pipe (32)) = 80
[pid 3083] write(2, "\n"..., 1
) = 1
[pid 3083] rt_sigaction(SIGUSR1, {SIG_IGN}, NULL, 8) = 0
[pid 3083] rt_sigaction(SIGUSR2, {SIG_IGN}, NULL, 8) = 0
[pid 3083] gettimeofday({1218891337, 769475}, NULL) = 0
[pid 3083] select(0, NULL, NULL, NULL, {0, 100000} <unfinished ...>
[pid 3084] --- SIGUSR1 (User defined signal 1) @ 0 (0) ---
[pid 3084] select(5, NULL, [4], [4], {60, 0}) = 1 (out [4], left {60, 0})
[pid 3084] write(4, "R\0\0\nrsync error: timeout in data "..., 86) = 86
[pid 3084] gettimeofday({1218891337, 770193}, NULL) = 0
[pid 3084] select(0, NULL, NULL, NULL, {0, 100000} <unfinished ...>
[pid 3083] <... select resumed> ) = 0 (Timeout)
[pid 3083] gettimeofday({1218891337, 867447}, NULL) = 0
[pid 3083] select(0, NULL, NULL, NULL, {0, 3000} <unfinished ...>
[pid 3084] <... select resumed> ) = 0 (Timeout)
[pid 3084] gettimeofday({1218891337, 867735}, NULL) = 0
[pid 3084] select(0, NULL, NULL, NULL, {0, 3000} <unfinished ...>
[pid 3083] <... select resumed> ) = 0 (Timeout)
[pid 3083] gettimeofday({1218891337, 879805}, NULL) = 0
[pid 3083] exit_group(19) = ?
Process 3083 detached
<... select resumed> ) = 0 (Timeout)
gettimeofday({1218891337, 890184}, NULL) = 0
exit_group(30) = ?
Process 3084 detached
please not that directory dati/Documenti/Gabriele/Maildir/.Bugtraq.2006/cur/
contains some thousands of files. A simple "ls" command on this folder, takes
many minutes to complete.
Ask me more informations, if you need.
Thank you.
Gabriele Tozzi
--
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.
More information about the rsync
mailing list