DO NOT REPLY [Bug 4168] New: Random file has vanished when syncing clock with ntpdate/hwclock ?

[samba-bugs at samba.org]

https://bugzilla.samba.org/show_bug.cgi?id=4168

           Summary: Random file has vanished when syncing clock with
                    ntpdate/hwclock ?
           Product: rsync
           Version: 2.6.4
          Platform: x86
        OS/Version: Linux
            Status: NEW
          Severity: major
          Priority: P3
         Component: core
        AssignedTo: wayned at samba.org
        ReportedBy: baco at infomaniak.ch
         QAContact: rsync-qa at samba.org


We have one master server with 2 GB and 1'331'703 inodes of files
rsynced in parallels by two slave server at the same time (by a cron job).

Randomly the rsync failed on both slaves with a list of files
who sems to be vanished but the list of files are not the same on
the two slaves who rsync the same source, the same time.
The master source don't have any modification.

On the beginning "ignore-errors" was used so all vanished files was
removed from all slaves but still exist on the master.

file has vanished: "xxxxxxxxxxxxxxx13"
file has vanished: "xxxxxxxxxxxxxxx42" done
deleting xxxxxxxxxxxxxxx13.
deleting xxxxxxxxxxxxxxx42.

After reading your docs I have removed "ignore-errors" to avoid
removing files when file vanished detected !

file has vanished: "xxxxxxxxxxxxxxx13"
file has vanished: "xxxxxxxxxxxxxxx42" 
done
IO error encountered -- skipping file deletion

After some research on all bugs reports about file vanished
I found https://bugzilla.samba.org/show_bug.cgi?id=2607

Several months ago I have switched the cron job of ntpdate
from cron.daily to cron.hourly.

My master source and two slaves launch cron ntpdate/hwclock
every hours at 17 *. The rsync batch starts at 00 * and takes
about 20 to 30 minutes to finish.

I suspect rsync to failed with random vanished file during the
clock sync.

Please could you confirm this theory ?


Debian Sarge with rsync 2.6.4-6
rsync --recursive -e ssh \
--rsh="ssh" \
--verbose \
--recursive \
--links \
--perms \
--times \
--omit-dir-times \
--whole-file \
--one-file-system \
--ignore-existing \
--delete-before \
--partial \
--timeout=10800 \
--exclude=_TRANSFERED \
--no-blocking-io \
--ipv4 \
$user@$host:$masterdir/ \
$localdir/

rsync starts at the same time on both slaves

slave1
file has vanished: "xxxxxxxxxxxxxxx13"
file has vanished: "xxxxxxxxxxxxxxx42" 
done
IO error encountered -- skipping file deletion

slave2
file has vanished: "xxxxxxxxxxxxxxx03"
file has vanished: "xxxxxxxxxxxxxxx56" 
done
IO error encountered -- skipping file deletion

Thanks for your feedback

--

Infomaniak Network SA
Guy Baconniere <baco at infomaniak.ch>
Unix System Administrator
Certified Linux Engineer (RHCE, LPIC-2)
Avenue de la Praille 26
1227 Carouge (Geneva)
Switzerland (CH)
Phone +41 (0)22 820 3541
Fax +41 (0)22 820 3546
AS29222 / BACO-RIPE


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.