rsync splits filenames, creates special characters where none are, weird permissions

Lenz Weber mail at lenzw.de
Wed Jan 7 08:16:06 MST 2015


Hello,
I have a quite unusual encoding problem (?).

I call rsync with the following parameters:

/usr/bin/rsync -a --delete --numeric-ids --delete-excluded \
     --rsh="/usr/bin/ssh -o StrictHostKeyChecking=no -i \
     /etc/rsnapshot_ssh_certs/mykey" \
     --link-dest=/data/snapshots/hourly.1/folder/mail/ \
     rsyncbackup at server:/var/backups/mail/. \
     /data/snapshots/hourly.0/folder/mail/

Where the local destination /data/snapshots is an NFS volume mounted with the flags
    (rw,noatime,addr=192.168.1.XX)
and the source is a symlink to a zfs snapshot - that looks like this:
    /var/backups/mail -> /tank/mail/.zfs/snapshot/zfs-auto-snap_hourly-2015-01-07-1417

as far as I can tell, both systems work with UTF8 just fine (source is Ubuntu 14.04 and target is Debian Lenny)

Now there seems to be a problem while gathering or transferring the file list,
as rsync tries to create files/folders that share a part with real files on the source,
but with additional characters, sometimes cut off, without the preceding parent folder et cetera.

The source file names in this case look like this:

/var/backups/mail/redacted-domain/catchall/Maildir/.Sent/cur/1313508314.M654736P32713V0000000000000801I000B03CC_6.redacted-hostname,S=42352:2,S
/var/backups/mail/redacted-domain/info/Maildir/.Sent/cur/1313508314.M654736P32713V0000000000000801I000B03CC_6.redacted-hostname,S=42352:2,S

but rsync fails on files like this, that clearly do not exist:

skipping non-regular file "2713V0000000000000801I000B03CC_6.redacted-hostname,S=423\#001\#305\#001O\#233\#240é"
skipping non-regular file "2713V0000000000000801I000B03CC_6.redacted-hostname,S=42352:2,S"
skipping non-regular file "83E13498714.M297793P23544V000"
skipping non-regular file "Ø \#201"
skipping non-regular file "redacted-domain/catchall/Maildir/.Sent/cur/1301490998.M622842P6671V0000000000000801I00280BD9_0.redacted-hostname\#004"
skipping non-regular file "2713V0000000000000801I000B03CC_6.redacted-hostname,S=pedition/courierimapkeywords/:list"


while skipping/failing is still the good part, it even creates folders and files with names like
dr--rw--wt   2   48    49   4.0K Apr  9  1970 00B03C3_0.redacted-hostname,S=559475:2,S?s?NffJ??
c--SrwS-w-   1 root    66 48, 37 Aug 22  1995 317028.M727693P4967V0000000000000801I000C23B2_0.redacted-hostname,S
dr-Srw---x   2   48 staff   4.0K Aug 15  1995 6683671.M93103P25845V0000000000000801I002E40C9_0.

take a look at the garbled up file permissions, not to forget that these files are created in the target directory root instead of a subdirectory.


I have been using rsync happily for years, but after adding this new source server, nothing seems to work.
Is this a bug in combination with zfs?
Is this known?
Is there a workaround?

Please help me,
Lenz


More information about the rsync mailing list