rsync taking a while on really large files

[leen at consolejunky.net]

On 01/15/2010 07:46 PM, David Trammell wrote:
> I could use an ordinary copying script for the mail files, but I 
> figured if rsync can do it in some more optimal way, I'll stick with 
> it for simplicity (since it's working great for the several hundred 
> gigs of user files).
>
> I saw the -W option, but I wasn't sure about how it behaves as the man 
> pages don't have many details, and I thought there might be other 
> options I missed.  For -W the man page just says "copy files whole 
> (w/o delta-xfer algorithm)"
>
> Does that mean it will copy all files with no comparison, or does it 
> at least verify that there is some change to the file first?  I 
> suppose either way I can test it to see, which is faster, but if 
> someone can clarify the behavior I'd appreciate it.
>
> Thanks,
> David
>

Without -W set it will check for file date/time and I think size.

>
> ----- Original Message ----- From: <leen at consolejunky.net>
> To: <rsync at lists.samba.org>
> Sent: Friday, January 15, 2010 12:40 PM
> Subject: Re: rsync taking a while on really large files
>
>
>> On 01/15/2010 07:22 PM, David Trammell wrote:
>>> Can anyone suggest a good way to speed up rsync on really large 
>>> files? In particular, when I rsync the mail spool directory, I have 
>>> a few users with inboxes over 1GB and up and it seems to take a very 
>>> long time to just compare the files.  Maybe it would be faster to 
>>> copy from scratch for files over a certain size or something if the 
>>> time stamps don't match.
>>>
>>> David
>>>
>>>
>> rsync is meant to safe bandwidth, that's the main use of the tool. If 
>> you have enough bandwidth, rsync without options might not be how you 
>> want to use it.
>>
>> Their is -W for whole files.
>>
>> -- 
>> Please use reply-all for most replies to avoid omitting the mailing 
>> list.
>> To unsubscribe or change options: 
>> https://lists.samba.org/mailman/listinfo/rsync
>> Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
>>
>