<html>
<head>
<style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 10pt;
font-family:Tahoma
}
--></style></head>
<body class='hmmessage'><div dir='ltr'>
We are running Kernel 2.6.18-308.1.1.el5 which is latest in RHEL 5.8 on both the server. I think i might have to explore option of using ext4.<BR> <BR>
<DIV>
<DIV id=SkyDrivePlaceholder></DIV>> Date: Thu, 12 Apr 2012 17:31:35 -0400<BR>> From: kmk@sanitarium.net<BR>> To: rsync@lists.samba.org<BR>> Subject: Re: Rsync takes long time to finish<BR>> <BR>> -----BEGIN PGP SIGNED MESSAGE-----<BR>> Hash: SHA1<BR>> <BR>> There was also a serious performance regression in 2.6.39.<BR>> <BR>> <BR>> On 04/12/12 17:29, Dan Stromberg wrote:<BR>> > <BR>> > I've heard lots of good suggestions already - another thing that<BR>> > I've not seen mentioned is, upgrading your kernel may help.<BR>> > Somewhere shortly before kernel 3.0, pathname lookups got<BR>> > noticeably faster.<BR>> > <BR>> > You could also try an alternative filesystem like xfs. It's<BR>> > supposed to be pretty good at large directories.<BR>> > <BR>> > On Thu, Apr 12, 2012 at 11:29 AM, vijay patel<BR>> > <catchvjay@hotmail.com <mailto:catchvjay@hotmail.com>> wrote:<BR>> > <BR>> > Hi Friends,<BR>> > <BR>> > I am using rsync to copy data from Production File Server to <BR>> > Disaster Recovery file server. I have 100Mbps link setup between <BR>> > these two servers. Folder structure is very deep. It is having<BR>> > path like /reports/folder1/date/folder2/file.tx, where we have<BR>> > 1600 directories like 'folder1', daily folders since last year in<BR>> > date folder and 2 folders for each date folder like folder2 which <BR>> > ultimately will contain the file. Files are not too big but just <BR>> > design of folder structure is complex. Folder structure design is <BR>> > done by application and we can't change it at the moment. I am<BR>> > using following command in cron to run rsync.<BR>> > <BR>> > rsync -avh --delete --exclude-from 'ex_file.txt' /reports/ <BR>> > 10.10.10.100:/reports/ | tee /tmp/rsync_report.out >> <BR>> > /tmp/rsync_report.out.$today<BR>> > <BR>> > Initially we were running it every 5 mins then we increased it to <BR>> > every 30 mins since one instance was not getting finished in 5<BR>> > mins. Now we have made it to run every 8 hours because of lots of<BR>> > folders. Is there a way i can improve performance of my rsync??<BR>> > <BR>> > <BR>> > Regards, Vijay<BR>> > <BR>> > <BR>> > -- Please use reply-all for most replies to avoid omitting the<BR>> > mailing list. To unsubscribe or change options: <BR>> > https://lists.samba.org/mailman/listinfo/rsync Before posting,<BR>> > read: http://www.catb.org/~esr/faqs/smart-questions.html <BR>> > <http://www.catb.org/%7Eesr/faqs/smart-questions.html><BR>> > <BR>> > <BR>> > <BR>> > <BR>> <BR>> - -- <BR>> ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~<BR>> Kevin Korb Phone: (407) 252-6853<BR>> Systems Administrator Internet:<BR>> FutureQuest, Inc. Kevin@FutureQuest.net (work)<BR>> Orlando, Florida kmk@sanitarium.net (personal)<BR>> Web page: http://www.sanitarium.net/<BR>> PGP public key available on web site.<BR>> ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~<BR>> -----BEGIN PGP SIGNATURE-----<BR>> Version: GnuPG v2.0.17 (GNU/Linux)<BR>> Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/<BR>> <BR>> iEYEARECAAYFAk+HSbcACgkQVKC1jlbQAQfW+wCgn9wl1RFxLhFFaEAqQi7rbQcc<BR>> i1MAoPqFk0qbcPvcBIlYYU5T7/HG0H6i<BR>> =abbJ<BR>> -----END PGP SIGNATURE-----<BR>> -- <BR>> Please use reply-all for most replies to avoid omitting the mailing list.<BR>> To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync<BR>> Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html<BR></DIV> </div></body>
</html>