Fw: The performance of a large number of files

[xue jiaolong]

发自 Windows 邮件

发件人: live:jiaolongxue<mailto:jiaolongxue at outlook.com>
发送时间: ‎2016‎年‎11‎月‎2‎日, ‎星期三 ‎16‎:‎18
收件人: live:jiaolongxue<mailto:jiaolongxue at outlook.com>

When I copy the directory with 500 sub-files, it is like this
[cid:Image881.png at 15824158dfb372]
​[cid:Image1001.png at 158241e24f93ea]





发件人: live:jiaolongxue<mailto:jiaolongxue at outlook.com>
发送时间: ‎2016‎年‎11‎月‎2‎日, ‎星期三 ‎15‎:‎13
收件人: live:jiaolongxue<mailto:jiaolongxue at outlook.com>
抄送: samba-technical at lists.samba.org<mailto:samba-technical at lists.samba.org>

i copy a simple dir like this

[cid:Image572.png at 15823df0d9823d]

the log is

[cid:Image586.png at 15823e14bf524b]



发件人: live:jiaolongxue<mailto:jiaolongxue at outlook.com>
发送时间: ‎2016‎年‎11‎月‎2‎日, ‎星期三 ‎14‎:‎07
收件人: Volker Lendecke<mailto:vl at samba.org>
抄送: samba-technical at lists.samba.org<mailto:samba-technical at lists.samba.org>

Sorry, I did not describe it clearly. I did not re-export a cifsfs mount, just by using the smbd  to map a linux normal directory to a window disk?The "case sensitive" option uses default values?

my smbd version is 3.6.23.

thx


???: Volker Lendecke<mailto:vl at samba.org>
????: ?2016???11???2??, ???? ?12?:?39
???: Jeremy Allison<mailto:jra at samba.org>
??: live:jiaolongxue<mailto:jiaolongxue at outlook.com>, samba-technical at lists.samba.org<mailto:samba-technical at lists.samba.org>

Jeremy Allison <jra at samba.org> writes:

> On Tue, Nov 01, 2016 at 11:46:02PM +0000, xue jiaolong wrote:
>> When I try to create more than 100,000 files under a CIFS mount
>> directory on a Windows machine, the smbd cpu usage increases as the
>> number of files increases and performance degrades. I look at the
>> smbd log, before the creation of each document will receive from the
>> client SMB2_FIND request, the request parameters in_file_name = "*",
>> used to obtain the entire directory of information. That is to say
>> that each file needs to create a whole directory of information,
>> with the increase in the number of sub-files, performance
>> significantly decreased. I would like to ask is whether the SMB
>> protocol to consider the use of a large number of documents under
>> the directory scene, smbd there is no way to optimize, or modify the
>> configuration can improve performance?
>
> This looks like a cifsfs client question.
>
> What system calls (use strace) is your 100,000
> file creation code doing ? That might explain
> a lot.

Isn't that the normal case sensitive/insensitive directory lookup
thingy? cifsfs should be a case insensitive below.

Am I getting this right that you are re-exporting a cifsfs mount?

Volker
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Image572.png
Type: image/png
Size: 3492 bytes
Desc: Image572.png
URL: <http://lists.samba.org/pipermail/samba-technical/attachments/20161102/870bc7ba/Image572-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Image586.png
Type: image/png
Size: 67806 bytes
Desc: Image586.png
URL: <http://lists.samba.org/pipermail/samba-technical/attachments/20161102/870bc7ba/Image586-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Image881.png
Type: image/png
Size: 13837 bytes
Desc: Image881.png
URL: <http://lists.samba.org/pipermail/samba-technical/attachments/20161102/870bc7ba/Image881-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Image1001.png
Type: image/png
Size: 47909 bytes
Desc: Image1001.png
URL: <http://lists.samba.org/pipermail/samba-technical/attachments/20161102/870bc7ba/Image1001-0001.png>