[Samba] long delays with file enumeration & listing in large data storage environment

Matthias Kühne | Ellerhold Aktiengesellschaft matthias.kuehne at ellerhold.de
Wed Feb 8 10:59:11 UTC 2023


Hello Ralph Böhme, Hello samba-people,

I *think* I have enabled all possible optimizations, but if you want to 
have a look if I forgot something I'd be thankful. Thanks! (Sorry for 
highjacking this thread - should I open a new one?)

Ive asked the users and on-prem IT-people for more details and this is 
what they tell me:

  * MacOS 10.15 Catalina with Intel chipset -> fast directory listing
  * MacOS 12+ with Intel or M1 chipset -> slow directory listing

Server side is the same Debian linux box with samba 4.16.

The smb.conf for this fileserver s:

[global]
     workgroup = AD-ELLERHOLD
     realm     = AD.ELLERHOLD.LAN
     dns proxy = no

     load printers           = no
     printing                = bsd
     printcap name           = /dev/null
     disable spoolss         = Yes
     show add printer wizard = no

     panic action = /usr/share/samba/panic-action %d
     server role = member server
     netbios name = FILESERVER

     security = ADS

     winbind offline logon = Yes

     idmap config * : backend = tdb
     idmap config * : range = 3000-7999

     idmap config AD-ELLERHOLD:backend = ad
     idmap config AD-ELLERHOLD:range = 10000-99999
     idmap config AD-ELLERHOLD:schema_mode = rfc2307
     idmap config AD-ELLERHOLD:unix_nss_info = yes
     idmap config AD-ELLERHOLD:unix_primary_group = yes

     username map            = /etc/samba/user-map.conf

     winbind refresh tickets = Yes
     dedicated keytab file   = /etc/krb5.keytab
     kerberos method         = secrets and keytab

     map acl inherit         = Yes
     template shell          = /bin/bash
     template homedir        = /home/AD-ELLERHOLD/%U

     spotlight backend     = elasticsearch
     elasticsearch:address = localhost
     elasticsearch:port    = 9200
     spotlight             = Yes

     vfs objects = catia fruit streams_xattr acl_xattr recycle
     fruit:metadata = stream
     fruit:veto_appledouble = no

     veto files = /.DS_Store/
     delete veto files = yes

     recycle:repository = Papierkorb
     recycle:keeptree = Yes
     recycle:touch_mtime = Yes
     recycle:directory_mode = 0770

     server min protocol = NT1
     ntlm auth           = yes
     lanman auth         = yes

     client min protocol = NT1
     client lanman auth  = yes

     unix extensions = Yes

     store dos attributes = No
     map archive = No
     map hidden = No
     map readonly = No
     map system = No


[homes]
     browseable = no
     path = /storage/homes/%U
     read only = no

[My Share1]
     force group = +AD-ELLERHOLD\fs_fileserver_my_share_1
     inherit permissions = yes
     path = /storage/my-share1
     read only = no

Am 08.02.23 um 09:47 schrieb Ralph Boehme via samba:
> On 2/8/23 09:29, Matthias Kühne | Ellerhold Aktiengesellschaft via 
> samba wrote:
>> Directory listings from our MacOS clients took a big hit when we
>> switched from AFP shares and SMB shares from our old Mac OS Server to
>> the new debian fileserver with samba shares.
>>
>> Especially opening big directories with AFP is blazingly fast, while in
>> samba it takes forever. E. g. we have a directory with 37k
>> subdirectories and 245k files in one level. Opening this dir on a Mac
>> via a samba share take approx. 9 minutes. Our advice was to reduce the
>> amount of files in a single directory and create cronjobs that
>> automatically moves files into subdirectories.
>
> Apple designed a few SMB2 protocol extensions that improve directory 
> listing performance and Samba implements those in vfs_fruit. 
> Additionally latest macos since a few releases has additinoal 
> improvements that should improve listing regardless of these extensions.
>
>
> -slow
>
>
-- 
Senior Webentwickler
Datenschutzbeauftragter

Ellerhold Aktiengesellschaft
Friedrich-List-Str. 4
01445 Radebeul

Telefon: +49 (0) 351 83933-61
Web:www.ellerhold.de
Facebook:www.facebook.com/ellerhold.gruppe
Instagram:www.instagram.com/ellerhold.gruppe
Twitter:https://twitter.com/EllerholdGruppe

Amtsgericht Dresden / HRB 23769
Vorstand: Stephan Ellerhold, Maximilian Ellerhold
Vorsitzender des Aufsichtsrates: Frank Ellerhold


---Diese E-Mail und Ihre Anlagen enthalten vertrauliche Mitteilungen. Sollten Sie nicht der beabsichtigte Adressat sein, so bitten wir Sie um Mitteilung und um sofortiges löschen dieser E-Mail und der Anlagen.

Unsere Hinweise zum Datenschutz finden Sie hier: http://www.ellerhold.de/datenschutz/

This e-mail and its attachments are privileged and confidential. If you are not the intended recipient, please notify us and immediately delete this e-mail and its attachments.

You can find our privacy policy here: http://www.ellerhold.de/datenschutz/




More information about the samba mailing list