[Samba] Truncated list of files/folders when using AWS EFS share

[Pednekar, Shirish]

Hello Ralph,

Thank you for looking into the case.

I couldn’t find definite but saw some vague references about AWS EFS doesn't support xattrs. Since it was an easy try, I added the but to no effect.

I then tried to track the smbd_dirptr_get_entry.The grep smbd_dirptr_get_entry shows the below and not sure what exactly to look at in this,

   smbd_dirptr_get_entry mask=[*] found test_tmp/file_20201030_000000.log fname=file_20201030_000000.log (file_20201030_000000.log)
[2022/05/13 01:57:25.444968,  6, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:823(smbd_dirptr_get_entry)
   smbd_dirptr_get_entry: dirptr 0x5627b77b4050 now at offset -2840337293508226108
[2022/05/13 01:57:25.445085,  3, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:1025(smbd_dirptr_get_entry)
   smbd_dirptr_get_entry mask=[*] found test_tmp/file_20191031_080000.csv fname=file_20191031_080000.csv (file_20191031_080000.csv)
[2022/05/13 01:57:25.445152,  6, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:823(smbd_dirptr_get_entry)
   smbd_dirptr_get_entry: dirptr 0x5627b77b4050 now at offset -2840337293504025804
[2022/05/13 01:57:25.445269,  3, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:1025(smbd_dirptr_get_entry)
   smbd_dirptr_get_entry mask=[*] found test_tmp/file_20200331_080000.csv fname=file_20200331_080000.csv (file_20200331_080000.csv)
[2022/05/13 01:57:25.445334,  6, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:823(smbd_dirptr_get_entry)
   smbd_dirptr_get_entry: dirptr 0x5627b77b4050 now at offset -2840337293503724356
[2022/05/13 01:57:25.445452,  3, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:1025(smbd_dirptr_get_entry)
   smbd_dirptr_get_entry mask=[*] found test_tmp/file_20190313_080000.csv fname=file_20190313_080000.csv (file_20190313_080000.csv)
[2022/05/13 01:57:25.445517,  6, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:823(smbd_dirptr_get_entry)
   smbd_dirptr_get_entry: dirptr 0x5627b77b4050 now at offset -2840337293506046836
[2022/05/13 01:57:25.445645,  3, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:1025(smbd_dirptr_get_entry)
   smbd_dirptr_get_entry mask=[*] found test_tmp/file_20201229.csv fname=file_20201229.csv (file_20201229.csv)
[2022/05/13 01:57:25.445711,  6, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:823(smbd_dirptr_get_entry)
   smbd_dirptr_get_entry: dirptr 0x5627b77b4050 now at offset -2840337293483267404
[2022/05/13 01:57:25.445828,  3, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:1025(smbd_dirptr_get_entry)
   smbd_dirptr_get_entry mask=[*] found test_tmp/file_20190221_080000.csv fname=file_20190221_080000.csv (file_20190221_080000.csv)
[2022/05/13 01:57:25.570669,  6, pid=531032, effective(97606749, 97601207), real(97606749, 0)] ../../source3/smbd/dir.c:823(smbd_dirptr_get_entry)
   smbd_dirptr_get_entry: dirptr 0x5627b77b4050 now at offset -1

Towards the end of  “smbd_dirptr_get_entry” , the following lines appear

   [2022/05/13 01:57:25.570682,  3, pid=531032, effective(97606749, 97601207), real(97606749, 0), class=smb2] ../../source3/smbd/smb2_server.c:3874(smbd_smb2_request_error_ex)
  smbd_smb2_request_error_ex: smbd_smb2_request_error_ex: idx[1] status[STATUS_NO_MORE_FILES] || at ../../source3/smbd/smb2_query_directory.c:160
[2022/05/13 01:57:25.570693, 10, pid=531032, effective(97606749, 97601207), real(97606749, 0), class=smb2] ../../source3/smbd/smb2_server.c:3766(smbd_smb2_request_done_ex)
  smbd_smb2_request_done_ex: mid [166] idx[1] status[STATUS_NO_MORE_FILES] body[8] dyn[yes:1] at ../../source3/smbd/smb2_server.c:3922
[2022/05/13 01:57:25.570704, 10, pid=531032, effective(97606749, 97601207), real(97606749, 0), class=smb2_credits] ../../source3/smbd/smb2_server.c:981(smb2_set_operation_credit)
  smb2_set_operation_credit: smb2_set_operation_credit: requested 1, charge 1, granted 1, current possible/max 8070/8192, total granted/max/low/range 123/8192/167/123
[2022/05/13 01:57:25.570993, 10, pid=531032, effective(97606749, 97601207), real(97606749, 0), class=smb2] ../../source3/smbd/smb2_server.c:4901(smbd_smb2_io_handler)
  smbd_smb2_request idx[1] of 5 vectors

Thanks,
Shirish

From: Ralph Boehme <slow at samba.org>
Sent: Wednesday, May 11, 2022 3:30 PM
To: Pednekar, Shirish <Shirish.Pednekar at qube-rt.com>; samba at lists.samba.org
Subject: Re: [Samba] Truncated list of files/folders when using AWS EFS share

On 5/11/22 08:54, Pednekar, Shirish via samba wrote:
> I have Samba Server Version 4.14.5 installed on RHEL8
> (REDHAT_SUPPORT_PRODUCT_VERSION="8.5") Installed on an EC2 instance
> and the mount is an EFS. I can't list all the files/folders browsing
> from the windows client.

does EFS support xattrs? If not, you could try setting "store dos
attributes = no", but I'm not sure if this is going to help.

You may want to closely inspect a Samba log with level 10, comparing
both cases to find out where things go south. The code of the directory
enumeration loop is not that hard to follow, in the logs look out for
lines containing "smbd_dirptr_get_entry".

Hth!
-slow

--
Ralph Boehme, Samba Team https://samba.org/<https://samba.org>
SerNet Samba Team Lead https://sernet.de/en/team-samba<https://sernet.de/en/team-samba>