[Samba] Samba 4 DC log.smd flooded with Conversion error

Mon Feb 11 07:29:09 MST 2013

Dear all,

I have created another test case for the problem.

Rather testing in domU, running Debian Wheezy, I have constructed another machine without running xen and installed with Debian squeeze.

I have successfully setup samba 4.0.3 and create a folder called "中港矛盾" in share named "test".  And I have used convmv to make sure the name is in UTF-8
================================
root at file:/home/test# convmv * -t utf8
Your Perl version has fleas #37757 #49830 
Starting a dry run without changes...
Skipping, already UTF-8: ./中港矛盾
No changes to your files done. Use --notest to finally rename the files.
================================

When I issue a command:
/usr/local/samba/bin/smbclient //localhost/test -UAdministrator%'verysecurepassword' -c 'ls'

The log.smbd with log level = 3 is as follows: (the same conversion error!)
=================================
[2013/02/11 22:19:15.472365,  3] ../source3/smbd/vfs.c:1118(check_reduced_name)
  check_reduced_name [*] [/home/test]
[2013/02/11 22:19:15.472461,  3] ../source3/smbd/vfs.c:1248(check_reduced_name)
  check_reduced_name: * reduced to /home/test/*
[2013/02/11 22:19:15.472597,  3] ../source3/smbd/dir.c:663(dptr_create)
  creating new dirptr 256 for path ., expect_close = 1
[2013/02/11 22:19:15.472886,  3] ../source3/locking/share_mode_lock.c:408(fetch_share_mode_unlocked)
  Could not fetch share entry
[2013/02/11 22:19:15.472956,  3] ../source3/smbd/dir.c:1136(smbd_dirptr_get_entry)
  smbd_dirptr_get_entry mask=[*] found ./. fname=. (.)
[2013/02/11 22:19:15.473110,  3] ../source3/locking/share_mode_lock.c:408(fetch_share_mode_unlocked)
  Could not fetch share entry
[2013/02/11 22:19:15.473173,  3] ../source3/smbd/dir.c:1136(smbd_dirptr_get_entry)
  smbd_dirptr_get_entry mask=[*] found ./.. fname=.. (..)
[2013/02/11 22:19:15.473285,  3] ../lib/util/charset/convert_string.c:316(convert_string_handle)
  convert_string_internal: Conversion error: Illegal multibyte sequence(ä¸æ¸¯ç<9f><9b>ç<9b>¾)
[2013/02/11 22:19:15.473347,  3] ../lib/util/charset/convert_string.c:297(convert_string_handle)
  convert_string_internal: Conversion error: Incomplete multibyte sequence(¸æ¸¯ç<9f><9b>ç<9b>¾)
[2013/02/11 22:19:15.473404,  3] ../lib/util/charset/convert_string.c:297(convert_string_handle)
  convert_string_internal: Conversion error: Incomplete multibyte sequence(æ¸¯ç<9f><9b>ç<9b>¾)
[2013/02/11 22:19:15.473462,  3] ../lib/util/charset/convert_string.c:316(convert_string_handle)
  convert_string_internal: Conversion error: Illegal multibyte sequence(æ¸¯ç<9f><9b>ç<9b>¾)
[2013/02/11 22:19:15.473535,  3] ../lib/util/charset/convert_string.c:297(convert_string_handle)
  convert_string_internal: Conversion error: Incomplete multibyte sequence(¸¯ç<9f><9b>ç<9b>¾)
[2013/02/11 22:19:15.473592,  3] ../lib/util/charset/convert_string.c:297(convert_string_handle)
  convert_string_internal: Conversion error: Incomplete multibyte sequence(¯ç<9f><9b>ç<9b>¾)
[2013/02/11 22:19:15.473649,  3] ../lib/util/charset/convert_string.c:316(convert_string_handle)
  convert_string_internal: Conversion error: Illegal multibyte sequence(ç<9f><9b>ç<9b>¾)
[2013/02/11 22:19:15.473705,  3] ../lib/util/charset/convert_string.c:297(convert_string_handle)
  convert_string_internal: Conversion error: Incomplete multibyte sequence(<9f><9b>ç<9b>¾)
[2013/02/11 22:19:15.473762,  3] ../lib/util/charset/convert_string.c:297(convert_string_handle)
  convert_string_internal: Conversion error: Incomplete multibyte sequence(<9b>ç<9b>¾)
[2013/02/11 22:19:15.473819,  3] ../lib/util/charset/convert_string.c:316(convert_string_handle)
  convert_string_internal: Conversion error: Illegal multibyte sequence(ç<9b>¾)
[2013/02/11 22:19:15.473875,  3] ../lib/util/charset/convert_string.c:297(convert_string_handle)
  convert_string_internal: Conversion error: Incomplete multibyte sequence(<9b>¾)
[2013/02/11 22:19:15.473964,  3] ../source3/locking/share_mode_lock.c:408(fetch_share_mode_unlocked)
  Could not fetch share entry
======================================

the smb.conf
======================================
# Global parameters
[global]
        workgroup = PLKLSP2
        realm = SAMBA4.PLKLSP.EDU.HK
        netbios name = FILE
        server role = active directory domain controller
        dns forwarder = 192.168.107.1
        log level = 3

[netlogon]
        path = /usr/local/samba/var/locks/sysvol/samba4.plklsp.edu.hk/scripts
        read only = No

[sysvol]
        path = /usr/local/samba/var/locks/sysvol
        read only = No

[test]
        path = /home/test
        read only = No
========================================

As far as I know, I think the conversion error is not caused by Xen and debian version.

How can I offer more help for testing / debugging this issue?

Kinglok, Fong

On 10 Feb 2013, at 1:35 AM, TAKAHASHI Motonobu wrote:

> You had better set 'dos charset' parameter correctly and 'unix charset'
> parameter if you do not use UTF-8 on Linux.
> 
> From: Jeremy Allison <jra at samba.org>
> Date: Sat, 9 Feb 2013 09:04:47 -0800
> 
> On Sat, Feb 09, 2013 at 11:54:26PM +0800, Kinglok, Fong wrote:
> My machine is running samba 4.0.3 inside a DomU of Debian Wheezy.
> 
> Following the Samba AD Howto and running Samba 4.0.3 successfully but with one pretty serious problem.  When I try access the folder with 1000 files, the speed is *VERY* slow.
> 
> After employ log level to 3, log.smbd is flooded with:
> =============================================
> [2013/02/09 23:44:05.910717,  3] ../source3/locking/share_mode_lock.c:408(fetch_share_mode_unlocked)
>   Could not fetch share entry
> [2013/02/09 23:44:05.911631,  3] ../source3/smbd/dir.c:1136(smbd_dirptr_get_entry)
>   smbd_dirptr_get_entry mask=[*] found ./行政 fname=行政 (行政)
> [2013/02/09 23:44:05.912607,  3] ../lib/util/charset/convert_string.c:316(convert_string_handle)
>   convert_string_internal: Conversion error: Illegal multibyte sequence(行政)
> [2013/02/09 23:44:05.913517,  3] ../lib/util/charset/convert_string.c:297(convert_string_handle)
>   convert_string_internal: Conversion error: Incomplete multibyte sequence(??政)
> [2013/02/09 23:44:05.914467,  3] ../lib/util/charset/convert_string.c:297(convert_string_handle)
>   convert_string_internal: Conversion error: Incomplete multibyte sequence(?政)
> [2013/02/09 23:44:05.915412,  3] ../lib/util/charset/convert_string.c:316(convert_string_handle)
>   convert_string_internal: Conversion error: Illegal multibyte sequence(政)
> [2013/02/09 23:44:05.916356,  3] ../lib/util/charset/convert_string.c:297(convert_string_handle)
>   convert_string_internal: Conversion error: Incomplete multibyte sequence(??)
> ==================================================================
> 
> Is that filename '行政' in utf8 format on the disk ?
> Or is it in a previous encoding format such as big5 or
> Guobiao ?
> 
> Without a parameter setting Samba defaults to utf8
> encoding, and things can go wrong if filenames on
> disk aren't actually utf8.
> 
> Jeremy.
> -- 
> To unsubscribe from this list go to the following URL and read the
> instructions:  https://lists.samba.org/mailman/options/samba