FileSystem for CTDB

[Michael Adam]

Hi Fabio,

Fábio Cordeiro wrote:
> Helo Adam,
> 
> I understand  your considerations
> 
> About the comments and spaces betwen this lines in configuration files,
> this was a Typing mistake, becouse in my real configuration file all
> stay without comments.
> 
> Another point, i am using CTDB Version 1.0.14 with Linux Fedora14 and
> Samba 3.5.7
> 
> The GlusterFS is instaled on Ubuntu 10.04 Server.
> 
> Before i was using Debian for the CTDB, but this was very heavy and the
> LOG file generated many errors, i resolved this errors using Fedora14.
> 
> Lets go to my problem:
> 
> 1) In the file /etc/syconfig/ctdb  I need specifi a place for the lock
> file in
> 
> CTDB_RECOVERY_LOCK=”/mnt/gluster/ctdb.lock” , right ?
> 
> Question a) This file ctdb.lock can be any file created for myself, or
> the CTDB will create it automatically?

ctdb will create it.
The only constraint is that this should point to a file
in the shared file system.

> 2) In the configuration file of samba, i need share the directory
> mounted with the GlusterFS FileSystem, like the code below: rigth ?
> 
> [Share]
> path=/mnt/gluster/
> vfs objects=fileid
> 
> Question a): I only have indicate the folder where stay pointing for the
> lock file?

Samba share path are independet of ctdb's lock file.
Only, they should also point to folders in the cluster file system.

> Question b): Has more any folder of CTDB that need be share on samba and
> place in a point mounted for GlusterFS?

Sorry, I don't understand the question.
You can define as many samba shares pointing into glusterfs as
you like.

> 
> If it is not asking too much, you can send me a configuration file of
> CTDB and of SMB (only the part when make reference of the files of CTDB
> for me understand better the configuration.

I suggest you read this paper, which contains examples and
explanations:
http://samba.org/~obnox/presentations/sambaXP-2009/samba-and-ctdb.pdf

Cheers - Michael

> Thanks a lot for your he
> 
> Fábio Cordeiro
> PUC Minas Guanhães
> =====================================================================
> Em Ter, 2010-11-09 às 10:03 +0100, Michael Adam escreveu:
> > Fábio Cordeiro wrote:
> > > Hi Adam,
> > > Thanks for the help.
> > > 
> > > Part of GlusterFS I have not been clear is the following:
> > > - Did you install GlusterFS and it worked fine. But I do not know how to
> > > configure the smb. Conf to point to the directory riding
> > > ex: /mnt/gluster.
> > > 
> > > I think it is like this:
> > > -------------------------------------------------
> > > # Clustering = yes
> > > # Idmap backend = tdb2
> > > # Private dir = /mnt/gluster/
> > > # Fileid: mapping = fsname
> > > # Use mmap = no
> > > ------------------------------------------------
> > 
> > Just to make sure: you should remove the comment signs ('#')
> > at the beginning of the lines in order for the settings to
> > take effect...
> > 
> > If you have a reasonably recent version of ctdb (>= 1.0.50),
> > then you should remove the options "private dir = ..." and
> > "use mmap = no".
> > 
> > (They won't stop your setup from working, though.)
> > 
> > > Another question is about the CTDB folders that must be in file-system
> > > distributed.
> > > As I understand it has to be those containing the lock file:
> > > -------------------------------------------------- -----
> > > # # CTDB_RECOVERY_LOCK = "/ mnt / gluster / ctdb.lock"
> > > -------------------------------------------------- -------
> > 
> > You have to get rid of the leading comment signs ('#') and of
> > all the spaces! This is a shell snippet, so there may be no
> > space between CTDB_RECOVERY_LOCK and the = sign. And I suppose
> > the path does not contain spaces either.
> > 
> > CTDB_RECOVERY_LOCK="/mnt/gluster/ctdb.lock"
> > 
> > >  And also share in this directory
> > > smb.conf
> > > -------------------------------------------------
> > > # [Share]
> > > # Path = / mnt / gluster /
> > > # Vfs objects = = fileid
> > > -------------------------------------------------- -
> > 
> > Same remark with comment signs and spaces in the path
> > name. In smb.conf, there may be spaces around the
> > "=" signs though.
> > 
> > > I hope I was clear.
> > 
> > Actually, no!
> > You did not describe what your problem is, at all...
> > What is going wrong?
> > 
> > Cheers - Michael
> > 
> > > Thanks for the help.
> > > 
> > > Atenciosamente:
> > > Fábio Cordeiro
> > > CRC - PUC Minas
> > > 
> > > 
> > > 
> > > Em Seg, 2010-11-08 às 16:30 +0100, Michael Adam escreveu:
> > > > Hi Fábio,
> > > > 
> > > > Fábio Cordeiro wrote:
> > > > > Problems with distributed file systems for CTDB.
> > > > > 
> > > > > Someone recommended a filesystem to the CTDB.
> > > > 
> > > > in principle you can use GlusterFS and GFS2 and OCFS2
> > > > for samba+ctdb. I can not say anything definitive
> > > > about Lustre, but as far as I know it should work
> > > > in principle, too.
> > > > 
> > > > The cluster file system that has seen the most thorough
> > > > testing is probably IBM's proprietory GPFS file system.
> > > > 
> > > > You should make sure that the file system supports
> > > > POSIX fcntl byte range locks (--> ping_pong test).
> > > > 
> > > > 
> > > > Fábio Cordeiro wrote:
> > > > > I was experimenting with GlusterFS and he is working well, but I can not
> > > > > cause the CTDB recognize the mount point that points to the network
> > > > > GlusterFS.:
> > > > 
> > > > Sorry, I don't understand, what you mean here.
> > > > Can you elaborate, what the problem is?
> > > > 
> > > > > What setting should be used in smb.conf for GlusterFS.
> > > > > I could not understand how to do this by setting Wiki.
> > > > > 
> > > > There is no required file-sysstem specific
> > > > configuration to samba or ctdb. For samba and CTDB,
> > > > the file systems are a black box. For some
> > > > file systems, samba provides special vfs modules,
> > > > that can take advantage of specific features of the
> > > > file system. The gpfs vfs module is an example of such
> > > > a file system module for a cluster file system.
> > > > 
> > > > I myself had set up a GlusterFS cluster for testing.
> > > > Settig up gluster is especially easy since it is fuse
> > > > based and hence does not require special kernel modules or so.
> > > > But there may be issues. Be sure to test any file system
> > > > thoroughly for data and locking consistency.
> > > > For Gluster, you should make sure you use the
> > > > feature/posix-locks (or feature/locks) in your
> > > > config.
> > > > 
> > > > > I'm still trying to GFS2 run, but I'm not getting the material that he
> > > > > found on the network is weak. Does anyone have some good stuff for me to
> > > > > indicate, or some tips related to the GFS for CTDB.
> > > > 
> > > > I don't have cook book for setting up GFS2.
> > > > I did it once following instructions by red hat
> > > > (web sites and such). I admit that setting up GFS2 does
> > > > require some configuration, but it can be done. Maybe seek
> > > > help in an appropriate irc-help-channle? Once you got a gfs2 mounted,
> > > > simply point your samba shares and ctdb reclock file to it.
> > > > 
> > > > I know that there are GFS2 clusters out there in production.
> > > > So it can be done.
> > > > 
> > > > Cheers - Michael
> > > > 
> > > > 
> > > > > Thanks
> > > > > 
> > > > > Fábio Cordeiro
> > > > > Centro de Recursos Computacionais
> > > > > PUC Minas em Guanhães
> > > > > fabioleandro at pucminas.br
> > > > > fabio at taichous.com
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 206 bytes
Desc: not available
URL: <http://lists.samba.org/pipermail/samba-technical/attachments/20101110/535dd86f/attachment.pgp>