FileSystem for CTDB

[Fábio Cordeiro]

Helo Adam,

I understand  your considerations

About the comments and spaces betwen this lines in configuration files,
this was a Typing mistake, becouse in my real configuration file all
stay without comments.

Another point, i am using CTDB Version 1.0.14 with Linux Fedora14 and
Samba 3.5.7

The GlusterFS is instaled on Ubuntu 10.04 Server.

Before i was using Debian for the CTDB, but this was very heavy and the
LOG file generated many errors, i resolved this errors using Fedora14.

Lets go to my problem:

1) In the file /etc/syconfig/ctdb  I need specifi a place for the lock
file in

CTDB_RECOVERY_LOCK=”/mnt/gluster/ctdb.lock” , right ?

Question a) This file ctdb.lock can be any file created for myself, or
the CTDB will create it automatically?

2) In the configuration file of samba, i need share the directory
mounted with the GlusterFS FileSystem, like the code below: rigth ?

[Share]
path=/mnt/gluster/
vfs objects=fileid

Question a): I only have indicate the folder where stay pointing for the
lock file?

Question b): Has more any folder of CTDB that need be share on samba and
place in a point mounted for GlusterFS?

If it is not asking too much, you can send me a configuration file of
CTDB and of SMB (only the part when make reference of the files of CTDB
for me understand better the configuration.

Thanks a lot for your he

Fábio Cordeiro
PUC Minas Guanhães
=====================================================================
Em Ter, 2010-11-09 às 10:03 +0100, Michael Adam escreveu:
> Fábio Cordeiro wrote:
> > Hi Adam,
> > Thanks for the help.
> > 
> > Part of GlusterFS I have not been clear is the following:
> > - Did you install GlusterFS and it worked fine. But I do not know how to
> > configure the smb. Conf to point to the directory riding
> > ex: /mnt/gluster.
> > 
> > I think it is like this:
> > -------------------------------------------------
> > # Clustering = yes
> > # Idmap backend = tdb2
> > # Private dir = /mnt/gluster/
> > # Fileid: mapping = fsname
> > # Use mmap = no
> > ------------------------------------------------
> 
> Just to make sure: you should remove the comment signs ('#')
> at the beginning of the lines in order for the settings to
> take effect...
> 
> If you have a reasonably recent version of ctdb (>= 1.0.50),
> then you should remove the options "private dir = ..." and
> "use mmap = no".
> 
> (They won't stop your setup from working, though.)
> 
> > Another question is about the CTDB folders that must be in file-system
> > distributed.
> > As I understand it has to be those containing the lock file:
> > -------------------------------------------------- -----
> > # # CTDB_RECOVERY_LOCK = "/ mnt / gluster / ctdb.lock"
> > -------------------------------------------------- -------
> 
> You have to get rid of the leading comment signs ('#') and of
> all the spaces! This is a shell snippet, so there may be no
> space between CTDB_RECOVERY_LOCK and the = sign. And I suppose
> the path does not contain spaces either.
> 
> CTDB_RECOVERY_LOCK="/mnt/gluster/ctdb.lock"
> 
> >  And also share in this directory
> > smb.conf
> > -------------------------------------------------
> > # [Share]
> > # Path = / mnt / gluster /
> > # Vfs objects = = fileid
> > -------------------------------------------------- -
> 
> Same remark with comment signs and spaces in the path
> name. In smb.conf, there may be spaces around the
> "=" signs though.
> 
> > I hope I was clear.
> 
> Actually, no!
> You did not describe what your problem is, at all...
> What is going wrong?
> 
> Cheers - Michael
> 
> > Thanks for the help.
> > 
> > Atenciosamente:
> > Fábio Cordeiro
> > CRC - PUC Minas
> > 
> > 
> > 
> > Em Seg, 2010-11-08 às 16:30 +0100, Michael Adam escreveu:
> > > Hi Fábio,
> > > 
> > > Fábio Cordeiro wrote:
> > > > Problems with distributed file systems for CTDB.
> > > > 
> > > > Someone recommended a filesystem to the CTDB.
> > > 
> > > in principle you can use GlusterFS and GFS2 and OCFS2
> > > for samba+ctdb. I can not say anything definitive
> > > about Lustre, but as far as I know it should work
> > > in principle, too.
> > > 
> > > The cluster file system that has seen the most thorough
> > > testing is probably IBM's proprietory GPFS file system.
> > > 
> > > You should make sure that the file system supports
> > > POSIX fcntl byte range locks (--> ping_pong test).
> > > 
> > > 
> > > Fábio Cordeiro wrote:
> > > > I was experimenting with GlusterFS and he is working well, but I can not
> > > > cause the CTDB recognize the mount point that points to the network
> > > > GlusterFS.:
> > > 
> > > Sorry, I don't understand, what you mean here.
> > > Can you elaborate, what the problem is?
> > > 
> > > > What setting should be used in smb.conf for GlusterFS.
> > > > I could not understand how to do this by setting Wiki.
> > > > 
> > > There is no required file-sysstem specific
> > > configuration to samba or ctdb. For samba and CTDB,
> > > the file systems are a black box. For some
> > > file systems, samba provides special vfs modules,
> > > that can take advantage of specific features of the
> > > file system. The gpfs vfs module is an example of such
> > > a file system module for a cluster file system.
> > > 
> > > I myself had set up a GlusterFS cluster for testing.
> > > Settig up gluster is especially easy since it is fuse
> > > based and hence does not require special kernel modules or so.
> > > But there may be issues. Be sure to test any file system
> > > thoroughly for data and locking consistency.
> > > For Gluster, you should make sure you use the
> > > feature/posix-locks (or feature/locks) in your
> > > config.
> > > 
> > > > I'm still trying to GFS2 run, but I'm not getting the material that he
> > > > found on the network is weak. Does anyone have some good stuff for me to
> > > > indicate, or some tips related to the GFS for CTDB.
> > > 
> > > I don't have cook book for setting up GFS2.
> > > I did it once following instructions by red hat
> > > (web sites and such). I admit that setting up GFS2 does
> > > require some configuration, but it can be done. Maybe seek
> > > help in an appropriate irc-help-channle? Once you got a gfs2 mounted,
> > > simply point your samba shares and ctdb reclock file to it.
> > > 
> > > I know that there are GFS2 clusters out there in production.
> > > So it can be done.
> > > 
> > > Cheers - Michael
> > > 
> > > 
> > > > Thanks
> > > > 
> > > > Fábio Cordeiro
> > > > Centro de Recursos Computacionais
> > > > PUC Minas em Guanhães
> > > > fabioleandro at pucminas.br
> > > > fabio at taichous.com