FileSystem for CTDB

[Michael Adam]

Fábio Cordeiro wrote:
> Hi Adam,
> Thanks for the help.
> 
> Part of GlusterFS I have not been clear is the following:
> - Did you install GlusterFS and it worked fine. But I do not know how to
> configure the smb. Conf to point to the directory riding
> ex: /mnt/gluster.
> 
> I think it is like this:
> -------------------------------------------------
> # Clustering = yes
> # Idmap backend = tdb2
> # Private dir = /mnt/gluster/
> # Fileid: mapping = fsname
> # Use mmap = no
> ------------------------------------------------

Just to make sure: you should remove the comment signs ('#')
at the beginning of the lines in order for the settings to
take effect...

If you have a reasonably recent version of ctdb (>= 1.0.50),
then you should remove the options "private dir = ..." and
"use mmap = no".

(They won't stop your setup from working, though.)

> Another question is about the CTDB folders that must be in file-system
> distributed.
> As I understand it has to be those containing the lock file:
> -------------------------------------------------- -----
> # # CTDB_RECOVERY_LOCK = "/ mnt / gluster / ctdb.lock"
> -------------------------------------------------- -------

You have to get rid of the leading comment signs ('#') and of
all the spaces! This is a shell snippet, so there may be no
space between CTDB_RECOVERY_LOCK and the = sign. And I suppose
the path does not contain spaces either.

CTDB_RECOVERY_LOCK="/mnt/gluster/ctdb.lock"

>  And also share in this directory
> smb.conf
> -------------------------------------------------
> # [Share]
> # Path = / mnt / gluster /
> # Vfs objects = = fileid
> -------------------------------------------------- -

Same remark with comment signs and spaces in the path
name. In smb.conf, there may be spaces around the
"=" signs though.

> I hope I was clear.

Actually, no!
You did not describe what your problem is, at all...
What is going wrong?

Cheers - Michael

> Thanks for the help.
> 
> Atenciosamente:
> Fábio Cordeiro
> CRC - PUC Minas
> 
> 
> 
> Em Seg, 2010-11-08 às 16:30 +0100, Michael Adam escreveu:
> > Hi Fábio,
> > 
> > Fábio Cordeiro wrote:
> > > Problems with distributed file systems for CTDB.
> > > 
> > > Someone recommended a filesystem to the CTDB.
> > 
> > in principle you can use GlusterFS and GFS2 and OCFS2
> > for samba+ctdb. I can not say anything definitive
> > about Lustre, but as far as I know it should work
> > in principle, too.
> > 
> > The cluster file system that has seen the most thorough
> > testing is probably IBM's proprietory GPFS file system.
> > 
> > You should make sure that the file system supports
> > POSIX fcntl byte range locks (--> ping_pong test).
> > 
> > 
> > Fábio Cordeiro wrote:
> > > I was experimenting with GlusterFS and he is working well, but I can not
> > > cause the CTDB recognize the mount point that points to the network
> > > GlusterFS.:
> > 
> > Sorry, I don't understand, what you mean here.
> > Can you elaborate, what the problem is?
> > 
> > > What setting should be used in smb.conf for GlusterFS.
> > > I could not understand how to do this by setting Wiki.
> > > 
> > There is no required file-sysstem specific
> > configuration to samba or ctdb. For samba and CTDB,
> > the file systems are a black box. For some
> > file systems, samba provides special vfs modules,
> > that can take advantage of specific features of the
> > file system. The gpfs vfs module is an example of such
> > a file system module for a cluster file system.
> > 
> > I myself had set up a GlusterFS cluster for testing.
> > Settig up gluster is especially easy since it is fuse
> > based and hence does not require special kernel modules or so.
> > But there may be issues. Be sure to test any file system
> > thoroughly for data and locking consistency.
> > For Gluster, you should make sure you use the
> > feature/posix-locks (or feature/locks) in your
> > config.
> > 
> > > I'm still trying to GFS2 run, but I'm not getting the material that he
> > > found on the network is weak. Does anyone have some good stuff for me to
> > > indicate, or some tips related to the GFS for CTDB.
> > 
> > I don't have cook book for setting up GFS2.
> > I did it once following instructions by red hat
> > (web sites and such). I admit that setting up GFS2 does
> > require some configuration, but it can be done. Maybe seek
> > help in an appropriate irc-help-channle? Once you got a gfs2 mounted,
> > simply point your samba shares and ctdb reclock file to it.
> > 
> > I know that there are GFS2 clusters out there in production.
> > So it can be done.
> > 
> > Cheers - Michael
> > 
> > 
> > > Thanks
> > > 
> > > Fábio Cordeiro
> > > Centro de Recursos Computacionais
> > > PUC Minas em Guanhães
> > > fabioleandro at pucminas.br
> > > fabio at taichous.com
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 206 bytes
Desc: not available
URL: <http://lists.samba.org/pipermail/samba-technical/attachments/20101109/467cc169/attachment.pgp>