SAMBA eats up all memory...

William Jojo jojowil at hvcc.edu
Wed Jul 5 18:07:18 GMT 2000



Sumitro Chowdhury wrote:
> 
> Hi,
> 1. I am at AIX 4.3.3.0_02 maint. rel. (instfix confirms that)

That sounds about right

> 2. There is 8 GB of RAM

Sweet... :)

> 3. Please explain how to find out "how aggressively I am caching files"?

Have you enabled I/O pacing or write-behind? Unless you've heard of them, then
you're not, as they are turned off by default. If you have lots of memory (which
you have) and really fast disks (which you probably do) then you shouldn't need
them. These concepts are more for memory-challenged systems.

> 4. System is an S80

Sweet...

> 5. PINnable memory (vmtune) was 80%. I changed it now to 60% of RAM.

80 was probably ok. How much perm I wonder? (see below) what's the view of the
whole vmtune?

> 6. Pl. explain "memory shared by SAMBA". If you mean shared memory,
>     I have set "shared mem size = 5242880" in smb.conf but smbstatus
>     shows
>    "Share mode memory usage (bytes):1045920(99%) free + 2184(0%)
>      used + 472(0%) overhead = 1048576 (100%) total"

This will not change unless you either 1) reboot or 2) stop samba, delete the
shared memory area with ipcrm and restart samba. If you are at all squeemish,
about doing this - reboot...

> 7. I have about 10 Win98 and 10 Mac(s) as client.

Hmmmm. sounds like a memory leak to me, but what do I know...can you remove the
macs and try to recreate the problem. One of my colleagues thinks they are the
problem.

> 8. The clients copy files from unix thru samba to their local harddisk, then
> edit them, and then copy these files to unix thru samba in a different
> subdirectory (but in the same filesystem).
> No two clients open the same file at one time.
> Any one client copies around 1000 files in one transaction, each about 50Mb
> size.
> 

That should be okay, except if that's where the problem is.

> 9. vmstat 5 output:
> 
> kthr     memory             page              faults        cpu
> ----- ----------- ------------------------ ------------ -----------
> r  b   avm   fre  re  pi  po  fr   sr  cy  in   sy  cs us sy id wa
> 1  3 241311   134   0   0   0 604 1558   0 3518 11448 6706 18  5 57 19
> 1  3 241311   180   0   0   0 137  427   0 1938 8882 4026 18  4 60 17
> 2  2 241311   132   0   0   0 902 3624   0 4691 16193 8594 21 15 40 23
> 1  3 241311   128   0   0   0 105  179   0 2071 11502 4604 20  5 56 19
> 1  3 241311   128   0   0   0 350  551   0 2714 10862 5608 18  5 58 19
> 1  2 241476   128   0   0   0 459 2293   0 3013 12787 5850 19  6 55 20
> 2  3 241319   130   0   0   0 579 1596   0 3473 13111 7201 18  7 56 19
> 1  3 241117   128   0   0   0  63  215   0 1902 9049 4211 18  4 59 19
> 1  3 241118   127   0   0   0 863 2825   0 4331 15372 8436 20  7 55 19
> 1  3 241119   132   0   0   0 333  872   0 2818 15402 5901 24  6 50 19
> 

This indicates several things. 1) You're system memory requirements are about
943MB for everything to run "nicely" (avm * 4 / 1024) As you can see demand
paging is certainly working - sr is the number of pages scanned by the VMM to
satisfy memory requests and fr is the number of pages freed.

At the same time, you're not doing and paging to *or* from disk. I would like to
know what lsps -a has to say about all this.

What troubles me is you have many processors twiddling their thumbs (3-4 at any
given interval based on id) while you have several blocked threads and a
somewhat busy VMM. In other words...everything's fairly normal except for what
is happening to you.

> 10. I have kept debug level as 1 otherwise the log files are growing
>    very fast.
> 

Tell me about it...

> 11. error messages in log.<username> file in /var/samba/log directory:
> "[2000/06/30 07:36:04, 0] lib/util_sock.c:write_data(508)
>   write_data: write failure. Error = There is not enough memory available
> now."
> 
> Please let me know what more information is required and I shall post it
> ASAP.
> 
> Thanks in advance,
> Sumitro Chowdhury.
> Anderson Merchandisers
> ph: 1-806-376-6251 ext 4864
> 
> >From: William Jojo <jojowil at hvcc.edu>
> >To: smc_adsm at hotmail.com
> >Subject: Re: SAMBA eats up all memory...
> >Date: Wed, 05 Jul 2000 11:25:48 -0400
> >
> >
> >Sumitro,
> >
> >That's very interesting...we have exact setup here and do not have what you
> >describe. Are you certain all available patches for AIX 433 are installed?
> >There
> >are known data corruption issues at base levels.
> >
> >Also, how much memory is in your system to support this amount of I/O? how
> >aggressively are you caching files? what model system is this? how much
> >memory
> >is allowed to be pinned? (vmtune)
> >
> >How much memory is shared for SAMBA? How many clients do have and how many
> >files
> >are you projecting them to open at one time?
> >
> >I can help you figure this out if you can provide some seriously detailed
> >info
> >for me.
> >
> >Bill
> >
> >
> >Sumitro Chowdhury wrote:
> > >
> > > Hello,
> > > I am running SAMBA 2.0.7.0 on AIX 4.3.3.0
> > >
> > > I have a 1 Tera Byte filesystem on AIX made available to NT and MAC.
> > > There is heavy IO activity on this filesystem and all of a sudden the
> >NT's
> > > and MAC's can't read or write any file on this shared filesystem.
> > >
> > > Also AIX is running out of memory whenever this happens and files cannot
> >be
> > > copied onto the said filesystem even at unix level.
> > >
> > > The only remedy is to kill the smbd processes, unmount filesystem and
> > > remount the filesystem. Invariably, the filesystem is getting corrupted
> >and
> > > we need to run fsck on it before it can be remounted.
> > >
> > > Please note that there is 8 GB of RAM in AIX.
> > > And there is absolutely no paging going on.
> > >
> > > We think samba is not freeing up memory that it uses up for reading
> >files.
> > >
> > > Please provide a fix for this.
> > >
> > > Regards,
> > > Sumitro Chowdhury
> > > Anderson Merchandisers
> > > ph: 1-806-376-6251 ext 4864
> > >
> > > ________________________________________________________________________
> > > Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com
> >
> >--
> >
> >
> >         /------------------------------------------------------\
> >         |                                                      |
> >         |                 William E. Jojo, Jr.                 |
> >         |                                                      |
> >         |         Senior Systems and Network Specialist        |
> >         |                                                      |
> >         |            Hudson Valley Community College           |
> >         |                                                      |
> >         |                    (518) 629 7540                    |
> >         |                                                      |
> >         |                   jojowil at hvcc.edu                   |
> >         |                                                      |
> >         \------------------------------------------------------/
> >
> >
> >             One step on your own as you walk all over me
> >
> >       One head in the clouds you won't let go you're too proud
> >
> >                 One light to the blind and they see
> >
> >                 One touch on the head and we believe
> 
> ________________________________________________________________________
> Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com

-- 


        /------------------------------------------------------\
        |                                                      |
        |                 William E. Jojo, Jr.                 |
        |                                                      |
        |         Senior Systems and Network Specialist        |
        |                                                      |
        |            Hudson Valley Community College           |
        |                                                      |
        |                    (518) 629 7540                    |
        |                                                      |
        |                   jojowil at hvcc.edu                   |
        |                                                      |
        \------------------------------------------------------/


	      One step on your own as you walk all over me

	One head in the clouds you won't let go you're too proud

		  One light to the blind and they see

		  One touch on the head and we believe


More information about the samba mailing list