Rsync Memory Issues - Kernel 2.4.18 - Box Hangs
Rick Parada
rick at bizrate.com
Wed Jul 10 13:48:31 EST 2002
Hi,
Im running a Dell 6450 w/ 4GB of memory, 2 2GB Swap Partitions. Redhat 7.3
kernel 2.4.18 (kernel.org). It runs our images for our site. We use rsync to
sync images from a main image box. It runs fine for maybe 4 days untill all
memory is in cache, and like 7MB of physical memory is free. The box will
hardly do anything, and cache will just keep going up and up untill no more
memory is free. Then when I run rsync (a memory hog) at night, kswapd and
rsync will compete with each other and send the cpu load through the roof.
Funny thing is the box won't really use swap at all. Then while the box is
rsyncing I cant even do simple things like SSH to the box. Why did older
kernels (2.2 kernels) work a whole lot better. Did older kernels swap a lot
better? Is there anything I can adjust in 2.4.18. Can I flush cache out
manually some how to return that memory back for use, for applications like
rsync. If I could do that my problems would be solved, since rsync runs
great with 1 GB of memory free. ANY HELP Would be much appreciative.
total used free shared buffers cached
Mem: 3997300 3918388 78912 0 472364 3056796
-/+ buffers/cache: 389228 3608072
Swap: 4192880 2460 4190420
10:21am up 6 days, 19:45, 2 users, load average: 0.04, 0.03, 0.00
79 processes: 78 sleeping, 1 running, 0 zombie, 0 stopped
CPU0 states: 0.1% user, 0.3% system, 0.0% nice, 99.1% idle
CPU1 states: 0.0% user, 0.2% system, 0.0% nice, 99.3% idle
CPU2 states: 0.0% user, 0.1% system, 0.0% nice, 99.4% idle
CPU3 states: 0.2% user, 0.0% system, 0.0% nice, 99.3% idle
Mem: 3997300K av, 3919908K used, 77392K free, 0K shrd, 472680K
buff
Swap: 4192880K av, 2460K used, 4190420K free 3057584K
cached
PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND
7826 root 16 0 1040 1040 832 R 0.5 0.0 0:00 top
2293 root 9 0 1736 1684 1400 S 0.1 0.0 0:00 sshd
5776 nobody 10 0 1124 1108 972 S 0.1 0.0 0:00 httpd
6385 nobody 11 0 1120 1104 968 S 0.1 0.0 0:00 httpd
6707 nobody 10 0 1120 1108 976 S 0.1 0.0 0:00 httpd
6919 nobody 9 0 1116 1100 964 S 0.1 0.0 0:00 httpd
1 root 10 0 472 428 412 S 0.0 0.0 14:45 init
2 root 9 0 0 0 0 SW 0.0 0.0 50:40 keventd
3 root 19 19 0 0 0 SWN 0.0 0.0 0:00 ksoftirqd_CPU0
4 root 19 19 0 0 0 SWN 0.0 0.0 0:00 ksoftirqd_CPU1
5 root 19 19 0 0 0 SWN 0.0 0.0 0:00 ksoftirqd_CPU2
6 root 19 19 0 0 0 SWN 0.0 0.0 0:00 ksoftirqd_CPU3
7 root 9 0 0 0 0 SW 0.0 0.0 305:31 kswapd
8 root 9 0 0 0 0 SW 0.0 0.0 0:00 bdflush
9 root 9 0 0 0 0 SW 0.0 0.0 83:16 kupdated
10 root 9 0 0 0 0 SW 0.0 0.0 13:08 kjournald
122 root 9 0 0 0 0 SW 0.0 0.0 0:00 kjournald
123 root 9 0 0 0 0 SW 0.0 0.0 2:26 kreiserfsd
124 root 9 0 0 0 0 SW 0.0 0.0 1:05 kjournald
125 root 9 0 0 0 0 SW 0.0 0.0 4:50 kjournald
126 root 9 0 0 0 0 SW 0.0 0.0 4:29 kjournald
537 root 9 0 604 536 500 S 0.0 0.0 11:27 syslogd
542 root 9 0 444 428 428 S 0.0 0.0 0:00 klogd
654 root 9 0 1024 912 828 S 0.0 0.0 13:34 sshd
More information about the rsync
mailing list