ctdb/log.ctdb: High hopcount 578746399 dbid:0x7a19d84d key:0x1a5954bc ...

Rainer Krienke krienke at uni-koblenz.de
Tue Aug 6 06:29:10 MDT 2013


Hello,

I run ctdb 2.3 with samba 3.6.16 on 6 nodes. I recently upgraded from
ctdb 1.2. I tried a smooth update. Stopping the old ctdb on one node,
upgrading this node and starting the new version again. Then I did the
same with the next cluster node.

Since the upgrade I noticed that ctdb is using much more CPU power. ctdb
process is using up to 75% of one cpu depending on how many clients
connect to a certain node. Each node has roughly the same number of
clients. The total number of connections to the samba cluster is about
260 (entries counted from smbstaus -b).

In /var/log/ctdb/log.ctb I see entries like this:

High hopcount 578746399 dbid:0x7a19d84d key:0x1a5954bc pnn:0 src:3
lmaster:0 header->dmaster:5 dst:5

These messages are visible on all nodes however some nodes show only a
*total* of 10 such messages and other nodes show about 50 per second
such messages. For each particular node the database id and the key id
logged seems to be always the same on this node,  but this value is
different for each of the other nodes.

Running ctdb dbstatistics on one node that fires out 50 log entries per
sec for db 0x7a19d84d I get this:

smbnode1:/var/log/ctdb # ctdb dbstatistics 0x7a19d84d
DB Statistics: 0x7a19d84d
 ro_delegations                     0
 ro_revokes                         0
 locks
     total                     593739
     failed                         0
     current                        0
     pending                        1
 hop_count_buckets: 7188559 9181 173 615 40 0 0 0 0 0 0 0 0 0 0 0
 lock_buckets: 0 156494 437000 242 0 0 0 3 0 0 0 0 0 0 0 0
 locks_latency      MIN/AVG/MAX     0.006288/0.011594/9.349069 sec out
of 593739
 Num Hot Keys:     0

Now I ask myself what the messages actually mean, why some nodes show
very very much of these messages and others do not and how to get rid of
these messages or the problem causing the messages?

Any idea?

Thanks
Rainer
--
Rainer Krienke, Uni Koblenz, Rechenzentrum, A22, Universitaetsstrasse  1
56070 Koblenz, http://userpages.uni-koblenz.de/~krienke, Tel: +49261287 1312
PGP: http://userpages.uni-koblenz.de/~krienke/mypgp.html,Fax: +49261287
1001312

-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 4697 bytes
Desc: S/MIME Kryptografische Unterschrift
URL: <http://lists.samba.org/pipermail/samba-technical/attachments/20130806/ad5797b1/attachment.bin>


More information about the samba-technical mailing list