[SCM] CTDB repository - branch 1.0.114 created - ctdb-1.0.114-95-g14a1bf4
Michael Adam
obnox at samba.org
Fri Jun 3 09:50:19 MDT 2011
The branch, 1.0.114 has been created
at 14a1bf4fff4ce4a48704d09324e4757fbf043f92 (commit)
- Log -----------------------------------------------------------------
commit 14a1bf4fff4ce4a48704d09324e4757fbf043f92
Author: Michael Adam <obnox at samba.org>
Date: Fri May 20 13:00:55 2011 +0200
Version 1.0.114.2: Start a new series of versions 1.0.114.X based on 1.0.114
This starts at .2 in order to avoid confusion with 1.0.114-1...
commit f6bed28adf391c86564787684d2a702947e3a0b5
Author: Michael Adam <obnox at samba.org>
Date: Tue Apr 5 13:58:09 2011 +0200
packaging: remove the dependency to tdbtool and tdbdump from the spec file
The init script does now check for the availability of tdbdump
and "tdbtool check" and issues warnings if they are not available.
This can remove a dependency loop with building samba RPMs.
(cherry picked from commit c7652c4038e012b7ef9bc1da352dd2c02d60dc29)
commit 6baf8a9e6035edc5b5ee17c5cacfd172a411c30b
Author: Michael Adam <obnox at samba.org>
Date: Tue Apr 5 13:50:00 2011 +0200
ctdb.init: print a warning when tdbdump is found but tdbtoo or "tdbtool check" is not available
(cherry picked from commit afb26e38b617b85cdac14a7cd6dd3c85b8fddbc4)
commit fd7794e223fd1b87863ac82712432d9d396c2061
Author: Michael Adam <obnox at samba.org>
Date: Tue Apr 5 13:43:56 2011 +0200
ctdb.init: check for availability of "tdbtool check" and "tdbdump"
Print a warning if neither is available.
(cherry picked from commit 4137d2a7d31cdce22847cebfc0239cfe2d8e937c)
commit 7508aaa3144d3ebfb8890b8fde232f3a04aba7de
Author: Michael Adam <obnox at samba.org>
Date: Wed May 4 14:28:26 2011 +0200
packaging: add ltdbtool and its manpage to the RPM
commit dd11a1a31cc6e4ccc54faa26813da36d9c1606cb
Author: Michael Adam <obnox at samba.org>
Date: Wed May 4 14:25:48 2011 +0200
install the ltdbtool manpage with "make install"
commit d404b3c669c62f9d522b35e1421431395e8569de
Author: Michael Adam <obnox at samba.org>
Date: Wed May 4 13:44:59 2011 +0200
install ltdbtool with "make install"
commit 64d4a98caefc1789b7f2854146ffa9eeb6016d53
Author: Michael Adam <obnox at samba.org>
Date: Wed May 4 13:44:10 2011 +0200
build "ltdbtool" in "make all"
commit 8bade15bcda9fdb39977fb08f39cfcf56b58c10b
Author: Gregor Beck <gbeck at sernet.de>
Date: Wed May 4 14:17:04 2011 +0200
ltdbtool: add manpage html + roff
Signed-off-by: Michael Adam <obnox at samba.org>
commit d9ccd8f8ebf00c789e147f90ef6c7d0dd424b877
Author: Gregor Beck <gbeck at sernet.de>
Date: Wed May 4 14:14:54 2011 +0200
ltdbtool: add manpage
Signed-off-by: Michael Adam <obnox at samba.org>
commit ca317aa681b9f1b1f840ab0acada7875328b88bb
Author: Gregor Beck <gbeck at sernet.de>
Date: Thu Apr 14 12:51:59 2011 +0200
add ltdbtool - a standalone ltdb tool
This this is a tool to handle (dump and convert) ctdb's local tdb
copies (ltdbs) without connecting to a ctdb daemon.
It can be used to
* dump the contents of a ltdb, printing
the ctdb record header information
* dump a non-clustered tdb database (like tdbdump)
* convert between an ltdb and a non-clustered tdb
(adding or removing ctdb headers)
* convert between 64 and 32 bit ltdbs
(the ctdb record headers differ by 4 bytes of padding)
usage: bin/ltdbtool dump [-p] [-s{0|32|64}] <idb>
bin/ltdbtool convert [-s{0|32|64}] [-o{0|32|64}] <idb> <odb>
Pair-Programmed-With: Michael Adam <obnox at samba.org>
commit e839005cb67b08e3b6556165ebf73ecd46154a33
Author: Gregor Beck <gbeck at sernet.de>
Date: Thu Apr 14 12:55:57 2011 +0200
ctdb catdb: fix escaping of '"' and '\'
Signed-off-by: Michael Adam <obnox at samba.org>
commit cddbaf00adf85ce88640f05016d2c132817289c0
Author: Michael Adam <obnox at samba.org>
Date: Mon Jan 3 13:16:16 2011 +0100
vacuum: use tdb_jenkins_hash() instead of ctdb_hash() for vacuuming lists.
This is to reduce the chance for hash collisions.
We now use the jenkins_hash for the delete_queue and the delete_tree.
commit 99c4dfd7edc319499f516885a9171e13e5bd8bec
Author: Stefan Metzmacher <metze at samba.org>
Date: Mon Apr 18 12:05:28 2011 +0200
lib/tdb: backport from ctdb/1.2 and ctdb/master
In ctdb/master commit d09fa845bd848d04507853809acf42e0471b44bf.
metze
commit ca5c80328d82aa790076182115767abf70cb2c85
Author: Stefan Metzmacher <metze at samba.org>
Date: Mon Apr 18 18:42:14 2011 +0200
Revert "Ignore any scripts that timesout for most events, except startup."
This reverts commit b6d939c9758c7d2e39206838492f2f644dd61db7.
It's a bad idea to ignore hanging scripts, there must be something
wrong if that happens!
metze
Signed-off-by: Michael Adam <obnox at samba.org>
commit 349e44165cc1520fb93f2631541cafc6ecfe64b4
Author: Ronnie Sahlberg <ronniesahlberg at gmail.com>
Date: Sun Mar 13 11:30:52 2011 +1100
Vacuuming: initialize a variable to avoid a harmless valgrind hit
Signed-off-by: Michael Adam <obnox at samba.org>
(cherry picked from commit ad709e99bcad7a4884f2336663d161ba61307ae5)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 1d8b4d9ad6740edadf4c32599bd5282cc46f46be
Author: Michael Adam <obnox at samba.org>
Date: Fri Mar 11 16:05:44 2011 +0100
vacuum: fix a comment typo
(cherry picked from commit a16dc65b4602da5ce2c16578bec2e7882aff240d)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 899ef8ff8e933bebe0a2ae203749485ce90068fd
Author: Michael Adam <obnox at samba.org>
Date: Fri Mar 11 15:57:45 2011 +0100
vacuum: use insert_record_into_delete_queue in ctdb_local_schedule_for_deletion.
This is to take advantage of the hash collision handling and logging
also in ctdb_local_schedule_for_deletion.
(cherry picked from commit 52193b6692091e341ed7a81dbd9a61ae49a8aac5)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit fa521d3bae76ea4b7fb5c52d156769da1e620f63
Author: Michael Adam <obnox at samba.org>
Date: Fri Mar 11 15:55:52 2011 +0100
vacuum: refactor insert_record_into_delete_queue out of ctdb_control_schedule_for_deletion
(cherry picked from commit be4b63ee18933524f780df5c313447e5ef0786d1)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit e6584ccef5d61528a52c194d6e7bfd1fc6b96b74
Author: Michael Adam <obnox at samba.org>
Date: Fri Mar 11 14:57:15 2011 +0100
vacuum: raise a debug level from INFO to DEBUG
when overwriting an existing entry in the delete_queue.
(cherry picked from commit f28e636cc4a04ef982672d5f569ad6b6b963db1f)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 2da9177f71e459400a15e82dd85ad083b7887351
Author: Michael Adam <obnox at samba.org>
Date: Thu Feb 3 16:32:23 2011 +0100
ctdb_ltdb_store_server: honour the AUTOMATIC record flag
Do not delete empty records that carry this flag but store
them and schedule them for deletetion. Do not store the flag
in the ltdb though, since this is internal only and should not
be visible to the client.
(cherry picked from commit f898ff21fa338358179e79381215b13a6bc77c53)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 471e96db0f08a28c912ec439b9ce1fb3d0f207fa
Author: Michael Adam <obnox at samba.org>
Date: Thu Feb 3 16:30:52 2011 +0100
ltdb: add the CTDB_REC_FLAG_AUTOMATIC to the initial header in ctdb_ltdb_fetch()
Signals that this record was not created by a client level store.
(cherry picked from commit 69d34983a37b0324ff7610b8dfdcd8d13bf81c54)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit aae06ce5bb889216ec3a02c559f81229e3634a07
Author: Michael Adam <obnox at samba.org>
Date: Thu Feb 3 16:27:42 2011 +0100
ctdb_private.h: add record flag CTDB_REC_FLAG_AUTOMATIC
This is a flag that shall signa that a record has been automatically generated by ctdb
and not by an explicit client store operation. This will be used in the ctdb_ltdb_fetch
operation which stores an empty record with default initial header before trying to
migrate the record from the dmaster when the record does not exist in the local tdb.
similar to commit 46381a3cb58ccc11422af8f7798c80ea8d72294f.
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 131a43ef68b382b38b9dd90e449b4d05775af933
Author: Michael Adam <obnox at samba.org>
Date: Tue Dec 28 13:19:22 2010 +0100
ctdb_ltdb_store_server: add ability to send SCHEDULE_FOR_DELETION control to ctdb_ltdb_store.
(cherry picked from commit ab2711701999a5ecc23a36b3d9ba8e94f92e4c87)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 4df5393cf164376b5a31c4d3b47a7a1fd6bbf780
Author: Michael Adam <obnox at samba.org>
Date: Tue Dec 21 18:08:11 2010 +0100
ctdb_ltdb_store_server: Improve debug message in ctdb_ltdb_store when store or delete fails.
(cherry picked from commit 2559b2a45eb11834da3b0e0963e24351c8b7477f)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 7fcd7020e0c1003c1b4c5469029567652b334d78
Author: Michael Adam <obnox at samba.org>
Date: Tue Dec 21 17:50:52 2010 +0100
ctdb_ltdb_store_server: always store the data when ctdb_ltdb_store() is called from the client
This also fixes a segfault since ctdb_lmaster uses the vnn_map.
(cherry picked from commit e58c8f51f27e468897af5210b80e5f5f45c3c4bb)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit dfd01892bc4a03f3e324a78691da135baddfd140
Author: Michael Adam <obnox at samba.org>
Date: Fri Dec 10 14:13:50 2010 +0100
ctdb_ltdb_store_server: implement fastpath vacuuming deletion based on VACUUM_MIGRATED flag.
When the record has been obtained by the lmaster as part of the vacuuming-fetch
handler and it is empty and never been migrated with data, then such records
are deleted instead of being stored. These records have automatically been
deleted when leaving the former dmaster, so that they vanish for good when
hitting the lmaster in this way. This will reduces the load on traditional
vacuuming.
Pair-Programmed-With: Stefan Metzmacher <metze at samba.org>
(cherry picked from commit c9b65f3602f51bcbf0e6d82c12076c31e4aebe38)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 982031c0702e35395ad30fdf13607b64b1495f1f
Author: Michael Adam <obnox at samba.org>
Date: Fri Dec 3 15:29:21 2010 +0100
ctdb_ltdb_store_server: delete an empty record that is safe to delete instead of storing locally.
When storing a record that is being migrated off to another node
and has never been migrated with data, then we can safely delete it
from the local tdb instead of storing the record with empty data.
Note: This record is not deleted if we are its lmaster or dmaster.
Pair-Programmed-With: Stefan Metzmacher <metze at samba.org>
(cherry picked from commit 3cca0d4b48325d86de2cb0b44bb7811a30701352)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 7b6b9b3b5a6d88297bc964385b8ec8e3bd456b3a
Author: Michael Adam <obnox at samba.org>
Date: Thu Dec 30 18:19:32 2010 +0100
server: Use the ctdb_ltdb_store_server() in the ctdb daemon for non-persistent dbs
This is realized by adding a ctdb_ltdb_store_fn function pointer to the db
context and filling it in the attach procedure for non-persistent dbs.
similar to commit df49ec44de80affa5ccc637dec12a20a26e8706e.
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit d49a2cd7c3bdd7f8bf796428aab27b138fb0f195
Author: Michael Adam <obnox at samba.org>
Date: Thu Dec 30 17:44:51 2010 +0100
server: create a server variant ctdb_ltdb_store_server() of ctdb_ltdb_store().
This is supposed to contain logic for deleting records that are safe
to delete and scheduling records for deletion. It will be called in
server context for non-persistent databases instead of the standard
ctdb_ltdb_store() function.
(cherry picked from commit 23631ffc152486aed9ce5b69a391e52bc4947833)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 6954e70372a3c285d6835c1d5a5b0547d9462e53
Author: Michael Adam <obnox at samba.org>
Date: Tue Dec 28 13:14:23 2010 +0100
daemon: fill ctdb->ctdbd_pid early
(cherry picked from commit 3da1e2e30bf34622f08e6ecd5b8fe55684e5007a)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 02d5d7f293956eb1c64881944a592f3da82c7319
Author: Michael Adam <obnox at samba.org>
Date: Tue Dec 21 15:29:46 2010 +0100
test: send SCHEDULE_FOR_DELETION control from randrec test.
(cherry picked from commit 30aa55b3efc6fbd4078f93da386b6aeb337c1a0c)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 0458aa9cdc082d4bcd0d6d91746df06505411043
Author: Michael Adam <obnox at samba.org>
Date: Tue Dec 21 15:29:23 2010 +0100
client: add accessor function ctdb_header_from_record_handle().
similar to commit cf57efd440ccc3db381386f4749bfcbf8ac5ecae.
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 631f423f83f60a04676843c1595618c82b8937c7
Author: Michael Adam <obnox at samba.org>
Date: Tue Dec 28 13:13:34 2010 +0100
vacuum: add ctdb_local_schedule_for_deletion()
(cherry picked from commit b70bc141d84f7355d2c6c901961b7366db566980)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit e4a98c08a7731d02a63fbefd673a8c1eafec3f67
Author: Michael Adam <obnox at samba.org>
Date: Tue Dec 21 14:25:48 2010 +0100
server: implement a new control SCHEDULE_FOR_DELETION to fill the delete_queue.
similar to commit 680223074e992b32ccf6f42cb80c3fa93074fee7.
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit d45c13a80fb4cffa9314e43f75433394e42dde62
Author: Michael Adam <obnox at samba.org>
Date: Wed Mar 9 00:57:55 2011 +0100
control: add a new control opcode CTDB_CONTROL_SCHEDULE_FOR_DELETION
similar to commit 4cebfa33db3c7effa087f753530c52b2dd8550e6.
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 667fd668fa061fcdc4ac2ba0ca0c766507d7ad5e
Author: Michael Adam <obnox at samba.org>
Date: Wed Mar 9 00:56:25 2011 +0100
control: add macro CHECK_CONTROL_MIN_DATA_SIZE.
This is for the control dispatcher to check whether the input data has
a required minimum size.
(cherry picked from commit 2038e745db33cc5c3b4e2db8a00a57ede03906a2)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 093d555e0ca5aafafbba65f6e1fefe7a9cef75fd
Author: Michael Adam <obnox at samba.org>
Date: Thu Dec 23 11:54:09 2010 +0100
vacuum: lower level of hash collision debug message to INFO
(cherry picked from commit b9bdef46fedfbc543263b67cfee3e896773cd8e8)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 9ab3b3a795e32eb548551c12a54e4f4cb0f3b460
Author: Michael Adam <obnox at samba.org>
Date: Thu Dec 23 00:27:27 2010 +0100
vacuum: add statistics output to the fast and full traverse runs.
(cherry picked from commit 3addd28aa73883b3b05888e309d19db0eb67eab9)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 81bb642dd0163462446617269ff64331a5e83bf1
Author: Michael Adam <obnox at samba.org>
Date: Tue Dec 21 14:19:00 2010 +0100
vacuum: refactor insert_delete_record_data_into_tree() out of add_record_to_delete_tree()
for reuse in filling the delete_queue.
(cherry picked from commit 7bbb12695c24da25671f1c39a411295d35870d2c)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 6a5d8eef18916c5085fb9ab7820a2199d0550798
Author: Michael Adam <obnox at samba.org>
Date: Mon Dec 20 21:43:41 2010 +0100
vacuum: change all Vacuum*Interval tunables to default to 10
So, by default we have a fastpath vacuuming every 10 seconds and
full blown db-traverse vacuuming once every 10 minutes.
(cherry picked from commit 4f0ace982dbb5b4f9c035dbf4cb0ae74cd18d81b)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 612063ce2d7bee6b60656703c9524a45a59ad7c8
Author: Michael Adam <obnox at samba.org>
Date: Mon Dec 20 21:30:39 2010 +0100
vacuum: disable full db-traverse vacuuming runs when VacuumFastPathCount == 0
(cherry picked from commit 571683e7c48aeed8ce41c584d016ced7ff0d2e2d)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 13ac62d3cd4a22e5498cfe97b3ddc22b231a5468
Author: Michael Adam <obnox at samba.org>
Date: Mon Dec 20 18:03:38 2010 +0100
vacuum: Only run full vacuumig (db traverse) every VacuumFastPathCount times.
(cherry picked from commit 23b8c8c5fc8604ee0bd6da1f4b5152277eb5f1c0)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit d86cbcd7dff6d86ed8e08fd292f2e2a1cfe6563d
Author: Michael Adam <obnox at samba.org>
Date: Mon Dec 20 17:54:04 2010 +0100
vacuum: reset the fast path count in the event handle if it exceeds the limit.
similar to commit 91e6d36a190b1c9e4c8b18f7833e51c5c9a67574.
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit b703ede0ca80396067b3003d33c4a26b79640ff3
Author: Michael Adam <obnox at samba.org>
Date: Mon Dec 20 17:49:29 2010 +0100
vacuum: bump the number of fast-path runs in the vacuum child destructor
(cherry picked from commit c0668bfe0bb4e69988ae34d875568d08539e6fb9)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 684396af4883a5d093351624de3f3d208262bf03
Author: Michael Adam <obnox at samba.org>
Date: Mon Dec 20 17:44:02 2010 +0100
vacuum: add a fast_path_count to the vacuum_handle.
(cherry picked from commit 53a39d0cc5ea251c2189ec8178ccb769fa046c43)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit ae90a058ada553d33841e6d3eb82625b7617899f
Author: Michael Adam <obnox at samba.org>
Date: Mon Dec 20 17:42:25 2010 +0100
Add a tunable VacuumFastPathCount.
This will control how many fast-path vacuuming runs wil have to
be done, before a full vacuuming will be triggered, i.e. one with
a db-traversal.
similar to commit 0d997ec7e61a7bee2cb05456f9c7d5e6f7a44797.
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 0987423acfc140737dd24a6a2d3a26c42347284b
Author: Michael Adam <obnox at samba.org>
Date: Mon Dec 20 17:25:35 2010 +0100
vacuum: traverse the delete_queue befor traversing the database.
(cherry picked from commit 04c335f9195a5fd83c91a57d06b1e4eaa511844e)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 7ca65ac8cbcd123b848216b8b1c406703c582c19
Author: Michael Adam <obnox at samba.org>
Date: Mon Dec 20 17:24:32 2010 +0100
vacuum: add delete_queue_traverse() for traversal of the delete_queue.
(cherry picked from commit 5eee05c4d256c08f4ee60a1a69efda6844e39729)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 7537272336f526a633b703904a952f8a39b24d9c
Author: Michael Adam <obnox at samba.org>
Date: Tue Dec 21 11:22:50 2010 +0100
vacuum: reduce indentation in add_record_to_delete_tree()
This simplyfies the logical structure a bit by using early return.
(cherry picked from commit 4d32908fdcec120426536a761e1d0be60f076198)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit e59ea993bc7af5c62e926f5c3a90f51b17dda769
Author: Michael Adam <obnox at samba.org>
Date: Mon Dec 20 17:11:27 2010 +0100
vacuum: refactor new add_record_to_delete_tree() out of vacuum_traverse().
This will be reused by the traversal of the delete_queue list.
(cherry picked from commit 4407e5a7fb045ce56b6d902f7116de663ea648cb)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit edd90895e98fc2235ed7a8a5296e7672590eb56f
Author: Michael Adam <obnox at samba.org>
Date: Mon Dec 20 16:41:13 2010 +0100
vacuum: skip adding records to list of records to send to lmaster on lmaster
This list is skipped afterwards when the lists are processed.
(cherry picked from commit e99834c1a2eea60f7f974c0689ae0a65cfe178ff)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit eccc4b71d837d7a226d3784e3e11789297915aba
Author: Michael Adam <obnox at samba.org>
Date: Mon Dec 20 16:31:27 2010 +0100
vacuum: refactor new add_record_to_vacuum_fetch_list() out of vacuum_traverse().
This is the function that fills the list of records to send to each lmaster
with the VACUUM_FETCH message.
This function will be reused in the traverse function for the delete_queue.
(cherry picked from commit d4ab790c1f679e833eb97816762fcfcee15ccb10)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit f603c0de0c0506981d1de4fd03b56fa7974e02cb
Author: Michael Adam <obnox at samba.org>
Date: Mon Dec 20 10:55:53 2010 +0100
server: rename ctdb_repack_db() to ctdb_vacuum_and_repack_db()
(cherry picked from commit 6c603f85726d2efac9710af7c4875ded2ca7230e)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 8ce09054b94f05317a0e77249048e3868c43a52b
Author: Michael Adam <obnox at samba.org>
Date: Fri Dec 17 02:22:02 2010 +0100
When wiping a database, clear the delete_queue.
(cherry picked from commit 731a6011ce4a1301f86eacb039955745f2b5d866)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit a7cf9493fcb9038ce8b7205eb2a794fbe2674d6b
Author: Michael Adam <obnox at samba.org>
Date: Fri Dec 17 01:53:25 2010 +0100
vaccum: clear the fast-path vacuuming delete_queue after creating the vacuuming child.
Maybe we should keep a copy for the case that the vacuuming fails?
(cherry picked from commit f19fe5b45748a6998c6950a5b1db7ec2c4468c1c)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit e20e19db13a03c70322a7ec168a69d1fbb1854c8
Author: Michael Adam <obnox at samba.org>
Date: Fri Dec 17 01:38:09 2010 +0100
When attaching to a non-persistent DB, initialize the delete_queue.
(cherry picked from commit 0aff1b61dd1b683c6739478008a5b014b933df50)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 985abab42eefe70c0cd32a12d7bdfe45bcb41955
Author: Michael Adam <obnox at samba.org>
Date: Wed Dec 22 14:50:53 2010 +0100
Add a delete_queue to the ctdb database context struct.
This list will be filled by the client using a new
delete control. The list will then be used to implement
a fast-path vacuuming that will traverse this list instead
of traversing the database.
similar to commit 9bbedf786b26bb074f668b31f29a9032af958673.
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit d9523edc85988259528dee84661c3e1383d7968d
Author: Michael Adam <obnox at samba.org>
Date: Fri Dec 10 14:11:38 2010 +0100
call: becoming dmaster in VACUUM_MIGRATION, set the VACUUM_MIGRATED record flag
This temporary flag is used for the local record storage function to
decide whether to delete an empty record which has never been migrated
with data as part of the fast-path vacuuming process or, or to store
the record.
(cherry picked from commit c11ca778ee90444c44dee0a629cd2eefa3a1f75e)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 895e502d562d20426dc984cddaab0b0446b4fa7d
Author: Michael Adam <obnox at samba.org>
Date: Fri Dec 10 14:07:21 2010 +0100
call: hand the submitted record_flags to local record storage function.
(cherry picked from commit 4079b8bf7a57a27a45d29784a1b0a414c778e552)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit b84a2e69e1dc94f88d65bfa90e6af06199f3578e
Author: Michael Adam <obnox at samba.org>
Date: Fri Dec 10 14:02:33 2010 +0100
call: transfer the record flags in the ctdb call packets.
This way, the MIGRATED_WITH_DATA information can be transported
along with the records. This is important for vacuuming to function
properly.
The record flags are appended to the data section of the ctdb_req_dmaster
and ctdb_reply_dmaster structs.
Pair-Programmed-With: Stefan Metzmacher <metze at samba.org>
(cherry picked from commit 945187d64cfc7bd30a0c3b0d548cbe582d95dde3)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit a1c5d361c2c4244a46c41d8be426a3008dac2b16
Author: Michael Adam <obnox at samba.org>
Date: Fri Dec 10 13:59:37 2010 +0100
server: in the VACUUM_FETCH handler, add the VACUUM_MIGRAION to the call flags
This way, the records coming in via this handler, can be treated appropriately.
Namely, they can be deleted instead of being stored when the meet the fast-path
vacuuming criteria (empty, never migrated with data...)
(cherry picked from commit fb5d832104970320359b3e474eb291ca3d629380)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit a12c6c20e1012821d56eee5f91d305e9a6c4bd64
Author: Michael Adam <obnox at samba.org>
Date: Fri Dec 10 13:57:01 2010 +0100
add a new record flag CTDB_REC_FLAG_VACUUM_MIGRATED.
This is to be used internally. The purpose is to flag a record
as been migrated by a VACUUM_MIGRATION, which is triggered by
a VACUUM_FETCH message as part of the vacuuming. The local store
routine will base its decision whether to delete or to store
the record (among other things) upon the value of this flag.
This flag should never be stored in the local database copies.
similar to commit dd2449c422f323f9b5485e45107a9cc5acc09e08.
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 99b1a1572df66186a0dd149a11e9e474ec6130e9
Author: Michael Adam <obnox at samba.org>
Date: Fri Dec 10 14:22:55 2010 +0100
call: Move definition of call flags down to the definition of the flags field.
similar to commit 86c844fb08a7fd33e94f56b8d5e43278120e1162.
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 2fcdffc5b36e7d3da5d5ad1f5f3dc3078ded0909
Author: Michael Adam <obnox at samba.org>
Date: Fri Dec 10 14:24:40 2010 +0100
call: add new call flag CTDB_CALL_FLAG_VACUUM_MIGRATION
This is to be used when the CTDB_SRVID_VACUUM_FETCH message
triggers the migration of deleted records to the lmaster.
The lmaster can then delete records that have not been
migrated with data instead of storing them.
similar to commit 455cc6616e10b7f09589f9b87cb60f591bb502b0.
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit ded1b95c7cce0e68b04c14e99a0c4daeac75b3da
Author: Michael Adam <obnox at samba.org>
Date: Fri Dec 3 15:24:06 2010 +0100
recoverd: in a recovery, set the MIGRATED_WITH_DATA flag on all records
Those records that are kept after recovery, are non-empty, and
stored identically on all nodes. So this is as if they had been
migrated with data.
Pair-Programmed-With: Stefan Metzmacher <metze at samba.org>
(cherry picked from commit 101be642e492a3a54231e2e3e6553a59380fe702)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 02fea8d72d54a37bd457bf2465020f106ef4b691
Author: Michael Adam <obnox at samba.org>
Date: Fri Dec 3 15:21:51 2010 +0100
server: when we migrate off a record with data, set the MIGRATED_WITH_DATA flag
(cherry picked from commit f5fb232117886186066ab3430fdd2307cba94960)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit f6a7ec85ea7f129a40042c8618587ed8931d7347
Author: Ronnie Sahlberg <ronniesahlberg at gmail.com>
Date: Mon Dec 6 13:08:53 2010 +1100
Add two new flags for the ltdb header.
One of which signals that the record has never been migrated to/from a node
while containing data.
This property "has never been migrated while non-zero" is important later
to provide heuristics on which records we might be able to purge
from the tdb files cheaply, i.e. without having to rely on the full-blown
database vacuum.
These records are belived to be very common and the pattern would look like
this :
1, no record exists at all.
2, client opens a file
3, samba requests the record for this file
4, an empty record is created on the LMASTER
5, the empty record is migrated to the DMASTER
6, samba writes a <sharemode> to the record locally and the record grows
7, client finishes working the file and closes the file
8, samba removes the sharemode and the record becomes empty again.
9, much later : vacuuming will delete the record
At stage 8, since the record has never been migrated onto a node wile being
non-zero it would be safe, and much more efficient to just delete the record
completely from the database and hand it back to the LMASTER.
The flags occupy the same uint32_t as was previously used for laccessor/lacount
in the header. For now, make sure the flags only define/use the top 16 bits
of this field so that we are sure we dont collide with bits set to one
from previous generations of the ctdb cluster database prior to this
change in semantics of this word.
This is a rework of Michaels patch :
commit 2af1a47cbe1a608496c8caf3eb0c990eb7259a0d
Author: Michael Adam <obnox at samba.org>
Date: Tue Nov 30 17:00:54 2010 +0100
add a DEFAULT record flag and a MIGRATED_WITH_DATA record flag.
similar to commit e075670dee8e6ecaba54986f87a85be3d0528b6b.
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit c08ec58f867eb811f03bdb914b0f35f589d331a3
Author: Ronnie Sahlberg <ronniesahlberg at gmail.com>
Date: Mon Nov 29 13:07:59 2010 +1100
Remove LACOUNT and LACCESSOR and migrate the records immediately.
This concept didnt work out and it is really just as expensive as a full migration
anyway, without the benefit of caching the data for subsequence accesses.
Now, migrate the records immediately on first access.
This will be combined with a "cheap vacuum-lite" for special empty records to
prevent growth of databases.
Later extensions to mimic read-only behaviour of records will include proper shared read-only locking of database records, making the laccessor/lacount read-only access to the data obsolete anyway.
By removing this special case and handling of lacount laccessor makes the codapath where shared read-only locking will be be implemented simpler, and frees up space in the ctdb_ltdb header for use by vacuuming flags as well as read-only locking flags.
similar to commit 155dd1f4885fe142c6f8bd09430f65daf8a17e51.
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit d9de260909b40ed028a3f05c2bfa2c6fb6d1e3e0
Author: Ronnie Sahlberg <ronniesahlberg at gmail.com>
Date: Wed Jun 9 14:31:05 2010 +1000
add extra logging for failed ctdb_ltdb_unlock() for a few more places
it is called from
(cherry picked from commit 5c0fea90c6474a51992a9c4aeb6af7dfeb213ee0)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 8dce755e51ff0534d8439ac4465607b7413946ed
Author: Michael Adam <obnox at samba.org>
Date: Thu Feb 3 12:15:41 2011 +0100
vacuum: check lmaster against num_nodes instead of vnn_map->size
When lmaster is bigger than the biggest recorded node number,
then exit the traverse with error.
(cherry picked from commit 3930c7796b72bbf275bbca8aaeceec3e705a964b)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit f1b1718a0f66d5e58f6800a117f98c20a4577e0e
Author: Michael Adam <obnox at samba.org>
Date: Thu Feb 3 17:47:36 2011 +0100
vacuum: reduce indentation of the loop sending VACUUM_FETCH controls
This slightly improves the code structure in that loop.
similar to commit bc4990e600c53433a924a0d70e3488a5a6bdc1ff.
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit c03ab282086f84a4a0ef03d0434868887fe7e76b
Author: Michael Adam <obnox at samba.org>
Date: Thu Feb 3 12:26:45 2011 +0100
vacuum: correctly send TRY_DELETE_RECORDS ctrl to all active nodes
Originally, the control was sent to all records in the vnn_map, but
there was something still missing here:
When a node can not become lmaster (via CTDB_CAPABILITY_LMASTER=no)
then it will not be part of the vnn_map. So such a node would
be active but never receive the TRY_DELETE_RECORDS control from a
vacuuming run.
This is fixed in this change by correctly building the list of
active nodes first in the same way that the recovery process does it.
(cherry picked from commit 49247df4a47a8a107fa7dd7b187e69e243e6bdbe)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit f10183e1189ca819a79c754f03279b24dafe998d
Author: Michael Adam <obnox at samba.org>
Date: Thu Feb 3 12:18:58 2011 +0100
vacuum: in ctdb_vacuum_db, fix the length of the array of vacuum fetch lists
This patch fixes segfaults in the vacuum child when at least one
node has been stopped or removed from the cluster:
The size of the vnn_map is only the number of active nodes
(that can be lmaster). But the node numbers that are referenced
by the vnn_map spread over all configured nodes.
Since the array of vacuum fetch lists is referenced by the
key's lmaster's node number later on, the array needs to
be of size num_nodes instad of vnn_map->size.
similar to commit 136508e3f4dd0acc210dde938ad59ef38b63d3a1.
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit ceb84f0b4fa8674d571dc0955f1f78934a548cb1
Author: Michael Adam <obnox at samba.org>
Date: Mon Dec 20 16:26:50 2010 +0100
Fix typos in a comment in vacuum_traverse.
(cherry picked from commit 6a4df8242ee4d095ff03229a168b83bcd84c8a7a)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit dffa104e6bbe04b5223cb02fb7de0137050e74a9
Author: Michael Adam <obnox at samba.org>
Date: Tue Dec 21 17:18:03 2010 +0100
tests: fix segfault in store test when connection to ctdbd failed.
(cherry picked from commit 43a15d2906b3f9d08af234f55a3a0f614571d3a7)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 234263cd465e2e86d95698cc23e2fa1dd4248aef
Author: Michael Adam <obnox at samba.org>
Date: Tue Dec 21 17:15:41 2010 +0100
tests: fix segfault in fetch_one test when connection to ctdbd fails
(cherry picked from commit 89c8e52de3878b8e29c6a24725eb66c18fd1f52a)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit aad8b6bb12148c740a60eac9cee4edb89643f14a
Author: Michael Adam <obnox at samba.org>
Date: Tue Dec 21 17:14:33 2010 +0100
tests: fix segfault in fetch test when connection to ctdb failed.
similar to commit f493eb31abf956fd38347c2ff77026e380a9664d
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit 91b0896e9431268efe2f9a5d4a5922e433e4c293
Author: Michael Adam <obnox at samba.org>
Date: Tue Dec 21 17:11:26 2010 +0100
tests: fix segfault in randrec test when connection to daemon fails.
(cherry picked from commit 715999d7ffbf10f3a57de3ee08a293165333553a)
Signed-off-by: Stefan Metzmacher <metze at samba.org>
commit c17a2b2e031074f5b004df99cea9a61135326dba
Author: Michael Adam <obnox at samba.org>
Date: Fri Dec 3 15:39:44 2010 +0100
gitignore: add tags file
commit 31b7c257b71cfa63beae14d197b0bf80a0f1ca1d
Author: Michael Adam <obnox at samba.org>
Date: Fri Dec 3 15:39:26 2010 +0100
gitignore: add vi swap files
commit 2c605f3527bf1ae9e602de1040ae06d07829114a
Author: Michael Adam <obnox at samba.org>
Date: Tue Nov 30 17:09:09 2010 +0100
Remove prototype of non-existing function ctdb_set_max_lacount()
commit 2aa0e55edc7b9a9d4aa50afdefa3d119de9fe6f9
Author: Michael Adam <obnox at samba.org>
Date: Wed Nov 24 08:01:01 2010 +0100
server: add a comment explaining the call redirect logic in ctdb_call_send_redirect().
commit c242818639c01e33460166ecf79c7169f5e11a25
Author: Stefan Metzmacher <metze at samba.org>
Date: Mon Jul 12 14:11:41 2010 +0200
config/interface_modify.sh: do the echo before running the script
metze
Signed-off-by: Rusty Russell <rusty at rustcorp.com.au>
commit a6ad686c80541c7f0f2e2b2ca7d9ec816e1b638c
Author: Stefan Metzmacher <metze at samba.org>
Date: Mon Jul 12 14:05:51 2010 +0200
config/interface_modify.sh: before calling a script check if it exists and is executable
For non bash shells $_s_script might end with '/*'.
We do the workarround this way, because it makes sense to check
that a script is executable, before trying to execute it.
metze
[ This actually applies to any shell -- Rusty Russell ]
Signed-off-by: Rusty Russell <rusty at rustcorp.com.au>
commit 892d2ae227dd9f63a5cff813e1f22f9ff7a06011
Author: Stefan Metzmacher <metze at samba.org>
Date: Wed Nov 10 13:24:59 2010 +0100
config/13.per_ip_routing: add CTDB_PER_IP_ROUTING_DEBUG option for debugging
CTDB_DEBUGLEVEL=DEBUG also triggers CTDB_PER_IP_ROUTING_DEBUG=yes.
metze
commit fb70bfb5e8f3ea24d24c631779b8b190c8424847
Author: Stefan Metzmacher <metze at samba.org>
Date: Wed Nov 10 12:11:49 2010 +0100
config/13.per_ip_routing: we don't need locks in generate_table_id() anymore
metze
commit 4f7bdf765a51f20ee9dc2a6f86dc1189dc38108d
Author: Stefan Metzmacher <metze at samba.org>
Date: Tue Feb 9 16:31:50 2010 +0100
config/13.per_ip_routing: use a global flock for the events which need to do something
We call ourself recursively with the same args under the lock.
This hopefully prevents races where we endup with an empty
routing table for an ip.
metze
commit c169f94eed43d1a772932b2222084b713c875156
Author: Stefan Metzmacher <metze at samba.org>
Date: Wed Nov 10 13:00:46 2010 +0100
Revert "config: let 13.per_ip_routing use a flock for generate_auto_link_local()"
This reverts commit dc2d0d0e559308ad2676f9ad973746c147d65eb9.
This is not needed anymore as we use a global flock for the whole event
metze
commit 4735b6bb05f78735477fa67ce8bca4f0f5178a04
Author: Stefan Metzmacher <metze at samba.org>
Date: Wed Nov 10 09:35:51 2010 +0100
event.d/13.per_ip_routing: remember the result if we want to print it
metze
commit 9ece6e7c304001503144b17d0ab9f3f204c8a973
Author: Stefan Metzmacher <metze at samba.org>
Date: Tue Oct 19 19:21:23 2010 +0200
events.d/11.routing: handle "updateip" event
metze
commit 921c7db5eb890acea2ff209594f7ff11d374751f
Author: Stefan Metzmacher <metze at samba.org>
Date: Tue Aug 31 09:28:34 2010 +0200
server/banning: also release all ips if we're banning ourself
metze
commit 6b2ee15904ba6ee452d592ff4e65e8ab1bba06a1
Author: Stefan Metzmacher <metze at samba.org>
Date: Mon Aug 30 18:25:28 2010 +0200
server/recoverd: if we can't get the recovery lock, ban ourself
metze
commit d69edc873367405162cbc2c116fdca41969c4b86
Author: Stefan Metzmacher <metze at samba.org>
Date: Tue Aug 31 08:42:32 2010 +0200
server/recoverd: do takeover_run after verifying the reclock file
metze
commit d4ae8406455d222051db75c4809d731203e82b89
Author: Stefan Metzmacher <metze at samba.org>
Date: Tue Aug 24 09:22:49 2010 +0200
server/monitor: ask for a takeoverrun after propagating our new flags
metze
-----------------------------------------------------------------------
--
CTDB repository
More information about the samba-cvs
mailing list