8 Commits

Author	SHA1	Message	Date
Alex Sharov	9091ce62bb	KV reduce features amount (#975) ... * move IdealBatchSize method to Batch object :-) remove cursor.Walk remove kv.IdealBatchSize * remove bolt_db.go file * move method NoValueCursor to tx object	2020-08-26 07:03:50 +01:00
Alex Sharov	522287ac18	Transactional cycle (#966) ... * v0 * v1 * v3 * v4 * clean * temporary fix of txpool * Add debug logs about tx start/commit * Add debug logs about tx start/commit * Add debug logs about tx start/commit * add condition * tx pool to not hold own db * try to enable TxPool in integration * exclude tx pool from tx * exclude tx pool from integration * reduce limit * fix integration * clean * clean * clean * clean * clean * exclude tx pool unwind * exclude tx pool unwind in integration * fix integration tx pool * fix commit * fix current stage after unwind * fix current stage after unwind * fix linter * move unwind of tx_pool after unwind of unwind of senders, then all stages from body to tx_pool will be inside tx. * move body and headers unwind out of tx * fix unwind order after reboot * add support external tx to exec stage * clean * clean * clean * clean * clean * add logs * better id check * better id check	2020-08-26 07:02:10 +01:00
Alex Sharov	43a4e34a6e	[to discuss] exec blocks without ObjectDb: Mutation over TxDb (#947) ... * use mutation over tx * clean * clear * add .CommitAndBegin() method * clean * increase timings for logging * return ideal batch size	2020-08-24 12:07:59 +01:00
Alex Sharov	a6be18b915	ticker-based logs (#954) ... * timer-based logs * timer-based logs * delegate progress calculation to user * delegate progress calculation to user * delegate progress calculation to user * clear * add logs to senders recovery * use default dir in integration * more logs * more logs	2020-08-22 12:12:33 +02:00
ledgerwatch	01f211f3b8	Revert "IH: no retain list (#946)" (#948) ... This reverts commit f86ed64288.	2020-08-20 13:37:34 +01:00
Alex Sharov	f86ed64288	IH: no retain list (#946) ... * experiment of not using retain list * better handle sub-tx * save progress * don't touch collector * don't run collector on sub-tx because of `mdb_cursor_put: MDB_TXN_FULL: Transaction has too many dirty pages - transaction too big` * clear * clear	2020-08-20 11:42:43 +01:00
Alex Sharov	081d02920d	Remove "Bucket" class from KV abstraction (#928) ... * drop Bucket object from KV abstraction * add some non-public methods * rebase master * rebase master	2020-08-17 08:24:59 +01:00
Alex Sharov	0e253e7336	lmdb transactions of unlimited size (#918) ... * add logging to loader * use pure tx in etl loading, logs in mutation commit * clean * bletter logging and more cleanup * bletter logging and more cleanup * increase batch size to 500M * better batch commit logging * async fsync * sync fsync * sync fsync * unify logging * fix corner-case when etl can use empty bucket name * fix tests * better logging * better logging * rebase master * remove lmdb.NoMetaSync flag for now * consistent walk and multi-walk * clean * sub tx * add consistent multi-put * implement dupsort support in one new cursor method * clear	2020-08-17 07:45:52 +01:00