185 Commits

Author	SHA1	Message	Date
awskii	0a4e293b4f	e4 speedup collate/prune (#944) ... Continuing experiments on reducing time consumption of each aggregate step.	2023-03-21 23:33:06 +00:00
awskii	08c5e41ea6	E4 metrics update (#939)	2023-03-16 23:59:24 +00:00
Alex Sharov	e143f7756f	e3: history no auto-increment (#935)	2023-03-15 06:47:48 +00:00
alex.sharov	59238cf44d	e3: less merge logs	2023-03-15 13:34:13 +07:00
hexoscott	4493b598b9	read config yaml file to check for metrics being enabled (#909) ... created to help with https://github.com/ledgerwatch/erigon/issues/6530	2023-03-14 00:07:27 +00:00
alex.sharov	ac75ffcda0	save	2023-03-13 19:07:50 +07:00
alex.sharov	f5faade958	save	2023-03-13 15:44:19 +07:00
Alex Sharov	b968398cbd	e3: split "changed keys" iterator to simplify (#933)	2023-03-13 08:06:37 +00:00
Alex Sharov	6f17999b1f	e3: simplify wal (#932)	2023-03-13 02:35:14 +00:00
awskii	9f522be0bb	E4 integrate state (#930) ... minor refactoring of state/aggregator. added simple aggregator metrics.	2023-03-10 19:20:47 +00:00
alex.sharov	c48bbde775	save	2023-03-09 14:56:13 +07:00
alex.sharov	3f4fdb9e20	remove NextBatch method	2023-03-09 09:37:55 +07:00
Alex Sharov	05d0018864	e3: use iterators composition in invIndex.Range( (#926)	2023-03-09 02:26:29 +00:00
alex.sharov	51698bfc97	more history tests	2023-03-08 10:18:58 +07:00
alex.sharov	565ab562a4	more history tests	2023-03-08 10:09:43 +07:00
Alex Sharov	44f8a908db	etl: distinct empty values from nil (#919) ... Reverts ledgerwatch/erigon-lib#918	2023-03-07 04:19:08 +00:00
Alex Sharov	f0a051c44c	Revert "etl: distinct empty values from nil" (#918) ... Reverts ledgerwatch/erigon-lib#902	2023-03-07 03:22:20 +00:00
Alex Sharov	f4a02864a9	etl: distinct empty values from nil (#902)	2023-03-07 02:30:45 +00:00
awskii	f645d8daf8	moved state tests to benchmarks/fuzz, speedup test run (#917)	2023-03-06 18:40:04 +00:00
awskii	32eddc9df4	E4 btree index (#914) ... recreated branch from https://github.com/ledgerwatch/erigon-lib/pull/891 without fixups for windows tests	2023-03-03 18:32:03 +00:00
Alex Sharov	5edc0612ce	e3: close files (#912)	2023-03-02 05:05:34 +00:00
Alex Sharov	18a0f2bafa	e3: less locks (#911)	2023-03-01 07:59:54 +00:00
Alex Sharov	4d6d154bec	e3: less wal locks (#908)	2023-02-27 07:02:55 +00:00
Alex Sharov	d548f225b9	e3: index readers pool (#906)	2023-02-26 02:04:19 +00:00
Alex Sharov	c68d3c4ff8	eliasfano iterator.Seek() (#904)	2023-02-24 05:59:36 +00:00
Alex Sharov	70f4a28e0e	e3: optimize iterators, step1 (#903)	2023-02-24 03:31:10 +00:00
alex.sharov	d14c31f185	Revert "save" ... This reverts commit 5679d509d2.	2023-02-21 09:11:12 +07:00
alex.sharov	5679d509d2	save	2023-02-21 09:07:42 +07:00
Alex Sharov	565acd3624	e3: read files list from db (#885)	2023-02-13 05:16:58 +00:00
Alex Sharov	e647e5fe3b	e3: reduce buildIndex ctx scope (#889)	2023-02-12 09:24:16 +00:00
Alex Sharov	e57fe47ffb	e3: temporary remove semaphore (#888)	2023-02-12 16:06:24 +07:00
Alex Sharov	3e933bc456	Downloader: "incomplete" markers are more important than "complete", so commit them with fsync (#883) ... On power-off recent "no-sync" txs may be lost. It will cause 2. cases: - Good piece on disk and recent "complete" db marker lost. Self-Heal by re-download. - Bad piece on dis and recent "incomplete" db marker lost. No Self-Heal. So, can't afford loosing recent "incomplete" markers.	2023-02-10 13:20:13 +07:00
Alex Sharov	ef4e4e5402	less logs about compression (#882)	2023-02-09 12:28:07 +07:00
Alex Sharov	1b22208462	e3: Thread safe reopen folder (#881)	2023-02-09 12:11:36 +07:00
Alex Sharov	6254a32e4b	e3: MakeContext must not see garbage files (deleted, overlapped, etc...). make it cheaper. (#880)	2023-02-08 12:50:44 +07:00
Alex Sharov	9d7928f2d3	e3: to fix test (#879)	2023-02-06 09:54:30 +07:00
Alex Sharov	4344efa765	e3: more mergeFiles tests, refcnt for LocalityIndex (#878)	2023-02-03 19:14:34 +07:00
Alex Sharov	c6d823dae0	e3: last reader to close/remove merged files (marked as canDelete) inside tx.Rollback() (#869)	2023-02-01 15:44:11 +07:00
Alex Sharov	6f6764ee01	e3: indices wal - to reuse etl collector (#875)	2023-02-01 10:02:26 +07:00
Alex Sharov	ffc4dc71d6	E3 small rename3 (#868)	2023-01-29 11:32:26 +07:00
Alex Sharov	3e82f0fc87	e3: small rename (#867)	2023-01-29 10:56:01 +07:00
Alex Sharov	96db46b3ed	e3: small rename (#866)	2023-01-29 10:47:04 +07:00
Alex Sharov	bc136bd0f5	e3: eth_getModifiedAccountsByNumber (#865)	2023-01-29 10:10:28 +07:00
Alex Sharov	206fbadf9c	iter: filter tests (#862)	2023-01-28 12:03:20 +07:00
Alex Sharov	040fefda7b	e3: ots underflow fixes (#860)	2023-01-27 14:40:29 +07:00
Alex Sharov	3f234f90d0	e3: ots some underflow fixes (#859)	2023-01-27 14:16:08 +07:00
Alex Sharov	775989d068	move math big constants to erigon-lib (#858)	2023-01-27 11:39:38 +07:00
Alex Sharov	8861f19b11	e3: ots_getContractCreator (#854)	2023-01-26 16:34:57 +07:00
Alex Sharov	98f907a7a6	e3: cleanup locality idx (#853)	2023-01-26 10:41:29 +07:00
Alex Sharov	f62649c307	e3: getLogs on iterators (#851)	2023-01-25 16:29:23 +07:00