16 Commits

Author	SHA1	Message	Date
ledgerwatch	f2d93b959b	Introduce separate logging for etl functions (#998) ... Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>	2023-05-18 19:55:02 +00:00
Alex Sharov	9cdea8f079	e3: remove garbage files (#977)	2023-04-21 02:49:49 +00:00
alex.sharov	e15093d30e	fix test	2023-03-23 13:26:04 +07:00
alex.sharov	d7b01ea68f	save	2023-03-23 12:19:17 +07:00
Alex Sharov	f110e80dab	go 1.19 atomics (#951)	2023-03-23 05:11:20 +00:00
Alex Sharov	5edc0612ce	e3: close files (#912)	2023-03-02 05:05:34 +00:00
Alex Sharov	c68d3c4ff8	eliasfano iterator.Seek() (#904)	2023-02-24 05:59:36 +00:00
Alex Sharov	565acd3624	e3: read files list from db (#885)	2023-02-13 05:16:58 +00:00
Alex Sharov	1b22208462	e3: Thread safe reopen folder (#881)	2023-02-09 12:11:36 +07:00
Alex Sharov	6254a32e4b	e3: MakeContext must not see garbage files (deleted, overlapped, etc...). make it cheaper. (#880)	2023-02-08 12:50:44 +07:00
Alex Sharov	9d7928f2d3	e3: to fix test (#879)	2023-02-06 09:54:30 +07:00
Alex Sharov	4344efa765	e3: more mergeFiles tests, refcnt for LocalityIndex (#878)	2023-02-03 19:14:34 +07:00
Alex Sharov	c6d823dae0	e3: last reader to close/remove merged files (marked as canDelete) inside tx.Rollback() (#869)	2023-02-01 15:44:11 +07:00
Alex Sharov	98f907a7a6	e3: cleanup locality idx (#853)	2023-01-26 10:41:29 +07:00
Alex Sharov	aaafab8fc0	e3: storageRangeAt (#833)	2023-01-17 14:16:33 +07:00
Alex Sharov	ac40ca5269	e3: locality index (#823) ... Mainnet: ``` 447M accounts.0-544.l 45M accounts.0-544.li 133M code.0-544.l 14M code.0-544.li 2.0G storage.0-544.l 197M storage.0-544.li ``` Decided no to use Roaring - because it can only keep full bitmap in RAM (no way to stream into file). But it's more compact 2Gb -> 1.4Gb. Maybe can shard large bitmap - or do other trick (storage has 1B keys - sharding probably is cheap). Maybe in the future.	2023-01-07 12:30:57 +07:00