Commit Graph

9 Commits

Author SHA1 Message Date
Alex Sharov
565acd3624
e3: read files list from db (#885) 2023-02-13 05:16:58 +00:00
Alex Sharov
1b22208462
e3: Thread safe reopen folder (#881) 2023-02-09 12:11:36 +07:00
Alex Sharov
6254a32e4b
e3: MakeContext must not see garbage files (deleted, overlapped, etc...). make it cheaper. (#880) 2023-02-08 12:50:44 +07:00
Alex Sharov
9d7928f2d3
e3: to fix test (#879) 2023-02-06 09:54:30 +07:00
Alex Sharov
4344efa765
e3: more mergeFiles tests, refcnt for LocalityIndex (#878) 2023-02-03 19:14:34 +07:00
Alex Sharov
c6d823dae0
e3: last reader to close/remove merged files (marked as canDelete) inside tx.Rollback() (#869) 2023-02-01 15:44:11 +07:00
Alex Sharov
98f907a7a6
e3: cleanup locality idx (#853) 2023-01-26 10:41:29 +07:00
Alex Sharov
aaafab8fc0
e3: storageRangeAt (#833) 2023-01-17 14:16:33 +07:00
Alex Sharov
ac40ca5269
e3: locality index (#823)
Mainnet:
```
447M	accounts.0-544.l
45M	accounts.0-544.li
133M	code.0-544.l
14M	code.0-544.li
2.0G	storage.0-544.l
197M	storage.0-544.li
```

Decided no to use Roaring - because it can only keep full bitmap in RAM
(no way to stream into file). But it's more compact 2Gb -> 1.4Gb. Maybe
can shard large bitmap - or do other trick (storage has 1B keys -
sharding probably is cheap). Maybe in the future.
2023-01-07 12:30:57 +07:00