Commit Graph

13 Commits

Author SHA1 Message Date
alex.sharov
d7b01ea68f save 2023-03-23 12:19:17 +07:00
Alex Sharov
f110e80dab
go 1.19 atomics (#951) 2023-03-23 05:11:20 +00:00
Alex Sharov
5edc0612ce
e3: close files (#912) 2023-03-02 05:05:34 +00:00
Alex Sharov
c68d3c4ff8
eliasfano iterator.Seek() (#904) 2023-02-24 05:59:36 +00:00
Alex Sharov
565acd3624
e3: read files list from db (#885) 2023-02-13 05:16:58 +00:00
Alex Sharov
1b22208462
e3: Thread safe reopen folder (#881) 2023-02-09 12:11:36 +07:00
Alex Sharov
6254a32e4b
e3: MakeContext must not see garbage files (deleted, overlapped, etc...). make it cheaper. (#880) 2023-02-08 12:50:44 +07:00
Alex Sharov
9d7928f2d3
e3: to fix test (#879) 2023-02-06 09:54:30 +07:00
Alex Sharov
4344efa765
e3: more mergeFiles tests, refcnt for LocalityIndex (#878) 2023-02-03 19:14:34 +07:00
Alex Sharov
c6d823dae0
e3: last reader to close/remove merged files (marked as canDelete) inside tx.Rollback() (#869) 2023-02-01 15:44:11 +07:00
Alex Sharov
98f907a7a6
e3: cleanup locality idx (#853) 2023-01-26 10:41:29 +07:00
Alex Sharov
aaafab8fc0
e3: storageRangeAt (#833) 2023-01-17 14:16:33 +07:00
Alex Sharov
ac40ca5269
e3: locality index (#823)
Mainnet:
```
447M	accounts.0-544.l
45M	accounts.0-544.li
133M	code.0-544.l
14M	code.0-544.li
2.0G	storage.0-544.l
197M	storage.0-544.li
```

Decided no to use Roaring - because it can only keep full bitmap in RAM
(no way to stream into file). But it's more compact 2Gb -> 1.4Gb. Maybe
can shard large bitmap - or do other trick (storage has 1B keys -
sharding probably is cheap). Maybe in the future.
2023-01-07 12:30:57 +07:00