Commit Graph

7 Commits

Author SHA1 Message Date
ledgerwatch
f2d93b959b
Introduce separate logging for etl functions (#998)
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-05-18 19:55:02 +00:00
Alex Sharov
9cdea8f079
e3: remove garbage files (#977) 2023-04-21 02:49:49 +00:00
Alex Sharov
f110e80dab
go 1.19 atomics (#951) 2023-03-23 05:11:20 +00:00
Alex Sharov
c68d3c4ff8
eliasfano iterator.Seek() (#904) 2023-02-24 05:59:36 +00:00
Alex Sharov
4344efa765
e3: more mergeFiles tests, refcnt for LocalityIndex (#878) 2023-02-03 19:14:34 +07:00
Alex Sharov
c6d823dae0
e3: last reader to close/remove merged files (marked as canDelete) inside tx.Rollback() (#869) 2023-02-01 15:44:11 +07:00
Alex Sharov
ac40ca5269
e3: locality index (#823)
Mainnet:
```
447M	accounts.0-544.l
45M	accounts.0-544.li
133M	code.0-544.l
14M	code.0-544.li
2.0G	storage.0-544.l
197M	storage.0-544.li
```

Decided no to use Roaring - because it can only keep full bitmap in RAM
(no way to stream into file). But it's more compact 2Gb -> 1.4Gb. Maybe
can shard large bitmap - or do other trick (storage has 1B keys -
sharding probably is cheap). Maybe in the future.
2023-01-07 12:30:57 +07:00