Commit Graph

288 Commits

Author SHA1 Message Date
Alex Sharov
cf41b09ed2
remove "db" log line from (#995) 2023-05-14 01:42:51 +00:00
ledgerwatch
1113e19aca
Separate logs for kv/remotedbserver (#993)
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-05-10 16:09:09 +00:00
Alex Sharov
160ecd927e
reduce default --db.size.limit from 7 to 3 Tb (to fit defaults of some systems) (#992) 2023-05-10 02:43:17 +00:00
Alex Sharov
0e2883bf3f
LeakDetector: use it to find which resource was created but not closed (leaked) (#990) 2023-05-08 05:22:24 +00:00
Alex Sharov
1e70a0a4ee
e3: rethink meaning of kv_temporal.BeginRw() (#983) 2023-04-30 03:08:39 +00:00
Alex Sharov
546a2a4ccd
erigon backup: v0 of sub-command (#980) 2023-04-27 03:41:17 +00:00
alex.sharov
16d5e77056 save 2023-04-24 10:04:23 +07:00
Alex Sharov
b1183da945
e3: remove files when no readers (#978) 2023-04-23 04:55:13 +00:00
Alex Sharov
0d918d9f7d
add flag --db.size.limit (#973) 2023-04-17 12:49:08 +00:00
Andrew Ashikhmin
a6e2d936a3
Remove Parlia (#969) 2023-04-13 20:56:49 +00:00
Andrew Ashikhmin
9ef1a57e84
[interfaces] lower_snake_case field names (#967)
Pick up https://github.com/ledgerwatch/interfaces/pull/163
2023-04-12 09:59:02 +00:00
omahs
0d45034fbb
Fix: typos (#966)
Fix: typos
2023-04-07 02:06:34 +00:00
alex.sharov
691c293d11 clean 2023-03-26 12:23:40 +07:00
alex.sharov
b5c4b8266f clean 2023-03-26 12:22:22 +07:00
alex.sharov
b220ee207a clean 2023-03-26 12:18:36 +07:00
alex.sharov
daa2d67790 clean 2023-03-26 12:18:29 +07:00
Alex Sharov
0b9404adb8
add constant kv.Unlim=-1 (#955) 2023-03-26 03:18:07 +00:00
Alex Sharov
a4034d5cea
enable more linters (#954) 2023-03-25 05:13:20 +00:00
Alex Sharov
5160bef4bc
e3: DomainGetAsOf, DomainRange (#953) 2023-03-25 03:51:41 +00:00
Alex Sharov
f110e80dab
go 1.19 atomics (#951) 2023-03-23 05:11:20 +00:00
Alex Sharov
0915811f47
e3: domain range api simplify (#949) 2023-03-22 07:35:58 +00:00
Alex Sharov
24a5f38a85
e3: unionKV limit (#948) 2023-03-22 06:58:07 +00:00
Alex Sharov
c2b85725c8
e3: union limit (#947) 2023-03-22 06:38:02 +00:00
Alex Sharov
39f1d090c6
e3: remove settings table (#946) 2023-03-22 05:21:11 +00:00
Alex Sharov
e143f7756f
e3: history no auto-increment (#935) 2023-03-15 06:47:48 +00:00
Jason Yellick
820840bbbb
Fix broken doc link (#934)
The [KV
Readme.md](https://github.com/ledgerwatch/erigon-lib/tree/main/kv#ethdbabstractkv-design)
currently references `dupsort.md` which is in the original Erigon repo,
so the link is broken. This simply fixes the reference to point back to
the main repo.

Co-authored-by: Jason Yellick <jason@enya.ai>
2023-03-14 15:43:07 +07:00
Alex Sharov
b968398cbd
e3: split "changed keys" iterator to simplify (#933) 2023-03-13 08:06:37 +00:00
alex.sharov
c3c270fdf5 rawdb: txnums.Last 2023-03-10 15:14:03 +07:00
alex.sharov
25d913c676 better iter dup 2023-03-09 09:57:16 +07:00
Alex Sharov
05d0018864
e3: use iterators composition in invIndex.Range( (#926) 2023-03-09 02:26:29 +00:00
Alex Sharov
fd8122be5b
mdbx: RangeDupSort iterator (#925) 2023-03-08 10:16:04 +00:00
Alex Sharov
44f8a908db
etl: distinct empty values from nil (#919)
Reverts ledgerwatch/erigon-lib#918
2023-03-07 04:19:08 +00:00
Alex Sharov
f0a051c44c
Revert "etl: distinct empty values from nil" (#918)
Reverts ledgerwatch/erigon-lib#902
2023-03-07 03:22:20 +00:00
Alex Sharov
f4a02864a9
etl: distinct empty values from nil (#902) 2023-03-07 02:30:45 +00:00
Giulio rebuffo
a790ec764a
added finalized roots table (#915) 2023-03-05 18:28:54 +00:00
Alex Sharov
70f4a28e0e
e3: optimize iterators, step1 (#903) 2023-02-24 03:31:10 +00:00
ledgerwatch
fe85438cb4
kv/mdbx: Ability to list tables from read-only tx, and enumerate DBs open in a process (#897)
This is for the diagnostics project

---------

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
2023-02-22 08:30:20 +00:00
Alex Sharov
cb8d3ec530
EliasFano: Search to touch only UpperBits array (#895) 2023-02-20 06:42:35 +00:00
Alex Sharov
565acd3624
e3: read files list from db (#885) 2023-02-13 05:16:58 +00:00
Maxim Andreev
ddf6c3bcf3
kv_mdbx: fix typo db.evn -> db.env (#887) 2023-02-12 18:20:50 +07:00
ledgerwatch
aa2b561741
Disallow memory db creation with empty tmpDir (#886)
It silently fills up `/tmp` directory with directories that never get
cleaned up and eventually cause trouble

---------

Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro-2.local>
2023-02-11 20:08:54 +00:00
Alex Sharov
db0e7ed112
e3: return list of e3 files by grpc (#884) 2023-02-10 14:16:39 +07:00
Alex Sharov
3e933bc456
Downloader: "incomplete" markers are more important than "complete", so commit them with fsync (#883)
On power-off recent "no-sync" txs may be lost. It will cause 2. cases:
- Good piece on disk and recent "complete" db marker lost. Self-Heal by
re-download.
- Bad piece on dis and recent "incomplete" db marker lost. No Self-Heal.
So, can't afford loosing recent "incomplete" markers.
2023-02-10 13:20:13 +07:00
Alex Sharov
6254a32e4b
e3: MakeContext must not see garbage files (deleted, overlapped, etc...). make it cheaper. (#880) 2023-02-08 12:50:44 +07:00
Alex Sharov
4344efa765
e3: more mergeFiles tests, refcnt for LocalityIndex (#878) 2023-02-03 19:14:34 +07:00
Alex Sharov
ffc4dc71d6
E3 small rename3 (#868) 2023-01-29 11:32:26 +07:00
Alex Sharov
bc136bd0f5
e3: eth_getModifiedAccountsByNumber (#865) 2023-01-29 10:10:28 +07:00
nanevardanyan
a1ac65bc07
kv: added transactionsV3 to the accessors config (#864) 2023-01-29 10:00:42 +07:00
Alex Sharov
206fbadf9c
iter: filter tests (#862) 2023-01-28 12:03:20 +07:00
Alex Sharov
775989d068
move math big constants to erigon-lib (#858) 2023-01-27 11:39:38 +07:00