Alex Sharov
17abe11cc0
Remote RPC: add state cache ( #2738 )
2021-09-29 08:36:25 +07:00
ledgerwatch
0d34a5b9c5
[State sync experiment] Building dictionary for state file compression ( #2721 )
...
* Kasai experiments
* Use divsufsort instead of standard lib
* Refactor experiments, split dictionary building into chunks
* Fixes
* Estimate compression, sample
* More stats
* Parallelise
* Fix lint
* dictionary aggregator
* Actual replacement
* Fixes, separate dictionary processing
* Test file
* More correct dictionary, decompression
* Use dynamic programming to reduce dictionary
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-09-27 21:32:53 +01:00
Alex Sharov
bf5bde0a09
Pool: break data-dependency between effectiveTip and other fields ( #2735 )
2021-09-27 21:26:53 +07:00
Alex Sharov
3dcc226b8b
--mdbx.augment.limit ( #2734 )
2021-09-27 18:43:24 +07:00
Alex Sharov
a148e71d9d
Pool: switch to pendingBaseFee ( #2732 )
2021-09-26 23:09:36 +07:00
Alexandr Borodulin
d7159cd8bd
More convenient pruning for non-PoW consensus: add --prune.*.before flags ( #2714 )
2021-09-23 09:13:19 +07:00
Alex Sharov
0b776eead4
flag --txpool.v2 to enable --state.stream flag ( #2718 )
2021-09-22 15:39:51 +07:00
Alex Sharov
133eec0c7e
Pool: correct new pending txs notifications ( #2715 )
2021-09-21 17:35:28 +07:00
ledgerwatch
a9e4cbc83e
Recsplit experiments ( #2706 )
...
* Only do 2m
* Optimisation
* Flexible count
* Count properly
* count
* Bijection check
* Add keys
* Print bucket info
* Collision map
* Collision map
* Add tracing
* Tracing
* Fix split
* No trace, print lookup time
* Not override count if block=0
* fix count
* Go mod tidy
* Fix lint
* Measurements
* Cleanup
* Latest erigon-lib
Co-authored-by: Alexey Sharp <alexeysharp@Alexeys-iMac.local>
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-09-21 07:53:22 +01:00
Alex Sharov
a0321e2f3a
Pool: return lost error, fix race of 2 sentries, more friendly logs ( #2707 )
2021-09-20 20:16:50 +07:00
Alex Sharov
1f8937fdd1
Pool: discard reasons, lru, start pool even if no --mine flag ( #2704 )
2021-09-20 13:20:50 +07:00
Alex Sharp
c519b04551
Revert "state mphf experiment"
...
This reverts commit b0182d7834
2021-09-19 11:41:51 +01:00
Alex Sharp
b0182d7834
state mphf experiment
2021-09-19 11:40:23 +01:00
Alex Sharov
8d9e058eb7
Pool: chain config, non-mainnet ( #2702 )
2021-09-18 20:58:23 +07:00
Alex Sharov
b30ccd2ddf
Revert "Add prune before parameters" ( #2701 )
...
This reverts commit 49a98ad4b6
2021-09-18 08:37:39 +07:00
Alexandr Borodulin
49a98ad4b6
Add prune before parameters
2021-09-17 19:01:15 +07:00
Alex Sharov
400c71b7ce
Pool: txID-based cache ( #2697 )
2021-09-17 10:31:20 +07:00
Alex Sharov
896bf5edf5
Pool: up to last version ( #2689 )
2021-09-15 20:16:49 +07:00
alex.sharov
f4969876ad
suppress rlp parse warnings
2021-09-15 20:06:18 +07:00
alex.sharov
74df0a9516
suppress rlp parse warnings
2021-09-15 20:04:57 +07:00
Alex Sharov
76dd448c70
Pool: switch cache to tx.ID(), add blockNum to tx info to drop from full pool old txs first ( #2688 )
2021-09-15 19:34:05 +07:00
Alex Sharov
ad1682cf40
Expose mdbx's txID to remote_kv ( #2686 )
2021-09-15 14:22:57 +07:00
Alex Sharov
ec14cba611
Remote Pool: add mining rpc, test pending txs stream ( #2685 )
2021-09-15 09:09:19 +07:00
Alex Sharov
77db993cfc
Pool: add coherent cache ( #2678 )
2021-09-13 14:58:25 +07:00
ledgerwatch
15b4095718
Move ETL to erigon-lib ( #2667 )
...
* Move ETL to erigon-lib
* Update link in the readme
* go mod tidy
* Use common/chan.go from erigon-lib
* Clean up
* Fix lint
* Fix test
* Fix compilation
Co-authored-by: Alex Sharp <alexsharp@Alexs-MacBook-Pro.local>
2021-09-12 08:50:17 +01:00
Alex Sharov
798c2d64a4
Pool: no state presistance ( #2646 )
2021-09-08 19:33:14 +07:00
Alex Sharov
2d8941a845
Pool: built-in v2 ( #2643 )
2021-09-08 12:31:51 +07:00
Alex Sharov
873ef75f39
Pool: grafana board ( #2625 )
2021-09-03 14:16:27 +07:00
Alex Sharov
28480a36ec
Pool: add --txpool.v2 flag to rpcdaemon ( #2624 )
2021-09-03 11:19:35 +07:00
Alex Sharov
4c1dbdf50e
Pool: add --txpool.v2 flag to erigon (it just disabling existing machinery for now) ( #2620 )
2021-09-02 17:04:30 +07:00
Alex Sharov
daf945dc13
Rpcdaemon: handle "WaitGroup is reused before previous Wait has returned" panic on shutdown ( #2619 )
2021-09-02 16:36:56 +07:00
Alex Sharov
953f348d1e
Pool: add grpc server ( #2615 )
2021-09-02 12:55:04 +07:00
Alex Sharov
9e1fc980a7
Pool: batch incoming p2p transactions (but preserve "don't recover sender twice" property) ( #2608 )
2021-09-01 16:10:00 +07:00
Alex Sharov
edb83d1ed9
Roaring bitmap lib version up ( #2606 )
2021-09-01 12:09:04 +07:00
Alex Sharov
143a0d0231
Pool: remove redundant prefix in txs table ( #2603 )
2021-08-31 21:59:30 +07:00
Alex Sharov
fb9ee7177a
Pool: correct use of base fee ( #2597 )
...
* pool: add new empty sender to eviction
* pool: correct use of baseFee
2021-08-30 20:59:40 +07:00
Alex Sharov
74c2a1a317
pool: add new empty sender to eviction ( #2596 )
2021-08-30 11:49:43 +07:00
Alex Sharov
cfeac97156
Pool: state eviction ( #2590 )
2021-08-28 18:24:53 +07:00
Alex Sharov
1f480fa472
pool: make sender info unloadable ( #2584 )
...
* ss
* ss
* ss
* ss
* ss
* ss
* ss
* ss
* ss
* ss
* ss
* ss
* ss
2021-08-27 11:51:33 +07:00
Alex Sharov
10feb71530
Pool: handle "stop at non-canonical block" case ( #2582 )
2021-08-26 10:01:00 +07:00
Alex Sharov
38ea553300
Mdbx v0.10.1 ( #2578 )
2021-08-25 09:40:23 +07:00
Alex Sharov
7e4db20427
pool: add own db ( #2575 )
...
* save
* save
2021-08-24 10:56:13 +07:00
Alex Sharov
1d11dee5ca
Pool: senders cache - right merging and fallback logic ( #2563 )
...
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
* save
2021-08-21 22:04:24 +07:00
Alex Sharov
289e434b87
Pool: senders cache object, reject known tx before senders recover, fix lock contention ( #2562 )
...
* save
* save
2021-08-21 08:25:42 +07:00
Alex Sharov
f5c6def4bc
close db ( #2548 )
2021-08-18 15:50:22 +07:00
Alex Sharov
d5b9abab7d
reduce log level in tests ( #2546 )
...
* hack
* hack
* hack
* less debug logs in tests
* less debug logs in tests
2021-08-18 14:25:03 +07:00
Alex Sharov
ccc22c9f6a
add ms to logs ( #2544 )
2021-08-17 22:39:38 +07:00
Alex Sharov
6c7edb0d34
state diff send to txpool ( #2532 )
2021-08-17 15:52:55 +07:00
Alex Sharov
5278ef4224
experimental: txpool cmd ( #2530 )
...
* save
* sentry handshake
* move sentry clients to erigon-lib
* move sentry clients to erigon-lib
* move sentry clients to erigon-lib
* move sentry clients to erigon-lib
* correct grpc retry
* correct grpc retry
* correct grpc retry
* save
* save
* save
* save
2021-08-14 20:47:11 +07:00
Alex Sharov
98e60b5b4b
Separate handshake from set_status - because txpool can't set any sentry status but need to handshake ( #2529 )
...
* sentry handshake
* move sentry clients to erigon-lib
* correct grpc retry
* correct grpc retry
* correct grpc retry
2021-08-14 15:11:46 +07:00
