NagyZoltanPeter
7f1ea0890a
Bump nim-chornicles, nim-libp2p, nimcrypto
...
Bump nim-web3, nim-eth and deps - on_chain/group_manager.nim adaption
Added status-im/nim-minilru submodule required by latest nim-eth
Added nim-quic and nim-ngtcp2 as new deps of nim-libp2p
Fixing tests.
Changes:
modified: .gitmodules
modified: tests/waku_discv5/utils.nim
modified: tests/waku_enr/utils.nim
modified: tests/waku_rln_relay/test_rln_group_manager_onchain.nim
modified: tests/waku_rln_relay/utils.nim
modified: tests/waku_rln_relay/utils_onchain.nim
modified: vendor/nim-chronicles
modified: vendor/nim-eth
modified: vendor/nim-http-utils
modified: vendor/nim-json-rpc
modified: vendor/nim-json-serialization
modified: vendor/nim-libp2p
modified: vendor/nim-metrics
new file: vendor/nim-minilru
modified: vendor/nim-nat-traversal
new file: vendor/nim-ngtcp2
modified: vendor/nim-presto
new file: vendor/nim-quic
modified: vendor/nim-secp256k1
modified: vendor/nim-serialization
modified: vendor/nim-stew
modified: vendor/nim-taskpools
modified: vendor/nim-testutils
modified: vendor/nim-toml-serialization
modified: vendor/nim-unicodedb
modified: vendor/nim-unittest2
modified: vendor/nim-web3
modified: vendor/nim-websock
modified: vendor/nim-zlib
modified: vendor/nimcrypto
modified: waku.nimble
modified: waku/common/enr/builder.nim
modified: waku/common/enr/typed_record.nim
modified: waku/common/utils/nat.nim
modified: waku/discovery/waku_discv5.nim
modified: waku/waku_rln_relay/conversion_utils.nim
modified: waku/waku_rln_relay/group_manager/on_chain/group_manager.nim
modified: waku/waku_rln_relay/rln/wrappers.nim
modified: waku/waku_rln_relay/rln_relay.nim
2024-10-09 01:57:51 +02:00
Ivan FB
3ad613cad4
chore: waku_keystore: give some more context in case of error ( #3064 )
2024-10-03 00:05:49 +02:00
gabrielmer
ca448789f0
Merge branch 'master' into chore-merge-release-v0.33-to-master
2024-10-02 10:32:34 +03:00
Ivan FB
5875ed63af
chore: Optimize store ( #3061 )
...
* use messages_lookup to retrieve timestamps
* deep refactoring in db_postgres for better use of async approach
2024-10-01 23:36:03 +02:00
gabrielmer
45fec1a1d9
Update peer_manager.nim
2024-09-30 21:05:03 +03:00
gabrielmer
eebce3ccce
Merge branch 'master' into chore-merge-release-v0.33-to-master
2024-09-30 21:02:26 +03:00
gabrielmer
f8946b8263
fix: rejecting excess relay connections ( #3065 )
2024-09-27 19:42:51 +03:00
gabrielmer
8b0884c7b5
fix: rejecting excess relay connections ( #3065 )
2024-09-27 19:35:18 +03:00
Darshan K
729e63f53d
refactor: wrap peer store ( #3051 )
...
Encapsulate peerstore with wakupeerstore
2024-09-27 18:16:46 +05:30
gabrielmer
b358c90fa5
chore: disabling metrics for libwaku ( #3058 )
2024-09-25 14:08:01 +03:00
Ivan FB
368bb3c199
append current version in agentString which is used by the identify protocol ( #3057 )
2024-09-25 12:59:46 +03:00
Ivan FB
b688edc079
append current version in agentString which is used by the identify protocol ( #3057 )
2024-09-25 11:52:02 +02:00
NagyZoltanPeter
5afa9b13ea
Fix PeerExchange rpc decode in order not to take response's status_code mandatory - for support old protocol implementation ( #3059 )
2024-09-25 11:51:50 +02:00
Ivan FB
711e7db1e9
chore: test peer connection management ( #3049 )
...
* Make some useful consts public, add some utils.
* Implement various utilities.
* peer_manager reconnectPeers enhancements
---------
Co-authored-by: Álex Cabeza Romero <alex93cabeza@gmail.com>
2024-09-24 18:20:29 +02:00
NagyZoltanPeter
9b445ac49f
fix: px protocol decode - do not treat missing response field as error ( #3055 )
...
* Fix missing response field of PeerExchange RPC treated as error.
* Fix PX metrics from gauge to counter for better dashboard stats
2024-09-24 12:47:52 +02:00
Ivan FB
e492c590e9
chore: Better database query logs and logarithmic scale in grafana store panels ( #3048 )
2024-09-20 22:47:15 +03:00
Ivan FB
d68b06f145
chore: Better database query logs and logarithmic scale in grafana store panels ( #3048 )
2024-09-20 17:43:56 +02:00
Ivan FB
26a488d522
chore: extending store metrics ( #3042 )
...
* adding query_metrics module
* update fleet-dashboard with new store panels for better timing insight
2024-09-20 15:43:00 +03:00
Ivan FB
b534a1c257
sharding: reduce log level for a too spammy message ( #3045 )
2024-09-20 15:42:46 +03:00
Ivan FB
fd83b42faa
chore: extending store metrics ( #3042 )
...
* adding query_metrics module
* update fleet-dashboard with new store panels for better timing insight
2024-09-20 13:23:53 +02:00
Ivan FB
7add5b7991
sharding: reduce log level for a too spammy message ( #3045 )
2024-09-20 13:22:10 +02:00
NagyZoltanPeter
0a7f16a332
chore: rate limit peer exchange protocol, enhanced response status in RPC ( #3035 )
...
* Enhanced peer-ex protocol - added rate limiting, added response status and desc to the rpc
* Better error result handling for PeerEx request, adjusted tests
* Refactored RateLimit configuration option for better CLI UX - now possible to set separate limits per protocol. Adjusted mountings. Added and adjusted tests
* Fix libwaku due to changes of error return type of fetchPeerExchangePeers
* Fix rate limit setting tests due to changed defaults
* Introduce new gauge to help dasboard effectively show current rate limit applied for protocol
* Adjust timeing in filter rate limit test to let macos CI test run ok.
* Address review findings, namings, error logs, removed left-overs
* Changes to reflect latest spec agreement and changes. PeerExchange RPC is changed the now respond structure will contain status_code and status_desc.
2024-09-18 15:58:07 +02:00
NagyZoltanPeter
83f25c3e99
chore: Switch libnegentropy library build from shared to static linkage ( #3041 )
...
* Switch libnegentropy library build from shared to static linkage
* Update negentropy with -fPIC compile option that is necessary for libwaku build
* Bump waku-org/negentropy to the latest on master to incorporate merged static build of libnegentropy
2024-09-18 14:34:50 +02:00
gabrielmer
8f28992599
fix: setting up node with modified config ( #3036 )
2024-09-16 16:30:38 +03:00
gabrielmer
51391aa2ac
adding a dynamic sleep interval in the connectivity loop ( #3031 )
2024-09-12 22:49:47 +02:00
Ivan FB
5ea1cf0cf3
chore: libwaku - extending the library with peer_manager and peer_exchange features ( #3026 )
...
* libwaku: get peerids by protocol and peer exchange request
2024-09-11 10:13:54 +02:00
fryorcraken
ce9a8c468a
chore: use submodule nph in CI to check lint ( #3027 )
2024-09-11 11:51:42 +10:00
gabrielmer
a3cd2a1a92
chore: deprecating pubsub topic ( #2997 )
2024-09-10 15:07:12 -06:00
Ivan FB
d3e6717a60
chore: lightpush - error metric less variable by only setting a fixed string ( #3020 )
2024-09-10 17:30:09 +02:00
Ivan FB
5a0edff79a
fix: get back health check for postgres legacy ( #3010 )
2024-09-10 15:07:53 +02:00
Ivan FB
6c890de4a8
chore: Bump dependencies for v0.33 ( #3017 )
2024-09-09 10:45:14 +02:00
Ivan FB
45319f09c9
chore: enhance libpq management ( #3015 )
...
* db_postgres: register pg socket fd to chronos better data available awareness
* waku_store protocol: better logs to track time and new store metrics
2024-09-06 11:33:15 +02:00
Simon-Pierre Vivier
e1e05afb02
chore: per limit split of PostgreSQL queries ( #3008 )
2024-09-04 10:17:28 -04:00
Ivan FB
e8a49b76b2
chore: Better timing and requestId detail for slower store db queries ( #2994 )
...
* Better timing and requestId detail for store db queries slower than two seconds
* Adapt tests and client to allow sending custom store requestId
2024-08-29 22:56:14 +02:00
Ivan FB
fd84363ec4
chore: remove unused setting from external_config.nim ( #3004 )
2024-08-29 17:54:37 +02:00
Ivan FB
bd2cf99d7e
libwaku: exposing more features ( #3003 )
...
- Allow to start or store discv5
- Expose lightpush request operation
- Expose list of connected and mesh peers
- Expose store client
2024-08-29 14:29:02 +02:00
Simon-Pierre Vivier
87b340f78a
fix waku sync config defaults ( #3001 )
2024-08-28 10:26:38 -04:00
Ivan FB
0f68274c85
chore: delivery monitor for store v3 reliability protocol ( #2977 )
...
- Use of observer observable pattern to inform delivery_monitor about subscription state
- send_monitor becomes a publish observer of lightpush and relay
- deliver monitor add more protection against possible crash and better logs
- creating a separate proc in store client for delivery monitor
2024-08-27 16:49:46 +02:00
Darshan K
4315710289
fix: peer-exchange issue ( #2889 )
2024-08-23 23:31:30 +05:30
Ivan FB
32f2d85dcc
chore: ANALYZE messages query should be performed regularly ( #2986 )
...
---------
Co-authored-by: Richard Ramos <info@richardramos.me>
2024-08-21 19:17:08 +02:00
NagyZoltanPeter
c7093d7ce2
Distinction between gross/net trafic in bandwidth per shard metric, added bandwidths and request rate panels to single node and fleet dashboards ( #2920 )
2024-08-21 17:10:29 +02:00
NagyZoltanPeter
f4fa73e961
chore: liteprotocoltester for simulation and for fleets ( #2813 )
...
* Added phase 2 - waku-simulatior integration in README.md
* Enhancement on statistics reports, added list of sent messages with hash, fixed latency calculations
* Enable standalonde running liteprotocoltester agains any waku network/fleet
* Fix missing env vars on run_tester_node.sh
* Adjustment on log levels, fix REST initialization
* Added standalon docker image build, fine tune duplicate detection and logging.
* Adjustments for waku-simulator runs
* Extended liteprotocoltester README.md with docker build
* Fix test inside docker service node connectivity failure
* Update apps/liteprotocoltester/README.md
Co-authored-by: gabrielmer <101006718+gabrielmer@users.noreply.github.com>
* Apply suggestions from code review
Co-authored-by: gabrielmer <101006718+gabrielmer@users.noreply.github.com>
Co-authored-by: Ivan FB <128452529+Ivansete-status@users.noreply.github.com>
* Explain minLatency calculation in code comment
---------
Co-authored-by: gabrielmer <101006718+gabrielmer@users.noreply.github.com>
Co-authored-by: Ivan FB <128452529+Ivansete-status@users.noreply.github.com>
2024-08-21 14:54:18 +02:00
gabrielmer
e8bce67d76
chore: logging received message info via onValidated observer ( #2973 )
2024-08-19 14:13:28 +02:00
gabrielmer
e51ffe0759
chore: deprecating protected topics in favor of protected shards ( #2983 )
2024-08-19 12:56:22 +02:00
gabrielmer
67439057fb
chore: rename NsPubsubTopic ( #2974 )
2024-08-19 11:29:35 +02:00
Ivan FB
b8550c5550
postgres_driver limit max num hashes to 100 ( #2976 )
2024-08-19 11:12:31 +02:00
richΛrd
2fd4eb62fd
chore: print WakuMessageHash as hex strings ( #2969 )
2024-08-14 21:04:20 +02:00
gabrielmer
225b5e7260
avoid using the msg key in chronicles ( #2970 )
2024-08-14 16:40:08 +02:00
Simon-Pierre Vivier
2cc86c51da
feat: Nwaku Sync ( #2403 )
...
* feat: Waku Sync Protocol
* feat: state machine (#2656 )
* feat: pruning storage mehcanism (#2673 )
* feat: message transfer mechanism & tests (#2688 )
* update docker files
* added ENR filed for sync & misc. fixes
* adding new sync range param & fixes
---------
Co-authored-by: Ivan FB <128452529+Ivansete-status@users.noreply.github.com>
Co-authored-by: Prem Chaitanya Prathi <chaitanyaprem@gmail.com>
2024-08-13 07:27:34 -04:00
gabrielmer
54b5222222
pruning excess in relay connections ( #2965 )
2024-08-12 17:59:11 +02:00
