debc5f19d9
feat(relay): ordered validator execution ( #1966 )
...
* feat(relay): ordered validator execution
* fix: make more readable
* test: ignore accepts only
* fix: idempotent .subscribe
* fix(rln-relay): make validators private
Co-authored-by: Ivan Folgueira Bande <128452529+Ivansete-status@users.noreply.github.com>
* fix: include comments, unsubscribe behaviour
* fix: compilation
---------
Co-authored-by: Ivan Folgueira Bande <128452529+Ivansete-status@users.noreply.github.com>
2023-09-05 14:35:07 +05:30
a14c32614a
chore(rln-relay): use the only key from keystore if only 1 exists ( #1984 )
...
* chore(rln-relay): use the only key from keystore if only 1 exists
* fix: convert iterator to seq and then index into it
2023-09-04 15:46:44 +05:30
be48891f77
chore(rln-relay): confirm that the provided credential is correct using onchain query ( #1980 )
2023-09-04 11:22:31 +05:30
05c988645d
chore(api): validate rln message before sending (rest + rpc) ( #1968 )
2023-09-01 15:03:59 +02:00
f262397d71
fix(tests): fix flaky test ( #1972 )
2023-08-31 12:24:41 +02:00
e7b2b88f5b
fix(rln-relay): modify keystore credentials logic ( #1956 )
...
* fix(rln-relay): modify keystore credentials logic
fix: bump version
* Update waku/waku_rln_relay/group_manager/on_chain/group_manager.nim
Co-authored-by: Ivan Folgueira Bande <128452529+Ivansete-status@users.noreply.github.com>
* Update tests/waku_rln_relay/test_waku_rln_relay.nim
Co-authored-by: Ivan Folgueira Bande <128452529+Ivansete-status@users.noreply.github.com>
* Update waku/waku_keystore/protocol_types.nim
Co-authored-by: Ivan Folgueira Bande <128452529+Ivansete-status@users.noreply.github.com>
* fix: greatly improve error handling
* fix: display proc and appropriate assert
---------
Co-authored-by: Ivan Folgueira Bande <128452529+Ivansete-status@users.noreply.github.com>
2023-08-29 17:46:21 +05:30
bd3be21929
fix(rln-relay): sync from deployed block number ( #1955 )
...
* fix(rln-relay): sync from deployed block number
* fix(rln-relay): remove option usage for ints
* fix: unnecessary decl
2023-08-29 13:12:13 +05:30
01634f57f0
fix(rln-relay): window of acceptable roots synced to rln metadata ( #1953 )
...
* fix(rln-relay): window of acceptable roots synced to rln metadata
* fix(rln-relay): s/var/let, use for loop
2023-08-25 23:29:17 +05:30
cc9f8d4254
chore(rln-relay): integrate waku rln registry ( #1943 )
2023-08-25 22:48:52 +05:30
4539dfc761
feat(discv5): topic subscriptions update discv5 filter predicate ( #1918 )
2023-08-23 11:50:59 -04:00
c369b3294e
feat: topic subscriptions updates discv5 ENR ( #1875 )
2023-08-23 09:53:17 -04:00
1ae5b5a951
fix(rln-relay): RLN DB should be aware of chain and contract address ( #1932 )
2023-08-23 18:23:30 +05:30
0ac8a7f0cd
fix(test): fix flaky rln test ( #1923 )
2023-08-22 10:10:54 +02:00
af95b5713f
chore(rln): run rln in all relay pubsubtopics + remove cli flags ( #1917 )
2023-08-21 08:55:34 +02:00
cf3013962c
feat: update various protocols to autoshard ( #1857 )
...
* feat: update FILTER & LIGHTPUSH to autoshard
2023-08-17 08:11:18 -04:00
c9772af0be
fix(rln-relay): timeout on macos runners, use fixed version of ganache ( #1913 )
2023-08-16 17:04:16 +05:30
d5d2243c2e
fix: bring back default topic in config ( #1902 )
...
* fix: bring back default topic in config
* fix
* Fix a bug
* Fix enr creation
2023-08-11 17:28:24 +02:00
b9d5d28af5
chore: remove references to v2 ( #1898 )
...
* chore: remove references to v2
* fix: lingering rln-relay import path
2023-08-09 18:11:50 +01:00
ab344a9dec
chore: remove Waku v1 and wakubridge code ( #1874 )
...
* chore: remove v1 code
* chore: deprecate support for v1 compatibility from JSON-RPC API
* chore: remove v1 tests from JSON-RPC suite
* chore: remove wakubridge code
* chore: remove v1 compatibility functions
* chore: remove support for v1 payloads from chat2 app
* chore: remove v1 from CI processes
* fix: lingering references to private API functions
* fix: remove v1 compat from chat2
* fix: some more lingering references in tests
2023-08-07 15:11:46 +01:00
08ff667227
feat: Rest API interface for legacy (v1) filter service. ( #1851 )
...
* Added Rest API interface for legacy (v1) filter service with tests.
2023-08-04 11:34:22 +02:00
afb93e2995
feat: autosharding content topics in config ( #1856 )
...
- added content topic to config.
- updated ENR building to include content topics.
2023-08-01 16:01:44 -04:00
bbff1ac138
feat: autosharding core algorithm ( #1854 )
...
- basic rendezvous hashing
- content topic parsing
- sharding config
- tests
2023-08-01 09:05:16 -04:00
3fe4522a7e
chore(rln-relay): verify proofs based on bandwidth usage ( #1844 )
...
* chore(rln-relay): Verify proofs based on bandwidth usage
* fix(rln-relay): make default threshold 0, for backwards compat
* fix(rln-relay): add unit test for bandwidth cutoff
* fix(rln-relay): rlnRelayBandwidthTreshold option
2023-07-07 17:28:37 +05:30
17b24cded6
feat: limit relay connections below max conns ( #1813 )
2023-07-04 13:31:18 +02:00
cf46fb7cf6
chore: discv5 re-org clean-up ( #1823 )
...
- Remove discv5 from node and it's builder
- Require a record to init a node (was previously using discv5 record).
- Fix various tests that assumed nodes with discv5.
- Fix ENR creation
- Fix wakubridge
- Fix networkmonitor
2023-06-28 08:57:10 -04:00
e12c979c4e
chore(networking): disconnect due to colocation ip in conn handler ( #1821 )
2023-06-28 09:14:11 +02:00
3aefade647
fix(discv5): Fixing issue that prevented the wakunode2 from starting ( #1829 )
...
* Fixing issue that prevented the wakunode2 from starting
The issue was introduced in PR#1818.
Before this commit, the `wakunode2` app crashed with the next error:
ERR 2023-06-27 15:57:27.268+00:00 5/7 Starting node and protocols failed
topics="wakunode main" tid=1 file=wakunode2.nim:92 error="failed to
start waku discovery v5: "
* fix tests accordingly
* publisher.nim, subscriber.nim: fix
2023-06-27 15:16:59 -04:00
62d3653022
chore: move discv5 out of node. ( #1818 )
...
- Refactor discv5 start, stop & loop.
- Fix tests.
2023-06-27 09:50:11 -04:00
52894a82d0
refactor(archive): Moving waku archive logic from app.nim to the archive module ( #1817 )
...
* Refactoring the Waku Archive. Simplifying the app.nim
This change is needed to accommodate the further PRs where we will integrate Postgres in `wakunode2`.
2023-06-27 13:24:31 +02:00
71c4ac1641
chore: add peer manager config to builder ( #1816 )
2023-06-23 15:30:28 +02:00
4573e8c592
fix(ci): fix broken test with wrong import ( #1820 )
2023-06-23 14:50:58 +02:00
a44d4bfbcd
refactor(databases): Creation of the databases folder to keep the logic for sqlite and postgres ( #1811 )
...
* Refactoring in sqlite and postgres. Creation of the databases folder.
2023-06-22 11:27:40 +02:00
a4da87bb8c
feat: discovery peer filtering for relay shard ( #1804 )
...
Add discv6 predicate that filter peer by static shard.
Co-authored-by: Hanno Cornelius <68783915+jm-clius@users.noreply.github.com>
2023-06-20 12:08:10 -04:00
50412d1880
sharded topic validation & ENR update ( #1795 )
...
Add sharded topic validation and update the node ENR accordingly.
2023-06-19 18:16:25 -04:00
f8e270fbe3
fix(rln-relay): tree race condition upon initialization ( #1807 )
2023-06-19 13:46:05 +05:30
045f07c616
feat(rln-relay): metadata ffi api ( #1803 )
...
* feat(rln-relay): metadata ffi api
* chore(rln-relay): bump to latest master after merge
* fix(rln-relay): naming, visibility, tests
2023-06-16 11:33:41 +05:30
0e9ecbd6a9
fix(rln-relay): flaky static group manager test ( #1798 )
2023-06-14 20:55:33 +05:30
940206b439
feat(rln-relay): integrate get_leaf ffi api ( #1790 )
2023-06-12 15:30:07 +05:30
5fc5770da9
feat(postgres): complete implementation of driver and apply more tests ( #1785 )
2023-06-09 12:42:33 +02:00
cb2e3d86a6
feat(postgres): Adding a postgres async pool to make the db interactions asynchronous ( #1779 )
...
* feat(postgres): added postgres async pool wrapper
---------
Co-authored-by: Lorenzo Delgado <lorenzo@status.im>
2023-06-07 10:08:43 +02:00
a00aa8cc59
feat(rln-relay): pass in index to keystore credentials ( #1777 )
...
* feat(rln-relay): pass in index to keystore credentials
* fix(rln-relay): s/MembershipIndex/uint
2023-06-06 23:13:05 +05:30
34a9263191
feat(networking): integrate gossipsub scoring ( #1769 )
2023-06-06 19:28:47 +02:00
21737c7c1b
feat(discv5): added find random nodes with predicate ( #1762 ) ( #1763 )
...
* feat(discv5): added find random nodes with predicate (#1762 )
Co-authored-by: Lorenzo Delgado <lnsdev@proton.me>
* chore: play around with sleep times on tests
* chore: simplify flaky tests
* chore: update waku/v2/node/waku_node.nim
Co-authored-by: Ivan Folgueira Bande <128452529+Ivansete-status@users.noreply.github.com>
* chore: update tests/v2/test_waku_discv5.nim
Co-authored-by: Ivan Folgueira Bande <128452529+Ivansete-status@users.noreply.github.com>
* chore: update examples/v2/subscriber.nim
Co-authored-by: Ivan Folgueira Bande <128452529+Ivansete-status@users.noreply.github.com>
---------
Co-authored-by: Lorenzo Delgado <lnsdev@proton.me>
Co-authored-by: Ivan Folgueira Bande <128452529+Ivansete-status@users.noreply.github.com>
2023-06-06 16:36:20 +02:00
fcd7f33d9b
Allow compile postgres tests only on Linux platforms ( #1771 )
...
This is needed because currently the GitHub Actions only supports
starting a docker container in a Linux runners.
2023-06-02 14:53:13 +02:00
835a409d10
feat(wakunode2): enable libp2p rendezvous protocol by default ( #1770 )
2023-06-01 21:43:10 +02:00
7df6f4c851
feat(postgresql): align Andrea's PR#1590 changes into master ( #1764 )
...
* Add postgres basic support
* test_driver_postgres.nim: adding simple test to validate asynchronous-ness
* Aligning the changes made by Andrea to the current master state
* test_driver_postgres.nim: new unit test (checking duplicate insertion)
---------
Co-authored-by: Andrea Maria Piana <andrea.maria.piana@gmail.com>
2023-05-31 10:28:48 +02:00
047d1cf095
feat(networking): prune peers from same ip beyond colocation limit ( #1765 )
2023-05-31 09:47:56 +02:00
59ca03a875
feat(postgresql): 1st commit to async sql (waku_archive/driver...) ( #1755 )
2023-05-25 17:34:34 +02:00
3c2d2891e5
chore(px): close px streams after resp is sent ( #1746 )
2023-05-25 16:42:48 +02:00
0fce3d8388
fix(test): wait more for gossip ( #1753 )
2023-05-23 12:01:27 +02:00
46e231d03f
fix: fix flaky test for dos topic ( #1747 )
2023-05-19 12:34:02 +02:00
87f694a8b6
chore(networking): set and use target outbound connections + prune ( #1739 )
2023-05-18 09:40:14 +02:00
611e9539a6
feat(rln-relay): use new atomic_operation ffi api ( #1733 )
...
* chore(rln-relay): bump zerokit
* feat(rln-relay): use new atomic_operations ffi api
* fix(rln-relay): static gm
2023-05-18 10:42:08 +05:30
665484c17b
refactor: proper use of setupNat ( #1740 )
...
Notice that I had to adapt to use 'rlpx_connected_peers' instead
of 'connected_peers' in 'wakunode1.nim' because due to the update
of the 'vendor/nim-eth', which adds the dependency-break with
'confutils' but also includes another changes.
Aside note: we cannot have 'confutils' dependency in 'nim-eth' because
that will prevent the generation of any waku dynamic library.
2023-05-17 18:32:53 +02:00
81dffee893
fix(rln-relay): handle invalid deletes ( #1717 )
2023-05-05 15:48:06 +05:30
3e0a693d2e
chore: add timestamp and ephemeral for opt-in dos validator ( #1713 )
2023-05-05 10:12:49 +02:00
eaa162ee94
chore: add test vectors dos protection validator ( #1711 )
2023-05-04 15:38:52 +02:00
3e14686950
chore: add validator for dos protec metrics and move to app ( #1704 )
2023-05-02 16:20:38 +02:00
b397ed6cbd
refactor:optimize getting number of connections and streams ( #1673 )
2023-04-26 10:47:46 +02:00
c8081c8859
refactor(wakunode2): split setup logic into app module
2023-04-25 15:34:57 +02:00
dca0e9b2cc
chore: refactor flaky test with while ( #1698 )
2023-04-25 09:50:13 +02:00
e041e04342
chore(core): move peers utils module to waku_core
2023-04-24 16:37:54 +02:00
93b0c0713e
chore(core): move utils time module to waku_core
2023-04-19 16:39:52 +02:00
14305c610a
feat: curate peers shared over px protocol ( #1671 )
2023-04-19 16:12:00 +02:00
c9b6b2308c
chore(core): rename waku_message module to waku_core
2023-04-19 13:29:23 +02:00
d7b72ac736
chore: flatten waku v2 protocols folder
2023-04-18 15:22:10 +02:00
9616253611
feat(enr): added support for relay shards field
2023-04-17 15:21:20 +02:00
8d213e85a6
chore: fix test failing intermittently ( #1679 )
2023-04-17 14:30:11 +02:00
d5c2770c54
bug: move canBeConnected to PeerManager and check for potential overflow ( #1670 )
2023-04-14 15:12:22 +02:00
73cbafa658
chore(networking): get relay number of connections from protocol conns/streams ( #1609 )
2023-04-12 13:05:34 +02:00
b2dcb07751
Adding parsePeerInfo and deprecating 'parseRemotePeerInfo' ( #1658 )
2023-04-12 11:29:11 +02:00
0b4a2e68e4
chore: allow to call store api endpoints without a storenode ( #1575 ) ( #1647 )
...
* test_jsonrpc_store: testing when there is no peer-store-node available
2023-04-12 09:26:26 +02:00
418efca27f
feat: integrate new filter protocol, other improvements ( #1637 )
2023-04-11 10:12:54 +02:00
b2acb54d6a
feat(rest-api-store): new rest api to retrieve store waku messages ( #1611 ) ( #1630 )
...
* feat: new rest api based on the current store json-rpc api and
following the same structure as the current relay rest api.
* feat: the store api attend GET requests to retrieve historical messages
* feat: unit tests.
* feat: allow return message to rest-client in case error (4XX or 5XX)
* chore: always allow to call the store api endpoints (only rest) without explicit storenode (#1575 )
* feat: always mounting the current node as storenode client
2023-04-06 11:43:19 +02:00
9dadc1f5a0
refactor(node): remove deprecated constructor and extend testlib with builder
2023-04-05 16:01:51 +02:00
e8448dfdbe
chore: pointed all waku node imports to the barrel import
2023-04-05 11:58:59 +02:00
139428883f
refactor(node): added waku_node barrel import and split config module
2023-04-05 09:46:13 +02:00
0627b4f8f2
chore: remove deprecated enr record init method
2023-04-04 15:35:15 +02:00
caf78249b2
fix: fixed multiple bare except warnings
2023-04-04 15:34:53 +02:00
c26dcb2b39
feat: dos protected topic relay msgs based on meta field ( #1614 )
2023-04-04 10:58:45 +02:00
2b5fd2a21f
chore: remove waku swap protocol
2023-03-31 17:21:40 +02:00
00a3812b91
chore(rln-relay): gracefully handle chain forks ( #1623 )
...
* chore(rln-relay): gracefully handle chain forks
* fix(rln-relay): better root windowing
* fix(rln-relay): better future generation for test
* fix(rln-relay): reduced width
* fix: better naming of futs, collision free
2023-03-31 19:15:04 +05:30
048ca45dc9
build: added testcommon target to makefile
2023-03-31 15:24:04 +02:00
1f79375679
chore: increase meta size to 64 bytes + tests ( #1629 )
2023-03-30 10:38:45 +02:00
2ffd2f8010
refactor(enr): move waku enr multiaddr to typedrecod and builder extensions
2023-03-30 09:35:13 +02:00
85f33a8efd
bug: connect instead dial relay peers ( #1622 )
2023-03-28 13:29:48 +02:00
157724d9b9
refactor(enr): added waku2 capabilities accessor
2023-03-22 16:01:02 +01:00
d920b973b1
feat: further filter improvements ( #1617 )
2023-03-22 10:32:53 +02:00
ac56e1dcdd
feat(common): added extensible implementation of the enr typed record
2023-03-21 17:27:51 +01:00
be446b9892
feat(filter-v2): new filter protocol increment - message handling and clients ( #1600 )
...
* feat: further filter v2 progress
* feat: filter client implementation
* chore: rename test modules
* feat: extend tests and minor improvements
2023-03-20 13:19:53 +02:00
2f3ba3d6d1
chore(rln-relay): reduce exports ( #1615 )
2023-03-20 16:21:35 +05:30
08b2180441
fix(rln-relay): msg validation according to new circuit ( #1594 )
2023-03-13 20:09:33 +05:30
11c19a3751
chore: update submodules ( #1601 )
...
* chore: update submodules
* fix: fix peer store test
* fix: legacy build requires Nim binary deps
2023-03-13 16:33:24 +02:00
075815b072
feat(enr): added enr builder waku capabilities extension
2023-03-10 11:49:41 +01:00
1995bbec6c
feat(common): added the enr builder
2023-03-10 01:33:52 +01:00
622ec27fcd
refactor(networking): unify peer data models, remove StoredInfo ( #1597 )
2023-03-09 11:05:50 -07:00
7639d8d273
refactor(enr): node capabilities code clean up and reorganization
2023-03-08 15:44:10 +01:00
67db35e29d
feat(message): differentiate content and pubsub topic namespacing
2023-03-07 11:10:36 +01:00
d5f93e385d
chore(enr): move waku_enr to protocols module
2023-03-07 10:52:12 +01:00
412ac20606
chore: move discovery protocols under protocol module
2023-03-06 17:18:41 +01:00
Aaryamann Challani
Alvaro Revuelta
Simon-Pierre Vivier
Hanno Cornelius
NagyZoltanPeter
Ivan Folgueira Bande
Vaclav Pavlin
Vaclav Pavlin
Lorenzo Delgado