08ff667227
feat: Rest API interface for legacy (v1) filter service. ( #1851 )
...
* Added Rest API interface for legacy (v1) filter service with tests.
2023-08-04 11:34:22 +02:00
afb93e2995
feat: autosharding content topics in config ( #1856 )
...
- added content topic to config.
- updated ENR building to include content topics.
2023-08-01 16:01:44 -04:00
bbff1ac138
feat: autosharding core algorithm ( #1854 )
...
- basic rendezvous hashing
- content topic parsing
- sharding config
- tests
2023-08-01 09:05:16 -04:00
3fe4522a7e
chore(rln-relay): verify proofs based on bandwidth usage ( #1844 )
...
* chore(rln-relay): Verify proofs based on bandwidth usage
* fix(rln-relay): make default threshold 0, for backwards compat
* fix(rln-relay): add unit test for bandwidth cutoff
* fix(rln-relay): rlnRelayBandwidthTreshold option
2023-07-07 17:28:37 +05:30
17b24cded6
feat: limit relay connections below max conns ( #1813 )
2023-07-04 13:31:18 +02:00
cf46fb7cf6
chore: discv5 re-org clean-up ( #1823 )
...
- Remove discv5 from node and it's builder
- Require a record to init a node (was previously using discv5 record).
- Fix various tests that assumed nodes with discv5.
- Fix ENR creation
- Fix wakubridge
- Fix networkmonitor
2023-06-28 08:57:10 -04:00
e12c979c4e
chore(networking): disconnect due to colocation ip in conn handler ( #1821 )
2023-06-28 09:14:11 +02:00
3aefade647
fix(discv5): Fixing issue that prevented the wakunode2 from starting ( #1829 )
...
* Fixing issue that prevented the wakunode2 from starting
The issue was introduced in PR#1818.
Before this commit, the `wakunode2` app crashed with the next error:
ERR 2023-06-27 15:57:27.268+00:00 5/7 Starting node and protocols failed
topics="wakunode main" tid=1 file=wakunode2.nim:92 error="failed to
start waku discovery v5: "
* fix tests accordingly
* publisher.nim, subscriber.nim: fix
2023-06-27 15:16:59 -04:00
62d3653022
chore: move discv5 out of node. ( #1818 )
...
- Refactor discv5 start, stop & loop.
- Fix tests.
2023-06-27 09:50:11 -04:00
52894a82d0
refactor(archive): Moving waku archive logic from app.nim to the archive module ( #1817 )
...
* Refactoring the Waku Archive. Simplifying the app.nim
This change is needed to accommodate the further PRs where we will integrate Postgres in `wakunode2`.
2023-06-27 13:24:31 +02:00
71c4ac1641
chore: add peer manager config to builder ( #1816 )
2023-06-23 15:30:28 +02:00
4573e8c592
fix(ci): fix broken test with wrong import ( #1820 )
2023-06-23 14:50:58 +02:00
a44d4bfbcd
refactor(databases): Creation of the databases folder to keep the logic for sqlite and postgres ( #1811 )
...
* Refactoring in sqlite and postgres. Creation of the databases folder.
2023-06-22 11:27:40 +02:00
a4da87bb8c
feat: discovery peer filtering for relay shard ( #1804 )
...
Add discv6 predicate that filter peer by static shard.
Co-authored-by: Hanno Cornelius <68783915+jm-clius@users.noreply.github.com>
2023-06-20 12:08:10 -04:00
50412d1880
sharded topic validation & ENR update ( #1795 )
...
Add sharded topic validation and update the node ENR accordingly.
2023-06-19 18:16:25 -04:00
f8e270fbe3
fix(rln-relay): tree race condition upon initialization ( #1807 )
2023-06-19 13:46:05 +05:30
045f07c616
feat(rln-relay): metadata ffi api ( #1803 )
...
* feat(rln-relay): metadata ffi api
* chore(rln-relay): bump to latest master after merge
* fix(rln-relay): naming, visibility, tests
2023-06-16 11:33:41 +05:30
0e9ecbd6a9
fix(rln-relay): flaky static group manager test ( #1798 )
2023-06-14 20:55:33 +05:30
940206b439
feat(rln-relay): integrate get_leaf ffi api ( #1790 )
2023-06-12 15:30:07 +05:30
5fc5770da9
feat(postgres): complete implementation of driver and apply more tests ( #1785 )
2023-06-09 12:42:33 +02:00
cb2e3d86a6
feat(postgres): Adding a postgres async pool to make the db interactions asynchronous ( #1779 )
...
* feat(postgres): added postgres async pool wrapper
---------
Co-authored-by: Lorenzo Delgado <lorenzo@status.im>
2023-06-07 10:08:43 +02:00
a00aa8cc59
feat(rln-relay): pass in index to keystore credentials ( #1777 )
...
* feat(rln-relay): pass in index to keystore credentials
* fix(rln-relay): s/MembershipIndex/uint
2023-06-06 23:13:05 +05:30
34a9263191
feat(networking): integrate gossipsub scoring ( #1769 )
2023-06-06 19:28:47 +02:00
21737c7c1b
feat(discv5): added find random nodes with predicate ( #1762 ) ( #1763 )
...
* feat(discv5): added find random nodes with predicate (#1762 )
Co-authored-by: Lorenzo Delgado <lnsdev@proton.me>
* chore: play around with sleep times on tests
* chore: simplify flaky tests
* chore: update waku/v2/node/waku_node.nim
Co-authored-by: Ivan Folgueira Bande <128452529+Ivansete-status@users.noreply.github.com>
* chore: update tests/v2/test_waku_discv5.nim
Co-authored-by: Ivan Folgueira Bande <128452529+Ivansete-status@users.noreply.github.com>
* chore: update examples/v2/subscriber.nim
Co-authored-by: Ivan Folgueira Bande <128452529+Ivansete-status@users.noreply.github.com>
---------
Co-authored-by: Lorenzo Delgado <lnsdev@proton.me>
Co-authored-by: Ivan Folgueira Bande <128452529+Ivansete-status@users.noreply.github.com>
2023-06-06 16:36:20 +02:00
fcd7f33d9b
Allow compile postgres tests only on Linux platforms ( #1771 )
...
This is needed because currently the GitHub Actions only supports
starting a docker container in a Linux runners.
2023-06-02 14:53:13 +02:00
835a409d10
feat(wakunode2): enable libp2p rendezvous protocol by default ( #1770 )
2023-06-01 21:43:10 +02:00
7df6f4c851
feat(postgresql): align Andrea's PR#1590 changes into master ( #1764 )
...
* Add postgres basic support
* test_driver_postgres.nim: adding simple test to validate asynchronous-ness
* Aligning the changes made by Andrea to the current master state
* test_driver_postgres.nim: new unit test (checking duplicate insertion)
---------
Co-authored-by: Andrea Maria Piana <andrea.maria.piana@gmail.com>
2023-05-31 10:28:48 +02:00
047d1cf095
feat(networking): prune peers from same ip beyond colocation limit ( #1765 )
2023-05-31 09:47:56 +02:00
59ca03a875
feat(postgresql): 1st commit to async sql (waku_archive/driver...) ( #1755 )
2023-05-25 17:34:34 +02:00
3c2d2891e5
chore(px): close px streams after resp is sent ( #1746 )
2023-05-25 16:42:48 +02:00
0fce3d8388
fix(test): wait more for gossip ( #1753 )
2023-05-23 12:01:27 +02:00
46e231d03f
fix: fix flaky test for dos topic ( #1747 )
2023-05-19 12:34:02 +02:00
87f694a8b6
chore(networking): set and use target outbound connections + prune ( #1739 )
2023-05-18 09:40:14 +02:00
611e9539a6
feat(rln-relay): use new atomic_operation ffi api ( #1733 )
...
* chore(rln-relay): bump zerokit
* feat(rln-relay): use new atomic_operations ffi api
* fix(rln-relay): static gm
2023-05-18 10:42:08 +05:30
665484c17b
refactor: proper use of setupNat ( #1740 )
...
Notice that I had to adapt to use 'rlpx_connected_peers' instead
of 'connected_peers' in 'wakunode1.nim' because due to the update
of the 'vendor/nim-eth', which adds the dependency-break with
'confutils' but also includes another changes.
Aside note: we cannot have 'confutils' dependency in 'nim-eth' because
that will prevent the generation of any waku dynamic library.
2023-05-17 18:32:53 +02:00
81dffee893
fix(rln-relay): handle invalid deletes ( #1717 )
2023-05-05 15:48:06 +05:30
3e0a693d2e
chore: add timestamp and ephemeral for opt-in dos validator ( #1713 )
2023-05-05 10:12:49 +02:00
eaa162ee94
chore: add test vectors dos protection validator ( #1711 )
2023-05-04 15:38:52 +02:00
3e14686950
chore: add validator for dos protec metrics and move to app ( #1704 )
2023-05-02 16:20:38 +02:00
b397ed6cbd
refactor:optimize getting number of connections and streams ( #1673 )
2023-04-26 10:47:46 +02:00
c8081c8859
refactor(wakunode2): split setup logic into app module
2023-04-25 15:34:57 +02:00
dca0e9b2cc
chore: refactor flaky test with while ( #1698 )
2023-04-25 09:50:13 +02:00
e041e04342
chore(core): move peers utils module to waku_core
2023-04-24 16:37:54 +02:00
93b0c0713e
chore(core): move utils time module to waku_core
2023-04-19 16:39:52 +02:00
14305c610a
feat: curate peers shared over px protocol ( #1671 )
2023-04-19 16:12:00 +02:00
c9b6b2308c
chore(core): rename waku_message module to waku_core
2023-04-19 13:29:23 +02:00
d7b72ac736
chore: flatten waku v2 protocols folder
2023-04-18 15:22:10 +02:00
9616253611
feat(enr): added support for relay shards field
2023-04-17 15:21:20 +02:00
8d213e85a6
chore: fix test failing intermittently ( #1679 )
2023-04-17 14:30:11 +02:00
d5c2770c54
bug: move canBeConnected to PeerManager and check for potential overflow ( #1670 )
2023-04-14 15:12:22 +02:00
73cbafa658
chore(networking): get relay number of connections from protocol conns/streams ( #1609 )
2023-04-12 13:05:34 +02:00
b2dcb07751
Adding parsePeerInfo and deprecating 'parseRemotePeerInfo' ( #1658 )
2023-04-12 11:29:11 +02:00
0b4a2e68e4
chore: allow to call store api endpoints without a storenode ( #1575 ) ( #1647 )
...
* test_jsonrpc_store: testing when there is no peer-store-node available
2023-04-12 09:26:26 +02:00
418efca27f
feat: integrate new filter protocol, other improvements ( #1637 )
2023-04-11 10:12:54 +02:00
b2acb54d6a
feat(rest-api-store): new rest api to retrieve store waku messages ( #1611 ) ( #1630 )
...
* feat: new rest api based on the current store json-rpc api and
following the same structure as the current relay rest api.
* feat: the store api attend GET requests to retrieve historical messages
* feat: unit tests.
* feat: allow return message to rest-client in case error (4XX or 5XX)
* chore: always allow to call the store api endpoints (only rest) without explicit storenode (#1575 )
* feat: always mounting the current node as storenode client
2023-04-06 11:43:19 +02:00
9dadc1f5a0
refactor(node): remove deprecated constructor and extend testlib with builder
2023-04-05 16:01:51 +02:00
e8448dfdbe
chore: pointed all waku node imports to the barrel import
2023-04-05 11:58:59 +02:00
139428883f
refactor(node): added waku_node barrel import and split config module
2023-04-05 09:46:13 +02:00
0627b4f8f2
chore: remove deprecated enr record init method
2023-04-04 15:35:15 +02:00
caf78249b2
fix: fixed multiple bare except warnings
2023-04-04 15:34:53 +02:00
c26dcb2b39
feat: dos protected topic relay msgs based on meta field ( #1614 )
2023-04-04 10:58:45 +02:00
2b5fd2a21f
chore: remove waku swap protocol
2023-03-31 17:21:40 +02:00
00a3812b91
chore(rln-relay): gracefully handle chain forks ( #1623 )
...
* chore(rln-relay): gracefully handle chain forks
* fix(rln-relay): better root windowing
* fix(rln-relay): better future generation for test
* fix(rln-relay): reduced width
* fix: better naming of futs, collision free
2023-03-31 19:15:04 +05:30
048ca45dc9
build: added testcommon target to makefile
2023-03-31 15:24:04 +02:00
1f79375679
chore: increase meta size to 64 bytes + tests ( #1629 )
2023-03-30 10:38:45 +02:00
2ffd2f8010
refactor(enr): move waku enr multiaddr to typedrecod and builder extensions
2023-03-30 09:35:13 +02:00
85f33a8efd
bug: connect instead dial relay peers ( #1622 )
2023-03-28 13:29:48 +02:00
157724d9b9
refactor(enr): added waku2 capabilities accessor
2023-03-22 16:01:02 +01:00
d920b973b1
feat: further filter improvements ( #1617 )
2023-03-22 10:32:53 +02:00
ac56e1dcdd
feat(common): added extensible implementation of the enr typed record
2023-03-21 17:27:51 +01:00
be446b9892
feat(filter-v2): new filter protocol increment - message handling and clients ( #1600 )
...
* feat: further filter v2 progress
* feat: filter client implementation
* chore: rename test modules
* feat: extend tests and minor improvements
2023-03-20 13:19:53 +02:00
2f3ba3d6d1
chore(rln-relay): reduce exports ( #1615 )
2023-03-20 16:21:35 +05:30
08b2180441
fix(rln-relay): msg validation according to new circuit ( #1594 )
2023-03-13 20:09:33 +05:30
11c19a3751
chore: update submodules ( #1601 )
...
* chore: update submodules
* fix: fix peer store test
* fix: legacy build requires Nim binary deps
2023-03-13 16:33:24 +02:00
075815b072
feat(enr): added enr builder waku capabilities extension
2023-03-10 11:49:41 +01:00
1995bbec6c
feat(common): added the enr builder
2023-03-10 01:33:52 +01:00
622ec27fcd
refactor(networking): unify peer data models, remove StoredInfo ( #1597 )
2023-03-09 11:05:50 -07:00
7639d8d273
refactor(enr): node capabilities code clean up and reorganization
2023-03-08 15:44:10 +01:00
67db35e29d
feat(message): differentiate content and pubsub topic namespacing
2023-03-07 11:10:36 +01:00
d5f93e385d
chore(enr): move waku_enr to protocols module
2023-03-07 10:52:12 +01:00
412ac20606
chore: move discovery protocols under protocol module
2023-03-06 17:18:41 +01:00
1c39de7fbc
refactor(message): move namespacing utils to waku message module
2023-03-03 10:07:25 +01:00
ef7ce679df
feat: new filter protocol increment - subscribe request handling ( #1584 )
...
* feat: new filter protocol service node
* feat: add test and fix compilation errors
* feat: more tests and minor fixes
* chore: update waku/v2/protocol/waku_filter_v2/protocol.nim
Co-authored-by: Lorenzo Delgado <lorenzo@status.im>
* chore: add some convenience functions
---------
Co-authored-by: Lorenzo Delgado <lorenzo@status.im>
2023-03-02 17:23:30 +02:00
a57bea299b
feat(message): added waku message deterministic hashing
2023-03-02 11:41:41 +01:00
699a35217b
chore(rln-relay): move rln-relay test suite to own dir ( #1587 )
...
* chore(rln-relay): move rln-relay test suite to own dir
* fix(tests): rename test_utils to utils
2023-03-02 15:37:37 +05:30
92546bd997
chore(rln-relay): address laundry list of improvements ( #1585 )
2023-03-01 17:29:13 +05:30
4066b7490c
tests(common): extend base64 test coverage
2023-03-01 10:28:55 +01:00
8f66e61ac1
feat(rln-relay): group manager integration ( #1496 )
...
* feat(rln-relay): init group manager integration
fix(rln-relay): integrate group manager. todo spam and reg handlers
fix(rln-relay): decouple waku-relay and waku-rln-relay
fix(rln-relay): compiles now
fix(chat2): compilation
fix(rln-relay): wip segfault
fix(rln-relay): segfault
fix(chat2|wakunode2): use optional field
fix(rln-relay): wakunode test
fix(rln-relay): uncomment fields in proto decode
fix(rln-relay): used pragma on tests
fix(rln-relay): include cred processing
fix(rln-relay): add reg callback
fix(rln-relay): args to mount
fix(rln-relay): add timeout to waitForExit
fix(rln-relay): use osproc term instead of posix kill
fix(rln-relay): use poParentStream to prevent deadlock
fix(rln-relay): remove poParentStream, remove ganache log output
* fix(rln-relay): abstract tuple into own type
2023-02-28 19:08:30 +05:30
700dbbb7fd
refactor(networking): peermanager refactor and cleanups ( #1539 )
...
* refactor(networking): use addServicePeer where needed + add metrics
2023-02-27 10:24:31 -07:00
8258415804
fix(jsonrpc): use padded-base64 for payload encoding
2023-02-23 09:31:06 +01:00
b6a011733d
chore(rln-relay): bump zerokit and update ffi ( #1571 )
...
fix(chat2): compilation
2023-02-22 19:47:12 +05:30
59203c7453
fix: allow higher resolution timestamps ( #1570 )
...
* fix: allow higher resolution timestamps
* fix: higher precision requires coarser test
2023-02-21 14:52:30 +02:00
f7584dfc49
feat(protobuf): added error wrappers for invalid length validation
2023-02-20 15:03:32 +01:00
9258914057
fix(jsonrpc): encode waku messages payload in base64 ( #1139 )
2023-02-14 09:19:06 +01:00
28e5bcf8b5
fix(networking): fix flaky peerstore test ( #1554 )
2023-02-13 18:10:20 +01:00
0a15ce48d8
refactor(rest): deep code and tests reorganization
2023-02-13 15:22:24 +01:00
9a40ad6400
fix: remove unused imports
2023-02-13 15:02:34 +01:00
6eb13b9a0b
fix(tests): do not specify port number
2023-02-13 12:27:49 +01:00
6782398989
feat(testlib): added global tests rng and waku2 sub-module
2023-02-13 11:43:49 +01:00
a7f0a7f704
fix(node): remove subscription to waku default network topic ( #1545 )
2023-02-10 17:55:47 +01:00
NagyZoltanPeter
Simon-Pierre Vivier
Aaryamann Challani
Alvaro Revuelta
Ivan Folgueira Bande
Hanno Cornelius
Vaclav Pavlin
Vaclav Pavlin
Lorenzo Delgado