69406bf1f0
reintroduce and deprecate named sharding ( #1751 )
...
Co-authored-by: danisharora099 <danisharora099@gmail.com>
2024-01-10 13:04:30 +05:30
528803f4c8
fix(tests): multiple pubsub topics ( #1774 )
2024-01-09 13:43:44 +05:30
c81872ae0e
supress info log for tests ( #1763 )
2024-01-02 16:30:18 +05:30
9983549e8b
chore: use connected peers instead of discovered peers for protocols ( #1758 )
...
* switch to use connected peers instead of discovered peers for protocols
* switch to use connected peers instead of discovered peers for protocols
2024-01-02 15:49:31 +05:30
b7e78ca370
light-push/index.node.spec.ts: adjust metadata size to nwaku max size adjustment
...
The "Fails to push message with large meta" test used 10 ** 6 when
`nwaku` node had MaxWakuMessageSize == 1MiB ( 1*2^20 .)
`nwaku` establishes the max lightpush msg size as `const MaxRpcSize* =
MaxWakuMessageSize + 64 * 1024`
see:
07beea0209/waku/waku_lightpush/rpc_codec.nim (L15)https://github.com/waku-org/nwaku/pull/2298 we reduced the
MaxWakuMessageSize
from 1MiB to 150KiB. Therefore, the 105024 number comes from
substracting ( 1*2^20 - 150*2^10 )
to the original 10^6 that this test had when MaxWakuMessageSize ==
1*2^20
2023-12-22 11:04:09 +01:00
2bc3735e4d
feat: add support for autosharded pubsub topics
...
tests: use a generator for sharded pubsub topics
set pubsub topic in encoder/decoder based on sharding type
add function for grouping content topics by pubsub topic
add autosharding config to create options
add autoshard rpc endpoints to nwaku and use in tests
set autoshard pubsub topics in all protocols
fix rebase with static sharding
removes unused function
remove console logs
remove autosharding from ShardInfo, add to EncoderOptions
fix enr and encoder/decoder options
test that same application/version hashes to same shard index
update comment on shard field
fix spelling of autosharding
fix content topic protocol in tests
add sharding type alias and function to determine topic in encoders/decoders
move DefaultPubsubTopic from core to interfaces
2023-12-21 10:03:22 -08:00
4de54865ca
chore(deps)(deps-dev): bump @types/tail from 2.2.1 to 2.2.3 ( #1760 )
...
Bumps [@types/tail](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/tail ) from 2.2.1 to 2.2.3.
- [Release notes](https://github.com/DefinitelyTyped/DefinitelyTyped/releases )
- [Commits](https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/tail )
---
updated-dependencies:
- dependency-name: "@types/tail"
dependency-type: direct:development
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-12-19 20:47:33 +01:00
566e02e0cf
chore(deps)(deps-dev): bump datastore-core from 9.2.3 to 9.2.6 ( #1757 )
...
Bumps [datastore-core](https://github.com/ipfs/js-stores ) from 9.2.3 to 9.2.6.
- [Release notes](https://github.com/ipfs/js-stores/releases )
- [Commits](https://github.com/ipfs/js-stores/compare/datastore-core-v9.2.3...datastore-core-v9.2.6 )
---
updated-dependencies:
- dependency-name: datastore-core
dependency-type: direct:development
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-12-15 02:50:25 +05:30
9ac2a3f363
feat: metadata protocol ( #1732 )
...
* add proto
* add rpc and interfaces
* add protocol implementation
* update faulty proto def
* add rpc and interfaces
* refactor implementation & write test
* setup the metadata protocol as a service
* fix cases where metadata service needs to be undefined
* remove redundant catch block
* remove addressed TODO
* update import path
* log errors
* remove redundant code from handling incoming metadata request
* update tests
* add test to check for active connections
* change expects
* save remote peer's shard info after successful connection
2023-12-05 19:26:52 +05:30
12a553494f
chore(deps)(deps): bump sinon and @types/sinon ( #1747 )
...
Bumps [sinon](https://github.com/sinonjs/sinon ) and [@types/sinon](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/sinon ). These dependencies needed to be updated together.
Updates `sinon` from 16.0.0 to 17.0.1
- [Release notes](https://github.com/sinonjs/sinon/releases )
- [Changelog](https://github.com/sinonjs/sinon/blob/main/docs/changelog.md )
- [Commits](https://github.com/sinonjs/sinon/compare/v16.0.0...v17.0.1 )
Updates `@types/sinon` from 10.0.16 to 17.0.2
- [Release notes](https://github.com/DefinitelyTyped/DefinitelyTyped/releases )
- [Commits](https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/sinon )
---
updated-dependencies:
- dependency-name: sinon
dependency-type: direct:production
update-type: version-update:semver-major
- dependency-name: "@types/sinon"
dependency-type: direct:development
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-12-05 14:29:06 +05:30
bbd372120a
chore: update all references of shard info to RFC terminology ( #1740 )
...
* update all references of shard info to RFC terminology
* bump nwaku to v0.22.0 (#1741 )
2023-11-29 17:37:59 +05:30
4d19fc7b75
bump nwaku to v0.22.0 ( #1741 )
2023-11-29 15:48:50 +05:30
4cf2ffefa7
feat!: add support for sharded pubsub topics & remove support for named pubsub topics ( #1697 )
...
* merge branches
* tests: use a generator for sharded pubsub topics
* fix namespace edge case
* move shardInfo to pubsubTopic logic in waku.ts
* simplify encoder/decoder creation logic + update tests
* sharding utils: add error handling
* remove redundant test util
* baseprotocol: create abstraction for initialising pubsub topics
* fix: `createDecoder` interface
* filter: createSubscription takes shardInfo instead of pubsubTopicStr
* fix: sharding utils for error handling
* SingleShardInfo: use a new interface instead of omitting and rename namespace
* change redundant namespaces
2023-11-28 15:57:18 +05:30
7eb3375f50
feat!: export crypto primitives ( #1728 )
...
* export crypto primitives
* export crypto
* update imports
* fix size limit
* rename crypto.js
* move Signature type
* fix path
* fix: size-limit (#1734 )
* fix paths, revert change to config
---------
Co-authored-by: Danish Arora <35004822+danisharora099@users.noreply.github.com>
2023-11-28 01:02:12 +01:00
7df21b7756
chore: add info message with expected WebSocket connection failures ( #1733 )
...
* audit deps
* add info message
* add option to hide message
* add test
* remove only
2023-11-28 00:40:59 +01:00
1d0e2ace7f
feat: track node connection state ( #1719 )
...
Co-authored-by: chair <29414216+chair28980@users.noreply.github.com>
Co-authored-by: Sasha <118575614+weboko@users.noreply.github.com>
2023-11-27 12:44:49 +01:00
affdc265b8
chore(deps)(deps): bump chai and @types/chai ( #1731 )
...
Bumps [chai](https://github.com/chaijs/chai ) and [@types/chai](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/chai ). These dependencies needed to be updated together.
Updates `chai` from 4.3.8 to 4.3.10
- [Release notes](https://github.com/chaijs/chai/releases )
- [Changelog](https://github.com/chaijs/chai/blob/4.x.x/History.md )
- [Commits](https://github.com/chaijs/chai/compare/v4.3.8...v4.3.10 )
Updates `@types/chai` from 4.3.6 to 4.3.11
- [Release notes](https://github.com/DefinitelyTyped/DefinitelyTyped/releases )
- [Commits](https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/chai )
---
updated-dependencies:
- dependency-name: chai
dependency-type: direct:production
update-type: version-update:semver-patch
- dependency-name: "@types/chai"
dependency-type: direct:development
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-11-27 12:26:31 +01:00
3166a5135e
chore!: change all instances of `PubSubTopic` to `PubsubTopic` ( #1703 )
...
* rename all PubSub patterns
* feat: forbid identifiers with camelcase pubSub (#1709 )
---------
Co-authored-by: Arseniy Klempner <adklempner@gmail.com>
2023-11-14 18:52:52 +03:00
4c5a8a9b64
chore(deps)(deps-dev): bump @libp2p/bootstrap from 9.0.6 to 9.0.10 ( #1700 )
...
Bumps [@libp2p/bootstrap](https://github.com/libp2p/js-libp2p ) from 9.0.6 to 9.0.10.
- [Release notes](https://github.com/libp2p/js-libp2p/releases )
- [Changelog](https://github.com/libp2p/js-libp2p/blob/master/.release-please.json )
- [Commits](https://github.com/libp2p/js-libp2p/compare/mdns-v9.0.6...mdns-v9.0.10 )
---
updated-dependencies:
- dependency-name: "@libp2p/bootstrap"
dependency-type: direct:development
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-11-04 00:18:11 +01:00
b7dc3d7576
fix: measure total message size ( #1643 )
...
Network message limitations are imposed on the whole message, not just
the payload.
Co-authored-by: Sasha <118575614+weboko@users.noreply.github.com>
2023-10-26 13:14:47 +02:00
9593a8a8a5
test: fix ci logs ( #1687 )
...
* fix ci logs
* replace lodash with uint8arrays/equals
2023-10-25 10:39:04 +03:00
1ec0c200ca
chore: new relay tests ( #1649 )
...
* make relay folder
* make relay folder
* adjust message collector for relay
* small fix
* small fix
* small fix
* split tests more
* small fixes
* small fix
* new test
* fix pubsubtopic name
* new subscribe tests
* new subscribe tests
* new tests
* small fix after ci run
* small fix after ci run2
* fix skipped test
* added issue for skipped test
2023-10-23 18:08:33 +03:00
80a33b9c2b
chore: allure test reporting ( #1668 )
...
* allure test reporting
* make reports only for the main job
* fail a test for demo
* fail a test for demo
* revert
* fail a test for demo
* revert
* deploy to allure-jswaku
* use PAT
* add pat as secret
* check if pat exists
* debug secrets issue
* remove debug steps
* debug1
* debug2
* debug3
* debug4
* set reports for all tests
* fix after ci run
* self review
---------
Co-authored-by: Sasha <118575614+weboko@users.noreply.github.com>
2023-10-23 17:53:56 +03:00
491366bd4f
fix: filter subscription with `pubsubTopic1` and decoder with `pubsubTopic2` ( #1675 )
...
* add a test for a failing case
* add error handling & update test
* remove only
* rename test
2023-10-23 14:17:02 +05:30
1892f5093d
fix: don't dial discovered peers if have already been attempted dial ( #1657 )
...
* don't dial peers if they exist in PeerStore already
* fix(tests): bugs & add types to dispatch event
* fix: more tests
* fix: dial validation
* update doc & reduce delay
* refactor test
* use -1 instead of Infinity
* fix comment
* fix rebase
2023-10-20 18:16:48 +05:30
0f7d63ef93
feat: Logger with log levels ( #1672 )
...
* setup a custom Logger with log level support
* refactor codebase for to use new Logger with log levels
* disallow usage of `debug` directly / only allow usage in/through custom Logger
* remove `debug` from logger
2023-10-20 16:36:47 +05:30
1150ddcd02
fix: remote peer rejected ( #1645 )
...
* update empty payload light push tests response
* bump up nwaku version
* remove only
* remove diff between gowaku and nwaku
2023-10-20 10:21:15 +03:00
2af96281cd
test: ensure filter/light push work with message-encryption ( #1671 )
...
Co-authored-by: Sasha <118575614+weboko@users.noreply.github.com>
2023-10-18 13:07:11 +02:00
6aade791cc
chore(deps)(deps): bump libp2p from 0.46.12 to 0.46.14 ( #1670 )
...
Bumps [libp2p](https://github.com/libp2p/js-libp2p ) from 0.46.12 to 0.46.14.
- [Release notes](https://github.com/libp2p/js-libp2p/releases )
- [Changelog](https://github.com/libp2p/js-libp2p/blob/master/.release-please.json )
- [Commits](https://github.com/libp2p/js-libp2p/compare/libp2p-v0.46.12...libp2p-v0.46.14 )
---
updated-dependencies:
- dependency-name: libp2p
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-18 11:49:20 +05:30
c4ed9d8b90
chore(deps)(deps): bump @libp2p/peer-id from 3.0.2 to 3.0.3 ( #1663 )
...
Bumps [@libp2p/peer-id](https://github.com/libp2p/js-libp2p ) from 3.0.2 to 3.0.3.
- [Release notes](https://github.com/libp2p/js-libp2p/releases )
- [Changelog](https://github.com/libp2p/js-libp2p/blob/master/.release-please.json )
- [Commits](https://github.com/libp2p/js-libp2p/compare/logger-v3.0.2...logger-v3.0.3 )
---
updated-dependencies:
- dependency-name: "@libp2p/peer-id"
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Danish Arora <35004822+danisharora099@users.noreply.github.com>
2023-10-17 12:22:19 +05:30
6bad4ea7d1
feat: fail early when trying to send empty payload ( #1642 )
...
* refactor: rename as this method does not check empty payloads
* feat: fail early when trying to send empty payload
---------
Co-authored-by: Sasha <oleksandr@status.im>
2023-10-17 00:14:45 +02:00
9fe04d85f3
chore: use `pubsubTopic`/`pubsubTopics` across the codebase ( #1653 )
...
* chore: change all references of pubSubTopic to pubsubTopic
* change references of pubSubTopics to pubsubTopics
* flag words in cspell
2023-10-16 12:52:32 +05:30
b96c3bd3e1
chore: disable paralles runs locally ( #1662 )
...
* disable paralles runs locally
* add logs
* add readme info about local execution
2023-10-13 17:32:28 +03:00
ce5a48c13c
gowaku store bugfixes ( #1661 )
2023-10-13 17:21:30 +03:00
b8d006bee7
chore: refactor `ConnectionManager` for readability & maintainability ( #1658 )
...
* restructure shouldDialPeer for readability & maintainability:
* fix return & add logs
* fix: check on dialPeer instead of attemptDial
* rm: console log
2023-10-13 18:08:37 +05:30
d39d4507ef
chore: add a test that uses ping to check filter subscription ( #1656 )
...
* add a test that uses ping to check filter subscription
* remove comment
2023-10-13 16:53:15 +05:30
347cbfa08a
chore: run tests in parallel ( #1655 )
...
* run tests in parallel
* small fixes
* small fixes
* fix setup of nodes
* fix relay tests
* fix Static Sharding: Running Nodes tests
* try with 5 threads
* try with 6 threads
* use startWithRetries as default start
* revert to 6
* set 10 jobs
* revert to back to 6
* add CI info in readme
2023-10-13 12:36:43 +03:00
124a29ebba
feat(static-sharding): filter peer connections per shards ( #1626 )
...
* add interface for `ShardInfo`
* enr: add deserialization logic & setup getters
* add sharding related utils
* utils: add shard<-> bytes conversion helpers
* pass `pubSubTopics` to `Waku`
* add `rs`/`rsv` details during discovery
* connection-manager: discard irrelevant peers
* add tests for static sharding - peer exchange
* update `ConnectionManager` tests to account for topic validity
* add js suffix to import
* address some comments
* move shardInfo encoding to ENR
* test: update for new API
* enr: add tests for serialisation & deserialisation
* address comment
* update test
* move getPeershardInfo to ConnectionManager and return ShardInfo instead of bytes
* update encoding and decoding relay shards to also factor for shards>64
* relay shard encoding decoding: use DataView and verbose spec tests
* improve tests for relay shard encoding decoding
* rm: only
* improve log message for unconfigured pubsub topic
* minor improvement
* fix: buffer <> Uint8array problems with shard decoding
* fix: test
* rm: only
2023-10-10 20:18:02 +05:30
aa195a75ed
fix unsubscribes test
2023-10-10 10:18:01 +03:00
7e96644ba8
merge master into branch
2023-10-10 09:59:24 +03:00
6f8cf039df
remove .only
2023-10-10 09:23:51 +03:00
aa93a441d5
use loadash instead of custom function
2023-10-10 09:15:36 +03:00
c9389e3d07
improve teardown nodes
2023-10-10 09:03:44 +03:00
1d1c7a28a8
updated wrong cursor test
2023-10-10 08:51:41 +03:00
b0d658c4a1
add comments for known issues
2023-10-09 14:52:40 +03:00
95dbac3c57
self review
2023-10-06 13:34:30 +03:00
0e5ff3e13d
add final tests
2023-10-06 12:45:00 +03:00
5519877b5e
adjustments
2023-10-06 11:24:10 +03:00
0b1f2ec31d
Merge branch 'master' of https://github.com/waku-org/js-waku into chore/new-store-tests
2023-10-05 19:07:02 +03:00
c52b895c1e
new store tests
2023-10-05 19:06:37 +03:00
Arseniy Klempner
Danish Arora
Ivan Folgueira Bande
danisharora099
dependabot[bot]
Sasha
fryorcraken
Florin Barbu
fbarbu15