e2cab1a8ae
fix: ensure community events eventual consistency
...
- Extracted `community_events_factory.go`
- Introduced `eventsProcessor`
- Improved processing logic order
- Improved events filtering
- Introduced concept of `EventTypeID` to prevent redundant events handling
- Added sanity check before events appliance when reading community from
database
- Removed reject&re-apply scheme (no more ping-pong issue)
- Fixed and added more variants to eventual consistency test
fixes : status-im/status-desktop#13387
fixes : status-im/status-desktop#13388
2024-02-20 21:07:01 +01:00
f7c40d4c40
chore: use lamport timestamp for events clock
...
- make clock logical per event type
- increase clock precision to millisecends
Rationale:
https://www.notion.so/Eventual-consistency-9d6a9c6c55c14ab1aee76f801301522b
iterates: status-im/status-desktop#13387
2024-02-20 21:07:01 +01:00
3f19972c8e
enable custom community storenodes ( #4532 )
...
* enable custom community store nodes
* fix
* fix
* fix
* fix
* cleanup
* fix
* migration
* fix
* cleanup
* fix
* cleanup
* fix
* fix
* cleanup
* message to update the community storenodes
* rename
* fix test
* wait for availability only if global storenode
* fix test
* fix typo
* sync community storenodes
* remove unused
* add tests
* fix imports
* fix todo
* unused
* pr comments
* pr feedback
* revert merge deleted
* fix lint
* fix db and perform ms request
* typo
* fix log
* fix go imports
* refactor handle message
* cleanup public message
* add tests
* fix test
* cleanup test
* fix test
* avoid making one file to big to keep codeclimate from complaining
* fix lint
* revert
* Update protocol/storenodes/database.go
Co-authored-by: richΛrd <info@richardramos.me>
* Update protocol/messenger_mailserver_cycle.go
Co-authored-by: richΛrd <info@richardramos.me>
* PR comment
* fix tx
* proto files
* pr comment
---------
Co-authored-by: richΛrd <info@richardramos.me>
2024-02-20 17:49:39 +02:00
515dbdf2b3
fix: waku connection status subscription lock ( #4762 )
...
* fix: lock waku connStatus subscription for sending
* update skipped tests
2024-02-19 23:44:38 +00:00
30f4edf48d
fix: keep flaky tests compilable and easy to find
2024-02-19 21:46:35 +01:00
1fca1e1743
Revert "Comment out flaky tests ( #4741 )"
...
This reverts commit 582927868d
2024-02-19 21:46:35 +01:00
a866b8025e
feat: Community token received notification ( #4682 )
2024-02-19 14:55:38 +01:00
582927868d
Comment out flaky tests ( #4741 )
2024-02-19 10:10:37 +01:00
85c0e282ae
feature: profile showcase preferences sync&backup ( #4729 )
2024-02-17 18:07:20 +00:00
f0e6fd31de
chore: TestFetchingHistoryWhenOnline ( #4701 )
2024-02-16 18:34:04 +00:00
add46fbda0
chore: `make generate` with nix-shell ( #4745 )
2024-02-16 12:48:27 +00:00
789ee81201
fix: saved addresses sync (`TestSyncDeletesOfSavedAddresses` flaky test) ( #4742 )
2024-02-16 09:45:10 +00:00
526e3d74f1
Feat: proof of membership for profile showcase communities ( #4713 )
...
* chore: move profile showcase structures to the indentity package
* feat: implement proof of membership for unecrypted communities
* feat: implement proof of membership for encrypted communties with grants
2024-02-15 22:13:12 +03:00
27f0884b51
Exclude watch only accounts from permissions checks
2024-02-14 17:03:28 +00:00
3a0fe0e62f
fix: fix contact not updating when an ID verif is canceled ( #4719 )
...
Fixes https://github.com/status-im/status-desktop/issues/13412
2024-02-13 14:34:56 -05:00
598d58f0d6
fix: a proper clock set when dispatching saved addresses
2024-02-13 17:39:10 +01:00
2bdc7ec0f4
fix(handler): fix CR received from a removed contact removed ( #4708 )
...
Fixes https://github.com/status-im/status-desktop/issues/13488
The problem was that when you add a contact, it create the chat. Then, if you remove them, it doesn't remove the chat, so `chat.Active` is true.
Now I check in that case if it's a 1x1 chat and if so, if we are contact.
2024-02-13 10:15:42 -05:00
5149976ce0
fix: improve messenger offline detection ( #4703 )
2024-02-13 13:12:59 +00:00
598e3217ba
Signal user if the networks are not supported
2024-02-13 12:09:46 +00:00
5e905518aa
fix: missing fields in Communtiy CreateDeepCopy ( #4718 )
2024-02-12 23:26:32 +00:00
432bfeea2f
fix: flaky `MessengerStoreNodeRequestSuite` ( #4721 )
2024-02-12 22:30:19 +00:00
1c42c07760
feat(discord_import): send signal when the import was cleaned up ( #4693 )
...
This is to let the front end know that the community was deleted so it can also delete it from the UI
2024-02-12 16:04:12 -05:00
44c39d345e
chore: testWakuV2Config ( #4704 )
...
* chore: testWakuV2Config
* renamed to `NewTestWakuV2`
2024-02-12 12:53:15 +00:00
8d4f4904c6
fix: better calculation of from/to mailserver batch parameters ( #4702 )
2024-02-12 12:20:56 +00:00
daef5c56e2
Add HighestRole & ordered roles to permission response
...
This commit adds HighestRole & a list of permissions in order of
importance to the CheckPermissionToJoinResponse.
This simplify client code so that it doesn't need to be calculated on
the client.
2024-02-12 12:18:56 +00:00
3ea2002904
Feat: Modify grants for profile showcase use ( #4694 )
...
* chore: regenerate proto binaries
* feat: remove unused grant code for community's canPost
2024-02-11 15:11:04 +03:00
ec1238e020
fix: adapt to `response.RequestsToJoinCommunity` interface change ( #4705 )
...
fixes tests build
2024-02-09 18:23:24 +00:00
cc66f43713
fix: fix permissions checker
...
Improve CheckPermissions function.
Check separately member and admin+tokenmaster permissions..
Issue #12884
2024-02-09 19:00:43 +01:00
87199a8c99
chore: cover community events eventual consistency with test
...
It proves eventual consistency is broken for contact request events.
iterates: status-im/status-desktop#13387
2024-02-09 16:02:17 +01:00
a0e7b1374e
feat: introduce `MessagesOrderController`
...
Enables controlling order of messages in tests. Useful for deterministic
reproduction of out-of-order messages.
Required for: status-im/status-desktop#13387
2024-02-09 16:02:17 +01:00
a8b7854ce9
feat: introduce `testWakuWrapper` and `testPublicWakuAPIWrapper`
...
Enables `PublicWakuAPI` introspection.
2024-02-09 16:02:17 +01:00
7e8b61f888
feat: introduce `MessagesIterator`
...
Enables customization of iteration strategy for retrieved messages.
2024-02-09 16:02:17 +01:00
9b7926b23b
feat: delete profile showcase community entry on community leave or kicked ( #4686 )
2024-02-09 12:37:54 +03:00
2350461818
feat: Dispatch profile showcase message on mutual/verified contacts change ( #4678 )
2024-02-09 12:36:54 +03:00
c49a0fc314
[ Fixes : #4687 ] Change requestsToJoinCommunity to a map
...
The test was flaky because of re-receiving the message, which resulted
in multiple identical requestsToJoin being added to messengerResponse.
We should in general avoid using arrays in messengerResponse and prefer
maps for exactly this reason.
2024-02-08 11:18:53 +00:00
e7e6782241
Fix: linter error
2024-02-07 20:10:49 +00:00
31277f1e9e
Fix: cover case where criteria doesn't have token IDs
2024-02-07 20:10:49 +00:00
b727f1e14b
Extract entire permissioned balances logic to separate file
2024-02-07 20:10:49 +00:00
105703e2eb
Remove zombie code from experiments
2024-02-07 20:10:49 +00:00
4f8a66fc07
Create endpoint to get permissioned balances
2024-02-07 20:10:49 +00:00
18e7b6c331
Fix Discord Import getting stuck ( #4681 )
...
* fix(community_import): fix import getting stuck in case of error in msgs
Fixes #13438 and #13439
* fix(community_import): fixes a bug with the timestamp format
The importer didn't like `-` time zones like `-4`. Using the standard date format makes it work.
2024-02-07 13:02:47 -05:00
70ee70a19a
feat: implement new endpoint to set customization color ( #4568 )
2024-02-07 18:20:54 +03:00
605fe40e32
Fix encryption metadata issues #4613
...
This commit fixes a few issues with communities encryption:
Key distribution was disconnected from the community description, this created a case where the key would arrive after the community description and that would result in the client thinking that it was kicked.
To overcome this, we added a message that signals the user that is kicked. Also, we distribute the key with the community description so that there's no more issues with timing.
This is a bit expensive for large communities, and it will require some further optimizations.
Key distribution is now also connected to the request to join response, so there are no timing issues.
Fixes an issue with key distribution (race condition) where the community would be modified before being compared, resulting in a comparison of two identical communities, which would result in no key being distributed. This commit only partially address the issue.
2024-02-07 10:25:41 +00:00
47b9978525
Feat: Save and dispatch profile showcase on wallet account change ( #4674 )
...
* Feat: Save and dispatch profile showcase on wallet account change
* Feat: Remove entry and dispatch profile showcase on wallet account removal
2024-02-07 12:30:56 +03:00
33c46dd59d
fix(protocol): crash in concurrent map write/read
2024-02-05 15:21:44 +01:00
2dc1b48968
[ #4671 ] Increase interval between calls to Directory contract ( #4672 )
2024-02-05 14:01:59 +01:00
e9b10c4beb
chore: sync history regardless of connection type ( #4656 )
2024-02-02 13:03:55 -04:00
9b10b29da2
[ #4630 ] Add wallet_fetchOrGetCachedWalletBalances method ( #4666 )
2024-02-02 11:42:56 +01:00
9879b1ea77
fix: set display name issue ( #4642 )
2024-02-01 19:13:41 +03:30
0c2a935578
fix: fetch history when back online ( #4651 )
2024-01-30 18:13:18 +00:00
98c1ebec05
fix: handle community shard unassignment and update ( #4627 )
2024-01-30 13:56:59 -04:00
1f0fc2935c
fix: clear waku envelopes cache when deleting a chat ( #4621 )
...
* chore: extract `ErrPermissionToJoinNotSatisfied`
* chore: disable resending messages in communities tests
* chore: move newTestMessenger extraOptions to testMessengerConfig
* chore: `WithTestStoreNode` messenger option
* feat: waku `ClearEnvelopesCache` method
* fix: call `ClearEnvelopesCache` when deleting chat
* chore: `TestBecomeMemberPermissions` checks messages after rejoin
2024-01-30 13:43:34 +00:00
73a5189398
feat(BridgeMessage): Add new type of chat message content: BridgeMessage
...
BridgeMessage is a type of chat message content which will be sent from Matterbridge.
It contains fields:
- bridge name - depends on the used bridge, eg. "discord", "slack", etc...
- user name - username the message was received from
- content - message content
- user avatar
- message id
- parent message id - used in case of replies
Message is saved to a separated table: bridge_messages, similarly to discord messages.
The user_messages table is untouched.
bridge_messages table contains user_messages_id in order to join with user_messages table.
Issue #13098
2024-01-30 12:14:54 +01:00
4a7d15b36d
fix: use CommunityShardKey's clock rather than community's clock
2024-01-29 21:31:11 +01:00
ac81c15805
fix: ignore outdated COMMUNITY_SHARD_KEY messages
...
This mitigates issue where community shard on client's side was not in
sync with owner's.
relates to: status-im/status-desktop#13217
2024-01-29 18:21:51 +01:00
67e18a8ff0
chore: introduce `unhandledMessagesTracker`
2024-01-29 18:21:51 +01:00
6403a7413b
feat: new endpoint added which returns accounts of all contacts that match the passed address
2024-01-29 13:15:24 +01:00
ab641c0c78
fix: remove store node envelopes ordering hotfix ( #4622 )
2024-01-27 13:02:12 +00:00
fb98ee93ce
Correct profile showcase tokens and collectibles ( #4511 )
...
* feat: add profile showcase collectibles & assets missing fileds
* feat: resolve collectible identification issue
* feat: add validation for collectible visibility relative account
* feat: separate profile showcase assets on verified and unverified tokens
* fix: make chainId uint64, comment collectible account check
* chore: re-generate protobuf binaries with right protoc version
* Update protocol/messenger_profile_showcase.go
Co-authored-by: Igor Sirotin <sirotin@status.im>
2024-01-25 20:48:27 +04:00
bea0b5a63d
fix TestMarkAllActivityCenterNotificationsReadMarksMessagesAsSeen ( #4615 )
2024-01-25 13:56:56 +08:00
5f6f7e502d
(fix/status-go) fix profile picture update/removal ( #4570 )
...
This PR fixes [9947](status-im/status-desktop#9947 ) and contains :
- Commit to fix the changing of custom picture and having the change
reflected on contact's side
- Commit to fix the deleting of picture and having the change reflected
on contact's side
- Rename confusing `ImageType` to `ImageFormat`
2024-01-24 12:09:28 -08:00
1a85a29b1b
chore: cover community sharding with tests
...
closes : #4262
2024-01-24 14:24:57 +01:00
5162c285a8
refactor: introduce `newTestCommunitiesMessenger`
2024-01-24 14:24:57 +01:00
92f43bac78
chore: extend `CreateWakuV2Network` with `useShardAsDefaultTopic`
2024-01-24 14:24:57 +01:00
2a91fba1fa
chore: added and fixed some logs ( #4577 )
...
* chore: logs for successful storenode request
2024-01-23 18:20:01 +00:00
e65760ca85
Add basic peersyncing
...
This commit adds basic syncing capabilities with peers if they are both
online.
It updates the work done on MVDS, but I decided to create the code in
status-go instead, since it's very tight to the application (similarly
the code that was the inspiration for mvds, bramble, is all tight
together at the database level).
I reused parts of the protobufs.
The flow is:
1) An OFFER message is sent periodically with a bunch of message-ids and
group-ids.
2) Anyone can REQUEST some of those messages if not present in their
database.
3) The peer will then send over those messages.
It's disabled by default, but I am planning to add a way to set up the
flags.
2024-01-23 12:46:17 +00:00
bf5dcacdeb
refactor: introduce `newTestMessenger`
...
This avoids duplication and enables better configuration possibilities
for clients.
Next step is to cleanup all `newMessenger` derivatives in tests.
2024-01-22 13:08:58 +01:00
436d229856
Add last opened at key for community ( #4514 )
2024-01-21 12:55:14 +02:00
81f4c86086
fix: return CustomizationColor only on db rows affected ( #4593 )
2024-01-19 18:26:39 +08:00
926f6a3c72
Revert "test: bump go-libp2p"
...
This reverts commit d0ca4447c6
2024-01-18 20:29:33 +00:00
0d2c3cef7c
feat: implement token management settings for collectibles
2024-01-18 11:46:35 -03:00
d0ca4447c6
test: bump go-libp2p
2024-01-18 14:28:06 +00:00
ea3e59ffee
replace mention name with public key ( #4579 )
...
* replace mention with public key
* bump version
2024-01-18 21:18:01 +08:00
0bd4a06edc
Comment out all logged flaky tests
2024-01-18 06:36:12 +00:00
9aef13f83e
[ #4200 ] Enable prevention of tx detection on unrevealed mnemonic/address ( #4444 )
2024-01-16 15:17:02 +01:00
a5acffc001
fix: TestFetchRealCommunity with shards fleet ( #4553 )
...
* fix: TestFetchRealCommunity with shards fleet
* fix: DefaultShardPubsubTopic
* chore: print waku query request id
2024-01-16 13:38:41 +03:00
94bee02ef7
chore: fetch comunity token metadata during handling community description ( #4562 )
2024-01-16 09:08:56 +01:00
3d7ab79d91
fix: execute BeforeDispatch only once
...
Issue #4557
2024-01-15 17:03:33 +01:00
3ddec465c5
fix: restore FetchCommunity&TryDatabase fallback to store nodes
...
Add missing check caused by recent `communities.GetByID` refactoring.
2024-01-12 13:15:29 +01:00
280f48877d
chore(savedaddresses)!: favourite property removed and primary key updated
...
- favourite column removed from the saved_addresses table
- favourite property removed from the SavedAddress struct
- ens name removed from the primary key, the primary key now is composed of address and is_test columns
- ens parameter removed from wakuext_deleteSavedAddress
- wallet_getSavedAddresses moved to wakuext_getSavedAddresses (to keep them all in a single place)
- saved addresses related endpoints removed from the wallet service, even they logically belong there, a reason for that
is avoiding emitting sync message if one uses calls from the wallet service, while that's not the case in ext service. Once
we refactor this and introduce devices syncing mechanism in the wallet service, we should not only these but other wallet
related endpoints move there (removed: wallet_getSavedAddresses, wallet_addSavedAddress and wallet_deleteSavedAddress).
Affected area:
Saved addresses
2024-01-10 19:30:56 +01:00
2a5dc6dec0
chore: remove boilerplate check of `communities.GetByID` clients
...
motivated by:
https://github.com/status-im/status-go/pull/4514#discussion_r1445808116
2024-01-10 18:58:17 +01:00
781a2c7c8e
fix: ensure needed community tokens are available in the db
...
Fixes #13171
2024-01-10 12:57:10 -03:00
5cb1972261
chore: return chats after mark all notifications read ( #4432 )
2024-01-10 09:36:33 +08:00
e1b52f9eae
Add joined at key to communities ( #4513 )
2024-01-09 20:36:47 +02:00
9d9c40b7cf
fix: make fetchCommunity return latest available community
...
Fixes #13145
2024-01-08 18:09:21 -03:00
16f11d49df
fix: flaky TestEncryptionDecryption
...
fixes : #4510
2024-01-08 21:18:51 +01:00
9d8b55e3d9
This PR (status-go) fixes #12821 ( #4516 )
...
- Add album_images column to the user_messages table
- Migrate the database
2024-01-08 10:18:57 -08:00
405d468e0e
fix: force verifiedOwner in `handleSyncInstallationCommunity` ( #4405 ) ( #4538 )
2024-01-08 15:57:57 +00:00
53ac61bb8b
fix: a few adjustments for matterbridge
...
- exposig Online info
- adding ability to disable backup loop and auto message loop
Issue #12710
2024-01-08 14:21:26 +01:00
5c704b2ec2
chore: check and manualy verify community if during the fetchCommunity, community was added to the verification loop ( #4533 )
2024-01-05 18:09:38 +01:00
7814f39cd7
feat: Add advanced token settings ( #4524 )
2024-01-05 12:12:53 +01:00
846a4e2363
feat: Community token received notification ( #4515 )
2024-01-04 13:22:06 +01:00
a8357dceac
feat: color field added to saved address
...
- `color` column added to `saved_addresses` table
- `colorId` parameter exposed via `SavedAddress` struct
Affected area - saved addresses.
The following endpoints return or receive `SavedAddress` instance:
- `UpsertSavedAddress`
- `GetSavedAddresses`
- `AddSavedAddress`
2023-12-29 10:39:52 +01:00
195982c950
fix_(StoreNodeRequestManager): various fixes and improvements ( #4509 )
2023-12-27 13:53:19 +00:00
843bae5659
feat: Return seen/unseen messages count in MessnegerResponse ( #4461 )
2023-12-25 13:25:22 +07:00
151185c436
chore: log message contents before being sent ( #4494 )
...
When debugging message reliability we often get the number of messages sent and their IDs but we do not know the content of the messages and the type of message sent.
This commit adds debug level logs so that it helps in investigations.
ref : https://github.com/status-im/status-mobile/issues/18031
Closes [#18206 ](https://github.com/status-im/status-mobile/issues/18206 )
2023-12-23 09:42:45 +05:30
a90589f4f7
chore: test filters are in the right place after store node requests ( #4500 )
2023-12-22 19:23:39 +00:00
1d3c618fb4
feat: encrypt `CommunityDescription` fields
...
Extended `CommunityDescription` with a `privateData` map. This map
associates each hash ratchet `key_id` and `seq_no` with an encrypted
`CommunityDescription`. Each encrypted instance includes only data
requiring encryption.
closes : status-im/status-desktop#12851
closes : status-im/status-desktop#12852
closes : status-im/status-desktop#12853
2023-12-22 18:17:06 +01:00
9cbfda69da
chore: share shard info independently on waku version ( #4507 )
2023-12-22 17:43:38 +01:00
1317f0c796
hotfix: Update profile showcase proto ( #4506 )
2023-12-22 22:43:27 +07:00
Patryk Osmaczko
Pablo Lopez
Igor Sirotin
Cuteivist
Roman Volosovskyi
Mikhail Rogachev
Andrea Maria Piana
Jonathan Rainville
Sale Djenic
osmaczko
Michal Iskierko
Icaro Motta
Mohsen
Ivan Belyakov
richΛrd
frank
Godfrain Jacques
Ibrahem Khalil
Siddarth Kumar
Dario Gabriel Lipicar
Mykhailo Prakhov