status-go/protocol
Pascal Precht f5dfa58602 refactor(communities): better archive download handling
This commit makes a few changes to the community history archive
download routine to make it more robust:

1. Prior to this commit, even when there were no archives to be
   downloaded, we were still trying to extract messages from archive
   data.
2. Logs have been improved as they were sometimes showing confusing
   information
3. We now handle interruption of ongoing download + data import much
   better in case of multiple magnetlinks being processed in roughly the
   same time.
4. We now keep track of which archive has been successfully imported
   into the database. Without this, Status would consider any downloaded
   archives as "done" even though they haven't actually been imported
   into the database yet. This way Status should be able to pick up its
   work were it left of the last time, in case a user closes the app, or
   another magnetlink interrupts the ongoing process.
2022-12-13 16:13:15 +01:00
..
anonmetrics Sync community encryption keys 2022-11-15 10:11:01 +00:00
audio Add audio messages 2020-07-27 17:14:50 +02:00
common Added device name set on Messenger.Start() 2022-11-25 11:33:58 +00:00
communities refactor(communities): better archive download handling 2022-12-13 16:13:15 +01:00
datasync Rename MessageProcessor to MessageSender (#2264) 2021-06-23 17:13:48 +03:00
discord feat(communities): add community images to import progress signal 2022-11-07 17:16:00 +01:00
encryption Sync community encryption keys 2022-11-15 10:11:01 +00:00
ens feat: make kdf iterations configurable when creating a multiaccount (#2796) 2022-09-27 16:27:20 -04:00
identity ColourHash is a distinct type that has a discrete pattern 2022-11-28 16:26:07 +00:00
images load audio from http server 2022-03-01 15:58:32 +01:00
internal/sqlite Sync Settings (#2478) 2022-03-23 18:47:00 +00:00
migrations Sync community encryption keys 2022-11-15 10:11:01 +00:00
protobuf Allow owner/admin to delete messages of a community (#2958) 2022-12-02 19:34:02 +08:00
pushnotificationclient Sync community encryption keys 2022-11-15 10:11:01 +00:00
pushnotificationserver Sync community encryption keys 2022-11-15 10:11:01 +00:00
requests Allow owner/admin to delete messages of a community (#2958) 2022-12-02 19:34:02 +08:00
sqlite feat: make kdf iterations configurable when creating a multiaccount (#2796) 2022-09-27 16:27:20 -04:00
subscription Move to monorepo structure (#1684) 2019-11-21 17:19:22 +01:00
transport debug: add more logs to determine why community requests are missing 2022-12-13 10:25:24 -04:00
tt Tests and linting 2021-09-30 13:02:41 +01:00
urls fix: remove tenor.com from preview whitelist 2022-09-15 12:27:49 +02:00
v1 Disable abridged sending 2022-11-18 11:43:23 +00:00
verification Add notification for trustworthy/untrustworthy 2022-11-16 16:17:13 +00:00
zaputil Move to monorepo structure (#1684) 2019-11-21 17:19:22 +01:00
LICENSE Move to monorepo structure (#1684) 2019-11-21 17:19:22 +01:00
README.md Added basic history of the protocol package (#1984) 2020-06-04 11:23:09 +01:00
activity_center.go Handle identity verifications 2022-10-26 17:19:44 +01:00
activity_center_persistence.go Add notification for trustworthy/untrustworthy 2022-11-16 16:17:13 +00:00
anon_metrics_test.go rename status-react to status-mobile 2022-07-17 15:37:14 +02:00
chat.go Fix private group members details not being sent on preview (#2936) 2022-11-03 11:57:51 +03:00
chat_group_proxy.go Clean up protocol package (#1890) 2020-03-09 07:19:23 +01:00
chat_test.go feat: add and distribute `chatIdentity.FirstMessageTimestamp` 2022-09-09 08:59:39 +02:00
communities_messenger_test.go fix(community): don't delete chat and messages when leaving community 2022-12-09 14:43:56 -05:00
contact.go feat: make any member able to add new users to group chat 2022-09-13 12:16:14 +02:00
delete_for_me_message.go feat: delete for me (#2866) 2022-09-28 19:42:17 +08:00
delete_message.go Delete messages (#2279) 2021-07-26 17:06:32 -04:00
edit_message.go address feedback 2021-06-29 13:15:15 +02:00
emoji_reaction.go Skip wrapping emojis in private group chats 2021-01-26 09:39:47 +01:00
errors.go Add ClearHistory & DeactivateChat methods 2021-01-11 13:36:05 +01:00
group_chat_invitation.go group chat invitation 2020-09-07 12:15:58 +02:00
group_chat_system_messages.go feat: Handle image in group chat 2022-09-01 12:19:01 +02:00
identity_images.go Add HasAddedUs field 2021-10-04 12:19:15 +02:00
local_notifications.go Sync Settings (#2478) 2022-03-23 18:47:00 +00:00
message_builder.go add PinMessage and PinnedMessage (#2180) 2021-05-14 23:22:50 +02:00
message_persistence.go fix(community): don't delete chat and messages when leaving community 2022-12-09 14:43:56 -05:00
message_validator.go feat: introduce discord import tool 2022-10-28 09:52:26 +02:00
message_validator_test.go Fix protobuf ImageType change 2020-12-17 14:10:00 +01:00
messenger.go refactor(communities): better archive download handling 2022-12-13 16:13:15 +01:00
messenger_activity_center.go Allow to pass activity center status as a parameter 2022-11-14 10:17:43 +01:00
messenger_activity_center_test.go Turning the tests back on (#2519) 2022-02-03 20:37:41 +00:00
messenger_auto_message.go Add read/unread messenger functions for activity center 2022-10-26 17:19:44 +01:00
messenger_backup.go Sync community encryption keys 2022-11-15 10:11:01 +00:00
messenger_backup_test.go feat(messenger): add `createDefaultChannel` flag to `CreateCommunity` API 2022-07-26 10:23:49 +02:00
messenger_bookmarks.go feat: add garbage collection for soft deleted bookmarks 2022-06-17 14:21:21 +02:00
messenger_browsers.go Issue 13813 -- Use messenger ns for browser CRUD (#2801) 2022-08-24 16:05:35 +02:00
messenger_browsers_test.go Issue 13813 -- Use messenger ns for browser CRUD (#2801) 2022-08-24 16:05:35 +02:00
messenger_chats.go fix(community): don't delete chat and messages when leaving community 2022-12-09 14:43:56 -05:00
messenger_communities.go chore: better community archive protocol logs 2022-12-13 16:13:15 +01:00
messenger_config.go feat: add signal indicating that history messages are being imported 2022-12-05 10:51:53 +01:00
messenger_contact_requests_test.go fix: lint (#2845) 2022-09-27 18:59:02 -04:00
messenger_contact_update_test.go Sync Settings (#2478) 2022-03-23 18:47:00 +00:00
messenger_contact_verification.go Add notification for trustworthy/untrustworthy 2022-11-16 16:17:13 +00:00
messenger_contact_verification_test.go Add notification for trustworthy/untrustworthy 2022-11-16 16:17:13 +00:00
messenger_contacts.go fix(community): don't delete chat and messages when leaving community 2022-12-09 14:43:56 -05:00
messenger_delete_message_for_everyone_test.go fix: TestDeleteMessageForEveryone fail (#3020) 2022-12-13 16:06:01 +08:00
messenger_delete_message_for_me_test.go feat: delete message for new design (#2922) 2022-11-17 18:11:58 +08:00
messenger_delete_message_test.go Allow owner/admin to delete messages of a community (#2958) 2022-12-02 19:34:02 +08:00
messenger_discv5.go feat: Add DiscV5 to Waku2 (#2434) 2021-11-22 09:40:14 -04:00
messenger_edit_message_test.go feat: make any member able to add new users to group chat 2022-09-13 12:16:14 +02:00
messenger_emoji_test.go feat: make any member able to add new users to group chat 2022-09-13 12:16:14 +02:00
messenger_ens.go Request/Decline access to communities 2021-02-26 15:35:43 +01:00
messenger_group_chat.go Remove group members (#3011) 2022-12-10 08:26:51 +04:00
messenger_group_chat_test.go Remove group members (#3011) 2022-12-10 08:26:51 +04:00
messenger_handler.go refactor(communities): better archive download handling 2022-12-13 16:13:15 +01:00
messenger_handler_test.go feat: Handle image in group chat 2022-09-01 12:19:01 +02:00
messenger_identity.go Addressing feedback 2022-11-25 11:33:58 +00:00
messenger_identity_image_test.go Added multiaccounts.Database tests for new funcs 2022-08-22 13:27:59 +01:00
messenger_images.go Get preferred network IP and refactor server package to increase reusability (#2626) 2022-06-15 15:49:31 +01:00
messenger_installations_test.go fix(community): don't delete chat and messages when leaving community 2022-12-09 14:43:56 -05:00
messenger_mailserver.go fix(store): generate signals per storenode request with custom requestIDs 2022-11-28 08:40:58 -04:00
messenger_mailserver_cycle.go fix: set waku version to mailservers and set min peers for relay to 1 2022-11-07 18:03:52 +03:00
messenger_maps.go Tests and linting 2021-09-30 13:02:41 +01:00
messenger_messages.go Allow owner/admin to delete messages of a community (#2958) 2022-12-02 19:34:02 +08:00
messenger_mute_test.go Fix some tests and restore private/public RPC client 2021-07-20 10:57:38 +02:00
messenger_peers.go feat: add wakuext_listenAddresses 2022-11-28 08:10:51 -04:00
messenger_pin_message_test.go Turning the tests back on (#2519) 2022-02-03 20:37:41 +00:00
messenger_pin_messages.go feat: introduce `CommunityAdminSettings` in `CommunityDescription` 2022-05-18 09:58:11 +02:00
messenger_response.go feat: introduce discord import tool 2022-10-28 09:52:26 +02:00
messenger_response_test.go feat: desktop mailserver cycle (#2481) 2022-01-12 12:02:01 -04:00
messenger_saved_address.go Addressing feedback 2022-11-25 11:33:58 +00:00
messenger_share_image_test.go fix: TestImageMessageSharing (#2874) 2022-09-21 09:48:04 -04:00
messenger_status_updates.go feat: mark automatic status updates as ephemeral 2022-11-09 15:49:26 +03:00
messenger_status_updates_test.go Timeout automatic status updates (#2757) 2022-08-03 04:38:01 +05:30
messenger_sync_bookmark_test.go feat: add garbage collection for soft deleted bookmarks 2022-06-17 14:21:21 +02:00
messenger_sync_chat_test.go fix(community): don't delete chat and messages when leaving community 2022-12-09 14:43:56 -05:00
messenger_sync_clear_history_test.go Sync clear history 2022-02-17 11:15:01 +00:00
messenger_sync_profile_picture_test.go Added multiaccounts.Database tests for new funcs 2022-08-22 13:27:59 +01:00
messenger_sync_saved_addresses_test.go feat: sync saved addresses 2022-10-10 11:26:35 +02:00
messenger_sync_settings.go Enable currency settings and sticker pack synchronization 2022-05-11 16:59:12 +03:00
messenger_sync_settings_test.go chore: use provided pictures visibility options when creating settings db entry (#2867) 2022-10-05 12:53:42 +02:00
messenger_sync_verification_test.go feat: contact verification request (#2586) 2022-07-05 15:49:44 -04:00
messenger_sync_wallets_test.go Wallet sync for generated accounts 2022-07-06 19:24:43 +03:00
messenger_test.go chore: extend `TestRetrieveBlockedContact` 2022-11-11 15:44:22 +01:00
messenger_walletconnect.go Implement wallet connect session CRUD API 2022-08-19 12:32:00 +01:00
messenger_walletconnect_test.go Implement wallet connect session CRUD API 2022-08-19 12:32:00 +01:00
persistence.go Use image server for all kind of images and integrate identity rings 2022-09-16 09:52:08 +01:00
persistence_test.go fix(community): don't delete chat and messages when leaving community 2022-12-09 14:43:56 -05:00
push_notification_test.go feat(messenger): add `createDefaultChannel` flag to `CreateCommunity` API 2022-07-26 10:23:49 +02:00
status_update.go feat: user status (#2276) 2021-07-22 13:41:49 -04:00
transaction_validator.go Move message to common namespace 2020-09-09 21:22:12 +02:00
transaction_validator_test.go Move message to common namespace 2020-09-09 21:22:12 +02:00

README.md

status-go/protocol

This is an implementation of the secure transport and payloads which are a part of the Status Client specification.

This implementation uses SQLite and SQLCipher for persistent storage.

The payloads are encoded using protocol-buffers.

Content

  • messenger.go is the main file which exports Messenger struct. This is a public API to interact with this implementation of the Status Chat Protocol.
  • protobuf/ contains protobuf files implementing payloads described in the Payloads spec.
  • encryption/ implements the Secure Transport spec.
  • transport/ connects the Status Chat Protocol with a wire-protocol which in our case is either Whisper or Waku.
  • datasync/ is an adapter for MVDS.
  • applicationmetadata/ is an outer layer wrapping a payload with an app-specific metadata like a signature.
  • identity/ implements details related to creating a three-word name and identicon.
  • migrations/ contains implementation specific migrations for the sqlite database which is used by Messenger as a persistent data store.

History

Originally this package was a dedicated repo called status-protocol-go and was migrated into status-go. The new status-go/protocol package maintained its own dependencies until sub modules were removed and the root go.mod file managed all dependencies for the entire status-go repo.