status-go/protocol
Pascal Precht f85c500e9a Resume import of message history archives upon bootstrap
This adds the functionality that history archives continue to be imported
in case the import has been interrupted the last time the app/client
was running.

This typically happens when users don't wait for an ongoing import to finish,
which sometimes can take a while. Users then close the app/kill the client
which leaves the database in a state where there's downloaded archives that
haven't been fully imported.

Prior to this change, the node will have to wait until it receives a new
magnetlink that it hasn't seen before, until it processes imports again.
This can take several days.

Now, it will check on startup if there are any archives left to be imported
and resumes the import from there.
2023-01-20 07:57:24 +01:00
..
anonmetrics Persist switcher cards (#3049) 2023-01-05 21:41:57 +05:30
audio Add audio messages 2020-07-27 17:14:50 +02:00
common fix: add discord message data to quoted messages 2023-01-17 12:08:42 +01:00
communities refactor(communities): improve archive handling memory pressure 2023-01-18 15:45:13 +01:00
datasync Rename MessageProcessor to MessageSender (#2264) 2021-06-23 17:13:48 +03:00
discord feat(communities): add community images to import progress signal 2022-11-07 17:16:00 +01:00
encryption Bump encryption too high number 2023-01-13 11:51:30 +00:00
ens feat: make kdf iterations configurable when creating a multiaccount (#2796) 2022-09-27 16:27:20 -04:00
identity ColourHash is a distinct type that has a discrete pattern 2022-11-28 16:26:07 +00:00
images load audio from http server 2022-03-01 15:58:32 +01:00
internal/sqlite Sync Settings (#2478) 2022-03-23 18:47:00 +00:00
migrations Image width height (#3061) 2023-01-12 13:43:14 +04:00
protobuf fix: should include ContactRequestState and HasAddedUs when sync contact (#3100) 2023-01-18 16:12:27 +08:00
pushnotificationclient Persist switcher cards (#3049) 2023-01-05 21:41:57 +05:30
pushnotificationserver Persist switcher cards (#3049) 2023-01-05 21:41:57 +05:30
requests Persist switcher cards (#3049) 2023-01-05 21:41:57 +05:30
sqlite replace deprecated ioutil.TempDir with os.MkdirTemp 2023-01-03 15:40:11 +01:00
subscription Move to monorepo structure (#1684) 2019-11-21 17:19:22 +01:00
transport chore: make `createMessagesRequestV2` respect `mailserverRequestTimeout` 2023-01-11 20:26:10 +01:00
tt Tests and linting 2021-09-30 13:02:41 +01:00
urls fix: remove tenor.com from preview whitelist 2022-09-15 12:27:49 +02:00
v1 fix TestGroupChatMembersRemoval sometimes failed (#3037) 2023-01-05 23:37:50 +08:00
verification feat(ActivityCenter): Add message for canceling contact requests (#2992) 2022-12-14 12:27:02 +04:00
wakusync Upgrade linter to 1.50.0 2023-01-13 17:52:03 +00:00
zaputil Move to monorepo structure (#1684) 2019-11-21 17:19:22 +01:00
LICENSE Move to monorepo structure (#1684) 2019-11-21 17:19:22 +01:00
README.md Added basic history of the protocol package (#1984) 2020-06-04 11:23:09 +01:00
activity_center.go Handle identity verifications 2022-10-26 17:19:44 +01:00
activity_center_persistence.go Add notification for trustworthy/untrustworthy 2022-11-16 16:17:13 +00:00
anon_metrics_test.go rename status-react to status-mobile 2022-07-17 15:37:14 +02:00
chat.go Fix private group members details not being sent on preview (#2936) 2022-11-03 11:57:51 +03:00
chat_group_proxy.go Clean up protocol package (#1890) 2020-03-09 07:19:23 +01:00
chat_test.go feat: add and distribute `chatIdentity.FirstMessageTimestamp` 2022-09-09 08:59:39 +02:00
communities_messenger_test.go feat: backup profile data to waku and sync them from waku 2022-12-23 15:07:14 +01:00
contact.go feat: make any member able to add new users to group chat 2022-09-13 12:16:14 +02:00
delete_for_me_message.go feat: delete for me (#2866) 2022-09-28 19:42:17 +08:00
delete_message.go Delete messages (#2279) 2021-07-26 17:06:32 -04:00
edit_message.go address feedback 2021-06-29 13:15:15 +02:00
emoji_reaction.go Skip wrapping emojis in private group chats 2021-01-26 09:39:47 +01:00
errors.go Add ClearHistory & DeactivateChat methods 2021-01-11 13:36:05 +01:00
group_chat_invitation.go group chat invitation 2020-09-07 12:15:58 +02:00
group_chat_system_messages.go feat: Handle image in group chat 2022-09-01 12:19:01 +02:00
identity_images.go Add HasAddedUs field 2021-10-04 12:19:15 +02:00
local_notifications.go Sync Settings (#2478) 2022-03-23 18:47:00 +00:00
message_builder.go add PinMessage and PinnedMessage (#2180) 2021-05-14 23:22:50 +02:00
message_persistence.go fix: add discord message data to quoted messages 2023-01-17 12:08:42 +01:00
message_validator.go feat: introduce discord import tool 2022-10-28 09:52:26 +02:00
message_validator_test.go Fix protobuf ImageType change 2020-12-17 14:10:00 +01:00
messenger.go Resume import of message history archives upon bootstrap 2023-01-20 07:57:24 +01:00
messenger_activity_center.go Allow to pass activity center status as a parameter 2022-11-14 10:17:43 +01:00
messenger_activity_center_test.go Turning the tests back on (#2519) 2022-02-03 20:37:41 +00:00
messenger_auto_message.go Add read/unread messenger functions for activity center 2022-10-26 17:19:44 +01:00
messenger_backup.go chore: code review comments applied 2022-12-23 15:07:14 +01:00
messenger_backup_handler.go chore: code review comments applied 2022-12-23 15:07:14 +01:00
messenger_backup_test.go chore: code review comments applied 2022-12-23 15:07:14 +01:00
messenger_bookmarks.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_browsers.go Issue 13813 -- Use messenger ns for browser CRUD (#2801) 2022-08-24 16:05:35 +02:00
messenger_browsers_test.go Issue 13813 -- Use messenger ns for browser CRUD (#2801) 2022-08-24 16:05:35 +02:00
messenger_chats.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_communities.go Resume import of message history archives upon bootstrap 2023-01-20 07:57:24 +01:00
messenger_config.go feat: backup profile data to waku and sync them from waku 2022-12-23 15:07:14 +01:00
messenger_contact_requests_test.go Restart discovery when it fails 2022-12-14 20:54:48 +00:00
messenger_contact_update_test.go Sync Settings (#2478) 2022-03-23 18:47:00 +00:00
messenger_contact_verification.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_contact_verification_test.go feat(ActivityCenter): Add missing AC notifications for verification requests (#3029) 2022-12-26 08:35:46 +04:00
messenger_contacts.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_delete_message_for_everyone_test.go Upgrade linter to 1.50.0 2023-01-13 17:52:03 +00:00
messenger_delete_message_for_me_test.go feat: delete message for new design (#2922) 2022-11-17 18:11:58 +08:00
messenger_delete_message_test.go Allow owner/admin to delete messages of a community (#2958) 2022-12-02 19:34:02 +08:00
messenger_discv5.go feat: Add DiscV5 to Waku2 (#2434) 2021-11-22 09:40:14 -04:00
messenger_edit_message_test.go feat: make any member able to add new users to group chat 2022-09-13 12:16:14 +02:00
messenger_emoji_test.go feat: make replies act as mentions 2023-01-10 13:39:57 -05:00
messenger_ens.go Request/Decline access to communities 2021-02-26 15:35:43 +01:00
messenger_group_chat.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_group_chat_test.go fix inconsistent contact request state (#3056) 2023-01-06 18:24:39 +08:00
messenger_handler.go Resume import of message history archives upon bootstrap 2023-01-20 07:57:24 +01:00
messenger_handler_test.go feat: Handle image in group chat 2022-09-01 12:19:01 +02:00
messenger_identity.go feat: backup profile data to waku and sync them from waku 2022-12-23 15:07:14 +01:00
messenger_identity_image_test.go Added multiaccounts.Database tests for new funcs 2022-08-22 13:27:59 +01:00
messenger_images.go Get preferred network IP and refactor server package to increase reusability (#2626) 2022-06-15 15:49:31 +01:00
messenger_installations_test.go fix: should include ContactRequestState and HasAddedUs when sync contact (#3100) 2023-01-18 16:12:27 +08:00
messenger_mailserver.go Restart discovery when it fails 2022-12-14 20:54:48 +00:00
messenger_mailserver_cycle.go Update messenger_mailserver_cycle.go 2023-01-19 13:56:50 -04:00
messenger_maps.go Tests and linting 2021-09-30 13:02:41 +01:00
messenger_messages.go Allow owner/admin to delete messages of a community (#2958) 2022-12-02 19:34:02 +08:00
messenger_mute_test.go Fix some tests and restore private/public RPC client 2021-07-20 10:57:38 +02:00
messenger_peers.go feat: add wakuext_listenAddresses 2022-11-28 08:10:51 -04:00
messenger_pin_message_test.go Turning the tests back on (#2519) 2022-02-03 20:37:41 +00:00
messenger_pin_messages.go feat: introduce `CommunityAdminSettings` in `CommunityDescription` 2022-05-18 09:58:11 +02:00
messenger_reply_test.go fix(reply-test): fix reply test because msgs could come out of order 2023-01-11 16:24:42 -05:00
messenger_response.go synchronize display name (#2989) 2022-12-29 14:16:19 +08:00
messenger_response_test.go feat: desktop mailserver cycle (#2481) 2022-01-12 12:02:01 -04:00
messenger_saved_address.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_share_image_test.go fix: TestImageMessageSharing (#2874) 2022-09-21 09:48:04 -04:00
messenger_status_updates.go Upgrade linter to 1.50.0 2023-01-13 17:52:03 +00:00
messenger_status_updates_test.go Timeout automatic status updates (#2757) 2022-08-03 04:38:01 +05:30
messenger_switcher_cards.go Persist switcher cards (#3049) 2023-01-05 21:41:57 +05:30
messenger_sync_bookmark_test.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_sync_chat_test.go fix(community): don't delete chat and messages when leaving community 2022-12-09 14:43:56 -05:00
messenger_sync_clear_history_test.go Sync clear history 2022-02-17 11:15:01 +00:00
messenger_sync_profile_picture_test.go Added multiaccounts.Database tests for new funcs 2022-08-22 13:27:59 +01:00
messenger_sync_raw_messages.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_sync_saved_addresses_test.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_sync_settings.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_sync_settings_test.go chore: use provided pictures visibility options when creating settings db entry (#2867) 2022-10-05 12:53:42 +02:00
messenger_sync_verification_test.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_sync_wallets_test.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_test.go chore: extend `TestRetrieveBlockedContact` 2022-11-11 15:44:22 +01:00
messenger_walletconnect.go Implement wallet connect session CRUD API 2022-08-19 12:32:00 +01:00
messenger_walletconnect_test.go Implement wallet connect session CRUD API 2022-08-19 12:32:00 +01:00
persistence.go Upgrade linter to 1.50.0 2023-01-13 17:52:03 +00:00
persistence_test.go feat(QuotedMessage): pass Deleted to QuotedMessage 2023-01-12 11:47:38 -05:00
push_notification_test.go feat(messenger): add `createDefaultChannel` flag to `CreateCommunity` API 2022-07-26 10:23:49 +02:00
status_update.go feat: user status (#2276) 2021-07-22 13:41:49 -04:00
switcher_card.go Persist switcher cards (#3049) 2023-01-05 21:41:57 +05:30
transaction_validator.go Move message to common namespace 2020-09-09 21:22:12 +02:00
transaction_validator_test.go Move message to common namespace 2020-09-09 21:22:12 +02:00

README.md

status-go/protocol

This is an implementation of the secure transport and payloads which are a part of the Status Client specification.

This implementation uses SQLite and SQLCipher for persistent storage.

The payloads are encoded using protocol-buffers.

Content

  • messenger.go is the main file which exports Messenger struct. This is a public API to interact with this implementation of the Status Chat Protocol.
  • protobuf/ contains protobuf files implementing payloads described in the Payloads spec.
  • encryption/ implements the Secure Transport spec.
  • transport/ connects the Status Chat Protocol with a wire-protocol which in our case is either Whisper or Waku.
  • datasync/ is an adapter for MVDS.
  • applicationmetadata/ is an outer layer wrapping a payload with an app-specific metadata like a signature.
  • identity/ implements details related to creating a three-word name and identicon.
  • migrations/ contains implementation specific migrations for the sqlite database which is used by Messenger as a persistent data store.

History

Originally this package was a dedicated repo called status-protocol-go and was migrated into status-go. The new status-go/protocol package maintained its own dependencies until sub modules were removed and the root go.mod file managed all dependencies for the entire status-go repo.