status-go/protocol
Pascal Precht 1bab7ae056 refactor(communities): improve archive handling memory pressure
Instead of loading the entire torrent file into memory when trying
to extrract active messages, we now only read the chunks that are
necessary to decode any individual archive and then process
extracted messages in chunks.

This doesn't introduce a max cap of allowed memory yet, since the
chunk size depends entirely on the size of the archive, but this
will be done soon.
2023-01-18 15:45:13 +01:00
..
anonmetrics Persist switcher cards (#3049) 2023-01-05 21:41:57 +05:30
audio Add audio messages 2020-07-27 17:14:50 +02:00
common fix: add discord message data to quoted messages 2023-01-17 12:08:42 +01:00
communities refactor(communities): improve archive handling memory pressure 2023-01-18 15:45:13 +01:00
datasync Rename MessageProcessor to MessageSender (#2264) 2021-06-23 17:13:48 +03:00
discord feat(communities): add community images to import progress signal 2022-11-07 17:16:00 +01:00
encryption Bump encryption too high number 2023-01-13 11:51:30 +00:00
ens feat: make kdf iterations configurable when creating a multiaccount (#2796) 2022-09-27 16:27:20 -04:00
identity ColourHash is a distinct type that has a discrete pattern 2022-11-28 16:26:07 +00:00
images load audio from http server 2022-03-01 15:58:32 +01:00
internal/sqlite Sync Settings (#2478) 2022-03-23 18:47:00 +00:00
migrations Image width height (#3061) 2023-01-12 13:43:14 +04:00
protobuf fix: should include ContactRequestState and HasAddedUs when sync contact (#3100) 2023-01-18 16:12:27 +08:00
pushnotificationclient Persist switcher cards (#3049) 2023-01-05 21:41:57 +05:30
pushnotificationserver Persist switcher cards (#3049) 2023-01-05 21:41:57 +05:30
requests Persist switcher cards (#3049) 2023-01-05 21:41:57 +05:30
sqlite replace deprecated ioutil.TempDir with os.MkdirTemp 2023-01-03 15:40:11 +01:00
subscription
transport chore: make `createMessagesRequestV2` respect `mailserverRequestTimeout` 2023-01-11 20:26:10 +01:00
tt Tests and linting 2021-09-30 13:02:41 +01:00
urls fix: remove tenor.com from preview whitelist 2022-09-15 12:27:49 +02:00
v1 fix TestGroupChatMembersRemoval sometimes failed (#3037) 2023-01-05 23:37:50 +08:00
verification feat(ActivityCenter): Add message for canceling contact requests (#2992) 2022-12-14 12:27:02 +04:00
wakusync Upgrade linter to 1.50.0 2023-01-13 17:52:03 +00:00
zaputil
LICENSE
README.md
activity_center.go Handle identity verifications 2022-10-26 17:19:44 +01:00
activity_center_persistence.go Add notification for trustworthy/untrustworthy 2022-11-16 16:17:13 +00:00
anon_metrics_test.go rename status-react to status-mobile 2022-07-17 15:37:14 +02:00
chat.go Fix private group members details not being sent on preview (#2936) 2022-11-03 11:57:51 +03:00
chat_group_proxy.go
chat_test.go feat: add and distribute `chatIdentity.FirstMessageTimestamp` 2022-09-09 08:59:39 +02:00
communities_messenger_test.go feat: backup profile data to waku and sync them from waku 2022-12-23 15:07:14 +01:00
contact.go feat: make any member able to add new users to group chat 2022-09-13 12:16:14 +02:00
delete_for_me_message.go feat: delete for me (#2866) 2022-09-28 19:42:17 +08:00
delete_message.go Delete messages (#2279) 2021-07-26 17:06:32 -04:00
edit_message.go address feedback 2021-06-29 13:15:15 +02:00
emoji_reaction.go Skip wrapping emojis in private group chats 2021-01-26 09:39:47 +01:00
errors.go Add ClearHistory & DeactivateChat methods 2021-01-11 13:36:05 +01:00
group_chat_invitation.go group chat invitation 2020-09-07 12:15:58 +02:00
group_chat_system_messages.go feat: Handle image in group chat 2022-09-01 12:19:01 +02:00
identity_images.go Add HasAddedUs field 2021-10-04 12:19:15 +02:00
local_notifications.go Sync Settings (#2478) 2022-03-23 18:47:00 +00:00
message_builder.go add PinMessage and PinnedMessage (#2180) 2021-05-14 23:22:50 +02:00
message_persistence.go fix: add discord message data to quoted messages 2023-01-17 12:08:42 +01:00
message_validator.go feat: introduce discord import tool 2022-10-28 09:52:26 +02:00
message_validator_test.go Fix protobuf ImageType change 2020-12-17 14:10:00 +01:00
messenger.go fix: should include ContactRequestState and HasAddedUs when sync contact (#3100) 2023-01-18 16:12:27 +08:00
messenger_activity_center.go Allow to pass activity center status as a parameter 2022-11-14 10:17:43 +01:00
messenger_activity_center_test.go Turning the tests back on (#2519) 2022-02-03 20:37:41 +00:00
messenger_auto_message.go Add read/unread messenger functions for activity center 2022-10-26 17:19:44 +01:00
messenger_backup.go chore: code review comments applied 2022-12-23 15:07:14 +01:00
messenger_backup_handler.go chore: code review comments applied 2022-12-23 15:07:14 +01:00
messenger_backup_test.go chore: code review comments applied 2022-12-23 15:07:14 +01:00
messenger_bookmarks.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_browsers.go Issue 13813 -- Use messenger ns for browser CRUD (#2801) 2022-08-24 16:05:35 +02:00
messenger_browsers_test.go Issue 13813 -- Use messenger ns for browser CRUD (#2801) 2022-08-24 16:05:35 +02:00
messenger_chats.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_communities.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_config.go feat: backup profile data to waku and sync them from waku 2022-12-23 15:07:14 +01:00
messenger_contact_requests_test.go Restart discovery when it fails 2022-12-14 20:54:48 +00:00
messenger_contact_update_test.go Sync Settings (#2478) 2022-03-23 18:47:00 +00:00
messenger_contact_verification.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_contact_verification_test.go feat(ActivityCenter): Add missing AC notifications for verification requests (#3029) 2022-12-26 08:35:46 +04:00
messenger_contacts.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_delete_message_for_everyone_test.go Upgrade linter to 1.50.0 2023-01-13 17:52:03 +00:00
messenger_delete_message_for_me_test.go feat: delete message for new design (#2922) 2022-11-17 18:11:58 +08:00
messenger_delete_message_test.go Allow owner/admin to delete messages of a community (#2958) 2022-12-02 19:34:02 +08:00
messenger_discv5.go feat: Add DiscV5 to Waku2 (#2434) 2021-11-22 09:40:14 -04:00
messenger_edit_message_test.go feat: make any member able to add new users to group chat 2022-09-13 12:16:14 +02:00
messenger_emoji_test.go feat: make replies act as mentions 2023-01-10 13:39:57 -05:00
messenger_ens.go Request/Decline access to communities 2021-02-26 15:35:43 +01:00
messenger_group_chat.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_group_chat_test.go fix inconsistent contact request state (#3056) 2023-01-06 18:24:39 +08:00
messenger_handler.go refactor(communities): improve archive handling memory pressure 2023-01-18 15:45:13 +01:00
messenger_handler_test.go feat: Handle image in group chat 2022-09-01 12:19:01 +02:00
messenger_identity.go feat: backup profile data to waku and sync them from waku 2022-12-23 15:07:14 +01:00
messenger_identity_image_test.go Added multiaccounts.Database tests for new funcs 2022-08-22 13:27:59 +01:00
messenger_images.go Get preferred network IP and refactor server package to increase reusability (#2626) 2022-06-15 15:49:31 +01:00
messenger_installations_test.go fix: should include ContactRequestState and HasAddedUs when sync contact (#3100) 2023-01-18 16:12:27 +08:00
messenger_mailserver.go Restart discovery when it fails 2022-12-14 20:54:48 +00:00
messenger_mailserver_cycle.go fix: dropping peer in mailserver cycle 2023-01-18 09:28:08 -04:00
messenger_maps.go Tests and linting 2021-09-30 13:02:41 +01:00
messenger_messages.go Allow owner/admin to delete messages of a community (#2958) 2022-12-02 19:34:02 +08:00
messenger_mute_test.go Fix some tests and restore private/public RPC client 2021-07-20 10:57:38 +02:00
messenger_peers.go feat: add wakuext_listenAddresses 2022-11-28 08:10:51 -04:00
messenger_pin_message_test.go Turning the tests back on (#2519) 2022-02-03 20:37:41 +00:00
messenger_pin_messages.go feat: introduce `CommunityAdminSettings` in `CommunityDescription` 2022-05-18 09:58:11 +02:00
messenger_reply_test.go fix(reply-test): fix reply test because msgs could come out of order 2023-01-11 16:24:42 -05:00
messenger_response.go synchronize display name (#2989) 2022-12-29 14:16:19 +08:00
messenger_response_test.go feat: desktop mailserver cycle (#2481) 2022-01-12 12:02:01 -04:00
messenger_saved_address.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_share_image_test.go fix: TestImageMessageSharing (#2874) 2022-09-21 09:48:04 -04:00
messenger_status_updates.go Upgrade linter to 1.50.0 2023-01-13 17:52:03 +00:00
messenger_status_updates_test.go Timeout automatic status updates (#2757) 2022-08-03 04:38:01 +05:30
messenger_switcher_cards.go Persist switcher cards (#3049) 2023-01-05 21:41:57 +05:30
messenger_sync_bookmark_test.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_sync_chat_test.go fix(community): don't delete chat and messages when leaving community 2022-12-09 14:43:56 -05:00
messenger_sync_clear_history_test.go Sync clear history 2022-02-17 11:15:01 +00:00
messenger_sync_profile_picture_test.go Added multiaccounts.Database tests for new funcs 2022-08-22 13:27:59 +01:00
messenger_sync_raw_messages.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_sync_saved_addresses_test.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_sync_settings.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_sync_settings_test.go chore: use provided pictures visibility options when creating settings db entry (#2867) 2022-10-05 12:53:42 +02:00
messenger_sync_verification_test.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_sync_wallets_test.go Sync all devices after initial pairing (#3047) 2023-01-06 20:21:14 +08:00
messenger_test.go chore: extend `TestRetrieveBlockedContact` 2022-11-11 15:44:22 +01:00
messenger_walletconnect.go Implement wallet connect session CRUD API 2022-08-19 12:32:00 +01:00
messenger_walletconnect_test.go Implement wallet connect session CRUD API 2022-08-19 12:32:00 +01:00
persistence.go Upgrade linter to 1.50.0 2023-01-13 17:52:03 +00:00
persistence_test.go feat(QuotedMessage): pass Deleted to QuotedMessage 2023-01-12 11:47:38 -05:00
push_notification_test.go feat(messenger): add `createDefaultChannel` flag to `CreateCommunity` API 2022-07-26 10:23:49 +02:00
status_update.go feat: user status (#2276) 2021-07-22 13:41:49 -04:00
switcher_card.go Persist switcher cards (#3049) 2023-01-05 21:41:57 +05:30
transaction_validator.go Move message to common namespace 2020-09-09 21:22:12 +02:00
transaction_validator_test.go Move message to common namespace 2020-09-09 21:22:12 +02:00

README.md

status-go/protocol

This is an implementation of the secure transport and payloads which are a part of the Status Client specification.

This implementation uses SQLite and SQLCipher for persistent storage.

The payloads are encoded using protocol-buffers.

Content

  • messenger.go is the main file which exports Messenger struct. This is a public API to interact with this implementation of the Status Chat Protocol.
  • protobuf/ contains protobuf files implementing payloads described in the Payloads spec.
  • encryption/ implements the Secure Transport spec.
  • transport/ connects the Status Chat Protocol with a wire-protocol which in our case is either Whisper or Waku.
  • datasync/ is an adapter for MVDS.
  • applicationmetadata/ is an outer layer wrapping a payload with an app-specific metadata like a signature.
  • identity/ implements details related to creating a three-word name and identicon.
  • migrations/ contains implementation specific migrations for the sqlite database which is used by Messenger as a persistent data store.

History

Originally this package was a dedicated repo called status-protocol-go and was migrated into status-go. The new status-go/protocol package maintained its own dependencies until sub modules were removed and the root go.mod file managed all dependencies for the entire status-go repo.