status-go/services
Stefan 579f7e4a52 chore(wallet) optimize the filer query
Main changes:

- Use tr_type instead of IN clause
- Use binary (X'...' syntax) directly into the query instead of
  converting DB values to HEX
  - Found to be slightly faster than query parameters in the dedicated benchmark
  - Didn't see much improvement in filter benchmarks
- Tried various combinations of optimizations but without impressive performance results

Benchmark results:

| Name                   | Original   | tr_type   | join     | hex      | no-db     | db_only   |     last |    net_j |
|:-----------------------|:-----------|:----------|:---------|:---------|:----------|:----------|---------:|---------:|
| RAM_NoFilter-10        | 49580229   | 51253242  | 51112462 | 50915133 | 121217817 | 141691008 | 50908642 | 50239712 |
| SSD_NoFilter-10        | 49963604   | 51393588  | 51213038 | 50881483 | 120785679 | 141063467 | 50462767 | 49676867 |
| SSD_MovingWindow-10    | 53695712   | 54155292  | 54161733 | 54061325 | 126966633 | 146866017 | 53479929 | 53350475 |
| SSD_AllAddr_AllTos-10  | 41382804   | 41195225  | 51684175 | 52107262 | 64348100  | 97608833  | 50523529 | 49968321 |
| SSD_OneAddress-10      | 34945275   | 35103850  | 31066429 | 31328762 | 50927300  | 54322971  | 30098529 | 30252546 |
| FilterSend_AllAddr-10  | 39546808   | 37566604  | 38389725 | 38260738 | 114820458 | 125588408 | 37127625 | 36864575 |
| FilterSend_6Addr-10    | 41221458   | 41111225  | 40848288 | 40135492 | 118629700 | 128200467 | 38942521 | 39012100 |
| FilterThreeNetworks-10 | -          | -         | -        | -        | -         | -         | 50058929 | 49854450 |

Update status-desktop: #11036
2023-09-21 13:56:44 +02:00
..
accounts feat: added `MigrateNonProfileKeycardKeypairToApp` endpoint 2023-08-30 10:17:19 +02:00
appmetrics fix(tests): moved test db setup to a common place 't/helpers', created 2023-08-18 09:00:56 +02:00
browsers fix(tests): moved test db setup to a common place 't/helpers', created 2023-08-18 09:00:56 +02:00
chat Always use protobufs by reference & generate handlers 2023-08-22 12:08:54 +01:00
communitytokens feat(Collectibles): Change Collectibles service name to CommunityTokens. 2023-08-29 11:01:01 +02:00
ens fix(wallet) propagate multi-transactions IDs to transfers 2023-08-22 18:39:42 +02:00
ext feat(Collectibles): Change Collectibles service name to CommunityTokens. 2023-08-29 11:01:01 +02:00
gif fix(tests): moved test db setup to a common place 't/helpers', created 2023-08-18 09:00:56 +02:00
local-notifications Fix/wallet watcher panic (#3940) 2023-08-24 10:57:10 +08:00
mailservers feat: use protected topics for communities 2023-08-23 13:56:00 -04:00
peer Fix hash & start moving to lifecycle 2021-07-20 10:57:38 +02:00
permissions fix(tests): moved test db setup to a common place 't/helpers', created 2023-08-18 09:00:56 +02:00
personal feat: Rpc client manage multiple eth client (#2359) 2021-09-22 13:49:20 -04:00
rpcfilters feat(wallet): Move pending transactions to `transactions` module. 2023-07-11 16:07:42 +02:00
rpcstats Move services to status-node 2021-07-20 10:57:38 +02:00
shhext Remove group members (#3011) 2022-12-10 08:26:51 +04:00
status fix(RequestCommunityInfoFromMailserver): Add useDatabase flag to read/not read community info before requesting mailserver.. 2022-11-30 11:10:13 +01:00
stickers fix(wallet) propagate multi-transactions IDs to transfers 2023-08-22 18:39:42 +02:00
subscriptions feat: Rpc client manage multiple eth client (#2359) 2021-09-22 13:49:20 -04:00
typeddata fix: metamask test 2022-10-26 09:39:30 +02:00
updates feat: add service for checking if there are new versions available (#2552) 2022-06-08 08:38:26 -04:00
utils feat(collectibles): Mint collectibles (ERC-721): 2023-02-13 12:59:55 +01:00
wakuext fix(tests): moved test db setup to a common place 't/helpers', created 2023-08-18 09:00:56 +02:00
wakuv2ext feat: fetch curated communities from smart contract on optimism (#2685) 2022-06-02 08:17:52 -04:00
wallet chore(wallet) optimize the filer query 2023-09-21 13:56:44 +02:00
web3provider fix(tests): moved test db setup to a common place 't/helpers', created 2023-08-18 09:00:56 +02:00