logos-messaging/message-finder
1
0
Fork 0
mirror of https://github.com/logos-messaging/message-finder.git synced 2026-01-02 14:03:11 +00:00
Code Issues Packages Projects Releases Wiki Activity
message-finder/README.md
Richard Ramos 065a8b4a67
chore: make the message finder more useful
2024-06-06 22:46:28 -04:00

6.0 KiB
Raw Blame History

Query tool

Use this to query a storenode

make

To retrieve data using StoreV2

./build/query \
  --cluster-id=16 \
  --storenode=/dns4/store-01.do-ams3.shards.test.status.im/tcp/30303/p2p/16Uiu2HAmAUdrQ3uwzuE4Gy4D56hX6uLKEeerJAnhKEHZ3DxF1EfT \
  --pubsub-topic=/waku/2/rs/16/32 \
  --content-topic=/waku/1/0x242ed557/rfc26 \
  --content-topic=/waku/1/0xd811cd50/rfc26 \
  --content-topic=/waku/1/0x89bed93d/rfc26 \
  --content-topic=/waku/1/0xc95d2429/rfc26 \
  --content-topic=/waku/1/0xa0a6b41b/rfc26 \
  --start-time=1717507412000000000 \
  --end-time=1717593812000000000 \
  --pagesize=20 \
  --use-legacy=true


Page: 1, Record from 1 to 20
MessageHash                                                         Content Topic             Timestamp (unix nano)  Timestamp (UTC)                       
0xacb469e0464aa6ebe7847807bf856c05a7ed3d26c5813f76c206ff9706eb686b  /waku/1/0xd811cd50/rfc26  1717586544149237000    2024-06-05 07:22:24.149237 -0400 AST  
0x518dd28a733ce491cedf698e4ed375e362fd435603f7d8807dc341303e838f3f  /waku/1/0x242ed557/rfc26  1717586545164878000    2024-06-05 07:22:25.164878 -0400 AST  
...
...

Cursor: Digest(f4e9ceb8cb71b5f59e788858c1133d6853fbcf11094d80da53db235843351509); ReceiverTime:1717586544149237000, SenderTime: 1717586544149237000, PubsubTopic: /waku/2/rs/16/32

Page: 2, Record from 21 to 30
MessageHash                                                         Content Topic             Timestamp (unix nano)  Timestamp (UTC)                       
0x2398b5e4e76e756c45d44e4bc80e419ed30442c6ae4a5f821e76a16c5046f7c0  /waku/1/0xa0a6b41b/rfc26  1717508510925960000    2024-06-04 09:41:50.92596 -0400 AST   
0x81eb1068e582095d440d145b64b1f96e66a5b928626fa8a87f258f80b09b8034  /waku/1/0xa0a6b41b/rfc26  1717575288097033000    2024-06-05 04:14:48.097033 -0400 AST  
...
...

To retrieve data using StoreV3

# Using filter criteria
./build/query \
  --cluster-id=16 \
  --storenode=/dns4/store-01.do-ams3.shards.test.status.im/tcp/30303/p2p/16Uiu2HAmAUdrQ3uwzuE4Gy4D56hX6uLKEeerJAnhKEHZ3DxF1EfT \
  --pubsub-topic=/waku/2/rs/16/32 \
  --content-topic=/waku/1/0x242ed557/rfc26 \
  --content-topic=/waku/1/0xd811cd50/rfc26 \
  --content-topic=/waku/1/0x89bed93d/rfc26 \
  --content-topic=/waku/1/0xc95d2429/rfc26 \
  --content-topic=/waku/1/0xa0a6b41b/rfc26 \
  --start-time=1717507412000000000 \
  --end-time=1717593812000000000 \
  --pagesize=20

Page: 1, Record from 1 to 20
MessageHash                                                         Content Topic             Timestamp (unix nano)  Timestamp (UTC)                       
0xacb469e0464aa6ebe7847807bf856c05a7ed3d26c5813f76c206ff9706eb686b  /waku/1/0xd811cd50/rfc26  0xc000c340f0           2024-06-05 07:22:24.149237 -0400 AST  
0x518dd28a733ce491cedf698e4ed375e362fd435603f7d8807dc341303e838f3f  /waku/1/0x242ed557/rfc26  0xc000c34110           2024-06-05 07:22:25.164878 -0400 AST  
...
...

Cursor: acb469e0464aa6ebe7847807bf856c05a7ed3d26c5813f76c206ff9706eb686b


# Using message hashes
./build/query \
  --cluster-id=16 
  --storenode=/dns4/store-01.do-ams3.shards.test.status.im/tcp/30303/p2p/16Uiu2HAmAUdrQ3uwzuE4Gy4D56hX6uLKEeerJAnhKEHZ3DxF1EfT \
  --hash=0x203f84d1bc5c02020155a0aa018341411a0a099a705004160fb9c2cfdf301e8e \
  --hash=0x0a4a33435c66cb76c70fccf19d93b50ce6acbb76c95f4006531157ff6eeffa5e \
  --hash=0x0bd982e0cfb907a897955af0b2f29fa69a84fb42b1d5ce99c014232bc290d4d6

Page: 1, Record from 1 to 3
MessageHash                                                         Content Topic             Timestamp (unix nano)  Timestamp (UTC)                       
0x203f84d1bc5c02020155a0aa018341411a0a099a705004160fb9c2cfdf301e8e  /waku/1/0x242ed557/rfc26  0xc00070e6c0           2024-06-05 07:23:00.592406 -0400 AST  
0x0a4a33435c66cb76c70fccf19d93b50ce6acbb76c95f4006531157ff6eeffa5e  /waku/1/0x242ed557/rfc26  0xc00070e6e0           2024-06-05 07:56:29.179335 -0400 AST  
0x0bd982e0cfb907a897955af0b2f29fa69a84fb42b1d5ce99c014232bc290d4d6  /waku/1/0x242ed557/rfc26  0xc00070e700           2024-06-05 08:10:53.641212 -0400 AST

To see the content of a message

 ./build/query --cluster-id=16 --storenode=/dns4/store-01.do-ams3.shards.test.status.im/tcp/30303/p2p/16Uiu2HAmAUdrQ3uwzuE4Gy4D56hX6uLKEeerJAnhKEHZ3DxF1EfT --hash 0xacb469e0464aa6ebe7847807bf856c05a7ed3d26c5813f76c206ff9706eb686b

PubsubTopic: 0xc000350830
MessageHash: 0xacb469e0464aa6ebe7847807bf856c05a7ed3d26c5813f76c206ff9706eb686b
ContentTopic: /waku/1/0xd811cd50/rfc26
Timestamp (unix nano): 1717586544149237000
Timestamp (UTC): 2024-06-05 07:22:24.149237 -0400 AST
Version: 1
Payload:
00000000  c4 33 ca 2a 86 20 35 e8  5c 9b 3b aa 1d d4 e1 25  |.3.*. 5.\.;....%|
00000010  52 e4 62 8b 84 94 ca 1a  4a 02 4a e6 11 39 0c 99  |R.b.....J.J..9..|
00000020  12 aa 28 ae 70 0c b1 f2  31 e4 a1 10 ee 0f c8 6d  |..(.p...1......m|
00000030  c7 28 2e 75 c8 a0 a4 21  19 9a ee e1 07 5b 41 7f  |.(.u...!.....[A.|
00000040  bf f7 19 cd a9 f4 54 08  39 3f 55 2e ed 79 55 df  |......T.9?U..yU.|
00000050  77 cf fc f8 49 c3 04 c2  bf 77 b4 ce b9 95 a8 56  |w...I....w.....V|
00000060  46 06 c4 89 be 15 09 89  8b a5 06 30 90 96 36 8b  |F..........0..6.|
00000070  96 f8 df c3 84 c4 58 93  8f 76 58 d0 33 bb 14 cd  |......X..vX.3...|
00000080  8e 59 9b 51 1f 97 ab 8c  07 fe 3a ff f7 e7 6f fb  |.Y.Q......:...o.|
00000090  7f d0 aa 56 03 ca 49 eb  ef 08 9a ef ca 12 85 72  |...V..I........r|
000000a0  b0 47 79 2b 28 50 06 7d  89 69 d8 85 8e 3c 7f cb  |.Gy+(P.}.i...<..|

Meta: <nil>
Meta: <nil>
RateLimitProof: <nil>

Docker

# Build
docker build -t querytool:latest .

# Execute
docker run querytool:latest \
  --cluster-id=16 \
  --storenode=/dns4/store-01.do-ams3.shards.test.status.im/tcp/30303/p2p/16Uiu2HAmAUdrQ3uwzuE4Gy4D56hX6uLKEeerJAnhKEHZ3DxF1EfT \
  --pubsub-topic=/waku/2/rs/16/32 \
  --content-topic=/waku/1/0x242ed557/rfc26 \
  --content-topic=/waku/1/0xd811cd50/rfc26 \
  --content-topic=/waku/1/0x89bed93d/rfc26 \
  --content-topic=/waku/1/0xc95d2429/rfc26 \
  --content-topic=/waku/1/0xa0a6b41b/rfc26 \
  --start-time=1717507412000000000 \
  --end-time=1717593812000000000 \
  --pagesize=20 \
  --use-legacy=true