201 lines
36 KiB
Plaintext

2026-03-13 04:38:16.270 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-13 04:38:16.270 DEBUG [tests.conftest] Running test: test_unsubscribe_from_all_content_topics with id: 2026-03-13_04-38-16__359ee48a-e678-4c94-84f0-d0f33baf33f7
2026-03-13 04:38:16.271 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-13 04:38:16.272 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-13 04:38:16.272 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-13 04:38:16.284 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:16.284 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-13_04-38-16__359ee48a-e678-4c94-84f0-d0f33baf33f7__wakuorg_nwaku:latest.log
2026-03-13 04:38:16.284 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:16.285 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:16.287 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:16.287 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.201.185
2026-03-13 04:38:16.287 DEBUG [src.node.docker_mananger] Generated ports ['43983', '43984', '43985', '43986', '43987']
2026-03-13 04:38:16.288 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:16.288 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:16.288 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:16.288 DEBUG [src.node.docker_mananger] docker run -i -t -p 43983:43983 -p 43984:43984 -p 43985:43985 -p 43986:43986 -p 43987:43987 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=43985 --rest-port=43983 --tcp-port=43984 --discv5-udp-port=43986 --rest-address=0.0.0.0 --nat=extip:172.18.201.185 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=df65da3fc38b25525d9c362d9aee39a21f4ed4a7257acfd4ebbfcf9baf299a72 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=43987 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-13 04:38:16.496 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.201.185 waku 6f31dbe77c33f6ef31ee6db9353ae9f21f64f29400f021c303b9bcd00eb4e955
2026-03-13 04:38:16.519 ERROR [src.node.docker_mananger] Max retries reached for container 677d5066b53f. Exiting log stream.
2026-03-13 04:38:16.532 DEBUG [src.node.docker_mananger] Container started with ID 6f31dbe77c33. Setting up logs at ./log/docker/node1_2026-03-13_04-38-16__359ee48a-e678-4c94-84f0-d0f33baf33f7__wakuorg_nwaku:latest.log
2026-03-13 04:38:16.533 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 43983
2026-03-13 04:38:16.533 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:17.178 ERROR [src.node.docker_mananger] Max retries reached for container 6602baf76ef2. Exiting log stream.
2026-03-13 04:38:17.533 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:17.561 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:17.661 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:17.664 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:17.665 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:17.665 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:17.668 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.201.185/tcp/43984/p2p/16Uiu2HAm72ZmaKkZyGoidPt8UEgBUZupgvU6CQzE9dPvZu5sDeBc","/ip4/172.18.201.185/tcp/43985/ws/p2p/16Uiu2HAm72ZmaKkZyGoidPt8UEgBUZupgvU6CQzE9dPvZu5sDeBc"],"enrUri":"enr:-L24QAw1PaDdXa189S1fvQkakAHqYGmeqTis-lL2dvFpccycSrmRw99hKqzdYmdo8pWoMcUNaAXkdI0nbOzrd4ZIzH8CgmlkgnY0gmlwhKwSybmKbXVsdGlhZGRyc5YACASsEsm5BqvQAAoErBLJuQar0d0DgnJzhQACAQAAiXNlY3AyNTZrMaECrGDcsjQiXTnpeytKkOEFYCKrh-eWAAn5KZLL0v-KLBuDdGNwgqvQg3VkcIKr0oV3YWt1MgU"}'
2026-03-13 04:38:17.668 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:17.676 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:38:17.676 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-13_04-38-16__359ee48a-e678-4c94-84f0-d0f33baf33f7__wakuorg_nwaku:latest.log
2026-03-13 04:38:17.677 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:38:17.677 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:38:17.680 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:38:17.680 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.19.168
2026-03-13 04:38:17.680 DEBUG [src.node.docker_mananger] Generated ports ['40571', '40572', '40573', '40574', '40575']
2026-03-13 04:38:17.680 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:38:17.680 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:38:17.680 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:38:17.681 DEBUG [src.node.docker_mananger] docker run -i -t -p 40571:40571 -p 40572:40572 -p 40573:40573 -p 40574:40574 -p 40575:40575 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=40573 --rest-port=40571 --tcp-port=40572 --discv5-udp-port=40574 --rest-address=0.0.0.0 --nat=extip:172.18.19.168 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=fcbccc7f9b74fa6dfeabb5dc2bceeddc195ec9eb5d2f3c43bc25bcaead397b85 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=40575 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAw1PaDdXa189S1fvQkakAHqYGmeqTis-lL2dvFpccycSrmRw99hKqzdYmdo8pWoMcUNaAXkdI0nbOzrd4ZIzH8CgmlkgnY0gmlwhKwSybmKbXVsdGlhZGRyc5YACASsEsm5BqvQAAoErBLJuQar0d0DgnJzhQACAQAAiXNlY3AyNTZrMaECrGDcsjQiXTnpeytKkOEFYCKrh-eWAAn5KZLL0v-KLBuDdGNwgqvQg3VkcIKr0oV3YWt1MgU --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-13 04:38:17.891 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.19.168 waku 2dba9019dd8300be94ce9da86bc8250bc04aebc22e78b0a638f9a3af1f5d230f
2026-03-13 04:38:17.925 DEBUG [src.node.docker_mananger] Container started with ID 2dba9019dd83. Setting up logs at ./log/docker/node2_2026-03-13_04-38-16__359ee48a-e678-4c94-84f0-d0f33baf33f7__wakuorg_nwaku:latest.log
2026-03-13 04:38:17.925 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 40571
2026-03-13 04:38:17.927 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:38:18.927 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40571/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:18.930 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:19.030 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40571/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:19.033 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:19.133 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40571/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:19.136 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:19.236 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40571/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:19.239 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:19.339 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40571/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:19.352 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:38:19.453 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40571/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:19.455 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:38:19.456 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:38:19.456 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40571/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:19.458 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.19.168/tcp/40572/p2p/16Uiu2HAmSay6TpqW428TcrCDotax55MML28WuxGeHm4oB5ht362U","/ip4/172.18.19.168/tcp/40573/ws/p2p/16Uiu2HAmSay6TpqW428TcrCDotax55MML28WuxGeHm4oB5ht362U"],"enrUri":"enr:-L24QERg9EXrL7836A85ko2wM8dhzQyOkIhR810ylRpuokxCRMSJ_Q0E_6zZpH1QQbIgsbE9CN-GbXclmIgbldARnOgCgmlkgnY0gmlwhKwSE6iKbXVsdGlhZGRyc5YACASsEhOoBp58AAoErBITqAaefd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDzvvfvZlgj1URAWoCR_Gv27U_oh2JT4ardt6MeJVPz4mDdGNwgp58g3VkcIKefoV3YWt1MgE"}'
2026-03-13 04:38:19.458 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:38:19.459 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:40571/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.201.185/tcp/43984/p2p/16Uiu2HAm72ZmaKkZyGoidPt8UEgBUZupgvU6CQzE9dPvZu5sDeBc"]'
2026-03-13 04:38:19.488 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:19.492 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43983/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-13 04:38:19.502 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:19.503 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:40571/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-13 04:38:19.508 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:19.510 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43983/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:19.519 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:19.519 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:38:19.620 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:19.620 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:19.623 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376699509817358,"ephemeral":false,"proof":""}]'
2026-03-13 04:38:19.624 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:19.624 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40571/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:19.627 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376699509817358,"ephemeral":false,"proof":""}]'
2026-03-13 04:38:19.629 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43983/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/waku/2/content/test.js", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:19.638 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:19.638 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:38:19.739 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:19.739 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/relay/v1/auto/messages/%2Fwaku%2F2%2Fcontent%2Ftest.js" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:19.742 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/waku/2/content/test.js","version":0,"timestamp":1773376699628984613,"ephemeral":false,"proof":""}]'
2026-03-13 04:38:19.744 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:19.744 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40571/relay/v1/auto/messages/%2Fwaku%2F2%2Fcontent%2Ftest.js" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:19.746 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/waku/2/content/test.js","version":0,"timestamp":1773376699628984613,"ephemeral":false,"proof":""}]'
2026-03-13 04:38:19.748 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43983/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/22/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:19.757 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:19.757 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:38:19.857 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:19.858 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/relay/v1/auto/messages/%2Fapp%2F22%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:19.860 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/22/sometopic/someencoding","version":0,"timestamp":1773376699748317431,"ephemeral":false,"proof":""}]'
2026-03-13 04:38:19.862 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:19.862 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40571/relay/v1/auto/messages/%2Fapp%2F22%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:19.864 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/22/sometopic/someencoding","version":0,"timestamp":1773376699748317431,"ephemeral":false,"proof":""}]'
2026-03-13 04:38:19.866 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43983/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/toychat/2/huilong/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:19.875 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:19.876 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:38:19.976 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:19.977 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/relay/v1/auto/messages/%2Ftoychat%2F2%2Fhuilong%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:19.979 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1773376699866536884,"ephemeral":false,"proof":""}]'
2026-03-13 04:38:19.981 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:19.981 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40571/relay/v1/auto/messages/%2Ftoychat%2F2%2Fhuilong%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:19.983 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1773376699866536884,"ephemeral":false,"proof":""}]'
2026-03-13 04:38:19.985 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43983/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/statusim/1/community/cbor", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:19.993 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:19.994 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:38:20.094 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:20.094 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/relay/v1/auto/messages/%2Fstatusim%2F1%2Fcommunity%2Fcbor" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:20.097 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/statusim/1/community/cbor","version":0,"timestamp":1773376699985153936,"ephemeral":false,"proof":""}]'
2026-03-13 04:38:20.099 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:20.099 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40571/relay/v1/auto/messages/%2Fstatusim%2F1%2Fcommunity%2Fcbor" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:20.102 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/statusim/1/community/cbor","version":0,"timestamp":1773376699985153936,"ephemeral":false,"proof":""}]'
2026-03-13 04:38:20.103 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43983/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/27/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:20.113 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:20.113 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:38:20.214 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:20.214 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/relay/v1/auto/messages/%2Fapp%2F27%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:20.217 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/27/sometopic/someencoding","version":0,"timestamp":1773376700103792364,"ephemeral":false,"proof":""}]'
2026-03-13 04:38:20.219 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:20.219 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40571/relay/v1/auto/messages/%2Fapp%2F27%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:20.221 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/27/sometopic/someencoding","version":0,"timestamp":1773376700103792364,"ephemeral":false,"proof":""}]'
2026-03-13 04:38:20.223 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43983/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/29/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:20.232 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:20.233 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:38:20.333 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:20.333 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/relay/v1/auto/messages/%2Fapp%2F29%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:20.336 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/29/sometopic/someencoding","version":0,"timestamp":1773376700223380593,"ephemeral":false,"proof":""}]'
2026-03-13 04:38:20.337 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:20.338 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40571/relay/v1/auto/messages/%2Fapp%2F29%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:20.340 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/29/sometopic/someencoding","version":0,"timestamp":1773376700223380593,"ephemeral":false,"proof":""}]'
2026-03-13 04:38:20.342 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43983/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/20/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:20.351 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:20.351 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:38:20.452 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:20.453 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/relay/v1/auto/messages/%2Fapp%2F20%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:20.458 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/20/sometopic/someencoding","version":0,"timestamp":1773376700342108804,"ephemeral":false,"proof":""}]'
2026-03-13 04:38:20.460 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:20.461 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40571/relay/v1/auto/messages/%2Fapp%2F20%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:20.467 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/20/sometopic/someencoding","version":0,"timestamp":1773376700342108804,"ephemeral":false,"proof":""}]'
2026-03-13 04:38:20.469 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:43983/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-13 04:38:20.516 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:20.516 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:40571/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-13 04:38:20.563 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:20.563 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43983/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:20.569 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:20.570 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:38:20.670 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:20.670 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:20.675 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:43983/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto. Response content: b'/myapp/1/latest/proto'
2026-03-13 04:38:20.677 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43983/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/waku/2/content/test.js", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:20.685 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:20.685 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:38:20.786 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:20.786 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/relay/v1/auto/messages/%2Fwaku%2F2%2Fcontent%2Ftest.js" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:20.788 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:43983/relay/v1/auto/messages/%2Fwaku%2F2%2Fcontent%2Ftest.js. Response content: b'/waku/2/content/test.js'
2026-03-13 04:38:20.790 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43983/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/22/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:20.796 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:20.796 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:38:20.896 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:20.897 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/relay/v1/auto/messages/%2Fapp%2F22%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:20.900 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:43983/relay/v1/auto/messages/%2Fapp%2F22%2Fsometopic%2Fsomeencoding. Response content: b'/app/22/sometopic/someencoding'
2026-03-13 04:38:20.901 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43983/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/toychat/2/huilong/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:20.908 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:20.908 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:38:21.008 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:21.009 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/relay/v1/auto/messages/%2Ftoychat%2F2%2Fhuilong%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:21.011 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:43983/relay/v1/auto/messages/%2Ftoychat%2F2%2Fhuilong%2Fproto. Response content: b'/toychat/2/huilong/proto'
2026-03-13 04:38:21.013 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43983/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/statusim/1/community/cbor", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:21.019 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:21.019 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:38:21.119 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:21.120 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/relay/v1/auto/messages/%2Fstatusim%2F1%2Fcommunity%2Fcbor" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:21.123 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:43983/relay/v1/auto/messages/%2Fstatusim%2F1%2Fcommunity%2Fcbor. Response content: b'/statusim/1/community/cbor'
2026-03-13 04:38:21.124 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43983/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/27/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:21.131 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:21.131 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:38:21.231 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:21.232 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/relay/v1/auto/messages/%2Fapp%2F27%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:21.234 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:43983/relay/v1/auto/messages/%2Fapp%2F27%2Fsometopic%2Fsomeencoding. Response content: b'/app/27/sometopic/someencoding'
2026-03-13 04:38:21.236 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43983/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/29/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:21.242 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:21.243 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:38:21.343 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:21.343 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/relay/v1/auto/messages/%2Fapp%2F29%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:21.346 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:43983/relay/v1/auto/messages/%2Fapp%2F29%2Fsometopic%2Fsomeencoding. Response content: b'/app/29/sometopic/someencoding'
2026-03-13 04:38:21.347 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43983/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/20/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:38:21.354 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:38:21.354 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:38:21.454 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:38:21.455 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43983/relay/v1/auto/messages/%2Fapp%2F20%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:38:21.457 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:43983/relay/v1/auto/messages/%2Fapp%2F20%2Fsometopic%2Fsomeencoding. Response content: b'/app/20/sometopic/someencoding'
2026-03-13 04:38:21.459 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-13 04:38:21.461 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-13 04:38:21.461 DEBUG [src.node.waku_node] Stopping container with id 6f31dbe77c33
2026-03-13 04:38:22.043 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:22.046 DEBUG [src.node.waku_node] Stopping container with id 2dba9019dd83
2026-03-13 04:38:22.624 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:38:22.628 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-13 04:38:22.680 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:38:22.721 DEBUG [src.node.docker_mananger] No errors found in the waku logs.