196 lines
35 KiB
Plaintext

2026-03-15 04:52:24.385 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-15 04:52:24.386 DEBUG [tests.conftest] Running test: test_unsubscribe_from_some_pubsub_topics with id: 2026-03-15_04-52-24__08a720a3-0453-479b-abe9-b1db7c6029a7
2026-03-15 04:52:24.386 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-15 04:52:24.386 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-15 04:52:24.387 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-15 04:52:24.393 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-15 04:52:24.393 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-15_04-52-24__08a720a3-0453-479b-abe9-b1db7c6029a7__wakuorg_nwaku:latest.log
2026-03-15 04:52:24.394 DEBUG [src.node.waku_node] Starting Node...
2026-03-15 04:52:24.394 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-15 04:52:24.395 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-15 04:52:24.395 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.141.156
2026-03-15 04:52:24.395 DEBUG [src.node.docker_mananger] Generated ports ['17638', '17639', '17640', '17641', '17642']
2026-03-15 04:52:24.395 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-15 04:52:24.396 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-15 04:52:24.396 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-15 04:52:24.396 DEBUG [src.node.waku_node] Using volumes []
2026-03-15 04:52:24.396 DEBUG [src.node.docker_mananger] docker run -i -t -p 17638:17638 -p 17639:17639 -p 17640:17640 -p 17641:17641 -p 17642:17642 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17640 --rest-port=17638 --tcp-port=17639 --discv5-udp-port=17641 --rest-address=0.0.0.0 --nat=extip:172.18.141.156 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=0bc0b490bf139ee6ec9d15fd92bbbae3eb7d3cc6cbfcfcdcdaa40ab0bdd53868 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17642 --metrics-logging=true --relay=true --filter=true
2026-03-15 04:52:24.548 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.141.156 waku 77f8cc3eb5a3629089c975886896feb3ec9cb824c69717ea58f1c3d817385aca
2026-03-15 04:52:24.576 DEBUG [src.node.docker_mananger] Container started with ID 77f8cc3eb5a3. Setting up logs at ./log/docker/node1_2026-03-15_04-52-24__08a720a3-0453-479b-abe9-b1db7c6029a7__wakuorg_nwaku:latest.log
2026-03-15 04:52:24.576 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 17638
2026-03-15 04:52:24.576 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-15 04:52:24.636 ERROR [src.node.docker_mananger] Max retries reached for container 846ba6d906cf. Exiting log stream.
2026-03-15 04:52:25.130 ERROR [src.node.docker_mananger] Max retries reached for container 4d593704453c. Exiting log stream.
2026-03-15 04:52:25.577 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17638/health" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:25.579 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-15 04:52:25.579 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-15 04:52:25.580 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17638/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:25.582 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.141.156/tcp/17639/p2p/16Uiu2HAmDzrLBqk2TkjY2pxBL6ZHSqL5zZM7rBMwrRkf3QpGV6Tz","/ip4/172.18.141.156/tcp/17640/ws/p2p/16Uiu2HAmDzrLBqk2TkjY2pxBL6ZHSqL5zZM7rBMwrRkf3QpGV6Tz"],"enrUri":"enr:-L24QPp3tIQ6TfgTlqSvkvHA--6azzUyeOfZwyif7XVrPNbnPyMI_rWFVMHPGOZKa4AODBADZDNmut0ipghtBfy1sFMCgmlkgnY0gmlwhKwSjZyKbXVsdGlhZGRyc5YACASsEo2cBkTnAAoErBKNnAZE6N0DgnJzhQACAQAAiXNlY3AyNTZrMaEDE_I8agK4UpRqfyJCK_PYhMD7vWgcNmWTvuwvv3-esUGDdGNwgkTng3VkcIJE6YV3YWt1MgU"}'
2026-03-15 04:52:25.582 INFO [src.node.waku_node] REST service is ready !!
2026-03-15 04:52:25.588 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-15 04:52:25.588 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-15_04-52-24__08a720a3-0453-479b-abe9-b1db7c6029a7__wakuorg_nwaku:latest.log
2026-03-15 04:52:25.588 DEBUG [src.node.waku_node] Starting Node...
2026-03-15 04:52:25.588 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-15 04:52:25.590 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-15 04:52:25.590 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.29.207
2026-03-15 04:52:25.590 DEBUG [src.node.docker_mananger] Generated ports ['19246', '19247', '19248', '19249', '19250']
2026-03-15 04:52:25.590 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-15 04:52:25.590 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-15 04:52:25.590 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-15 04:52:25.590 DEBUG [src.node.waku_node] Using volumes []
2026-03-15 04:52:25.591 DEBUG [src.node.docker_mananger] docker run -i -t -p 19246:19246 -p 19247:19247 -p 19248:19248 -p 19249:19249 -p 19250:19250 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=19248 --rest-port=19246 --tcp-port=19247 --discv5-udp-port=19249 --rest-address=0.0.0.0 --nat=extip:172.18.29.207 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=0dc4daef1abcff96be4ea8ea14f01d76ef97df8fb7be3efdeb826c53dfbae5ac --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=19250 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QPp3tIQ6TfgTlqSvkvHA--6azzUyeOfZwyif7XVrPNbnPyMI_rWFVMHPGOZKa4AODBADZDNmut0ipghtBfy1sFMCgmlkgnY0gmlwhKwSjZyKbXVsdGlhZGRyc5YACASsEo2cBkTnAAoErBKNnAZE6N0DgnJzhQACAQAAiXNlY3AyNTZrMaEDE_I8agK4UpRqfyJCK_PYhMD7vWgcNmWTvuwvv3-esUGDdGNwgkTng3VkcIJE6YV3YWt1MgU
2026-03-15 04:52:25.774 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.29.207 waku cfc6948130b0fa6e9b95f54d4725c8f575e4842ed1655d5ff3499b46de365147
2026-03-15 04:52:25.800 DEBUG [src.node.docker_mananger] Container started with ID cfc6948130b0. Setting up logs at ./log/docker/node2_2026-03-15_04-52-24__08a720a3-0453-479b-abe9-b1db7c6029a7__wakuorg_nwaku:latest.log
2026-03-15 04:52:25.800 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 19246
2026-03-15 04:52:25.800 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-15 04:52:26.801 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19246/health" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:26.838 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-15 04:52:26.940 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19246/health" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:26.942 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-15 04:52:26.943 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-15 04:52:26.943 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19246/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:26.945 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.29.207/tcp/19247/p2p/16Uiu2HAmNRgZ5vi4yjEgxteGbdz76cFLm3dEz8wzNiygwjGUuqcW","/ip4/172.18.29.207/tcp/19248/ws/p2p/16Uiu2HAmNRgZ5vi4yjEgxteGbdz76cFLm3dEz8wzNiygwjGUuqcW"],"enrUri":"enr:-L24QN86LWDgulI5_GUy8UAh3AwCsqFE-x9pyYWboW2FW2ReHM0if5ncZjtleLEEC8xDlG8mwbTTFDGAS7CmgbSfNEUCgmlkgnY0gmlwhKwSHc-KbXVsdGlhZGRyc5YACASsEh3PBksvAAoErBIdzwZLMN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDkSwyL6tV7Gsb8cYAH3AKWVc2nWsjBJlTWfivreNERHuDdGNwgksvg3VkcIJLMYV3YWt1MgE"}'
2026-03-15 04:52:26.945 INFO [src.node.waku_node] REST service is ready !!
2026-03-15 04:52:26.946 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19246/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.141.156/tcp/17639/p2p/16Uiu2HAmDzrLBqk2TkjY2pxBL6ZHSqL5zZM7rBMwrRkf3QpGV6Tz"]'
2026-03-15 04:52:26.966 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:52:26.968 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17638/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-15 04:52:26.975 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:52:26.975 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19246/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-15 04:52:26.980 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:52:26.981 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-15 04:52:26.990 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:52:26.991 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-15 04:52:27.092 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:27.092 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:27.095 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550346981290108,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:27.097 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:27.097 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19246/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:27.100 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550346981290108,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:27.101 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-15 04:52:27.109 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:52:27.110 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-15 04:52:27.210 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:27.211 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:27.213 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550347101479594,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:27.215 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:27.215 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19246/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:27.218 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550347101479594,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:27.220 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-15 04:52:27.228 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:52:27.228 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-15 04:52:27.329 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:27.329 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:27.332 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550347220495220,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:27.334 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:27.334 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19246/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:27.336 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550347220495220,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:27.338 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-15 04:52:27.346 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:52:27.347 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-15 04:52:27.447 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:27.448 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:27.450 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550347338557659,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:27.451 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:27.452 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19246/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:27.454 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550347338557659,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:27.456 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-15 04:52:27.464 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:52:27.464 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-15 04:52:27.564 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:27.568 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:27.573 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550347455951253,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:27.575 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:27.576 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19246/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:27.579 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550347455951253,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:27.581 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-15 04:52:27.590 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:52:27.590 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-15 04:52:27.690 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:27.691 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:27.694 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550347581222101,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:27.695 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:27.696 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19246/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:27.698 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550347581222101,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:27.700 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-15 04:52:27.710 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:52:27.710 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-15 04:52:27.811 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:27.811 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:27.814 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550347700153503,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:27.815 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:27.815 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19246/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:27.817 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550347700153503,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:27.819 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-15 04:52:27.827 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:52:27.828 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-15 04:52:27.929 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:27.929 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:27.933 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550347819194458,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:27.935 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:27.935 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19246/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:27.939 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550347819194458,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:27.941 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:17638/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2"]'
2026-03-15 04:52:27.957 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:52:27.957 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:19246/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2"]'
2026-03-15 04:52:27.973 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:52:27.973 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-15 04:52:27.975 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/0'
2026-03-15 04:52:27.977 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-15 04:52:27.979 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/1'
2026-03-15 04:52:27.981 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-15 04:52:27.983 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/2'
2026-03-15 04:52:27.985 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-15 04:52:27.992 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:52:27.992 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-15 04:52:28.093 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:28.093 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:28.095 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550347984935349,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:28.097 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:28.097 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19246/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:28.099 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550347984935349,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:28.101 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-15 04:52:28.109 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:52:28.109 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-15 04:52:28.210 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:28.210 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:28.213 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550348101180377,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:28.215 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:28.215 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19246/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:28.217 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550348101180377,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:28.219 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-15 04:52:28.226 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:52:28.227 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-15 04:52:28.328 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:28.328 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:28.331 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550348219263288,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:28.333 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:28.333 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19246/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:28.336 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550348219263288,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:28.337 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-15 04:52:28.345 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:52:28.345 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-15 04:52:28.445 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:28.446 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:28.448 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550348337593884,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:28.449 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:28.450 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19246/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:28.452 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550348337593884,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:28.454 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-15 04:52:28.462 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:52:28.463 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-15 04:52:28.564 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:28.565 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17638/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:28.573 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550348454019557,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:28.576 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-15 04:52:28.576 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19246/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:52:28.583 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773550348454019557,"ephemeral":false,"proof":""}]'
2026-03-15 04:52:28.586 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-15 04:52:28.587 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-15 04:52:28.587 DEBUG [src.node.waku_node] Stopping container with id 77f8cc3eb5a3
2026-03-15 04:52:29.081 DEBUG [src.node.waku_node] Container stopped.
2026-03-15 04:52:29.081 DEBUG [src.node.waku_node] Stopping container with id cfc6948130b0
2026-03-15 04:52:29.570 DEBUG [src.node.waku_node] Container stopped.
2026-03-15 04:52:29.571 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-15 04:52:29.613 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-15 04:52:29.661 DEBUG [src.node.docker_mananger] No errors found in the waku logs.