187 lines
34 KiB
Plaintext

2026-01-30 04:33:49.678 DEBUG [tests.conftest] Running fixture setup: test_id
2026-01-30 04:33:49.679 DEBUG [tests.conftest] Running test: test_unsubscribe_from_all_pubsub_topics_one_by_one with id: 2026-01-30_04-33-49__eb22964b-72aa-4d2f-9dc8-fe14958584dd
2026-01-30 04:33:49.679 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-01-30 04:33:49.679 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-01-30 04:33:49.680 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-01-30 04:33:49.687 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-30 04:33:49.687 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-01-30_04-33-49__eb22964b-72aa-4d2f-9dc8-fe14958584dd__wakuorg_nwaku:latest.log
2026-01-30 04:33:49.687 DEBUG [src.node.waku_node] Starting Node...
2026-01-30 04:33:49.688 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-30 04:33:49.689 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-30 04:33:49.689 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.100.174
2026-01-30 04:33:49.689 DEBUG [src.node.docker_mananger] Generated ports ['59048', '59049', '59050', '59051', '59052']
2026-01-30 04:33:49.689 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-01-30 04:33:49.690 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-30 04:33:49.690 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-30 04:33:49.690 DEBUG [src.node.waku_node] Using volumes []
2026-01-30 04:33:49.690 DEBUG [src.node.docker_mananger] docker run -i -t -p 59048:59048 -p 59049:59049 -p 59050:59050 -p 59051:59051 -p 59052:59052 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=59050 --rest-port=59048 --tcp-port=59049 --discv5-udp-port=59051 --rest-address=0.0.0.0 --nat=extip:172.18.100.174 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=0bb2e3e838a26c1cdf7c48b5643efc66c6ba67b5f1b85a3bed5eddc6c358b04f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=59052 --metrics-logging=true --relay=true --filter=true
2026-01-30 04:33:49.866 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.100.174 waku 6c767187f80ea7adcb04e656bc1e4b3dbd01f7fe2a23f0d48cd1b678daac28b4
2026-01-30 04:33:49.900 DEBUG [src.node.docker_mananger] Container started with ID 6c767187f80e. Setting up logs at ./log/docker/node1_2026-01-30_04-33-49__eb22964b-72aa-4d2f-9dc8-fe14958584dd__wakuorg_nwaku:latest.log
2026-01-30 04:33:49.900 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 59048
2026-01-30 04:33:49.901 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-30 04:33:49.918 ERROR [src.node.docker_mananger] Max retries reached for container 934af47e58d2. Exiting log stream.
2026-01-30 04:33:50.487 ERROR [src.node.docker_mananger] Max retries reached for container 356570ab7413. Exiting log stream.
2026-01-30 04:33:50.902 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59048/health" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:50.905 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-01-30 04:33:50.905 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-30 04:33:50.906 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59048/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:50.908 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.100.174/tcp/59049/p2p/16Uiu2HAmS4zBHvckhKXWacGGPNjVPsk26mqwFLNbNBP6GpPyUFcn","/ip4/172.18.100.174/tcp/59050/ws/p2p/16Uiu2HAmS4zBHvckhKXWacGGPNjVPsk26mqwFLNbNBP6GpPyUFcn"],"enrUri":"enr:-L24QLp4UmPdr0FnofFzMRfWvgqMuzTAwztb83unowEiT4EwFIap7NVn3L7rcMEmTu5oRQITrTApzh7l3iLZXq9p5JgCgmlkgnY0gmlwhKwSZK6KbXVsdGlhZGRyc5YACASsEmSuBuapAAoErBJkrgbmqt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDx02ssElHfYhDeVU_qrPaNU7UdwuSwB4ZTxD_eEOM7cuDdGNwguapg3VkcILmq4V3YWt1MgU"}'
2026-01-30 04:33:50.908 INFO [src.node.waku_node] REST service is ready !!
2026-01-30 04:33:50.915 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-30 04:33:50.915 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-01-30_04-33-49__eb22964b-72aa-4d2f-9dc8-fe14958584dd__wakuorg_nwaku:latest.log
2026-01-30 04:33:50.915 DEBUG [src.node.waku_node] Starting Node...
2026-01-30 04:33:50.915 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-30 04:33:50.916 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-30 04:33:50.917 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.8.163
2026-01-30 04:33:50.917 DEBUG [src.node.docker_mananger] Generated ports ['3507', '3508', '3509', '3510', '3511']
2026-01-30 04:33:50.917 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-01-30 04:33:50.917 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-30 04:33:50.917 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-30 04:33:50.917 DEBUG [src.node.waku_node] Using volumes []
2026-01-30 04:33:50.917 DEBUG [src.node.docker_mananger] docker run -i -t -p 3507:3507 -p 3508:3508 -p 3509:3509 -p 3510:3510 -p 3511:3511 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3509 --rest-port=3507 --tcp-port=3508 --discv5-udp-port=3510 --rest-address=0.0.0.0 --nat=extip:172.18.8.163 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=c0abe3d5b3579efacdf6baf9b4c6ef3add4ca22b62a5f93e4a7c2c12bfd3b87b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3511 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QLp4UmPdr0FnofFzMRfWvgqMuzTAwztb83unowEiT4EwFIap7NVn3L7rcMEmTu5oRQITrTApzh7l3iLZXq9p5JgCgmlkgnY0gmlwhKwSZK6KbXVsdGlhZGRyc5YACASsEmSuBuapAAoErBJkrgbmqt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDx02ssElHfYhDeVU_qrPaNU7UdwuSwB4ZTxD_eEOM7cuDdGNwguapg3VkcILmq4V3YWt1MgU
2026-01-30 04:33:51.102 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.8.163 waku 7d35ad9425dd872aebc84708b9a0953b8a43735f73a454173b72320a980e9b78
2026-01-30 04:33:51.131 DEBUG [src.node.docker_mananger] Container started with ID 7d35ad9425dd. Setting up logs at ./log/docker/node2_2026-01-30_04-33-49__eb22964b-72aa-4d2f-9dc8-fe14958584dd__wakuorg_nwaku:latest.log
2026-01-30 04:33:51.132 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 3507
2026-01-30 04:33:51.132 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-30 04:33:52.132 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3507/health" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:52.151 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-01-30 04:33:52.151 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-30 04:33:52.152 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3507/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:52.158 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.8.163/tcp/3508/p2p/16Uiu2HAmNzcnmurJyeDTrJm1YVr3q9QWubDoU9TRsPLf5Q46Z9ff","/ip4/172.18.8.163/tcp/3509/ws/p2p/16Uiu2HAmNzcnmurJyeDTrJm1YVr3q9QWubDoU9TRsPLf5Q46Z9ff"],"enrUri":"enr:-L24QMKPGMWjh-IMf1PTYj96rKDEEr0-lIMc78aF57v4afi9cV-tZ4gyPSIy-AlMJEaotte3LlkbXGWdq4s06WqeGKQCgmlkgnY0gmlwhKwSCKOKbXVsdGlhZGRyc5YACASsEgijBg20AAoErBIIowYNtd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDmZwbVyHMzpEu7U6QfgpaqdYqmY4mkPMdYCSrKZny7tKDdGNwgg20g3VkcIINtoV3YWt1MgE"}'
2026-01-30 04:33:52.158 INFO [src.node.waku_node] REST service is ready !!
2026-01-30 04:33:52.159 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3507/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.100.174/tcp/59049/p2p/16Uiu2HAmS4zBHvckhKXWacGGPNjVPsk26mqwFLNbNBP6GpPyUFcn"]'
2026-01-30 04:33:52.162 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:52.162 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59048/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-01-30 04:33:52.170 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:52.171 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3507/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-01-30 04:33:52.186 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:52.188 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-30 04:33:52.201 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:52.201 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-01-30 04:33:52.301 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-01-30 04:33:52.302 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:52.304 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769747632188015917,"ephemeral":false,"proof":""}]'
2026-01-30 04:33:52.306 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-01-30 04:33:52.306 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3507/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:52.309 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769747632188015917,"ephemeral":false,"proof":""}]'
2026-01-30 04:33:52.310 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-30 04:33:52.315 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:52.315 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-01-30 04:33:52.415 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-01-30 04:33:52.416 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:52.418 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769747632310793597,"ephemeral":false,"proof":""}]'
2026-01-30 04:33:52.420 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-01-30 04:33:52.420 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3507/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:52.422 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769747632310793597,"ephemeral":false,"proof":""}]'
2026-01-30 04:33:52.424 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-30 04:33:52.429 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:52.429 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-01-30 04:33:52.530 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-01-30 04:33:52.530 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:52.533 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769747632424688611,"ephemeral":false,"proof":""}]'
2026-01-30 04:33:52.534 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-01-30 04:33:52.535 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3507/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:52.537 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769747632424688611,"ephemeral":false,"proof":""}]'
2026-01-30 04:33:52.538 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-30 04:33:52.542 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:52.543 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-01-30 04:33:52.643 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-01-30 04:33:52.644 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:52.646 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769747632538690923,"ephemeral":false,"proof":""}]'
2026-01-30 04:33:52.648 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-01-30 04:33:52.648 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3507/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:52.650 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769747632538690923,"ephemeral":false,"proof":""}]'
2026-01-30 04:33:52.652 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-30 04:33:52.656 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:52.656 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-01-30 04:33:52.757 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-01-30 04:33:52.757 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:52.760 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769747632652099900,"ephemeral":false,"proof":""}]'
2026-01-30 04:33:52.761 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-01-30 04:33:52.762 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3507/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:52.764 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769747632652099900,"ephemeral":false,"proof":""}]'
2026-01-30 04:33:52.765 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-30 04:33:52.769 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:52.770 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-01-30 04:33:52.870 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-01-30 04:33:52.871 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:52.873 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769747632765627738,"ephemeral":false,"proof":""}]'
2026-01-30 04:33:52.875 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-01-30 04:33:52.877 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3507/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:52.879 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769747632765627738,"ephemeral":false,"proof":""}]'
2026-01-30 04:33:52.881 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-30 04:33:52.886 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:52.887 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-01-30 04:33:52.987 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-01-30 04:33:52.987 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:52.990 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769747632881605405,"ephemeral":false,"proof":""}]'
2026-01-30 04:33:52.992 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-01-30 04:33:52.992 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3507/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:52.994 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769747632881605405,"ephemeral":false,"proof":""}]'
2026-01-30 04:33:52.996 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-30 04:33:53.002 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:53.002 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-01-30 04:33:53.103 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-01-30 04:33:53.103 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:53.106 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769747632996408218,"ephemeral":false,"proof":""}]'
2026-01-30 04:33:53.107 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-01-30 04:33:53.107 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3507/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d 'None'
2026-01-30 04:33:53.110 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769747632996408218,"ephemeral":false,"proof":""}]'
2026-01-30 04:33:53.112 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:59048/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-01-30 04:33:53.117 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:53.118 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:3507/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-01-30 04:33:53.123 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:53.124 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:59048/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/1"]'
2026-01-30 04:33:53.127 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:53.128 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:3507/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/1"]'
2026-01-30 04:33:53.132 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:53.132 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:59048/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/2"]'
2026-01-30 04:33:53.136 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:53.137 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:3507/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/2"]'
2026-01-30 04:33:53.140 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:53.141 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:59048/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/3"]'
2026-01-30 04:33:53.145 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:53.145 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:3507/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/3"]'
2026-01-30 04:33:53.149 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:53.150 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:59048/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/4"]'
2026-01-30 04:33:53.155 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:53.155 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:3507/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/4"]'
2026-01-30 04:33:53.159 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:53.160 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:59048/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/5"]'
2026-01-30 04:33:53.165 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:53.165 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:3507/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/5"]'
2026-01-30 04:33:53.169 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:53.169 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:59048/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/6"]'
2026-01-30 04:33:53.174 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:53.174 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:3507/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/6"]'
2026-01-30 04:33:53.178 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:53.179 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:59048/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/7"]'
2026-01-30 04:33:53.183 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:53.184 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:3507/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/7"]'
2026-01-30 04:33:53.188 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-30 04:33:53.189 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-30 04:33:53.192 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/0'
2026-01-30 04:33:53.193 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-30 04:33:53.195 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/1'
2026-01-30 04:33:53.197 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-30 04:33:53.199 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/2'
2026-01-30 04:33:53.200 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-30 04:33:53.203 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/3'
2026-01-30 04:33:53.204 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-30 04:33:53.206 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/4'
2026-01-30 04:33:53.208 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-30 04:33:53.210 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/5'
2026-01-30 04:33:53.211 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-30 04:33:53.213 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/6'
2026-01-30 04:33:53.214 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-30 04:33:53.217 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:59048/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/7'
2026-01-30 04:33:53.219 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-01-30 04:33:53.220 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-01-30 04:33:53.220 DEBUG [src.node.waku_node] Stopping container with id 6c767187f80e
2026-01-30 04:33:53.756 DEBUG [src.node.waku_node] Container stopped.
2026-01-30 04:33:53.756 DEBUG [src.node.waku_node] Stopping container with id 7d35ad9425dd
2026-01-30 04:33:54.277 DEBUG [src.node.waku_node] Container stopped.
2026-01-30 04:33:54.278 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-01-30 04:33:54.291 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-30 04:33:54.304 DEBUG [src.node.docker_mananger] No errors found in the waku logs.