2025-12-14 04:26:06.990 DEBUG [tests.conftest] Running fixture setup: test_id
2025-12-14 04:26:06.990 DEBUG [tests.conftest] Running test: test_single_pubsub_topic[/waku/2/rs/999/999] with id: 2025-12-14_04-26-06__1a453e82-b9b4-4d86-b99d-eb6e087c9e23
2025-12-14 04:26:06.990 DEBUG [src.steps.common] Running fixture setup: common_setup
2025-12-14 04:26:06.990 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2025-12-14 04:26:06.991 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2025-12-14 04:26:06.999 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-14 04:26:06.999 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2025-12-14_04-26-06__1a453e82-b9b4-4d86-b99d-eb6e087c9e23__wakuorg_nwaku:latest.log
2025-12-14 04:26:06.999 DEBUG [src.node.waku_node] Starting Node...
2025-12-14 04:26:06.999 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-14 04:26:07.000 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-14 04:26:07.001 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.206.155
2025-12-14 04:26:07.001 DEBUG [src.node.docker_mananger] Generated ports ['22015', '22016', '22017', '22018', '22019']
2025-12-14 04:26:07.001 DEBUG [src.node.waku_node] Cluster id was resolved to: 999
2025-12-14 04:26:07.001 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2025-12-14 04:26:07.001 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-14 04:26:07.001 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-14 04:26:07.001 DEBUG [src.node.waku_node] Using volumes []
2025-12-14 04:26:07.001 DEBUG [src.node.docker_mananger] docker run -i -t -p 22015:22015 -p 22016:22016 -p 22017:22017 -p 22018:22018 -p 22019:22019 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=22017 --rest-port=22015 --tcp-port=22016 --discv5-udp-port=22018 --rest-address=0.0.0.0 --nat=extip:172.18.206.155 --peer-exchange=true --discv5-discovery=true --cluster-id=999 --nodekey=8caa54abb50e4e77ffbfe72d4ffd1ad90f5c778ae45eddab98d93bac9faeca28 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=22019 --metrics-logging=true --relay=true --filter=true
2025-12-14 04:26:07.190 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.206.155 waku bf0ee642d3dd85aa4403cb113020c4e5f23b9dd6f524badf471f140f8ef62c1c
2025-12-14 04:26:07.222 DEBUG [src.node.docker_mananger] Container started with ID bf0ee642d3dd. Setting up logs at ./log/docker/node1_2025-12-14_04-26-06__1a453e82-b9b4-4d86-b99d-eb6e087c9e23__wakuorg_nwaku:latest.log
2025-12-14 04:26:07.222 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 22015
2025-12-14 04:26:07.222 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-14 04:26:07.278 ERROR [src.node.docker_mananger] Max retries reached for container e9fe99623997. Exiting log stream.
2025-12-14 04:26:07.797 ERROR [src.node.docker_mananger] Max retries reached for container 9484685439b0. Exiting log stream.
2025-12-14 04:26:08.224 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22015/health" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:26:08.227 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-14 04:26:08.227 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-14 04:26:08.227 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22015/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:26:08.229 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.206.155/tcp/22016/p2p/16Uiu2HAmNKZwPcJ8u9WphB61Tyw8kNUq5dgHTToLH1WwFhR5uLEo","/ip4/172.18.206.155/tcp/22017/ws/p2p/16Uiu2HAmNKZwPcJ8u9WphB61Tyw8kNUq5dgHTToLH1WwFhR5uLEo"],"enrUri":"enr:-L24QKC3P3-hUCrZatgFYHzPe7FuxkojuKv-tVxK-HDWLJTWQehqdbH7ANnIAL4K0brhbUS4H-mAgeEVh5BRMlEqKXYCgmlkgnY0gmlwhKwSzpuKbXVsdGlhZGRyc5YACASsEs6bBlYAAAoErBLOmwZWAd0DgnJzhQPnAQAAiXNlY3AyNTZrMaEDj5s7KMr8erJ4tDOIqc4qBvTOFvyMM99ITcnmgGITjSyDdGNwglYAg3VkcIJWAoV3YWt1MgU"}'
2025-12-14 04:26:08.230 INFO [src.node.waku_node] REST service is ready !!
2025-12-14 04:26:08.236 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-14 04:26:08.236 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2025-12-14_04-26-06__1a453e82-b9b4-4d86-b99d-eb6e087c9e23__wakuorg_nwaku:latest.log
2025-12-14 04:26:08.237 DEBUG [src.node.waku_node] Starting Node...
2025-12-14 04:26:08.237 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-14 04:26:08.238 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-14 04:26:08.238 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.16.200
2025-12-14 04:26:08.238 DEBUG [src.node.docker_mananger] Generated ports ['35005', '35006', '35007', '35008', '35009']
2025-12-14 04:26:08.238 DEBUG [src.node.waku_node] Cluster id was resolved to: 999
2025-12-14 04:26:08.239 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2025-12-14 04:26:08.239 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-14 04:26:08.239 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-14 04:26:08.239 DEBUG [src.node.waku_node] Using volumes []
2025-12-14 04:26:08.239 DEBUG [src.node.docker_mananger] docker run -i -t -p 35005:35005 -p 35006:35006 -p 35007:35007 -p 35008:35008 -p 35009:35009 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=35007 --rest-port=35005 --tcp-port=35006 --discv5-udp-port=35008 --rest-address=0.0.0.0 --nat=extip:172.18.16.200 --peer-exchange=true --discv5-discovery=true --cluster-id=999 --nodekey=b758bd354c1c9b1b90ed78ccbe277ae57192a0f9ae166e04feca1c4a89aea16f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=35009 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKC3P3-hUCrZatgFYHzPe7FuxkojuKv-tVxK-HDWLJTWQehqdbH7ANnIAL4K0brhbUS4H-mAgeEVh5BRMlEqKXYCgmlkgnY0gmlwhKwSzpuKbXVsdGlhZGRyc5YACASsEs6bBlYAAAoErBLOmwZWAd0DgnJzhQPnAQAAiXNlY3AyNTZrMaEDj5s7KMr8erJ4tDOIqc4qBvTOFvyMM99ITcnmgGITjSyDdGNwglYAg3VkcIJWAoV3YWt1MgU
2025-12-14 04:26:08.413 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.16.200 waku c039c561eb25af6eeabc0285536baf3048c925ca8266f4574549a051fefcb37b
2025-12-14 04:26:08.445 DEBUG [src.node.docker_mananger] Container started with ID c039c561eb25. Setting up logs at ./log/docker/node2_2025-12-14_04-26-06__1a453e82-b9b4-4d86-b99d-eb6e087c9e23__wakuorg_nwaku:latest.log
2025-12-14 04:26:08.445 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 35005
2025-12-14 04:26:08.446 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-14 04:26:09.446 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35005/health" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:26:09.458 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2025-12-14 04:26:09.459 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-14 04:26:09.459 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35005/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:26:09.464 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.16.200/tcp/35006/p2p/16Uiu2HAm9d99GP5FibFTTYCKWCWpc8XQVo7TSgYZiKcuC9tYbao9","/ip4/172.18.16.200/tcp/35007/ws/p2p/16Uiu2HAm9d99GP5FibFTTYCKWCWpc8XQVo7TSgYZiKcuC9tYbao9"],"enrUri":"enr:-L24QC3vSGRGpNk1kp7l6gMTDah7I2mDFdhv-fidoVCfvAfGebqB-M03uQMQ0ef-KcDhA233ydnHGu-CSWO30R6uBHQCgmlkgnY0gmlwhKwSEMiKbXVsdGlhZGRyc5YACASsEhDIBoi-AAoErBIQyAaIv90DgnJzhQPnAQAAiXNlY3AyNTZrMaEC0vO4MzA627SIGTMyGaz0mAAUmMPG6kqtHAHYAROdELiDdGNwgoi-g3VkcIKIwIV3YWt1MgE"}'
2025-12-14 04:26:09.467 INFO [src.node.waku_node] REST service is ready !!
2025-12-14 04:26:09.467 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35005/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.206.155/tcp/22016/p2p/16Uiu2HAmNKZwPcJ8u9WphB61Tyw8kNUq5dgHTToLH1WwFhR5uLEo"]'
2025-12-14 04:26:09.472 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-14 04:26:09.472 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22015/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/999/999"]'
2025-12-14 04:26:09.476 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-14 04:26:09.476 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35005/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/999/999"]'
2025-12-14 04:26:09.480 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-14 04:26:09.481 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22015/relay/v1/messages/%2Fwaku%2F2%2Frs%2F999%2F999" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-14 04:26:09.487 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-14 04:26:09.487 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2025-12-14 04:26:09.588 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2025-12-14 04:26:09.588 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22015/relay/v1/messages/%2Fwaku%2F2%2Frs%2F999%2F999" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:26:09.591 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1765686369481279030,"ephemeral":false,"proof":""}]'
2025-12-14 04:26:09.593 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2025-12-14 04:26:09.593 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35005/relay/v1/messages/%2Fwaku%2F2%2Frs%2F999%2F999" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:26:09.595 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1765686369481279030,"ephemeral":false,"proof":""}]'
2025-12-14 04:26:09.598 DEBUG [tests.conftest] Running fixture teardown: test_setup
2025-12-14 04:26:09.599 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2025-12-14 04:26:09.599 DEBUG [src.node.waku_node] Stopping container with id bf0ee642d3dd
2025-12-14 04:26:10.131 DEBUG [src.node.waku_node] Container stopped.
2025-12-14 04:26:10.131 DEBUG [src.node.waku_node] Stopping container with id c039c561eb25
2025-12-14 04:26:10.626 DEBUG [src.node.waku_node] Container stopped.
2025-12-14 04:26:10.626 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2025-12-14 04:26:10.632 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-14 04:26:10.638 DEBUG [src.node.docker_mananger] No errors found in the waku logs.