2025-12-11 04:15:44.159 DEBUG [tests.conftest] Running fixture setup: test_id
2025-12-11 04:15:44.160 DEBUG [tests.conftest] Running test: test_single_pubsub_topic[/waku/2/rs/2/0] with id: 2025-12-11_04-15-44__f1bd1376-70a7-419f-a806-4e536c3033f4
2025-12-11 04:15:44.160 DEBUG [src.steps.common] Running fixture setup: common_setup
2025-12-11 04:15:44.160 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2025-12-11 04:15:44.160 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2025-12-11 04:15:44.167 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-11 04:15:44.167 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2025-12-11_04-15-44__f1bd1376-70a7-419f-a806-4e536c3033f4__wakuorg_nwaku:latest.log
2025-12-11 04:15:44.167 DEBUG [src.node.waku_node] Starting Node...
2025-12-11 04:15:44.167 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-11 04:15:44.168 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-11 04:15:44.169 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.174.159
2025-12-11 04:15:44.169 DEBUG [src.node.docker_mananger] Generated ports ['41673', '41674', '41675', '41676', '41677']
2025-12-11 04:15:44.169 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2025-12-11 04:15:44.169 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2025-12-11 04:15:44.169 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-11 04:15:44.169 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-11 04:15:44.169 DEBUG [src.node.waku_node] Using volumes []
2025-12-11 04:15:44.169 DEBUG [src.node.docker_mananger] docker run -i -t -p 41673:41673 -p 41674:41674 -p 41675:41675 -p 41676:41676 -p 41677:41677 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=41675 --rest-port=41673 --tcp-port=41674 --discv5-udp-port=41676 --rest-address=0.0.0.0 --nat=extip:172.18.174.159 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=ebdec3df54dfbb386eec1bcef97689ccd69dde11e6bd60dacdde1dcd9e1db269 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=41677 --metrics-logging=true --relay=true --filter=true
2025-12-11 04:15:44.318 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.174.159 waku a2573524bf21b0987a7dec79da6e90c81cf84b9212a9a4a7ddbd99d0e2619f24
2025-12-11 04:15:44.345 DEBUG [src.node.docker_mananger] Container started with ID a2573524bf21. Setting up logs at ./log/docker/node1_2025-12-11_04-15-44__f1bd1376-70a7-419f-a806-4e536c3033f4__wakuorg_nwaku:latest.log
2025-12-11 04:15:44.346 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 41673
2025-12-11 04:15:44.346 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-11 04:15:44.463 ERROR [src.node.docker_mananger] Max retries reached for container 5740b329fdc4. Exiting log stream.
2025-12-11 04:15:44.959 ERROR [src.node.docker_mananger] Max retries reached for container f74aa1e00fd2. Exiting log stream.
2025-12-11 04:15:45.346 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41673/health" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:15:45.349 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-11 04:15:45.349 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-11 04:15:45.350 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41673/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:15:45.352 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.174.159/tcp/41674/p2p/16Uiu2HAmCSr8opV12fDDp8MSQXyMjk41Y17j6NnsKuLGTMsvzoAG","/ip4/172.18.174.159/tcp/41675/ws/p2p/16Uiu2HAmCSr8opV12fDDp8MSQXyMjk41Y17j6NnsKuLGTMsvzoAG"],"enrUri":"enr:-L24QPRT3_-dzT9bRwHmSicaj-_mixS4t7X_SMSWpmY2rrSATWrgrbHjNzEGSvpuV105VndKI727RZy5WrLTmGdhQHICgmlkgnY0gmlwhKwSrp-KbXVsdGlhZGRyc5YACASsEq6fBqLKAAoErBKunwaiy90DgnJzhQACAQAAiXNlY3AyNTZrMaEC_OO9x8_w1bc452MEkz-1mMaR1qOCph2J49U6eJ8jSgmDdGNwgqLKg3VkcIKizIV3YWt1MgU"}'
2025-12-11 04:15:45.352 INFO [src.node.waku_node] REST service is ready !!
2025-12-11 04:15:45.358 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-11 04:15:45.358 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2025-12-11_04-15-44__f1bd1376-70a7-419f-a806-4e536c3033f4__wakuorg_nwaku:latest.log
2025-12-11 04:15:45.359 DEBUG [src.node.waku_node] Starting Node...
2025-12-11 04:15:45.359 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-11 04:15:45.360 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-11 04:15:45.360 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.93.117
2025-12-11 04:15:45.360 DEBUG [src.node.docker_mananger] Generated ports ['24180', '24181', '24182', '24183', '24184']
2025-12-11 04:15:45.360 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2025-12-11 04:15:45.360 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2025-12-11 04:15:45.360 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-11 04:15:45.360 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-11 04:15:45.360 DEBUG [src.node.waku_node] Using volumes []
2025-12-11 04:15:45.361 DEBUG [src.node.docker_mananger] docker run -i -t -p 24180:24180 -p 24181:24181 -p 24182:24182 -p 24183:24183 -p 24184:24184 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24182 --rest-port=24180 --tcp-port=24181 --discv5-udp-port=24183 --rest-address=0.0.0.0 --nat=extip:172.18.93.117 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=b42adbedad5f758ff5d8980d0285213bd47c6f29100ca47c1f16b504e8d8a06e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24184 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QPRT3_-dzT9bRwHmSicaj-_mixS4t7X_SMSWpmY2rrSATWrgrbHjNzEGSvpuV105VndKI727RZy5WrLTmGdhQHICgmlkgnY0gmlwhKwSrp-KbXVsdGlhZGRyc5YACASsEq6fBqLKAAoErBKunwaiy90DgnJzhQACAQAAiXNlY3AyNTZrMaEC_OO9x8_w1bc452MEkz-1mMaR1qOCph2J49U6eJ8jSgmDdGNwgqLKg3VkcIKizIV3YWt1MgU
2025-12-11 04:15:45.516 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.93.117 waku 5bae3666f945449976db0db1e2f96d0521e4fe5cb7dde879a827d584151009ad
2025-12-11 04:15:45.541 DEBUG [src.node.docker_mananger] Container started with ID 5bae3666f945. Setting up logs at ./log/docker/node2_2025-12-11_04-15-44__f1bd1376-70a7-419f-a806-4e536c3033f4__wakuorg_nwaku:latest.log
2025-12-11 04:15:45.542 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 24180
2025-12-11 04:15:45.542 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-11 04:15:46.542 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24180/health" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:15:46.553 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2025-12-11 04:15:46.554 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-11 04:15:46.554 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24180/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:15:46.559 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.93.117/tcp/24181/p2p/16Uiu2HAm6KH9X4tHyj2mGhP1hxDzU68SUDgBAoNnPyxBKE7QyWQt","/ip4/172.18.93.117/tcp/24182/ws/p2p/16Uiu2HAm6KH9X4tHyj2mGhP1hxDzU68SUDgBAoNnPyxBKE7QyWQt"],"enrUri":"enr:-L24QLTKYcz572qb-A_WQyOe0fwspUWGzK6Sv06E_7ZxSPFVenTk4vfNKndQ0HEU2mZVRELNf0sv6K_4_Zyhr0vSdAoCgmlkgnY0gmlwhKwSXXWKbXVsdGlhZGRyc5YACASsEl11Bl51AAoErBJddQZedt0DgnJzhQACAQAAiXNlY3AyNTZrMaECoc1BN4zSDkXmZvGCqJWZBgzyT0pS8mN-y9wYkNRCt62DdGNwgl51g3VkcIJed4V3YWt1MgE"}'
2025-12-11 04:15:46.563 INFO [src.node.waku_node] REST service is ready !!
2025-12-11 04:15:46.564 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24180/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.174.159/tcp/41674/p2p/16Uiu2HAmCSr8opV12fDDp8MSQXyMjk41Y17j6NnsKuLGTMsvzoAG"]'
2025-12-11 04:15:46.567 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:15:46.567 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41673/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2025-12-11 04:15:46.569 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:15:46.570 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24180/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2025-12-11 04:15:46.572 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:15:46.572 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41673/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-11 04:15:46.576 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-11 04:15:46.577 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2025-12-11 04:15:46.677 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2025-12-11 04:15:46.678 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41673/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:15:46.680 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1765426546572813484,"ephemeral":false,"proof":""}]'
2025-12-11 04:15:46.682 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2025-12-11 04:15:46.682 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24180/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2025-12-11 04:15:46.684 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1765426546572813484,"ephemeral":false,"proof":""}]'
2025-12-11 04:15:46.686 DEBUG [tests.conftest] Running fixture teardown: test_setup
2025-12-11 04:15:46.687 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2025-12-11 04:15:46.687 DEBUG [src.node.waku_node] Stopping container with id a2573524bf21
2025-12-11 04:15:47.155 DEBUG [src.node.waku_node] Container stopped.
2025-12-11 04:15:47.157 DEBUG [src.node.waku_node] Stopping container with id 5bae3666f945
2025-12-11 04:15:47.651 DEBUG [src.node.waku_node] Container stopped.
2025-12-11 04:15:47.653 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2025-12-11 04:15:47.658 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-11 04:15:47.662 DEBUG [src.node.docker_mananger] No errors found in the waku logs.