2026-01-02 04:26:38.375 DEBUG [tests.conftest] Running fixture setup: test_id
2026-01-02 04:26:38.375 DEBUG [tests.conftest] Running test: test_single_content_topic[/waku/2/content/test.js] with id: 2026-01-02_04-26-38__701e881c-e4fb-4ddc-943d-db364d623e3b
2026-01-02 04:26:38.375 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-01-02 04:26:38.376 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-01-02 04:26:38.376 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-01-02 04:26:38.383 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-02 04:26:38.383 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-01-02_04-26-38__701e881c-e4fb-4ddc-943d-db364d623e3b__wakuorg_nwaku:latest.log
2026-01-02 04:26:38.383 DEBUG [src.node.waku_node] Starting Node...
2026-01-02 04:26:38.383 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-02 04:26:38.385 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-02 04:26:38.385 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.73.60
2026-01-02 04:26:38.385 DEBUG [src.node.docker_mananger] Generated ports ['60733', '60734', '60735', '60736', '60737']
2026-01-02 04:26:38.385 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-02 04:26:38.385 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-02 04:26:38.385 DEBUG [src.node.waku_node] Using volumes []
2026-01-02 04:26:38.385 DEBUG [src.node.docker_mananger] docker run -i -t -p 60733:60733 -p 60734:60734 -p 60735:60735 -p 60736:60736 -p 60737:60737 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=60735 --rest-port=60733 --tcp-port=60734 --discv5-udp-port=60736 --rest-address=0.0.0.0 --nat=extip:172.18.73.60 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=b1cde0ccb6e3b689f7673834b5466d94eadaef0130bee223ebae6dbef3cc9c15 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=60737 --metrics-logging=true --relay=true --filter=true --content-topic=/waku/2/content/test.js
2026-01-02 04:26:38.566 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.73.60 waku bb1d9baefc6cb67333f423791c02da466acc3ebdee84ddde4c4587b7373b3eef
2026-01-02 04:26:38.598 DEBUG [src.node.docker_mananger] Container started with ID bb1d9baefc6c. Setting up logs at ./log/docker/node1_2026-01-02_04-26-38__701e881c-e4fb-4ddc-943d-db364d623e3b__wakuorg_nwaku:latest.log
2026-01-02 04:26:38.598 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 60733
2026-01-02 04:26:38.598 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-02 04:26:38.641 ERROR [src.node.docker_mananger] Max retries reached for container 56d2fd245217. Exiting log stream.
2026-01-02 04:26:39.165 ERROR [src.node.docker_mananger] Max retries reached for container 73eebe06b140. Exiting log stream.
2026-01-02 04:26:39.599 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60733/health" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:26:39.601 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-01-02 04:26:39.602 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-02 04:26:39.602 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60733/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:26:39.604 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.73.60/tcp/60734/p2p/16Uiu2HAm4KM5p4e6sUpCz4333bFQCWpL1EWf1HAPbQTbK5iJyR9d","/ip4/172.18.73.60/tcp/60735/ws/p2p/16Uiu2HAm4KM5p4e6sUpCz4333bFQCWpL1EWf1HAPbQTbK5iJyR9d"],"enrUri":"enr:-L24QPuzmo4pqWCYEmpeXbGdToO_yzOCyQsx3r21i6RlpuUkezlpAPRTpF-mrzNXzsytd8g-ffkK5wjf1Y_FhiSsJCACgmlkgnY0gmlwhKwSSTyKbXVsdGlhZGRyc5YACASsEkk8Bu0-AAoErBJJPAbtP90DgnJzhQACAQAAiXNlY3AyNTZrMaEChBpU2dFR5eK8yDMjRPl7zP1nHBvsdTaeU54wY6XycsSDdGNwgu0-g3VkcILtQIV3YWt1MgU"}'
2026-01-02 04:26:39.604 INFO [src.node.waku_node] REST service is ready !!
2026-01-02 04:26:39.610 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-02 04:26:39.610 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-01-02_04-26-38__701e881c-e4fb-4ddc-943d-db364d623e3b__wakuorg_nwaku:latest.log
2026-01-02 04:26:39.611 DEBUG [src.node.waku_node] Starting Node...
2026-01-02 04:26:39.611 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-02 04:26:39.612 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-02 04:26:39.612 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.138.199
2026-01-02 04:26:39.612 DEBUG [src.node.docker_mananger] Generated ports ['36883', '36884', '36885', '36886', '36887']
2026-01-02 04:26:39.612 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-02 04:26:39.613 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-02 04:26:39.613 DEBUG [src.node.waku_node] Using volumes []
2026-01-02 04:26:39.613 DEBUG [src.node.docker_mananger] docker run -i -t -p 36883:36883 -p 36884:36884 -p 36885:36885 -p 36886:36886 -p 36887:36887 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=36885 --rest-port=36883 --tcp-port=36884 --discv5-udp-port=36886 --rest-address=0.0.0.0 --nat=extip:172.18.138.199 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=b6024ffa79fdda6eebe63bc9ba6bedc407e35feecf3b6b0f97c3cfc1ebfc431a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=36887 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QPuzmo4pqWCYEmpeXbGdToO_yzOCyQsx3r21i6RlpuUkezlpAPRTpF-mrzNXzsytd8g-ffkK5wjf1Y_FhiSsJCACgmlkgnY0gmlwhKwSSTyKbXVsdGlhZGRyc5YACASsEkk8Bu0-AAoErBJJPAbtP90DgnJzhQACAQAAiXNlY3AyNTZrMaEChBpU2dFR5eK8yDMjRPl7zP1nHBvsdTaeU54wY6XycsSDdGNwgu0-g3VkcILtQIV3YWt1MgU --content-topic=/waku/2/content/test.js
2026-01-02 04:26:39.802 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.138.199 waku ba72cfc0dfb4ae3aa2f1b2f67daff9dd6f3f97f2264f5fd7907b0a7c968f91f4
2026-01-02 04:26:39.829 DEBUG [src.node.docker_mananger] Container started with ID ba72cfc0dfb4. Setting up logs at ./log/docker/node2_2026-01-02_04-26-38__701e881c-e4fb-4ddc-943d-db364d623e3b__wakuorg_nwaku:latest.log
2026-01-02 04:26:39.829 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 36883
2026-01-02 04:26:39.830 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-02 04:26:40.831 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36883/health" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:26:40.847 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-01-02 04:26:40.848 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-02 04:26:40.848 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36883/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:26:40.857 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.138.199/tcp/36884/p2p/16Uiu2HAkyvwz3XPH2oqLH3vW88xyTJbgVXn5nPrRjD4uRQZThvpi","/ip4/172.18.138.199/tcp/36885/ws/p2p/16Uiu2HAkyvwz3XPH2oqLH3vW88xyTJbgVXn5nPrRjD4uRQZThvpi"],"enrUri":"enr:-L24QAFLpqHBwxMZfFe-xo1L1E5XIVDA-YAJ5ERswN-vkuecEbezb0BjIqelwvH6XGdzT_0a9BCIOYJZIjXxWLEc9wECgmlkgnY0gmlwhKwSiseKbXVsdGlhZGRyc5YACASsEorHBpAUAAoErBKKxwaQFd0DgnJzhQACAQAAiXNlY3AyNTZrMaECQu6v8-6blMaEJqfs0CUt0g0gQSOOiakgoaAh0qOHDuODdGNwgpAUg3VkcIKQFoV3YWt1MgE"}'
2026-01-02 04:26:40.857 INFO [src.node.waku_node] REST service is ready !!
2026-01-02 04:26:40.857 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36883/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.73.60/tcp/60734/p2p/16Uiu2HAm4KM5p4e6sUpCz4333bFQCWpL1EWf1HAPbQTbK5iJyR9d"]'
2026-01-02 04:26:40.860 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:26:40.860 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60733/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/content/test.js"]'
2026-01-02 04:26:40.863 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:26:40.863 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36883/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/content/test.js"]'
2026-01-02 04:26:40.865 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:26:40.866 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60733/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/waku/2/content/test.js", "timestamp": '$(date +%s%N)'}'
2026-01-02 04:26:40.871 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-02 04:26:40.871 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-01-02 04:26:40.971 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-01-02 04:26:40.972 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60733/relay/v1/auto/messages/%2Fwaku%2F2%2Fcontent%2Ftest.js" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:26:40.974 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/waku/2/content/test.js","version":0,"timestamp":1767328000866566202,"ephemeral":false,"proof":""}]'
2026-01-02 04:26:40.976 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-01-02 04:26:40.976 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36883/relay/v1/auto/messages/%2Fwaku%2F2%2Fcontent%2Ftest.js" -H "Content-Type: application/json" -d 'None'
2026-01-02 04:26:40.978 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/waku/2/content/test.js","version":0,"timestamp":1767328000866566202,"ephemeral":false,"proof":""}]'
2026-01-02 04:26:40.981 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-01-02 04:26:40.982 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-01-02 04:26:40.982 DEBUG [src.node.waku_node] Stopping container with id bb1d9baefc6c
2026-01-02 04:26:41.522 DEBUG [src.node.waku_node] Container stopped.
2026-01-02 04:26:41.523 DEBUG [src.node.waku_node] Stopping container with id ba72cfc0dfb4
2026-01-02 04:26:42.025 DEBUG [src.node.waku_node] Container stopped.
2026-01-02 04:26:42.026 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-01-02 04:26:42.033 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-02 04:26:42.038 DEBUG [src.node.docker_mananger] No errors found in the waku logs.