271 lines
46 KiB
Plaintext

2026-03-05 04:36:06.277 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-05 04:36:06.277 DEBUG [tests.conftest] Running test: test_content_topic_not_in_docker_flags with id: 2026-03-05_04-36-06__46217032-33fc-416a-b23a-c22f3d968d11
2026-03-05 04:36:06.278 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-05 04:36:06.278 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-05 04:36:06.278 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-05 04:36:06.286 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:36:06.286 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-05_04-36-06__46217032-33fc-416a-b23a-c22f3d968d11__wakuorg_nwaku:latest.log
2026-03-05 04:36:06.287 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:36:06.287 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:36:06.288 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:36:06.288 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.197.147
2026-03-05 04:36:06.288 DEBUG [src.node.docker_mananger] Generated ports ['34884', '34885', '34886', '34887', '34888']
2026-03-05 04:36:06.289 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-05 04:36:06.289 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:36:06.289 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:36:06.289 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:36:06.289 DEBUG [src.node.docker_mananger] docker run -i -t -p 34884:34884 -p 34885:34885 -p 34886:34886 -p 34887:34887 -p 34888:34888 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=34886 --rest-port=34884 --tcp-port=34885 --discv5-udp-port=34887 --rest-address=0.0.0.0 --nat=extip:172.18.197.147 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=a5554aee4767ac95cd63beb9fdbbaaa9ef4e01ac9c9def8f8da3dd1e19ceeacb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=34888 --metrics-logging=true --relay=true --filter=true
2026-03-05 04:36:06.486 ERROR [src.node.docker_mananger] Max retries reached for container c240022a741a. Exiting log stream.
2026-03-05 04:36:06.492 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.197.147 waku f60f6bd5b72a91ff67436f8e1138d57a2e74a3629453c85343bd49e87e2fdddb
2026-03-05 04:36:06.528 DEBUG [src.node.docker_mananger] Container started with ID f60f6bd5b72a. Setting up logs at ./log/docker/node1_2026-03-05_04-36-06__46217032-33fc-416a-b23a-c22f3d968d11__wakuorg_nwaku:latest.log
2026-03-05 04:36:06.528 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 34884
2026-03-05 04:36:06.528 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:36:06.969 ERROR [src.node.docker_mananger] Max retries reached for container e496543449de. Exiting log stream.
2026-03-05 04:36:07.529 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34884/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:07.532 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:07.632 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34884/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:07.635 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:07.735 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34884/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:07.738 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:07.839 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34884/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:07.841 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:36:07.841 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:36:07.842 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34884/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:07.844 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.197.147/tcp/34885/p2p/16Uiu2HAmCp21p8dUCsyHCxr7aXUrNSpxNwMi4TNGbbf3bFHPcPDm","/ip4/172.18.197.147/tcp/34886/ws/p2p/16Uiu2HAmCp21p8dUCsyHCxr7aXUrNSpxNwMi4TNGbbf3bFHPcPDm"],"enrUri":"enr:-L24QIa8qVEYxATcWEUWVW-FSYPf4_vVFnYxhpUL4B52nrQEdzomoaOUVnqLrJNwkhroy9Og3BgKbk_ol0IG4_r7WpwCgmlkgnY0gmlwhKwSxZOKbXVsdGlhZGRyc5YACASsEsWTBohFAAoErBLFkwaIRt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDAlAb50XpDh4kW1XUYkF83um5pglsFtovtCR1SEs901SDdGNwgohFg3VkcIKIR4V3YWt1MgU"}'
2026-03-05 04:36:07.844 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:36:07.852 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:36:07.852 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-05_04-36-06__46217032-33fc-416a-b23a-c22f3d968d11__wakuorg_nwaku:latest.log
2026-03-05 04:36:07.852 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:36:07.852 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:36:07.854 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:36:07.856 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.227.152
2026-03-05 04:36:07.857 DEBUG [src.node.docker_mananger] Generated ports ['36953', '36954', '36955', '36956', '36957']
2026-03-05 04:36:07.857 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-05 04:36:07.857 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:36:07.857 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:36:07.858 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:36:07.858 DEBUG [src.node.docker_mananger] docker run -i -t -p 36953:36953 -p 36954:36954 -p 36955:36955 -p 36956:36956 -p 36957:36957 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=36955 --rest-port=36953 --tcp-port=36954 --discv5-udp-port=36956 --rest-address=0.0.0.0 --nat=extip:172.18.227.152 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=2bad4aeebcba1258fc7c3fa7b528b0d8fac36e2a5b6edadc2782aab5cf2dc0ae --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=36957 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QIa8qVEYxATcWEUWVW-FSYPf4_vVFnYxhpUL4B52nrQEdzomoaOUVnqLrJNwkhroy9Og3BgKbk_ol0IG4_r7WpwCgmlkgnY0gmlwhKwSxZOKbXVsdGlhZGRyc5YACASsEsWTBohFAAoErBLFkwaIRt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDAlAb50XpDh4kW1XUYkF83um5pglsFtovtCR1SEs901SDdGNwgohFg3VkcIKIR4V3YWt1MgU
2026-03-05 04:36:08.077 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.227.152 waku 45f86e019045c50f5b40723c3885cb7accfa570739df13df027ee929a177c829
2026-03-05 04:36:08.113 DEBUG [src.node.docker_mananger] Container started with ID 45f86e019045. Setting up logs at ./log/docker/node2_2026-03-05_04-36-06__46217032-33fc-416a-b23a-c22f3d968d11__wakuorg_nwaku:latest.log
2026-03-05 04:36:08.114 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 36953
2026-03-05 04:36:08.114 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:36:09.114 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36953/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:09.117 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:09.217 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36953/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:09.220 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:36:09.220 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:36:09.220 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36953/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:09.223 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.227.152/tcp/36954/p2p/16Uiu2HAmBhg1yvLya8Vbvkg4UoRojXedRH8ysK3VUUynUpjETVX9","/ip4/172.18.227.152/tcp/36955/ws/p2p/16Uiu2HAmBhg1yvLya8Vbvkg4UoRojXedRH8ysK3VUUynUpjETVX9"],"enrUri":"enr:-L24QLAFHjyft_Re-e5cSFfuhkyb63F3h3UYV_Cq7d83P-aiCk1d0Lt4XbEGnYKGB-mzj7EyA7mySfsAsO45aYyJkNsCgmlkgnY0gmlwhKwS45iKbXVsdGlhZGRyc5YACASsEuOYBpBaAAoErBLjmAaQW90DgnJzhQACAQAAiXNlY3AyNTZrMaEC8dRTkTsdIYxitRkJpTY_jF5ddxaWAFIOfHuEnxfedySDdGNwgpBag3VkcIKQXIV3YWt1MgE"}'
2026-03-05 04:36:09.223 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:36:09.223 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36953/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.197.147/tcp/34885/p2p/16Uiu2HAmCp21p8dUCsyHCxr7aXUrNSpxNwMi4TNGbbf3bFHPcPDm"]'
2026-03-05 04:36:09.252 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:09.254 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34884/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-05 04:36:09.262 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:09.263 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36953/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-05 04:36:09.267 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:09.268 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34884/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:36:09.280 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:09.280 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-05 04:36:09.380 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-05 04:36:09.381 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34884/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:09.383 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772685367877123724,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772685369268684269,"ephemeral":false,"proof":""}]'
2026-03-05 04:36:09.393 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-05 04:36:09.394 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-05 04:36:09.395 DEBUG [src.node.waku_node] Stopping container with id f60f6bd5b72a
2026-03-05 04:36:09.979 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:36:09.979 DEBUG [src.node.waku_node] Stopping container with id 45f86e019045
2026-03-05 04:36:10.607 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:36:10.610 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-05 04:36:10.648 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:36:10.679 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:36:10.679 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-05 04:36:10.680 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-05 04:36:10.680 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-05_04-36-06__46217032-33fc-416a-b23a-c22f3d968d11__wakuorg_nwaku:latest.log
2026-03-05 04:36:10.681 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-05_04-36-06__46217032-33fc-416a-b23a-c22f3d968d11__wakuorg_nwaku:latest.log
2026-03-05 04:36:10.685 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-05 04:36:10.685 DEBUG [tests.conftest] Running test: test_content_topic_not_in_docker_flags with id: 2026-03-05_04-36-10__4a302793-e07f-49b9-85ce-a18bc5ffe983
2026-03-05 04:36:10.686 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-05 04:36:10.686 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-05 04:36:10.686 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-05 04:36:10.694 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:36:10.694 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-05_04-36-10__4a302793-e07f-49b9-85ce-a18bc5ffe983__wakuorg_nwaku:latest.log
2026-03-05 04:36:10.694 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:36:10.694 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:36:10.696 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:36:10.696 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.51.233
2026-03-05 04:36:10.696 DEBUG [src.node.docker_mananger] Generated ports ['17866', '17867', '17868', '17869', '17870']
2026-03-05 04:36:10.696 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-05 04:36:10.696 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:36:10.696 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:36:10.697 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:36:10.697 DEBUG [src.node.docker_mananger] docker run -i -t -p 17866:17866 -p 17867:17867 -p 17868:17868 -p 17869:17869 -p 17870:17870 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17868 --rest-port=17866 --tcp-port=17867 --discv5-udp-port=17869 --rest-address=0.0.0.0 --nat=extip:172.18.51.233 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=ef840cf65f0d1cab91a69b5b3b70ab0f3bdcba98ccaeb1f37df22f41dfab6361 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17870 --metrics-logging=true --relay=true --filter=true
2026-03-05 04:36:10.797 ERROR [src.node.docker_mananger] Max retries reached for container f60f6bd5b72a. Exiting log stream.
2026-03-05 04:36:10.900 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.51.233 waku cd0e52b951e28cd668b2d5c9e1b08f969627db2905db7fa19c9190f72c640e25
2026-03-05 04:36:10.936 DEBUG [src.node.docker_mananger] Container started with ID cd0e52b951e2. Setting up logs at ./log/docker/node1_2026-03-05_04-36-10__4a302793-e07f-49b9-85ce-a18bc5ffe983__wakuorg_nwaku:latest.log
2026-03-05 04:36:10.937 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 17866
2026-03-05 04:36:10.938 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:36:11.458 ERROR [src.node.docker_mananger] Max retries reached for container 45f86e019045. Exiting log stream.
2026-03-05 04:36:11.939 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17866/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:11.942 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:12.042 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17866/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:12.045 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:12.145 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17866/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:12.148 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:12.248 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17866/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:12.251 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:36:12.251 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:36:12.251 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17866/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:12.254 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.51.233/tcp/17867/p2p/16Uiu2HAmVKcFKsn4cm48YNUFXkhuq9oPMCvNbjG1oFhRkLDjs7mu","/ip4/172.18.51.233/tcp/17868/ws/p2p/16Uiu2HAmVKcFKsn4cm48YNUFXkhuq9oPMCvNbjG1oFhRkLDjs7mu"],"enrUri":"enr:-L24QKg0ldrUKbulmktJ4zpAiJuW7Qajmx_6l5sZjzu6Iy2nIdwsPtBVw5iV8UsjZJr8kJLk1NgwFFs4YQTaCx6z3vgCgmlkgnY0gmlwhKwSM-mKbXVsdGlhZGRyc5YACASsEjPpBkXLAAoErBIz6QZFzN0DgnJzhQACAQAAiXNlY3AyNTZrMaED95-mkBb2RWesyv3A6bpDf_JNmxqfoxKYrixBvjIuxzSDdGNwgkXLg3VkcIJFzYV3YWt1MgU"}'
2026-03-05 04:36:12.254 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:36:12.262 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:36:12.263 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-05_04-36-10__4a302793-e07f-49b9-85ce-a18bc5ffe983__wakuorg_nwaku:latest.log
2026-03-05 04:36:12.263 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:36:12.263 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:36:12.264 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:36:12.265 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.66.163
2026-03-05 04:36:12.265 DEBUG [src.node.docker_mananger] Generated ports ['61060', '61061', '61062', '61063', '61064']
2026-03-05 04:36:12.265 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-05 04:36:12.265 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:36:12.265 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:36:12.265 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:36:12.265 DEBUG [src.node.docker_mananger] docker run -i -t -p 61060:61060 -p 61061:61061 -p 61062:61062 -p 61063:61063 -p 61064:61064 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=61062 --rest-port=61060 --tcp-port=61061 --discv5-udp-port=61063 --rest-address=0.0.0.0 --nat=extip:172.18.66.163 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=f70ce50f47aebc6cb41097b0001bd4c5ede6413f5cc879c0f9be8db3be4365e3 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=61064 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKg0ldrUKbulmktJ4zpAiJuW7Qajmx_6l5sZjzu6Iy2nIdwsPtBVw5iV8UsjZJr8kJLk1NgwFFs4YQTaCx6z3vgCgmlkgnY0gmlwhKwSM-mKbXVsdGlhZGRyc5YACASsEjPpBkXLAAoErBIz6QZFzN0DgnJzhQACAQAAiXNlY3AyNTZrMaED95-mkBb2RWesyv3A6bpDf_JNmxqfoxKYrixBvjIuxzSDdGNwgkXLg3VkcIJFzYV3YWt1MgU
2026-03-05 04:36:12.475 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.66.163 waku 23da1f36e1726950786cf07ebc0a5465b746f44e6bf4c5ebe0e792dd40277266
2026-03-05 04:36:12.514 DEBUG [src.node.docker_mananger] Container started with ID 23da1f36e172. Setting up logs at ./log/docker/node2_2026-03-05_04-36-10__4a302793-e07f-49b9-85ce-a18bc5ffe983__wakuorg_nwaku:latest.log
2026-03-05 04:36:12.515 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 61060
2026-03-05 04:36:12.515 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:36:13.515 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61060/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:13.518 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:13.619 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61060/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:13.665 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:13.765 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61060/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:13.768 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:36:13.768 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:36:13.768 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61060/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:13.773 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.66.163/tcp/61061/p2p/16Uiu2HAmEnW4hcuaBSsYKnoEhDyYXdRpDFKpmUkA2dyupHUh3Wra","/ip4/172.18.66.163/tcp/61062/ws/p2p/16Uiu2HAmEnW4hcuaBSsYKnoEhDyYXdRpDFKpmUkA2dyupHUh3Wra"],"enrUri":"enr:-L24QO6UEqX5JnrgnqsbDiFLggr_mSAfR9SUuhNK1AaYb2KxN5jA1722PintRSkWRYeUU8chIqGPChXUZsxJUMbJ8KcCgmlkgnY0gmlwhKwSQqOKbXVsdGlhZGRyc5YACASsEkKjBu6FAAoErBJCowbuht0DgnJzhQACAQAAiXNlY3AyNTZrMaEDH6QJh9U5Czz_5vs2B4e5tp9Zp3EVMQJ_XGQTPtYjrH-DdGNwgu6Fg3VkcILuh4V3YWt1MgE"}'
2026-03-05 04:36:13.773 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:36:13.773 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61060/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.51.233/tcp/17867/p2p/16Uiu2HAmVKcFKsn4cm48YNUFXkhuq9oPMCvNbjG1oFhRkLDjs7mu"]'
2026-03-05 04:36:13.801 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:13.804 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17866/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-05 04:36:13.811 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:13.811 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61060/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-05 04:36:13.820 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:13.820 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17866/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:36:13.832 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:13.833 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-05 04:36:13.934 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-05 04:36:13.935 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17866/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:13.938 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772685372447591300,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772685369268684269,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772685373533937940,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772685373820797631,"ephemeral":false,"proof":""}]'
2026-03-05 04:36:13.946 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-05 04:36:13.948 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-05 04:36:13.948 DEBUG [src.node.waku_node] Stopping container with id cd0e52b951e2
2026-03-05 04:36:14.598 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:36:14.600 DEBUG [src.node.waku_node] Stopping container with id 23da1f36e172
2026-03-05 04:36:15.201 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:36:15.204 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-05 04:36:15.258 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:36:15.302 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:36:15.304 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-05 04:36:15.304 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-05 04:36:15.305 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-05_04-36-10__4a302793-e07f-49b9-85ce-a18bc5ffe983__wakuorg_nwaku:latest.log
2026-03-05 04:36:15.306 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-05_04-36-10__4a302793-e07f-49b9-85ce-a18bc5ffe983__wakuorg_nwaku:latest.log
2026-03-05 04:36:15.311 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-05 04:36:15.311 DEBUG [tests.conftest] Running test: test_content_topic_not_in_docker_flags with id: 2026-03-05_04-36-15__7d12012f-be56-4e0f-bc3b-83a605bf3f7c
2026-03-05 04:36:15.312 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-05 04:36:15.312 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-05 04:36:15.312 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-05 04:36:15.320 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:36:15.320 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-05_04-36-15__7d12012f-be56-4e0f-bc3b-83a605bf3f7c__wakuorg_nwaku:latest.log
2026-03-05 04:36:15.320 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:36:15.321 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:36:15.322 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:36:15.322 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.246.118
2026-03-05 04:36:15.322 DEBUG [src.node.docker_mananger] Generated ports ['30088', '30089', '30090', '30091', '30092']
2026-03-05 04:36:15.322 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-05 04:36:15.323 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:36:15.323 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:36:15.323 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:36:15.323 DEBUG [src.node.docker_mananger] docker run -i -t -p 30088:30088 -p 30089:30089 -p 30090:30090 -p 30091:30091 -p 30092:30092 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=30090 --rest-port=30088 --tcp-port=30089 --discv5-udp-port=30091 --rest-address=0.0.0.0 --nat=extip:172.18.246.118 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=761abdb40e1bea3ce2f0d4fbeb3c4cc9c0f3bd675c8eedee7a861ed7b9ab2a2b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=30092 --metrics-logging=true --relay=true --filter=true
2026-03-05 04:36:15.507 ERROR [src.node.docker_mananger] Max retries reached for container cd0e52b951e2. Exiting log stream.
2026-03-05 04:36:15.528 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.246.118 waku 457f25a7da1619a7da4d9faefe6982b6a8d5fbe3ee2681670a71ecc345ecea89
2026-03-05 04:36:15.565 DEBUG [src.node.docker_mananger] Container started with ID 457f25a7da16. Setting up logs at ./log/docker/node1_2026-03-05_04-36-15__7d12012f-be56-4e0f-bc3b-83a605bf3f7c__wakuorg_nwaku:latest.log
2026-03-05 04:36:15.565 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 30088
2026-03-05 04:36:15.567 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:36:16.018 ERROR [src.node.docker_mananger] Max retries reached for container 23da1f36e172. Exiting log stream.
2026-03-05 04:36:16.567 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30088/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:16.572 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:16.672 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30088/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:16.675 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:16.775 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30088/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:16.779 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:16.880 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30088/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:16.883 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:16.983 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30088/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:16.985 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:17.086 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30088/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:17.088 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:17.189 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30088/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:17.192 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:17.292 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30088/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:17.295 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:17.395 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30088/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:17.398 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:17.498 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30088/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:17.501 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:17.601 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30088/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:17.604 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:17.704 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30088/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:17.707 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:36:17.707 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:36:17.707 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30088/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:17.710 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.246.118/tcp/30089/p2p/16Uiu2HAmPKqjaNUr4jtW6vRkuGUSr6PWPp5QiGPyYuDmYYJBRDa9","/ip4/172.18.246.118/tcp/30090/ws/p2p/16Uiu2HAmPKqjaNUr4jtW6vRkuGUSr6PWPp5QiGPyYuDmYYJBRDa9"],"enrUri":"enr:-L24QIOvPRcT2BiuJZt9DMQibAcyxgZZ6P4TZmHzJml6J1c7L9goNZj-FI_we1mntMbHr87hMcwtFfL9YJ-U2nJ3tAoCgmlkgnY0gmlwhKwS9naKbXVsdGlhZGRyc5YACASsEvZ2BnWJAAoErBL2dgZ1it0DgnJzhQACAQAAiXNlY3AyNTZrMaEDnojHaYQZKphd8tQ8DKkl-KaulrYVZgq1ljZOamebvnKDdGNwgnWJg3VkcIJ1i4V3YWt1MgU"}'
2026-03-05 04:36:17.710 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:36:17.717 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:36:17.717 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-05_04-36-15__7d12012f-be56-4e0f-bc3b-83a605bf3f7c__wakuorg_nwaku:latest.log
2026-03-05 04:36:17.717 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:36:17.717 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:36:17.719 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:36:17.719 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.123.9
2026-03-05 04:36:17.719 DEBUG [src.node.docker_mananger] Generated ports ['44689', '44690', '44691', '44692', '44693']
2026-03-05 04:36:17.719 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-05 04:36:17.719 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:36:17.720 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:36:17.720 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:36:17.720 DEBUG [src.node.docker_mananger] docker run -i -t -p 44689:44689 -p 44690:44690 -p 44691:44691 -p 44692:44692 -p 44693:44693 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=44691 --rest-port=44689 --tcp-port=44690 --discv5-udp-port=44692 --rest-address=0.0.0.0 --nat=extip:172.18.123.9 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=9d9cff26b60ff9146bbbca2e4c7af9f2ab96be56e7e61c64dfd5f81da24a73af --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=44693 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QIOvPRcT2BiuJZt9DMQibAcyxgZZ6P4TZmHzJml6J1c7L9goNZj-FI_we1mntMbHr87hMcwtFfL9YJ-U2nJ3tAoCgmlkgnY0gmlwhKwS9naKbXVsdGlhZGRyc5YACASsEvZ2BnWJAAoErBL2dgZ1it0DgnJzhQACAQAAiXNlY3AyNTZrMaEDnojHaYQZKphd8tQ8DKkl-KaulrYVZgq1ljZOamebvnKDdGNwgnWJg3VkcIJ1i4V3YWt1MgU
2026-03-05 04:36:17.927 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.123.9 waku ab9008f3a7f9a84c1885b37f47be6d522c6719fa5b3305d36a62cca6930be5d8
2026-03-05 04:36:17.963 DEBUG [src.node.docker_mananger] Container started with ID ab9008f3a7f9. Setting up logs at ./log/docker/node2_2026-03-05_04-36-15__7d12012f-be56-4e0f-bc3b-83a605bf3f7c__wakuorg_nwaku:latest.log
2026-03-05 04:36:17.964 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 44689
2026-03-05 04:36:17.964 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:36:18.964 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44689/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:18.967 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:36:19.067 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44689/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:19.070 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:36:19.070 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:36:19.070 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44689/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:19.073 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.123.9/tcp/44690/p2p/16Uiu2HAm658F9S1Q6Sp7vyy4Au3FP3guMjpNsLDiHaJtci1Wgb9H","/ip4/172.18.123.9/tcp/44691/ws/p2p/16Uiu2HAm658F9S1Q6Sp7vyy4Au3FP3guMjpNsLDiHaJtci1Wgb9H"],"enrUri":"enr:-L24QMzkeX6Ai3e8mGoDfOs3WjW88ttjgOQlHt0kIQ4K9Dv-RInwQrzSehG4qSlca8Vk2ev4A8OPqy3zqZUQVPXuCoYCgmlkgnY0gmlwhKwSewmKbXVsdGlhZGRyc5YACASsEnsJBq6SAAoErBJ7CQauk90DgnJzhQACAQAAiXNlY3AyNTZrMaECni0OieOL0THDwCpumSZO59YC2qGz-Msudqg1URQRiFCDdGNwgq6Sg3VkcIKulIV3YWt1MgE"}'
2026-03-05 04:36:19.073 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:36:19.073 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44689/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.246.118/tcp/30089/p2p/16Uiu2HAmPKqjaNUr4jtW6vRkuGUSr6PWPp5QiGPyYuDmYYJBRDa9"]'
2026-03-05 04:36:19.094 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:19.095 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30088/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-05 04:36:19.103 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:19.104 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44689/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-05 04:36:19.108 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:19.109 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30088/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:36:19.118 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:36:19.119 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-05 04:36:19.220 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-05 04:36:19.220 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30088/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:36:19.223 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772685377726231275,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772685379109238910,"ephemeral":false,"proof":""}]'
2026-03-05 04:36:19.231 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-05 04:36:19.233 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-05 04:36:19.233 DEBUG [src.node.waku_node] Stopping container with id 457f25a7da16
2026-03-05 04:36:19.874 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:36:19.875 DEBUG [src.node.waku_node] Stopping container with id ab9008f3a7f9
2026-03-05 04:36:20.441 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:36:20.443 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-05 04:36:20.482 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:36:20.520 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:36:20.522 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-05 04:36:20.523 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-05 04:36:20.525 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-05_04-36-15__7d12012f-be56-4e0f-bc3b-83a605bf3f7c__wakuorg_nwaku:latest.log
2026-03-05 04:36:20.528 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-05_04-36-15__7d12012f-be56-4e0f-bc3b-83a605bf3f7c__wakuorg_nwaku:latest.log