171 lines
29 KiB
Plaintext

2026-03-06 04:33:55.660 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-06 04:33:55.660 DEBUG [tests.conftest] Running test: test_single_content_topic[/app/22/sometopic/someencoding] with id: 2026-03-06_04-33-55__debac955-725c-4b5d-a877-75d9ca0b2ff6
2026-03-06 04:33:55.661 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-06 04:33:55.661 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-06 04:33:55.661 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-06 04:33:55.669 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-06 04:33:55.669 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-06_04-33-55__debac955-725c-4b5d-a877-75d9ca0b2ff6__wakuorg_nwaku:latest.log
2026-03-06 04:33:55.669 DEBUG [src.node.waku_node] Starting Node...
2026-03-06 04:33:55.669 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-06 04:33:55.670 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-06 04:33:55.671 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.226.176
2026-03-06 04:33:55.671 DEBUG [src.node.docker_mananger] Generated ports ['39467', '39468', '39469', '39470', '39471']
2026-03-06 04:33:55.671 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-06 04:33:55.671 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-06 04:33:55.671 DEBUG [src.node.waku_node] Using volumes []
2026-03-06 04:33:55.671 DEBUG [src.node.docker_mananger] docker run -i -t -p 39467:39467 -p 39468:39468 -p 39469:39469 -p 39470:39470 -p 39471:39471 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=39469 --rest-port=39467 --tcp-port=39468 --discv5-udp-port=39470 --rest-address=0.0.0.0 --nat=extip:172.18.226.176 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=c5cec9ddda97dfd1bca6064b73eafaa2460cd2cdb3ebcca4de07bf908d0cd2ac --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=39471 --metrics-logging=true --relay=true --filter=true --content-topic=/app/22/sometopic/someencoding
2026-03-06 04:33:55.865 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.226.176 waku f2964e4a17966daefe22bb84f259b370a637f2b82d3e6b0607f1621aba076e30
2026-03-06 04:33:55.889 ERROR [src.node.docker_mananger] Max retries reached for container 7205e968eff9. Exiting log stream.
2026-03-06 04:33:55.902 DEBUG [src.node.docker_mananger] Container started with ID f2964e4a1796. Setting up logs at ./log/docker/node1_2026-03-06_04-33-55__debac955-725c-4b5d-a877-75d9ca0b2ff6__wakuorg_nwaku:latest.log
2026-03-06 04:33:55.902 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 39467
2026-03-06 04:33:55.902 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-06 04:33:56.456 ERROR [src.node.docker_mananger] Max retries reached for container 89f43c8752c6. Exiting log stream.
2026-03-06 04:33:56.903 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39467/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:56.929 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:57.029 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39467/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:57.032 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-06 04:33:57.032 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-06 04:33:57.033 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39467/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:57.035 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.226.176/tcp/39468/p2p/16Uiu2HAmKr38J3ZhyEwCpVVSEfzfNhdwLKDpLKsu5MnMJ2inowUK","/ip4/172.18.226.176/tcp/39469/ws/p2p/16Uiu2HAmKr38J3ZhyEwCpVVSEfzfNhdwLKDpLKsu5MnMJ2inowUK"],"enrUri":"enr:-L24QHP6Cn4H8MqB7yndVca-XUYdeKNN6-DqI09jE8Xk6pYnGCYQFfKjLl19wr9UNh1VjKjz29CjIr-qR_N5P1hNS2QCgmlkgnY0gmlwhKwS4rCKbXVsdGlhZGRyc5YACASsEuKwBposAAoErBLisAaaLd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDatZWDkTtrwlNfQXS6YDeym4fTfpNaE3duGk6tg1OMCiDdGNwgposg3VkcIKaLoV3YWt1MgU"}'
2026-03-06 04:33:57.035 INFO [src.node.waku_node] REST service is ready !!
2026-03-06 04:33:57.043 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-06 04:33:57.044 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-06_04-33-55__debac955-725c-4b5d-a877-75d9ca0b2ff6__wakuorg_nwaku:latest.log
2026-03-06 04:33:57.044 DEBUG [src.node.waku_node] Starting Node...
2026-03-06 04:33:57.044 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-06 04:33:57.047 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-06 04:33:57.047 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.13.122
2026-03-06 04:33:57.047 DEBUG [src.node.docker_mananger] Generated ports ['42393', '42394', '42395', '42396', '42397']
2026-03-06 04:33:57.048 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-06 04:33:57.049 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-06 04:33:57.049 DEBUG [src.node.waku_node] Using volumes []
2026-03-06 04:33:57.050 DEBUG [src.node.docker_mananger] docker run -i -t -p 42393:42393 -p 42394:42394 -p 42395:42395 -p 42396:42396 -p 42397:42397 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=42395 --rest-port=42393 --tcp-port=42394 --discv5-udp-port=42396 --rest-address=0.0.0.0 --nat=extip:172.18.13.122 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=fae699d1ccbcaf2756fe4ede1f31ed4c992cb8846ff68858fd07526b536b0d92 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=42397 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QHP6Cn4H8MqB7yndVca-XUYdeKNN6-DqI09jE8Xk6pYnGCYQFfKjLl19wr9UNh1VjKjz29CjIr-qR_N5P1hNS2QCgmlkgnY0gmlwhKwS4rCKbXVsdGlhZGRyc5YACASsEuKwBposAAoErBLisAaaLd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDatZWDkTtrwlNfQXS6YDeym4fTfpNaE3duGk6tg1OMCiDdGNwgposg3VkcIKaLoV3YWt1MgU --content-topic=/app/22/sometopic/someencoding
2026-03-06 04:33:57.251 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.13.122 waku 55b3d37c3823834a8ea66e3145dcb4b94ded985d600401ab242ea492a784a546
2026-03-06 04:33:57.292 DEBUG [src.node.docker_mananger] Container started with ID 55b3d37c3823. Setting up logs at ./log/docker/node2_2026-03-06_04-33-55__debac955-725c-4b5d-a877-75d9ca0b2ff6__wakuorg_nwaku:latest.log
2026-03-06 04:33:57.293 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 42393
2026-03-06 04:33:57.293 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-06 04:33:58.294 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42393/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:58.297 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:58.397 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42393/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:58.399 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:58.500 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42393/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:58.502 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:58.603 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42393/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:58.605 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-06 04:33:58.605 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-06 04:33:58.605 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42393/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:58.608 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.13.122/tcp/42394/p2p/16Uiu2HAmUAnkDyDmNusjyVTTpggQ73UrMjK5fibN7hx47ar86DcG","/ip4/172.18.13.122/tcp/42395/ws/p2p/16Uiu2HAmUAnkDyDmNusjyVTTpggQ73UrMjK5fibN7hx47ar86DcG"],"enrUri":"enr:-L24QNW4aNdyM3N71bFh8I25PmBT7PaiZU0uGi0QPM4K1x-tVjVEYF1jNpYmrQ6AnJ_0iP8vEdtqLNa_oDLc0DR2PgsCgmlkgnY0gmlwhKwSDXqKbXVsdGlhZGRyc5YACASsEg16BqWaAAoErBINegalm90DgnJzhQACAQAAiXNlY3AyNTZrMaED5oGbWUMyYz4aCPenGdNSlTQWy9AoTXfZpqxihrPB7cWDdGNwgqWag3VkcIKlnIV3YWt1MgE"}'
2026-03-06 04:33:58.608 INFO [src.node.waku_node] REST service is ready !!
2026-03-06 04:33:58.608 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42393/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.226.176/tcp/39468/p2p/16Uiu2HAmKr38J3ZhyEwCpVVSEfzfNhdwLKDpLKsu5MnMJ2inowUK"]'
2026-03-06 04:33:58.635 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:58.637 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39467/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/22/sometopic/someencoding"]'
2026-03-06 04:33:58.645 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:58.646 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42393/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/22/sometopic/someencoding"]'
2026-03-06 04:33:58.653 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:58.654 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39467/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/22/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-06 04:33:58.662 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:58.662 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-06 04:33:58.764 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-06 04:33:58.764 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39467/relay/v1/auto/messages/%2Fapp%2F22%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:58.767 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/22/sometopic/someencoding","version":0,"timestamp":1772771638061930704,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/22/sometopic/someencoding","version":0,"timestamp":1772771638653867836,"ephemeral":false,"proof":""}]'
2026-03-06 04:33:58.819 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-06 04:33:58.820 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-06 04:33:58.820 DEBUG [src.node.waku_node] Stopping container with id f2964e4a1796
2026-03-06 04:33:59.381 DEBUG [src.node.waku_node] Container stopped.
2026-03-06 04:33:59.381 DEBUG [src.node.waku_node] Stopping container with id 55b3d37c3823
2026-03-06 04:33:59.978 DEBUG [src.node.waku_node] Container stopped.
2026-03-06 04:33:59.982 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-06 04:34:00.017 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-06 04:34:00.048 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-06 04:34:00.049 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-06 04:34:00.050 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-06 04:34:00.050 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-06_04-33-55__debac955-725c-4b5d-a877-75d9ca0b2ff6__wakuorg_nwaku:latest.log
2026-03-06 04:34:00.051 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-06_04-33-55__debac955-725c-4b5d-a877-75d9ca0b2ff6__wakuorg_nwaku:latest.log
2026-03-06 04:34:00.056 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-06 04:34:00.056 DEBUG [tests.conftest] Running test: test_single_content_topic[/app/22/sometopic/someencoding] with id: 2026-03-06_04-34-00__53028b82-8ab5-40b0-89a1-ba1cd95a3801
2026-03-06 04:34:00.056 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-06 04:34:00.057 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-06 04:34:00.057 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-06 04:34:00.064 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-06 04:34:00.064 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-06_04-34-00__53028b82-8ab5-40b0-89a1-ba1cd95a3801__wakuorg_nwaku:latest.log
2026-03-06 04:34:00.065 DEBUG [src.node.waku_node] Starting Node...
2026-03-06 04:34:00.065 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-06 04:34:00.066 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-06 04:34:00.067 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.22.94
2026-03-06 04:34:00.067 DEBUG [src.node.docker_mananger] Generated ports ['33031', '33032', '33033', '33034', '33035']
2026-03-06 04:34:00.067 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-06 04:34:00.067 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-06 04:34:00.067 DEBUG [src.node.waku_node] Using volumes []
2026-03-06 04:34:00.067 DEBUG [src.node.docker_mananger] docker run -i -t -p 33031:33031 -p 33032:33032 -p 33033:33033 -p 33034:33034 -p 33035:33035 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=33033 --rest-port=33031 --tcp-port=33032 --discv5-udp-port=33034 --rest-address=0.0.0.0 --nat=extip:172.18.22.94 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=3062f33abbd844a937bf1f419b9efbffc21c2fefa956f167f97b1b2c30dad4bb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=33035 --metrics-logging=true --relay=true --filter=true --content-topic=/app/22/sometopic/someencoding
2026-03-06 04:34:00.252 ERROR [src.node.docker_mananger] Max retries reached for container f2964e4a1796. Exiting log stream.
2026-03-06 04:34:00.267 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.22.94 waku 416a1f71f9c4af29666c12fd55e481f3110b76b40e7b48ed4784092b4b4acd11
2026-03-06 04:34:00.303 DEBUG [src.node.docker_mananger] Container started with ID 416a1f71f9c4. Setting up logs at ./log/docker/node1_2026-03-06_04-34-00__53028b82-8ab5-40b0-89a1-ba1cd95a3801__wakuorg_nwaku:latest.log
2026-03-06 04:34:00.304 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 33031
2026-03-06 04:34:00.304 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-06 04:34:00.791 ERROR [src.node.docker_mananger] Max retries reached for container 55b3d37c3823. Exiting log stream.
2026-03-06 04:34:01.304 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33031/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:34:01.311 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-06 04:34:01.312 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-06 04:34:01.313 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33031/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:34:01.315 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.22.94/tcp/33032/p2p/16Uiu2HAmKBaThfvbGgsy9TWnNX4e6wyQ9NSoiwstGQUCQa3EMpZ7","/ip4/172.18.22.94/tcp/33033/ws/p2p/16Uiu2HAmKBaThfvbGgsy9TWnNX4e6wyQ9NSoiwstGQUCQa3EMpZ7"],"enrUri":"enr:-L24QLibCzKDPNCw1nlQy63WuckIEF71bvqQgjFX5ixPtWdJeJRobzxj9kMHC6w6iB_ioPFp5OSmMNtYfTDBeEEtnlsCgmlkgnY0gmlwhKwSFl6KbXVsdGlhZGRyc5YACASsEhZeBoEIAAoErBIWXgaBCd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDYPwdYL21KOst99ZOjtInxdXQpBY9GjojC3aXEDAZvdKDdGNwgoEIg3VkcIKBCoV3YWt1MgU"}'
2026-03-06 04:34:01.316 INFO [src.node.waku_node] REST service is ready !!
2026-03-06 04:34:01.323 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-06 04:34:01.323 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-06_04-34-00__53028b82-8ab5-40b0-89a1-ba1cd95a3801__wakuorg_nwaku:latest.log
2026-03-06 04:34:01.323 DEBUG [src.node.waku_node] Starting Node...
2026-03-06 04:34:01.323 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-06 04:34:01.324 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-06 04:34:01.325 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.205.216
2026-03-06 04:34:01.325 DEBUG [src.node.docker_mananger] Generated ports ['43577', '43578', '43579', '43580', '43581']
2026-03-06 04:34:01.325 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-06 04:34:01.325 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-06 04:34:01.325 DEBUG [src.node.waku_node] Using volumes []
2026-03-06 04:34:01.325 DEBUG [src.node.docker_mananger] docker run -i -t -p 43577:43577 -p 43578:43578 -p 43579:43579 -p 43580:43580 -p 43581:43581 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=43579 --rest-port=43577 --tcp-port=43578 --discv5-udp-port=43580 --rest-address=0.0.0.0 --nat=extip:172.18.205.216 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=83f729d9f6ea7def76a8dcbe02984e2af0aa34ea294eaa8abfb39e4eebf0ab28 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=43581 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QLibCzKDPNCw1nlQy63WuckIEF71bvqQgjFX5ixPtWdJeJRobzxj9kMHC6w6iB_ioPFp5OSmMNtYfTDBeEEtnlsCgmlkgnY0gmlwhKwSFl6KbXVsdGlhZGRyc5YACASsEhZeBoEIAAoErBIWXgaBCd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDYPwdYL21KOst99ZOjtInxdXQpBY9GjojC3aXEDAZvdKDdGNwgoEIg3VkcIKBCoV3YWt1MgU --content-topic=/app/22/sometopic/someencoding
2026-03-06 04:34:01.546 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.205.216 waku b21ae0c4975630c0c16a7af87c4ae3e0816e6bbc130d4be51f6711f19cad72d0
2026-03-06 04:34:01.583 DEBUG [src.node.docker_mananger] Container started with ID b21ae0c49756. Setting up logs at ./log/docker/node2_2026-03-06_04-34-00__53028b82-8ab5-40b0-89a1-ba1cd95a3801__wakuorg_nwaku:latest.log
2026-03-06 04:34:01.584 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 43577
2026-03-06 04:34:01.585 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-06 04:34:02.585 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43577/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:34:02.588 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:34:02.689 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43577/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:34:02.691 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:34:02.792 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43577/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:34:02.794 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:34:02.894 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43577/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:34:02.897 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:34:02.997 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43577/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:34:02.999 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:34:03.099 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43577/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:34:03.101 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:34:03.202 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43577/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:34:03.204 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:34:03.305 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43577/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:34:03.307 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-06 04:34:03.308 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-06 04:34:03.308 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43577/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:34:03.310 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.205.216/tcp/43578/p2p/16Uiu2HAmDE7uXSEGQNffb8bDBs62ZhU5HEdzg6YGAmdkfNn25otR","/ip4/172.18.205.216/tcp/43579/ws/p2p/16Uiu2HAmDE7uXSEGQNffb8bDBs62ZhU5HEdzg6YGAmdkfNn25otR"],"enrUri":"enr:-L24QImXs4SMULrykMYgiFfXib74-wGyZDO_U9_Kab826voEcSfl0pHM5jWnggyx72lN9ynuTFKKGsNS8P2IP8FkyfECgmlkgnY0gmlwhKwSzdiKbXVsdGlhZGRyc5YACASsEs3YBqo6AAoErBLN2AaqO90DgnJzhQACAQAAiXNlY3AyNTZrMaEDCHy1xjbpNherGmMH7j1PnSxE-TXNg9SxsohnWgCiuC6DdGNwgqo6g3VkcIKqPIV3YWt1MgE"}'
2026-03-06 04:34:03.311 INFO [src.node.waku_node] REST service is ready !!
2026-03-06 04:34:03.311 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43577/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.22.94/tcp/33032/p2p/16Uiu2HAmKBaThfvbGgsy9TWnNX4e6wyQ9NSoiwstGQUCQa3EMpZ7"]'
2026-03-06 04:34:03.335 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:34:03.337 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33031/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/22/sometopic/someencoding"]'
2026-03-06 04:34:03.347 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:34:03.348 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43577/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/22/sometopic/someencoding"]'
2026-03-06 04:34:03.352 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:34:03.353 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33031/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/22/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-06 04:34:03.363 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:34:03.364 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-06 04:34:03.467 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-06 04:34:03.467 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33031/relay/v1/auto/messages/%2Fapp%2F22%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:34:03.470 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/22/sometopic/someencoding","version":0,"timestamp":1772771638653867836,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/22/sometopic/someencoding","version":0,"timestamp":1772771639048329864,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/22/sometopic/someencoding","version":0,"timestamp":1772771643353575017,"ephemeral":false,"proof":""}]'
2026-03-06 04:34:03.479 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-06 04:34:03.480 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-06 04:34:03.480 DEBUG [src.node.waku_node] Stopping container with id 416a1f71f9c4
2026-03-06 04:34:04.042 DEBUG [src.node.waku_node] Container stopped.
2026-03-06 04:34:04.044 DEBUG [src.node.waku_node] Stopping container with id b21ae0c49756
2026-03-06 04:34:04.600 DEBUG [src.node.waku_node] Container stopped.
2026-03-06 04:34:04.602 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-06 04:34:04.683 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-06 04:34:04.708 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-06 04:34:04.709 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-06 04:34:04.709 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-06 04:34:04.709 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-06_04-34-00__53028b82-8ab5-40b0-89a1-ba1cd95a3801__wakuorg_nwaku:latest.log
2026-03-06 04:34:04.710 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-06_04-34-00__53028b82-8ab5-40b0-89a1-ba1cd95a3801__wakuorg_nwaku:latest.log