183 lines
31 KiB
Plaintext

2026-03-05 04:34:10.236 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-05 04:34:10.237 DEBUG [tests.conftest] Running test: test_sender_uses_regular_api_receiver_uses_auto_api with id: 2026-03-05_04-34-10__116624e7-845d-452e-94df-494f6313efd5
2026-03-05 04:34:10.237 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-05 04:34:10.237 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-05 04:34:10.238 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-05 04:34:10.245 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:34:10.245 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-05_04-34-10__116624e7-845d-452e-94df-494f6313efd5__wakuorg_nwaku:latest.log
2026-03-05 04:34:10.246 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:34:10.246 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:34:10.247 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:34:10.247 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.155.54
2026-03-05 04:34:10.247 DEBUG [src.node.docker_mananger] Generated ports ['24044', '24045', '24046', '24047', '24048']
2026-03-05 04:34:10.248 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-05 04:34:10.248 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:34:10.248 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:34:10.248 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:34:10.248 DEBUG [src.node.docker_mananger] docker run -i -t -p 24044:24044 -p 24045:24045 -p 24046:24046 -p 24047:24047 -p 24048:24048 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24046 --rest-port=24044 --tcp-port=24045 --discv5-udp-port=24047 --rest-address=0.0.0.0 --nat=extip:172.18.155.54 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=0be5e261dfaefd294fc9beebc8cd405f42dddade0d6dbcc87d56b8a388d7bebf --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24048 --metrics-logging=true --relay=true --filter=true
2026-03-05 04:34:10.432 ERROR [src.node.docker_mananger] Max retries reached for container de3b53cf8c81. Exiting log stream.
2026-03-05 04:34:10.449 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.155.54 waku d6d29d405c5ecb86cca9d5a2002c3f3c9b47b5afa1996c43c5176753b11069dc
2026-03-05 04:34:10.487 DEBUG [src.node.docker_mananger] Container started with ID d6d29d405c5e. Setting up logs at ./log/docker/node1_2026-03-05_04-34-10__116624e7-845d-452e-94df-494f6313efd5__wakuorg_nwaku:latest.log
2026-03-05 04:34:10.488 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 24044
2026-03-05 04:34:10.488 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:34:11.003 ERROR [src.node.docker_mananger] Max retries reached for container 48703aeaa975. Exiting log stream.
2026-03-05 04:34:11.488 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24044/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:11.491 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:11.591 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24044/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:11.594 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:11.694 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24044/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:11.697 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:11.797 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24044/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:11.799 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:11.900 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24044/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:11.902 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:12.003 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24044/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:12.005 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:12.105 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24044/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:12.108 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:12.208 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24044/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:12.232 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:12.333 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24044/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:12.335 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:34:12.336 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:34:12.336 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24044/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:12.338 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.155.54/tcp/24045/p2p/16Uiu2HAm3EV5ijN7Uo6tg14xWaKXFDgwp3VKDCkn5VqVCcFFNyv3","/ip4/172.18.155.54/tcp/24046/ws/p2p/16Uiu2HAm3EV5ijN7Uo6tg14xWaKXFDgwp3VKDCkn5VqVCcFFNyv3"],"enrUri":"enr:-L24QJ1YOjEPkl9zo6LW4JntazA3FtC69V5NCb4wZuGvE2_HOJpsC85sGj1qKL7nVKC1ji9PHBLM8HGRqU2VaRdw98ACgmlkgnY0gmlwhKwSmzaKbXVsdGlhZGRyc5YACASsEps2Bl3tAAoErBKbNgZd7t0DgnJzhQACAQAAiXNlY3AyNTZrMaECc__IyMQST5AN3RRaD2TSNaewpUs6GKEdvWo2HJlh4QyDdGNwgl3tg3VkcIJd74V3YWt1MgU"}'
2026-03-05 04:34:12.338 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:34:12.345 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:34:12.346 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-05_04-34-10__116624e7-845d-452e-94df-494f6313efd5__wakuorg_nwaku:latest.log
2026-03-05 04:34:12.346 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:34:12.346 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:34:12.347 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:34:12.347 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.185.95
2026-03-05 04:34:12.347 DEBUG [src.node.docker_mananger] Generated ports ['30243', '30244', '30245', '30246', '30247']
2026-03-05 04:34:12.348 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-05 04:34:12.348 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:34:12.348 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:34:12.348 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:34:12.348 DEBUG [src.node.docker_mananger] docker run -i -t -p 30243:30243 -p 30244:30244 -p 30245:30245 -p 30246:30246 -p 30247:30247 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=30245 --rest-port=30243 --tcp-port=30244 --discv5-udp-port=30246 --rest-address=0.0.0.0 --nat=extip:172.18.185.95 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=576a8cd38cef8a3de769011675a3dc5f689f2373f5c774b4e2e44501a8b7a973 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=30247 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QJ1YOjEPkl9zo6LW4JntazA3FtC69V5NCb4wZuGvE2_HOJpsC85sGj1qKL7nVKC1ji9PHBLM8HGRqU2VaRdw98ACgmlkgnY0gmlwhKwSmzaKbXVsdGlhZGRyc5YACASsEps2Bl3tAAoErBKbNgZd7t0DgnJzhQACAQAAiXNlY3AyNTZrMaECc__IyMQST5AN3RRaD2TSNaewpUs6GKEdvWo2HJlh4QyDdGNwgl3tg3VkcIJd74V3YWt1MgU
2026-03-05 04:34:12.547 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.185.95 waku 375db27e9b2cc8387bf6c85f5913b589ffb30a2f8be666c3c8bb1d95df195646
2026-03-05 04:34:12.580 DEBUG [src.node.docker_mananger] Container started with ID 375db27e9b2c. Setting up logs at ./log/docker/node2_2026-03-05_04-34-10__116624e7-845d-452e-94df-494f6313efd5__wakuorg_nwaku:latest.log
2026-03-05 04:34:12.580 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 30243
2026-03-05 04:34:12.580 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:34:13.582 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30243/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:13.584 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:13.685 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30243/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:13.687 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:13.788 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30243/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:13.790 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:13.891 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30243/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:13.894 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:34:13.894 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:34:13.895 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30243/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:13.898 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.185.95/tcp/30244/p2p/16Uiu2HAmSYNUMgWeFr2BLa3iJK1pNXEXMZAWM1tZTHUXf7rukVra","/ip4/172.18.185.95/tcp/30245/ws/p2p/16Uiu2HAmSYNUMgWeFr2BLa3iJK1pNXEXMZAWM1tZTHUXf7rukVra"],"enrUri":"enr:-L24QBfyVosA1a_HMU818qa_lL70akNDWzOnjdkXdgwszI3IBqBu_wpuIjVCxaiAeo5vKW7Gg_ymOkkFGGVZDL4AyskCgmlkgnY0gmlwhKwSuV-KbXVsdGlhZGRyc5YACASsErlfBnYkAAoErBK5XwZ2Jd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDzlGQh1auG7tUjK2LGSyrgSf4-vWmZwNGz6jUzRfyC0ODdGNwgnYkg3VkcIJ2JoV3YWt1MgE"}'
2026-03-05 04:34:13.898 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:34:13.898 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30243/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.155.54/tcp/24045/p2p/16Uiu2HAm3EV5ijN7Uo6tg14xWaKXFDgwp3VKDCkn5VqVCcFFNyv3"]'
2026-03-05 04:34:13.919 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:13.922 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24044/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-03-05 04:34:13.943 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:13.946 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30243/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-05 04:34:13.962 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:13.962 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24044/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:34:13.974 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:13.974 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-05 04:34:14.074 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30243/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:14.077 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772685253896088357,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772685253962762076,"ephemeral":false,"proof":""}]'
2026-03-05 04:34:14.082 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-05 04:34:14.083 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-05 04:34:14.083 DEBUG [src.node.waku_node] Stopping container with id d6d29d405c5e
2026-03-05 04:34:14.697 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:34:14.697 DEBUG [src.node.waku_node] Stopping container with id 375db27e9b2c
2026-03-05 04:34:15.280 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:34:15.281 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-05 04:34:15.316 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:34:15.353 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:34:15.353 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-05 04:34:15.354 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-05 04:34:15.354 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-05_04-34-10__116624e7-845d-452e-94df-494f6313efd5__wakuorg_nwaku:latest.log
2026-03-05 04:34:15.355 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-05_04-34-10__116624e7-845d-452e-94df-494f6313efd5__wakuorg_nwaku:latest.log
2026-03-05 04:34:15.359 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-05 04:34:15.360 DEBUG [tests.conftest] Running test: test_sender_uses_regular_api_receiver_uses_auto_api with id: 2026-03-05_04-34-15__b05d4bb9-03dc-4acd-b4ce-da5cd522d9ab
2026-03-05 04:34:15.360 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-05 04:34:15.360 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-05 04:34:15.360 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-05 04:34:15.367 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:34:15.368 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-05_04-34-15__b05d4bb9-03dc-4acd-b4ce-da5cd522d9ab__wakuorg_nwaku:latest.log
2026-03-05 04:34:15.368 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:34:15.368 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:34:15.369 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:34:15.370 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.217.151
2026-03-05 04:34:15.370 DEBUG [src.node.docker_mananger] Generated ports ['37031', '37032', '37033', '37034', '37035']
2026-03-05 04:34:15.370 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-05 04:34:15.370 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:34:15.370 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:34:15.370 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:34:15.370 DEBUG [src.node.docker_mananger] docker run -i -t -p 37031:37031 -p 37032:37032 -p 37033:37033 -p 37034:37034 -p 37035:37035 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=37033 --rest-port=37031 --tcp-port=37032 --discv5-udp-port=37034 --rest-address=0.0.0.0 --nat=extip:172.18.217.151 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=cbbbf4fb42ded5db8ff02e9d1b24ac00b401badc5bc6dee143de505373bb5fc8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=37035 --metrics-logging=true --relay=true --filter=true
2026-03-05 04:34:15.556 ERROR [src.node.docker_mananger] Max retries reached for container d6d29d405c5e. Exiting log stream.
2026-03-05 04:34:15.567 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.217.151 waku 0b54a6c3a64dbde3d78552fba5dec50feef8565a8ba539c8e6cd4c5bc92a90df
2026-03-05 04:34:15.599 DEBUG [src.node.docker_mananger] Container started with ID 0b54a6c3a64d. Setting up logs at ./log/docker/node1_2026-03-05_04-34-15__b05d4bb9-03dc-4acd-b4ce-da5cd522d9ab__wakuorg_nwaku:latest.log
2026-03-05 04:34:15.600 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 37031
2026-03-05 04:34:15.600 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:34:16.126 ERROR [src.node.docker_mananger] Max retries reached for container 375db27e9b2c. Exiting log stream.
2026-03-05 04:34:16.600 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37031/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:16.603 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:16.703 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37031/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:16.706 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:16.806 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37031/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:16.809 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:34:16.809 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:34:16.809 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37031/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:16.812 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.217.151/tcp/37032/p2p/16Uiu2HAm6sHnXm2kmckdaErmHCwaRvsUvoZTLCW11JSZfmsS9THp","/ip4/172.18.217.151/tcp/37033/ws/p2p/16Uiu2HAm6sHnXm2kmckdaErmHCwaRvsUvoZTLCW11JSZfmsS9THp"],"enrUri":"enr:-L24QNbrbCrsBHkljKb9N6fdtfEvg0CEUeaoBbUYEse2J0TSL-AuCsKtnuawhpeVgTZGUuRdBKw8g_l8Yqafo0HK0FoCgmlkgnY0gmlwhKwS2ZeKbXVsdGlhZGRyc5YACASsEtmXBpCoAAoErBLZlwaQqd0DgnJzhQACAQAAiXNlY3AyNTZrMaECqgCP64r-TDzO91Z66nTpEtwhFdvyEDCz_li8_sg5uoeDdGNwgpCog3VkcIKQqoV3YWt1MgU"}'
2026-03-05 04:34:16.812 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:34:16.819 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:34:16.819 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-05_04-34-15__b05d4bb9-03dc-4acd-b4ce-da5cd522d9ab__wakuorg_nwaku:latest.log
2026-03-05 04:34:16.820 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:34:16.820 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:34:16.821 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:34:16.821 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.68.143
2026-03-05 04:34:16.822 DEBUG [src.node.docker_mananger] Generated ports ['64968', '64969', '64970', '64971', '64972']
2026-03-05 04:34:16.822 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-05 04:34:16.822 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:34:16.822 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:34:16.822 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:34:16.822 DEBUG [src.node.docker_mananger] docker run -i -t -p 64968:64968 -p 64969:64969 -p 64970:64970 -p 64971:64971 -p 64972:64972 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=64970 --rest-port=64968 --tcp-port=64969 --discv5-udp-port=64971 --rest-address=0.0.0.0 --nat=extip:172.18.68.143 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=a1e6cbb84809cfbc3530c5911f27ebbc57df1cafbda68ce19eae9c5ee7f1293b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=64972 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNbrbCrsBHkljKb9N6fdtfEvg0CEUeaoBbUYEse2J0TSL-AuCsKtnuawhpeVgTZGUuRdBKw8g_l8Yqafo0HK0FoCgmlkgnY0gmlwhKwS2ZeKbXVsdGlhZGRyc5YACASsEtmXBpCoAAoErBLZlwaQqd0DgnJzhQACAQAAiXNlY3AyNTZrMaECqgCP64r-TDzO91Z66nTpEtwhFdvyEDCz_li8_sg5uoeDdGNwgpCog3VkcIKQqoV3YWt1MgU
2026-03-05 04:34:17.020 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.68.143 waku 6fc800e7e5286115e425192a3e281454d98621958af6a0be0ac09baa4a5c01ee
2026-03-05 04:34:17.054 DEBUG [src.node.docker_mananger] Container started with ID 6fc800e7e528. Setting up logs at ./log/docker/node2_2026-03-05_04-34-15__b05d4bb9-03dc-4acd-b4ce-da5cd522d9ab__wakuorg_nwaku:latest.log
2026-03-05 04:34:17.055 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 64968
2026-03-05 04:34:17.055 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:34:18.056 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64968/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:18.059 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:18.159 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64968/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:18.162 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:18.263 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64968/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:18.265 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:18.366 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64968/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:18.368 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:34:18.368 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:34:18.369 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64968/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:18.371 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.68.143/tcp/64969/p2p/16Uiu2HAmGQMwj7fDo8cF5h8FLk8CP6ZQ263nVPkXZ71WTtHXS6DZ","/ip4/172.18.68.143/tcp/64970/ws/p2p/16Uiu2HAmGQMwj7fDo8cF5h8FLk8CP6ZQ263nVPkXZ71WTtHXS6DZ"],"enrUri":"enr:-L24QBtIp5MkEs8R_RVfe67nDlM3ipGcxHG_PC_Y9cuwxQztJvaKMrWky4EiV1IJXrTDynDbptSdS-eHS2Cq_YqqvWICgmlkgnY0gmlwhKwSRI-KbXVsdGlhZGRyc5YACASsEkSPBv3JAAoErBJEjwb9yt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDN69zohAAXCIM6u5MPvSX_BDmcdVo54Xf-yaJWaaSmRSDdGNwgv3Jg3VkcIL9y4V3YWt1MgE"}'
2026-03-05 04:34:18.371 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:34:18.371 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64968/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.217.151/tcp/37032/p2p/16Uiu2HAm6sHnXm2kmckdaErmHCwaRvsUvoZTLCW11JSZfmsS9THp"]'
2026-03-05 04:34:18.407 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:18.410 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37031/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-03-05 04:34:18.414 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:18.415 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64968/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-05 04:34:18.420 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:18.421 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37031/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:34:18.432 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:18.433 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-05 04:34:18.534 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64968/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:18.537 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772685258421510253,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772685258475726034,"ephemeral":false,"proof":""}]'
2026-03-05 04:34:18.542 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-05 04:34:18.543 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-05 04:34:18.543 DEBUG [src.node.waku_node] Stopping container with id 0b54a6c3a64d
2026-03-05 04:34:19.132 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:34:19.132 DEBUG [src.node.waku_node] Stopping container with id 6fc800e7e528
2026-03-05 04:34:19.749 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:34:19.751 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-05 04:34:19.793 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:34:19.828 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:34:19.830 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-05 04:34:19.830 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-05 04:34:19.833 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-05_04-34-15__b05d4bb9-03dc-4acd-b4ce-da5cd522d9ab__wakuorg_nwaku:latest.log
2026-03-05 04:34:19.837 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-05_04-34-15__b05d4bb9-03dc-4acd-b4ce-da5cd522d9ab__wakuorg_nwaku:latest.log