279 lines
48 KiB
Plaintext

2026-03-05 04:35:22.124 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-05 04:35:22.124 DEBUG [tests.conftest] Running test: test_2_nodes_different_content_topic_same_shard with id: 2026-03-05_04-35-22__4032a241-b8ee-44b1-ae55-f72c04e22f33
2026-03-05 04:35:22.125 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-05 04:35:22.125 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-05 04:35:22.125 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-05 04:35:22.133 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:35:22.134 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-05_04-35-22__4032a241-b8ee-44b1-ae55-f72c04e22f33__wakuorg_nwaku:latest.log
2026-03-05 04:35:22.134 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:35:22.134 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:35:22.135 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:35:22.136 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.150.31
2026-03-05 04:35:22.136 DEBUG [src.node.docker_mananger] Generated ports ['35986', '35987', '35988', '35989', '35990']
2026-03-05 04:35:22.136 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:35:22.136 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:35:22.136 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:35:22.136 DEBUG [src.node.docker_mananger] docker run -i -t -p 35986:35986 -p 35987:35987 -p 35988:35988 -p 35989:35989 -p 35990:35990 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=35988 --rest-port=35986 --tcp-port=35987 --discv5-udp-port=35989 --rest-address=0.0.0.0 --nat=extip:172.18.150.31 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=c6eb6badaeda04baa76fc57a1f8c1d50beea0891abd9f72dfcd95f0eaebebffe --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=35990 --metrics-logging=true --relay=true --filter=true --content-topic=/newsService/1.0/weekly/protobuf
2026-03-05 04:35:22.319 ERROR [src.node.docker_mananger] Max retries reached for container a1498f5c7791. Exiting log stream.
2026-03-05 04:35:22.346 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.150.31 waku 8fa3fe4666147ec3d071e1c107aab3872665cfe76e3cf00d8e5314eaad6f656c
2026-03-05 04:35:22.383 DEBUG [src.node.docker_mananger] Container started with ID 8fa3fe466614. Setting up logs at ./log/docker/node1_2026-03-05_04-35-22__4032a241-b8ee-44b1-ae55-f72c04e22f33__wakuorg_nwaku:latest.log
2026-03-05 04:35:22.385 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 35986
2026-03-05 04:35:22.385 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:35:22.855 ERROR [src.node.docker_mananger] Max retries reached for container a9a1729bf9a6. Exiting log stream.
2026-03-05 04:35:23.386 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35986/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:23.427 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:23.527 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35986/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:23.531 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:35:23.532 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:35:23.532 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35986/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:23.535 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.150.31/tcp/35987/p2p/16Uiu2HAmTeNmf3ZcmSZdTj6L13x91uX2nib2NMJrnqURGwEd6rcV","/ip4/172.18.150.31/tcp/35988/ws/p2p/16Uiu2HAmTeNmf3ZcmSZdTj6L13x91uX2nib2NMJrnqURGwEd6rcV"],"enrUri":"enr:-L24QPprPDnk8L4YweVucF41VGXW1sZzeWRAOAkYWdo2ZNO8PDVfGr45c7YlPPLUBvLVQhveWb4RtMzSukmLEfjG5W8CgmlkgnY0gmlwhKwSlh-KbXVsdGlhZGRyc5YACASsEpYfBoyTAAoErBKWHwaMlN0DgnJzhQACAQAAiXNlY3AyNTZrMaED3rcS1x_7opkADH9Dw6Ftp-M3CPmzvaMP-6_SI8lCexaDdGNwgoyTg3VkcIKMlYV3YWt1MgU"}'
2026-03-05 04:35:23.535 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:35:23.543 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:35:23.543 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-05_04-35-22__4032a241-b8ee-44b1-ae55-f72c04e22f33__wakuorg_nwaku:latest.log
2026-03-05 04:35:23.543 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:35:23.543 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:35:23.546 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:35:23.547 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.80.229
2026-03-05 04:35:23.547 DEBUG [src.node.docker_mananger] Generated ports ['17251', '17252', '17253', '17254', '17255']
2026-03-05 04:35:23.547 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:35:23.547 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:35:23.547 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:35:23.548 DEBUG [src.node.docker_mananger] docker run -i -t -p 17251:17251 -p 17252:17252 -p 17253:17253 -p 17254:17254 -p 17255:17255 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17253 --rest-port=17251 --tcp-port=17252 --discv5-udp-port=17254 --rest-address=0.0.0.0 --nat=extip:172.18.80.229 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=7c55d9ccaee9cde94a52a3be31c9965af8a0dd87fdfa4b7ac1ea9e7b107de15b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17255 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QPprPDnk8L4YweVucF41VGXW1sZzeWRAOAkYWdo2ZNO8PDVfGr45c7YlPPLUBvLVQhveWb4RtMzSukmLEfjG5W8CgmlkgnY0gmlwhKwSlh-KbXVsdGlhZGRyc5YACASsEpYfBoyTAAoErBKWHwaMlN0DgnJzhQACAQAAiXNlY3AyNTZrMaED3rcS1x_7opkADH9Dw6Ftp-M3CPmzvaMP-6_SI8lCexaDdGNwgoyTg3VkcIKMlYV3YWt1MgU --content-topic=/newsService/1.0/alerts/xml
2026-03-05 04:35:23.762 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.80.229 waku d636ff0b52b0a6fe05ddb0cf22efa9d97405200113cc7bb1cbf8873b2d2d30bf
2026-03-05 04:35:23.800 DEBUG [src.node.docker_mananger] Container started with ID d636ff0b52b0. Setting up logs at ./log/docker/node2_2026-03-05_04-35-22__4032a241-b8ee-44b1-ae55-f72c04e22f33__wakuorg_nwaku:latest.log
2026-03-05 04:35:23.800 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 17251
2026-03-05 04:35:23.800 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:35:24.801 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17251/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:24.804 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:24.904 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17251/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:24.908 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:25.010 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17251/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:25.013 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:25.113 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17251/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:25.116 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:25.216 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17251/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:25.219 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:25.319 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17251/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:25.322 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:35:25.323 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:35:25.323 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17251/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:25.325 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.80.229/tcp/17252/p2p/16Uiu2HAmLxHvUZqWHvGebE8W49HmXBW5GP5uwWTujveWGCK3cm8L","/ip4/172.18.80.229/tcp/17253/ws/p2p/16Uiu2HAmLxHvUZqWHvGebE8W49HmXBW5GP5uwWTujveWGCK3cm8L"],"enrUri":"enr:-L24QHevUQeKUlzqGhbDsxGZrw6OFbSXEDJttmigI6XwJr2dQopl2CvjQywe9O9ff24LsDu0NQ5fF2NBm54KG0r3eecCgmlkgnY0gmlwhKwSUOWKbXVsdGlhZGRyc5YACASsElDlBkNkAAoErBJQ5QZDZd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDe0w881ahsbJz4F3uSD1me2XG2UKIEP_insCRecBMW_GDdGNwgkNkg3VkcIJDZoV3YWt1MgE"}'
2026-03-05 04:35:25.326 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:35:25.326 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17251/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.150.31/tcp/35987/p2p/16Uiu2HAmTeNmf3ZcmSZdTj6L13x91uX2nib2NMJrnqURGwEd6rcV"]'
2026-03-05 04:35:25.350 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:35:25.352 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35986/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/newsService/1.0/weekly/protobuf"]'
2026-03-05 04:35:25.360 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:35:25.361 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17251/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/newsService/1.0/alerts/xml"]'
2026-03-05 04:35:25.370 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:35:25.371 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35986/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/newsService/1.0/weekly/protobuf", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:35:25.386 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:35:25.388 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-05 04:35:25.488 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-05 04:35:25.488 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35986/relay/v1/auto/messages/%2FnewsService%2F1.0%2Fweekly%2Fprotobuf" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:25.492 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/newsService/1.0/weekly/protobuf","version":0,"timestamp":1772685325371726422,"ephemeral":false,"proof":""}]'
2026-03-05 04:35:25.494 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-05 04:35:25.495 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17251/relay/v1/auto/messages/%2FnewsService%2F1.0%2Fweekly%2Fprotobuf" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:25.498 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:17251/relay/v1/auto/messages/%2FnewsService%2F1.0%2Fweekly%2Fprotobuf. Response content: b'/newsService/1.0/weekly/protobuf'
2026-03-05 04:35:25.535 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-05 04:35:25.536 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-05 04:35:25.537 DEBUG [src.node.waku_node] Stopping container with id 8fa3fe466614
2026-03-05 04:35:26.140 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:35:26.141 DEBUG [src.node.waku_node] Stopping container with id d636ff0b52b0
2026-03-05 04:35:26.737 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:35:26.739 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-05 04:35:26.770 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:35:26.801 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:35:26.802 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-05 04:35:26.803 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-05 04:35:26.804 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-05_04-35-22__4032a241-b8ee-44b1-ae55-f72c04e22f33__wakuorg_nwaku:latest.log
2026-03-05 04:35:26.805 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-05_04-35-22__4032a241-b8ee-44b1-ae55-f72c04e22f33__wakuorg_nwaku:latest.log
2026-03-05 04:35:26.808 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-05 04:35:26.809 DEBUG [tests.conftest] Running test: test_2_nodes_different_content_topic_same_shard with id: 2026-03-05_04-35-26__3e7e9343-d632-4b41-adb0-b22d82caaf77
2026-03-05 04:35:26.809 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-05 04:35:26.809 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-05 04:35:26.810 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-05 04:35:26.817 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:35:26.818 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-05_04-35-26__3e7e9343-d632-4b41-adb0-b22d82caaf77__wakuorg_nwaku:latest.log
2026-03-05 04:35:26.818 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:35:26.818 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:35:26.819 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:35:26.820 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.68.229
2026-03-05 04:35:26.820 DEBUG [src.node.docker_mananger] Generated ports ['43912', '43913', '43914', '43915', '43916']
2026-03-05 04:35:26.820 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:35:26.820 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:35:26.820 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:35:26.820 DEBUG [src.node.docker_mananger] docker run -i -t -p 43912:43912 -p 43913:43913 -p 43914:43914 -p 43915:43915 -p 43916:43916 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=43914 --rest-port=43912 --tcp-port=43913 --discv5-udp-port=43915 --rest-address=0.0.0.0 --nat=extip:172.18.68.229 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=da2dbadf05c9cfbbed05fecb705eeb4cc20eb7c1b5ed333da64010448a667743 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=43916 --metrics-logging=true --relay=true --filter=true --content-topic=/newsService/1.0/weekly/protobuf
2026-03-05 04:35:27.007 ERROR [src.node.docker_mananger] Max retries reached for container 8fa3fe466614. Exiting log stream.
2026-03-05 04:35:27.014 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.68.229 waku 6958f5151d08397d35160243b7133095dfa5a6b2264e86ae550c0b0fa9942a63
2026-03-05 04:35:27.051 DEBUG [src.node.docker_mananger] Container started with ID 6958f5151d08. Setting up logs at ./log/docker/node1_2026-03-05_04-35-26__3e7e9343-d632-4b41-adb0-b22d82caaf77__wakuorg_nwaku:latest.log
2026-03-05 04:35:27.052 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 43912
2026-03-05 04:35:27.053 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:35:27.578 ERROR [src.node.docker_mananger] Max retries reached for container d636ff0b52b0. Exiting log stream.
2026-03-05 04:35:28.053 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43912/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:28.056 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:28.157 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43912/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:28.160 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:28.260 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43912/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:28.263 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:35:28.264 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:35:28.264 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43912/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:28.267 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.68.229/tcp/43913/p2p/16Uiu2HAm1b5no4xWinqqH9Zm5rkN2qN7BDjouYWY9oyp2xd2Fu49","/ip4/172.18.68.229/tcp/43914/ws/p2p/16Uiu2HAm1b5no4xWinqqH9Zm5rkN2qN7BDjouYWY9oyp2xd2Fu49"],"enrUri":"enr:-L24QEcwkBTPKZz96OOck8WSP4g4VqBGB9FKk_JPKIeOmt9MbfiewXXIYZwa7bbWUK6pV4AXh_A7lILLsPOJmqmAAkYCgmlkgnY0gmlwhKwSROWKbXVsdGlhZGRyc5YACASsEkTlBquJAAoErBJE5Qarit0DgnJzhQACAQAAiXNlY3AyNTZrMaECW49FdMncK-v56nY_Qdrb3U5BNiIEdJDvYr_wpC3qOwaDdGNwgquJg3VkcIKri4V3YWt1MgU"}'
2026-03-05 04:35:28.267 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:35:28.275 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:35:28.276 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-05_04-35-26__3e7e9343-d632-4b41-adb0-b22d82caaf77__wakuorg_nwaku:latest.log
2026-03-05 04:35:28.276 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:35:28.276 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:35:28.278 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:35:28.278 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.192.194
2026-03-05 04:35:28.278 DEBUG [src.node.docker_mananger] Generated ports ['31028', '31029', '31030', '31031', '31032']
2026-03-05 04:35:28.278 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:35:28.279 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:35:28.279 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:35:28.279 DEBUG [src.node.docker_mananger] docker run -i -t -p 31028:31028 -p 31029:31029 -p 31030:31030 -p 31031:31031 -p 31032:31032 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=31030 --rest-port=31028 --tcp-port=31029 --discv5-udp-port=31031 --rest-address=0.0.0.0 --nat=extip:172.18.192.194 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=e4efca0e7ffcedd5dcbcaff8caca8af58007ebfebc5fc5ecd06c6b1862eee7c8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=31032 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QEcwkBTPKZz96OOck8WSP4g4VqBGB9FKk_JPKIeOmt9MbfiewXXIYZwa7bbWUK6pV4AXh_A7lILLsPOJmqmAAkYCgmlkgnY0gmlwhKwSROWKbXVsdGlhZGRyc5YACASsEkTlBquJAAoErBJE5Qarit0DgnJzhQACAQAAiXNlY3AyNTZrMaECW49FdMncK-v56nY_Qdrb3U5BNiIEdJDvYr_wpC3qOwaDdGNwgquJg3VkcIKri4V3YWt1MgU --content-topic=/newsService/1.0/alerts/xml
2026-03-05 04:35:28.505 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.192.194 waku 7eedbde664fe799530828f494754087a95d6c6637af79016f7dfa83d6ef5a1d7
2026-03-05 04:35:28.543 DEBUG [src.node.docker_mananger] Container started with ID 7eedbde664fe. Setting up logs at ./log/docker/node2_2026-03-05_04-35-26__3e7e9343-d632-4b41-adb0-b22d82caaf77__wakuorg_nwaku:latest.log
2026-03-05 04:35:28.543 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 31028
2026-03-05 04:35:28.543 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:35:29.544 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31028/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:29.547 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:29.647 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31028/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:29.650 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:29.750 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31028/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:29.753 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:29.854 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31028/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:29.856 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:29.957 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31028/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:29.959 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:30.060 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31028/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:30.078 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:30.178 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31028/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:30.181 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:35:30.181 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:35:30.182 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31028/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:30.184 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.192.194/tcp/31029/p2p/16Uiu2HAmUWMRTpz4pzukkfjgcZUFzsvneCjje4RCHEai37vYUtKG","/ip4/172.18.192.194/tcp/31030/ws/p2p/16Uiu2HAmUWMRTpz4pzukkfjgcZUFzsvneCjje4RCHEai37vYUtKG"],"enrUri":"enr:-L24QMf0qGU8DpfkxhtTD_1qr4gE7hL4Nimkos6K9viNKjGdeal44N3BKZC3RUJ8xluK-eDtzT6znRUot4ilCIp5MVMCgmlkgnY0gmlwhKwSwMKKbXVsdGlhZGRyc5YACASsEsDCBnk1AAoErBLAwgZ5Nt0DgnJzhQACAQAAiXNlY3AyNTZrMaED64SW9RW3uIvwAYPn_CejQt-RnSwnuiNwmOVWGNAvlReDdGNwgnk1g3VkcIJ5N4V3YWt1MgE"}'
2026-03-05 04:35:30.185 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:35:30.185 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31028/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.68.229/tcp/43913/p2p/16Uiu2HAm1b5no4xWinqqH9Zm5rkN2qN7BDjouYWY9oyp2xd2Fu49"]'
2026-03-05 04:35:30.209 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:35:30.212 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43912/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/newsService/1.0/weekly/protobuf"]'
2026-03-05 04:35:30.218 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:35:30.221 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31028/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/newsService/1.0/alerts/xml"]'
2026-03-05 04:35:30.228 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:35:30.229 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43912/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/newsService/1.0/weekly/protobuf", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:35:30.240 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:35:30.240 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-05 04:35:30.341 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-05 04:35:30.341 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43912/relay/v1/auto/messages/%2FnewsService%2F1.0%2Fweekly%2Fprotobuf" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:30.345 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/newsService/1.0/weekly/protobuf","version":0,"timestamp":1772685330228846530,"ephemeral":false,"proof":""}]'
2026-03-05 04:35:30.347 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-05 04:35:30.347 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31028/relay/v1/auto/messages/%2FnewsService%2F1.0%2Fweekly%2Fprotobuf" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:30.351 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:31028/relay/v1/auto/messages/%2FnewsService%2F1.0%2Fweekly%2Fprotobuf. Response content: b'/newsService/1.0/weekly/protobuf'
2026-03-05 04:35:30.388 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-05 04:35:30.389 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-05 04:35:30.389 DEBUG [src.node.waku_node] Stopping container with id 6958f5151d08
2026-03-05 04:35:30.994 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:35:30.995 DEBUG [src.node.waku_node] Stopping container with id 7eedbde664fe
2026-03-05 04:35:31.580 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:35:31.583 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-05 04:35:31.615 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:35:31.646 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:35:31.648 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-05 04:35:31.648 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-05 04:35:31.649 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-05_04-35-26__3e7e9343-d632-4b41-adb0-b22d82caaf77__wakuorg_nwaku:latest.log
2026-03-05 04:35:31.650 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-05_04-35-26__3e7e9343-d632-4b41-adb0-b22d82caaf77__wakuorg_nwaku:latest.log
2026-03-05 04:35:31.654 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-05 04:35:31.654 DEBUG [tests.conftest] Running test: test_2_nodes_different_content_topic_same_shard with id: 2026-03-05_04-35-31__2ba532f6-e204-438a-99fa-2693e0c39916
2026-03-05 04:35:31.655 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-05 04:35:31.655 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-05 04:35:31.655 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-05 04:35:31.663 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:35:31.664 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-05_04-35-31__2ba532f6-e204-438a-99fa-2693e0c39916__wakuorg_nwaku:latest.log
2026-03-05 04:35:31.664 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:35:31.664 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:35:31.666 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:35:31.666 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.18.16
2026-03-05 04:35:31.666 DEBUG [src.node.docker_mananger] Generated ports ['56359', '56360', '56361', '56362', '56363']
2026-03-05 04:35:31.666 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:35:31.666 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:35:31.666 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:35:31.667 DEBUG [src.node.docker_mananger] docker run -i -t -p 56359:56359 -p 56360:56360 -p 56361:56361 -p 56362:56362 -p 56363:56363 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=56361 --rest-port=56359 --tcp-port=56360 --discv5-udp-port=56362 --rest-address=0.0.0.0 --nat=extip:172.18.18.16 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=c1bee17fa41c89b8b0ceb04fa26e7b2666da68f1ede95a7dacf047a76dfab6f5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=56363 --metrics-logging=true --relay=true --filter=true --content-topic=/newsService/1.0/weekly/protobuf
2026-03-05 04:35:31.850 ERROR [src.node.docker_mananger] Max retries reached for container 6958f5151d08. Exiting log stream.
2026-03-05 04:35:31.873 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.18.16 waku 17198e4e0f30bfb99be6decb7de70beef108ba4131fdc6df8d0182e16b1315fe
2026-03-05 04:35:31.910 DEBUG [src.node.docker_mananger] Container started with ID 17198e4e0f30. Setting up logs at ./log/docker/node1_2026-03-05_04-35-31__2ba532f6-e204-438a-99fa-2693e0c39916__wakuorg_nwaku:latest.log
2026-03-05 04:35:31.911 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 56359
2026-03-05 04:35:31.911 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:35:32.427 ERROR [src.node.docker_mananger] Max retries reached for container 7eedbde664fe. Exiting log stream.
2026-03-05 04:35:32.913 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56359/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:32.922 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:33.022 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56359/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:33.025 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:35:33.025 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:35:33.026 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56359/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:33.028 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.18.16/tcp/56360/p2p/16Uiu2HAm7K5fph8W1S3FE71fgPN9KUWVpTZMmJzYiELYBfrzTiGQ","/ip4/172.18.18.16/tcp/56361/ws/p2p/16Uiu2HAm7K5fph8W1S3FE71fgPN9KUWVpTZMmJzYiELYBfrzTiGQ"],"enrUri":"enr:-L24QOi-e06edCt2WaES5fQOiFc1UodNiyC3FOJBxhmfLSZ_Jk1HA4WAR4-4nDV3Vls0OLKYhT897ZHk2SNnX0IE44ACgmlkgnY0gmlwhKwSEhCKbXVsdGlhZGRyc5YACASsEhIQBtwoAAoErBISEAbcKd0DgnJzhQACAQAAiXNlY3AyNTZrMaECsJv2yTXk7KvHz7agv_m0y7kpNjArXLsMdw2Jjef2wgGDdGNwgtwog3VkcILcKoV3YWt1MgU"}'
2026-03-05 04:35:33.028 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:35:33.035 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:35:33.036 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-05_04-35-31__2ba532f6-e204-438a-99fa-2693e0c39916__wakuorg_nwaku:latest.log
2026-03-05 04:35:33.036 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:35:33.036 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:35:33.037 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:35:33.038 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.126.111
2026-03-05 04:35:33.038 DEBUG [src.node.docker_mananger] Generated ports ['9727', '9728', '9729', '9730', '9731']
2026-03-05 04:35:33.038 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:35:33.038 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:35:33.038 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:35:33.038 DEBUG [src.node.docker_mananger] docker run -i -t -p 9727:9727 -p 9728:9728 -p 9729:9729 -p 9730:9730 -p 9731:9731 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=9729 --rest-port=9727 --tcp-port=9728 --discv5-udp-port=9730 --rest-address=0.0.0.0 --nat=extip:172.18.126.111 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=1f1fa31adfefdec44ade093ad7ea5886545fd287ab5b8c1facfe2abc214da3f5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=9731 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QOi-e06edCt2WaES5fQOiFc1UodNiyC3FOJBxhmfLSZ_Jk1HA4WAR4-4nDV3Vls0OLKYhT897ZHk2SNnX0IE44ACgmlkgnY0gmlwhKwSEhCKbXVsdGlhZGRyc5YACASsEhIQBtwoAAoErBISEAbcKd0DgnJzhQACAQAAiXNlY3AyNTZrMaECsJv2yTXk7KvHz7agv_m0y7kpNjArXLsMdw2Jjef2wgGDdGNwgtwog3VkcILcKoV3YWt1MgU --content-topic=/newsService/1.0/alerts/xml
2026-03-05 04:35:33.253 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.126.111 waku 54c655378f2636fa878eb1b67c7f8f5a84957cba24d02280ee9e55854867c861
2026-03-05 04:35:33.290 DEBUG [src.node.docker_mananger] Container started with ID 54c655378f26. Setting up logs at ./log/docker/node2_2026-03-05_04-35-31__2ba532f6-e204-438a-99fa-2693e0c39916__wakuorg_nwaku:latest.log
2026-03-05 04:35:33.290 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 9727
2026-03-05 04:35:33.290 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:35:34.291 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9727/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:34.294 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:34.394 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9727/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:34.398 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:34.498 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9727/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:34.501 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:34.602 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9727/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:34.604 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:34.705 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9727/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:34.708 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:34.808 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9727/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:34.811 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:34.911 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9727/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:34.914 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:35.015 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9727/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:35.017 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:35.118 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9727/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:35.121 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:35.221 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9727/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:35.224 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:35:35.325 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9727/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:35.328 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:35:35.328 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:35:35.328 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9727/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:35.330 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.126.111/tcp/9728/p2p/16Uiu2HAmHPxiD6dwEJM5eSVBquU8fCbk11Q8UyhrFSxmBmAJVvqR","/ip4/172.18.126.111/tcp/9729/ws/p2p/16Uiu2HAmHPxiD6dwEJM5eSVBquU8fCbk11Q8UyhrFSxmBmAJVvqR"],"enrUri":"enr:-L24QCksxy6jv6NeRJLq9s-gRyT6HrI2hbpwgROGbzxEkowwMF1YCnZqSAg4xpltc7oG9Qr8-yziixmS7Q2-GjwHAvUCgmlkgnY0gmlwhKwSfm-KbXVsdGlhZGRyc5YACASsEn5vBiYAAAoErBJ-bwYmAd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDRnDecQSYVacJoo4aywmkn-Vc5LhA75lM4TVV7NQSYnyDdGNwgiYAg3VkcIImAoV3YWt1MgE"}'
2026-03-05 04:35:35.331 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:35:35.331 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9727/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.18.16/tcp/56360/p2p/16Uiu2HAm7K5fph8W1S3FE71fgPN9KUWVpTZMmJzYiELYBfrzTiGQ"]'
2026-03-05 04:35:35.357 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:35:35.358 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56359/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/newsService/1.0/weekly/protobuf"]'
2026-03-05 04:35:35.363 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:35:35.364 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9727/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/newsService/1.0/alerts/xml"]'
2026-03-05 04:35:35.372 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:35:35.373 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56359/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/newsService/1.0/weekly/protobuf", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:35:35.385 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:35:35.386 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-05 04:35:35.488 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-05 04:35:35.488 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56359/relay/v1/auto/messages/%2FnewsService%2F1.0%2Fweekly%2Fprotobuf" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:35:35.491 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/newsService/1.0/weekly/protobuf","version":0,"timestamp":1772685330228846530,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/newsService/1.0/weekly/protobuf","version":0,"timestamp":1772685335372864381,"ephemeral":false,"proof":""}]'
2026-03-05 04:35:35.501 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-05 04:35:35.503 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-05 04:35:35.503 DEBUG [src.node.waku_node] Stopping container with id 17198e4e0f30
2026-03-05 04:35:36.089 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:35:36.091 DEBUG [src.node.waku_node] Stopping container with id 54c655378f26
2026-03-05 04:35:36.689 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:35:36.691 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-05 04:35:36.752 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:35:36.782 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:35:36.783 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-05 04:35:36.783 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-05 04:35:36.784 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-05_04-35-31__2ba532f6-e204-438a-99fa-2693e0c39916__wakuorg_nwaku:latest.log
2026-03-05 04:35:36.785 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-05_04-35-31__2ba532f6-e204-438a-99fa-2693e0c39916__wakuorg_nwaku:latest.log