162 lines
31 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_optional_nodes_not_subscribed_to_same_pubsub_topic with id: 2026-03-12_04-33-39__0121f6ad-8eb4-4acb-a353-2b4db392bf51
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.steps.relay:relay.py:34 Running fixture setup: setup_main_relay_nodes
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-03-12_04-33-39__0121f6ad-8eb4-4acb-a353-2b4db392bf51__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.109.64
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['44566', '44567', '44568', '44569', '44570']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 44566:44566 -p 44567:44567 -p 44568:44568 -p 44569:44569 -p 44570:44570 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=44568 --rest-port=44566 --tcp-port=44567 --discv5-udp-port=44569 --rest-address=0.0.0.0 --nat=extip:172.18.109.64 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=89a6cf997ab7bb6d68ef381db4c8a6fc85ccc8cb30696c86e38a3ecc89e1f958 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=44570 --metrics-logging=true --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.109.64 waku 8df6c8fbbd05807d974311a7196722f76c1191ab2e44133f800120d02d4f95b1
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 6157f4b8107e. Exiting log stream.
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 8df6c8fbbd05. Setting up logs at ./log/docker/node1_2026-03-12_04-33-39__0121f6ad-8eb4-4acb-a353-2b4db392bf51__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 44566
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 58babff732b5. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:44566/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:44566/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.109.64/tcp/44567/p2p/16Uiu2HAmGotYf8NpYnJWf5xtHamQcD2uR4QebCeZkjivSHAaV2io","/ip4/172.18.109.64/tcp/44568/ws/p2p/16Uiu2HAmGotYf8NpYnJWf5xtHamQcD2uR4QebCeZkjivSHAaV2io"],"enrUri":"enr:-L24QKMGhlD6_SQBKiGigmQ2vgsfDJl6QOInwS2AN2H2VztbNaoj8iz3QMPUXLCFDkawLgn7ZF3G2aA38FvTtnmQc_8CgmlkgnY0gmlwhKwSbUCKbXVsdGlhZGRyc5YACASsEm1ABq4XAAoErBJtQAauGN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDPbZpklipeNYbXBpNczues1AAYSSdcmDATvRE0uPoDiyDdGNwgq4Xg3VkcIKuGYV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-03-12_04-33-39__0121f6ad-8eb4-4acb-a353-2b4db392bf51__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.194.162
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['28064', '28065', '28066', '28067', '28068']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 28064:28064 -p 28065:28065 -p 28066:28066 -p 28067:28067 -p 28068:28068 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=28066 --rest-port=28064 --tcp-port=28065 --discv5-udp-port=28067 --rest-address=0.0.0.0 --nat=extip:172.18.194.162 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f6be9524b7aa5d10b21b3e8ac1cdf1ab6b07c7bae6dcecbd0cdadcecefc5c20d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=28068 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKMGhlD6_SQBKiGigmQ2vgsfDJl6QOInwS2AN2H2VztbNaoj8iz3QMPUXLCFDkawLgn7ZF3G2aA38FvTtnmQc_8CgmlkgnY0gmlwhKwSbUCKbXVsdGlhZGRyc5YACASsEm1ABq4XAAoErBJtQAauGN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDPbZpklipeNYbXBpNczues1AAYSSdcmDATvRE0uPoDiyDdGNwgq4Xg3VkcIKuGYV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.194.162 waku f538362cf2576f536ae35c8d04ca269eaec565df7c51e2c28d174979f6474ce2
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID f538362cf257. Setting up logs at ./log/docker/node2_2026-03-12_04-33-39__0121f6ad-8eb4-4acb-a353-2b4db392bf51__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 28064
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28064/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28064/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.194.162/tcp/28065/p2p/16Uiu2HAmN8nXjqTSKzHxdfn86tCu9BDftc7TQ5To9rEFi1TmTd9R","/ip4/172.18.194.162/tcp/28066/ws/p2p/16Uiu2HAmN8nXjqTSKzHxdfn86tCu9BDftc7TQ5To9rEFi1TmTd9R"],"enrUri":"enr:-L24QDchU8mjHcGToglNwND1cJ5rNbpZOoNUd0WNdZMAyujtcpmwrnRb6E9ydRRcTJQqE5yE3x9lUqiv48-FVJu4vkkCgmlkgnY0gmlwhKwSwqKKbXVsdGlhZGRyc5YACASsEsKiBm2hAAoErBLCogZtot0DgnJzhQADAQAAiXNlY3AyNTZrMaEDjNgUi-NjGmiMVId_nppsOmTd_0asq8DKgm6weKHaBoiDdGNwgm2hg3VkcIJto4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:28064/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.109.64/tcp/44567/p2p/16Uiu2HAmGotYf8NpYnJWf5xtHamQcD2uR4QebCeZkjivSHAaV2io"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.steps.relay:relay.py:46 Running fixture setup: setup_optional_relay_nodes
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node3_2026-03-12_04-33-39__0121f6ad-8eb4-4acb-a353-2b4db392bf51__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.178.21
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['53646', '53647', '53648', '53649', '53650']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 53646:53646 -p 53647:53647 -p 53648:53648 -p 53649:53649 -p 53650:53650 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=53648 --rest-port=53646 --tcp-port=53647 --discv5-udp-port=53649 --rest-address=0.0.0.0 --nat=extip:172.18.178.21 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ee1f2bab31dff4ca2c4e018c207bdcc7e7c19ca9c43a5cedd10cf0bce7dfeafc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=53650 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKMGhlD6_SQBKiGigmQ2vgsfDJl6QOInwS2AN2H2VztbNaoj8iz3QMPUXLCFDkawLgn7ZF3G2aA38FvTtnmQc_8CgmlkgnY0gmlwhKwSbUCKbXVsdGlhZGRyc5YACASsEm1ABq4XAAoErBJtQAauGN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDPbZpklipeNYbXBpNczues1AAYSSdcmDATvRE0uPoDiyDdGNwgq4Xg3VkcIKuGYV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.178.21 waku 3032b0a4a8e769919b491e9a35fe0c81fc27ab2add349976b5976fbdc0adf2b6
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 3032b0a4a8e7. Setting up logs at ./log/docker/node3_2026-03-12_04-33-39__0121f6ad-8eb4-4acb-a353-2b4db392bf51__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 53646
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:53646/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:53646/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.178.21/tcp/53647/p2p/16Uiu2HAmJMxEf5m5fmj9J4Ra1iHFVwjv4mkaqFJkycgtYsh7dkzv","/ip4/172.18.178.21/tcp/53648/ws/p2p/16Uiu2HAmJMxEf5m5fmj9J4Ra1iHFVwjv4mkaqFJkycgtYsh7dkzv"],"enrUri":"enr:-L24QKllKTkYhUP4WbNeP-iYhKFD0MbJZuiMaG474x7Pym-US0pCko2xdIygY6beSpOZ-B9bt709-7x3lwxOUZg1wOwCgmlkgnY0gmlwhKwSshWKbXVsdGlhZGRyc5YACASsErIVBtGPAAoErBKyFQbRkN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDVMjbarrFLvg8MEkFxQDoRUeiKLZSoOhzsrR7Lb58oiuDdGNwgtGPg3VkcILRkYV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:53646/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.109.64/tcp/44567/p2p/16Uiu2HAmGotYf8NpYnJWf5xtHamQcD2uR4QebCeZkjivSHAaV2io"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node4_2026-03-12_04-33-39__0121f6ad-8eb4-4acb-a353-2b4db392bf51__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.33.59
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['21328', '21329', '21330', '21331', '21332']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 21328:21328 -p 21329:21329 -p 21330:21330 -p 21331:21331 -p 21332:21332 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=21330 --rest-port=21328 --tcp-port=21329 --discv5-udp-port=21331 --rest-address=0.0.0.0 --nat=extip:172.18.33.59 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a7802faa6b75ce3f9d0a09b0edf48c66f9ceb779d8e923ddfc20e5d213e7ca7e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=21332 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKMGhlD6_SQBKiGigmQ2vgsfDJl6QOInwS2AN2H2VztbNaoj8iz3QMPUXLCFDkawLgn7ZF3G2aA38FvTtnmQc_8CgmlkgnY0gmlwhKwSbUCKbXVsdGlhZGRyc5YACASsEm1ABq4XAAoErBJtQAauGN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDPbZpklipeNYbXBpNczues1AAYSSdcmDATvRE0uPoDiyDdGNwgq4Xg3VkcIKuGYV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.33.59 waku 6b287a0cef067d9fb20f53ab76e01d66420d47c014d9f0605f109de9adcb8191
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 6b287a0cef06. Setting up logs at ./log/docker/node4_2026-03-12_04-33-39__0121f6ad-8eb4-4acb-a353-2b4db392bf51__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 21328
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:21328/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:21328/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.33.59/tcp/21329/p2p/16Uiu2HAmVJcJV2PU9DNKUBaoeez2fW4Nhth69pX6ZMeV5KH8nC5s","/ip4/172.18.33.59/tcp/21330/ws/p2p/16Uiu2HAmVJcJV2PU9DNKUBaoeez2fW4Nhth69pX6ZMeV5KH8nC5s"],"enrUri":"enr:-L24QNCsRwqAI-j81vMeFDSqrBGFEXPZvjjsSfHlqfkAIK3yVwGgoP8zRMZbQhc8buOsi8CDEW6mK3VQXWBg0B5t0TACgmlkgnY0gmlwhKwSITuKbXVsdGlhZGRyc5YACASsEiE7BlNRAAoErBIhOwZTUt0DgnJzhQADAQAAiXNlY3AyNTZrMaED914hoo778Bu1QlQj37e_QEFNFXEjGglsuF4HWNhL2J6DdGNwglNRg3VkcIJTU4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:21328/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.109.64/tcp/44567/p2p/16Uiu2HAmGotYf8NpYnJWf5xtHamQcD2uR4QebCeZkjivSHAaV2io"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node5_2026-03-12_04-33-39__0121f6ad-8eb4-4acb-a353-2b4db392bf51__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.165.78
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['39948', '39949', '39950', '39951', '39952']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 39948:39948 -p 39949:39949 -p 39950:39950 -p 39951:39951 -p 39952:39952 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=39950 --rest-port=39948 --tcp-port=39949 --discv5-udp-port=39951 --rest-address=0.0.0.0 --nat=extip:172.18.165.78 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=33cc911bc38ca21ddaeece3ceabf9afdf1b74cb492bd1b62edafcea019a3d320 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=39952 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKMGhlD6_SQBKiGigmQ2vgsfDJl6QOInwS2AN2H2VztbNaoj8iz3QMPUXLCFDkawLgn7ZF3G2aA38FvTtnmQc_8CgmlkgnY0gmlwhKwSbUCKbXVsdGlhZGRyc5YACASsEm1ABq4XAAoErBJtQAauGN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDPbZpklipeNYbXBpNczues1AAYSSdcmDATvRE0uPoDiyDdGNwgq4Xg3VkcIKuGYV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.165.78 waku 29a6a66ac25d4e1b29fc4d11746baae203c30ba6a0ab70668755963830a0a9c9
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 29a6a66ac25d. Setting up logs at ./log/docker/node5_2026-03-12_04-33-39__0121f6ad-8eb4-4acb-a353-2b4db392bf51__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 39948
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:39948/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:39948/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.165.78/tcp/39949/p2p/16Uiu2HAm99xAEYuNNq2B6VGjs7BsEe5SEAU2dUGzvuA4cVTGq6gK","/ip4/172.18.165.78/tcp/39950/ws/p2p/16Uiu2HAm99xAEYuNNq2B6VGjs7BsEe5SEAU2dUGzvuA4cVTGq6gK"],"enrUri":"enr:-L24QD-J5_UomPxSXBvGFRR5W7V_30hbzK0YL2OQxH_05sn1TNfn0HQWwag6QZe_G1HgG-_rSEvUSUgazecwamwlG4YCgmlkgnY0gmlwhKwSpU6KbXVsdGlhZGRyc5YACASsEqVOBpwNAAoErBKlTgacDt0DgnJzhQADAQAAiXNlY3AyNTZrMaECy_yea2GlzEJ-ORFMYhDzRXSV4zwhq_5aM4dOKfRNu8yDdGNwgpwNg3VkcIKcD4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:39948/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.109.64/tcp/44567/p2p/16Uiu2HAmGotYf8NpYnJWf5xtHamQcD2uR4QebCeZkjivSHAaV2io"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.steps.relay:relay.py:59 Running fixture setup: subscribe_main_relay_nodes
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:44566/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:28064/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:44566/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.relay:relay.py:123 Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:44566/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1773290025372733184,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.relay:relay.py:123 Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:28064/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1773290025372733184,"ephemeral":false,"proof":""}]'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:44566/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.relay:relay.py:123 Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:53646/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
ERROR  src.node.api_clients.base_client:base_client.py:16 HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:53646/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1. Response content: b''
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 8df6c8fbbd05
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id f538362cf257
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 3032b0a4a8e7
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 8df6c8fbbd05. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 6b287a0cef06
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container f538362cf257. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 29a6a66ac25d
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 3032b0a4a8e7. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.