2026-02-25 07:41:35 +00:00

163 lines
30 KiB
Plaintext

2026-02-25 07:23:03.389 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-25 07:23:03.389 DEBUG [tests.conftest] Running test: test_optional_nodes_not_subscribed_to_same_pubsub_topic with id: 2026-02-25_07-23-03__08a98009-01f7-462a-9e63-3f778ee78836
2026-02-25 07:23:03.389 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-25 07:23:03.390 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-25 07:23:03.390 DEBUG [src.steps.relay] Running fixture setup: setup_main_relay_nodes
2026-02-25 07:23:03.396 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 07:23:03.396 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-25_07-23-03__08a98009-01f7-462a-9e63-3f778ee78836__wakuorg_nwaku:latest.log
2026-02-25 07:23:03.396 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 07:23:03.396 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 07:23:03.397 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 07:23:03.398 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.93.190
2026-02-25 07:23:03.398 DEBUG [src.node.docker_mananger] Generated ports ['35649', '35650', '35651', '35652', '35653']
2026-02-25 07:23:03.398 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 07:23:03.398 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 07:23:03.398 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 07:23:03.398 DEBUG [src.node.docker_mananger] docker run -i -t -p 35649:35649 -p 35650:35650 -p 35651:35651 -p 35652:35652 -p 35653:35653 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=35651 --rest-port=35649 --tcp-port=35650 --discv5-udp-port=35652 --rest-address=0.0.0.0 --nat=extip:172.18.93.190 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ccf7603d7efcbdab0e6082fca24a20095ccebc99cfaf5faca3eea5810abb0da0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=35653 --metrics-logging=true --relay=true
2026-02-25 07:23:03.584 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.93.190 waku 8ab7d501a5a869ac3ad1663558cd209138de940edfad5e24f21c49022043582a
2026-02-25 07:23:03.616 DEBUG [src.node.docker_mananger] Container started with ID 8ab7d501a5a8. Setting up logs at ./log/docker/node1_2026-02-25_07-23-03__08a98009-01f7-462a-9e63-3f778ee78836__wakuorg_nwaku:latest.log
2026-02-25 07:23:03.616 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 35649
2026-02-25 07:23:03.617 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 07:23:03.633 ERROR [src.node.docker_mananger] Max retries reached for container 3dc747fa0e79. Exiting log stream.
2026-02-25 07:23:04.169 ERROR [src.node.docker_mananger] Max retries reached for container 602e77d3f572. Exiting log stream.
2026-02-25 07:23:04.618 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35649/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:04.621 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 07:23:04.621 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 07:23:04.621 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35649/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:04.624 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.93.190/tcp/35650/p2p/16Uiu2HAm2Y6ZKGgH6NVohxUKcCHDna6JbvLYtMMUMoaw5t2JAFay","/ip4/172.18.93.190/tcp/35651/ws/p2p/16Uiu2HAm2Y6ZKGgH6NVohxUKcCHDna6JbvLYtMMUMoaw5t2JAFay"],"enrUri":"enr:-L24QNIHiXMk4hG6rlxhwNMNj9cKA8FdlpcNNumzC56Y6EYkEbQ5El2OSADmW2w_2fFnJI6HFBIgjm--jjrZKYPKog8CgmlkgnY0gmlwhKwSXb6KbXVsdGlhZGRyc5YACASsEl2-BotCAAoErBJdvgaLQ90DgnJzhQADAQAAiXNlY3AyNTZrMaECaacVb-xNkLsoj03xwgvzYGzQ-Uvs2OS6X_A_6lKjf4KDdGNwgotCg3VkcIKLRIV3YWt1MgE"}'
2026-02-25 07:23:04.624 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 07:23:04.630 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 07:23:04.630 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-25_07-23-03__08a98009-01f7-462a-9e63-3f778ee78836__wakuorg_nwaku:latest.log
2026-02-25 07:23:04.630 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 07:23:04.630 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 07:23:04.632 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 07:23:04.632 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.150.211
2026-02-25 07:23:04.632 DEBUG [src.node.docker_mananger] Generated ports ['9242', '9243', '9244', '9245', '9246']
2026-02-25 07:23:04.632 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 07:23:04.632 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 07:23:04.632 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 07:23:04.632 DEBUG [src.node.docker_mananger] docker run -i -t -p 9242:9242 -p 9243:9243 -p 9244:9244 -p 9245:9245 -p 9246:9246 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=9244 --rest-port=9242 --tcp-port=9243 --discv5-udp-port=9245 --rest-address=0.0.0.0 --nat=extip:172.18.150.211 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cc0f76cc26dbc28d4d49c996c4bffbe13ef5fafdc8c609adf808a736b6d3bcf7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=9246 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNIHiXMk4hG6rlxhwNMNj9cKA8FdlpcNNumzC56Y6EYkEbQ5El2OSADmW2w_2fFnJI6HFBIgjm--jjrZKYPKog8CgmlkgnY0gmlwhKwSXb6KbXVsdGlhZGRyc5YACASsEl2-BotCAAoErBJdvgaLQ90DgnJzhQADAQAAiXNlY3AyNTZrMaECaacVb-xNkLsoj03xwgvzYGzQ-Uvs2OS6X_A_6lKjf4KDdGNwgotCg3VkcIKLRIV3YWt1MgE
2026-02-25 07:23:04.820 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.150.211 waku 43fb73397565ff2ec5b84d9eb474cede09fe94e3b9675d7b307ea6bc85cfb8af
2026-02-25 07:23:04.850 DEBUG [src.node.docker_mananger] Container started with ID 43fb73397565. Setting up logs at ./log/docker/node2_2026-02-25_07-23-03__08a98009-01f7-462a-9e63-3f778ee78836__wakuorg_nwaku:latest.log
2026-02-25 07:23:04.850 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 9242
2026-02-25 07:23:04.851 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 07:23:05.852 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9242/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:05.874 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 07:23:05.874 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 07:23:05.875 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9242/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:05.881 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.150.211/tcp/9243/p2p/16Uiu2HAmACDkLRtabPsD2qfEFfpdnr2MGNNoYrtdGLNtvVNrECjr","/ip4/172.18.150.211/tcp/9244/ws/p2p/16Uiu2HAmACDkLRtabPsD2qfEFfpdnr2MGNNoYrtdGLNtvVNrECjr"],"enrUri":"enr:-L24QAeuqWlCX7AFBqQlWWK4eJ6b4FtjrWKYoPsYfJa8DFERVareqWkAsB8JMwN-Rrd3_oop_D9KAXZ0DeWChA71yCkCgmlkgnY0gmlwhKwSltOKbXVsdGlhZGRyc5YACASsEpbTBiQbAAoErBKW0wYkHN0DgnJzhQADAQAAiXNlY3AyNTZrMaEC220XvPNIZLQm3qmpR2lrqW9sTrcTweYJoxj9Z9FkyPmDdGNwgiQbg3VkcIIkHYV3YWt1MgE"}'
2026-02-25 07:23:05.881 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 07:23:05.882 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9242/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.93.190/tcp/35650/p2p/16Uiu2HAm2Y6ZKGgH6NVohxUKcCHDna6JbvLYtMMUMoaw5t2JAFay"]'
2026-02-25 07:23:05.886 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:23:05.887 DEBUG [src.steps.relay] Running fixture setup: setup_optional_relay_nodes
2026-02-25 07:23:05.895 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 07:23:05.895 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-25_07-23-03__08a98009-01f7-462a-9e63-3f778ee78836__wakuorg_nwaku:latest.log
2026-02-25 07:23:05.895 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 07:23:05.896 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 07:23:05.897 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 07:23:05.897 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.185.142
2026-02-25 07:23:05.897 DEBUG [src.node.docker_mananger] Generated ports ['48815', '48816', '48817', '48818', '48819']
2026-02-25 07:23:05.897 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 07:23:05.897 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 07:23:05.897 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 07:23:05.898 DEBUG [src.node.docker_mananger] docker run -i -t -p 48815:48815 -p 48816:48816 -p 48817:48817 -p 48818:48818 -p 48819:48819 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=48817 --rest-port=48815 --tcp-port=48816 --discv5-udp-port=48818 --rest-address=0.0.0.0 --nat=extip:172.18.185.142 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e26336e37e4b48a4c1f3c82ea81c8ad4dd7c1892b1ff7a160ca6add0d530cd0f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=48819 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNIHiXMk4hG6rlxhwNMNj9cKA8FdlpcNNumzC56Y6EYkEbQ5El2OSADmW2w_2fFnJI6HFBIgjm--jjrZKYPKog8CgmlkgnY0gmlwhKwSXb6KbXVsdGlhZGRyc5YACASsEl2-BotCAAoErBJdvgaLQ90DgnJzhQADAQAAiXNlY3AyNTZrMaECaacVb-xNkLsoj03xwgvzYGzQ-Uvs2OS6X_A_6lKjf4KDdGNwgotCg3VkcIKLRIV3YWt1MgE
2026-02-25 07:23:06.092 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.185.142 waku e78b0dbd404b0577af914183e0de38e51fc92378695c4c194d2c2c2c9c3f410b
2026-02-25 07:23:06.121 DEBUG [src.node.docker_mananger] Container started with ID e78b0dbd404b. Setting up logs at ./log/docker/node3_2026-02-25_07-23-03__08a98009-01f7-462a-9e63-3f778ee78836__wakuorg_nwaku:latest.log
2026-02-25 07:23:06.121 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 48815
2026-02-25 07:23:06.121 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 07:23:07.126 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48815/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:07.142 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 07:23:07.142 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 07:23:07.144 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48815/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:07.148 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.185.142/tcp/48816/p2p/16Uiu2HAmA6Mwor6H35W6HwaFVYmBb7L66KaNZBnUryt2waLDqw2t","/ip4/172.18.185.142/tcp/48817/ws/p2p/16Uiu2HAmA6Mwor6H35W6HwaFVYmBb7L66KaNZBnUryt2waLDqw2t"],"enrUri":"enr:-L24QHX3UQWhdJEWMiVzgJFCnPV06cSg8wOwqwnPGtoyAWOBfHvTRSyn24jWpG1Nqsf9uNSXCFpndpzzzEw6rGdhhbkCgmlkgnY0gmlwhKwSuY6KbXVsdGlhZGRyc5YACASsErmOBr6wAAoErBK5jga-sd0DgnJzhQADAQAAiXNlY3AyNTZrMaEC2ezgjZfOWfyY0cPt6kfaMJ_oyJ2AR4ibHFuOFdaIcWWDdGNwgr6wg3VkcIK-soV3YWt1MgE"}'
2026-02-25 07:23:07.149 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 07:23:07.149 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48815/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.93.190/tcp/35650/p2p/16Uiu2HAm2Y6ZKGgH6NVohxUKcCHDna6JbvLYtMMUMoaw5t2JAFay"]'
2026-02-25 07:23:07.152 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:23:07.159 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 07:23:07.159 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-02-25_07-23-03__08a98009-01f7-462a-9e63-3f778ee78836__wakuorg_nwaku:latest.log
2026-02-25 07:23:07.159 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 07:23:07.159 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 07:23:07.160 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 07:23:07.160 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.38.241
2026-02-25 07:23:07.161 DEBUG [src.node.docker_mananger] Generated ports ['14561', '14562', '14563', '14564', '14565']
2026-02-25 07:23:07.161 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 07:23:07.161 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 07:23:07.161 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 07:23:07.161 DEBUG [src.node.docker_mananger] docker run -i -t -p 14561:14561 -p 14562:14562 -p 14563:14563 -p 14564:14564 -p 14565:14565 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=14563 --rest-port=14561 --tcp-port=14562 --discv5-udp-port=14564 --rest-address=0.0.0.0 --nat=extip:172.18.38.241 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dfcf9fcf25f90dbec210c324a2db76cfebdea52bcac92f0ab55cec8aa13f921e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=14565 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNIHiXMk4hG6rlxhwNMNj9cKA8FdlpcNNumzC56Y6EYkEbQ5El2OSADmW2w_2fFnJI6HFBIgjm--jjrZKYPKog8CgmlkgnY0gmlwhKwSXb6KbXVsdGlhZGRyc5YACASsEl2-BotCAAoErBJdvgaLQ90DgnJzhQADAQAAiXNlY3AyNTZrMaECaacVb-xNkLsoj03xwgvzYGzQ-Uvs2OS6X_A_6lKjf4KDdGNwgotCg3VkcIKLRIV3YWt1MgE
2026-02-25 07:23:07.355 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.38.241 waku 738c071b58ac9d187caaf4285c219e280009aec4de648ad022b9c836920ace61
2026-02-25 07:23:07.386 DEBUG [src.node.docker_mananger] Container started with ID 738c071b58ac. Setting up logs at ./log/docker/node4_2026-02-25_07-23-03__08a98009-01f7-462a-9e63-3f778ee78836__wakuorg_nwaku:latest.log
2026-02-25 07:23:07.386 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 14561
2026-02-25 07:23:07.387 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 07:23:08.388 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14561/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:08.399 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 07:23:08.400 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 07:23:08.400 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14561/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:08.406 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.38.241/tcp/14562/p2p/16Uiu2HAmHkwQvL9d9diuaLdRrMtwhVJY3ZpMZCnjjvECx2SEZ9e5","/ip4/172.18.38.241/tcp/14563/ws/p2p/16Uiu2HAmHkwQvL9d9diuaLdRrMtwhVJY3ZpMZCnjjvECx2SEZ9e5"],"enrUri":"enr:-L24QHMdGrPbqVT2oq0LnFLS8NmvpTqgFhI3Szr_4JPvr557WDBPSMciD-yp65XrFqDuB6rV0C7zxdr19bkTZdS4XcUCgmlkgnY0gmlwhKwSJvGKbXVsdGlhZGRyc5YACASsEibxBjjiAAoErBIm8QY4490DgnJzhQADAQAAiXNlY3AyNTZrMaEDS9CZIF41iAkxWcwz2YrFI65zWce_AoxRMjMCOF7gpbaDdGNwgjjig3VkcII45IV3YWt1MgE"}'
2026-02-25 07:23:08.407 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 07:23:08.408 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14561/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.93.190/tcp/35650/p2p/16Uiu2HAm2Y6ZKGgH6NVohxUKcCHDna6JbvLYtMMUMoaw5t2JAFay"]'
2026-02-25 07:23:08.410 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:23:08.417 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 07:23:08.417 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-02-25_07-23-03__08a98009-01f7-462a-9e63-3f778ee78836__wakuorg_nwaku:latest.log
2026-02-25 07:23:08.417 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 07:23:08.417 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 07:23:08.419 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 07:23:08.419 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.133.227
2026-02-25 07:23:08.419 DEBUG [src.node.docker_mananger] Generated ports ['14488', '14489', '14490', '14491', '14492']
2026-02-25 07:23:08.419 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 07:23:08.419 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 07:23:08.419 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 07:23:08.419 DEBUG [src.node.docker_mananger] docker run -i -t -p 14488:14488 -p 14489:14489 -p 14490:14490 -p 14491:14491 -p 14492:14492 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=14490 --rest-port=14488 --tcp-port=14489 --discv5-udp-port=14491 --rest-address=0.0.0.0 --nat=extip:172.18.133.227 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=4acda238a0b5e4fb49f7df9ca58e4c53fbf84484ea4c146cb3bdaabf8150c6be --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=14492 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNIHiXMk4hG6rlxhwNMNj9cKA8FdlpcNNumzC56Y6EYkEbQ5El2OSADmW2w_2fFnJI6HFBIgjm--jjrZKYPKog8CgmlkgnY0gmlwhKwSXb6KbXVsdGlhZGRyc5YACASsEl2-BotCAAoErBJdvgaLQ90DgnJzhQADAQAAiXNlY3AyNTZrMaECaacVb-xNkLsoj03xwgvzYGzQ-Uvs2OS6X_A_6lKjf4KDdGNwgotCg3VkcIKLRIV3YWt1MgE
2026-02-25 07:23:08.612 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.133.227 waku 588aaeb72d956d0d3f5d657700631301573d8c149a2768d5aa811da31e64e347
2026-02-25 07:23:08.643 DEBUG [src.node.docker_mananger] Container started with ID 588aaeb72d95. Setting up logs at ./log/docker/node5_2026-02-25_07-23-03__08a98009-01f7-462a-9e63-3f778ee78836__wakuorg_nwaku:latest.log
2026-02-25 07:23:08.644 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 14488
2026-02-25 07:23:08.644 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 07:23:09.644 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14488/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:09.656 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 07:23:09.657 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 07:23:09.657 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14488/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:09.664 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.133.227/tcp/14489/p2p/16Uiu2HAmE9Hwjpe9p4SLAQFNMjCqj5JQfkUJVRZEV9XTWzDtiLQA","/ip4/172.18.133.227/tcp/14490/ws/p2p/16Uiu2HAmE9Hwjpe9p4SLAQFNMjCqj5JQfkUJVRZEV9XTWzDtiLQA"],"enrUri":"enr:-L24QL24gz4qc2OtaEnKon8ayRJxWs_7TneLiXAu9sN4xbORanYm7jrQCZXRHyKF8uAtIzMBJLTHjVhvUcdFMhHJbQUCgmlkgnY0gmlwhKwSheOKbXVsdGlhZGRyc5YACASsEoXjBjiZAAoErBKF4wY4mt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDFhvX1xjhl29mBS0QDZxlXC3iDxTbzbtCDC3wOHGY18ODdGNwgjiZg3VkcII4m4V3YWt1MgE"}'
2026-02-25 07:23:09.664 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 07:23:09.665 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14488/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.93.190/tcp/35650/p2p/16Uiu2HAm2Y6ZKGgH6NVohxUKcCHDna6JbvLYtMMUMoaw5t2JAFay"]'
2026-02-25 07:23:09.667 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:23:09.668 DEBUG [src.steps.relay] Running fixture setup: subscribe_main_relay_nodes
2026-02-25 07:23:09.668 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35649/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 07:23:09.677 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:23:09.678 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9242/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 07:23:09.683 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:23:09.686 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35649/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:23:09.690 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:23:09.691 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-02-25 07:23:09.791 DEBUG [src.steps.relay] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-02-25 07:23:09.791 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35649/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:09.793 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772004189686080512,"ephemeral":false,"proof":""}]'
2026-02-25 07:23:09.795 DEBUG [src.steps.relay] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-02-25 07:23:09.795 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9242/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:09.797 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772004189686080512,"ephemeral":false,"proof":""}]'
2026-02-25 07:23:09.799 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35649/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:23:09.802 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:23:09.803 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-02-25 07:23:09.903 DEBUG [src.steps.relay] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-02-25 07:23:09.903 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48815/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:23:09.905 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:48815/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1. Response content: b''
2026-02-25 07:23:09.908 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-25 07:23:09.909 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-25 07:23:09.909 DEBUG [src.node.waku_node] Stopping container with id 8ab7d501a5a8
2026-02-25 07:23:10.511 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 07:23:10.511 DEBUG [src.node.waku_node] Stopping container with id 43fb73397565
2026-02-25 07:23:11.058 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 07:23:11.060 DEBUG [src.node.waku_node] Stopping container with id e78b0dbd404b
2026-02-25 07:23:11.324 ERROR [src.node.docker_mananger] Max retries reached for container 8ab7d501a5a8. Exiting log stream.
2026-02-25 07:23:11.612 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 07:23:11.612 DEBUG [src.node.waku_node] Stopping container with id 738c071b58ac
2026-02-25 07:23:11.871 ERROR [src.node.docker_mananger] Max retries reached for container 43fb73397565. Exiting log stream.
2026-02-25 07:23:12.136 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 07:23:12.137 DEBUG [src.node.waku_node] Stopping container with id 588aaeb72d95
2026-02-25 07:23:12.425 ERROR [src.node.docker_mananger] Max retries reached for container e78b0dbd404b. Exiting log stream.
2026-02-25 07:23:12.637 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 07:23:12.639 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-25 07:23:12.654 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 07:23:12.660 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 07:23:12.665 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 07:23:12.670 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 07:23:12.675 DEBUG [src.node.docker_mananger] No errors found in the waku logs.