DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id DEBUG  tests.conftest:conftest.py:57 Running test: test_metadata_protocol_mounted_also_on_non_1_clusters with id: 2025-12-11_04-14-40__ccf6b188-2052-4992-9de7-070647a5e930 DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup DEBUG  src.steps.relay:relay.py:34 Running fixture setup: setup_main_relay_nodes DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2025-12-11_04-14-40__ccf6b188-2052-4992-9de7-070647a5e930__wakuorg_nwaku:latest.log DEBUG  src.node.waku_node:waku_node.py:90 Starting Node... DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.246.133 DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['13338', '13339', '13340', '13341', '13342'] DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN DEBUG  src.node.waku_node:waku_node.py:178 Using volumes [] DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 13338:13338 -p 13339:13339 -p 13340:13340 -p 13341:13341 -p 13342:13342 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13340 --rest-port=13338 --tcp-port=13339 --discv5-udp-port=13341 --rest-address=0.0.0.0 --nat=extip:172.18.246.133 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=4a6fafc70929bc20baf0e9db983836bca2fbb5a8280a2924553ec8363755bdf5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13342 --metrics-logging=true --relay=true DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.246.133 waku a7533324b8200b7bbcc83366615583da99285d231a4c35fa59c84abbb12cc9ef DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID a7533324b820. Setting up logs at ./log/docker/node1_2025-12-11_04-14-40__ccf6b188-2052-4992-9de7-070647a5e930__wakuorg_nwaku:latest.log DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 13338 DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container d377338a10a9. Exiting log stream. ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container fc67733b53be. Exiting log stream. INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:13338/health" -H "Content-Type: application/json" -d 'None' INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}' INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !! INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:13338/debug/v1/info" -H "Content-Type: application/json" -d 'None' INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.246.133/tcp/13339/p2p/16Uiu2HAmF2GHUwLJB8vxMvVTNfTZuHDi6rmX4jFf5tyPtV7X39xm","/ip4/172.18.246.133/tcp/13340/ws/p2p/16Uiu2HAmF2GHUwLJB8vxMvVTNfTZuHDi6rmX4jFf5tyPtV7X39xm"],"enrUri":"enr:-L24QBUo4uPNIR7DyOXrbHABPCKtVSA5hWRMyRI218GfnC7DZPAewjqQW8N8-miIs2oxxQdHZPghQS7vNAzMUQMhaMECgmlkgnY0gmlwhKwS9oWKbXVsdGlhZGRyc5YACASsEvaFBjQbAAoErBL2hQY0HN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDIyqWfw9q6R9K6uERSyROnaqGpTeShFE2IG-apr2GDDKDdGNwgjQbg3VkcII0HYV3YWt1MgE"}' INFO  src.node.waku_node:waku_node.py:292 REST service is ready !! DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2025-12-11_04-14-40__ccf6b188-2052-4992-9de7-070647a5e930__wakuorg_nwaku:latest.log DEBUG  src.node.waku_node:waku_node.py:90 Starting Node... DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.227.230 DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['38087', '38088', '38089', '38090', '38091'] DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN DEBUG  src.node.waku_node:waku_node.py:178 Using volumes [] DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 38087:38087 -p 38088:38088 -p 38089:38089 -p 38090:38090 -p 38091:38091 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=38089 --rest-port=38087 --tcp-port=38088 --discv5-udp-port=38090 --rest-address=0.0.0.0 --nat=extip:172.18.227.230 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=3c9fcae3f6bceeabadfa115c9bfaab3df63b7bb3a2e017dd8d7f17a5d0c68cab --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=38091 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBUo4uPNIR7DyOXrbHABPCKtVSA5hWRMyRI218GfnC7DZPAewjqQW8N8-miIs2oxxQdHZPghQS7vNAzMUQMhaMECgmlkgnY0gmlwhKwS9oWKbXVsdGlhZGRyc5YACASsEvaFBjQbAAoErBL2hQY0HN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDIyqWfw9q6R9K6uERSyROnaqGpTeShFE2IG-apr2GDDKDdGNwgjQbg3VkcII0HYV3YWt1MgE DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.227.230 waku d316a49770c7f1bbd7598f29547a43d1b919064514c359f979a68dc4dd2cd6b6 DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID d316a49770c7. Setting up logs at ./log/docker/node2_2025-12-11_04-14-40__ccf6b188-2052-4992-9de7-070647a5e930__wakuorg_nwaku:latest.log DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 38087 DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:38087/health" -H "Content-Type: application/json" -d 'None' INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}' INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !! INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:38087/debug/v1/info" -H "Content-Type: application/json" -d 'None' INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.227.230/tcp/38088/p2p/16Uiu2HAkvd6WnPdtJWuhWnBnPG94V3wMhchWXko5LTo5jNDWFs8e","/ip4/172.18.227.230/tcp/38089/ws/p2p/16Uiu2HAkvd6WnPdtJWuhWnBnPG94V3wMhchWXko5LTo5jNDWFs8e"],"enrUri":"enr:-L24QCvBJB40jCUaGMgt3SnOGwVc4cKQcwllnV_hwIMLv41FHh-i1biGj0_yHh8Q4aSmAs4s73JiEfkADk0baZgkllMCgmlkgnY0gmlwhKwS4-aKbXVsdGlhZGRyc5YACASsEuPmBpTIAAoErBLj5gaUyd0DgnJzhQADAQAAiXNlY3AyNTZrMaECEcjRHY100wkgg7-zx8K3buJgki9tEQsS1OxT3KRuS4ODdGNwgpTIg3VkcIKUyoV3YWt1MgE"}' INFO  src.node.waku_node:waku_node.py:292 REST service is ready !! INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:38087/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.246.133/tcp/13339/p2p/16Uiu2HAmF2GHUwLJB8vxMvVTNfTZuHDi6rmX4jFf5tyPtV7X39xm"]' INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK' DEBUG  src.node.docker_mananger:docker_mananger.py:141 Found matches for keyword 'Created WakuMetadata protocol': ['INF 2025-12-11 04:14:40.237+00:00 Created WakuMetadata protocol topics="waku node" tid=1 file=protocol.nim:107 clusterId=3 shards=[]'] DEBUG  src.node.docker_mananger:docker_mananger.py:141 Found matches for keyword 'Created WakuMetadata protocol': ['INF 2025-12-11 04:14:41.474+00:00 Created WakuMetadata protocol topics="waku node" tid=1 file=protocol.nim:107 clusterId=3 shards=[]'] DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id a7533324b820 DEBUG  src.node.waku_node:waku_node.py:241 Container stopped. DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id d316a49770c7 DEBUG  src.node.waku_node:waku_node.py:241 Container stopped. DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs. DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.