2025-12-18 04:15:43.699 DEBUG [tests.conftest] Running fixture setup: test_id 2025-12-18 04:15:43.699 DEBUG [tests.conftest] Running test: test_last_node_to_start_publishes with id: 2025-12-18_04-15-43__d6e13b7d-3e43-4e59-a62a-7056f08bf1c2 2025-12-18 04:15:43.699 DEBUG [src.steps.common] Running fixture setup: common_setup 2025-12-18 04:15:43.700 DEBUG [src.steps.relay] Running fixture setup: relay_setup 2025-12-18 04:15:43.700 DEBUG [src.steps.relay] Running fixture setup: setup_main_relay_nodes 2025-12-18 04:15:43.706 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest 2025-12-18 04:15:43.706 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2025-12-18_04-15-43__d6e13b7d-3e43-4e59-a62a-7056f08bf1c2__wakuorg_nwaku:latest.log 2025-12-18 04:15:43.707 DEBUG [src.node.waku_node] Starting Node... 2025-12-18 04:15:43.707 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku 2025-12-18 04:15:43.708 DEBUG [src.node.docker_mananger] Network waku already exists 2025-12-18 04:15:43.708 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.200.182 2025-12-18 04:15:43.708 DEBUG [src.node.docker_mananger] Generated ports ['61380', '61381', '61382', '61383', '61384'] 2025-12-18 04:15:43.708 DEBUG [src.node.waku_node] RLN credentials were not set 2025-12-18 04:15:43.709 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN 2025-12-18 04:15:43.709 DEBUG [src.node.waku_node] Using volumes [] 2025-12-18 04:15:43.709 DEBUG [src.node.docker_mananger] docker run -i -t -p 61380:61380 -p 61381:61381 -p 61382:61382 -p 61383:61383 -p 61384:61384 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=61382 --rest-port=61380 --tcp-port=61381 --discv5-udp-port=61383 --rest-address=0.0.0.0 --nat=extip:172.18.200.182 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e0987e81bde1d2db4a7f5a777d3e81bc31cd77570bfddebd38f9c7a1eeea1ad8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=61384 --metrics-logging=true --relay=true 2025-12-18 04:15:43.916 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.200.182 waku 4d8135742e04486e02abef9f3639c27361a542f806740708f32e9ad1f02b1c08 2025-12-18 04:15:43.956 DEBUG [src.node.docker_mananger] Container started with ID 4d8135742e04. Setting up logs at ./log/docker/node1_2025-12-18_04-15-43__d6e13b7d-3e43-4e59-a62a-7056f08bf1c2__wakuorg_nwaku:latest.log 2025-12-18 04:15:43.957 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 61380 2025-12-18 04:15:43.958 DEBUG [src.libs.common] Sleeping for 1 seconds 2025-12-18 04:15:44.959 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61380/health" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:44.962 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}' 2025-12-18 04:15:44.962 INFO [src.node.waku_node] Node protocols are initialized !! 2025-12-18 04:15:44.963 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61380/debug/v1/info" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:44.965 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.200.182/tcp/61381/p2p/16Uiu2HAmT3QRwVns42VYH2i28zwbvgmVq9GWKP7ZDu7h5udesD2H","/ip4/172.18.200.182/tcp/61382/ws/p2p/16Uiu2HAmT3QRwVns42VYH2i28zwbvgmVq9GWKP7ZDu7h5udesD2H"],"enrUri":"enr:-L24QInfd8neNT1jvt4THmKXJmhK7FQbkVc2ZjiNiByUlAOaGw9VCJB8-i4p_mrt2bHuS-i7cgIhF4TcLO4aHnJ8o_QCgmlkgnY0gmlwhKwSyLaKbXVsdGlhZGRyc5YACASsEsi2Bu_FAAoErBLItgbvxt0DgnJzhQADAQAAiXNlY3AyNTZrMaED1cGfUCY9S6hfly17fDHQtuJPWglFklc7u9dFNC606pqDdGNwgu_Fg3VkcILvx4V3YWt1MgE"}' 2025-12-18 04:15:44.965 INFO [src.node.waku_node] REST service is ready !! 2025-12-18 04:15:44.972 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest 2025-12-18 04:15:44.972 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2025-12-18_04-15-43__d6e13b7d-3e43-4e59-a62a-7056f08bf1c2__wakuorg_nwaku:latest.log 2025-12-18 04:15:44.972 DEBUG [src.node.waku_node] Starting Node... 2025-12-18 04:15:44.972 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku 2025-12-18 04:15:44.974 DEBUG [src.node.docker_mananger] Network waku already exists 2025-12-18 04:15:44.974 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.78.117 2025-12-18 04:15:44.974 DEBUG [src.node.docker_mananger] Generated ports ['1963', '1964', '1965', '1966', '1967'] 2025-12-18 04:15:44.974 DEBUG [src.node.waku_node] RLN credentials were not set 2025-12-18 04:15:44.974 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN 2025-12-18 04:15:44.975 DEBUG [src.node.waku_node] Using volumes [] 2025-12-18 04:15:44.975 DEBUG [src.node.docker_mananger] docker run -i -t -p 1963:1963 -p 1964:1964 -p 1965:1965 -p 1966:1966 -p 1967:1967 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=1965 --rest-port=1963 --tcp-port=1964 --discv5-udp-port=1966 --rest-address=0.0.0.0 --nat=extip:172.18.78.117 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=d36a9045101f2a1eb9efd49e0c18ff31236aecb4216fd0b82ee31d3d0cc81ff9 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=1967 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QInfd8neNT1jvt4THmKXJmhK7FQbkVc2ZjiNiByUlAOaGw9VCJB8-i4p_mrt2bHuS-i7cgIhF4TcLO4aHnJ8o_QCgmlkgnY0gmlwhKwSyLaKbXVsdGlhZGRyc5YACASsEsi2Bu_FAAoErBLItgbvxt0DgnJzhQADAQAAiXNlY3AyNTZrMaED1cGfUCY9S6hfly17fDHQtuJPWglFklc7u9dFNC606pqDdGNwgu_Fg3VkcILvx4V3YWt1MgE 2025-12-18 04:15:45.171 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.78.117 waku df8b56294cb489ae24a756e3882d830aab9bb543e2a5480279bfa099ded58215 2025-12-18 04:15:45.209 DEBUG [src.node.docker_mananger] Container started with ID df8b56294cb4. Setting up logs at ./log/docker/node2_2025-12-18_04-15-43__d6e13b7d-3e43-4e59-a62a-7056f08bf1c2__wakuorg_nwaku:latest.log 2025-12-18 04:15:45.209 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 1963 2025-12-18 04:15:45.210 DEBUG [src.libs.common] Sleeping for 1 seconds 2025-12-18 04:15:46.211 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1963/health" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:46.220 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}' 2025-12-18 04:15:46.220 INFO [src.node.waku_node] Node protocols are initialized !! 2025-12-18 04:15:46.220 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1963/debug/v1/info" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:46.224 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.78.117/tcp/1964/p2p/16Uiu2HAm9pkJ8zTPTbajAoFfsDho9Tm2ovt5izqSEP9dHWrWLTGD","/ip4/172.18.78.117/tcp/1965/ws/p2p/16Uiu2HAm9pkJ8zTPTbajAoFfsDho9Tm2ovt5izqSEP9dHWrWLTGD"],"enrUri":"enr:-L24QK-K6sTzg5qtWqLKxyOCa8wYXfSGuSCOgKJyXH9ILFSFThCFbkdoAHrPnAWF0AtugoCjKZAfIe2hu4uNtCRdmTECgmlkgnY0gmlwhKwSTnWKbXVsdGlhZGRyc5YACASsEk51BgesAAoErBJOdQYHrd0DgnJzhQADAQAAiXNlY3AyNTZrMaEC1ezbJJifyz6JppfzWtYCYq8cPitaS8bS8oVWfqY2qcKDdGNwggesg3VkcIIHroV3YWt1MgE"}' 2025-12-18 04:15:46.224 INFO [src.node.waku_node] REST service is ready !! 2025-12-18 04:15:46.225 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1963/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.200.182/tcp/61381/p2p/16Uiu2HAmT3QRwVns42VYH2i28zwbvgmVq9GWKP7ZDu7h5udesD2H"]' 2025-12-18 04:15:46.228 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-18 04:15:46.229 DEBUG [src.steps.relay] Running fixture setup: setup_optional_relay_nodes 2025-12-18 04:15:46.235 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest 2025-12-18 04:15:46.235 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2025-12-18_04-15-43__d6e13b7d-3e43-4e59-a62a-7056f08bf1c2__wakuorg_nwaku:latest.log 2025-12-18 04:15:46.235 DEBUG [src.node.waku_node] Starting Node... 2025-12-18 04:15:46.235 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku 2025-12-18 04:15:46.237 DEBUG [src.node.docker_mananger] Network waku already exists 2025-12-18 04:15:46.237 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.87.129 2025-12-18 04:15:46.237 DEBUG [src.node.docker_mananger] Generated ports ['27092', '27093', '27094', '27095', '27096'] 2025-12-18 04:15:46.237 DEBUG [src.node.waku_node] RLN credentials were not set 2025-12-18 04:15:46.237 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN 2025-12-18 04:15:46.237 DEBUG [src.node.waku_node] Using volumes [] 2025-12-18 04:15:46.238 DEBUG [src.node.docker_mananger] docker run -i -t -p 27092:27092 -p 27093:27093 -p 27094:27094 -p 27095:27095 -p 27096:27096 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=27094 --rest-port=27092 --tcp-port=27093 --discv5-udp-port=27095 --rest-address=0.0.0.0 --nat=extip:172.18.87.129 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=0e7b3facf6e7dadf84edcaf8a1815cdcafb0baae7ecba8a7d54bea6b17ecbead --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=27096 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QInfd8neNT1jvt4THmKXJmhK7FQbkVc2ZjiNiByUlAOaGw9VCJB8-i4p_mrt2bHuS-i7cgIhF4TcLO4aHnJ8o_QCgmlkgnY0gmlwhKwSyLaKbXVsdGlhZGRyc5YACASsEsi2Bu_FAAoErBLItgbvxt0DgnJzhQADAQAAiXNlY3AyNTZrMaED1cGfUCY9S6hfly17fDHQtuJPWglFklc7u9dFNC606pqDdGNwgu_Fg3VkcILvx4V3YWt1MgE 2025-12-18 04:15:46.418 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.87.129 waku 6bd4294b5874cd70fadf3a2babcddcaf3c567ce9c61743415003d9731a14fac4 2025-12-18 04:15:46.451 DEBUG [src.node.docker_mananger] Container started with ID 6bd4294b5874. Setting up logs at ./log/docker/node3_2025-12-18_04-15-43__d6e13b7d-3e43-4e59-a62a-7056f08bf1c2__wakuorg_nwaku:latest.log 2025-12-18 04:15:46.452 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 27092 2025-12-18 04:15:46.452 DEBUG [src.libs.common] Sleeping for 1 seconds 2025-12-18 04:15:47.452 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:27092/health" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:47.465 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"READY"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}' 2025-12-18 04:15:47.465 INFO [src.node.waku_node] Node protocols are initialized !! 2025-12-18 04:15:47.467 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:27092/debug/v1/info" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:47.470 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.87.129/tcp/27093/p2p/16Uiu2HAmP3vRLYKJd8nrusva7SgRds22fxpvCSv3LCctGoo4x1aJ","/ip4/172.18.87.129/tcp/27094/ws/p2p/16Uiu2HAmP3vRLYKJd8nrusva7SgRds22fxpvCSv3LCctGoo4x1aJ"],"enrUri":"enr:-L24QIdxMu5GwZgqwZnCjcrG4CQQC1v8TfUsl465doYuWe73Ac5UOmsjMMd3ti8kShrckS3npFB3ESvrY7s_3srCyQoCgmlkgnY0gmlwhKwSV4GKbXVsdGlhZGRyc5YACASsEleBBmnVAAoErBJXgQZp1t0DgnJzhQADAQAAiXNlY3AyNTZrMaEDmnTIskECrOb_j7bO2PS_VDcn1fU5UdC-7y2qOxIYEhODdGNwgmnVg3VkcIJp14V3YWt1MgE"}' 2025-12-18 04:15:47.470 INFO [src.node.waku_node] REST service is ready !! 2025-12-18 04:15:47.471 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27092/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.200.182/tcp/61381/p2p/16Uiu2HAmT3QRwVns42VYH2i28zwbvgmVq9GWKP7ZDu7h5udesD2H"]' 2025-12-18 04:15:47.474 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-18 04:15:47.480 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest 2025-12-18 04:15:47.480 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2025-12-18_04-15-43__d6e13b7d-3e43-4e59-a62a-7056f08bf1c2__wakuorg_nwaku:latest.log 2025-12-18 04:15:47.480 DEBUG [src.node.waku_node] Starting Node... 2025-12-18 04:15:47.480 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku 2025-12-18 04:15:47.482 DEBUG [src.node.docker_mananger] Network waku already exists 2025-12-18 04:15:47.482 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.25.41 2025-12-18 04:15:47.482 DEBUG [src.node.docker_mananger] Generated ports ['12910', '12911', '12912', '12913', '12914'] 2025-12-18 04:15:47.482 DEBUG [src.node.waku_node] RLN credentials were not set 2025-12-18 04:15:47.482 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN 2025-12-18 04:15:47.482 DEBUG [src.node.waku_node] Using volumes [] 2025-12-18 04:15:47.482 DEBUG [src.node.docker_mananger] docker run -i -t -p 12910:12910 -p 12911:12911 -p 12912:12912 -p 12913:12913 -p 12914:12914 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=12912 --rest-port=12910 --tcp-port=12911 --discv5-udp-port=12913 --rest-address=0.0.0.0 --nat=extip:172.18.25.41 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cd86d42ddcc789abfe5c3a9ea59a0ee5e7b6cafaa29f077f23f79baab0e05e2b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=12914 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QInfd8neNT1jvt4THmKXJmhK7FQbkVc2ZjiNiByUlAOaGw9VCJB8-i4p_mrt2bHuS-i7cgIhF4TcLO4aHnJ8o_QCgmlkgnY0gmlwhKwSyLaKbXVsdGlhZGRyc5YACASsEsi2Bu_FAAoErBLItgbvxt0DgnJzhQADAQAAiXNlY3AyNTZrMaED1cGfUCY9S6hfly17fDHQtuJPWglFklc7u9dFNC606pqDdGNwgu_Fg3VkcILvx4V3YWt1MgE 2025-12-18 04:15:47.671 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.25.41 waku a8dc9a94ab34497eef99dc55901252cd0511a203b6d4cb5a7fe5ac611452ee01 2025-12-18 04:15:47.704 DEBUG [src.node.docker_mananger] Container started with ID a8dc9a94ab34. Setting up logs at ./log/docker/node4_2025-12-18_04-15-43__d6e13b7d-3e43-4e59-a62a-7056f08bf1c2__wakuorg_nwaku:latest.log 2025-12-18 04:15:47.705 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 12910 2025-12-18 04:15:47.705 DEBUG [src.libs.common] Sleeping for 1 seconds 2025-12-18 04:15:48.705 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12910/health" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:48.716 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"READY"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}' 2025-12-18 04:15:48.717 INFO [src.node.waku_node] Node protocols are initialized !! 2025-12-18 04:15:48.717 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12910/debug/v1/info" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:48.721 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.25.41/tcp/12911/p2p/16Uiu2HAkzK7VGxAXdzTMLXaoSicJZaKW4FV46yKGYFBb7CnksV2k","/ip4/172.18.25.41/tcp/12912/ws/p2p/16Uiu2HAkzK7VGxAXdzTMLXaoSicJZaKW4FV46yKGYFBb7CnksV2k"],"enrUri":"enr:-L24QNqt3CthcPt3rq4iCIaEuRhFqIGq3py7G2hWHV2eWoUzY_cB7p1M2k1rBVtKAQsR_L6JnJSA4aBnfFtVZaZzD2sCgmlkgnY0gmlwhKwSGSmKbXVsdGlhZGRyc5YACASsEhkpBjJvAAoErBIZKQYycN0DgnJzhQADAQAAiXNlY3AyNTZrMaECSJw2GJo4Fn5GbBrqKyeg2JyWfgfgNitHHtwRPbDHFLWDdGNwgjJvg3VkcIIycYV3YWt1MgE"}' 2025-12-18 04:15:48.721 INFO [src.node.waku_node] REST service is ready !! 2025-12-18 04:15:48.721 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12910/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.200.182/tcp/61381/p2p/16Uiu2HAmT3QRwVns42VYH2i28zwbvgmVq9GWKP7ZDu7h5udesD2H"]' 2025-12-18 04:15:48.724 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-18 04:15:48.730 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest 2025-12-18 04:15:48.730 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2025-12-18_04-15-43__d6e13b7d-3e43-4e59-a62a-7056f08bf1c2__wakuorg_nwaku:latest.log 2025-12-18 04:15:48.730 DEBUG [src.node.waku_node] Starting Node... 2025-12-18 04:15:48.730 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku 2025-12-18 04:15:48.731 DEBUG [src.node.docker_mananger] Network waku already exists 2025-12-18 04:15:48.732 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.191.201 2025-12-18 04:15:48.732 DEBUG [src.node.docker_mananger] Generated ports ['10516', '10517', '10518', '10519', '10520'] 2025-12-18 04:15:48.732 DEBUG [src.node.waku_node] RLN credentials were not set 2025-12-18 04:15:48.732 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN 2025-12-18 04:15:48.732 DEBUG [src.node.waku_node] Using volumes [] 2025-12-18 04:15:48.732 DEBUG [src.node.docker_mananger] docker run -i -t -p 10516:10516 -p 10517:10517 -p 10518:10518 -p 10519:10519 -p 10520:10520 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=10518 --rest-port=10516 --tcp-port=10517 --discv5-udp-port=10519 --rest-address=0.0.0.0 --nat=extip:172.18.191.201 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=afd4a05eba40deea754bcd2beee004b7c84aff3bbf9272aad41b0b7f7baa6d9d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=10520 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QInfd8neNT1jvt4THmKXJmhK7FQbkVc2ZjiNiByUlAOaGw9VCJB8-i4p_mrt2bHuS-i7cgIhF4TcLO4aHnJ8o_QCgmlkgnY0gmlwhKwSyLaKbXVsdGlhZGRyc5YACASsEsi2Bu_FAAoErBLItgbvxt0DgnJzhQADAQAAiXNlY3AyNTZrMaED1cGfUCY9S6hfly17fDHQtuJPWglFklc7u9dFNC606pqDdGNwgu_Fg3VkcILvx4V3YWt1MgE 2025-12-18 04:15:48.924 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.191.201 waku c0996ea784a3b1e40caf16d57d7ffc67fb767961401056f5e9d87ef9098bbcc0 2025-12-18 04:15:48.959 DEBUG [src.node.docker_mananger] Container started with ID c0996ea784a3. Setting up logs at ./log/docker/node5_2025-12-18_04-15-43__d6e13b7d-3e43-4e59-a62a-7056f08bf1c2__wakuorg_nwaku:latest.log 2025-12-18 04:15:48.959 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 10516 2025-12-18 04:15:48.960 DEBUG [src.libs.common] Sleeping for 1 seconds 2025-12-18 04:15:49.961 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10516/health" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:49.967 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"READY"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}' 2025-12-18 04:15:49.967 INFO [src.node.waku_node] Node protocols are initialized !! 2025-12-18 04:15:49.967 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10516/debug/v1/info" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:49.970 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.191.201/tcp/10517/p2p/16Uiu2HAmVTxL3pV4u48FBfPV3L677uek3CKUsSEreoRRp7SeWmNN","/ip4/172.18.191.201/tcp/10518/ws/p2p/16Uiu2HAmVTxL3pV4u48FBfPV3L677uek3CKUsSEreoRRp7SeWmNN"],"enrUri":"enr:-L24QDMxV-82dG1WGEXnDc_4q56maQSdYsxJ50DrAn8Ocev8XoJWC_nzzgRdoB4yDU29bw99X4Dc9U78uy8DSp7ozjcCgmlkgnY0gmlwhKwSv8mKbXVsdGlhZGRyc5YACASsEr_JBikVAAoErBK_yQYpFt0DgnJzhQADAQAAiXNlY3AyNTZrMaED-cMA1YkZ-UsDvzLSeF_c1P92x3T0ZL5JwQpPg8dESH-DdGNwgikVg3VkcIIpF4V3YWt1MgE"}' 2025-12-18 04:15:49.970 INFO [src.node.waku_node] REST service is ready !! 2025-12-18 04:15:49.971 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10516/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.200.182/tcp/61381/p2p/16Uiu2HAmT3QRwVns42VYH2i28zwbvgmVq9GWKP7ZDu7h5udesD2H"]' 2025-12-18 04:15:49.973 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-18 04:15:49.974 DEBUG [src.steps.relay] Running fixture setup: subscribe_main_relay_nodes 2025-12-18 04:15:49.974 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61380/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]' 2025-12-18 04:15:49.980 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-18 04:15:49.980 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1963/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]' 2025-12-18 04:15:49.985 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-18 04:15:49.987 DEBUG [src.steps.relay] Running fixture setup: subscribe_optional_relay_nodes 2025-12-18 04:15:49.988 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27092/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]' 2025-12-18 04:15:49.993 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-18 04:15:49.993 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12910/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]' 2025-12-18 04:15:50.000 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-18 04:15:50.000 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10516/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]' 2025-12-18 04:15:50.005 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-18 04:15:50.007 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61380/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}' 2025-12-18 04:15:50.016 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-18 04:15:50.017 DEBUG [src.libs.common] Sleeping for 0.1 seconds 2025-12-18 04:15:50.117 DEBUG [src.steps.relay] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message 2025-12-18 04:15:50.117 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61380/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:50.120 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1766031350007438336,"ephemeral":false,"proof":""}]' 2025-12-18 04:15:50.121 DEBUG [src.steps.relay] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message 2025-12-18 04:15:50.121 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1963/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:50.123 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1766031350007438336,"ephemeral":false,"proof":""}]' 2025-12-18 04:15:50.125 DEBUG [src.steps.relay] Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message 2025-12-18 04:15:50.125 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:27092/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:50.127 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1766031350007438336,"ephemeral":false,"proof":""}]' 2025-12-18 04:15:50.129 DEBUG [src.steps.relay] Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message 2025-12-18 04:15:50.129 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12910/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:50.131 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1766031350007438336,"ephemeral":false,"proof":""}]' 2025-12-18 04:15:50.132 DEBUG [src.steps.relay] Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message 2025-12-18 04:15:50.132 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10516/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:50.134 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1766031350007438336,"ephemeral":false,"proof":""}]' 2025-12-18 04:15:50.136 INFO [src.steps.relay] WARM UP successful!! 2025-12-18 04:15:50.137 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10516/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}' 2025-12-18 04:15:50.140 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-18 04:15:50.141 DEBUG [src.libs.common] Sleeping for 0.1 seconds 2025-12-18 04:15:50.241 DEBUG [src.steps.relay] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message 2025-12-18 04:15:50.241 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61380/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:50.243 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1766031350137121359,"ephemeral":false,"proof":""}]' 2025-12-18 04:15:50.245 DEBUG [src.steps.relay] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message 2025-12-18 04:15:50.245 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1963/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:50.247 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1766031350137121359,"ephemeral":false,"proof":""}]' 2025-12-18 04:15:50.248 DEBUG [src.steps.relay] Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message 2025-12-18 04:15:50.248 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:27092/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:50.250 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1766031350137121359,"ephemeral":false,"proof":""}]' 2025-12-18 04:15:50.252 DEBUG [src.steps.relay] Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message 2025-12-18 04:15:50.252 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12910/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:50.254 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1766031350137121359,"ephemeral":false,"proof":""}]' 2025-12-18 04:15:50.255 DEBUG [src.steps.relay] Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message 2025-12-18 04:15:50.255 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10516/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None' 2025-12-18 04:15:50.257 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1766031350137121359,"ephemeral":false,"proof":""}]' 2025-12-18 04:15:50.261 DEBUG [tests.conftest] Running fixture teardown: test_setup 2025-12-18 04:15:50.262 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes 2025-12-18 04:15:50.262 DEBUG [src.node.waku_node] Stopping container with id 4d8135742e04 2025-12-18 04:15:50.837 DEBUG [src.node.waku_node] Container stopped. 2025-12-18 04:15:50.838 DEBUG [src.node.waku_node] Stopping container with id df8b56294cb4 2025-12-18 04:15:51.348 DEBUG [src.node.waku_node] Container stopped. 2025-12-18 04:15:51.349 DEBUG [src.node.waku_node] Stopping container with id 6bd4294b5874 2025-12-18 04:15:51.706 ERROR [src.node.docker_mananger] Max retries reached for container 4d8135742e04. Exiting log stream. 2025-12-18 04:15:51.906 DEBUG [src.node.waku_node] Container stopped. 2025-12-18 04:15:51.906 DEBUG [src.node.waku_node] Stopping container with id a8dc9a94ab34 2025-12-18 04:15:52.159 ERROR [src.node.docker_mananger] Max retries reached for container df8b56294cb4. Exiting log stream. 2025-12-18 04:15:52.423 DEBUG [src.node.waku_node] Container stopped. 2025-12-18 04:15:52.424 DEBUG [src.node.waku_node] Stopping container with id c0996ea784a3 2025-12-18 04:15:52.720 ERROR [src.node.docker_mananger] Max retries reached for container 6bd4294b5874. Exiting log stream. 2025-12-18 04:15:52.977 DEBUG [src.node.waku_node] Container stopped. 2025-12-18 04:15:52.977 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors 2025-12-18 04:15:53.008 DEBUG [src.node.docker_mananger] No errors found in the waku logs. 2025-12-18 04:15:53.014 DEBUG [src.node.docker_mananger] No errors found in the waku logs. 2025-12-18 04:15:53.019 DEBUG [src.node.docker_mananger] No errors found in the waku logs. 2025-12-18 04:15:53.024 DEBUG [src.node.docker_mananger] No errors found in the waku logs. 2025-12-18 04:15:53.029 DEBUG [src.node.docker_mananger] No errors found in the waku logs.