163 lines
30 KiB
Plaintext

2026-03-20 04:33:53.670 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-20 04:33:53.671 DEBUG [tests.conftest] Running test: test_optional_nodes_not_subscribed_to_same_pubsub_topic with id: 2026-03-20_04-33-53__9778d7f2-a418-4c75-8ec8-006babc26902
2026-03-20 04:33:53.671 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-20 04:33:53.671 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-20 04:33:53.671 DEBUG [src.steps.relay] Running fixture setup: setup_main_relay_nodes
2026-03-20 04:33:53.678 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-20 04:33:53.678 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-20_04-33-53__9778d7f2-a418-4c75-8ec8-006babc26902__wakuorg_nwaku:latest.log
2026-03-20 04:33:53.678 DEBUG [src.node.waku_node] Starting Node...
2026-03-20 04:33:53.679 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-20 04:33:53.680 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-20 04:33:53.680 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.248.63
2026-03-20 04:33:53.680 DEBUG [src.node.docker_mananger] Generated ports ['62625', '62626', '62627', '62628', '62629']
2026-03-20 04:33:53.680 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-20 04:33:53.681 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-20 04:33:53.681 DEBUG [src.node.waku_node] Using volumes []
2026-03-20 04:33:53.681 DEBUG [src.node.docker_mananger] docker run -i -t -p 62625:62625 -p 62626:62626 -p 62627:62627 -p 62628:62628 -p 62629:62629 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=62627 --rest-port=62625 --tcp-port=62626 --discv5-udp-port=62628 --rest-address=0.0.0.0 --nat=extip:172.18.248.63 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=730cd9a767ecd7c8aa5e69baa0a1f33427f9404aa10beafddb27cde620e7e4ed --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=62629 --metrics-logging=true --relay=true
2026-03-20 04:33:53.905 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.248.63 waku c078c29f765efc828c18b5b12003fb6acfbe1a3e41697a774af36ef371c8c975
2026-03-20 04:33:53.920 ERROR [src.node.docker_mananger] Max retries reached for container c7d01dec1b79. Exiting log stream.
2026-03-20 04:33:53.946 DEBUG [src.node.docker_mananger] Container started with ID c078c29f765e. Setting up logs at ./log/docker/node1_2026-03-20_04-33-53__9778d7f2-a418-4c75-8ec8-006babc26902__wakuorg_nwaku:latest.log
2026-03-20 04:33:53.946 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 62625
2026-03-20 04:33:53.946 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-20 04:33:54.468 ERROR [src.node.docker_mananger] Max retries reached for container 2c13c4f9520e. Exiting log stream.
2026-03-20 04:33:54.948 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62625/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:33:54.951 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-20 04:33:54.952 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-20 04:33:54.952 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62625/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:33:54.954 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.248.63/tcp/62626/p2p/16Uiu2HAm2aiwXTMSbhFMv5VF8QbiMLDNvTJSSkkUQpMT2BZEfW1W","/ip4/172.18.248.63/tcp/62627/ws/p2p/16Uiu2HAm2aiwXTMSbhFMv5VF8QbiMLDNvTJSSkkUQpMT2BZEfW1W"],"enrUri":"enr:-L24QBJIrXBUQN734M-MGaV-UXHcDAyufF6PIcgHClwkzt0qRSw7PJMxYU-5d6cE0oPOE6jpXZ_uy0f-vvKmtbNFnXACgmlkgnY0gmlwhKwS-D-KbXVsdGlhZGRyc5YACASsEvg_BvSiAAoErBL4Pwb0o90DgnJzhQADAQAAiXNlY3AyNTZrMaECalNiOC_epRRD52VfaIy-o_Jqi0JrNu69au7S0Cecq_GDdGNwgvSig3VkcIL0pIV3YWt1MgE"}'
2026-03-20 04:33:54.954 INFO [src.node.waku_node] REST service is ready !!
2026-03-20 04:33:54.961 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-20 04:33:54.962 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-20_04-33-53__9778d7f2-a418-4c75-8ec8-006babc26902__wakuorg_nwaku:latest.log
2026-03-20 04:33:54.962 DEBUG [src.node.waku_node] Starting Node...
2026-03-20 04:33:54.962 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-20 04:33:54.963 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-20 04:33:54.963 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.28.25
2026-03-20 04:33:54.964 DEBUG [src.node.docker_mananger] Generated ports ['20505', '20506', '20507', '20508', '20509']
2026-03-20 04:33:54.964 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-20 04:33:54.964 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-20 04:33:54.964 DEBUG [src.node.waku_node] Using volumes []
2026-03-20 04:33:54.964 DEBUG [src.node.docker_mananger] docker run -i -t -p 20505:20505 -p 20506:20506 -p 20507:20507 -p 20508:20508 -p 20509:20509 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=20507 --rest-port=20505 --tcp-port=20506 --discv5-udp-port=20508 --rest-address=0.0.0.0 --nat=extip:172.18.28.25 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fe59ce6aa3c0e388ddd3cc3c8ebaf781f0aff4ebbfe2c35ec972f5d6eeb4a57e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=20509 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBJIrXBUQN734M-MGaV-UXHcDAyufF6PIcgHClwkzt0qRSw7PJMxYU-5d6cE0oPOE6jpXZ_uy0f-vvKmtbNFnXACgmlkgnY0gmlwhKwS-D-KbXVsdGlhZGRyc5YACASsEvg_BvSiAAoErBL4Pwb0o90DgnJzhQADAQAAiXNlY3AyNTZrMaECalNiOC_epRRD52VfaIy-o_Jqi0JrNu69au7S0Cecq_GDdGNwgvSig3VkcIL0pIV3YWt1MgE
2026-03-20 04:33:55.174 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.28.25 waku 59f73394e198b6b2a712d9837038d514ade3d289d82344feaae3f86dde78fb82
2026-03-20 04:33:55.210 DEBUG [src.node.docker_mananger] Container started with ID 59f73394e198. Setting up logs at ./log/docker/node2_2026-03-20_04-33-53__9778d7f2-a418-4c75-8ec8-006babc26902__wakuorg_nwaku:latest.log
2026-03-20 04:33:55.210 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 20505
2026-03-20 04:33:55.210 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-20 04:33:56.211 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20505/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:33:56.227 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-20 04:33:56.228 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-20 04:33:56.228 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20505/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:33:56.234 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.28.25/tcp/20506/p2p/16Uiu2HAkyjcrnGoghK3XrTKBQ79A1h2WbniSn362hp32uYCXzYa5","/ip4/172.18.28.25/tcp/20507/ws/p2p/16Uiu2HAkyjcrnGoghK3XrTKBQ79A1h2WbniSn362hp32uYCXzYa5"],"enrUri":"enr:-L24QG7RJ-6ioZ-jsx8gaan_vZd-xj06Plang4yHndIXpDYcMbwWGsu5-dUVlZpSKfMcfkY2VpRCUNeYsKlHHb9abXUCgmlkgnY0gmlwhKwSHBmKbXVsdGlhZGRyc5YACASsEhwZBlAaAAoErBIcGQZQG90DgnJzhQADAQAAiXNlY3AyNTZrMaECQAesZ65KeLrpvTykuTR986UIipsEzj1IURl3A6WITEKDdGNwglAag3VkcIJQHIV3YWt1MgE"}'
2026-03-20 04:33:56.235 INFO [src.node.waku_node] REST service is ready !!
2026-03-20 04:33:56.235 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20505/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.248.63/tcp/62626/p2p/16Uiu2HAm2aiwXTMSbhFMv5VF8QbiMLDNvTJSSkkUQpMT2BZEfW1W"]'
2026-03-20 04:33:56.239 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:33:56.240 DEBUG [src.steps.relay] Running fixture setup: setup_optional_relay_nodes
2026-03-20 04:33:56.247 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-20 04:33:56.247 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-20_04-33-53__9778d7f2-a418-4c75-8ec8-006babc26902__wakuorg_nwaku:latest.log
2026-03-20 04:33:56.247 DEBUG [src.node.waku_node] Starting Node...
2026-03-20 04:33:56.247 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-20 04:33:56.248 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-20 04:33:56.249 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.30.91
2026-03-20 04:33:56.249 DEBUG [src.node.docker_mananger] Generated ports ['18265', '18266', '18267', '18268', '18269']
2026-03-20 04:33:56.249 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-20 04:33:56.249 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-20 04:33:56.249 DEBUG [src.node.waku_node] Using volumes []
2026-03-20 04:33:56.249 DEBUG [src.node.docker_mananger] docker run -i -t -p 18265:18265 -p 18266:18266 -p 18267:18267 -p 18268:18268 -p 18269:18269 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=18267 --rest-port=18265 --tcp-port=18266 --discv5-udp-port=18268 --rest-address=0.0.0.0 --nat=extip:172.18.30.91 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bda7af5c20ed43210dbcf91fdf6eaedea7de87c10abf52cb6ddc5cb8edd8ee4d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=18269 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBJIrXBUQN734M-MGaV-UXHcDAyufF6PIcgHClwkzt0qRSw7PJMxYU-5d6cE0oPOE6jpXZ_uy0f-vvKmtbNFnXACgmlkgnY0gmlwhKwS-D-KbXVsdGlhZGRyc5YACASsEvg_BvSiAAoErBL4Pwb0o90DgnJzhQADAQAAiXNlY3AyNTZrMaECalNiOC_epRRD52VfaIy-o_Jqi0JrNu69au7S0Cecq_GDdGNwgvSig3VkcIL0pIV3YWt1MgE
2026-03-20 04:33:56.452 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.30.91 waku 58520b3806547af509c7aa51c21f2943e20ce811bdb18e4a6bd5c335c4711c91
2026-03-20 04:33:56.490 DEBUG [src.node.docker_mananger] Container started with ID 58520b380654. Setting up logs at ./log/docker/node3_2026-03-20_04-33-53__9778d7f2-a418-4c75-8ec8-006babc26902__wakuorg_nwaku:latest.log
2026-03-20 04:33:56.490 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 18265
2026-03-20 04:33:56.490 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-20 04:33:57.493 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18265/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:33:57.509 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-20 04:33:57.509 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-20 04:33:57.510 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18265/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:33:57.513 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.30.91/tcp/18266/p2p/16Uiu2HAmN8H4L2dxVu4BLbrBg2x27UHdYkgnFsrCNjqi4cZh1n8C","/ip4/172.18.30.91/tcp/18267/ws/p2p/16Uiu2HAmN8H4L2dxVu4BLbrBg2x27UHdYkgnFsrCNjqi4cZh1n8C"],"enrUri":"enr:-L24QLGahtGDUFRKfTh_vRAnQxOSdCf2v1HAe1eXEjsmg5aCX06r_JtIfB-fjTiHye9QGmw6wDQ2ymJaIwQowfcPFG4CgmlkgnY0gmlwhKwSHluKbXVsdGlhZGRyc5YACASsEh5bBkdaAAoErBIeWwZHW90DgnJzhQADAQAAiXNlY3AyNTZrMaEDjLbBZ9o1MZFE-xZfPuL9juki65NahIpTe3zzZ9xm8rWDdGNwgkdag3VkcIJHXIV3YWt1MgE"}'
2026-03-20 04:33:57.514 INFO [src.node.waku_node] REST service is ready !!
2026-03-20 04:33:57.514 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18265/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.248.63/tcp/62626/p2p/16Uiu2HAm2aiwXTMSbhFMv5VF8QbiMLDNvTJSSkkUQpMT2BZEfW1W"]'
2026-03-20 04:33:57.517 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:33:57.524 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-20 04:33:57.524 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-20_04-33-53__9778d7f2-a418-4c75-8ec8-006babc26902__wakuorg_nwaku:latest.log
2026-03-20 04:33:57.524 DEBUG [src.node.waku_node] Starting Node...
2026-03-20 04:33:57.524 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-20 04:33:57.526 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-20 04:33:57.526 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.187.171
2026-03-20 04:33:57.526 DEBUG [src.node.docker_mananger] Generated ports ['31237', '31238', '31239', '31240', '31241']
2026-03-20 04:33:57.526 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-20 04:33:57.526 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-20 04:33:57.527 DEBUG [src.node.waku_node] Using volumes []
2026-03-20 04:33:57.527 DEBUG [src.node.docker_mananger] docker run -i -t -p 31237:31237 -p 31238:31238 -p 31239:31239 -p 31240:31240 -p 31241:31241 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=31239 --rest-port=31237 --tcp-port=31238 --discv5-udp-port=31240 --rest-address=0.0.0.0 --nat=extip:172.18.187.171 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fc61b5640c71ea9c20d77ebe6ed3b73dfae71881bc25fd907dcc1fbedecd7ae2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=31241 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBJIrXBUQN734M-MGaV-UXHcDAyufF6PIcgHClwkzt0qRSw7PJMxYU-5d6cE0oPOE6jpXZ_uy0f-vvKmtbNFnXACgmlkgnY0gmlwhKwS-D-KbXVsdGlhZGRyc5YACASsEvg_BvSiAAoErBL4Pwb0o90DgnJzhQADAQAAiXNlY3AyNTZrMaECalNiOC_epRRD52VfaIy-o_Jqi0JrNu69au7S0Cecq_GDdGNwgvSig3VkcIL0pIV3YWt1MgE
2026-03-20 04:33:57.727 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.187.171 waku 0ef504b655078abdad33db145f6bb06d084ebc143088e2c0a00633903d3ec7b2
2026-03-20 04:33:57.764 DEBUG [src.node.docker_mananger] Container started with ID 0ef504b65507. Setting up logs at ./log/docker/node4_2026-03-20_04-33-53__9778d7f2-a418-4c75-8ec8-006babc26902__wakuorg_nwaku:latest.log
2026-03-20 04:33:57.765 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 31237
2026-03-20 04:33:57.765 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-20 04:33:58.766 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31237/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:33:58.776 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-20 04:33:58.777 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-20 04:33:58.777 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31237/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:33:58.786 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.187.171/tcp/31238/p2p/16Uiu2HAm2daxWNck48awmqxrWZ8ebqEUhq8Ax8NZTrfa5nYvtKh5","/ip4/172.18.187.171/tcp/31239/ws/p2p/16Uiu2HAm2daxWNck48awmqxrWZ8ebqEUhq8Ax8NZTrfa5nYvtKh5"],"enrUri":"enr:-L24QIYzqT6tTfr_REHhNMlAZorWFEKOFzTAi3O2LdR9bYbJbJudbe2mo0bciXcqUl9F6rei2W7LwUeAmfsr81NjFN8CgmlkgnY0gmlwhKwSu6uKbXVsdGlhZGRyc5YACASsErurBnoGAAoErBK7qwZ6B90DgnJzhQADAQAAiXNlY3AyNTZrMaECaw8Zf1tGdUnVecSDyx5tD0I-oAcrEtbKrYHOhgpFMoSDdGNwgnoGg3VkcIJ6CIV3YWt1MgE"}'
2026-03-20 04:33:58.787 INFO [src.node.waku_node] REST service is ready !!
2026-03-20 04:33:58.788 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31237/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.248.63/tcp/62626/p2p/16Uiu2HAm2aiwXTMSbhFMv5VF8QbiMLDNvTJSSkkUQpMT2BZEfW1W"]'
2026-03-20 04:33:58.791 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:33:58.798 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-20 04:33:58.798 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-20_04-33-53__9778d7f2-a418-4c75-8ec8-006babc26902__wakuorg_nwaku:latest.log
2026-03-20 04:33:58.798 DEBUG [src.node.waku_node] Starting Node...
2026-03-20 04:33:58.799 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-20 04:33:58.800 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-20 04:33:58.800 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.16.141
2026-03-20 04:33:58.800 DEBUG [src.node.docker_mananger] Generated ports ['41769', '41770', '41771', '41772', '41773']
2026-03-20 04:33:58.800 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-20 04:33:58.801 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-20 04:33:58.801 DEBUG [src.node.waku_node] Using volumes []
2026-03-20 04:33:58.801 DEBUG [src.node.docker_mananger] docker run -i -t -p 41769:41769 -p 41770:41770 -p 41771:41771 -p 41772:41772 -p 41773:41773 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=41771 --rest-port=41769 --tcp-port=41770 --discv5-udp-port=41772 --rest-address=0.0.0.0 --nat=extip:172.18.16.141 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=3ea8fdc3dccd7dcbb016b890db472e2afe39fca4fd5f41d30cecd19996b6d22c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=41773 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBJIrXBUQN734M-MGaV-UXHcDAyufF6PIcgHClwkzt0qRSw7PJMxYU-5d6cE0oPOE6jpXZ_uy0f-vvKmtbNFnXACgmlkgnY0gmlwhKwS-D-KbXVsdGlhZGRyc5YACASsEvg_BvSiAAoErBL4Pwb0o90DgnJzhQADAQAAiXNlY3AyNTZrMaECalNiOC_epRRD52VfaIy-o_Jqi0JrNu69au7S0Cecq_GDdGNwgvSig3VkcIL0pIV3YWt1MgE
2026-03-20 04:33:59.001 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.16.141 waku ef4e34727b20a7d303642f7f3b298d4b4e5a5eec41242327b02790b9ffd7656b
2026-03-20 04:33:59.037 DEBUG [src.node.docker_mananger] Container started with ID ef4e34727b20. Setting up logs at ./log/docker/node5_2026-03-20_04-33-53__9778d7f2-a418-4c75-8ec8-006babc26902__wakuorg_nwaku:latest.log
2026-03-20 04:33:59.038 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 41769
2026-03-20 04:33:59.038 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-20 04:34:00.040 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41769/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:34:00.064 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-20 04:34:00.064 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-20 04:34:00.065 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41769/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:34:00.069 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.16.141/tcp/41770/p2p/16Uiu2HAkwENqh4bhdxDdKLRTEhoCT2mzXrmc2pJBVLJhevaqZ3dw","/ip4/172.18.16.141/tcp/41771/ws/p2p/16Uiu2HAkwENqh4bhdxDdKLRTEhoCT2mzXrmc2pJBVLJhevaqZ3dw"],"enrUri":"enr:-L24QBqzNn2-sbBj_eSo3PxDeiEg8MhRe-eATWhAgEu3er8IEpuGJFmf7rudSVHfj8s64WRM5b5foq0CmGu0Q1sdo_0CgmlkgnY0gmlwhKwSEI2KbXVsdGlhZGRyc5YACASsEhCNBqMqAAoErBIQjQajK90DgnJzhQADAQAAiXNlY3AyNTZrMaECGtKa5DHS0pry_BeVJIm9kuQJiIG7bR_NghTNwFGEogaDdGNwgqMqg3VkcIKjLIV3YWt1MgE"}'
2026-03-20 04:34:00.070 INFO [src.node.waku_node] REST service is ready !!
2026-03-20 04:34:00.070 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41769/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.248.63/tcp/62626/p2p/16Uiu2HAm2aiwXTMSbhFMv5VF8QbiMLDNvTJSSkkUQpMT2BZEfW1W"]'
2026-03-20 04:34:00.076 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:34:00.076 DEBUG [src.steps.relay] Running fixture setup: subscribe_main_relay_nodes
2026-03-20 04:34:00.076 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62625/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-20 04:34:00.084 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:34:00.085 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20505/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-20 04:34:00.092 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:34:00.099 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62625/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:34:00.104 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:34:00.105 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-20 04:34:00.205 DEBUG [src.steps.relay] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-20 04:34:00.206 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62625/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:34:00.208 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1773981240099291904,"ephemeral":false,"proof":""}]'
2026-03-20 04:34:00.210 DEBUG [src.steps.relay] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-20 04:34:00.210 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20505/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:34:00.213 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1773981240099291904,"ephemeral":false,"proof":""}]'
2026-03-20 04:34:00.214 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62625/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:34:00.221 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:34:00.221 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-20 04:34:00.322 DEBUG [src.steps.relay] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-20 04:34:00.323 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18265/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:34:00.326 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:18265/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1. Response content: b''
2026-03-20 04:34:00.329 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-20 04:34:00.330 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-20 04:34:00.330 DEBUG [src.node.waku_node] Stopping container with id c078c29f765e
2026-03-20 04:34:01.005 DEBUG [src.node.waku_node] Container stopped.
2026-03-20 04:34:01.005 DEBUG [src.node.waku_node] Stopping container with id 59f73394e198
2026-03-20 04:34:01.582 DEBUG [src.node.waku_node] Container stopped.
2026-03-20 04:34:01.583 DEBUG [src.node.waku_node] Stopping container with id 58520b380654
2026-03-20 04:34:01.823 ERROR [src.node.docker_mananger] Max retries reached for container c078c29f765e. Exiting log stream.
2026-03-20 04:34:02.152 DEBUG [src.node.waku_node] Container stopped.
2026-03-20 04:34:02.152 DEBUG [src.node.waku_node] Stopping container with id 0ef504b65507
2026-03-20 04:34:02.422 ERROR [src.node.docker_mananger] Max retries reached for container 59f73394e198. Exiting log stream.
2026-03-20 04:34:02.711 DEBUG [src.node.waku_node] Container stopped.
2026-03-20 04:34:02.713 DEBUG [src.node.waku_node] Stopping container with id ef4e34727b20
2026-03-20 04:34:02.967 ERROR [src.node.docker_mananger] Max retries reached for container 58520b380654. Exiting log stream.
2026-03-20 04:34:03.273 DEBUG [src.node.waku_node] Container stopped.
2026-03-20 04:34:03.274 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-20 04:34:03.290 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-20 04:34:03.301 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-20 04:34:03.305 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-20 04:34:03.310 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-20 04:34:03.315 DEBUG [src.node.docker_mananger] No errors found in the waku logs.