2026-02-25 19:46:01 +00:00

163 lines
30 KiB
Plaintext

2026-02-25 19:26:43.589 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-25 19:26:43.590 DEBUG [tests.conftest] Running test: test_optional_nodes_not_subscribed_to_same_pubsub_topic with id: 2026-02-25_19-26-43__55d0a87f-4f41-4194-bf13-c7101c1d15df
2026-02-25 19:26:43.590 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-25 19:26:43.590 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-25 19:26:43.590 DEBUG [src.steps.relay] Running fixture setup: setup_main_relay_nodes
2026-02-25 19:26:43.598 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 19:26:43.598 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-25_19-26-43__55d0a87f-4f41-4194-bf13-c7101c1d15df__wakuorg_nwaku:latest.log
2026-02-25 19:26:43.598 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 19:26:43.598 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 19:26:43.600 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 19:26:43.600 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.70.241
2026-02-25 19:26:43.600 DEBUG [src.node.docker_mananger] Generated ports ['1536', '1537', '1538', '1539', '1540']
2026-02-25 19:26:43.600 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 19:26:43.600 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 19:26:43.600 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 19:26:43.600 DEBUG [src.node.docker_mananger] docker run -i -t -p 1536:1536 -p 1537:1537 -p 1538:1538 -p 1539:1539 -p 1540:1540 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=1538 --rest-port=1536 --tcp-port=1537 --discv5-udp-port=1539 --rest-address=0.0.0.0 --nat=extip:172.18.70.241 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fd8ea8e7a8fe749d996cecc7a9c38a9aba896dcdc4fe0cb0158dfdcf8a7fd6ac --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=1540 --metrics-logging=true --relay=true
2026-02-25 19:26:43.797 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.70.241 waku 37bae1caa8d73a7dbb25d2cb3e9844dc041e9a3bd4eb2e47c276069214460f50
2026-02-25 19:26:43.824 ERROR [src.node.docker_mananger] Max retries reached for container 8a2584b17331. Exiting log stream.
2026-02-25 19:26:43.836 DEBUG [src.node.docker_mananger] Container started with ID 37bae1caa8d7. Setting up logs at ./log/docker/node1_2026-02-25_19-26-43__55d0a87f-4f41-4194-bf13-c7101c1d15df__wakuorg_nwaku:latest.log
2026-02-25 19:26:43.836 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 1536
2026-02-25 19:26:43.837 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 19:26:44.372 ERROR [src.node.docker_mananger] Max retries reached for container 1c12044109b0. Exiting log stream.
2026-02-25 19:26:44.837 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1536/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:26:44.840 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 19:26:44.840 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 19:26:44.840 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1536/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:26:44.843 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.70.241/tcp/1537/p2p/16Uiu2HAmFAEeuRhyvHNashCT29yeS4XqtgVHo7FQ1knjR5UdMpsZ","/ip4/172.18.70.241/tcp/1538/ws/p2p/16Uiu2HAmFAEeuRhyvHNashCT29yeS4XqtgVHo7FQ1knjR5UdMpsZ"],"enrUri":"enr:-L24QKk3k0aS9G2068y7-N3RnMAjk5h_c8tXZ0d2wwmuVhS9M9IGMya-zkKp7xjFlWTjpNyJx78pTIi6Ybx8mhTl6jACgmlkgnY0gmlwhKwSRvGKbXVsdGlhZGRyc5YACASsEkbxBgYBAAoErBJG8QYGAt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDJTVj_Bwk7SD2nqSxW8XMYZsuqnVF0rrhVRrr3S-nq1CDdGNwggYBg3VkcIIGA4V3YWt1MgE"}'
2026-02-25 19:26:44.843 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 19:26:44.850 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 19:26:44.850 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-25_19-26-43__55d0a87f-4f41-4194-bf13-c7101c1d15df__wakuorg_nwaku:latest.log
2026-02-25 19:26:44.850 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 19:26:44.850 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 19:26:44.852 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 19:26:44.852 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.225.225
2026-02-25 19:26:44.852 DEBUG [src.node.docker_mananger] Generated ports ['24372', '24373', '24374', '24375', '24376']
2026-02-25 19:26:44.852 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 19:26:44.852 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 19:26:44.852 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 19:26:44.852 DEBUG [src.node.docker_mananger] docker run -i -t -p 24372:24372 -p 24373:24373 -p 24374:24374 -p 24375:24375 -p 24376:24376 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24374 --rest-port=24372 --tcp-port=24373 --discv5-udp-port=24375 --rest-address=0.0.0.0 --nat=extip:172.18.225.225 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=6ec327bd4d0ad5ed6414ab545b4ec9ac98d15008485974ff6945b6828ffac0be --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24376 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKk3k0aS9G2068y7-N3RnMAjk5h_c8tXZ0d2wwmuVhS9M9IGMya-zkKp7xjFlWTjpNyJx78pTIi6Ybx8mhTl6jACgmlkgnY0gmlwhKwSRvGKbXVsdGlhZGRyc5YACASsEkbxBgYBAAoErBJG8QYGAt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDJTVj_Bwk7SD2nqSxW8XMYZsuqnVF0rrhVRrr3S-nq1CDdGNwggYBg3VkcIIGA4V3YWt1MgE
2026-02-25 19:26:45.048 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.225.225 waku e2b51586d2cfba724c618dd2e115cb9c04bec62b564d7cb1fdf72b2f7cffce57
2026-02-25 19:26:45.083 DEBUG [src.node.docker_mananger] Container started with ID e2b51586d2cf. Setting up logs at ./log/docker/node2_2026-02-25_19-26-43__55d0a87f-4f41-4194-bf13-c7101c1d15df__wakuorg_nwaku:latest.log
2026-02-25 19:26:45.084 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 24372
2026-02-25 19:26:45.084 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 19:26:46.087 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24372/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:26:46.105 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 19:26:46.106 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 19:26:46.106 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24372/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:26:46.111 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.225.225/tcp/24373/p2p/16Uiu2HAkur1AYPXzyxzZmrW8CD2DdqRsBQSGiBVSaR6FFf6zr5hR","/ip4/172.18.225.225/tcp/24374/ws/p2p/16Uiu2HAkur1AYPXzyxzZmrW8CD2DdqRsBQSGiBVSaR6FFf6zr5hR"],"enrUri":"enr:-L24QGZOdRYQjTHtdX3Dnu5HsIUNyJSlyuajOUG7CPHlNjKoAwrOu-x7Lz_Mk-KclvqMbw7EJv1R8xLZn89muKT85jsCgmlkgnY0gmlwhKwS4eGKbXVsdGlhZGRyc5YACASsEuHhBl81AAoErBLh4QZfNt0DgnJzhQADAQAAiXNlY3AyNTZrMaECBjuh4CpMwD-mhVLtauQ9Ume-s0tTMvC-tbpqv8pCfJCDdGNwgl81g3VkcIJfN4V3YWt1MgE"}'
2026-02-25 19:26:46.111 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 19:26:46.112 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24372/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.70.241/tcp/1537/p2p/16Uiu2HAmFAEeuRhyvHNashCT29yeS4XqtgVHo7FQ1knjR5UdMpsZ"]'
2026-02-25 19:26:46.118 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 19:26:46.119 DEBUG [src.steps.relay] Running fixture setup: setup_optional_relay_nodes
2026-02-25 19:26:46.126 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 19:26:46.126 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-25_19-26-43__55d0a87f-4f41-4194-bf13-c7101c1d15df__wakuorg_nwaku:latest.log
2026-02-25 19:26:46.126 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 19:26:46.126 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 19:26:46.128 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 19:26:46.128 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.178.198
2026-02-25 19:26:46.128 DEBUG [src.node.docker_mananger] Generated ports ['60596', '60597', '60598', '60599', '60600']
2026-02-25 19:26:46.128 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 19:26:46.128 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 19:26:46.128 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 19:26:46.128 DEBUG [src.node.docker_mananger] docker run -i -t -p 60596:60596 -p 60597:60597 -p 60598:60598 -p 60599:60599 -p 60600:60600 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=60598 --rest-port=60596 --tcp-port=60597 --discv5-udp-port=60599 --rest-address=0.0.0.0 --nat=extip:172.18.178.198 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a56dcf3c6e1aa40f3aa763d4001ac01f1dcfb7eb4369fc9dbecdec4ee1ab5f5b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=60600 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKk3k0aS9G2068y7-N3RnMAjk5h_c8tXZ0d2wwmuVhS9M9IGMya-zkKp7xjFlWTjpNyJx78pTIi6Ybx8mhTl6jACgmlkgnY0gmlwhKwSRvGKbXVsdGlhZGRyc5YACASsEkbxBgYBAAoErBJG8QYGAt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDJTVj_Bwk7SD2nqSxW8XMYZsuqnVF0rrhVRrr3S-nq1CDdGNwggYBg3VkcIIGA4V3YWt1MgE
2026-02-25 19:26:46.331 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.178.198 waku 75f35158ce12867468c3c1bfa0fcbbe871434af7739ee8a10b1c041036c16da6
2026-02-25 19:26:46.365 DEBUG [src.node.docker_mananger] Container started with ID 75f35158ce12. Setting up logs at ./log/docker/node3_2026-02-25_19-26-43__55d0a87f-4f41-4194-bf13-c7101c1d15df__wakuorg_nwaku:latest.log
2026-02-25 19:26:46.366 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 60596
2026-02-25 19:26:46.366 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 19:26:47.367 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60596/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:26:47.380 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 19:26:47.380 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 19:26:47.380 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60596/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:26:47.385 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.178.198/tcp/60597/p2p/16Uiu2HAmSdKL1sq4PEmzwy5mQM7zzJ5DzbK7vsPrb22gaQ8cUYaS","/ip4/172.18.178.198/tcp/60598/ws/p2p/16Uiu2HAmSdKL1sq4PEmzwy5mQM7zzJ5DzbK7vsPrb22gaQ8cUYaS"],"enrUri":"enr:-L24QKqdSPvYV4atu1chJ7Z0f3bUsZjWpLkCUCi7t-cRT3Taccj61ug-l4Cb9iL_Uf5PGazE6uiz-UYSi45G1BWe9EMCgmlkgnY0gmlwhKwSssaKbXVsdGlhZGRyc5YACASsErLGBuy1AAoErBKyxgbstt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDz5Xp9EkxFbhTquiEbNb228YdRHqw_6SP8ENd5OkqUPeDdGNwguy1g3VkcILst4V3YWt1MgE"}'
2026-02-25 19:26:47.386 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 19:26:47.387 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60596/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.70.241/tcp/1537/p2p/16Uiu2HAmFAEeuRhyvHNashCT29yeS4XqtgVHo7FQ1knjR5UdMpsZ"]'
2026-02-25 19:26:47.390 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 19:26:47.397 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 19:26:47.397 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-02-25_19-26-43__55d0a87f-4f41-4194-bf13-c7101c1d15df__wakuorg_nwaku:latest.log
2026-02-25 19:26:47.397 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 19:26:47.398 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 19:26:47.399 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 19:26:47.399 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.253.197
2026-02-25 19:26:47.399 DEBUG [src.node.docker_mananger] Generated ports ['23930', '23931', '23932', '23933', '23934']
2026-02-25 19:26:47.399 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 19:26:47.399 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 19:26:47.400 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 19:26:47.400 DEBUG [src.node.docker_mananger] docker run -i -t -p 23930:23930 -p 23931:23931 -p 23932:23932 -p 23933:23933 -p 23934:23934 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=23932 --rest-port=23930 --tcp-port=23931 --discv5-udp-port=23933 --rest-address=0.0.0.0 --nat=extip:172.18.253.197 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=6cb0c467ee085eede35cabdee63cbb1c7db634d1a63acb1098ece33e3b647e2c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=23934 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKk3k0aS9G2068y7-N3RnMAjk5h_c8tXZ0d2wwmuVhS9M9IGMya-zkKp7xjFlWTjpNyJx78pTIi6Ybx8mhTl6jACgmlkgnY0gmlwhKwSRvGKbXVsdGlhZGRyc5YACASsEkbxBgYBAAoErBJG8QYGAt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDJTVj_Bwk7SD2nqSxW8XMYZsuqnVF0rrhVRrr3S-nq1CDdGNwggYBg3VkcIIGA4V3YWt1MgE
2026-02-25 19:26:47.609 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.253.197 waku 70b7791f78e37d5464bf1ec32a8f3fb1f5991cba84c7cdfd9fefd22a0c10b4d4
2026-02-25 19:26:47.648 DEBUG [src.node.docker_mananger] Container started with ID 70b7791f78e3. Setting up logs at ./log/docker/node4_2026-02-25_19-26-43__55d0a87f-4f41-4194-bf13-c7101c1d15df__wakuorg_nwaku:latest.log
2026-02-25 19:26:47.648 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 23930
2026-02-25 19:26:47.649 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 19:26:48.650 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23930/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:26:48.664 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 19:26:48.664 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 19:26:48.664 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23930/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:26:48.672 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.253.197/tcp/23931/p2p/16Uiu2HAmGfXdxz3anwz2S4Fyxd4FShULhsiTDvN5id8nfSu9nX87","/ip4/172.18.253.197/tcp/23932/ws/p2p/16Uiu2HAmGfXdxz3anwz2S4Fyxd4FShULhsiTDvN5id8nfSu9nX87"],"enrUri":"enr:-L24QE1rtjhf6azuL7Lvk1xceuviTA2JFS4X9evYfIaXfpYdbBmeX9lth9lF18ybS1Uwm9Jz5r3zff-egc2K7IyqxP4CgmlkgnY0gmlwhKwS_cWKbXVsdGlhZGRyc5YACASsEv3FBl17AAoErBL9xQZdfN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDO5If5uu4bdKdSH3VuNqEqj4ODeK0CScJ-veg3yqImByDdGNwgl17g3VkcIJdfYV3YWt1MgE"}'
2026-02-25 19:26:48.673 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 19:26:48.673 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23930/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.70.241/tcp/1537/p2p/16Uiu2HAmFAEeuRhyvHNashCT29yeS4XqtgVHo7FQ1knjR5UdMpsZ"]'
2026-02-25 19:26:48.677 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 19:26:48.684 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 19:26:48.684 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-02-25_19-26-43__55d0a87f-4f41-4194-bf13-c7101c1d15df__wakuorg_nwaku:latest.log
2026-02-25 19:26:48.684 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 19:26:48.684 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 19:26:48.685 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 19:26:48.686 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.96.41
2026-02-25 19:26:48.686 DEBUG [src.node.docker_mananger] Generated ports ['34910', '34911', '34912', '34913', '34914']
2026-02-25 19:26:48.686 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 19:26:48.686 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 19:26:48.686 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 19:26:48.686 DEBUG [src.node.docker_mananger] docker run -i -t -p 34910:34910 -p 34911:34911 -p 34912:34912 -p 34913:34913 -p 34914:34914 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=34912 --rest-port=34910 --tcp-port=34911 --discv5-udp-port=34913 --rest-address=0.0.0.0 --nat=extip:172.18.96.41 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=eedfe9ef71e65e1c63fc24f4ecacdc851e14fa80e5abe53ebcbad0d69e42b267 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=34914 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKk3k0aS9G2068y7-N3RnMAjk5h_c8tXZ0d2wwmuVhS9M9IGMya-zkKp7xjFlWTjpNyJx78pTIi6Ybx8mhTl6jACgmlkgnY0gmlwhKwSRvGKbXVsdGlhZGRyc5YACASsEkbxBgYBAAoErBJG8QYGAt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDJTVj_Bwk7SD2nqSxW8XMYZsuqnVF0rrhVRrr3S-nq1CDdGNwggYBg3VkcIIGA4V3YWt1MgE
2026-02-25 19:26:48.887 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.96.41 waku 0f4f15685b0f8607f206a28d6bf76e4bed0068384a7970cbf4294d249adf9b33
2026-02-25 19:26:48.921 DEBUG [src.node.docker_mananger] Container started with ID 0f4f15685b0f. Setting up logs at ./log/docker/node5_2026-02-25_19-26-43__55d0a87f-4f41-4194-bf13-c7101c1d15df__wakuorg_nwaku:latest.log
2026-02-25 19:26:48.921 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 34910
2026-02-25 19:26:48.923 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 19:26:49.923 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34910/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:26:49.938 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 19:26:49.939 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 19:26:49.939 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34910/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:26:49.944 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.96.41/tcp/34911/p2p/16Uiu2HAm3wi23cwC2KewZNCPw1qXe7UpY2PEoFycaPBAgfNDpvST","/ip4/172.18.96.41/tcp/34912/ws/p2p/16Uiu2HAm3wi23cwC2KewZNCPw1qXe7UpY2PEoFycaPBAgfNDpvST"],"enrUri":"enr:-L24QNVIZDMIQXrOYdt25Yp5f6GP4wdKJb0yVaGrv9iBjhpuYcU0L9l4KCbbPlBlDHXZbPUxN7IoxPracsUYCIhD6RcCgmlkgnY0gmlwhKwSYCmKbXVsdGlhZGRyc5YACASsEmApBohfAAoErBJgKQaIYN0DgnJzhQADAQAAiXNlY3AyNTZrMaECfo85mbgiQCUagcPfVLWevvpwerFjimwWlK-9qRioMnCDdGNwgohfg3VkcIKIYYV3YWt1MgE"}'
2026-02-25 19:26:49.944 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 19:26:49.945 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34910/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.70.241/tcp/1537/p2p/16Uiu2HAmFAEeuRhyvHNashCT29yeS4XqtgVHo7FQ1knjR5UdMpsZ"]'
2026-02-25 19:26:49.947 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 19:26:49.948 DEBUG [src.steps.relay] Running fixture setup: subscribe_main_relay_nodes
2026-02-25 19:26:49.948 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1536/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 19:26:49.956 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 19:26:49.957 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24372/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 19:26:49.963 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 19:26:49.967 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1536/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 19:26:49.971 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 19:26:49.972 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-02-25 19:26:50.072 DEBUG [src.steps.relay] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-02-25 19:26:50.072 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1536/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:26:50.075 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772047609967406080,"ephemeral":false,"proof":""}]'
2026-02-25 19:26:50.076 DEBUG [src.steps.relay] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-02-25 19:26:50.077 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24372/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:26:50.079 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1772047609967406080,"ephemeral":false,"proof":""}]'
2026-02-25 19:26:50.081 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1536/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 19:26:50.086 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 19:26:50.087 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-02-25 19:26:50.187 DEBUG [src.steps.relay] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-02-25 19:26:50.187 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60596/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-02-25 19:26:50.189 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:60596/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1. Response content: b''
2026-02-25 19:26:50.192 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-25 19:26:50.193 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-25 19:26:50.193 DEBUG [src.node.waku_node] Stopping container with id 37bae1caa8d7
2026-02-25 19:26:50.836 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 19:26:50.838 DEBUG [src.node.waku_node] Stopping container with id e2b51586d2cf
2026-02-25 19:26:51.379 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 19:26:51.382 DEBUG [src.node.waku_node] Stopping container with id 75f35158ce12
2026-02-25 19:26:51.649 ERROR [src.node.docker_mananger] Max retries reached for container 37bae1caa8d7. Exiting log stream.
2026-02-25 19:26:51.937 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 19:26:51.937 DEBUG [src.node.waku_node] Stopping container with id 70b7791f78e3
2026-02-25 19:26:52.192 ERROR [src.node.docker_mananger] Max retries reached for container e2b51586d2cf. Exiting log stream.
2026-02-25 19:26:52.495 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 19:26:52.496 DEBUG [src.node.waku_node] Stopping container with id 0f4f15685b0f
2026-02-25 19:26:52.749 ERROR [src.node.docker_mananger] Max retries reached for container 75f35158ce12. Exiting log stream.
2026-02-25 19:26:53.101 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 19:26:53.103 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-25 19:26:53.118 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 19:26:53.125 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 19:26:53.132 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 19:26:53.140 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 19:26:53.145 DEBUG [src.node.docker_mananger] No errors found in the waku logs.