192 lines
34 KiB
Plaintext

2026-04-23 05:11:15.974 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-23 05:11:15.975 DEBUG [tests.conftest] Running test: test_last_node_to_start_publishes with id: 2026-04-23_05-11-15__6f8172ef-1ffa-4a4d-bb54-3124fe1099d0
2026-04-23 05:11:15.975 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-23 05:11:15.975 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-23 05:11:15.975 DEBUG [src.steps.relay] Running fixture setup: setup_main_relay_nodes
2026-04-23 05:11:15.982 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:11:15.982 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-23_05-11-15__6f8172ef-1ffa-4a4d-bb54-3124fe1099d0__wakuorg_nwaku:latest.log
2026-04-23 05:11:15.982 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:11:15.982 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:11:15.984 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:11:15.984 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.156.203
2026-04-23 05:11:15.984 DEBUG [src.node.docker_mananger] Generated ports ['4142', '4143', '4144', '4145', '4146']
2026-04-23 05:11:15.984 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:11:15.984 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:11:15.984 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:11:15.985 DEBUG [src.node.docker_mananger] docker run -i -t -p 4142:4142 -p 4143:4143 -p 4144:4144 -p 4145:4145 -p 4146:4146 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=4144 --rest-port=4142 --tcp-port=4143 --discv5-udp-port=4145 --rest-address=0.0.0.0 --nat=extip:172.18.156.203 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=39515a63ba4abfeda07decb2bd4fe4097d5a44b11c583a9af326508b65d83249 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=4146 --metrics-logging=true --relay=true
2026-04-23 05:11:16.170 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.156.203 waku b9fe0a68aee8bfb9f908f258d7692bc96e1a6dcaf510664f71deb66fec128a12
2026-04-23 05:11:16.206 DEBUG [src.node.docker_mananger] Container started with ID b9fe0a68aee8. Setting up logs at ./log/docker/node1_2026-04-23_05-11-15__6f8172ef-1ffa-4a4d-bb54-3124fe1099d0__wakuorg_nwaku:latest.log
2026-04-23 05:11:16.206 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 4142
2026-04-23 05:11:16.207 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:11:16.330 ERROR [src.node.docker_mananger] Max retries reached for container 6cce4dbed58a. Exiting log stream.
2026-04-23 05:11:16.783 ERROR [src.node.docker_mananger] Max retries reached for container 0f8d1d5974f7. Exiting log stream.
2026-04-23 05:11:17.207 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4142/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:17.210 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:11:17.210 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:11:17.210 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4142/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:17.213 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.156.203/tcp/4143/p2p/16Uiu2HAm3geZZN2zvVNXVvJViTNYxoVJxSRZfJifTbXuCYkgMLtc","/ip4/172.18.156.203/tcp/4144/ws/p2p/16Uiu2HAm3geZZN2zvVNXVvJViTNYxoVJxSRZfJifTbXuCYkgMLtc"],"enrUri":"enr:-L24QEscJpkBbzNNQGGPvo1mjATtggjwGiB6yhih8UcMRUu8fEwVA665N5FobhmFoLHrLPilrkQnYTpJhpyA36ON0AwCgmlkgnY0gmlwhKwSnMuKbXVsdGlhZGRyc5YACASsEpzLBhAvAAoErBKcywYQMN0DgnJzhQDGAQAAiXNlY3AyNTZrMaECerOauU7RwrW0fbnO9q-MnxnMuOy-yTB_L1dV3MFf_Q2DdGNwghAvg3VkcIIQMYV3YWt1MgE"}'
2026-04-23 05:11:17.213 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:11:17.219 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:11:17.219 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-23_05-11-15__6f8172ef-1ffa-4a4d-bb54-3124fe1099d0__wakuorg_nwaku:latest.log
2026-04-23 05:11:17.220 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:11:17.220 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:11:17.221 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:11:17.221 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.53.37
2026-04-23 05:11:17.221 DEBUG [src.node.docker_mananger] Generated ports ['19483', '19484', '19485', '19486', '19487']
2026-04-23 05:11:17.222 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:11:17.222 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:11:17.222 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:11:17.222 DEBUG [src.node.docker_mananger] docker run -i -t -p 19483:19483 -p 19484:19484 -p 19485:19485 -p 19486:19486 -p 19487:19487 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=19485 --rest-port=19483 --tcp-port=19484 --discv5-udp-port=19486 --rest-address=0.0.0.0 --nat=extip:172.18.53.37 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=ebb83a11b3feb984f8e492a4f7446bac13e7075bbd47e8262c0cc6c3b0ba025b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=19487 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QEscJpkBbzNNQGGPvo1mjATtggjwGiB6yhih8UcMRUu8fEwVA665N5FobhmFoLHrLPilrkQnYTpJhpyA36ON0AwCgmlkgnY0gmlwhKwSnMuKbXVsdGlhZGRyc5YACASsEpzLBhAvAAoErBKcywYQMN0DgnJzhQDGAQAAiXNlY3AyNTZrMaECerOauU7RwrW0fbnO9q-MnxnMuOy-yTB_L1dV3MFf_Q2DdGNwghAvg3VkcIIQMYV3YWt1MgE
2026-04-23 05:11:17.404 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.53.37 waku 482cf0a34875337c8edd95156eae3b6ddd2e0c1615bc14c84fe21dfa6af672af
2026-04-23 05:11:17.440 DEBUG [src.node.docker_mananger] Container started with ID 482cf0a34875. Setting up logs at ./log/docker/node2_2026-04-23_05-11-15__6f8172ef-1ffa-4a4d-bb54-3124fe1099d0__wakuorg_nwaku:latest.log
2026-04-23 05:11:17.440 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 19483
2026-04-23 05:11:17.441 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:11:18.445 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19483/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:18.449 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:11:18.450 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:11:18.450 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19483/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:18.454 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.53.37/tcp/19484/p2p/16Uiu2HAkxHPDPGPXgZv7D9ET1q5kmxWJxDfUSW7sigikGPm9mNYW","/ip4/172.18.53.37/tcp/19485/ws/p2p/16Uiu2HAkxHPDPGPXgZv7D9ET1q5kmxWJxDfUSW7sigikGPm9mNYW"],"enrUri":"enr:-L24QEEUjg0QsniwsYeFifum3tpwOyjoSPkkLCJXIDIOQbhCaMGV5QndzC8BFr8JammlVtwFF5igUGaJRgzdETjlfkICgmlkgnY0gmlwhKwSNSWKbXVsdGlhZGRyc5YACASsEjUlBkwcAAoErBI1JQZMHd0DgnJzhQDGAQAAiXNlY3AyNTZrMaECKnN1EdzYWe3jTXvywj4BYEj_CxBgL72GxfO290wBmfeDdGNwgkwcg3VkcIJMHoV3YWt1MgE"}'
2026-04-23 05:11:18.454 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:11:18.455 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19483/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.156.203/tcp/4143/p2p/16Uiu2HAm3geZZN2zvVNXVvJViTNYxoVJxSRZfJifTbXuCYkgMLtc"]'
2026-04-23 05:11:18.461 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:11:18.462 DEBUG [src.steps.relay] Running fixture setup: setup_optional_relay_nodes
2026-04-23 05:11:18.469 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:11:18.470 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-04-23_05-11-15__6f8172ef-1ffa-4a4d-bb54-3124fe1099d0__wakuorg_nwaku:latest.log
2026-04-23 05:11:18.470 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:11:18.470 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:11:18.471 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:11:18.471 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.157.255
2026-04-23 05:11:18.472 DEBUG [src.node.docker_mananger] Generated ports ['24784', '24785', '24786', '24787', '24788']
2026-04-23 05:11:18.472 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:11:18.472 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:11:18.472 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:11:18.472 DEBUG [src.node.docker_mananger] docker run -i -t -p 24784:24784 -p 24785:24785 -p 24786:24786 -p 24787:24787 -p 24788:24788 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24786 --rest-port=24784 --tcp-port=24785 --discv5-udp-port=24787 --rest-address=0.0.0.0 --nat=extip:172.18.157.255 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=c7f3f2319851d214e5e13318bfbaafb9cce9d7af7defc65d2b06eb667891c8e2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24788 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QEscJpkBbzNNQGGPvo1mjATtggjwGiB6yhih8UcMRUu8fEwVA665N5FobhmFoLHrLPilrkQnYTpJhpyA36ON0AwCgmlkgnY0gmlwhKwSnMuKbXVsdGlhZGRyc5YACASsEpzLBhAvAAoErBKcywYQMN0DgnJzhQDGAQAAiXNlY3AyNTZrMaECerOauU7RwrW0fbnO9q-MnxnMuOy-yTB_L1dV3MFf_Q2DdGNwghAvg3VkcIIQMYV3YWt1MgE
2026-04-23 05:11:18.666 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.157.255 waku 5036f0ca498fddf45584bea9e5aa4572a05977d23a760ff5d85d6764d132dab2
2026-04-23 05:11:18.705 DEBUG [src.node.docker_mananger] Container started with ID 5036f0ca498f. Setting up logs at ./log/docker/node3_2026-04-23_05-11-15__6f8172ef-1ffa-4a4d-bb54-3124fe1099d0__wakuorg_nwaku:latest.log
2026-04-23 05:11:18.706 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 24784
2026-04-23 05:11:18.706 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:11:19.706 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24784/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:19.715 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:11:19.716 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:11:19.717 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24784/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:19.720 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.157.255/tcp/24785/p2p/16Uiu2HAmKg8DtQ71dZNS67iMzEkEfvUY1tyuFH2yssMiRKz3N7RJ","/ip4/172.18.157.255/tcp/24786/ws/p2p/16Uiu2HAmKg8DtQ71dZNS67iMzEkEfvUY1tyuFH2yssMiRKz3N7RJ"],"enrUri":"enr:-L24QM50kaChRvqMitEhZ2jFBd4lyokzy8gIvDhq3nyTmglyazl1XzwRV0JDN5lxtqsjvHhSf0lAPi-HlooCTtuyfvACgmlkgnY0gmlwhKwSnf-KbXVsdGlhZGRyc5YACASsEp3_BmDRAAoErBKd_wZg0t0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDaExKZQZ3kcEsDD8EKfZTftHrSsheGwMB9ZHwuQ4TGeGDdGNwgmDRg3VkcIJg04V3YWt1MgE"}'
2026-04-23 05:11:19.720 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:11:19.721 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24784/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.156.203/tcp/4143/p2p/16Uiu2HAm3geZZN2zvVNXVvJViTNYxoVJxSRZfJifTbXuCYkgMLtc"]'
2026-04-23 05:11:19.725 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:11:19.732 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:11:19.732 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-04-23_05-11-15__6f8172ef-1ffa-4a4d-bb54-3124fe1099d0__wakuorg_nwaku:latest.log
2026-04-23 05:11:19.732 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:11:19.732 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:11:19.733 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:11:19.733 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.190.152
2026-04-23 05:11:19.734 DEBUG [src.node.docker_mananger] Generated ports ['2068', '2069', '2070', '2071', '2072']
2026-04-23 05:11:19.734 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:11:19.734 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:11:19.734 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:11:19.734 DEBUG [src.node.docker_mananger] docker run -i -t -p 2068:2068 -p 2069:2069 -p 2070:2070 -p 2071:2071 -p 2072:2072 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=2070 --rest-port=2068 --tcp-port=2069 --discv5-udp-port=2071 --rest-address=0.0.0.0 --nat=extip:172.18.190.152 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=cca240674bd96fef36dc89d8e4c612dbd93b150dccfb0cad8e8fa9ddf1709c40 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=2072 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QEscJpkBbzNNQGGPvo1mjATtggjwGiB6yhih8UcMRUu8fEwVA665N5FobhmFoLHrLPilrkQnYTpJhpyA36ON0AwCgmlkgnY0gmlwhKwSnMuKbXVsdGlhZGRyc5YACASsEpzLBhAvAAoErBKcywYQMN0DgnJzhQDGAQAAiXNlY3AyNTZrMaECerOauU7RwrW0fbnO9q-MnxnMuOy-yTB_L1dV3MFf_Q2DdGNwghAvg3VkcIIQMYV3YWt1MgE
2026-04-23 05:11:19.934 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.190.152 waku 42d2d7c6d252df7ecb9c36736fb9057c9ece1b9e66e45cf5f9d29d0a54a39f91
2026-04-23 05:11:19.965 DEBUG [src.node.docker_mananger] Container started with ID 42d2d7c6d252. Setting up logs at ./log/docker/node4_2026-04-23_05-11-15__6f8172ef-1ffa-4a4d-bb54-3124fe1099d0__wakuorg_nwaku:latest.log
2026-04-23 05:11:19.965 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 2068
2026-04-23 05:11:19.965 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:11:20.970 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2068/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:20.977 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:11:20.977 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:11:20.977 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2068/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:20.980 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.190.152/tcp/2069/p2p/16Uiu2HAm9QmBFrWmGNjkjdfnADVWfFZhLSU3pJpREx4JXLXMcqyn","/ip4/172.18.190.152/tcp/2070/ws/p2p/16Uiu2HAm9QmBFrWmGNjkjdfnADVWfFZhLSU3pJpREx4JXLXMcqyn"],"enrUri":"enr:-L24QF2QgrIH25GjgOpV9ma777GJuKpJUcjvNZSvaG4ocRhPRa3MeLenFTKHWxdJpWyKa1nSUYOs0yAE4ge_jSIigV4CgmlkgnY0gmlwhKwSvpiKbXVsdGlhZGRyc5YACASsEr6YBggVAAoErBK-mAYIFt0DgnJzhQDGAQAAiXNlY3AyNTZrMaECz8fpxI_ZaW9xdY8x1HQXHtyxjfSYVs6w-LfCCLBCWdWDdGNwgggVg3VkcIIIF4V3YWt1MgE"}'
2026-04-23 05:11:20.980 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:11:20.980 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2068/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.156.203/tcp/4143/p2p/16Uiu2HAm3geZZN2zvVNXVvJViTNYxoVJxSRZfJifTbXuCYkgMLtc"]'
2026-04-23 05:11:20.983 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:11:20.990 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 05:11:20.990 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-04-23_05-11-15__6f8172ef-1ffa-4a4d-bb54-3124fe1099d0__wakuorg_nwaku:latest.log
2026-04-23 05:11:20.990 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 05:11:20.991 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 05:11:20.992 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 05:11:20.992 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.123.249
2026-04-23 05:11:20.992 DEBUG [src.node.docker_mananger] Generated ports ['53427', '53428', '53429', '53430', '53431']
2026-04-23 05:11:20.992 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 05:11:20.993 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 05:11:20.993 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 05:11:20.993 DEBUG [src.node.docker_mananger] docker run -i -t -p 53427:53427 -p 53428:53428 -p 53429:53429 -p 53430:53430 -p 53431:53431 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=53429 --rest-port=53427 --tcp-port=53428 --discv5-udp-port=53430 --rest-address=0.0.0.0 --nat=extip:172.18.123.249 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=5cafe6ff2fed4cd29e682ce162dc550af2b4bdb4a929fcdabe3e8fea6d9bfbf5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=53431 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QEscJpkBbzNNQGGPvo1mjATtggjwGiB6yhih8UcMRUu8fEwVA665N5FobhmFoLHrLPilrkQnYTpJhpyA36ON0AwCgmlkgnY0gmlwhKwSnMuKbXVsdGlhZGRyc5YACASsEpzLBhAvAAoErBKcywYQMN0DgnJzhQDGAQAAiXNlY3AyNTZrMaECerOauU7RwrW0fbnO9q-MnxnMuOy-yTB_L1dV3MFf_Q2DdGNwghAvg3VkcIIQMYV3YWt1MgE
2026-04-23 05:11:21.186 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.123.249 waku 2e437830ece6900b1db1d6a4ea03ee09a55a96b4264fb04fbed21cad4bdf2552
2026-04-23 05:11:21.217 DEBUG [src.node.docker_mananger] Container started with ID 2e437830ece6. Setting up logs at ./log/docker/node5_2026-04-23_05-11-15__6f8172ef-1ffa-4a4d-bb54-3124fe1099d0__wakuorg_nwaku:latest.log
2026-04-23 05:11:21.218 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 53427
2026-04-23 05:11:21.218 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 05:11:22.219 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53427/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:22.236 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 05:11:22.236 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 05:11:22.237 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53427/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:22.239 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.123.249/tcp/53428/p2p/16Uiu2HAmSj6qgynF3J52pEKnKdMPAivZgbtJzLcyRdDoNLHfG35n","/ip4/172.18.123.249/tcp/53429/ws/p2p/16Uiu2HAmSj6qgynF3J52pEKnKdMPAivZgbtJzLcyRdDoNLHfG35n"],"enrUri":"enr:-L24QCX85pbq-Pj22yeGcrFLTtCUYbcjT4W8pAkrnyT2PtPed8pgD5v_ScGtE5x9uIVUnZ61sj_Sk5A2q6rvrQkpeZUCgmlkgnY0gmlwhKwSe_mKbXVsdGlhZGRyc5YACASsEnv5BtC0AAoErBJ7-QbQtd0DgnJzhQDGAQAAiXNlY3AyNTZrMaED0RFHMKlsk5Ozu_9jDNVzl9q3H2d5wAXBce7LEKWKt1WDdGNwgtC0g3VkcILQtoV3YWt1MgE"}'
2026-04-23 05:11:22.239 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 05:11:22.240 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53427/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.156.203/tcp/4143/p2p/16Uiu2HAm3geZZN2zvVNXVvJViTNYxoVJxSRZfJifTbXuCYkgMLtc"]'
2026-04-23 05:11:22.242 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:11:22.243 DEBUG [src.steps.relay] Running fixture setup: subscribe_main_relay_nodes
2026-04-23 05:11:22.243 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:4142/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
2026-04-23 05:11:22.252 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:11:22.253 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19483/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
2026-04-23 05:11:22.261 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:11:22.261 DEBUG [src.steps.relay] Running fixture setup: subscribe_optional_relay_nodes
2026-04-23 05:11:22.262 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24784/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
2026-04-23 05:11:22.267 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:11:22.267 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2068/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
2026-04-23 05:11:22.273 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:11:22.273 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53427/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
2026-04-23 05:11:22.277 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:11:22.278 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:4142/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-04-23 05:11:22.293 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:11:22.294 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-04-23 05:11:22.395 DEBUG [src.steps.relay] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-04-23 05:11:22.395 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4142/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:22.398 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776921082278599168,"ephemeral":false,"proof":""}]'
2026-04-23 05:11:22.399 DEBUG [src.steps.relay] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-04-23 05:11:22.399 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19483/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:22.402 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776921082278599168,"ephemeral":false,"proof":""}]'
2026-04-23 05:11:22.403 DEBUG [src.steps.relay] Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
2026-04-23 05:11:22.403 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24784/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:22.406 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776921082278599168,"ephemeral":false,"proof":""}]'
2026-04-23 05:11:22.408 DEBUG [src.steps.relay] Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message
2026-04-23 05:11:22.408 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2068/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:22.410 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776921082278599168,"ephemeral":false,"proof":""}]'
2026-04-23 05:11:22.411 DEBUG [src.steps.relay] Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message
2026-04-23 05:11:22.412 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53427/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:22.414 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776921082278599168,"ephemeral":false,"proof":""}]'
2026-04-23 05:11:22.416 INFO [src.steps.relay] WARM UP successful!!
2026-04-23 05:11:22.417 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53427/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-04-23 05:11:22.421 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 05:11:22.422 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-04-23 05:11:22.522 DEBUG [src.steps.relay] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-04-23 05:11:22.522 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4142/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:22.525 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776921082417550073,"ephemeral":false,"proof":""}]'
2026-04-23 05:11:22.526 DEBUG [src.steps.relay] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-04-23 05:11:22.526 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19483/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:22.528 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776921082417550073,"ephemeral":false,"proof":""}]'
2026-04-23 05:11:22.529 DEBUG [src.steps.relay] Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
2026-04-23 05:11:22.530 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24784/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:22.532 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776921082417550073,"ephemeral":false,"proof":""}]'
2026-04-23 05:11:22.533 DEBUG [src.steps.relay] Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message
2026-04-23 05:11:22.533 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2068/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:22.535 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776921082417550073,"ephemeral":false,"proof":""}]'
2026-04-23 05:11:22.536 DEBUG [src.steps.relay] Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message
2026-04-23 05:11:22.537 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53427/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d 'None'
2026-04-23 05:11:22.539 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1776921082417550073,"ephemeral":false,"proof":""}]'
2026-04-23 05:11:22.542 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-23 05:11:22.544 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-23 05:11:22.544 DEBUG [src.node.waku_node] Stopping container with id b9fe0a68aee8
2026-04-23 05:11:23.049 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:11:23.049 DEBUG [src.node.waku_node] Stopping container with id 482cf0a34875
2026-04-23 05:11:23.549 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:11:23.550 DEBUG [src.node.waku_node] Stopping container with id 5036f0ca498f
2026-04-23 05:11:23.861 ERROR [src.node.docker_mananger] Max retries reached for container b9fe0a68aee8. Exiting log stream.
2026-04-23 05:11:23.997 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:11:23.998 DEBUG [src.node.waku_node] Stopping container with id 42d2d7c6d252
2026-04-23 05:11:24.362 ERROR [src.node.docker_mananger] Max retries reached for container 482cf0a34875. Exiting log stream.
2026-04-23 05:11:24.442 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:11:24.442 DEBUG [src.node.waku_node] Stopping container with id 2e437830ece6
2026-04-23 05:11:24.835 ERROR [src.node.docker_mananger] Max retries reached for container 5036f0ca498f. Exiting log stream.
2026-04-23 05:11:24.895 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 05:11:24.897 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-23 05:11:24.918 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:11:24.925 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:11:24.938 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:11:24.945 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 05:11:24.952 DEBUG [src.node.docker_mananger] No errors found in the waku logs.