149 lines
33 KiB
Plaintext

2026-03-27 04:50:52.326 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-27 04:50:52.326 DEBUG [tests.conftest] Running test: test_admin_connected_peers_on_shard_contains_all_three with id: 2026-03-27_04-50-52__b0bb78a9-5c3d-47cb-965e-dda439be8c5a
2026-03-27 04:50:52.326 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-27 04:50:52.326 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-27 04:50:52.327 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-27 04:50:52.333 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-27 04:50:52.334 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-27_04-50-52__b0bb78a9-5c3d-47cb-965e-dda439be8c5a__wakuorg_nwaku:latest.log
2026-03-27 04:50:52.340 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-27 04:50:52.341 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-27_04-50-52__b0bb78a9-5c3d-47cb-965e-dda439be8c5a__wakuorg_nwaku:latest.log
2026-03-27 04:50:52.347 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-27 04:50:52.347 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-27_04-50-52__b0bb78a9-5c3d-47cb-965e-dda439be8c5a__wakuorg_nwaku:latest.log
2026-03-27 04:50:52.353 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-27 04:50:52.353 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-27_04-50-52__b0bb78a9-5c3d-47cb-965e-dda439be8c5a__wakuorg_nwaku:latest.log
2026-03-27 04:50:52.353 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-27 04:50:52.354 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-27 04:50:52.355 DEBUG [src.node.waku_node] Starting Node...
2026-03-27 04:50:52.355 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-27 04:50:52.356 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-27 04:50:52.356 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.24.53
2026-03-27 04:50:52.357 DEBUG [src.node.docker_mananger] Generated ports ['3992', '3993', '3994', '3995', '3996']
2026-03-27 04:50:52.357 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-27 04:50:52.357 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-27 04:50:52.357 DEBUG [src.node.waku_node] Using volumes []
2026-03-27 04:50:52.357 DEBUG [src.node.docker_mananger] docker run -i -t -p 3992:3992 -p 3993:3993 -p 3994:3994 -p 3995:3995 -p 3996:3996 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3994 --rest-port=3992 --tcp-port=3993 --discv5-udp-port=3995 --rest-address=0.0.0.0 --nat=extip:172.18.24.53 --peer-exchange=true --discv5-discovery=false --cluster-id=3 --nodekey=9b7a4a0a22fe1bcbddda53f107b2c3d6c8ecea4ba311d25405ecb739a65eab44 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3996 --metrics-logging=true --relay=true --dns-discovery=false
2026-03-27 04:50:52.543 ERROR [src.node.docker_mananger] Max retries reached for container 30eaa03fea77. Exiting log stream.
2026-03-27 04:50:52.556 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.24.53 waku 2fbd4fb3c769c3be3cad3073adb9466795b8a9f6ed684a44d5e2890a982456e4
2026-03-27 04:50:52.597 DEBUG [src.node.docker_mananger] Container started with ID 2fbd4fb3c769. Setting up logs at ./log/docker/node1_2026-03-27_04-50-52__b0bb78a9-5c3d-47cb-965e-dda439be8c5a__wakuorg_nwaku:latest.log
2026-03-27 04:50:52.597 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 3992
2026-03-27 04:50:52.597 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-27 04:50:53.136 ERROR [src.node.docker_mananger] Max retries reached for container 0b072facc999. Exiting log stream.
2026-03-27 04:50:53.598 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3992/health" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:50:53.601 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-27 04:50:53.601 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-27 04:50:53.601 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3992/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:50:53.603 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.24.53/tcp/3993/p2p/16Uiu2HAmDbp7HmSbME3juKqg7NPBWy2GHKPnn5918WFLpctF85Me","/ip4/172.18.24.53/tcp/3994/ws/p2p/16Uiu2HAmDbp7HmSbME3juKqg7NPBWy2GHKPnn5918WFLpctF85Me"],"enrUri":"enr:-La4QOhkOX0_TFwtwp8HMBDDWWhFuoNIT9aHiM4lbK_4PWnnCwgt8gMln0KWjZIn7EegyCok-ihZc6KX5iDW6R4lALUCgmlkgnY0gmlwhKwSGDWKbXVsdGlhZGRyc5YACASsEhg1Bg-ZAAoErBIYNQYPmt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDDgtdUih0odIUt5X64NAu_vSuNf9543i1ubuL1STwiVWDdGNwgg-ZhXdha3UyAQ"}'
2026-03-27 04:50:53.604 INFO [src.node.waku_node] REST service is ready !!
2026-03-27 04:50:53.604 DEBUG [src.node.waku_node] Starting Node...
2026-03-27 04:50:53.604 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-27 04:50:53.605 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-27 04:50:53.606 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.11.217
2026-03-27 04:50:53.606 DEBUG [src.node.docker_mananger] Generated ports ['58551', '58552', '58553', '58554', '58555']
2026-03-27 04:50:53.606 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-27 04:50:53.606 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-27 04:50:53.606 DEBUG [src.node.waku_node] Using volumes []
2026-03-27 04:50:53.606 DEBUG [src.node.docker_mananger] docker run -i -t -p 58551:58551 -p 58552:58552 -p 58553:58553 -p 58554:58554 -p 58555:58555 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=58553 --rest-port=58551 --tcp-port=58552 --discv5-udp-port=58554 --rest-address=0.0.0.0 --nat=extip:172.18.11.217 --peer-exchange=true --discv5-discovery=false --cluster-id=3 --nodekey=e8d49beafe40bcdca707c3beccbfd5ffaacda98f3dca6d93af4d4e6dbd6d2f63 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=58555 --metrics-logging=true --relay=true --dns-discovery=false --discv5-bootstrap-node=enr:-La4QOhkOX0_TFwtwp8HMBDDWWhFuoNIT9aHiM4lbK_4PWnnCwgt8gMln0KWjZIn7EegyCok-ihZc6KX5iDW6R4lALUCgmlkgnY0gmlwhKwSGDWKbXVsdGlhZGRyc5YACASsEhg1Bg-ZAAoErBIYNQYPmt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDDgtdUih0odIUt5X64NAu_vSuNf9543i1ubuL1STwiVWDdGNwgg-ZhXdha3UyAQ
2026-03-27 04:50:53.805 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.11.217 waku 7da93dd1956fcabb7ea82040ae7703b164f624e0c07dafb1f9cebcbc6d6670a9
2026-03-27 04:50:53.843 DEBUG [src.node.docker_mananger] Container started with ID 7da93dd1956f. Setting up logs at ./log/docker/node2_2026-03-27_04-50-52__b0bb78a9-5c3d-47cb-965e-dda439be8c5a__wakuorg_nwaku:latest.log
2026-03-27 04:50:53.843 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 58551
2026-03-27 04:50:53.844 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-27 04:50:54.845 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58551/health" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:50:54.848 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-27 04:50:54.848 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-27 04:50:54.848 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58551/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:50:54.851 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.11.217/tcp/58552/p2p/16Uiu2HAkx9HR13673tzg41LQy9Fo4mnvvZ56Hsz8v7nxtWqGfGzw","/ip4/172.18.11.217/tcp/58553/ws/p2p/16Uiu2HAkx9HR13673tzg41LQy9Fo4mnvvZ56Hsz8v7nxtWqGfGzw"],"enrUri":"enr:-La4QFMmDcnnTCGZ_6JLVCduWl43VrUauONgBNVckWrdPKjTOGJRDuDfGC8b9XxxCZrzI8A9zxEOH7-63NqAhUX471kCgmlkgnY0gmlwhKwSC9mKbXVsdGlhZGRyc5YACASsEgvZBuS4AAoErBIL2Qbkud0DgnJzhQADAQAAiXNlY3AyNTZrMaECKGBAyaBFj-r7knuzCDszqWNbLFrKupLuUYxE5cNhK9yDdGNwguS4hXdha3UyAQ"}'
2026-03-27 04:50:54.851 INFO [src.node.waku_node] REST service is ready !!
2026-03-27 04:50:54.857 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-27 04:50:54.858 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-27_04-50-52__b0bb78a9-5c3d-47cb-965e-dda439be8c5a__wakuorg_nwaku:latest.log
2026-03-27 04:50:54.864 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-27 04:50:54.864 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-27_04-50-52__b0bb78a9-5c3d-47cb-965e-dda439be8c5a__wakuorg_nwaku:latest.log
2026-03-27 04:50:54.865 DEBUG [src.node.waku_node] Starting Node...
2026-03-27 04:50:54.865 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-27 04:50:54.866 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-27 04:50:54.866 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.251.199
2026-03-27 04:50:54.866 DEBUG [src.node.docker_mananger] Generated ports ['10872', '10873', '10874', '10875', '10876']
2026-03-27 04:50:54.867 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-27 04:50:54.867 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-27 04:50:54.867 DEBUG [src.node.waku_node] Using volumes []
2026-03-27 04:50:54.867 DEBUG [src.node.docker_mananger] docker run -i -t -p 10872:10872 -p 10873:10873 -p 10874:10874 -p 10875:10875 -p 10876:10876 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=10874 --rest-port=10872 --tcp-port=10873 --discv5-udp-port=10875 --rest-address=0.0.0.0 --nat=extip:172.18.251.199 --peer-exchange=true --discv5-discovery=false --cluster-id=3 --nodekey=20bde39fee9c1dcb41e21c3747e396ddff043457ed80ceecdaeaa4a6b359e32b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=10876 --metrics-logging=true --relay=true --dns-discovery=false --discv5-bootstrap-node=enr:-La4QOhkOX0_TFwtwp8HMBDDWWhFuoNIT9aHiM4lbK_4PWnnCwgt8gMln0KWjZIn7EegyCok-ihZc6KX5iDW6R4lALUCgmlkgnY0gmlwhKwSGDWKbXVsdGlhZGRyc5YACASsEhg1Bg-ZAAoErBIYNQYPmt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDDgtdUih0odIUt5X64NAu_vSuNf9543i1ubuL1STwiVWDdGNwgg-ZhXdha3UyAQ
2026-03-27 04:50:55.072 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.251.199 waku 3f26fd67beec847cfb380b4b358c17d2f644c23e5f853a300fbf56b2aebe19b6
2026-03-27 04:50:55.105 DEBUG [src.node.docker_mananger] Container started with ID 3f26fd67beec. Setting up logs at ./log/docker/node3_2026-03-27_04-50-52__b0bb78a9-5c3d-47cb-965e-dda439be8c5a__wakuorg_nwaku:latest.log
2026-03-27 04:50:55.105 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 10872
2026-03-27 04:50:55.106 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-27 04:50:56.106 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10872/health" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:50:56.109 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-27 04:50:56.109 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-27 04:50:56.109 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10872/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:50:56.112 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.251.199/tcp/10873/p2p/16Uiu2HAm7JBmQQYYW5BiuJJQJaUTtMhXsSEUqVZzVqwCAEr1SxcR","/ip4/172.18.251.199/tcp/10874/ws/p2p/16Uiu2HAm7JBmQQYYW5BiuJJQJaUTtMhXsSEUqVZzVqwCAEr1SxcR"],"enrUri":"enr:-La4QOviAYvJ_V7JpP0VLhhUI2vxMRcnbYhQRHYcT0VeASgZcTLCjCgMVnCWL7khaQ3gDxtHukVuoO01e3TGMaNSt0UCgmlkgnY0gmlwhKwS-8eKbXVsdGlhZGRyc5YACASsEvvHBip5AAoErBL7xwYqet0DgnJzhQADAQAAiXNlY3AyNTZrMaECsGFGtso_qRTD0v6TTkbp6i0OfgfYVeoPfVzEkmDk0wqDdGNwgip5hXdha3UyAQ"}'
2026-03-27 04:50:56.112 INFO [src.node.waku_node] REST service is ready !!
2026-03-27 04:50:56.112 DEBUG [src.node.waku_node] Starting Node...
2026-03-27 04:50:56.112 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-27 04:50:56.114 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-27 04:50:56.114 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.139.63
2026-03-27 04:50:56.114 DEBUG [src.node.docker_mananger] Generated ports ['15266', '15267', '15268', '15269', '15270']
2026-03-27 04:50:56.114 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-27 04:50:56.114 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-27 04:50:56.115 DEBUG [src.node.waku_node] Using volumes []
2026-03-27 04:50:56.115 DEBUG [src.node.docker_mananger] docker run -i -t -p 15266:15266 -p 15267:15267 -p 15268:15268 -p 15269:15269 -p 15270:15270 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=15268 --rest-port=15266 --tcp-port=15267 --discv5-udp-port=15269 --rest-address=0.0.0.0 --nat=extip:172.18.139.63 --peer-exchange=true --discv5-discovery=false --cluster-id=3 --nodekey=9c070821fdaecaca2abce4c79f1bdb8a7989cc04ac0abc8dcce74af541340cbe --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=15270 --metrics-logging=true --relay=true --dns-discovery=false --discv5-bootstrap-node=enr:-La4QOhkOX0_TFwtwp8HMBDDWWhFuoNIT9aHiM4lbK_4PWnnCwgt8gMln0KWjZIn7EegyCok-ihZc6KX5iDW6R4lALUCgmlkgnY0gmlwhKwSGDWKbXVsdGlhZGRyc5YACASsEhg1Bg-ZAAoErBIYNQYPmt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDDgtdUih0odIUt5X64NAu_vSuNf9543i1ubuL1STwiVWDdGNwgg-ZhXdha3UyAQ
2026-03-27 04:50:56.331 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.139.63 waku 0f6f35a19aa83fafab44af94013cf4402a780e4a5ec6ce8c88e77cb63d681319
2026-03-27 04:50:56.368 DEBUG [src.node.docker_mananger] Container started with ID 0f6f35a19aa8. Setting up logs at ./log/docker/node4_2026-03-27_04-50-52__b0bb78a9-5c3d-47cb-965e-dda439be8c5a__wakuorg_nwaku:latest.log
2026-03-27 04:50:56.368 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 15266
2026-03-27 04:50:56.368 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-27 04:50:57.369 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15266/health" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:50:57.372 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-27 04:50:57.372 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-27 04:50:57.372 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15266/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:50:57.374 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.139.63/tcp/15267/p2p/16Uiu2HAkuVn3bymUNw56MUmWD7cAAXAHL3Uhfbk58o8a8QNNK6Jy","/ip4/172.18.139.63/tcp/15268/ws/p2p/16Uiu2HAkuVn3bymUNw56MUmWD7cAAXAHL3Uhfbk58o8a8QNNK6Jy"],"enrUri":"enr:-La4QNR1FL1DhXKk6PuNm2JqNcehDlbBhiQlltRbk4kAMj68L0ZgnZIY_kDpi9HyM66c_xXuEd1OSseuXLP12lQ-XJUCgmlkgnY0gmlwhKwSiz-KbXVsdGlhZGRyc5YACASsEos_BjujAAoErBKLPwY7pN0DgnJzhQADAQAAiXNlY3AyNTZrMaECAQ0uhpIeFGeOUA4BETEkLnNi8Gzqi3qAjV9LzHBQ1UaDdGNwgjujhXdha3UyAQ"}'
2026-03-27 04:50:57.375 INFO [src.node.waku_node] REST service is ready !!
2026-03-27 04:50:57.375 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3992/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.11.217/tcp/58552/p2p/16Uiu2HAkx9HR13673tzg41LQy9Fo4mnvvZ56Hsz8v7nxtWqGfGzw"]'
2026-03-27 04:50:57.418 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:50:57.419 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58551/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.24.53/tcp/3993/p2p/16Uiu2HAmDbp7HmSbME3juKqg7NPBWy2GHKPnn5918WFLpctF85Me"]'
2026-03-27 04:50:57.439 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:50:57.440 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3992/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.251.199/tcp/10873/p2p/16Uiu2HAm7JBmQQYYW5BiuJJQJaUTtMhXsSEUqVZzVqwCAEr1SxcR"]'
2026-03-27 04:50:57.466 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:50:57.467 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10872/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.24.53/tcp/3993/p2p/16Uiu2HAmDbp7HmSbME3juKqg7NPBWy2GHKPnn5918WFLpctF85Me"]'
2026-03-27 04:50:57.490 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:50:57.492 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3992/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.139.63/tcp/15267/p2p/16Uiu2HAkuVn3bymUNw56MUmWD7cAAXAHL3Uhfbk58o8a8QNNK6Jy"]'
2026-03-27 04:50:57.522 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:50:57.523 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:15266/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.24.53/tcp/3993/p2p/16Uiu2HAmDbp7HmSbME3juKqg7NPBWy2GHKPnn5918WFLpctF85Me"]'
2026-03-27 04:50:57.541 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:50:57.541 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3992/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-27 04:50:57.544 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:50:57.544 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58551/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-27 04:50:57.547 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:50:57.547 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10872/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-27 04:50:57.550 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:50:57.550 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:15266/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-27 04:50:57.553 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-27 04:50:57.553 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3992/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:50:57.556 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.11.217/tcp/58552/p2p/16Uiu2HAkx9HR13673tzg41LQy9Fo4mnvvZ56Hsz8v7nxtWqGfGzw","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.251.199/tcp/10873/p2p/16Uiu2HAm7JBmQQYYW5BiuJJQJaUTtMhXsSEUqVZzVqwCAEr1SxcR","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.139.63/tcp/15267/p2p/16Uiu2HAkuVn3bymUNw56MUmWD7cAAXAHL3Uhfbk58o8a8QNNK6Jy","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"UnknownOrigin"}]'
2026-03-27 04:50:57.556 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58551/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:50:57.558 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.24.53/tcp/55266/p2p/16Uiu2HAmDbp7HmSbME3juKqg7NPBWy2GHKPnn5918WFLpctF85Me","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"UnknownOrigin"}]'
2026-03-27 04:50:57.558 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10872/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:50:57.561 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.24.53/tcp/35908/p2p/16Uiu2HAmDbp7HmSbME3juKqg7NPBWy2GHKPnn5918WFLpctF85Me","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"UnknownOrigin"}]'
2026-03-27 04:50:57.561 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15266/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:50:57.563 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.24.53/tcp/58970/p2p/16Uiu2HAmDbp7HmSbME3juKqg7NPBWy2GHKPnn5918WFLpctF85Me","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"UnknownOrigin"}]'
2026-03-27 04:50:57.563 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-27 04:50:59.564 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3992/admin/v1/peers/connected" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:50:59.567 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.11.217/tcp/58552/p2p/16Uiu2HAkx9HR13673tzg41LQy9Fo4mnvvZ56Hsz8v7nxtWqGfGzw","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.251.199/tcp/10873/p2p/16Uiu2HAm7JBmQQYYW5BiuJJQJaUTtMhXsSEUqVZzVqwCAEr1SxcR","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.139.63/tcp/15267/p2p/16Uiu2HAkuVn3bymUNw56MUmWD7cAAXAHL3Uhfbk58o8a8QNNK6Jy","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"UnknownOrigin"}]'
2026-03-27 04:50:59.568 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3992/admin/v1/peers/connected/on/0" -H "Content-Type: application/json" -d 'None'
2026-03-27 04:50:59.570 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.11.217/tcp/58552/p2p/16Uiu2HAkx9HR13673tzg41LQy9Fo4mnvvZ56Hsz8v7nxtWqGfGzw","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.251.199/tcp/10873/p2p/16Uiu2HAm7JBmQQYYW5BiuJJQJaUTtMhXsSEUqVZzVqwCAEr1SxcR","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.139.63/tcp/15267/p2p/16Uiu2HAkuVn3bymUNw56MUmWD7cAAXAHL3Uhfbk58o8a8QNNK6Jy","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-12-g0b8609","origin":"UnknownOrigin"}]'
2026-03-27 04:50:59.571 DEBUG [tests.rest_flags.test_admin_flags] /admin/v1/peers/connected/on/0 (contains 3): [{'multiaddr': '/ip4/172.18.11.217/tcp/58552/p2p/16Uiu2HAkx9HR13673tzg41LQy9Fo4mnvvZ56Hsz8v7nxtWqGfGzw', 'protocols': ['/ipfs/id/1.0.0', '/libp2p/autonat/1.0.0', '/libp2p/circuit/relay/0.2.0/hop', '/vac/waku/metadata/1.0.0', '/vac/waku/relay/2.0.0', '/vac/waku/rendezvous/1.0.0', '/ipfs/ping/1.0.0', '/vac/waku/filter-push/2.0.0-beta1', '/vac/waku/peer-exchange/2.0.0-alpha1'], 'shards': [0], 'connected': 'Connected', 'agent': 'logos-delivery-v0.38.0-rc.0-12-g0b8609', 'origin': 'UnknownOrigin'}, {'multiaddr': '/ip4/172.18.251.199/tcp/10873/p2p/16Uiu2HAm7JBmQQYYW5BiuJJQJaUTtMhXsSEUqVZzVqwCAEr1SxcR', 'protocols': ['/ipfs/id/1.0.0', '/libp2p/autonat/1.0.0', '/libp2p/circuit/relay/0.2.0/hop', '/vac/waku/metadata/1.0.0', '/vac/waku/relay/2.0.0', '/vac/waku/rendezvous/1.0.0', '/ipfs/ping/1.0.0', '/vac/waku/filter-push/2.0.0-beta1', '/vac/waku/peer-exchange/2.0.0-alpha1'], 'shards': [0], 'connected': 'Connected', 'agent': 'logos-delivery-v0.38.0-rc.0-12-g0b8609', 'origin': 'UnknownOrigin'}, {'multiaddr': '/ip4/172.18.139.63/tcp/15267/p2p/16Uiu2HAkuVn3bymUNw56MUmWD7cAAXAHL3Uhfbk58o8a8QNNK6Jy', 'protocols': ['/ipfs/id/1.0.0', '/libp2p/autonat/1.0.0', '/libp2p/circuit/relay/0.2.0/hop', '/vac/waku/metadata/1.0.0', '/vac/waku/relay/2.0.0', '/vac/waku/rendezvous/1.0.0', '/ipfs/ping/1.0.0', '/vac/waku/filter-push/2.0.0-beta1', '/vac/waku/peer-exchange/2.0.0-alpha1'], 'shards': [0], 'connected': 'Connected', 'agent': 'logos-delivery-v0.38.0-rc.0-12-g0b8609', 'origin': 'UnknownOrigin'}]
2026-03-27 04:50:59.573 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-27 04:50:59.574 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-27 04:50:59.574 DEBUG [src.node.waku_node] Stopping container with id 2fbd4fb3c769
2026-03-27 04:51:00.202 DEBUG [src.node.waku_node] Container stopped.
2026-03-27 04:51:00.204 DEBUG [src.node.waku_node] Stopping container with id 7da93dd1956f
2026-03-27 04:51:00.789 DEBUG [src.node.waku_node] Container stopped.
2026-03-27 04:51:00.791 DEBUG [src.node.waku_node] Stopping container with id 3f26fd67beec
2026-03-27 04:51:01.068 ERROR [src.node.docker_mananger] Max retries reached for container 2fbd4fb3c769. Exiting log stream.
2026-03-27 04:51:01.357 DEBUG [src.node.waku_node] Container stopped.
2026-03-27 04:51:01.359 DEBUG [src.node.waku_node] Stopping container with id 0f6f35a19aa8
2026-03-27 04:51:01.604 ERROR [src.node.docker_mananger] Max retries reached for container 7da93dd1956f. Exiting log stream.
2026-03-27 04:51:01.905 DEBUG [src.node.waku_node] Container stopped.
2026-03-27 04:51:01.907 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-27 04:51:01.930 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-27 04:51:01.937 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-27 04:51:01.941 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-27 04:51:01.947 DEBUG [src.node.docker_mananger] No errors found in the waku logs.