183 lines
33 KiB
Plaintext

2025-12-08 12:10:42.037 DEBUG [tests.conftest] Running fixture setup: test_id
2025-12-08 12:10:42.037 DEBUG [tests.conftest] Running test: test_multiple_receiving_nodes with id: 2025-12-08_12-10-42__948cc76b-9003-4711-95ea-19f4d18d1c7c
2025-12-08 12:10:42.037 DEBUG [src.steps.common] Running fixture setup: common_setup
2025-12-08 12:10:42.038 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2025-12-08 12:10:42.045 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-08 12:10:42.045 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node1_2025-12-08_12-10-42__948cc76b-9003-4711-95ea-19f4d18d1c7c__wakuorg_nwaku:latest.log
2025-12-08 12:10:42.045 DEBUG [src.node.waku_node] Starting Node...
2025-12-08 12:10:42.045 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-08 12:10:42.046 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-08 12:10:42.046 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.220.71
2025-12-08 12:10:42.047 DEBUG [src.node.docker_mananger] Generated ports ['22884', '22885', '22886', '22887', '22888']
2025-12-08 12:10:42.047 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-08 12:10:42.047 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-08 12:10:42.047 DEBUG [src.node.waku_node] Using volumes []
2025-12-08 12:10:42.047 DEBUG [src.node.docker_mananger] docker run -i -t -p 22884:22884 -p 22885:22885 -p 22886:22886 -p 22887:22887 -p 22888:22888 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=22886 --rest-port=22884 --tcp-port=22885 --discv5-udp-port=22887 --rest-address=0.0.0.0 --nat=extip:172.18.220.71 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cb52bc58ce4a5bebefba69ac3dcbe11fbe38d7aadaf596d7bea9c76e4f183d67 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=22888 --metrics-logging=true --lightpush=true --relay=true
2025-12-08 12:10:42.224 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.220.71 waku b41599bcc242a01ecbfbb6b8a2e34090e91075da96e7c84df2ed83b6b273cdb9
2025-12-08 12:10:42.256 DEBUG [src.node.docker_mananger] Container started with ID b41599bcc242. Setting up logs at ./log/docker/receiving_node1_2025-12-08_12-10-42__948cc76b-9003-4711-95ea-19f4d18d1c7c__wakuorg_nwaku:latest.log
2025-12-08 12:10:42.257 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 22884
2025-12-08 12:10:42.257 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-08 12:10:42.269 ERROR [src.node.docker_mananger] Max retries reached for container 976786f742dc. Exiting log stream.
2025-12-08 12:10:42.795 ERROR [src.node.docker_mananger] Max retries reached for container 9da9d4c7a23b. Exiting log stream.
2025-12-08 12:10:43.258 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22884/health" -H "Content-Type: application/json" -d 'None'
2025-12-08 12:10:43.262 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-08 12:10:43.262 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-08 12:10:43.262 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22884/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-08 12:10:43.264 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.220.71/tcp/22885/p2p/16Uiu2HAmQqSNkigkZtLLCVBfqkyBs3YRR3t76x8Q9HzD4E5s7Vzb","/ip4/172.18.220.71/tcp/22886/ws/p2p/16Uiu2HAmQqSNkigkZtLLCVBfqkyBs3YRR3t76x8Q9HzD4E5s7Vzb"],"enrUri":"enr:-L24QIwjz3Pir57_K_rRa_AJuetL0HRPlPRHDmVY1G7wAg3NWW9N9bHVYMTnEBQb3rCatSY_cKH3-HZd0fCX_fDxDhsCgmlkgnY0gmlwhKwS3EeKbXVsdGlhZGRyc5YACASsEtxHBlllAAoErBLcRwZZZt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDtPl6YdF0eNZbErVMpys7Ig9mIiwLkSQSqiBj12kQNEyDdGNwglllg3VkcIJZZ4V3YWt1Mgk"}'
2025-12-08 12:10:43.264 INFO [src.node.waku_node] REST service is ready !!
2025-12-08 12:10:43.271 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-08 12:10:43.271 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node2_2025-12-08_12-10-42__948cc76b-9003-4711-95ea-19f4d18d1c7c__wakuorg_nwaku:latest.log
2025-12-08 12:10:43.271 DEBUG [src.node.waku_node] Starting Node...
2025-12-08 12:10:43.271 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-08 12:10:43.273 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-08 12:10:43.273 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.202.234
2025-12-08 12:10:43.273 DEBUG [src.node.docker_mananger] Generated ports ['38662', '38663', '38664', '38665', '38666']
2025-12-08 12:10:43.273 DEBUG [src.node.waku_node] Cluster id was resolved to: 3
2025-12-08 12:10:43.273 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2025-12-08 12:10:43.273 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-08 12:10:43.273 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-08 12:10:43.273 DEBUG [src.node.waku_node] Using volumes []
2025-12-08 12:10:43.274 DEBUG [src.node.docker_mananger] docker run -i -t -p 38662:38662 -p 38663:38663 -p 38664:38664 -p 38665:38665 -p 38666:38666 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=38664 --rest-port=38662 --tcp-port=38663 --discv5-udp-port=38665 --rest-address=0.0.0.0 --nat=extip:172.18.202.234 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ce76d77fbad38fb3ecbdad7de6196e4d4c24a2b48e9fdebd6ced2dfcfebdcbba --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=38666 --metrics-logging=true --lightpush=true --relay=true
2025-12-08 12:10:43.458 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.202.234 waku e83eea728f7fbd6c90da444236d793a70052bfed9eebec8742d33dff1335821f
2025-12-08 12:10:43.490 DEBUG [src.node.docker_mananger] Container started with ID e83eea728f7f. Setting up logs at ./log/docker/receiving_node2_2025-12-08_12-10-42__948cc76b-9003-4711-95ea-19f4d18d1c7c__wakuorg_nwaku:latest.log
2025-12-08 12:10:43.491 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 38662
2025-12-08 12:10:43.492 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-08 12:10:44.492 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38662/health" -H "Content-Type: application/json" -d 'None'
2025-12-08 12:10:44.495 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-08 12:10:44.495 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-08 12:10:44.496 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38662/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-08 12:10:44.498 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.202.234/tcp/38663/p2p/16Uiu2HAkxnMCaCfrdPyVRaDaVjYa1VmuMxuQpu1evVEgmvVfGJmE","/ip4/172.18.202.234/tcp/38664/ws/p2p/16Uiu2HAkxnMCaCfrdPyVRaDaVjYa1VmuMxuQpu1evVEgmvVfGJmE"],"enrUri":"enr:-L24QF8V5ZnmBMGM1Jbb_3zIgMlozEurHvGNbGqdxg3-9D0lBGxdLcT98gCXvepMZg9Q1OAJHl7rtkiXvvf8f_jwQWUCgmlkgnY0gmlwhKwSyuqKbXVsdGlhZGRyc5YACASsEsrqBpcHAAoErBLK6gaXCN0DgnJzhQADAQAAiXNlY3AyNTZrMaECMd8GBsKFm9IHnPWaX4pBEzHDLHGZHf_Yr8o1z4qpGeGDdGNwgpcHg3VkcIKXCYV3YWt1Mgk"}'
2025-12-08 12:10:44.498 INFO [src.node.waku_node] REST service is ready !!
2025-12-08 12:10:44.498 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38662/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.220.71/tcp/22885/p2p/16Uiu2HAmQqSNkigkZtLLCVBfqkyBs3YRR3t76x8Q9HzD4E5s7Vzb"]'
2025-12-08 12:10:44.534 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-08 12:10:44.547 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-08 12:10:44.549 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node3_2025-12-08_12-10-42__948cc76b-9003-4711-95ea-19f4d18d1c7c__wakuorg_nwaku:latest.log
2025-12-08 12:10:44.549 DEBUG [src.node.waku_node] Starting Node...
2025-12-08 12:10:44.550 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-08 12:10:44.551 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-08 12:10:44.551 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.16.57
2025-12-08 12:10:44.551 DEBUG [src.node.docker_mananger] Generated ports ['9315', '9316', '9317', '9318', '9319']
2025-12-08 12:10:44.551 DEBUG [src.node.waku_node] Cluster id was resolved to: 3
2025-12-08 12:10:44.551 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2025-12-08 12:10:44.552 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-08 12:10:44.552 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-08 12:10:44.552 DEBUG [src.node.waku_node] Using volumes []
2025-12-08 12:10:44.552 DEBUG [src.node.docker_mananger] docker run -i -t -p 9315:9315 -p 9316:9316 -p 9317:9317 -p 9318:9318 -p 9319:9319 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=9317 --rest-port=9315 --tcp-port=9316 --discv5-udp-port=9318 --rest-address=0.0.0.0 --nat=extip:172.18.16.57 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ea1afa5bfd8bd707cbd74fd4adf0c9de2cd4cdbcba55df8889ececc03d0eb940 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=9319 --metrics-logging=true --lightpush=true --relay=true
2025-12-08 12:10:44.733 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.16.57 waku ccf16f6b06c049c7423a73743b1621c8ae2d5ec11d5eda138d17998d767b7b9c
2025-12-08 12:10:44.763 DEBUG [src.node.docker_mananger] Container started with ID ccf16f6b06c0. Setting up logs at ./log/docker/receiving_node3_2025-12-08_12-10-42__948cc76b-9003-4711-95ea-19f4d18d1c7c__wakuorg_nwaku:latest.log
2025-12-08 12:10:44.765 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 9315
2025-12-08 12:10:44.765 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-08 12:10:45.765 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9315/health" -H "Content-Type: application/json" -d 'None'
2025-12-08 12:10:45.768 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-08 12:10:45.769 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-08 12:10:45.769 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9315/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-08 12:10:45.771 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.16.57/tcp/9316/p2p/16Uiu2HAmHmuDZtBtZD75b9AXXfjEx3iRdkZHMmGht2VeXqtWmQTN","/ip4/172.18.16.57/tcp/9317/ws/p2p/16Uiu2HAmHmuDZtBtZD75b9AXXfjEx3iRdkZHMmGht2VeXqtWmQTN"],"enrUri":"enr:-L24QPEoJztirQgPPp_LEGeNSFvDeUGLMraQyJp7ISgY0-hJPI0d_GLWXLMU9lk-uwqlawDd8HvcxysvSIiRpI9x2isCgmlkgnY0gmlwhKwSEDmKbXVsdGlhZGRyc5YACASsEhA5BiRkAAoErBIQOQYkZd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDTA-yPHu4dh98jLymosu3TQzxBqsnhIfBzV___wMhvMWDdGNwgiRkg3VkcIIkZoV3YWt1Mgk"}'
2025-12-08 12:10:45.771 INFO [src.node.waku_node] REST service is ready !!
2025-12-08 12:10:45.771 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9315/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.220.71/tcp/22885/p2p/16Uiu2HAmQqSNkigkZtLLCVBfqkyBs3YRR3t76x8Q9HzD4E5s7Vzb"]'
2025-12-08 12:10:45.806 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-08 12:10:45.807 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9315/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.202.234/tcp/38663/p2p/16Uiu2HAkxnMCaCfrdPyVRaDaVjYa1VmuMxuQpu1evVEgmvVfGJmE"]'
2025-12-08 12:10:45.827 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-08 12:10:45.842 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-08 12:10:45.842 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node4_2025-12-08_12-10-42__948cc76b-9003-4711-95ea-19f4d18d1c7c__wakuorg_nwaku:latest.log
2025-12-08 12:10:45.843 DEBUG [src.node.waku_node] Starting Node...
2025-12-08 12:10:45.844 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-08 12:10:45.849 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-08 12:10:45.849 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.162.141
2025-12-08 12:10:45.849 DEBUG [src.node.docker_mananger] Generated ports ['41774', '41775', '41776', '41777', '41778']
2025-12-08 12:10:45.850 DEBUG [src.node.waku_node] Cluster id was resolved to: 3
2025-12-08 12:10:45.851 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2025-12-08 12:10:45.851 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-08 12:10:45.851 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-08 12:10:45.852 DEBUG [src.node.waku_node] Using volumes []
2025-12-08 12:10:45.853 DEBUG [src.node.docker_mananger] docker run -i -t -p 41774:41774 -p 41775:41775 -p 41776:41776 -p 41777:41777 -p 41778:41778 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=41776 --rest-port=41774 --tcp-port=41775 --discv5-udp-port=41777 --rest-address=0.0.0.0 --nat=extip:172.18.162.141 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=2bd0ae50b6cd0df64f4dceb7bbbee4ed7fd6bbba9b479fd5aeb87ad8149f7eff --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=41778 --metrics-logging=true --lightpush=true --relay=true
2025-12-08 12:10:46.037 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.162.141 waku 847284eba4893e50877181549dd072b4089818816d8439f9edf02ba714175531
2025-12-08 12:10:46.073 DEBUG [src.node.docker_mananger] Container started with ID 847284eba489. Setting up logs at ./log/docker/receiving_node4_2025-12-08_12-10-42__948cc76b-9003-4711-95ea-19f4d18d1c7c__wakuorg_nwaku:latest.log
2025-12-08 12:10:46.073 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 41774
2025-12-08 12:10:46.074 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-08 12:10:47.074 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41774/health" -H "Content-Type: application/json" -d 'None'
2025-12-08 12:10:47.077 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-08 12:10:47.077 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-08 12:10:47.078 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41774/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-08 12:10:47.080 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.162.141/tcp/41775/p2p/16Uiu2HAmGKwMwL7xLLzduRPoVLANxW6PWd1TsA26YLK9yW3JCZ7D","/ip4/172.18.162.141/tcp/41776/ws/p2p/16Uiu2HAmGKwMwL7xLLzduRPoVLANxW6PWd1TsA26YLK9yW3JCZ7D"],"enrUri":"enr:-L24QF0pkL0plND_DwjheYs7pc7qWY8ua9JeI63PZR28bUtBdxJCrkvYHj5OKt_sH8iFqrOSLXibCkJIp3Vp-FdGcAkCgmlkgnY0gmlwhKwSoo2KbXVsdGlhZGRyc5YACASsEqKNBqMvAAoErBKijQajMN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDNo1VNYoplvkVcXzSLZF2QHQrGtkXk4tHIexrMFCEwDCDdGNwgqMvg3VkcIKjMYV3YWt1Mgk"}'
2025-12-08 12:10:47.080 INFO [src.node.waku_node] REST service is ready !!
2025-12-08 12:10:47.080 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41774/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.220.71/tcp/22885/p2p/16Uiu2HAmQqSNkigkZtLLCVBfqkyBs3YRR3t76x8Q9HzD4E5s7Vzb"]'
2025-12-08 12:10:47.113 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-08 12:10:47.114 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41774/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.202.234/tcp/38663/p2p/16Uiu2HAkxnMCaCfrdPyVRaDaVjYa1VmuMxuQpu1evVEgmvVfGJmE"]'
2025-12-08 12:10:47.145 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-08 12:10:47.149 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41774/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.16.57/tcp/9316/p2p/16Uiu2HAmHmuDZtBtZD75b9AXXfjEx3iRdkZHMmGht2VeXqtWmQTN"]'
2025-12-08 12:10:47.174 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-08 12:10:47.191 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-08 12:10:47.192 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node1_2025-12-08_12-10-42__948cc76b-9003-4711-95ea-19f4d18d1c7c__wakuorg_nwaku:latest.log
2025-12-08 12:10:47.192 DEBUG [src.node.waku_node] Starting Node...
2025-12-08 12:10:47.192 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-08 12:10:47.197 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-08 12:10:47.197 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.153.151
2025-12-08 12:10:47.197 DEBUG [src.node.docker_mananger] Generated ports ['23191', '23192', '23193', '23194', '23195']
2025-12-08 12:10:47.198 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-08 12:10:47.198 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-08 12:10:47.198 DEBUG [src.node.waku_node] Using volumes []
2025-12-08 12:10:47.198 DEBUG [src.node.docker_mananger] docker run -i -t -p 23191:23191 -p 23192:23192 -p 23193:23193 -p 23194:23194 -p 23195:23195 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=23193 --rest-port=23191 --tcp-port=23192 --discv5-udp-port=23194 --rest-address=0.0.0.0 --nat=extip:172.18.153.151 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=b1f794b04fde55a480ee4e20cbbbfef96c40fe0f678dd53ed09bf9fd18cfd9fe --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=23195 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QIwjz3Pir57_K_rRa_AJuetL0HRPlPRHDmVY1G7wAg3NWW9N9bHVYMTnEBQb3rCatSY_cKH3-HZd0fCX_fDxDhsCgmlkgnY0gmlwhKwS3EeKbXVsdGlhZGRyc5YACASsEtxHBlllAAoErBLcRwZZZt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDtPl6YdF0eNZbErVMpys7Ig9mIiwLkSQSqiBj12kQNEyDdGNwglllg3VkcIJZZ4V3YWt1Mgk --lightpushnode=/ip4/172.18.220.71/tcp/22885/p2p/16Uiu2HAmQqSNkigkZtLLCVBfqkyBs3YRR3t76x8Q9HzD4E5s7Vzb --lightpush=true --relay=false
2025-12-08 12:10:47.398 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.153.151 waku bdbb56a39d403415a33dbb3c89b151d98ba898f7516553d7ab568d9fc3eca6ad
2025-12-08 12:10:47.431 DEBUG [src.node.docker_mananger] Container started with ID bdbb56a39d40. Setting up logs at ./log/docker/lightpush_node1_2025-12-08_12-10-42__948cc76b-9003-4711-95ea-19f4d18d1c7c__wakuorg_nwaku:latest.log
2025-12-08 12:10:47.432 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 23191
2025-12-08 12:10:47.432 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-08 12:10:48.432 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23191/health" -H "Content-Type: application/json" -d 'None'
2025-12-08 12:10:48.436 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-08 12:10:48.436 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-08 12:10:48.437 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23191/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-08 12:10:48.439 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.153.151/tcp/23192/p2p/16Uiu2HAkvmt4gFAGVDpUmuzDfsdgZMoAvRwtJzosn1hS1SHt6D6C","/ip4/172.18.153.151/tcp/23193/ws/p2p/16Uiu2HAkvmt4gFAGVDpUmuzDfsdgZMoAvRwtJzosn1hS1SHt6D6C"],"enrUri":"enr:-L24QJYCHuGApYwB3qIAj4IjdjVhBezlK1-GA3YaeXdLWEDVJrTBbbZYuJpJKd4E4Q-WDEXhyK0cFLq8ShomkfcOzBYCgmlkgnY0gmlwhKwSmZeKbXVsdGlhZGRyc5YACASsEpmXBlqYAAoErBKZlwZamd0DgnJzhQADAQAAiXNlY3AyNTZrMaECFAj3fcGaTZWIQFbK2IiejywDcYaZBJwwh7TtLf3_gxWDdGNwglqYg3VkcIJamoV3YWt1Mgg"}'
2025-12-08 12:10:48.439 INFO [src.node.waku_node] REST service is ready !!
2025-12-08 12:10:48.439 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23191/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.220.71/tcp/22885/p2p/16Uiu2HAmQqSNkigkZtLLCVBfqkyBs3YRR3t76x8Q9HzD4E5s7Vzb"]'
2025-12-08 12:10:48.468 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-08 12:10:48.469 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23191/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.202.234/tcp/38663/p2p/16Uiu2HAkxnMCaCfrdPyVRaDaVjYa1VmuMxuQpu1evVEgmvVfGJmE"]'
2025-12-08 12:10:48.500 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-08 12:10:48.500 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23191/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.16.57/tcp/9316/p2p/16Uiu2HAmHmuDZtBtZD75b9AXXfjEx3iRdkZHMmGht2VeXqtWmQTN"]'
2025-12-08 12:10:48.526 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-08 12:10:48.527 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23191/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.162.141/tcp/41775/p2p/16Uiu2HAmGKwMwL7xLLzduRPoVLANxW6PWd1TsA26YLK9yW3JCZ7D"]'
2025-12-08 12:10:48.548 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-08 12:10:48.550 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22884/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2025-12-08 12:10:48.561 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-08 12:10:48.565 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38662/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2025-12-08 12:10:48.578 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-08 12:10:48.578 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9315/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2025-12-08 12:10:48.582 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-08 12:10:48.582 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41774/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2025-12-08 12:10:48.584 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-08 12:10:48.585 DEBUG [src.steps.light_push] Lightpushing message
2025-12-08 12:10:48.585 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23191/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1765195848585153650}}'
2025-12-08 12:10:48.599 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-08 12:10:48.600 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2025-12-08 12:10:48.700 DEBUG [src.steps.light_push] Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
2025-12-08 12:10:48.700 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22884/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2025-12-08 12:10:48.703 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1765195848585153650,"ephemeral":false,"proof":""}]'
2025-12-08 12:10:48.704 DEBUG [src.steps.light_push] Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
2025-12-08 12:10:48.705 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38662/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2025-12-08 12:10:48.707 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1765195848585153650,"ephemeral":false,"proof":""}]'
2025-12-08 12:10:48.708 DEBUG [src.steps.light_push] Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
2025-12-08 12:10:48.708 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9315/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2025-12-08 12:10:48.711 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1765195848585153650,"ephemeral":false,"proof":""}]'
2025-12-08 12:10:48.712 DEBUG [src.steps.light_push] Checking that peer NODE_4:wakuorg/nwaku:latest can find the lightpushed message
2025-12-08 12:10:48.712 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41774/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2025-12-08 12:10:48.714 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1765195848585153650,"ephemeral":false,"proof":""}]'
2025-12-08 12:10:48.717 DEBUG [tests.conftest] Running fixture teardown: test_setup
2025-12-08 12:10:48.717 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2025-12-08 12:10:48.718 DEBUG [src.node.waku_node] Stopping container with id b41599bcc242
2025-12-08 12:10:49.282 DEBUG [src.node.waku_node] Container stopped.
2025-12-08 12:10:49.282 DEBUG [src.node.waku_node] Stopping container with id e83eea728f7f
2025-12-08 12:10:49.872 DEBUG [src.node.waku_node] Container stopped.
2025-12-08 12:10:49.872 DEBUG [src.node.waku_node] Stopping container with id ccf16f6b06c0
2025-12-08 12:10:50.097 ERROR [src.node.docker_mananger] Max retries reached for container b41599bcc242. Exiting log stream.
2025-12-08 12:10:50.445 DEBUG [src.node.waku_node] Container stopped.
2025-12-08 12:10:50.446 DEBUG [src.node.waku_node] Stopping container with id 847284eba489
2025-12-08 12:10:50.689 ERROR [src.node.docker_mananger] Max retries reached for container e83eea728f7f. Exiting log stream.
2025-12-08 12:10:50.984 DEBUG [src.node.waku_node] Container stopped.
2025-12-08 12:10:50.984 DEBUG [src.node.waku_node] Stopping container with id bdbb56a39d40
2025-12-08 12:10:51.260 ERROR [src.node.docker_mananger] Max retries reached for container ccf16f6b06c0. Exiting log stream.
2025-12-08 12:10:51.544 DEBUG [src.node.waku_node] Container stopped.
2025-12-08 12:10:51.545 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2025-12-08 12:10:51.559 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-08 12:10:51.573 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-08 12:10:51.586 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-08 12:10:51.598 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-08 12:10:51.610 DEBUG [src.node.docker_mananger] No errors found in the waku logs.