2026-02-04 12:12:58 +00:00

188 lines
34 KiB
Plaintext

2026-02-04 12:00:57.955 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-04 12:00:57.955 DEBUG [tests.conftest] Running test: test_multiple_receiving_nodes with id: 2026-02-04_12-00-57__43c026db-f203-423f-87fd-3c6210b78909
2026-02-04 12:00:57.956 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-04 12:00:57.956 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-02-04 12:00:57.963 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-04 12:00:57.963 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-02-04_12-00-57__43c026db-f203-423f-87fd-3c6210b78909__wakuorg_nwaku:latest.log
2026-02-04 12:00:57.964 DEBUG [src.node.waku_node] Starting Node...
2026-02-04 12:00:57.964 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-04 12:00:57.965 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-04 12:00:57.965 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.13.60
2026-02-04 12:00:57.965 DEBUG [src.node.docker_mananger] Generated ports ['51018', '51019', '51020', '51021', '51022']
2026-02-04 12:00:57.966 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-04 12:00:57.966 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-04 12:00:57.966 DEBUG [src.node.waku_node] Using volumes []
2026-02-04 12:00:57.966 DEBUG [src.node.docker_mananger] docker run -i -t -p 51018:51018 -p 51019:51019 -p 51020:51020 -p 51021:51021 -p 51022:51022 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=51020 --rest-port=51018 --tcp-port=51019 --discv5-udp-port=51021 --rest-address=0.0.0.0 --nat=extip:172.18.13.60 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=5bc0c3fdbd6cdc9dcabcaad121f6fddd7f1146fb8e7de57db29fdcaedc4bc046 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=51022 --metrics-logging=true --lightpush=true --relay=true
2026-02-04 12:00:58.147 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.13.60 waku 0243843e1262a4895303bab5650491323264293c6b800c3e579df1bfbc26b848
2026-02-04 12:00:58.176 DEBUG [src.node.docker_mananger] Container started with ID 0243843e1262. Setting up logs at ./log/docker/receiving_node1_2026-02-04_12-00-57__43c026db-f203-423f-87fd-3c6210b78909__wakuorg_nwaku:latest.log
2026-02-04 12:00:58.178 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 51018
2026-02-04 12:00:58.178 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-04 12:00:58.212 ERROR [src.node.docker_mananger] Max retries reached for container 22aa7518afe1. Exiting log stream.
2026-02-04 12:00:58.738 ERROR [src.node.docker_mananger] Max retries reached for container 257c75e0f8e1. Exiting log stream.
2026-02-04 12:00:59.178 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:51018/health" -H "Content-Type: application/json" -d 'None'
2026-02-04 12:00:59.181 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-02-04 12:00:59.182 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-04 12:00:59.182 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:51018/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-04 12:00:59.184 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.13.60/tcp/51019/p2p/16Uiu2HAkyeqtcsWzKwXfG3ggRtk3oshomFbtp1mKZbqK2nMfUjS5","/ip4/172.18.13.60/tcp/51020/ws/p2p/16Uiu2HAkyeqtcsWzKwXfG3ggRtk3oshomFbtp1mKZbqK2nMfUjS5"],"enrUri":"enr:-L24QJH_EsSpU0t7tkK_kXBAk_7fIR0cv-aU74xyGQMMU79oXjFwjA6gd6h05skoOBP0ZxFe2-CoTzXxgPRj8P5kqE8CgmlkgnY0gmlwhKwSDTyKbXVsdGlhZGRyc5YACASsEg08BsdLAAoErBINPAbHTN0DgnJzhQADAQAAiXNlY3AyNTZrMaECPs6BH5cwDLGMxsTNWTS8lU7sCDcQ1v07PfUgQRHj7m6DdGNwgsdLg3VkcILHTYV3YWt1Mgk"}'
2026-02-04 12:00:59.184 INFO [src.node.waku_node] REST service is ready !!
2026-02-04 12:00:59.191 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-04 12:00:59.191 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-02-04_12-00-57__43c026db-f203-423f-87fd-3c6210b78909__wakuorg_nwaku:latest.log
2026-02-04 12:00:59.192 DEBUG [src.node.waku_node] Starting Node...
2026-02-04 12:00:59.192 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-04 12:00:59.193 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-04 12:00:59.193 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.68.34
2026-02-04 12:00:59.193 DEBUG [src.node.docker_mananger] Generated ports ['11739', '11740', '11741', '11742', '11743']
2026-02-04 12:00:59.193 DEBUG [src.node.waku_node] Cluster id was resolved to: 3
2026-02-04 12:00:59.194 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-04 12:00:59.194 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-04 12:00:59.194 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-04 12:00:59.194 DEBUG [src.node.waku_node] Using volumes []
2026-02-04 12:00:59.194 DEBUG [src.node.docker_mananger] docker run -i -t -p 11739:11739 -p 11740:11740 -p 11741:11741 -p 11742:11742 -p 11743:11743 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=11741 --rest-port=11739 --tcp-port=11740 --discv5-udp-port=11742 --rest-address=0.0.0.0 --nat=extip:172.18.68.34 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=2321e9af5bd6e2c9721ddbfd2295b20d1f4dc4daf9e5f1e73ff73baf5cfe1fa5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=11743 --metrics-logging=true --lightpush=true --relay=true
2026-02-04 12:00:59.380 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.68.34 waku a79cb34818656942dfeef27a9a762944581e83104bb88e06611ee28e4b74afe4
2026-02-04 12:00:59.411 DEBUG [src.node.docker_mananger] Container started with ID a79cb3481865. Setting up logs at ./log/docker/receiving_node2_2026-02-04_12-00-57__43c026db-f203-423f-87fd-3c6210b78909__wakuorg_nwaku:latest.log
2026-02-04 12:00:59.412 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 11739
2026-02-04 12:00:59.412 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-04 12:01:00.412 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11739/health" -H "Content-Type: application/json" -d 'None'
2026-02-04 12:01:00.415 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-02-04 12:01:00.415 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-04 12:01:00.416 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11739/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-04 12:01:00.418 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.68.34/tcp/11740/p2p/16Uiu2HAm8ZAGCCJvcqrvsQXTwjgunmqJ6rMqYakcsVymDeZeS898","/ip4/172.18.68.34/tcp/11741/ws/p2p/16Uiu2HAm8ZAGCCJvcqrvsQXTwjgunmqJ6rMqYakcsVymDeZeS898"],"enrUri":"enr:-L24QB1WItz5JfGxZgobprse_VvhSxNMcnP4Z7GnI3gpuu3ZKaXF0AYNDXxXgfK6NJIZppYB6naYFPWg6t4D-h9b_lkCgmlkgnY0gmlwhKwSRCKKbXVsdGlhZGRyc5YACASsEkQiBi3cAAoErBJEIgYt3d0DgnJzhQADAQAAiXNlY3AyNTZrMaECwxL5ohSHW78p60PHKw5fMI_J06lc4MY7AKYUTk109EuDdGNwgi3cg3VkcIIt3oV3YWt1Mgk"}'
2026-02-04 12:01:00.418 INFO [src.node.waku_node] REST service is ready !!
2026-02-04 12:01:00.418 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11739/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.13.60/tcp/51019/p2p/16Uiu2HAkyeqtcsWzKwXfG3ggRtk3oshomFbtp1mKZbqK2nMfUjS5"]'
2026-02-04 12:01:00.451 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 12:01:00.462 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-04 12:01:00.463 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node3_2026-02-04_12-00-57__43c026db-f203-423f-87fd-3c6210b78909__wakuorg_nwaku:latest.log
2026-02-04 12:01:00.463 DEBUG [src.node.waku_node] Starting Node...
2026-02-04 12:01:00.463 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-04 12:01:00.467 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-04 12:01:00.467 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.227.107
2026-02-04 12:01:00.467 DEBUG [src.node.docker_mananger] Generated ports ['41965', '41966', '41967', '41968', '41969']
2026-02-04 12:01:00.467 DEBUG [src.node.waku_node] Cluster id was resolved to: 3
2026-02-04 12:01:00.468 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-04 12:01:00.468 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-04 12:01:00.468 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-04 12:01:00.468 DEBUG [src.node.waku_node] Using volumes []
2026-02-04 12:01:00.468 DEBUG [src.node.docker_mananger] docker run -i -t -p 41965:41965 -p 41966:41966 -p 41967:41967 -p 41968:41968 -p 41969:41969 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=41967 --rest-port=41965 --tcp-port=41966 --discv5-udp-port=41968 --rest-address=0.0.0.0 --nat=extip:172.18.227.107 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=6a37b4fd5f3eff1d1678ea2ef6a5012a1bbaacb0eee6a2a67d36a069acfa1e50 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=41969 --metrics-logging=true --lightpush=true --relay=true
2026-02-04 12:01:00.651 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.227.107 waku cd532509508f3baca0d583306658c8ad514377f4e4e4a7fd2701275ebb5a7294
2026-02-04 12:01:00.680 DEBUG [src.node.docker_mananger] Container started with ID cd532509508f. Setting up logs at ./log/docker/receiving_node3_2026-02-04_12-00-57__43c026db-f203-423f-87fd-3c6210b78909__wakuorg_nwaku:latest.log
2026-02-04 12:01:00.680 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 41965
2026-02-04 12:01:00.681 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-04 12:01:01.682 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41965/health" -H "Content-Type: application/json" -d 'None'
2026-02-04 12:01:01.685 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-02-04 12:01:01.685 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-04 12:01:01.686 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41965/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-04 12:01:01.688 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.227.107/tcp/41966/p2p/16Uiu2HAmBrhPwhRFE9ep11U12BLTtZ12KffqNB52vuMDtr4zh5N2","/ip4/172.18.227.107/tcp/41967/ws/p2p/16Uiu2HAmBrhPwhRFE9ep11U12BLTtZ12KffqNB52vuMDtr4zh5N2"],"enrUri":"enr:-L24QMDYAKD2dRT2hEMv_dE7aIQF2pQkbun27rV6Bdvrx-05AynBTtXcF_QHxPtra98SKzTYwg3b3g-SEn6n40s6dk0CgmlkgnY0gmlwhKwS42uKbXVsdGlhZGRyc5YACASsEuNrBqPuAAoErBLjawaj790DgnJzhQADAQAAiXNlY3AyNTZrMaEC9CQc0MPktr_Z0xvNiPGwvO_gsMNcfQIlvGjVHrpw_sODdGNwgqPug3VkcIKj8IV3YWt1Mgk"}'
2026-02-04 12:01:01.688 INFO [src.node.waku_node] REST service is ready !!
2026-02-04 12:01:01.689 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41965/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.13.60/tcp/51019/p2p/16Uiu2HAkyeqtcsWzKwXfG3ggRtk3oshomFbtp1mKZbqK2nMfUjS5"]'
2026-02-04 12:01:01.721 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 12:01:01.722 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41965/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.68.34/tcp/11740/p2p/16Uiu2HAm8ZAGCCJvcqrvsQXTwjgunmqJ6rMqYakcsVymDeZeS898"]'
2026-02-04 12:01:01.750 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 12:01:01.762 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-04 12:01:01.762 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node4_2026-02-04_12-00-57__43c026db-f203-423f-87fd-3c6210b78909__wakuorg_nwaku:latest.log
2026-02-04 12:01:01.763 DEBUG [src.node.waku_node] Starting Node...
2026-02-04 12:01:01.763 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-04 12:01:01.764 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-04 12:01:01.764 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.201.60
2026-02-04 12:01:01.764 DEBUG [src.node.docker_mananger] Generated ports ['32923', '32924', '32925', '32926', '32927']
2026-02-04 12:01:01.765 DEBUG [src.node.waku_node] Cluster id was resolved to: 3
2026-02-04 12:01:01.765 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-04 12:01:01.765 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-04 12:01:01.765 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-04 12:01:01.765 DEBUG [src.node.waku_node] Using volumes []
2026-02-04 12:01:01.765 DEBUG [src.node.docker_mananger] docker run -i -t -p 32923:32923 -p 32924:32924 -p 32925:32925 -p 32926:32926 -p 32927:32927 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32925 --rest-port=32923 --tcp-port=32924 --discv5-udp-port=32926 --rest-address=0.0.0.0 --nat=extip:172.18.201.60 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f3aacea3cdebca59d06d7cadb86a01f6d8c6e02fbf64b97f898eaff27cbdbcdd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32927 --metrics-logging=true --lightpush=true --relay=true
2026-02-04 12:01:01.962 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.201.60 waku 23ac708f90912369f63494301de4d17cce45781936a227a2d811c1e8204e0f39
2026-02-04 12:01:01.993 DEBUG [src.node.docker_mananger] Container started with ID 23ac708f9091. Setting up logs at ./log/docker/receiving_node4_2026-02-04_12-00-57__43c026db-f203-423f-87fd-3c6210b78909__wakuorg_nwaku:latest.log
2026-02-04 12:01:01.994 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 32923
2026-02-04 12:01:01.994 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-04 12:01:02.994 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32923/health" -H "Content-Type: application/json" -d 'None'
2026-02-04 12:01:02.998 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-02-04 12:01:02.998 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-04 12:01:02.998 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32923/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-04 12:01:03.000 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.201.60/tcp/32924/p2p/16Uiu2HAmBVruE1Ck4QY5tss68i2z45gDsAyvQfeguUoX4cjYmxdX","/ip4/172.18.201.60/tcp/32925/ws/p2p/16Uiu2HAmBVruE1Ck4QY5tss68i2z45gDsAyvQfeguUoX4cjYmxdX"],"enrUri":"enr:-L24QLWctfLNChQaSVbAR66Wjmt9fWWGQGSkMi-BJSJzeoICTGn1T7lGKASqO30eXYaTI6n2ipgVZYoSJ5lrkn-iOMgCgmlkgnY0gmlwhKwSyTyKbXVsdGlhZGRyc5YACASsEsk8BoCcAAoErBLJPAaAnd0DgnJzhQADAQAAiXNlY3AyNTZrMaEC7s2pqQKNyCJ6rfXYMyeysHs6iDyzQTVteXQQtB_Jm1KDdGNwgoCcg3VkcIKAnoV3YWt1Mgk"}'
2026-02-04 12:01:03.001 INFO [src.node.waku_node] REST service is ready !!
2026-02-04 12:01:03.001 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32923/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.13.60/tcp/51019/p2p/16Uiu2HAkyeqtcsWzKwXfG3ggRtk3oshomFbtp1mKZbqK2nMfUjS5"]'
2026-02-04 12:01:03.033 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 12:01:03.033 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32923/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.68.34/tcp/11740/p2p/16Uiu2HAm8ZAGCCJvcqrvsQXTwjgunmqJ6rMqYakcsVymDeZeS898"]'
2026-02-04 12:01:03.057 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 12:01:03.058 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32923/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.227.107/tcp/41966/p2p/16Uiu2HAmBrhPwhRFE9ep11U12BLTtZ12KffqNB52vuMDtr4zh5N2"]'
2026-02-04 12:01:03.081 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 12:01:03.097 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-04 12:01:03.100 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-02-04_12-00-57__43c026db-f203-423f-87fd-3c6210b78909__wakuorg_nwaku:latest.log
2026-02-04 12:01:03.101 DEBUG [src.node.waku_node] Starting Node...
2026-02-04 12:01:03.101 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-04 12:01:03.106 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-04 12:01:03.106 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.50.153
2026-02-04 12:01:03.106 DEBUG [src.node.docker_mananger] Generated ports ['45415', '45416', '45417', '45418', '45419']
2026-02-04 12:01:03.107 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-04 12:01:03.107 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-04 12:01:03.108 DEBUG [src.node.waku_node] Using volumes []
2026-02-04 12:01:03.108 DEBUG [src.node.docker_mananger] docker run -i -t -p 45415:45415 -p 45416:45416 -p 45417:45417 -p 45418:45418 -p 45419:45419 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=45417 --rest-port=45415 --tcp-port=45416 --discv5-udp-port=45418 --rest-address=0.0.0.0 --nat=extip:172.18.50.153 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c5719c89f8aba59ba8e10eab7012c2db61ce2bf6bddde30e6d4f9724a4acda7e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=45419 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QJH_EsSpU0t7tkK_kXBAk_7fIR0cv-aU74xyGQMMU79oXjFwjA6gd6h05skoOBP0ZxFe2-CoTzXxgPRj8P5kqE8CgmlkgnY0gmlwhKwSDTyKbXVsdGlhZGRyc5YACASsEg08BsdLAAoErBINPAbHTN0DgnJzhQADAQAAiXNlY3AyNTZrMaECPs6BH5cwDLGMxsTNWTS8lU7sCDcQ1v07PfUgQRHj7m6DdGNwgsdLg3VkcILHTYV3YWt1Mgk --lightpushnode=/ip4/172.18.13.60/tcp/51019/p2p/16Uiu2HAkyeqtcsWzKwXfG3ggRtk3oshomFbtp1mKZbqK2nMfUjS5 --lightpush=true --relay=true
2026-02-04 12:01:03.311 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.50.153 waku 902fbfbdd26d458775cd67951efd1f444c76f33ad6b8a8e1955cfdbfb695719a
2026-02-04 12:01:03.344 DEBUG [src.node.docker_mananger] Container started with ID 902fbfbdd26d. Setting up logs at ./log/docker/lightpush_node1_2026-02-04_12-00-57__43c026db-f203-423f-87fd-3c6210b78909__wakuorg_nwaku:latest.log
2026-02-04 12:01:03.345 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 45415
2026-02-04 12:01:03.345 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-04 12:01:04.346 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45415/health" -H "Content-Type: application/json" -d 'None'
2026-02-04 12:01:04.350 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-02-04 12:01:04.350 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-04 12:01:04.350 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45415/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-04 12:01:04.352 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.50.153/tcp/45416/p2p/16Uiu2HAm4JttXgnCySZaGMvQHPyVcPXLPSE5mvqEwtgvBGhnEEhu","/ip4/172.18.50.153/tcp/45417/ws/p2p/16Uiu2HAm4JttXgnCySZaGMvQHPyVcPXLPSE5mvqEwtgvBGhnEEhu"],"enrUri":"enr:-L24QILd36RJ4qbbYwyN_vg1VY-TiXqLMJ_NVgiGs12FtBNZHNcWTTbU0dxqkI10zeZxUy-9J9ZO5NN1GrBu_7sRsawCgmlkgnY0gmlwhKwSMpmKbXVsdGlhZGRyc5YACASsEjKZBrFoAAoErBIymQaxad0DgnJzhQADAQAAiXNlY3AyNTZrMaECg_y2lLQo-zOH7oOoZTxlgErTeRU_HZlVcdN-iwVsMrCDdGNwgrFog3VkcIKxaoV3YWt1Mgk"}'
2026-02-04 12:01:04.352 INFO [src.node.waku_node] REST service is ready !!
2026-02-04 12:01:04.353 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45415/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.13.60/tcp/51019/p2p/16Uiu2HAkyeqtcsWzKwXfG3ggRtk3oshomFbtp1mKZbqK2nMfUjS5"]'
2026-02-04 12:01:04.394 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 12:01:04.394 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45415/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.68.34/tcp/11740/p2p/16Uiu2HAm8ZAGCCJvcqrvsQXTwjgunmqJ6rMqYakcsVymDeZeS898"]'
2026-02-04 12:01:04.420 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 12:01:04.421 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45415/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.227.107/tcp/41966/p2p/16Uiu2HAmBrhPwhRFE9ep11U12BLTtZ12KffqNB52vuMDtr4zh5N2"]'
2026-02-04 12:01:04.445 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 12:01:04.446 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45415/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.201.60/tcp/32924/p2p/16Uiu2HAmBVruE1Ck4QY5tss68i2z45gDsAyvQfeguUoX4cjYmxdX"]'
2026-02-04 12:01:04.478 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 12:01:04.478 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:51018/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-02-04 12:01:04.484 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 12:01:04.488 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11739/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-02-04 12:01:04.491 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 12:01:04.492 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41965/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-02-04 12:01:04.497 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 12:01:04.497 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32923/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-02-04 12:01:04.501 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 12:01:04.502 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45415/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-02-04 12:01:04.505 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 12:01:04.505 DEBUG [src.steps.light_push] Lightpushing message
2026-02-04 12:01:04.505 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45415/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1770206464505514489}}'
2026-02-04 12:01:04.524 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 12:01:04.526 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-02-04 12:01:04.627 DEBUG [src.steps.light_push] Checking that peer NODE_1:wakuorg/nwaku:latest can find the lightpushed message
2026-02-04 12:01:04.627 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:51018/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-02-04 12:01:04.630 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1770206464505514489,"ephemeral":false,"proof":""}]'
2026-02-04 12:01:04.632 DEBUG [src.steps.light_push] Checking that peer NODE_2:wakuorg/nwaku:latest can find the lightpushed message
2026-02-04 12:01:04.632 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11739/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-02-04 12:01:04.634 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1770206464505514489,"ephemeral":false,"proof":""}]'
2026-02-04 12:01:04.635 DEBUG [src.steps.light_push] Checking that peer NODE_3:wakuorg/nwaku:latest can find the lightpushed message
2026-02-04 12:01:04.636 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41965/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-02-04 12:01:04.638 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1770206464505514489,"ephemeral":false,"proof":""}]'
2026-02-04 12:01:04.639 DEBUG [src.steps.light_push] Checking that peer NODE_4:wakuorg/nwaku:latest can find the lightpushed message
2026-02-04 12:01:04.639 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32923/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-02-04 12:01:04.642 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1770206464505514489,"ephemeral":false,"proof":""}]'
2026-02-04 12:01:04.643 DEBUG [src.steps.light_push] Checking that peer NODE_5:wakuorg/nwaku:latest can find the lightpushed message
2026-02-04 12:01:04.643 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45415/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-02-04 12:01:04.645 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"TGlnaHQgcHVzaCB3b3JrcyEh","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1770206464505514489,"ephemeral":false,"proof":""}]'
2026-02-04 12:01:04.648 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-04 12:01:04.649 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-04 12:01:04.649 DEBUG [src.node.waku_node] Stopping container with id 0243843e1262
2026-02-04 12:01:05.189 DEBUG [src.node.waku_node] Container stopped.
2026-02-04 12:01:05.189 DEBUG [src.node.waku_node] Stopping container with id a79cb3481865
2026-02-04 12:01:05.753 DEBUG [src.node.waku_node] Container stopped.
2026-02-04 12:01:05.754 DEBUG [src.node.waku_node] Stopping container with id cd532509508f
2026-02-04 12:01:06.003 ERROR [src.node.docker_mananger] Max retries reached for container 0243843e1262. Exiting log stream.
2026-02-04 12:01:06.333 DEBUG [src.node.waku_node] Container stopped.
2026-02-04 12:01:06.334 DEBUG [src.node.waku_node] Stopping container with id 23ac708f9091
2026-02-04 12:01:06.567 ERROR [src.node.docker_mananger] Max retries reached for container a79cb3481865. Exiting log stream.
2026-02-04 12:01:06.867 DEBUG [src.node.waku_node] Container stopped.
2026-02-04 12:01:06.868 DEBUG [src.node.waku_node] Stopping container with id 902fbfbdd26d
2026-02-04 12:01:07.147 ERROR [src.node.docker_mananger] Max retries reached for container cd532509508f. Exiting log stream.
2026-02-04 12:01:07.407 DEBUG [src.node.waku_node] Container stopped.
2026-02-04 12:01:07.409 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-04 12:01:07.422 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-04 12:01:07.435 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-04 12:01:07.448 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-04 12:01:07.461 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-04 12:01:07.474 DEBUG [src.node.docker_mananger] No errors found in the waku logs.