162 lines
30 KiB
Plaintext

2025-12-14 04:14:31.462 DEBUG [tests.conftest] Running fixture setup: test_id
2025-12-14 04:14:31.462 DEBUG [tests.conftest] Running test: test_store_no_peer_selected with id: 2025-12-14_04-14-31__a4418506-c67c-4cde-b347-ab2ddc2792c5
2025-12-14 04:14:31.463 DEBUG [src.steps.common] Running fixture setup: common_setup
2025-12-14 04:14:31.463 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2025-12-14 04:14:31.463 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2025-12-14 04:14:31.473 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-14 04:14:31.473 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2025-12-14_04-14-31__a4418506-c67c-4cde-b347-ab2ddc2792c5__wakuorg_nwaku:latest.log
2025-12-14 04:14:31.479 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-14 04:14:31.479 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2025-12-14_04-14-31__a4418506-c67c-4cde-b347-ab2ddc2792c5__wakuorg_nwaku:latest.log
2025-12-14 04:14:31.485 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-14 04:14:31.485 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2025-12-14_04-14-31__a4418506-c67c-4cde-b347-ab2ddc2792c5__wakuorg_nwaku:latest.log
2025-12-14 04:14:31.485 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2025-12-14 04:14:31.486 DEBUG [src.steps.store] Running fixture setup: store_setup
2025-12-14 04:14:31.486 DEBUG [tests.e2e.test_e2e] Start 5 nodes
2025-12-14 04:14:31.492 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-14 04:14:31.492 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2025-12-14_04-14-31__a4418506-c67c-4cde-b347-ab2ddc2792c5__wakuorg_nwaku:latest.log
2025-12-14 04:14:31.497 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-14 04:14:31.498 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2025-12-14_04-14-31__a4418506-c67c-4cde-b347-ab2ddc2792c5__wakuorg_nwaku:latest.log
2025-12-14 04:14:31.503 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-14 04:14:31.503 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2025-12-14_04-14-31__a4418506-c67c-4cde-b347-ab2ddc2792c5__wakuorg_nwaku:latest.log
2025-12-14 04:14:31.503 DEBUG [src.node.waku_node] Starting Node...
2025-12-14 04:14:31.503 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-14 04:14:31.545 DEBUG [src.node.docker_mananger] Network waku created
2025-12-14 04:14:31.545 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.71.182
2025-12-14 04:14:31.546 DEBUG [src.node.docker_mananger] Generated ports ['14087', '14088', '14089', '14090', '14091']
2025-12-14 04:14:31.546 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-14 04:14:31.546 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-14 04:14:31.546 DEBUG [src.node.waku_node] Using volumes []
2025-12-14 04:14:31.546 DEBUG [src.node.docker_mananger] docker run -i -t -p 14087:14087 -p 14088:14088 -p 14089:14089 -p 14090:14090 -p 14091:14091 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=14089 --rest-port=14087 --tcp-port=14088 --discv5-udp-port=14090 --rest-address=0.0.0.0 --nat=extip:172.18.71.182 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=de7bfa15daea2ad07fe0eba96f216fa49f0dcf8aac3baf4e3a29801c94a423bb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=14091 --metrics-logging=true --relay=true --store=true
2025-12-14 04:14:34.399 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.71.182 waku 4071c1b52e16b36cf597342b3c506b6bf70765449a441de0d1a1899282f2e996
2025-12-14 04:14:34.431 DEBUG [src.node.docker_mananger] Container started with ID 4071c1b52e16. Setting up logs at ./log/docker/node1_2025-12-14_04-14-31__a4418506-c67c-4cde-b347-ab2ddc2792c5__wakuorg_nwaku:latest.log
2025-12-14 04:14:34.432 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 14087
2025-12-14 04:14:34.432 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-14 04:14:35.433 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14087/health" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:14:35.436 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-14 04:14:35.437 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-14 04:14:35.437 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14087/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:14:35.439 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.71.182/tcp/14088/p2p/16Uiu2HAmCURiFsRG1xaxY4FEgJqyTwEKNqK5nxMAqfrh75XxUuBv","/ip4/172.18.71.182/tcp/14089/ws/p2p/16Uiu2HAmCURiFsRG1xaxY4FEgJqyTwEKNqK5nxMAqfrh75XxUuBv"],"enrUri":"enr:-L24QJj5ytJaEido_9Z9GjrPl635H4Vc7V35wJPTa7k-Gdr6QdfaBDLQM4yiV5vGJcg3xbEPgdX7hACnFA5C4jGBBMwCgmlkgnY0gmlwhKwSR7aKbXVsdGlhZGRyc5YACASsEke2BjcIAAoErBJHtgY3Cd0DgnJzhQADAQAAiXNlY3AyNTZrMaEC_UtJlgmG78efkloP8pSsz9m8JDHtlj6VeTGxxOQzyTGDdGNwgjcIg3VkcII3CoV3YWt1MgM"}'
2025-12-14 04:14:35.439 INFO [src.node.waku_node] REST service is ready !!
2025-12-14 04:14:35.439 DEBUG [src.node.waku_node] Starting Node...
2025-12-14 04:14:35.439 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-14 04:14:35.441 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-14 04:14:35.441 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.15.249
2025-12-14 04:14:35.442 DEBUG [src.node.docker_mananger] Generated ports ['13035', '13036', '13037', '13038', '13039']
2025-12-14 04:14:35.442 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-14 04:14:35.442 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-14 04:14:35.442 DEBUG [src.node.waku_node] Using volumes []
2025-12-14 04:14:35.442 DEBUG [src.node.docker_mananger] docker run -i -t -p 13035:13035 -p 13036:13036 -p 13037:13037 -p 13038:13038 -p 13039:13039 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13037 --rest-port=13035 --tcp-port=13036 --discv5-udp-port=13038 --rest-address=0.0.0.0 --nat=extip:172.18.15.249 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=824d961072a52e3eefb1ccbeaa4018a8b6dddcd0bffbc42fae0b9cda1b8eacc9 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13039 --metrics-logging=true --store=false --relay=false --discv5-bootstrap-node=enr:-L24QJj5ytJaEido_9Z9GjrPl635H4Vc7V35wJPTa7k-Gdr6QdfaBDLQM4yiV5vGJcg3xbEPgdX7hACnFA5C4jGBBMwCgmlkgnY0gmlwhKwSR7aKbXVsdGlhZGRyc5YACASsEke2BjcIAAoErBJHtgY3Cd0DgnJzhQADAQAAiXNlY3AyNTZrMaEC_UtJlgmG78efkloP8pSsz9m8JDHtlj6VeTGxxOQzyTGDdGNwgjcIg3VkcII3CoV3YWt1MgM
2025-12-14 04:14:35.637 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.15.249 waku bdc4c762ecade872f9f43e7c3d609431b47ed123ac56b6e7f25e6270b50af14e
2025-12-14 04:14:35.667 DEBUG [src.node.docker_mananger] Container started with ID bdc4c762ecad. Setting up logs at ./log/docker/node2_2025-12-14_04-14-31__a4418506-c67c-4cde-b347-ab2ddc2792c5__wakuorg_nwaku:latest.log
2025-12-14 04:14:35.667 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 13035
2025-12-14 04:14:35.668 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-14 04:14:36.668 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13035/health" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:14:36.673 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-14 04:14:36.673 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-14 04:14:36.673 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13035/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:14:36.675 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.15.249/tcp/13036/p2p/16Uiu2HAm666CphUnML6BRdryGFB5PUxvU8jrfjBZVD79dqADp3iu","/ip4/172.18.15.249/tcp/13037/ws/p2p/16Uiu2HAm666CphUnML6BRdryGFB5PUxvU8jrfjBZVD79dqADp3iu"],"enrUri":"enr:-L24QOpGxyaJN4YaxwySd3yVfU2DdomWHjxFM_X2AQQ0JMQ9CfTbH88cu2mVd-DUCo6sDVnklWVVrEqIJYdMkWkI3fECgmlkgnY0gmlwhKwSD_mKbXVsdGlhZGRyc5YACASsEg_5BjLsAAoErBIP-QYy7d0DgnJzhQADAQAAiXNlY3AyNTZrMaECnmxUtlJfP6gjZxQ4XCiKYsCXAe6_1F1u_222byio6n6DdGNwgjLsg3VkcIIy7oV3YWt1MgA"}'
2025-12-14 04:14:36.676 INFO [src.node.waku_node] REST service is ready !!
2025-12-14 04:14:36.676 DEBUG [src.node.waku_node] Starting Node...
2025-12-14 04:14:36.676 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-14 04:14:36.677 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-14 04:14:36.677 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.239.41
2025-12-14 04:14:36.677 DEBUG [src.node.docker_mananger] Generated ports ['52610', '52611', '52612', '52613', '52614']
2025-12-14 04:14:36.678 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-14 04:14:36.678 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-14 04:14:36.678 DEBUG [src.node.waku_node] Using volumes []
2025-12-14 04:14:36.678 DEBUG [src.node.docker_mananger] docker run -i -t -p 52610:52610 -p 52611:52611 -p 52612:52612 -p 52613:52613 -p 52614:52614 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=52612 --rest-port=52610 --tcp-port=52611 --discv5-udp-port=52613 --rest-address=0.0.0.0 --nat=extip:172.18.239.41 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=3aa73f7a6e772bf7d5bbe3b82ddd4df956fe25a43c27b92fdbb2c276eeaedff2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=52614 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QOpGxyaJN4YaxwySd3yVfU2DdomWHjxFM_X2AQQ0JMQ9CfTbH88cu2mVd-DUCo6sDVnklWVVrEqIJYdMkWkI3fECgmlkgnY0gmlwhKwSD_mKbXVsdGlhZGRyc5YACASsEg_5BjLsAAoErBIP-QYy7d0DgnJzhQADAQAAiXNlY3AyNTZrMaECnmxUtlJfP6gjZxQ4XCiKYsCXAe6_1F1u_222byio6n6DdGNwgjLsg3VkcIIy7oV3YWt1MgA
2025-12-14 04:14:36.863 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.239.41 waku 6b83033d1d746308e7c01fec85ccb7dbdb19beb3b3eeea3bb0985ea86519972a
2025-12-14 04:14:36.893 DEBUG [src.node.docker_mananger] Container started with ID 6b83033d1d74. Setting up logs at ./log/docker/node3_2025-12-14_04-14-31__a4418506-c67c-4cde-b347-ab2ddc2792c5__wakuorg_nwaku:latest.log
2025-12-14 04:14:36.893 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 52610
2025-12-14 04:14:36.893 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-14 04:14:37.894 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52610/health" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:14:37.897 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-14 04:14:37.898 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-14 04:14:37.898 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52610/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:14:37.900 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.239.41/tcp/52611/p2p/16Uiu2HAmA8DrGSET5T7qduq39XBiVpoc9ModdMx41Cs6tnfoJ3P9","/ip4/172.18.239.41/tcp/52612/ws/p2p/16Uiu2HAmA8DrGSET5T7qduq39XBiVpoc9ModdMx41Cs6tnfoJ3P9"],"enrUri":"enr:-L24QMHw1206dWJaYlvEZ5rGsoeWxIAXKDz7j32DTmQ_pgugAt3doyrwxXLHcjv-ZCtx5cgXCliYm6pxCwoTBBuQa-YCgmlkgnY0gmlwhKwS7ymKbXVsdGlhZGRyc5YACASsEu8pBs2DAAoErBLvKQbNhN0DgnJzhQADAQAAiXNlY3AyNTZrMaEC2mbilw6ryen9CNcguB2_WzwwdRqW779E_v-ABbxxEFSDdGNwgs2Dg3VkcILNhYV3YWt1MgA"}'
2025-12-14 04:14:37.900 INFO [src.node.waku_node] REST service is ready !!
2025-12-14 04:14:37.900 DEBUG [src.node.waku_node] Starting Node...
2025-12-14 04:14:37.900 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-14 04:14:37.902 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-14 04:14:37.902 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.48.173
2025-12-14 04:14:37.902 DEBUG [src.node.docker_mananger] Generated ports ['57602', '57603', '57604', '57605', '57606']
2025-12-14 04:14:37.902 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-14 04:14:37.903 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-14 04:14:37.903 DEBUG [src.node.waku_node] Using volumes []
2025-12-14 04:14:37.903 DEBUG [src.node.docker_mananger] docker run -i -t -p 57602:57602 -p 57603:57603 -p 57604:57604 -p 57605:57605 -p 57606:57606 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=57604 --rest-port=57602 --tcp-port=57603 --discv5-udp-port=57605 --rest-address=0.0.0.0 --nat=extip:172.18.48.173 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c6fcf1f37aaebac6cb1f086ea1eaf601c5cbaa6acf197320e5bf644aacdaacd3 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=57606 --metrics-logging=true --relay=true --store=false --discv5-bootstrap-node=enr:-L24QMHw1206dWJaYlvEZ5rGsoeWxIAXKDz7j32DTmQ_pgugAt3doyrwxXLHcjv-ZCtx5cgXCliYm6pxCwoTBBuQa-YCgmlkgnY0gmlwhKwS7ymKbXVsdGlhZGRyc5YACASsEu8pBs2DAAoErBLvKQbNhN0DgnJzhQADAQAAiXNlY3AyNTZrMaEC2mbilw6ryen9CNcguB2_WzwwdRqW779E_v-ABbxxEFSDdGNwgs2Dg3VkcILNhYV3YWt1MgA
2025-12-14 04:14:38.093 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.48.173 waku 07ed3bbadbce4a20d108ec44f41a2b3be63fc6379b5f36d06a96e1d18c7671e2
2025-12-14 04:14:38.126 DEBUG [src.node.docker_mananger] Container started with ID 07ed3bbadbce. Setting up logs at ./log/docker/node3_2025-12-14_04-14-31__a4418506-c67c-4cde-b347-ab2ddc2792c5__wakuorg_nwaku:latest.log
2025-12-14 04:14:38.126 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 57602
2025-12-14 04:14:38.127 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-14 04:14:39.127 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57602/health" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:14:39.135 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-14 04:14:39.136 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-14 04:14:39.136 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57602/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:14:39.142 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.48.173/tcp/57603/p2p/16Uiu2HAmBCDJX1QknWEbbu9keisQFtaQ3fKd2SDSEdpgJ5zCpgf5","/ip4/172.18.48.173/tcp/57604/ws/p2p/16Uiu2HAmBCDJX1QknWEbbu9keisQFtaQ3fKd2SDSEdpgJ5zCpgf5"],"enrUri":"enr:-L24QKUIo9zUEfREsZyH271yWNJDKdtqhUU69cSMv8StXf-UdVCIcHmRvfl7IaQsVUE3t7twhqADSo57AWmyoyi-Kq8CgmlkgnY0gmlwhKwSMK2KbXVsdGlhZGRyc5YACASsEjCtBuEDAAoErBIwrQbhBN0DgnJzhQADAQAAiXNlY3AyNTZrMaEC6khGvlIhZcEVsyOoYp-S_5l8thHkkgYQujfw0LO8F0SDdGNwguEDg3VkcILhBYV3YWt1MgE"}'
2025-12-14 04:14:39.143 INFO [src.node.waku_node] REST service is ready !!
2025-12-14 04:14:39.143 DEBUG [src.node.waku_node] Starting Node...
2025-12-14 04:14:39.144 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-14 04:14:39.147 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-14 04:14:39.147 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.101.8
2025-12-14 04:14:39.148 DEBUG [src.node.docker_mananger] Generated ports ['32325', '32326', '32327', '32328', '32329']
2025-12-14 04:14:39.148 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-14 04:14:39.148 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-14 04:14:39.149 DEBUG [src.node.waku_node] Using volumes []
2025-12-14 04:14:39.150 DEBUG [src.node.docker_mananger] docker run -i -t -p 32325:32325 -p 32326:32326 -p 32327:32327 -p 32328:32328 -p 32329:32329 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32327 --rest-port=32325 --tcp-port=32326 --discv5-udp-port=32328 --rest-address=0.0.0.0 --nat=extip:172.18.101.8 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ce253e1fbb1cf105cae7c0bdd5f4c7c0bf3f0baaa0776cfd752b42ebd15cdd8f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32329 --metrics-logging=true --relay=false --store=false --discv5-bootstrap-node=enr:-L24QKUIo9zUEfREsZyH271yWNJDKdtqhUU69cSMv8StXf-UdVCIcHmRvfl7IaQsVUE3t7twhqADSo57AWmyoyi-Kq8CgmlkgnY0gmlwhKwSMK2KbXVsdGlhZGRyc5YACASsEjCtBuEDAAoErBIwrQbhBN0DgnJzhQADAQAAiXNlY3AyNTZrMaEC6khGvlIhZcEVsyOoYp-S_5l8thHkkgYQujfw0LO8F0SDdGNwguEDg3VkcILhBYV3YWt1MgE
2025-12-14 04:14:39.333 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.101.8 waku e7a70c5dc925092e39ab69eaec71ea228467677561ea80598f08b9c86fd5fdbb
2025-12-14 04:14:39.362 DEBUG [src.node.docker_mananger] Container started with ID e7a70c5dc925. Setting up logs at ./log/docker/node4_2025-12-14_04-14-31__a4418506-c67c-4cde-b347-ab2ddc2792c5__wakuorg_nwaku:latest.log
2025-12-14 04:14:39.362 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 32325
2025-12-14 04:14:39.363 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-14 04:14:40.364 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32325/health" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:14:40.367 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-14 04:14:40.367 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-14 04:14:40.368 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32325/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:14:40.370 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.101.8/tcp/32326/p2p/16Uiu2HAm56wjXfKTChoQwJ2mqbHUFsVmTJrwAXDqVJT7p4a47yVE","/ip4/172.18.101.8/tcp/32327/ws/p2p/16Uiu2HAm56wjXfKTChoQwJ2mqbHUFsVmTJrwAXDqVJT7p4a47yVE"],"enrUri":"enr:-L24QOe0ypwBa6NNO1e58m9Ajv27qm4DjirNixXiayOzDZgCR2F1Yy3ZXrcN42P2gXN0pKjivbGkV8tD6t9BAB0do8cCgmlkgnY0gmlwhKwSZQiKbXVsdGlhZGRyc5YACASsEmUIBn5GAAoErBJlCAZ-R90DgnJzhQADAQAAiXNlY3AyNTZrMaECj8ilpog8S1gZXE2Z4aJOLhelymFMZjHlMsiDbUHRYkWDdGNwgn5Gg3VkcIJ-SIV3YWt1MgA"}'
2025-12-14 04:14:40.370 INFO [src.node.waku_node] REST service is ready !!
2025-12-14 04:14:40.370 DEBUG [tests.e2e.test_e2e] Add 3 peer nodes to node3
2025-12-14 04:14:40.371 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52610/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.71.182/tcp/14088/p2p/16Uiu2HAmCURiFsRG1xaxY4FEgJqyTwEKNqK5nxMAqfrh75XxUuBv"]'
2025-12-14 04:14:40.391 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-14 04:14:40.392 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52610/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.15.249/tcp/13036/p2p/16Uiu2HAm666CphUnML6BRdryGFB5PUxvU8jrfjBZVD79dqADp3iu"]'
2025-12-14 04:14:40.414 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-14 04:14:40.418 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52610/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.48.173/tcp/57603/p2p/16Uiu2HAmBCDJX1QknWEbbu9keisQFtaQ3fKd2SDSEdpgJ5zCpgf5"]'
2025-12-14 04:14:40.427 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-14 04:14:40.427 DEBUG [tests.e2e.test_e2e] Subscribe nodes 1,2 to relay on pubsubtopic /waku/2/rs/3/1
2025-12-14 04:14:40.427 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57602/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2025-12-14 04:14:40.438 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-14 04:14:40.438 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14087/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2025-12-14 04:14:40.443 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-14 04:14:40.443 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14087/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:14:40.447 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.239.41/tcp/38976/p2p/16Uiu2HAmA8DrGSET5T7qduq39XBiVpoc9ModdMx41Cs6tnfoJ3P9","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[],"connected":"Connected","agent":"nwaku-v0.36.0-114-g7d1c6a","origin":"UnknownOrigin"}]'
2025-12-14 04:14:40.447 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57602/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:14:40.449 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.239.41/tcp/52611/p2p/16Uiu2HAmA8DrGSET5T7qduq39XBiVpoc9ModdMx41Cs6tnfoJ3P9","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-114-g7d1c6a","origin":"Discv5"}]'
2025-12-14 04:14:40.450 DEBUG [src.libs.common] Sleeping for 30 seconds
2025-12-14 04:15:10.450 DEBUG [tests.e2e.test_e2e] Node1 publish message
2025-12-14 04:15:10.451 DEBUG [src.steps.store] Relaying message
2025-12-14 04:15:10.451 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57602/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2025-12-14 04:15:10.456 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-14 04:15:10.457 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-14 04:15:10.657 DEBUG [tests.e2e.test_e2e] Check if node3 can inquiry stored message without stor peer specified
2025-12-14 04:15:10.657 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52610/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F1&contentTopics=%2Ftest%2F1%2Fwaku-filter%2Fproto&pageSize=5&ascending=true" -H "Content-Type: application/json" -d 'None'
2025-12-14 04:15:10.666 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"3ea0de68848b1a3531ea","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x6c770f8bd4a9a867b2abda98137b503420e3cc16911ca057a9371ad808bf9717"}]}'
2025-12-14 04:15:10.668 DEBUG [tests.conftest] Running fixture teardown: test_setup
2025-12-14 04:15:10.669 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2025-12-14 04:15:10.669 DEBUG [src.node.waku_node] Stopping container with id 4071c1b52e16
2025-12-14 04:15:11.218 DEBUG [src.node.waku_node] Container stopped.
2025-12-14 04:15:11.219 DEBUG [src.node.waku_node] Stopping container with id bdc4c762ecad
2025-12-14 04:15:11.702 DEBUG [src.node.waku_node] Container stopped.
2025-12-14 04:15:11.702 DEBUG [src.node.waku_node] Stopping container with id 6b83033d1d74
2025-12-14 04:15:12.031 ERROR [src.node.docker_mananger] Max retries reached for container 4071c1b52e16. Exiting log stream.
2025-12-14 04:15:12.234 DEBUG [src.node.waku_node] Container stopped.
2025-12-14 04:15:12.234 DEBUG [src.node.waku_node] Stopping container with id 07ed3bbadbce
2025-12-14 04:15:12.514 ERROR [src.node.docker_mananger] Max retries reached for container bdc4c762ecad. Exiting log stream.
2025-12-14 04:15:12.748 DEBUG [src.node.waku_node] Container stopped.
2025-12-14 04:15:12.748 DEBUG [src.node.waku_node] Stopping container with id e7a70c5dc925
2025-12-14 04:15:13.047 ERROR [src.node.docker_mananger] Max retries reached for container 6b83033d1d74. Exiting log stream.
2025-12-14 04:15:13.289 DEBUG [src.node.waku_node] Container stopped.
2025-12-14 04:15:13.292 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2025-12-14 04:15:13.315 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-14 04:15:13.324 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-14 04:15:13.350 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-14 04:15:13.376 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-14 04:15:13.380 DEBUG [src.node.docker_mananger] No errors found in the waku logs.