162 lines
30 KiB
Plaintext

2025-12-18 04:10:23.480 DEBUG [tests.conftest] Running fixture setup: test_id
2025-12-18 04:10:23.480 DEBUG [tests.conftest] Running test: test_store_no_peer_selected with id: 2025-12-18_04-10-23__29dea090-0fb3-4c0d-9821-e2297100c8f6
2025-12-18 04:10:23.480 DEBUG [src.steps.common] Running fixture setup: common_setup
2025-12-18 04:10:23.481 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2025-12-18 04:10:23.481 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2025-12-18 04:10:23.490 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-18 04:10:23.490 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2025-12-18_04-10-23__29dea090-0fb3-4c0d-9821-e2297100c8f6__wakuorg_nwaku:latest.log
2025-12-18 04:10:23.496 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-18 04:10:23.496 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2025-12-18_04-10-23__29dea090-0fb3-4c0d-9821-e2297100c8f6__wakuorg_nwaku:latest.log
2025-12-18 04:10:23.502 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-18 04:10:23.502 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2025-12-18_04-10-23__29dea090-0fb3-4c0d-9821-e2297100c8f6__wakuorg_nwaku:latest.log
2025-12-18 04:10:23.502 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2025-12-18 04:10:23.502 DEBUG [src.steps.store] Running fixture setup: store_setup
2025-12-18 04:10:23.503 DEBUG [tests.e2e.test_e2e] Start 5 nodes
2025-12-18 04:10:23.509 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-18 04:10:23.509 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2025-12-18_04-10-23__29dea090-0fb3-4c0d-9821-e2297100c8f6__wakuorg_nwaku:latest.log
2025-12-18 04:10:23.514 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-18 04:10:23.514 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2025-12-18_04-10-23__29dea090-0fb3-4c0d-9821-e2297100c8f6__wakuorg_nwaku:latest.log
2025-12-18 04:10:23.519 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-18 04:10:23.519 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2025-12-18_04-10-23__29dea090-0fb3-4c0d-9821-e2297100c8f6__wakuorg_nwaku:latest.log
2025-12-18 04:10:23.520 DEBUG [src.node.waku_node] Starting Node...
2025-12-18 04:10:23.520 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-18 04:10:23.561 DEBUG [src.node.docker_mananger] Network waku created
2025-12-18 04:10:23.561 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.22.248
2025-12-18 04:10:23.561 DEBUG [src.node.docker_mananger] Generated ports ['50441', '50442', '50443', '50444', '50445']
2025-12-18 04:10:23.561 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-18 04:10:23.561 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-18 04:10:23.562 DEBUG [src.node.waku_node] Using volumes []
2025-12-18 04:10:23.562 DEBUG [src.node.docker_mananger] docker run -i -t -p 50441:50441 -p 50442:50442 -p 50443:50443 -p 50444:50444 -p 50445:50445 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=50443 --rest-port=50441 --tcp-port=50442 --discv5-udp-port=50444 --rest-address=0.0.0.0 --nat=extip:172.18.22.248 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=1dedae8cacddf0cbdcfbdc70b4828f4c4b7f8abecd76bc5bcb257933654ef8e6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=50445 --metrics-logging=true --relay=true --store=true
2025-12-18 04:10:25.459 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.22.248 waku 334830ed833b90b76c27d6dc5c8216204515128759b2575b786a55838aed2c96
2025-12-18 04:10:25.492 DEBUG [src.node.docker_mananger] Container started with ID 334830ed833b. Setting up logs at ./log/docker/node1_2025-12-18_04-10-23__29dea090-0fb3-4c0d-9821-e2297100c8f6__wakuorg_nwaku:latest.log
2025-12-18 04:10:25.492 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 50441
2025-12-18 04:10:25.493 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-18 04:10:26.493 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50441/health" -H "Content-Type: application/json" -d 'None'
2025-12-18 04:10:26.497 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-18 04:10:26.497 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-18 04:10:26.497 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50441/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-18 04:10:26.499 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.22.248/tcp/50442/p2p/16Uiu2HAmM2b1K9HE4vZUYqaCHpxGBAgAFtaVAAhKU6S58VjvwJDo","/ip4/172.18.22.248/tcp/50443/ws/p2p/16Uiu2HAmM2b1K9HE4vZUYqaCHpxGBAgAFtaVAAhKU6S58VjvwJDo"],"enrUri":"enr:-L24QCu4hslz3YnX2YBAgYHLlAi1evyFdQjSN8UNrV7g2pcgMiusUiMXSmZGfH_tNAToKXLz3jWpqCVsixpPo-S33kcCgmlkgnY0gmlwhKwSFviKbXVsdGlhZGRyc5YACASsEhb4BsUKAAoErBIW-AbFC90DgnJzhQADAQAAiXNlY3AyNTZrMaEDfGXgqepNVokDDKw2YhS4sDJ9zTnEL-i4L3dTT1RL2cqDdGNwgsUKg3VkcILFDIV3YWt1MgM"}'
2025-12-18 04:10:26.499 INFO [src.node.waku_node] REST service is ready !!
2025-12-18 04:10:26.500 DEBUG [src.node.waku_node] Starting Node...
2025-12-18 04:10:26.500 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-18 04:10:26.501 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-18 04:10:26.501 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.239.87
2025-12-18 04:10:26.501 DEBUG [src.node.docker_mananger] Generated ports ['29920', '29921', '29922', '29923', '29924']
2025-12-18 04:10:26.502 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-18 04:10:26.502 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-18 04:10:26.502 DEBUG [src.node.waku_node] Using volumes []
2025-12-18 04:10:26.502 DEBUG [src.node.docker_mananger] docker run -i -t -p 29920:29920 -p 29921:29921 -p 29922:29922 -p 29923:29923 -p 29924:29924 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=29922 --rest-port=29920 --tcp-port=29921 --discv5-udp-port=29923 --rest-address=0.0.0.0 --nat=extip:172.18.239.87 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8d0df6eab980716e8c69cbdc4488397bddbc64f456ecb4ebb1df2cef86ab4a1e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=29924 --metrics-logging=true --store=false --relay=false --discv5-bootstrap-node=enr:-L24QCu4hslz3YnX2YBAgYHLlAi1evyFdQjSN8UNrV7g2pcgMiusUiMXSmZGfH_tNAToKXLz3jWpqCVsixpPo-S33kcCgmlkgnY0gmlwhKwSFviKbXVsdGlhZGRyc5YACASsEhb4BsUKAAoErBIW-AbFC90DgnJzhQADAQAAiXNlY3AyNTZrMaEDfGXgqepNVokDDKw2YhS4sDJ9zTnEL-i4L3dTT1RL2cqDdGNwgsUKg3VkcILFDIV3YWt1MgM
2025-12-18 04:10:26.683 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.239.87 waku 65a40cc59e938516d5aa55f4be378db2062378ad7269b92cbd4ce14e939b76b4
2025-12-18 04:10:26.714 DEBUG [src.node.docker_mananger] Container started with ID 65a40cc59e93. Setting up logs at ./log/docker/node2_2025-12-18_04-10-23__29dea090-0fb3-4c0d-9821-e2297100c8f6__wakuorg_nwaku:latest.log
2025-12-18 04:10:26.715 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 29920
2025-12-18 04:10:26.715 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-18 04:10:27.715 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29920/health" -H "Content-Type: application/json" -d 'None'
2025-12-18 04:10:27.719 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-18 04:10:27.719 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-18 04:10:27.720 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29920/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-18 04:10:27.722 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.239.87/tcp/29921/p2p/16Uiu2HAm4BJheecbQq8PusK815RNmtTAdPiP4UScAXjBHpUZRYhB","/ip4/172.18.239.87/tcp/29922/ws/p2p/16Uiu2HAm4BJheecbQq8PusK815RNmtTAdPiP4UScAXjBHpUZRYhB"],"enrUri":"enr:-L24QPLffRQW6lqV07q2xEp0ChygIcy7uocTNGS40pIL93WVQVtT09DI24ki5V9ZiOwBGzZTL_VnAieufWT_3qU3OEsCgmlkgnY0gmlwhKwS71eKbXVsdGlhZGRyc5YACASsEu9XBnThAAoErBLvVwZ04t0DgnJzhQADAQAAiXNlY3AyNTZrMaECggr91A35iVagF7DsOc2IfXufk21bvw4BP3923KcJCdaDdGNwgnThg3VkcIJ044V3YWt1MgA"}'
2025-12-18 04:10:27.722 INFO [src.node.waku_node] REST service is ready !!
2025-12-18 04:10:27.722 DEBUG [src.node.waku_node] Starting Node...
2025-12-18 04:10:27.722 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-18 04:10:27.724 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-18 04:10:27.724 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.193.41
2025-12-18 04:10:27.724 DEBUG [src.node.docker_mananger] Generated ports ['21937', '21938', '21939', '21940', '21941']
2025-12-18 04:10:27.724 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-18 04:10:27.724 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-18 04:10:27.724 DEBUG [src.node.waku_node] Using volumes []
2025-12-18 04:10:27.724 DEBUG [src.node.docker_mananger] docker run -i -t -p 21937:21937 -p 21938:21938 -p 21939:21939 -p 21940:21940 -p 21941:21941 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=21939 --rest-port=21937 --tcp-port=21938 --discv5-udp-port=21940 --rest-address=0.0.0.0 --nat=extip:172.18.193.41 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=5b63d3ed570bf03e528f2ea15b775c5edee6ace1a03c7aac0e57ed7d0cddaaaf --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=21941 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QPLffRQW6lqV07q2xEp0ChygIcy7uocTNGS40pIL93WVQVtT09DI24ki5V9ZiOwBGzZTL_VnAieufWT_3qU3OEsCgmlkgnY0gmlwhKwS71eKbXVsdGlhZGRyc5YACASsEu9XBnThAAoErBLvVwZ04t0DgnJzhQADAQAAiXNlY3AyNTZrMaECggr91A35iVagF7DsOc2IfXufk21bvw4BP3923KcJCdaDdGNwgnThg3VkcIJ044V3YWt1MgA
2025-12-18 04:10:27.921 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.193.41 waku 39ac476b571f5dc73abcefd5d0e220d89a7090b3c8efb6cc623d88f7e5d6b93a
2025-12-18 04:10:27.951 DEBUG [src.node.docker_mananger] Container started with ID 39ac476b571f. Setting up logs at ./log/docker/node3_2025-12-18_04-10-23__29dea090-0fb3-4c0d-9821-e2297100c8f6__wakuorg_nwaku:latest.log
2025-12-18 04:10:27.951 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 21937
2025-12-18 04:10:27.952 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-18 04:10:28.953 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21937/health" -H "Content-Type: application/json" -d 'None'
2025-12-18 04:10:28.956 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-18 04:10:28.957 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-18 04:10:28.957 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21937/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-18 04:10:28.959 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.193.41/tcp/21938/p2p/16Uiu2HAm57d9k3w1h9KYSEy7VFrKHbjsH34X3b7KWRigsDvsgV4X","/ip4/172.18.193.41/tcp/21939/ws/p2p/16Uiu2HAm57d9k3w1h9KYSEy7VFrKHbjsH34X3b7KWRigsDvsgV4X"],"enrUri":"enr:-L24QDMbS40iYGUvChMX4Z9Ek9neW8RgRPhV3Iu_1hAW90QRXGxkiubT-an9cHkJaB3GnI4D_k3rcLnJXYedLcjdVqMCgmlkgnY0gmlwhKwSwSmKbXVsdGlhZGRyc5YACASsEsEpBlWyAAoErBLBKQZVs90DgnJzhQADAQAAiXNlY3AyNTZrMaECj_U3cCGk6EeLUtt4EcOH2gEOk9EScKKKF14hDh4f5RSDdGNwglWyg3VkcIJVtIV3YWt1MgA"}'
2025-12-18 04:10:28.959 INFO [src.node.waku_node] REST service is ready !!
2025-12-18 04:10:28.959 DEBUG [src.node.waku_node] Starting Node...
2025-12-18 04:10:28.960 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-18 04:10:28.961 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-18 04:10:28.961 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.122.154
2025-12-18 04:10:28.961 DEBUG [src.node.docker_mananger] Generated ports ['40321', '40322', '40323', '40324', '40325']
2025-12-18 04:10:28.961 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-18 04:10:28.962 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-18 04:10:28.962 DEBUG [src.node.waku_node] Using volumes []
2025-12-18 04:10:28.962 DEBUG [src.node.docker_mananger] docker run -i -t -p 40321:40321 -p 40322:40322 -p 40323:40323 -p 40324:40324 -p 40325:40325 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=40323 --rest-port=40321 --tcp-port=40322 --discv5-udp-port=40324 --rest-address=0.0.0.0 --nat=extip:172.18.122.154 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=da97c3d8d5e7c8a2afdfa334ac64eb7caff2d5d40a1daefd334c59b9f9de7e4e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=40325 --metrics-logging=true --relay=true --store=false --discv5-bootstrap-node=enr:-L24QDMbS40iYGUvChMX4Z9Ek9neW8RgRPhV3Iu_1hAW90QRXGxkiubT-an9cHkJaB3GnI4D_k3rcLnJXYedLcjdVqMCgmlkgnY0gmlwhKwSwSmKbXVsdGlhZGRyc5YACASsEsEpBlWyAAoErBLBKQZVs90DgnJzhQADAQAAiXNlY3AyNTZrMaECj_U3cCGk6EeLUtt4EcOH2gEOk9EScKKKF14hDh4f5RSDdGNwglWyg3VkcIJVtIV3YWt1MgA
2025-12-18 04:10:29.143 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.122.154 waku 723e506aa65bea8c7896d47d63a04bc3d42778562e7711559bce3cf843eb2b5e
2025-12-18 04:10:29.173 DEBUG [src.node.docker_mananger] Container started with ID 723e506aa65b. Setting up logs at ./log/docker/node3_2025-12-18_04-10-23__29dea090-0fb3-4c0d-9821-e2297100c8f6__wakuorg_nwaku:latest.log
2025-12-18 04:10:29.173 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 40321
2025-12-18 04:10:29.173 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-18 04:10:30.174 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40321/health" -H "Content-Type: application/json" -d 'None'
2025-12-18 04:10:30.188 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-18 04:10:30.188 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-18 04:10:30.190 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40321/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-18 04:10:30.198 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.122.154/tcp/40322/p2p/16Uiu2HAmKjCf4ekTajL8JzoYTuHyYeovGWhARvvYRW4oVyjKSAsW","/ip4/172.18.122.154/tcp/40323/ws/p2p/16Uiu2HAmKjCf4ekTajL8JzoYTuHyYeovGWhARvvYRW4oVyjKSAsW"],"enrUri":"enr:-L24QD6xikxRu91fmf-wg_C0zmS5Y9gnvpF-1yIq_jqIeLXoA0ehQG7AyfkatHm7N8bi2MNa_BufzTth4eO1khbUT5gCgmlkgnY0gmlwhKwSepqKbXVsdGlhZGRyc5YACASsEnqaBp2CAAoErBJ6mgadg90DgnJzhQADAQAAiXNlY3AyNTZrMaEDaRYL8iuK6xzK-BZc18jwaJO6ac8_kBlXQSgtXn4l6v2DdGNwgp2Cg3VkcIKdhIV3YWt1MgE"}'
2025-12-18 04:10:30.200 INFO [src.node.waku_node] REST service is ready !!
2025-12-18 04:10:30.201 DEBUG [src.node.waku_node] Starting Node...
2025-12-18 04:10:30.201 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-18 04:10:30.202 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-18 04:10:30.202 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.168.45
2025-12-18 04:10:30.203 DEBUG [src.node.docker_mananger] Generated ports ['20069', '20070', '20071', '20072', '20073']
2025-12-18 04:10:30.203 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-18 04:10:30.203 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-18 04:10:30.203 DEBUG [src.node.waku_node] Using volumes []
2025-12-18 04:10:30.203 DEBUG [src.node.docker_mananger] docker run -i -t -p 20069:20069 -p 20070:20070 -p 20071:20071 -p 20072:20072 -p 20073:20073 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=20071 --rest-port=20069 --tcp-port=20070 --discv5-udp-port=20072 --rest-address=0.0.0.0 --nat=extip:172.18.168.45 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=2e730abd4be0cababbdf6c08af9bf0bc9dd8aebaa9febfedbb9cfbf38a36bdaa --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=20073 --metrics-logging=true --relay=false --store=false --discv5-bootstrap-node=enr:-L24QD6xikxRu91fmf-wg_C0zmS5Y9gnvpF-1yIq_jqIeLXoA0ehQG7AyfkatHm7N8bi2MNa_BufzTth4eO1khbUT5gCgmlkgnY0gmlwhKwSepqKbXVsdGlhZGRyc5YACASsEnqaBp2CAAoErBJ6mgadg90DgnJzhQADAQAAiXNlY3AyNTZrMaEDaRYL8iuK6xzK-BZc18jwaJO6ac8_kBlXQSgtXn4l6v2DdGNwgp2Cg3VkcIKdhIV3YWt1MgE
2025-12-18 04:10:30.388 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.168.45 waku 4e07082e1843c8cb02a410a0c5e249593778848d4628026358eff4627a3e3259
2025-12-18 04:10:30.420 DEBUG [src.node.docker_mananger] Container started with ID 4e07082e1843. Setting up logs at ./log/docker/node4_2025-12-18_04-10-23__29dea090-0fb3-4c0d-9821-e2297100c8f6__wakuorg_nwaku:latest.log
2025-12-18 04:10:30.421 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 20069
2025-12-18 04:10:30.421 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-18 04:10:31.421 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20069/health" -H "Content-Type: application/json" -d 'None'
2025-12-18 04:10:31.425 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-18 04:10:31.425 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-18 04:10:31.426 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20069/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-18 04:10:31.428 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.168.45/tcp/20070/p2p/16Uiu2HAmPVALjom9DcnDUMhzwJoVfCxERAxVm3oYJ9qFBVsd3EUh","/ip4/172.18.168.45/tcp/20071/ws/p2p/16Uiu2HAmPVALjom9DcnDUMhzwJoVfCxERAxVm3oYJ9qFBVsd3EUh"],"enrUri":"enr:-L24QFUEVqulj4ZxLU6U2vAOFvSIkF-DKv4I-D5WgHeyYbVzSiOQbB1pge655s9BBIlhHkLD98fuAvzR7ap3rXpAX_YCgmlkgnY0gmlwhKwSqC2KbXVsdGlhZGRyc5YACASsEqgtBk5mAAoErBKoLQZOZ90DgnJzhQADAQAAiXNlY3AyNTZrMaEDoOwLXVgxmgQ0et7vcBU-hI5I021--HFsee4nGWDO8uqDdGNwgk5mg3VkcIJOaIV3YWt1MgA"}'
2025-12-18 04:10:31.428 INFO [src.node.waku_node] REST service is ready !!
2025-12-18 04:10:31.428 DEBUG [tests.e2e.test_e2e] Add 3 peer nodes to node3
2025-12-18 04:10:31.429 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21937/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.22.248/tcp/50442/p2p/16Uiu2HAmM2b1K9HE4vZUYqaCHpxGBAgAFtaVAAhKU6S58VjvwJDo"]'
2025-12-18 04:10:31.447 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-18 04:10:31.447 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21937/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.239.87/tcp/29921/p2p/16Uiu2HAm4BJheecbQq8PusK815RNmtTAdPiP4UScAXjBHpUZRYhB"]'
2025-12-18 04:10:31.465 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-18 04:10:31.465 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21937/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.122.154/tcp/40322/p2p/16Uiu2HAmKjCf4ekTajL8JzoYTuHyYeovGWhARvvYRW4oVyjKSAsW"]'
2025-12-18 04:10:31.475 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-18 04:10:31.475 DEBUG [tests.e2e.test_e2e] Subscribe nodes 1,2 to relay on pubsubtopic /waku/2/rs/3/1
2025-12-18 04:10:31.478 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:40321/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2025-12-18 04:10:31.482 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-18 04:10:31.482 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50441/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2025-12-18 04:10:31.488 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-18 04:10:31.489 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50441/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2025-12-18 04:10:31.494 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.193.41/tcp/36448/p2p/16Uiu2HAm57d9k3w1h9KYSEy7VFrKHbjsH34X3b7KWRigsDvsgV4X","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[],"connected":"Connected","agent":"nwaku-v0.36.0-119-gbc5059","origin":"UnknownOrigin"}]'
2025-12-18 04:10:31.495 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40321/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2025-12-18 04:10:31.497 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.193.41/tcp/21938/p2p/16Uiu2HAm57d9k3w1h9KYSEy7VFrKHbjsH34X3b7KWRigsDvsgV4X","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-119-gbc5059","origin":"Discv5"}]'
2025-12-18 04:10:31.498 DEBUG [src.libs.common] Sleeping for 30 seconds
2025-12-18 04:11:01.498 DEBUG [tests.e2e.test_e2e] Node1 publish message
2025-12-18 04:11:01.499 DEBUG [src.steps.store] Relaying message
2025-12-18 04:11:01.499 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:40321/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2025-12-18 04:11:01.504 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-18 04:11:01.504 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-18 04:11:01.705 DEBUG [tests.e2e.test_e2e] Check if node3 can inquiry stored message without stor peer specified
2025-12-18 04:11:01.705 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21937/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F1&contentTopics=%2Ftest%2F1%2Fwaku-filter%2Fproto&pageSize=5&ascending=true" -H "Content-Type: application/json" -d 'None'
2025-12-18 04:11:01.714 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"7694ccf233d5475d492c","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x1de6f0bf9b665f51c8668ba930c7b5d8a85943deab8a6563b772c53bf33353dd"}]}'
2025-12-18 04:11:01.716 DEBUG [tests.conftest] Running fixture teardown: test_setup
2025-12-18 04:11:01.716 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2025-12-18 04:11:01.717 DEBUG [src.node.waku_node] Stopping container with id 334830ed833b
2025-12-18 04:11:02.309 DEBUG [src.node.waku_node] Container stopped.
2025-12-18 04:11:02.309 DEBUG [src.node.waku_node] Stopping container with id 65a40cc59e93
2025-12-18 04:11:02.849 DEBUG [src.node.waku_node] Container stopped.
2025-12-18 04:11:02.851 DEBUG [src.node.waku_node] Stopping container with id 39ac476b571f
2025-12-18 04:11:03.192 ERROR [src.node.docker_mananger] Max retries reached for container 334830ed833b. Exiting log stream.
2025-12-18 04:11:03.367 DEBUG [src.node.waku_node] Container stopped.
2025-12-18 04:11:03.368 DEBUG [src.node.waku_node] Stopping container with id 723e506aa65b
2025-12-18 04:11:03.706 ERROR [src.node.docker_mananger] Max retries reached for container 65a40cc59e93. Exiting log stream.
2025-12-18 04:11:03.889 DEBUG [src.node.waku_node] Container stopped.
2025-12-18 04:11:03.891 DEBUG [src.node.waku_node] Stopping container with id 4e07082e1843
2025-12-18 04:11:04.179 ERROR [src.node.docker_mananger] Max retries reached for container 39ac476b571f. Exiting log stream.
2025-12-18 04:11:04.398 DEBUG [src.node.waku_node] Container stopped.
2025-12-18 04:11:04.400 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2025-12-18 04:11:04.438 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-18 04:11:04.457 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-18 04:11:04.493 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-18 04:11:04.529 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-18 04:11:04.531 DEBUG [src.node.docker_mananger] No errors found in the waku logs.