201 lines
40 KiB
Plaintext

2026-03-03 04:32:40.092 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-03 04:32:40.093 DEBUG [tests.conftest] Running test: test_store_filter_interaction_with_six_nodes with id: 2026-03-03_04-32-40__b29cb860-7206-4b65-a859-790d4736bdd6
2026-03-03 04:32:40.093 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-03 04:32:40.093 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-03 04:32:40.094 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-03 04:32:40.102 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:32:40.102 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-03_04-32-40__b29cb860-7206-4b65-a859-790d4736bdd6__wakuorg_nwaku:latest.log
2026-03-03 04:32:40.109 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:32:40.109 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-03_04-32-40__b29cb860-7206-4b65-a859-790d4736bdd6__wakuorg_nwaku:latest.log
2026-03-03 04:32:40.115 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:32:40.116 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-03_04-32-40__b29cb860-7206-4b65-a859-790d4736bdd6__wakuorg_nwaku:latest.log
2026-03-03 04:32:40.116 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-03 04:32:40.116 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-03 04:32:40.117 DEBUG [tests.e2e.test_e2e] Create 6 nodes
2026-03-03 04:32:40.123 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:32:40.123 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-03_04-32-40__b29cb860-7206-4b65-a859-790d4736bdd6__wakuorg_nwaku:latest.log
2026-03-03 04:32:40.129 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:32:40.129 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-03_04-32-40__b29cb860-7206-4b65-a859-790d4736bdd6__wakuorg_nwaku:latest.log
2026-03-03 04:32:40.134 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:32:40.134 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node6_2026-03-03_04-32-40__b29cb860-7206-4b65-a859-790d4736bdd6__wakuorg_nwaku:latest.log
2026-03-03 04:32:40.135 DEBUG [tests.e2e.test_e2e] Start 5 nodes with their corresponding config
2026-03-03 04:32:40.135 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:32:40.135 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:32:40.179 DEBUG [src.node.docker_mananger] Network waku created
2026-03-03 04:32:40.179 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.90.232
2026-03-03 04:32:40.179 DEBUG [src.node.docker_mananger] Generated ports ['13983', '13984', '13985', '13986', '13987']
2026-03-03 04:32:40.179 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:32:40.179 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:32:40.180 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:32:40.180 DEBUG [src.node.docker_mananger] docker run -i -t -p 13983:13983 -p 13984:13984 -p 13985:13985 -p 13986:13986 -p 13987:13987 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13985 --rest-port=13983 --tcp-port=13984 --discv5-udp-port=13986 --rest-address=0.0.0.0 --nat=extip:172.18.90.232 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=2f59b12fe8ea6d4e90818de2a9be5cd065fdeff91770abf5bbe4b995cbaef7ca --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13987 --metrics-logging=true --relay=true --store=true
2026-03-03 04:32:43.886 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.90.232 waku e7ca14cd9cd522718e0bf99fe5e4eaf7f76521ed5bf7fedaa2d881f7b39c6964
2026-03-03 04:32:43.921 DEBUG [src.node.docker_mananger] Container started with ID e7ca14cd9cd5. Setting up logs at ./log/docker/node1_2026-03-03_04-32-40__b29cb860-7206-4b65-a859-790d4736bdd6__wakuorg_nwaku:latest.log
2026-03-03 04:32:43.922 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 13983
2026-03-03 04:32:43.922 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:32:44.923 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13983/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:32:44.926 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:32:44.926 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:32:44.926 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13983/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:32:44.929 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.90.232/tcp/13984/p2p/16Uiu2HAm9oT25qb85DqYixddd4VqkZFLzq8iRTYLgVndVMSivLBA","/ip4/172.18.90.232/tcp/13985/ws/p2p/16Uiu2HAm9oT25qb85DqYixddd4VqkZFLzq8iRTYLgVndVMSivLBA"],"enrUri":"enr:-L24QOrDLe8j0wul5AQ7VE64u75ed9zRdzYHzoJJWf26xlGCAnPcY96GqppvkkghcsgbV9eeLdZkrm28az90nLuO6gICgmlkgnY0gmlwhKwSWuiKbXVsdGlhZGRyc5YACASsElroBjagAAoErBJa6AY2od0DgnJzhQADAQAAiXNlY3AyNTZrMaEC1Ze9guneE6GKHKpnrHIUxWvBBLc_ftrsv17Tfq6Li3GDdGNwgjagg3VkcII2ooV3YWt1MgM"}'
2026-03-03 04:32:44.929 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:32:44.929 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:32:44.929 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:32:44.931 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:32:44.931 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.213.246
2026-03-03 04:32:44.931 DEBUG [src.node.docker_mananger] Generated ports ['25396', '25397', '25398', '25399', '25400']
2026-03-03 04:32:44.931 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:32:44.931 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:32:44.932 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:32:44.932 DEBUG [src.node.docker_mananger] docker run -i -t -p 25396:25396 -p 25397:25397 -p 25398:25398 -p 25399:25399 -p 25400:25400 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=25398 --rest-port=25396 --tcp-port=25397 --discv5-udp-port=25399 --rest-address=0.0.0.0 --nat=extip:172.18.213.246 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=eb93e4b0f9bd8138f61b4348ad3104df1a3152dcfb52fe13dfd10acb50a17d28 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=25400 --metrics-logging=true --relay=true --store=true --discv5-bootstrap-node=enr:-L24QOrDLe8j0wul5AQ7VE64u75ed9zRdzYHzoJJWf26xlGCAnPcY96GqppvkkghcsgbV9eeLdZkrm28az90nLuO6gICgmlkgnY0gmlwhKwSWuiKbXVsdGlhZGRyc5YACASsElroBjagAAoErBJa6AY2od0DgnJzhQADAQAAiXNlY3AyNTZrMaEC1Ze9guneE6GKHKpnrHIUxWvBBLc_ftrsv17Tfq6Li3GDdGNwgjagg3VkcII2ooV3YWt1MgM
2026-03-03 04:32:45.140 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.213.246 waku 19b5c7545dda9e6ab9f18209a1edc6e65d8ccfd13e3d6783a8c668bb6f185a8b
2026-03-03 04:32:45.178 DEBUG [src.node.docker_mananger] Container started with ID 19b5c7545dda. Setting up logs at ./log/docker/node2_2026-03-03_04-32-40__b29cb860-7206-4b65-a859-790d4736bdd6__wakuorg_nwaku:latest.log
2026-03-03 04:32:45.179 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 25396
2026-03-03 04:32:45.179 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:32:46.179 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25396/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:32:46.182 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:32:46.183 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:32:46.183 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25396/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:32:46.185 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.213.246/tcp/25397/p2p/16Uiu2HAm6xX1HXN5YTdpGyS4wg3edQFZVFQ7vmsQLyUwMUu1fj2A","/ip4/172.18.213.246/tcp/25398/ws/p2p/16Uiu2HAm6xX1HXN5YTdpGyS4wg3edQFZVFQ7vmsQLyUwMUu1fj2A"],"enrUri":"enr:-L24QLmeLMWao0iQxtY-JwjzH9Gcl9IYU00CJzVwNRc4ccpfB9wynAd0rqvlYfmPzL21gGrU_Sh0ocCq9BAlWKlqpHsCgmlkgnY0gmlwhKwS1faKbXVsdGlhZGRyc5YACASsEtX2BmM1AAoErBLV9gZjNt0DgnJzhQADAQAAiXNlY3AyNTZrMaECq1dp_cpsy4YBSd6xdXPUiMA5S-_ENvxu-XkHg0xjZVuDdGNwgmM1g3VkcIJjN4V3YWt1MgM"}'
2026-03-03 04:32:46.185 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:32:46.186 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:32:46.186 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:32:46.187 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:32:46.187 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.39.188
2026-03-03 04:32:46.188 DEBUG [src.node.docker_mananger] Generated ports ['31063', '31064', '31065', '31066', '31067']
2026-03-03 04:32:46.188 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:32:46.188 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:32:46.188 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:32:46.188 DEBUG [src.node.docker_mananger] docker run -i -t -p 31063:31063 -p 31064:31064 -p 31065:31065 -p 31066:31066 -p 31067:31067 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=31065 --rest-port=31063 --tcp-port=31064 --discv5-udp-port=31066 --rest-address=0.0.0.0 --nat=extip:172.18.39.188 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=916771b29de1f39eebbba4ab8d292b76e545b9c11f7e25bfead7f3b5023e2d29 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=31067 --metrics-logging=true --relay=true --store=true --discv5-bootstrap-node=enr:-L24QLmeLMWao0iQxtY-JwjzH9Gcl9IYU00CJzVwNRc4ccpfB9wynAd0rqvlYfmPzL21gGrU_Sh0ocCq9BAlWKlqpHsCgmlkgnY0gmlwhKwS1faKbXVsdGlhZGRyc5YACASsEtX2BmM1AAoErBLV9gZjNt0DgnJzhQADAQAAiXNlY3AyNTZrMaECq1dp_cpsy4YBSd6xdXPUiMA5S-_ENvxu-XkHg0xjZVuDdGNwgmM1g3VkcIJjN4V3YWt1MgM
2026-03-03 04:32:46.409 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.39.188 waku 0d440381842d6f2e3e9ade5ca01db3a12a4ada5cd3d6d2e18fac929c656ef83e
2026-03-03 04:32:46.444 DEBUG [src.node.docker_mananger] Container started with ID 0d440381842d. Setting up logs at ./log/docker/node3_2026-03-03_04-32-40__b29cb860-7206-4b65-a859-790d4736bdd6__wakuorg_nwaku:latest.log
2026-03-03 04:32:46.444 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 31063
2026-03-03 04:32:46.446 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:32:47.447 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31063/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:32:47.449 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:32:47.450 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:32:47.450 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31063/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:32:47.452 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.39.188/tcp/31064/p2p/16Uiu2HAmHiE7Ny9xk5mwMMYSyTEmUJHg2nMuE31SjVi9Uzdfjekd","/ip4/172.18.39.188/tcp/31065/ws/p2p/16Uiu2HAmHiE7Ny9xk5mwMMYSyTEmUJHg2nMuE31SjVi9Uzdfjekd"],"enrUri":"enr:-L24QAIqhofDt9iAGl1oOKGER9f91iOjr-xgFx2PUHLufJCfFZA0-Qhfz2N155R6iKkkhUYctuj3qyYK3vtayL5mbzMCgmlkgnY0gmlwhKwSJ7yKbXVsdGlhZGRyc5YACASsEie8BnlYAAoErBInvAZ5Wd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDSx68WMiXga-UR1f2BmlZy9_umhlptjqzKW6fGhI1V0aDdGNwgnlYg3VkcIJ5WoV3YWt1MgM"}'
2026-03-03 04:32:47.452 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:32:47.453 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:32:47.453 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:32:47.454 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:32:47.454 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.126.165
2026-03-03 04:32:47.454 DEBUG [src.node.docker_mananger] Generated ports ['60730', '60731', '60732', '60733', '60734']
2026-03-03 04:32:47.455 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:32:47.455 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:32:47.455 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:32:47.455 DEBUG [src.node.docker_mananger] docker run -i -t -p 60730:60730 -p 60731:60731 -p 60732:60732 -p 60733:60733 -p 60734:60734 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=60732 --rest-port=60730 --tcp-port=60731 --discv5-udp-port=60733 --rest-address=0.0.0.0 --nat=extip:172.18.126.165 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ffb33e77fd2c1b90d1adc4ef17754f1b9a869b5b1feed73f4ffc280ae38bb1c5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=60734 --metrics-logging=true --relay=true --filter=true --store=true --discv5-bootstrap-node=enr:-L24QAIqhofDt9iAGl1oOKGER9f91iOjr-xgFx2PUHLufJCfFZA0-Qhfz2N155R6iKkkhUYctuj3qyYK3vtayL5mbzMCgmlkgnY0gmlwhKwSJ7yKbXVsdGlhZGRyc5YACASsEie8BnlYAAoErBInvAZ5Wd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDSx68WMiXga-UR1f2BmlZy9_umhlptjqzKW6fGhI1V0aDdGNwgnlYg3VkcIJ5WoV3YWt1MgM
2026-03-03 04:32:47.674 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.126.165 waku 90b9fa1605381dacae1d0d6bfb866076dff9a14ee92efa019e1215693489d290
2026-03-03 04:32:47.709 DEBUG [src.node.docker_mananger] Container started with ID 90b9fa160538. Setting up logs at ./log/docker/node4_2026-03-03_04-32-40__b29cb860-7206-4b65-a859-790d4736bdd6__wakuorg_nwaku:latest.log
2026-03-03 04:32:47.710 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 60730
2026-03-03 04:32:47.710 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:32:48.710 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60730/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:32:48.714 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:32:48.714 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:32:48.714 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60730/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:32:48.717 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.126.165/tcp/60731/p2p/16Uiu2HAkzqFFoFnfhEF2516KbZtMw2dHAj3Z1NWq8A3zMSoyNRgn","/ip4/172.18.126.165/tcp/60732/ws/p2p/16Uiu2HAkzqFFoFnfhEF2516KbZtMw2dHAj3Z1NWq8A3zMSoyNRgn"],"enrUri":"enr:-L24QDWW9189cUcZNGggswZH1ff-zPHzFQk3DCA2BSTePFHtJ0d2hWcEJ7VxVtudGW9NulbiusNvMaHFeyj7awp5Oe4CgmlkgnY0gmlwhKwSfqWKbXVsdGlhZGRyc5YACASsEn6lBu07AAoErBJ-pQbtPN0DgnJzhQADAQAAiXNlY3AyNTZrMaECUFRrIO4u14EpBuytIEy_qhrK_cxwCme80faL3ziPXyuDdGNwgu07g3VkcILtPYV3YWt1Mgc"}'
2026-03-03 04:32:48.717 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:32:48.717 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:32:48.717 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:32:48.719 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:32:48.719 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.98.28
2026-03-03 04:32:48.719 DEBUG [src.node.docker_mananger] Generated ports ['15795', '15796', '15797', '15798', '15799']
2026-03-03 04:32:48.719 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:32:48.719 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:32:48.719 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:32:48.719 DEBUG [src.node.docker_mananger] docker run -i -t -p 15795:15795 -p 15796:15796 -p 15797:15797 -p 15798:15798 -p 15799:15799 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=15797 --rest-port=15795 --tcp-port=15796 --discv5-udp-port=15798 --rest-address=0.0.0.0 --nat=extip:172.18.98.28 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=02decdf8afe82abab5af87f428ff172dda57f2bacbb25967daa60f8ec3d25b55 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=15799 --metrics-logging=true --relay=false --filternode=/ip4/172.18.126.165/tcp/60731/p2p/16Uiu2HAkzqFFoFnfhEF2516KbZtMw2dHAj3Z1NWq8A3zMSoyNRgn --discv5-bootstrap-node=enr:-L24QDWW9189cUcZNGggswZH1ff-zPHzFQk3DCA2BSTePFHtJ0d2hWcEJ7VxVtudGW9NulbiusNvMaHFeyj7awp5Oe4CgmlkgnY0gmlwhKwSfqWKbXVsdGlhZGRyc5YACASsEn6lBu07AAoErBJ-pQbtPN0DgnJzhQADAQAAiXNlY3AyNTZrMaECUFRrIO4u14EpBuytIEy_qhrK_cxwCme80faL3ziPXyuDdGNwgu07g3VkcILtPYV3YWt1Mgc
2026-03-03 04:32:48.939 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.98.28 waku 11937be9a33288384c60084904ae38918327ace16dc1c0f9751bbcb76973e607
2026-03-03 04:32:48.972 DEBUG [src.node.docker_mananger] Container started with ID 11937be9a332. Setting up logs at ./log/docker/node6_2026-03-03_04-32-40__b29cb860-7206-4b65-a859-790d4736bdd6__wakuorg_nwaku:latest.log
2026-03-03 04:32:48.973 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 15795
2026-03-03 04:32:48.973 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:32:49.974 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15795/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:32:49.977 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:32:49.977 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:32:49.978 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15795/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:32:49.980 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.98.28/tcp/15796/p2p/16Uiu2HAmLhmPzfbLuE8ctLgax8y1Xn1ZzDsLR6K33UgQAZxs4Ao5","/ip4/172.18.98.28/tcp/15797/ws/p2p/16Uiu2HAmLhmPzfbLuE8ctLgax8y1Xn1ZzDsLR6K33UgQAZxs4Ao5"],"enrUri":"enr:-L24QKFqbfMpAeT7aHtBqRPIQbfC1-9Awlw5Xm51-BujEOUpNEExv06_VC1XH9wI_NeP74aF_OLgWtEOdTuzKRks7M0CgmlkgnY0gmlwhKwSYhyKbXVsdGlhZGRyc5YACASsEmIcBj20AAoErBJiHAY9td0DgnJzhQADAQAAiXNlY3AyNTZrMaEDd5OXZ9aQTlI9RN6RYEHTppP_g4ThvOWHUcQawxrP0SyDdGNwgj20g3VkcII9toV3YWt1MgA"}'
2026-03-03 04:32:49.980 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:32:49.980 DEBUG [tests.e2e.test_e2e] Subscribe nodes to relay pubsub topics
2026-03-03 04:32:49.980 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13983/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-03 04:32:49.985 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:32:49.985 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:25396/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-03 04:32:49.993 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:32:49.993 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31063/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-03 04:32:50.001 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:32:50.001 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60730/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-03 04:32:50.009 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:32:50.011 DEBUG [tests.e2e.test_e2e] Node6 subscribe to filter for pubsubtopic /waku/2/rs/3/1
2026-03-03 04:32:50.011 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:15795/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-03 04:32:50.055 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-03-03 04:32:50.056 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13983/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:32:50.064 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.213.246/tcp/47642/p2p/16Uiu2HAm6xX1HXN5YTdpGyS4wg3edQFZVFQ7vmsQLyUwMUu1fj2A","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
2026-03-03 04:32:50.064 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25396/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:32:50.071 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.90.232/tcp/13984/p2p/16Uiu2HAm9oT25qb85DqYixddd4VqkZFLzq8iRTYLgVndVMSivLBA","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"},{"multiaddr":"/ip4/172.18.39.188/tcp/51164/p2p/16Uiu2HAmHiE7Ny9xk5mwMMYSyTEmUJHg2nMuE31SjVi9Uzdfjekd","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"}]'
2026-03-03 04:32:50.071 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31063/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:32:50.076 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.126.165/tcp/58094/p2p/16Uiu2HAkzqFFoFnfhEF2516KbZtMw2dHAj3Z1NWq8A3zMSoyNRgn","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.213.246/tcp/25397/p2p/16Uiu2HAm6xX1HXN5YTdpGyS4wg3edQFZVFQ7vmsQLyUwMUu1fj2A","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
2026-03-03 04:32:50.076 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60730/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:32:50.079 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.39.188/tcp/31064/p2p/16Uiu2HAmHiE7Ny9xk5mwMMYSyTEmUJHg2nMuE31SjVi9Uzdfjekd","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"},{"multiaddr":"/ip4/172.18.98.28/tcp/35360/p2p/16Uiu2HAmLhmPzfbLuE8ctLgax8y1Xn1ZzDsLR6K33UgQAZxs4Ao5","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"}]'
2026-03-03 04:32:50.079 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15795/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:32:50.081 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.126.165/tcp/60731/p2p/16Uiu2HAkzqFFoFnfhEF2516KbZtMw2dHAj3Z1NWq8A3zMSoyNRgn","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0,1],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
2026-03-03 04:32:50.082 DEBUG [src.libs.common] Sleeping for 50 seconds
2026-03-03 04:33:40.082 DEBUG [tests.e2e.test_e2e] Node1 publish message for topic /waku/2/rs/3/1
2026-03-03 04:33:40.083 DEBUG [src.steps.store] Relaying message
2026-03-03 04:33:40.083 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13983/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:33:40.096 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:33:40.097 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-03 04:33:40.302 DEBUG [src.libs.common] Sleeping for 4 seconds
2026-03-03 04:33:44.302 DEBUG [tests.e2e.test_e2e] Node6 inquery for filter messages on pubsubtopic /waku/2/rs/3/1 & contenttopic/test/1/waku-filter/proto
2026-03-03 04:33:44.303 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15795/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:44.306 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772512420083023151,"ephemeral":false}]'
2026-03-03 04:33:44.306 DEBUG [tests.e2e.test_e2e] Filter inquiry response is [{'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772512420083023151, 'ephemeral': False}]
2026-03-03 04:33:44.306 DEBUG [tests.e2e.test_e2e] Node5 goes live !!
2026-03-03 04:33:44.306 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:33:44.307 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:33:44.308 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:33:44.308 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.228.190
2026-03-03 04:33:44.308 DEBUG [src.node.docker_mananger] Generated ports ['13303', '13304', '13305', '13306', '13307']
2026-03-03 04:33:44.309 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:33:44.309 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:33:44.309 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:33:44.309 DEBUG [src.node.docker_mananger] docker run -i -t -p 13303:13303 -p 13304:13304 -p 13305:13305 -p 13306:13306 -p 13307:13307 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13305 --rest-port=13303 --tcp-port=13304 --discv5-udp-port=13306 --rest-address=0.0.0.0 --nat=extip:172.18.228.190 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=becef4ade0eca8fc7eb0e06463f1a8399fa7cc94259f073dba5a7d3ccc0dac9f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13307 --metrics-logging=true --relay=false --storenode=/ip4/172.18.126.165/tcp/60731/p2p/16Uiu2HAkzqFFoFnfhEF2516KbZtMw2dHAj3Z1NWq8A3zMSoyNRgn --discv5-bootstrap-node=enr:-L24QDWW9189cUcZNGggswZH1ff-zPHzFQk3DCA2BSTePFHtJ0d2hWcEJ7VxVtudGW9NulbiusNvMaHFeyj7awp5Oe4CgmlkgnY0gmlwhKwSfqWKbXVsdGlhZGRyc5YACASsEn6lBu07AAoErBJ-pQbtPN0DgnJzhQADAQAAiXNlY3AyNTZrMaECUFRrIO4u14EpBuytIEy_qhrK_cxwCme80faL3ziPXyuDdGNwgu07g3VkcILtPYV3YWt1Mgc
2026-03-03 04:33:44.507 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.228.190 waku c123b96d13f6784829186b7bf529400714e99d43d141a382a8ab0606e27c862c
2026-03-03 04:33:44.541 DEBUG [src.node.docker_mananger] Container started with ID c123b96d13f6. Setting up logs at ./log/docker/node5_2026-03-03_04-32-40__b29cb860-7206-4b65-a859-790d4736bdd6__wakuorg_nwaku:latest.log
2026-03-03 04:33:44.542 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 13303
2026-03-03 04:33:44.542 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:33:45.543 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13303/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:45.546 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:33:45.546 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:33:45.547 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13303/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:45.549 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.228.190/tcp/13304/p2p/16Uiu2HAmGpUthMm67iwL968xw9am7p6LdPgj1TBS5f9mRpWtiQmH","/ip4/172.18.228.190/tcp/13305/ws/p2p/16Uiu2HAmGpUthMm67iwL968xw9am7p6LdPgj1TBS5f9mRpWtiQmH"],"enrUri":"enr:-L24QOKHuic2ZN_vZ5PlDoJEVb7MzyUBmPRQClD6lUHBejKKDaZl9NPu4rQPcPtF_ZsCVCX2hQeHCBPCTB2c4E9MmMECgmlkgnY0gmlwhKwS5L6KbXVsdGlhZGRyc5YACASsEuS-BjP4AAoErBLkvgYz-d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDPd0_OLxti-aU_aKnur318x86I6q81v6qiKTn31j5m7yDdGNwgjP4g3VkcIIz-oV3YWt1MgA"}'
2026-03-03 04:33:45.549 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:33:45.549 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-03 04:33:47.550 DEBUG [tests.e2e.test_e2e] Node5 makes request to get stored messages
2026-03-03 04:33:47.550 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-03 04:33:47.551 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13303/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F1&pageSize=50&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:33:47.596 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"4704db52375509064f50","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x00b72131d9d299940a0016e2281f50378deaa3d049c4a76ab9216a9cfa5cca67"}]}'
2026-03-03 04:33:47.597 DEBUG [src.steps.store] messages length is 1
2026-03-03 04:33:47.605 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-03 04:33:47.606 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-03 04:33:47.607 DEBUG [src.node.waku_node] Stopping container with id e7ca14cd9cd5
2026-03-03 04:33:48.201 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:33:48.201 DEBUG [src.node.waku_node] Stopping container with id 19b5c7545dda
2026-03-03 04:33:48.767 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:33:48.768 DEBUG [src.node.waku_node] Stopping container with id 0d440381842d
2026-03-03 04:33:49.185 ERROR [src.node.docker_mananger] Max retries reached for container e7ca14cd9cd5. Exiting log stream.
2026-03-03 04:33:49.302 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:33:49.302 DEBUG [src.node.waku_node] Stopping container with id 90b9fa160538
2026-03-03 04:33:49.581 ERROR [src.node.docker_mananger] Max retries reached for container 19b5c7545dda. Exiting log stream.
2026-03-03 04:33:49.855 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:33:49.855 DEBUG [src.node.waku_node] Stopping container with id 11937be9a332
2026-03-03 04:33:50.115 ERROR [src.node.docker_mananger] Max retries reached for container 0d440381842d. Exiting log stream.
2026-03-03 04:33:50.443 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:33:50.444 DEBUG [src.node.waku_node] Stopping container with id c123b96d13f6
2026-03-03 04:33:50.667 ERROR [src.node.docker_mananger] Max retries reached for container 90b9fa160538. Exiting log stream.
2026-03-03 04:33:50.981 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:33:50.982 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-03 04:33:51.077 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:33:51.130 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:33:51.177 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:33:51.242 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:33:51.259 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:33:51.262 DEBUG [src.node.docker_mananger] No errors found in the waku logs.