201 lines
41 KiB
Plaintext

2026-03-01 04:37:15.306 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-01 04:37:15.306 DEBUG [tests.conftest] Running test: test_store_filter_interaction_with_six_nodes with id: 2026-03-01_04-37-15__bbdf68fc-7b6c-40a9-b09d-82496b1c9e60
2026-03-01 04:37:15.307 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-01 04:37:15.307 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-01 04:37:15.307 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-01 04:37:15.316 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-01 04:37:15.316 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-01_04-37-15__bbdf68fc-7b6c-40a9-b09d-82496b1c9e60__wakuorg_nwaku:latest.log
2026-03-01 04:37:15.322 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-01 04:37:15.322 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-01_04-37-15__bbdf68fc-7b6c-40a9-b09d-82496b1c9e60__wakuorg_nwaku:latest.log
2026-03-01 04:37:15.329 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-01 04:37:15.329 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-01_04-37-15__bbdf68fc-7b6c-40a9-b09d-82496b1c9e60__wakuorg_nwaku:latest.log
2026-03-01 04:37:15.329 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-01 04:37:15.329 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-01 04:37:15.330 DEBUG [tests.e2e.test_e2e] Create 6 nodes
2026-03-01 04:37:15.336 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-01 04:37:15.336 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-01_04-37-15__bbdf68fc-7b6c-40a9-b09d-82496b1c9e60__wakuorg_nwaku:latest.log
2026-03-01 04:37:15.342 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-01 04:37:15.342 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-01_04-37-15__bbdf68fc-7b6c-40a9-b09d-82496b1c9e60__wakuorg_nwaku:latest.log
2026-03-01 04:37:15.348 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-01 04:37:15.348 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node6_2026-03-01_04-37-15__bbdf68fc-7b6c-40a9-b09d-82496b1c9e60__wakuorg_nwaku:latest.log
2026-03-01 04:37:15.348 DEBUG [tests.e2e.test_e2e] Start 5 nodes with their corresponding config
2026-03-01 04:37:15.348 DEBUG [src.node.waku_node] Starting Node...
2026-03-01 04:37:15.348 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-01 04:37:15.394 DEBUG [src.node.docker_mananger] Network waku created
2026-03-01 04:37:15.395 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.19.149
2026-03-01 04:37:15.395 DEBUG [src.node.docker_mananger] Generated ports ['8219', '8220', '8221', '8222', '8223']
2026-03-01 04:37:15.395 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-01 04:37:15.395 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-01 04:37:15.395 DEBUG [src.node.waku_node] Using volumes []
2026-03-01 04:37:15.395 DEBUG [src.node.docker_mananger] docker run -i -t -p 8219:8219 -p 8220:8220 -p 8221:8221 -p 8222:8222 -p 8223:8223 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=8221 --rest-port=8219 --tcp-port=8220 --discv5-udp-port=8222 --rest-address=0.0.0.0 --nat=extip:172.18.19.149 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=b4a2fdebec37223594ce966cbd46238c9febe8abd84817a04e85bd717d624fc5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=8223 --metrics-logging=true --relay=true --store=true
2026-03-01 04:37:18.947 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.19.149 waku b0be700dfae7dc569a8928a277532e01cfd930650ae5c7851f47199b3a5ee281
2026-03-01 04:37:18.983 DEBUG [src.node.docker_mananger] Container started with ID b0be700dfae7. Setting up logs at ./log/docker/node1_2026-03-01_04-37-15__bbdf68fc-7b6c-40a9-b09d-82496b1c9e60__wakuorg_nwaku:latest.log
2026-03-01 04:37:18.984 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 8219
2026-03-01 04:37:18.985 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-01 04:37:19.985 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8219/health" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:37:19.988 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-01 04:37:19.988 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-01 04:37:19.989 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8219/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:37:19.991 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.19.149/tcp/8220/p2p/16Uiu2HAmLssRMqLVD9AYFN2vnaLT7CuiJd8dkDvhhLVr9qbZ2MP9","/ip4/172.18.19.149/tcp/8221/ws/p2p/16Uiu2HAmLssRMqLVD9AYFN2vnaLT7CuiJd8dkDvhhLVr9qbZ2MP9"],"enrUri":"enr:-L24QAzKRjXzvJsMUubVGiyET_VmhpSxxV5jp3ldYuKIquxoMQmJULrNVv9qXDNgCli6j85ymtdEmBw8MYT5Ic5LJb8CgmlkgnY0gmlwhKwSE5WKbXVsdGlhZGRyc5YACASsEhOVBiAcAAoErBITlQYgHd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDeio12YaB9kzor3qNTFSG1Hqa9vye6xsyUMqiMzjJ_DyDdGNwgiAcg3VkcIIgHoV3YWt1MgM"}'
2026-03-01 04:37:19.991 INFO [src.node.waku_node] REST service is ready !!
2026-03-01 04:37:19.992 DEBUG [src.node.waku_node] Starting Node...
2026-03-01 04:37:19.992 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-01 04:37:19.993 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-01 04:37:19.993 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.7.144
2026-03-01 04:37:19.994 DEBUG [src.node.docker_mananger] Generated ports ['22966', '22967', '22968', '22969', '22970']
2026-03-01 04:37:19.994 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-01 04:37:19.994 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-01 04:37:19.994 DEBUG [src.node.waku_node] Using volumes []
2026-03-01 04:37:19.994 DEBUG [src.node.docker_mananger] docker run -i -t -p 22966:22966 -p 22967:22967 -p 22968:22968 -p 22969:22969 -p 22970:22970 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=22968 --rest-port=22966 --tcp-port=22967 --discv5-udp-port=22969 --rest-address=0.0.0.0 --nat=extip:172.18.7.144 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c240ffae4ccdd595db463d4a981f4ec11a3ee4d2add35ebdcdeb8a05da84ce83 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=22970 --metrics-logging=true --relay=true --store=true --discv5-bootstrap-node=enr:-L24QAzKRjXzvJsMUubVGiyET_VmhpSxxV5jp3ldYuKIquxoMQmJULrNVv9qXDNgCli6j85ymtdEmBw8MYT5Ic5LJb8CgmlkgnY0gmlwhKwSE5WKbXVsdGlhZGRyc5YACASsEhOVBiAcAAoErBITlQYgHd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDeio12YaB9kzor3qNTFSG1Hqa9vye6xsyUMqiMzjJ_DyDdGNwgiAcg3VkcIIgHoV3YWt1MgM
2026-03-01 04:37:20.185 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.7.144 waku f4f12cdc8cb23dab24b9fb6bbc37614accedf03dc784def4ae7bd2b4c20c5765
2026-03-01 04:37:20.222 DEBUG [src.node.docker_mananger] Container started with ID f4f12cdc8cb2. Setting up logs at ./log/docker/node2_2026-03-01_04-37-15__bbdf68fc-7b6c-40a9-b09d-82496b1c9e60__wakuorg_nwaku:latest.log
2026-03-01 04:37:20.222 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 22966
2026-03-01 04:37:20.224 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-01 04:37:21.224 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22966/health" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:37:21.227 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-01 04:37:21.227 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-01 04:37:21.228 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22966/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:37:21.230 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.7.144/tcp/22967/p2p/16Uiu2HAmCk4kqWi6M6ARYAx2gyeb7r4sZb8yjeWmh5WHMWeswTSU","/ip4/172.18.7.144/tcp/22968/ws/p2p/16Uiu2HAmCk4kqWi6M6ARYAx2gyeb7r4sZb8yjeWmh5WHMWeswTSU"],"enrUri":"enr:-L24QCZ3WNtsMpdNel7gOXWni53G5enKO-4BzC-7FQP0ZW-8HiDppxpH3WPL01269Fb0zjC2LLuXCUQEkDFXNl7WrGECgmlkgnY0gmlwhKwSB5CKbXVsdGlhZGRyc5YACASsEgeQBlm3AAoErBIHkAZZuN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDAUziyzC9dFdADEjgfIGioWg-NT5B2Gw3stQ2gnk7Jl2DdGNwglm3g3VkcIJZuYV3YWt1MgM"}'
2026-03-01 04:37:21.230 INFO [src.node.waku_node] REST service is ready !!
2026-03-01 04:37:21.230 DEBUG [src.node.waku_node] Starting Node...
2026-03-01 04:37:21.230 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-01 04:37:21.232 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-01 04:37:21.232 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.10.53
2026-03-01 04:37:21.232 DEBUG [src.node.docker_mananger] Generated ports ['37662', '37663', '37664', '37665', '37666']
2026-03-01 04:37:21.233 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-01 04:37:21.233 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-01 04:37:21.233 DEBUG [src.node.waku_node] Using volumes []
2026-03-01 04:37:21.233 DEBUG [src.node.docker_mananger] docker run -i -t -p 37662:37662 -p 37663:37663 -p 37664:37664 -p 37665:37665 -p 37666:37666 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=37664 --rest-port=37662 --tcp-port=37663 --discv5-udp-port=37665 --rest-address=0.0.0.0 --nat=extip:172.18.10.53 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fb54abaae2effd3fed0f008a03d2dd7eb3fcb6ef56c3cbb7a1bf9a17ddf26e3e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=37666 --metrics-logging=true --relay=true --store=true --discv5-bootstrap-node=enr:-L24QCZ3WNtsMpdNel7gOXWni53G5enKO-4BzC-7FQP0ZW-8HiDppxpH3WPL01269Fb0zjC2LLuXCUQEkDFXNl7WrGECgmlkgnY0gmlwhKwSB5CKbXVsdGlhZGRyc5YACASsEgeQBlm3AAoErBIHkAZZuN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDAUziyzC9dFdADEjgfIGioWg-NT5B2Gw3stQ2gnk7Jl2DdGNwglm3g3VkcIJZuYV3YWt1MgM
2026-03-01 04:37:21.469 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.10.53 waku dae2e30e163ef0b722cc63204f7278996c9199f57fc506d3dec9e222ab52eafe
2026-03-01 04:37:21.501 DEBUG [src.node.docker_mananger] Container started with ID dae2e30e163e. Setting up logs at ./log/docker/node3_2026-03-01_04-37-15__bbdf68fc-7b6c-40a9-b09d-82496b1c9e60__wakuorg_nwaku:latest.log
2026-03-01 04:37:21.502 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 37662
2026-03-01 04:37:21.502 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-01 04:37:22.503 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37662/health" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:37:22.506 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-01 04:37:22.506 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-01 04:37:22.506 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37662/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:37:22.509 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.10.53/tcp/37663/p2p/16Uiu2HAm4fYDi7oPt7c1krC6DDhQGoLYzJyoDFj2YGbsSp8nnkWm","/ip4/172.18.10.53/tcp/37664/ws/p2p/16Uiu2HAm4fYDi7oPt7c1krC6DDhQGoLYzJyoDFj2YGbsSp8nnkWm"],"enrUri":"enr:-L24QJ3XQZusUpvfrbu2dqNpzJR7NErpyk9xIH88gwtdjh8_XDY0tG98yG6V1Si7kd0IPRrByaZqPkox4kjnwpF-8x8CgmlkgnY0gmlwhKwSCjWKbXVsdGlhZGRyc5YACASsEgo1BpMfAAoErBIKNQaTIN0DgnJzhQADAQAAiXNlY3AyNTZrMaECiUaKEZBkOiu298_PQGXoM0PqDHQ0T5vNJqDYKN3VrkKDdGNwgpMfg3VkcIKTIYV3YWt1MgM"}'
2026-03-01 04:37:22.509 INFO [src.node.waku_node] REST service is ready !!
2026-03-01 04:37:22.509 DEBUG [src.node.waku_node] Starting Node...
2026-03-01 04:37:22.509 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-01 04:37:22.511 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-01 04:37:22.511 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.30.9
2026-03-01 04:37:22.511 DEBUG [src.node.docker_mananger] Generated ports ['47179', '47180', '47181', '47182', '47183']
2026-03-01 04:37:22.511 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-01 04:37:22.511 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-01 04:37:22.511 DEBUG [src.node.waku_node] Using volumes []
2026-03-01 04:37:22.512 DEBUG [src.node.docker_mananger] docker run -i -t -p 47179:47179 -p 47180:47180 -p 47181:47181 -p 47182:47182 -p 47183:47183 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=47181 --rest-port=47179 --tcp-port=47180 --discv5-udp-port=47182 --rest-address=0.0.0.0 --nat=extip:172.18.30.9 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e7b6de1d44da9a0ce30aae25d1ecedcc8d1ec4dbf59c7f3f3fc364750129d2b3 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=47183 --metrics-logging=true --relay=true --filter=true --store=true --discv5-bootstrap-node=enr:-L24QJ3XQZusUpvfrbu2dqNpzJR7NErpyk9xIH88gwtdjh8_XDY0tG98yG6V1Si7kd0IPRrByaZqPkox4kjnwpF-8x8CgmlkgnY0gmlwhKwSCjWKbXVsdGlhZGRyc5YACASsEgo1BpMfAAoErBIKNQaTIN0DgnJzhQADAQAAiXNlY3AyNTZrMaECiUaKEZBkOiu298_PQGXoM0PqDHQ0T5vNJqDYKN3VrkKDdGNwgpMfg3VkcIKTIYV3YWt1MgM
2026-03-01 04:37:22.727 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.30.9 waku 3c7feb76aabcd20939a325fc7e5a42d4aa45fe5457d26589e4f70a918530eb50
2026-03-01 04:37:22.761 DEBUG [src.node.docker_mananger] Container started with ID 3c7feb76aabc. Setting up logs at ./log/docker/node4_2026-03-01_04-37-15__bbdf68fc-7b6c-40a9-b09d-82496b1c9e60__wakuorg_nwaku:latest.log
2026-03-01 04:37:22.762 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 47179
2026-03-01 04:37:22.762 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-01 04:37:23.763 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47179/health" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:37:23.766 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-01 04:37:23.766 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-01 04:37:23.766 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47179/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:37:23.769 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.30.9/tcp/47180/p2p/16Uiu2HAmBLwqn3GcvKvcGuXQ4GczXbjq4dg85evDByw4aBRwddy9","/ip4/172.18.30.9/tcp/47181/ws/p2p/16Uiu2HAmBLwqn3GcvKvcGuXQ4GczXbjq4dg85evDByw4aBRwddy9"],"enrUri":"enr:-L24QCfTma7dHz5LzNNNsoy_cjphc676if5L22_8QYliCRjjCs8khn-PKCRiwbUigDjAcz8W4uferJoj8cS-ye4tsnACgmlkgnY0gmlwhKwSHgmKbXVsdGlhZGRyc5YACASsEh4JBrhMAAoErBIeCQa4Td0DgnJzhQADAQAAiXNlY3AyNTZrMaEC7IUFkgtJFQ7-wJIOHlrfeCkPtTpXvpJemgwr1IewQ8iDdGNwgrhMg3VkcIK4ToV3YWt1Mgc"}'
2026-03-01 04:37:23.769 INFO [src.node.waku_node] REST service is ready !!
2026-03-01 04:37:23.769 DEBUG [src.node.waku_node] Starting Node...
2026-03-01 04:37:23.769 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-01 04:37:23.771 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-01 04:37:23.771 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.113.129
2026-03-01 04:37:23.771 DEBUG [src.node.docker_mananger] Generated ports ['6102', '6103', '6104', '6105', '6106']
2026-03-01 04:37:23.771 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-01 04:37:23.771 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-01 04:37:23.771 DEBUG [src.node.waku_node] Using volumes []
2026-03-01 04:37:23.772 DEBUG [src.node.docker_mananger] docker run -i -t -p 6102:6102 -p 6103:6103 -p 6104:6104 -p 6105:6105 -p 6106:6106 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=6104 --rest-port=6102 --tcp-port=6103 --discv5-udp-port=6105 --rest-address=0.0.0.0 --nat=extip:172.18.113.129 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ecaf2bdeabdfd1e1802b1e9857fa44de1ba6a7eebcbe6a1d4c5debab2a1bdf56 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=6106 --metrics-logging=true --relay=false --filternode=/ip4/172.18.30.9/tcp/47180/p2p/16Uiu2HAmBLwqn3GcvKvcGuXQ4GczXbjq4dg85evDByw4aBRwddy9 --discv5-bootstrap-node=enr:-L24QCfTma7dHz5LzNNNsoy_cjphc676if5L22_8QYliCRjjCs8khn-PKCRiwbUigDjAcz8W4uferJoj8cS-ye4tsnACgmlkgnY0gmlwhKwSHgmKbXVsdGlhZGRyc5YACASsEh4JBrhMAAoErBIeCQa4Td0DgnJzhQADAQAAiXNlY3AyNTZrMaEC7IUFkgtJFQ7-wJIOHlrfeCkPtTpXvpJemgwr1IewQ8iDdGNwgrhMg3VkcIK4ToV3YWt1Mgc
2026-03-01 04:37:23.990 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.113.129 waku 0d0dced628ceddf1d8156e913361ddbcb7ca2d1fb304f2c8bbf6d0619f6ecdea
2026-03-01 04:37:24.029 DEBUG [src.node.docker_mananger] Container started with ID 0d0dced628ce. Setting up logs at ./log/docker/node6_2026-03-01_04-37-15__bbdf68fc-7b6c-40a9-b09d-82496b1c9e60__wakuorg_nwaku:latest.log
2026-03-01 04:37:24.029 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 6102
2026-03-01 04:37:24.029 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-01 04:37:25.031 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6102/health" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:37:25.035 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-01 04:37:25.035 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-01 04:37:25.036 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6102/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:37:25.040 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.113.129/tcp/6103/p2p/16Uiu2HAmTDTwm2o1qaWrBXzdppdws6dqxeBaz9vGKLyDpfWisKy1","/ip4/172.18.113.129/tcp/6104/ws/p2p/16Uiu2HAmTDTwm2o1qaWrBXzdppdws6dqxeBaz9vGKLyDpfWisKy1"],"enrUri":"enr:-L24QPDposC3MNWWiEG3mPXSpWmHx3EwQUZvgNt8DLWa0PK5Mm7q8lCWNpL-rqgl85mC7-P-J2uByFHDVjBRHo9PwlUCgmlkgnY0gmlwhKwScYGKbXVsdGlhZGRyc5YACASsEnGBBhfXAAoErBJxgQYX2N0DgnJzhQADAQAAiXNlY3AyNTZrMaED2FVnYootHs0MyibaP4udwq9Xu6aJwC1F0Mez-4e9YriDdGNwghfXg3VkcIIX2YV3YWt1MgA"}'
2026-03-01 04:37:25.040 INFO [src.node.waku_node] REST service is ready !!
2026-03-01 04:37:25.040 DEBUG [tests.e2e.test_e2e] Subscribe nodes to relay pubsub topics
2026-03-01 04:37:25.040 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:8219/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-01 04:37:25.047 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:37:25.048 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22966/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-01 04:37:25.055 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:37:25.055 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37662/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-01 04:37:25.066 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:37:25.067 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:47179/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-01 04:37:25.074 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:37:25.076 DEBUG [tests.e2e.test_e2e] Node6 subscribe to filter for pubsubtopic /waku/2/rs/3/1
2026-03-01 04:37:25.076 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6102/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-01 04:37:25.124 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-03-01 04:37:25.125 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8219/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:37:25.137 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.10.53/tcp/37663/p2p/16Uiu2HAm4fYDi7oPt7c1krC6DDhQGoLYzJyoDFj2YGbsSp8nnkWm","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"},{"multiaddr":"/ip4/172.18.7.144/tcp/46218/p2p/16Uiu2HAmCk4kqWi6M6ARYAx2gyeb7r4sZb8yjeWmh5WHMWeswTSU","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
2026-03-01 04:37:25.138 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22966/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:37:25.141 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.10.53/tcp/37372/p2p/16Uiu2HAm4fYDi7oPt7c1krC6DDhQGoLYzJyoDFj2YGbsSp8nnkWm","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.19.149/tcp/8220/p2p/16Uiu2HAmLssRMqLVD9AYFN2vnaLT7CuiJd8dkDvhhLVr9qbZ2MP9","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
2026-03-01 04:37:25.141 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37662/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:37:25.143 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.19.149/tcp/56968/p2p/16Uiu2HAmLssRMqLVD9AYFN2vnaLT7CuiJd8dkDvhhLVr9qbZ2MP9","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.30.9/tcp/51812/p2p/16Uiu2HAmBLwqn3GcvKvcGuXQ4GczXbjq4dg85evDByw4aBRwddy9","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.7.144/tcp/22967/p2p/16Uiu2HAmCk4kqWi6M6ARYAx2gyeb7r4sZb8yjeWmh5WHMWeswTSU","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
2026-03-01 04:37:25.144 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47179/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:37:25.146 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.113.129/tcp/40766/p2p/16Uiu2HAmTDTwm2o1qaWrBXzdppdws6dqxeBaz9vGKLyDpfWisKy1","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.10.53/tcp/37663/p2p/16Uiu2HAm4fYDi7oPt7c1krC6DDhQGoLYzJyoDFj2YGbsSp8nnkWm","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
2026-03-01 04:37:25.146 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6102/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:37:25.149 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.30.9/tcp/47180/p2p/16Uiu2HAmBLwqn3GcvKvcGuXQ4GczXbjq4dg85evDByw4aBRwddy9","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0,1],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
2026-03-01 04:37:25.149 DEBUG [src.libs.common] Sleeping for 50 seconds
2026-03-01 04:38:15.149 DEBUG [tests.e2e.test_e2e] Node1 publish message for topic /waku/2/rs/3/1
2026-03-01 04:38:15.150 DEBUG [src.steps.store] Relaying message
2026-03-01 04:38:15.151 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:8219/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-01 04:38:15.162 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-01 04:38:15.164 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-01 04:38:15.364 DEBUG [src.libs.common] Sleeping for 4 seconds
2026-03-01 04:38:19.365 DEBUG [tests.e2e.test_e2e] Node6 inquery for filter messages on pubsubtopic /waku/2/rs/3/1 & contenttopic/test/1/waku-filter/proto
2026-03-01 04:38:19.366 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6102/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:38:19.369 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772339895150521904,"ephemeral":false}]'
2026-03-01 04:38:19.369 DEBUG [tests.e2e.test_e2e] Filter inquiry response is [{'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772339895150521904, 'ephemeral': False}]
2026-03-01 04:38:19.369 DEBUG [tests.e2e.test_e2e] Node5 goes live !!
2026-03-01 04:38:19.369 DEBUG [src.node.waku_node] Starting Node...
2026-03-01 04:38:19.369 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-01 04:38:19.371 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-01 04:38:19.371 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.76.48
2026-03-01 04:38:19.371 DEBUG [src.node.docker_mananger] Generated ports ['3741', '3742', '3743', '3744', '3745']
2026-03-01 04:38:19.371 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-01 04:38:19.371 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-01 04:38:19.372 DEBUG [src.node.waku_node] Using volumes []
2026-03-01 04:38:19.372 DEBUG [src.node.docker_mananger] docker run -i -t -p 3741:3741 -p 3742:3742 -p 3743:3743 -p 3744:3744 -p 3745:3745 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3743 --rest-port=3741 --tcp-port=3742 --discv5-udp-port=3744 --rest-address=0.0.0.0 --nat=extip:172.18.76.48 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=4aa7ddd42d5a0d6f401c7e511dde72af6bbcbb083b8d91ccf7f21badc0b1c0a7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3745 --metrics-logging=true --relay=false --storenode=/ip4/172.18.30.9/tcp/47180/p2p/16Uiu2HAmBLwqn3GcvKvcGuXQ4GczXbjq4dg85evDByw4aBRwddy9 --discv5-bootstrap-node=enr:-L24QCfTma7dHz5LzNNNsoy_cjphc676if5L22_8QYliCRjjCs8khn-PKCRiwbUigDjAcz8W4uferJoj8cS-ye4tsnACgmlkgnY0gmlwhKwSHgmKbXVsdGlhZGRyc5YACASsEh4JBrhMAAoErBIeCQa4Td0DgnJzhQADAQAAiXNlY3AyNTZrMaEC7IUFkgtJFQ7-wJIOHlrfeCkPtTpXvpJemgwr1IewQ8iDdGNwgrhMg3VkcIK4ToV3YWt1Mgc
2026-03-01 04:38:19.573 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.76.48 waku 9779807fa9fc4a80b980e4d57555665d8c08486b1493fc2dcaeefdc58204dd24
2026-03-01 04:38:19.608 DEBUG [src.node.docker_mananger] Container started with ID 9779807fa9fc. Setting up logs at ./log/docker/node5_2026-03-01_04-37-15__bbdf68fc-7b6c-40a9-b09d-82496b1c9e60__wakuorg_nwaku:latest.log
2026-03-01 04:38:19.608 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 3741
2026-03-01 04:38:19.608 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-01 04:38:20.609 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3741/health" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:38:20.612 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-01 04:38:20.612 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-01 04:38:20.612 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3741/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:38:20.614 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.76.48/tcp/3742/p2p/16Uiu2HAmB6B59fDCJzKba1AJEUeqwFcHgWGmL3S4pAFNbug8hKMG","/ip4/172.18.76.48/tcp/3743/ws/p2p/16Uiu2HAmB6B59fDCJzKba1AJEUeqwFcHgWGmL3S4pAFNbug8hKMG"],"enrUri":"enr:-L24QInsSd17PbWNSxSp8Fz09grltdwgWOZSlEPxT9ClseYRFA3J3fak5LcKBhqtLXhT1QOmilJ95F5iURNKjjBpF7ECgmlkgnY0gmlwhKwSTDCKbXVsdGlhZGRyc5YACASsEkwwBg6eAAoErBJMMAYOn90DgnJzhQADAQAAiXNlY3AyNTZrMaEC6LxE_AmWnlGLh8wECxI62ejDqQuVfiLv2tBI0bj_JS-DdGNwgg6eg3VkcIIOoIV3YWt1MgA"}'
2026-03-01 04:38:20.615 INFO [src.node.waku_node] REST service is ready !!
2026-03-01 04:38:20.615 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-01 04:38:22.615 DEBUG [tests.e2e.test_e2e] Node5 makes request to get stored messages
2026-03-01 04:38:22.616 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-01 04:38:22.616 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3741/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F1&pageSize=50&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-01 04:38:22.662 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"2216c60acf9dcbb69129","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xc8b919db45ba31b2c0bc5369a00d2c926608863ae4965e34a5433d1f6e424449"}]}'
2026-03-01 04:38:22.663 DEBUG [src.steps.store] messages length is 1
2026-03-01 04:38:22.671 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-01 04:38:22.672 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-01 04:38:22.672 DEBUG [src.node.waku_node] Stopping container with id b0be700dfae7
2026-03-01 04:38:23.265 DEBUG [src.node.waku_node] Container stopped.
2026-03-01 04:38:23.266 DEBUG [src.node.waku_node] Stopping container with id f4f12cdc8cb2
2026-03-01 04:38:23.903 DEBUG [src.node.waku_node] Container stopped.
2026-03-01 04:38:23.904 DEBUG [src.node.waku_node] Stopping container with id dae2e30e163e
2026-03-01 04:38:24.083 ERROR [src.node.docker_mananger] Max retries reached for container b0be700dfae7. Exiting log stream.
2026-03-01 04:38:24.505 DEBUG [src.node.waku_node] Container stopped.
2026-03-01 04:38:24.507 DEBUG [src.node.waku_node] Stopping container with id 3c7feb76aabc
2026-03-01 04:38:24.718 ERROR [src.node.docker_mananger] Max retries reached for container f4f12cdc8cb2. Exiting log stream.
2026-03-01 04:38:25.113 DEBUG [src.node.waku_node] Container stopped.
2026-03-01 04:38:25.113 DEBUG [src.node.waku_node] Stopping container with id 0d0dced628ce
2026-03-01 04:38:25.324 ERROR [src.node.docker_mananger] Max retries reached for container dae2e30e163e. Exiting log stream.
2026-03-01 04:38:25.692 DEBUG [src.node.waku_node] Container stopped.
2026-03-01 04:38:25.693 DEBUG [src.node.waku_node] Stopping container with id 9779807fa9fc
2026-03-01 04:38:25.934 ERROR [src.node.docker_mananger] Max retries reached for container 3c7feb76aabc. Exiting log stream.
2026-03-01 04:38:26.241 DEBUG [src.node.waku_node] Container stopped.
2026-03-01 04:38:26.246 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-01 04:38:26.290 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-01 04:38:26.342 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-01 04:38:26.391 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-01 04:38:26.452 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-01 04:38:26.469 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-01 04:38:26.474 DEBUG [src.node.docker_mananger] No errors found in the waku logs.