201 lines
41 KiB
Plaintext

2026-03-02 04:33:25.891 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-02 04:33:25.891 DEBUG [tests.conftest] Running test: test_store_filter_interaction_with_six_nodes with id: 2026-03-02_04-33-25__e409cade-e32d-4e10-9d99-2d91fbe47503
2026-03-02 04:33:25.891 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-02 04:33:25.892 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-02 04:33:25.892 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-02 04:33:25.900 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-02 04:33:25.901 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-02_04-33-25__e409cade-e32d-4e10-9d99-2d91fbe47503__wakuorg_nwaku:latest.log
2026-03-02 04:33:25.907 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-02 04:33:25.907 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-02_04-33-25__e409cade-e32d-4e10-9d99-2d91fbe47503__wakuorg_nwaku:latest.log
2026-03-02 04:33:25.913 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-02 04:33:25.913 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-02_04-33-25__e409cade-e32d-4e10-9d99-2d91fbe47503__wakuorg_nwaku:latest.log
2026-03-02 04:33:25.913 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-02 04:33:25.914 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-02 04:33:25.915 DEBUG [tests.e2e.test_e2e] Create 6 nodes
2026-03-02 04:33:25.920 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-02 04:33:25.921 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-02_04-33-25__e409cade-e32d-4e10-9d99-2d91fbe47503__wakuorg_nwaku:latest.log
2026-03-02 04:33:25.926 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-02 04:33:25.926 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-02_04-33-25__e409cade-e32d-4e10-9d99-2d91fbe47503__wakuorg_nwaku:latest.log
2026-03-02 04:33:25.932 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-02 04:33:25.932 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node6_2026-03-02_04-33-25__e409cade-e32d-4e10-9d99-2d91fbe47503__wakuorg_nwaku:latest.log
2026-03-02 04:33:25.932 DEBUG [tests.e2e.test_e2e] Start 5 nodes with their corresponding config
2026-03-02 04:33:25.932 DEBUG [src.node.waku_node] Starting Node...
2026-03-02 04:33:25.933 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-02 04:33:25.978 DEBUG [src.node.docker_mananger] Network waku created
2026-03-02 04:33:25.978 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.116.22
2026-03-02 04:33:25.978 DEBUG [src.node.docker_mananger] Generated ports ['62686', '62687', '62688', '62689', '62690']
2026-03-02 04:33:25.978 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-02 04:33:25.978 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-02 04:33:25.978 DEBUG [src.node.waku_node] Using volumes []
2026-03-02 04:33:25.979 DEBUG [src.node.docker_mananger] docker run -i -t -p 62686:62686 -p 62687:62687 -p 62688:62688 -p 62689:62689 -p 62690:62690 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=62688 --rest-port=62686 --tcp-port=62687 --discv5-udp-port=62689 --rest-address=0.0.0.0 --nat=extip:172.18.116.22 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=7cdac08bfc27d4ea973e28eeb142eea64e279fc50008dfbf8ceed54a79b0faac --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=62690 --metrics-logging=true --relay=true --store=true
2026-03-02 04:33:29.369 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.116.22 waku 9110a0cd4422a26e72cdd9553a29032442a9ed6eaf3120324e2ad9302f96e788
2026-03-02 04:33:29.402 DEBUG [src.node.docker_mananger] Container started with ID 9110a0cd4422. Setting up logs at ./log/docker/node1_2026-03-02_04-33-25__e409cade-e32d-4e10-9d99-2d91fbe47503__wakuorg_nwaku:latest.log
2026-03-02 04:33:29.402 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 62686
2026-03-02 04:33:29.402 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-02 04:33:30.403 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62686/health" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:33:30.406 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-02 04:33:30.407 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-02 04:33:30.407 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62686/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:33:30.409 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.116.22/tcp/62687/p2p/16Uiu2HAm43VJQhSknr7eZK59rCKFtW8FtrUf3U9PAbbuHgFiYdSV","/ip4/172.18.116.22/tcp/62688/ws/p2p/16Uiu2HAm43VJQhSknr7eZK59rCKFtW8FtrUf3U9PAbbuHgFiYdSV"],"enrUri":"enr:-L24QEbWcY4mG2ZW8S54AuGuTyz4JBa9UG5B6goX7Le22arXFX6l2BEJfcH31wtvCyani2Av6CmSBSSukRRFOHkm7BsCgmlkgnY0gmlwhKwSdBaKbXVsdGlhZGRyc5YACASsEnQWBvTfAAoErBJ0Fgb04N0DgnJzhQADAQAAiXNlY3AyNTZrMaECgApUaAYH7TlAOt75sypFD649uVLSLwR33zOzitoYg76DdGNwgvTfg3VkcIL04YV3YWt1MgM"}'
2026-03-02 04:33:30.409 INFO [src.node.waku_node] REST service is ready !!
2026-03-02 04:33:30.409 DEBUG [src.node.waku_node] Starting Node...
2026-03-02 04:33:30.409 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-02 04:33:30.411 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-02 04:33:30.411 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.204.78
2026-03-02 04:33:30.411 DEBUG [src.node.docker_mananger] Generated ports ['49121', '49122', '49123', '49124', '49125']
2026-03-02 04:33:30.411 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-02 04:33:30.411 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-02 04:33:30.412 DEBUG [src.node.waku_node] Using volumes []
2026-03-02 04:33:30.412 DEBUG [src.node.docker_mananger] docker run -i -t -p 49121:49121 -p 49122:49122 -p 49123:49123 -p 49124:49124 -p 49125:49125 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=49123 --rest-port=49121 --tcp-port=49122 --discv5-udp-port=49124 --rest-address=0.0.0.0 --nat=extip:172.18.204.78 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ec30b0f1ad0f8dacdfc1adb3c14f4405a08c9b2dc372e91c55bd6de1d8201437 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=49125 --metrics-logging=true --relay=true --store=true --discv5-bootstrap-node=enr:-L24QEbWcY4mG2ZW8S54AuGuTyz4JBa9UG5B6goX7Le22arXFX6l2BEJfcH31wtvCyani2Av6CmSBSSukRRFOHkm7BsCgmlkgnY0gmlwhKwSdBaKbXVsdGlhZGRyc5YACASsEnQWBvTfAAoErBJ0Fgb04N0DgnJzhQADAQAAiXNlY3AyNTZrMaECgApUaAYH7TlAOt75sypFD649uVLSLwR33zOzitoYg76DdGNwgvTfg3VkcIL04YV3YWt1MgM
2026-03-02 04:33:30.607 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.204.78 waku 36539e9f84b45c9fe5b6f1fb954af69ad999f6b99ec345ae82b18d448b5dbed1
2026-03-02 04:33:30.648 DEBUG [src.node.docker_mananger] Container started with ID 36539e9f84b4. Setting up logs at ./log/docker/node2_2026-03-02_04-33-25__e409cade-e32d-4e10-9d99-2d91fbe47503__wakuorg_nwaku:latest.log
2026-03-02 04:33:30.648 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 49121
2026-03-02 04:33:30.648 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-02 04:33:31.649 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49121/health" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:33:31.652 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-02 04:33:31.652 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-02 04:33:31.652 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49121/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:33:31.656 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.204.78/tcp/49122/p2p/16Uiu2HAkz6W7NP7yzkt5czMh4zPgBSoSwvpocxgvoCymqgaNSzrK","/ip4/172.18.204.78/tcp/49123/ws/p2p/16Uiu2HAkz6W7NP7yzkt5czMh4zPgBSoSwvpocxgvoCymqgaNSzrK"],"enrUri":"enr:-L24QKY35PsJNtWOXAhq8KUi_uqsalbh18Y1qItOGfs9EHbwMUfCNFjMZLGtYNC2daYTCM94QqJ-ZjHZHCRYEhsrwNECgmlkgnY0gmlwhKwSzE6KbXVsdGlhZGRyc5YACASsEsxOBr_iAAoErBLMTga_490DgnJzhQADAQAAiXNlY3AyNTZrMaECRWE9axnX8Mae0tSl_c8mcM2kAzsP0WJpkzUbWsul1ciDdGNwgr_ig3VkcIK_5IV3YWt1MgM"}'
2026-03-02 04:33:31.656 INFO [src.node.waku_node] REST service is ready !!
2026-03-02 04:33:31.657 DEBUG [src.node.waku_node] Starting Node...
2026-03-02 04:33:31.658 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-02 04:33:31.662 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-02 04:33:31.664 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.89.105
2026-03-02 04:33:31.664 DEBUG [src.node.docker_mananger] Generated ports ['56847', '56848', '56849', '56850', '56851']
2026-03-02 04:33:31.664 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-02 04:33:31.665 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-02 04:33:31.670 DEBUG [src.node.waku_node] Using volumes []
2026-03-02 04:33:31.670 DEBUG [src.node.docker_mananger] docker run -i -t -p 56847:56847 -p 56848:56848 -p 56849:56849 -p 56850:56850 -p 56851:56851 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=56849 --rest-port=56847 --tcp-port=56848 --discv5-udp-port=56850 --rest-address=0.0.0.0 --nat=extip:172.18.89.105 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f4bb4aeaff0ed6feeeebb1e8dfb427fefba85c0fed5e50709a5da6aa3cf954b7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=56851 --metrics-logging=true --relay=true --store=true --discv5-bootstrap-node=enr:-L24QKY35PsJNtWOXAhq8KUi_uqsalbh18Y1qItOGfs9EHbwMUfCNFjMZLGtYNC2daYTCM94QqJ-ZjHZHCRYEhsrwNECgmlkgnY0gmlwhKwSzE6KbXVsdGlhZGRyc5YACASsEsxOBr_iAAoErBLMTga_490DgnJzhQADAQAAiXNlY3AyNTZrMaECRWE9axnX8Mae0tSl_c8mcM2kAzsP0WJpkzUbWsul1ciDdGNwgr_ig3VkcIK_5IV3YWt1MgM
2026-03-02 04:33:31.882 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.89.105 waku 1ff91396fd3556d9133eb60ad651d11a929b2c1c0b18de64aff32b4702474267
2026-03-02 04:33:31.917 DEBUG [src.node.docker_mananger] Container started with ID 1ff91396fd35. Setting up logs at ./log/docker/node3_2026-03-02_04-33-25__e409cade-e32d-4e10-9d99-2d91fbe47503__wakuorg_nwaku:latest.log
2026-03-02 04:33:31.919 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 56847
2026-03-02 04:33:31.919 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-02 04:33:32.921 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56847/health" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:33:32.924 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-02 04:33:32.924 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-02 04:33:32.924 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56847/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:33:32.927 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.89.105/tcp/56848/p2p/16Uiu2HAmCQ9eHuHEPBpa3u23DUfARAxJ3yAf8xafiz8RZy7XWXHS","/ip4/172.18.89.105/tcp/56849/ws/p2p/16Uiu2HAmCQ9eHuHEPBpa3u23DUfARAxJ3yAf8xafiz8RZy7XWXHS"],"enrUri":"enr:-L24QAr3bIEPEmdEvs99cqRkGYbIIBxybrD9NHXr_M7fQZyzTFKJAdNq6TqGDOPfyK-qe8qPC-h3GMKxtdwJSFR_6kcCgmlkgnY0gmlwhKwSWWmKbXVsdGlhZGRyc5YACASsEllpBt4QAAoErBJZaQbeEd0DgnJzhQADAQAAiXNlY3AyNTZrMaEC_DLLsA3tOIq4hMClKbsgSq6L19VMf7gxlXi4v74rthmDdGNwgt4Qg3VkcILeEoV3YWt1MgM"}'
2026-03-02 04:33:32.927 INFO [src.node.waku_node] REST service is ready !!
2026-03-02 04:33:32.927 DEBUG [src.node.waku_node] Starting Node...
2026-03-02 04:33:32.928 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-02 04:33:32.930 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-02 04:33:32.930 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.225.208
2026-03-02 04:33:32.930 DEBUG [src.node.docker_mananger] Generated ports ['26020', '26021', '26022', '26023', '26024']
2026-03-02 04:33:32.931 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-02 04:33:32.931 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-02 04:33:32.932 DEBUG [src.node.waku_node] Using volumes []
2026-03-02 04:33:32.933 DEBUG [src.node.docker_mananger] docker run -i -t -p 26020:26020 -p 26021:26021 -p 26022:26022 -p 26023:26023 -p 26024:26024 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=26022 --rest-port=26020 --tcp-port=26021 --discv5-udp-port=26023 --rest-address=0.0.0.0 --nat=extip:172.18.225.208 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f2cac5a78d9ea6ff9d5ed0ebdb96ebe3e40bca9fceba968df3ea2d01d9ab21cb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=26024 --metrics-logging=true --relay=true --filter=true --store=true --discv5-bootstrap-node=enr:-L24QAr3bIEPEmdEvs99cqRkGYbIIBxybrD9NHXr_M7fQZyzTFKJAdNq6TqGDOPfyK-qe8qPC-h3GMKxtdwJSFR_6kcCgmlkgnY0gmlwhKwSWWmKbXVsdGlhZGRyc5YACASsEllpBt4QAAoErBJZaQbeEd0DgnJzhQADAQAAiXNlY3AyNTZrMaEC_DLLsA3tOIq4hMClKbsgSq6L19VMf7gxlXi4v74rthmDdGNwgt4Qg3VkcILeEoV3YWt1MgM
2026-03-02 04:33:33.157 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.225.208 waku 999b4c1212c76c839b767c11f5e0ff6e8668c37e8790d84ae7085aef19a77374
2026-03-02 04:33:33.194 DEBUG [src.node.docker_mananger] Container started with ID 999b4c1212c7. Setting up logs at ./log/docker/node4_2026-03-02_04-33-25__e409cade-e32d-4e10-9d99-2d91fbe47503__wakuorg_nwaku:latest.log
2026-03-02 04:33:33.194 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 26020
2026-03-02 04:33:33.195 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-02 04:33:34.196 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26020/health" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:33:34.199 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-02 04:33:34.199 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-02 04:33:34.199 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26020/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:33:34.202 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.225.208/tcp/26021/p2p/16Uiu2HAmUyz9erASWyvpBPapTMR7sDb1uKz4mjG5z63QShpDiEJj","/ip4/172.18.225.208/tcp/26022/ws/p2p/16Uiu2HAmUyz9erASWyvpBPapTMR7sDb1uKz4mjG5z63QShpDiEJj"],"enrUri":"enr:-L24QE40GCm0VdlrEkgoYNm-kRw0Ew0vZbMWqz3bciCnyJSFRNAvf9geagYDPWhJ60Do6r3Iks8yjhNdF57OLLrr07gCgmlkgnY0gmlwhKwS4dCKbXVsdGlhZGRyc5YACASsEuHQBmWlAAoErBLh0AZlpt0DgnJzhQADAQAAiXNlY3AyNTZrMaED8pjMoaUJFPygjtKdhthUBjdBRHjIacDgHyqzMT7F--CDdGNwgmWlg3VkcIJlp4V3YWt1Mgc"}'
2026-03-02 04:33:34.202 INFO [src.node.waku_node] REST service is ready !!
2026-03-02 04:33:34.203 DEBUG [src.node.waku_node] Starting Node...
2026-03-02 04:33:34.203 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-02 04:33:34.204 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-02 04:33:34.204 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.104.75
2026-03-02 04:33:34.205 DEBUG [src.node.docker_mananger] Generated ports ['42293', '42294', '42295', '42296', '42297']
2026-03-02 04:33:34.205 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-02 04:33:34.206 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-02 04:33:34.206 DEBUG [src.node.waku_node] Using volumes []
2026-03-02 04:33:34.207 DEBUG [src.node.docker_mananger] docker run -i -t -p 42293:42293 -p 42294:42294 -p 42295:42295 -p 42296:42296 -p 42297:42297 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=42295 --rest-port=42293 --tcp-port=42294 --discv5-udp-port=42296 --rest-address=0.0.0.0 --nat=extip:172.18.104.75 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=63ef62ca57de4e581e8aa47741dea2bb7b5fefacbc5e5dbd7eef465cce852d79 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=42297 --metrics-logging=true --relay=false --filternode=/ip4/172.18.225.208/tcp/26021/p2p/16Uiu2HAmUyz9erASWyvpBPapTMR7sDb1uKz4mjG5z63QShpDiEJj --discv5-bootstrap-node=enr:-L24QE40GCm0VdlrEkgoYNm-kRw0Ew0vZbMWqz3bciCnyJSFRNAvf9geagYDPWhJ60Do6r3Iks8yjhNdF57OLLrr07gCgmlkgnY0gmlwhKwS4dCKbXVsdGlhZGRyc5YACASsEuHQBmWlAAoErBLh0AZlpt0DgnJzhQADAQAAiXNlY3AyNTZrMaED8pjMoaUJFPygjtKdhthUBjdBRHjIacDgHyqzMT7F--CDdGNwgmWlg3VkcIJlp4V3YWt1Mgc
2026-03-02 04:33:34.428 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.104.75 waku 96b07dad0704b05ae5ba21cc323c918687069a20b3769c2f42181651c4ad10ee
2026-03-02 04:33:34.463 DEBUG [src.node.docker_mananger] Container started with ID 96b07dad0704. Setting up logs at ./log/docker/node6_2026-03-02_04-33-25__e409cade-e32d-4e10-9d99-2d91fbe47503__wakuorg_nwaku:latest.log
2026-03-02 04:33:34.464 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 42293
2026-03-02 04:33:34.464 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-02 04:33:35.464 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42293/health" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:33:35.468 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-02 04:33:35.468 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-02 04:33:35.468 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42293/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:33:35.471 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.104.75/tcp/42294/p2p/16Uiu2HAmFHHxY4rq2ZpdPfvZArv4j4o7gfsCuW7wE6cx5jGUsvJQ","/ip4/172.18.104.75/tcp/42295/ws/p2p/16Uiu2HAmFHHxY4rq2ZpdPfvZArv4j4o7gfsCuW7wE6cx5jGUsvJQ"],"enrUri":"enr:-L24QJdVglwW7zzUHgKyKn_4VWE9Q-aRkzCYjlvmyvMgNyBdRlChTNo9uquXrOt4U7rbscAGCzIOfigOLGDVg048zd0CgmlkgnY0gmlwhKwSaEuKbXVsdGlhZGRyc5YACASsEmhLBqU2AAoErBJoSwalN90DgnJzhQADAQAAiXNlY3AyNTZrMaEDJwQxK2ne_mzQ7BMngYQTU0pY2vacvj6vcVLaQ_NczsWDdGNwgqU2g3VkcIKlOIV3YWt1MgA"}'
2026-03-02 04:33:35.471 INFO [src.node.waku_node] REST service is ready !!
2026-03-02 04:33:35.471 DEBUG [tests.e2e.test_e2e] Subscribe nodes to relay pubsub topics
2026-03-02 04:33:35.471 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62686/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-02 04:33:35.477 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:33:35.478 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:49121/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-02 04:33:35.486 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:33:35.486 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56847/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-02 04:33:35.495 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:33:35.498 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26020/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-02 04:33:35.508 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:33:35.509 DEBUG [tests.e2e.test_e2e] Node6 subscribe to filter for pubsubtopic /waku/2/rs/3/1
2026-03-02 04:33:35.509 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42293/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-02 04:33:35.559 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-03-02 04:33:35.561 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62686/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:33:35.569 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.89.105/tcp/56848/p2p/16Uiu2HAmCQ9eHuHEPBpa3u23DUfARAxJ3yAf8xafiz8RZy7XWXHS","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"},{"multiaddr":"/ip4/172.18.204.78/tcp/39622/p2p/16Uiu2HAkz6W7NP7yzkt5czMh4zPgBSoSwvpocxgvoCymqgaNSzrK","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
2026-03-02 04:33:35.569 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49121/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:33:35.575 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.89.105/tcp/59746/p2p/16Uiu2HAmCQ9eHuHEPBpa3u23DUfARAxJ3yAf8xafiz8RZy7XWXHS","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.116.22/tcp/62687/p2p/16Uiu2HAm43VJQhSknr7eZK59rCKFtW8FtrUf3U9PAbbuHgFiYdSV","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
2026-03-02 04:33:35.575 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56847/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:33:35.578 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.204.78/tcp/49122/p2p/16Uiu2HAkz6W7NP7yzkt5czMh4zPgBSoSwvpocxgvoCymqgaNSzrK","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"},{"multiaddr":"/ip4/172.18.225.208/tcp/49442/p2p/16Uiu2HAmUyz9erASWyvpBPapTMR7sDb1uKz4mjG5z63QShpDiEJj","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.116.22/tcp/33730/p2p/16Uiu2HAm43VJQhSknr7eZK59rCKFtW8FtrUf3U9PAbbuHgFiYdSV","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"}]'
2026-03-02 04:33:35.578 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26020/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:33:35.581 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.89.105/tcp/56848/p2p/16Uiu2HAmCQ9eHuHEPBpa3u23DUfARAxJ3yAf8xafiz8RZy7XWXHS","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"},{"multiaddr":"/ip4/172.18.104.75/tcp/37484/p2p/16Uiu2HAmFHHxY4rq2ZpdPfvZArv4j4o7gfsCuW7wE6cx5jGUsvJQ","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"}]'
2026-03-02 04:33:35.581 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42293/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:33:35.583 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.225.208/tcp/26021/p2p/16Uiu2HAmUyz9erASWyvpBPapTMR7sDb1uKz4mjG5z63QShpDiEJj","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0,1],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
2026-03-02 04:33:35.584 DEBUG [src.libs.common] Sleeping for 50 seconds
2026-03-02 04:34:25.584 DEBUG [tests.e2e.test_e2e] Node1 publish message for topic /waku/2/rs/3/1
2026-03-02 04:34:25.585 DEBUG [src.steps.store] Relaying message
2026-03-02 04:34:25.585 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62686/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-02 04:34:25.598 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-02 04:34:25.601 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-02 04:34:25.801 DEBUG [src.libs.common] Sleeping for 4 seconds
2026-03-02 04:34:29.801 DEBUG [tests.e2e.test_e2e] Node6 inquery for filter messages on pubsubtopic /waku/2/rs/3/1 & contenttopic/test/1/waku-filter/proto
2026-03-02 04:34:29.802 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42293/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:34:29.805 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772426065585055287,"ephemeral":false}]'
2026-03-02 04:34:29.805 DEBUG [tests.e2e.test_e2e] Filter inquiry response is [{'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772426065585055287, 'ephemeral': False}]
2026-03-02 04:34:29.805 DEBUG [tests.e2e.test_e2e] Node5 goes live !!
2026-03-02 04:34:29.805 DEBUG [src.node.waku_node] Starting Node...
2026-03-02 04:34:29.805 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-02 04:34:29.807 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-02 04:34:29.807 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.139.69
2026-03-02 04:34:29.807 DEBUG [src.node.docker_mananger] Generated ports ['36417', '36418', '36419', '36420', '36421']
2026-03-02 04:34:29.807 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-02 04:34:29.807 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-02 04:34:29.808 DEBUG [src.node.waku_node] Using volumes []
2026-03-02 04:34:29.808 DEBUG [src.node.docker_mananger] docker run -i -t -p 36417:36417 -p 36418:36418 -p 36419:36419 -p 36420:36420 -p 36421:36421 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=36419 --rest-port=36417 --tcp-port=36418 --discv5-udp-port=36420 --rest-address=0.0.0.0 --nat=extip:172.18.139.69 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dd67e0ff81d0f57022c6cdf7bf5cd4ccaadeb958aa7e492f56fef7b4d1fe10bc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=36421 --metrics-logging=true --relay=false --storenode=/ip4/172.18.225.208/tcp/26021/p2p/16Uiu2HAmUyz9erASWyvpBPapTMR7sDb1uKz4mjG5z63QShpDiEJj --discv5-bootstrap-node=enr:-L24QE40GCm0VdlrEkgoYNm-kRw0Ew0vZbMWqz3bciCnyJSFRNAvf9geagYDPWhJ60Do6r3Iks8yjhNdF57OLLrr07gCgmlkgnY0gmlwhKwS4dCKbXVsdGlhZGRyc5YACASsEuHQBmWlAAoErBLh0AZlpt0DgnJzhQADAQAAiXNlY3AyNTZrMaED8pjMoaUJFPygjtKdhthUBjdBRHjIacDgHyqzMT7F--CDdGNwgmWlg3VkcIJlp4V3YWt1Mgc
2026-03-02 04:34:30.016 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.139.69 waku 77e088769f61773041b306f9759e86265ecc62f4331069f60c2c269bf08d7814
2026-03-02 04:34:30.051 DEBUG [src.node.docker_mananger] Container started with ID 77e088769f61. Setting up logs at ./log/docker/node5_2026-03-02_04-33-25__e409cade-e32d-4e10-9d99-2d91fbe47503__wakuorg_nwaku:latest.log
2026-03-02 04:34:30.051 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 36417
2026-03-02 04:34:30.051 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-02 04:34:31.052 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36417/health" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:34:31.054 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-02 04:34:31.055 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-02 04:34:31.055 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36417/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:34:31.057 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.139.69/tcp/36418/p2p/16Uiu2HAmRv29JUJ334Kwgbdgitd8hi8yqiPn2FzQ6hfXeW9p6F8u","/ip4/172.18.139.69/tcp/36419/ws/p2p/16Uiu2HAmRv29JUJ334Kwgbdgitd8hi8yqiPn2FzQ6hfXeW9p6F8u"],"enrUri":"enr:-L24QBSroqhgB9jcI4mYrG7T7wL5PESkOKtNi_-mhvL7r-AjREH9wMTx0F8wlIOqvmG2-YtTz6zlDRFJr6m2pHnNPaoCgmlkgnY0gmlwhKwSi0WKbXVsdGlhZGRyc5YACASsEotFBo5CAAoErBKLRQaOQ90DgnJzhQADAQAAiXNlY3AyNTZrMaEDxQGrfYinmiAV5Q0-O5xlRsTj480U4dC5bZf6yamwezqDdGNwgo5Cg3VkcIKORIV3YWt1MgA"}'
2026-03-02 04:34:31.057 INFO [src.node.waku_node] REST service is ready !!
2026-03-02 04:34:31.058 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-02 04:34:33.058 DEBUG [tests.e2e.test_e2e] Node5 makes request to get stored messages
2026-03-02 04:34:33.058 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-02 04:34:33.059 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36417/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F1&pageSize=50&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-02 04:34:33.108 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"71612bf829a8123ad811","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x9977bf3e87006d8a32bea3c247d9021a91096577df46ac6198e7080458025e3c"}]}'
2026-03-02 04:34:33.109 DEBUG [src.steps.store] messages length is 1
2026-03-02 04:34:33.117 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-02 04:34:33.118 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-02 04:34:33.118 DEBUG [src.node.waku_node] Stopping container with id 9110a0cd4422
2026-03-02 04:34:33.729 DEBUG [src.node.waku_node] Container stopped.
2026-03-02 04:34:33.729 DEBUG [src.node.waku_node] Stopping container with id 36539e9f84b4
2026-03-02 04:34:34.278 DEBUG [src.node.waku_node] Container stopped.
2026-03-02 04:34:34.279 DEBUG [src.node.waku_node] Stopping container with id 1ff91396fd35
2026-03-02 04:34:34.543 ERROR [src.node.docker_mananger] Max retries reached for container 9110a0cd4422. Exiting log stream.
2026-03-02 04:34:34.849 DEBUG [src.node.waku_node] Container stopped.
2026-03-02 04:34:34.852 DEBUG [src.node.waku_node] Stopping container with id 999b4c1212c7
2026-03-02 04:34:35.096 ERROR [src.node.docker_mananger] Max retries reached for container 36539e9f84b4. Exiting log stream.
2026-03-02 04:34:35.408 DEBUG [src.node.waku_node] Container stopped.
2026-03-02 04:34:35.410 DEBUG [src.node.waku_node] Stopping container with id 96b07dad0704
2026-03-02 04:34:35.666 ERROR [src.node.docker_mananger] Max retries reached for container 1ff91396fd35. Exiting log stream.
2026-03-02 04:34:35.952 DEBUG [src.node.waku_node] Container stopped.
2026-03-02 04:34:35.954 DEBUG [src.node.waku_node] Stopping container with id 77e088769f61
2026-03-02 04:34:36.432 ERROR [src.node.docker_mananger] Max retries reached for container 999b4c1212c7. Exiting log stream.
2026-03-02 04:34:36.514 DEBUG [src.node.waku_node] Container stopped.
2026-03-02 04:34:36.517 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-02 04:34:36.566 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-02 04:34:36.615 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-02 04:34:36.662 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-02 04:34:36.779 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-02 04:34:36.797 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-02 04:34:36.802 DEBUG [src.node.docker_mananger] No errors found in the waku logs.