201 lines
41 KiB
Plaintext

2026-01-29 04:31:04.542 DEBUG [tests.conftest] Running fixture setup: test_id
2026-01-29 04:31:04.542 DEBUG [tests.conftest] Running test: test_store_filter_interaction_with_six_nodes with id: 2026-01-29_04-31-04__14bf652a-78bb-4c68-8093-d2d81b06945d
2026-01-29 04:31:04.543 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-01-29 04:31:04.543 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-01-29 04:31:04.543 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-01-29 04:31:04.552 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-29 04:31:04.552 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-01-29_04-31-04__14bf652a-78bb-4c68-8093-d2d81b06945d__wakuorg_nwaku:latest.log
2026-01-29 04:31:04.558 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-29 04:31:04.558 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-01-29_04-31-04__14bf652a-78bb-4c68-8093-d2d81b06945d__wakuorg_nwaku:latest.log
2026-01-29 04:31:04.564 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-29 04:31:04.564 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-01-29_04-31-04__14bf652a-78bb-4c68-8093-d2d81b06945d__wakuorg_nwaku:latest.log
2026-01-29 04:31:04.564 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-01-29 04:31:04.564 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-01-29 04:31:04.565 DEBUG [tests.e2e.test_e2e] Create 6 nodes
2026-01-29 04:31:04.570 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-29 04:31:04.570 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-01-29_04-31-04__14bf652a-78bb-4c68-8093-d2d81b06945d__wakuorg_nwaku:latest.log
2026-01-29 04:31:04.576 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-29 04:31:04.576 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-01-29_04-31-04__14bf652a-78bb-4c68-8093-d2d81b06945d__wakuorg_nwaku:latest.log
2026-01-29 04:31:04.581 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-29 04:31:04.581 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node6_2026-01-29_04-31-04__14bf652a-78bb-4c68-8093-d2d81b06945d__wakuorg_nwaku:latest.log
2026-01-29 04:31:04.581 DEBUG [tests.e2e.test_e2e] Start 5 nodes with their corresponding config
2026-01-29 04:31:04.581 DEBUG [src.node.waku_node] Starting Node...
2026-01-29 04:31:04.582 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-29 04:31:04.621 DEBUG [src.node.docker_mananger] Network waku created
2026-01-29 04:31:04.621 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.87.153
2026-01-29 04:31:04.621 DEBUG [src.node.docker_mananger] Generated ports ['1025', '1026', '1027', '1028', '1029']
2026-01-29 04:31:04.621 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-29 04:31:04.621 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-29 04:31:04.622 DEBUG [src.node.waku_node] Using volumes []
2026-01-29 04:31:04.622 DEBUG [src.node.docker_mananger] docker run -i -t -p 1025:1025 -p 1026:1026 -p 1027:1027 -p 1028:1028 -p 1029:1029 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=1027 --rest-port=1025 --tcp-port=1026 --discv5-udp-port=1028 --rest-address=0.0.0.0 --nat=extip:172.18.87.153 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=78db0219ae3cde8eab9be87a05a57dc539aff510a8bb886d82ec2f83ee3b9740 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=1029 --metrics-logging=true --relay=true --store=true
2026-01-29 04:31:07.844 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.87.153 waku fe83c3fcc1b0beebc90ca8c8ee6e490edf314316921f1394d5dfa3206a6608ec
2026-01-29 04:31:07.872 DEBUG [src.node.docker_mananger] Container started with ID fe83c3fcc1b0. Setting up logs at ./log/docker/node1_2026-01-29_04-31-04__14bf652a-78bb-4c68-8093-d2d81b06945d__wakuorg_nwaku:latest.log
2026-01-29 04:31:07.874 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 1025
2026-01-29 04:31:07.874 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-29 04:31:08.876 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1025/health" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:08.880 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-01-29 04:31:08.880 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-29 04:31:08.880 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1025/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:08.882 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.87.153/tcp/1026/p2p/16Uiu2HAm683YZbKVNJvsZhU6yuL4Y59NDuPrcvFxu56gf6cCAjEw","/ip4/172.18.87.153/tcp/1027/ws/p2p/16Uiu2HAm683YZbKVNJvsZhU6yuL4Y59NDuPrcvFxu56gf6cCAjEw"],"enrUri":"enr:-L24QFVmYZeyyI2JojaUI677Zvu0X0nalN_pwJBNnB2l5vQJbb5LE93d_uHbDfBJyBPUDEfkbM2HHV8KdX325w1ZJVoCgmlkgnY0gmlwhKwSV5mKbXVsdGlhZGRyc5YACASsEleZBgQCAAoErBJXmQYEA90DgnJzhQADAQAAiXNlY3AyNTZrMaECnux8OFauFczdtJfjTmcwgSeQc8jF0Ah0Oq8GHqeTUkiDdGNwggQCg3VkcIIEBIV3YWt1MgM"}'
2026-01-29 04:31:08.883 INFO [src.node.waku_node] REST service is ready !!
2026-01-29 04:31:08.883 DEBUG [src.node.waku_node] Starting Node...
2026-01-29 04:31:08.883 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-29 04:31:08.884 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-29 04:31:08.884 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.102.155
2026-01-29 04:31:08.885 DEBUG [src.node.docker_mananger] Generated ports ['61885', '61886', '61887', '61888', '61889']
2026-01-29 04:31:08.885 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-29 04:31:08.885 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-29 04:31:08.885 DEBUG [src.node.waku_node] Using volumes []
2026-01-29 04:31:08.885 DEBUG [src.node.docker_mananger] docker run -i -t -p 61885:61885 -p 61886:61886 -p 61887:61887 -p 61888:61888 -p 61889:61889 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=61887 --rest-port=61885 --tcp-port=61886 --discv5-udp-port=61888 --rest-address=0.0.0.0 --nat=extip:172.18.102.155 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a4c6d4e9124ecdbbba8bf9ac3cbcce0edad40494cdfaa91d1c4de576edbc5b9a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=61889 --metrics-logging=true --relay=true --store=true --discv5-bootstrap-node=enr:-L24QFVmYZeyyI2JojaUI677Zvu0X0nalN_pwJBNnB2l5vQJbb5LE93d_uHbDfBJyBPUDEfkbM2HHV8KdX325w1ZJVoCgmlkgnY0gmlwhKwSV5mKbXVsdGlhZGRyc5YACASsEleZBgQCAAoErBJXmQYEA90DgnJzhQADAQAAiXNlY3AyNTZrMaECnux8OFauFczdtJfjTmcwgSeQc8jF0Ah0Oq8GHqeTUkiDdGNwggQCg3VkcIIEBIV3YWt1MgM
2026-01-29 04:31:09.070 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.102.155 waku c98fe28ddf497b800777368f2d425255778e339d790c4823d858e6b3ad9e4a16
2026-01-29 04:31:09.100 DEBUG [src.node.docker_mananger] Container started with ID c98fe28ddf49. Setting up logs at ./log/docker/node2_2026-01-29_04-31-04__14bf652a-78bb-4c68-8093-d2d81b06945d__wakuorg_nwaku:latest.log
2026-01-29 04:31:09.101 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 61885
2026-01-29 04:31:09.101 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-29 04:31:10.102 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61885/health" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:10.106 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-01-29 04:31:10.106 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-29 04:31:10.106 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61885/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:10.108 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.102.155/tcp/61886/p2p/16Uiu2HAkz4FXy8f1HehE1Lcwvv8ypZUKU2hgANhJrJDDZBnwmmsP","/ip4/172.18.102.155/tcp/61887/ws/p2p/16Uiu2HAkz4FXy8f1HehE1Lcwvv8ypZUKU2hgANhJrJDDZBnwmmsP"],"enrUri":"enr:-L24QN1m3DlU95TV4vyluLHOp-awLrxFknnQXm8CJj7lPpnjK__G70E5yD6z6JzrhwyH1XrCf54ntEKFVimFOnuTDNICgmlkgnY0gmlwhKwSZpuKbXVsdGlhZGRyc5YACASsEmabBvG-AAoErBJmmwbxv90DgnJzhQADAQAAiXNlY3AyNTZrMaECRM2Y6LbxKCUrh7FxiCc9pZoGogHjVhZklwolE5n0qXqDdGNwgvG-g3VkcILxwIV3YWt1MgM"}'
2026-01-29 04:31:10.108 INFO [src.node.waku_node] REST service is ready !!
2026-01-29 04:31:10.108 DEBUG [src.node.waku_node] Starting Node...
2026-01-29 04:31:10.109 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-29 04:31:10.110 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-29 04:31:10.110 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.37.81
2026-01-29 04:31:10.111 DEBUG [src.node.docker_mananger] Generated ports ['51064', '51065', '51066', '51067', '51068']
2026-01-29 04:31:10.111 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-29 04:31:10.111 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-29 04:31:10.111 DEBUG [src.node.waku_node] Using volumes []
2026-01-29 04:31:10.111 DEBUG [src.node.docker_mananger] docker run -i -t -p 51064:51064 -p 51065:51065 -p 51066:51066 -p 51067:51067 -p 51068:51068 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=51066 --rest-port=51064 --tcp-port=51065 --discv5-udp-port=51067 --rest-address=0.0.0.0 --nat=extip:172.18.37.81 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ea7398e1ebe2bc7acaaec5e6c188e2d4d181f394afaaf60ad8b83ee1b9af3bda --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=51068 --metrics-logging=true --relay=true --store=true --discv5-bootstrap-node=enr:-L24QN1m3DlU95TV4vyluLHOp-awLrxFknnQXm8CJj7lPpnjK__G70E5yD6z6JzrhwyH1XrCf54ntEKFVimFOnuTDNICgmlkgnY0gmlwhKwSZpuKbXVsdGlhZGRyc5YACASsEmabBvG-AAoErBJmmwbxv90DgnJzhQADAQAAiXNlY3AyNTZrMaECRM2Y6LbxKCUrh7FxiCc9pZoGogHjVhZklwolE5n0qXqDdGNwgvG-g3VkcILxwIV3YWt1MgM
2026-01-29 04:31:10.316 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.37.81 waku 9a6f6ef22e48e689943cd638c9fcb51045b0e119f7e8deb3c5038503f184f84b
2026-01-29 04:31:10.345 DEBUG [src.node.docker_mananger] Container started with ID 9a6f6ef22e48. Setting up logs at ./log/docker/node3_2026-01-29_04-31-04__14bf652a-78bb-4c68-8093-d2d81b06945d__wakuorg_nwaku:latest.log
2026-01-29 04:31:10.346 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 51064
2026-01-29 04:31:10.347 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-29 04:31:11.347 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:51064/health" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:11.351 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-01-29 04:31:11.351 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-29 04:31:11.351 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:51064/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:11.354 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.37.81/tcp/51065/p2p/16Uiu2HAm28johWiW7XN9vKVMQZ5CwBMeFTQBqz1XQH5abfNeunEf","/ip4/172.18.37.81/tcp/51066/ws/p2p/16Uiu2HAm28johWiW7XN9vKVMQZ5CwBMeFTQBqz1XQH5abfNeunEf"],"enrUri":"enr:-L24QFOUWFfHEdzAJmD8P8jilQQcqJMRhf0Gc8bLQEYK_tquRvGxHpTaoieEQ-URgz5a6q5Ak5sE1bvGG1kZFwI7c68CgmlkgnY0gmlwhKwSJVGKbXVsdGlhZGRyc5YACASsEiVRBsd5AAoErBIlUQbHet0DgnJzhQADAQAAiXNlY3AyNTZrMaECY6tCwRsN9bjvkow31oi8Gxrq6m6nsI-VlFP2KAY5f3yDdGNwgsd5g3VkcILHe4V3YWt1MgM"}'
2026-01-29 04:31:11.354 INFO [src.node.waku_node] REST service is ready !!
2026-01-29 04:31:11.354 DEBUG [src.node.waku_node] Starting Node...
2026-01-29 04:31:11.354 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-29 04:31:11.356 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-29 04:31:11.356 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.228.13
2026-01-29 04:31:11.356 DEBUG [src.node.docker_mananger] Generated ports ['37734', '37735', '37736', '37737', '37738']
2026-01-29 04:31:11.357 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-29 04:31:11.358 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-29 04:31:11.358 DEBUG [src.node.waku_node] Using volumes []
2026-01-29 04:31:11.360 DEBUG [src.node.docker_mananger] docker run -i -t -p 37734:37734 -p 37735:37735 -p 37736:37736 -p 37737:37737 -p 37738:37738 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=37736 --rest-port=37734 --tcp-port=37735 --discv5-udp-port=37737 --rest-address=0.0.0.0 --nat=extip:172.18.228.13 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ee9a660cfa4cedce5c97a0c9be1bfb4ea0e6a7b02be1cb4540e8b0e24765ed7e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=37738 --metrics-logging=true --relay=true --filter=true --store=true --discv5-bootstrap-node=enr:-L24QFOUWFfHEdzAJmD8P8jilQQcqJMRhf0Gc8bLQEYK_tquRvGxHpTaoieEQ-URgz5a6q5Ak5sE1bvGG1kZFwI7c68CgmlkgnY0gmlwhKwSJVGKbXVsdGlhZGRyc5YACASsEiVRBsd5AAoErBIlUQbHet0DgnJzhQADAQAAiXNlY3AyNTZrMaECY6tCwRsN9bjvkow31oi8Gxrq6m6nsI-VlFP2KAY5f3yDdGNwgsd5g3VkcILHe4V3YWt1MgM
2026-01-29 04:31:11.558 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.228.13 waku a3f0ab148f8c80564e10d5f4db433eb568efef293c83cbfea02bd8374ed3e322
2026-01-29 04:31:11.591 DEBUG [src.node.docker_mananger] Container started with ID a3f0ab148f8c. Setting up logs at ./log/docker/node4_2026-01-29_04-31-04__14bf652a-78bb-4c68-8093-d2d81b06945d__wakuorg_nwaku:latest.log
2026-01-29 04:31:11.593 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 37734
2026-01-29 04:31:11.593 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-29 04:31:12.593 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37734/health" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:12.597 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-01-29 04:31:12.598 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-29 04:31:12.598 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37734/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:12.602 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.228.13/tcp/37735/p2p/16Uiu2HAmLysSZVR5cZKEy5f645sxsbC1qTrdi2jARQULWFV4EtdQ","/ip4/172.18.228.13/tcp/37736/ws/p2p/16Uiu2HAmLysSZVR5cZKEy5f645sxsbC1qTrdi2jARQULWFV4EtdQ"],"enrUri":"enr:-L24QIpLGEXJQGUc_WOpR7TJLf1U4Ih4Q0eXLnhCqjZaeAhrH_LAcBuhFVFZzQilu_DLvkatM5Y7Tmq1J3zAPfbGdywCgmlkgnY0gmlwhKwS5A2KbXVsdGlhZGRyc5YACASsEuQNBpNnAAoErBLkDQaTaN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDe7O391UkxsYnWyv5bbZVa7XiOeAg3YdPnqIET_FXhCODdGNwgpNng3VkcIKTaYV3YWt1Mgc"}'
2026-01-29 04:31:12.602 INFO [src.node.waku_node] REST service is ready !!
2026-01-29 04:31:12.605 DEBUG [src.node.waku_node] Starting Node...
2026-01-29 04:31:12.606 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-29 04:31:12.613 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-29 04:31:12.615 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.169.201
2026-01-29 04:31:12.615 DEBUG [src.node.docker_mananger] Generated ports ['48797', '48798', '48799', '48800', '48801']
2026-01-29 04:31:12.615 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-29 04:31:12.615 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-29 04:31:12.615 DEBUG [src.node.waku_node] Using volumes []
2026-01-29 04:31:12.615 DEBUG [src.node.docker_mananger] docker run -i -t -p 48797:48797 -p 48798:48798 -p 48799:48799 -p 48800:48800 -p 48801:48801 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=48799 --rest-port=48797 --tcp-port=48798 --discv5-udp-port=48800 --rest-address=0.0.0.0 --nat=extip:172.18.169.201 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ddbbcc0b8f7decb7ff91a0ad1301127dd903ecbe6a71e689285dad52c6bcb6eb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=48801 --metrics-logging=true --relay=false --filternode=/ip4/172.18.228.13/tcp/37735/p2p/16Uiu2HAmLysSZVR5cZKEy5f645sxsbC1qTrdi2jARQULWFV4EtdQ --discv5-bootstrap-node=enr:-L24QIpLGEXJQGUc_WOpR7TJLf1U4Ih4Q0eXLnhCqjZaeAhrH_LAcBuhFVFZzQilu_DLvkatM5Y7Tmq1J3zAPfbGdywCgmlkgnY0gmlwhKwS5A2KbXVsdGlhZGRyc5YACASsEuQNBpNnAAoErBLkDQaTaN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDe7O391UkxsYnWyv5bbZVa7XiOeAg3YdPnqIET_FXhCODdGNwgpNng3VkcIKTaYV3YWt1Mgc
2026-01-29 04:31:12.815 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.169.201 waku e4b8f31166abb03ac85f22baad595bff889cf486187f5c052d1d366cd1d848ea
2026-01-29 04:31:12.844 DEBUG [src.node.docker_mananger] Container started with ID e4b8f31166ab. Setting up logs at ./log/docker/node6_2026-01-29_04-31-04__14bf652a-78bb-4c68-8093-d2d81b06945d__wakuorg_nwaku:latest.log
2026-01-29 04:31:12.844 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 48797
2026-01-29 04:31:12.844 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-29 04:31:13.846 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48797/health" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:13.850 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-01-29 04:31:13.850 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-29 04:31:13.850 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48797/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:13.852 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.169.201/tcp/48798/p2p/16Uiu2HAm7N1rAEK5o6FznLnv7ks53fv6ot6tVuUkr3ywaHXE1Y8u","/ip4/172.18.169.201/tcp/48799/ws/p2p/16Uiu2HAm7N1rAEK5o6FznLnv7ks53fv6ot6tVuUkr3ywaHXE1Y8u"],"enrUri":"enr:-L24QFETECLcYOrPj2OcTO0e8YfbYTAyytfmhiQwg-6g7rdkA0EM1m5tReTFE6rusHtFWoQBK3xpD2yau-uOelp9E-oCgmlkgnY0gmlwhKwSqcmKbXVsdGlhZGRyc5YACASsEqnJBr6eAAoErBKpyQa-n90DgnJzhQADAQAAiXNlY3AyNTZrMaECsVximEyDjzaCrdnltet7zUtNLkchbiwPdvTBB3flMDaDdGNwgr6eg3VkcIK-oIV3YWt1MgA"}'
2026-01-29 04:31:13.853 INFO [src.node.waku_node] REST service is ready !!
2026-01-29 04:31:13.853 DEBUG [tests.e2e.test_e2e] Subscribe nodes to relay pubsub topics
2026-01-29 04:31:13.853 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1025/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-01-29 04:31:13.860 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:31:13.860 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61885/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-01-29 04:31:13.866 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:31:13.869 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:51064/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-01-29 04:31:13.874 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:31:13.874 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37734/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-01-29 04:31:13.879 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:31:13.881 DEBUG [tests.e2e.test_e2e] Node6 subscribe to filter for pubsubtopic /waku/2/rs/3/1
2026-01-29 04:31:13.883 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48797/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-01-29 04:31:13.922 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-01-29 04:31:13.925 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1025/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:13.930 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.37.81/tcp/51065/p2p/16Uiu2HAm28johWiW7XN9vKVMQZ5CwBMeFTQBqz1XQH5abfNeunEf","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"Discv5"},{"multiaddr":"/ip4/172.18.228.13/tcp/37735/p2p/16Uiu2HAmLysSZVR5cZKEy5f645sxsbC1qTrdi2jARQULWFV4EtdQ","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"Discv5"},{"multiaddr":"/ip4/172.18.102.155/tcp/40088/p2p/16Uiu2HAkz4FXy8f1HehE1Lcwvv8ypZUKU2hgANhJrJDDZBnwmmsP","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"Discv5"}]'
2026-01-29 04:31:13.931 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61885/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:13.934 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.37.81/tcp/34996/p2p/16Uiu2HAm28johWiW7XN9vKVMQZ5CwBMeFTQBqz1XQH5abfNeunEf","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.87.153/tcp/1026/p2p/16Uiu2HAm683YZbKVNJvsZhU6yuL4Y59NDuPrcvFxu56gf6cCAjEw","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"Discv5"}]'
2026-01-29 04:31:13.934 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:51064/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:13.937 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.87.153/tcp/50918/p2p/16Uiu2HAm683YZbKVNJvsZhU6yuL4Y59NDuPrcvFxu56gf6cCAjEw","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.228.13/tcp/44340/p2p/16Uiu2HAmLysSZVR5cZKEy5f645sxsbC1qTrdi2jARQULWFV4EtdQ","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.102.155/tcp/61886/p2p/16Uiu2HAkz4FXy8f1HehE1Lcwvv8ypZUKU2hgANhJrJDDZBnwmmsP","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"Discv5"}]'
2026-01-29 04:31:13.937 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37734/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:13.939 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.37.81/tcp/51065/p2p/16Uiu2HAm28johWiW7XN9vKVMQZ5CwBMeFTQBqz1XQH5abfNeunEf","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"Discv5"},{"multiaddr":"/ip4/172.18.169.201/tcp/34292/p2p/16Uiu2HAm7N1rAEK5o6FznLnv7ks53fv6ot6tVuUkr3ywaHXE1Y8u","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.87.153/tcp/44388/p2p/16Uiu2HAm683YZbKVNJvsZhU6yuL4Y59NDuPrcvFxu56gf6cCAjEw","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"UnknownOrigin"}]'
2026-01-29 04:31:13.940 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48797/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:13.942 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.228.13/tcp/37735/p2p/16Uiu2HAmLysSZVR5cZKEy5f645sxsbC1qTrdi2jARQULWFV4EtdQ","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0,1],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"Discv5"}]'
2026-01-29 04:31:13.942 DEBUG [src.libs.common] Sleeping for 50 seconds
2026-01-29 04:32:03.942 DEBUG [tests.e2e.test_e2e] Node1 publish message for topic /waku/2/rs/3/1
2026-01-29 04:32:03.943 DEBUG [src.steps.store] Relaying message
2026-01-29 04:32:03.943 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1025/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-01-29 04:32:03.951 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:32:03.951 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-29 04:32:04.151 DEBUG [src.libs.common] Sleeping for 4 seconds
2026-01-29 04:32:08.151 DEBUG [tests.e2e.test_e2e] Node6 inquery for filter messages on pubsubtopic /waku/2/rs/3/1 & contenttopic/test/1/waku-filter/proto
2026-01-29 04:32:08.152 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48797/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:32:08.155 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1769661123943191591,"ephemeral":false}]'
2026-01-29 04:32:08.155 DEBUG [tests.e2e.test_e2e] Filter inquiry response is [{'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1769661123943191591, 'ephemeral': False}]
2026-01-29 04:32:08.155 DEBUG [tests.e2e.test_e2e] Node5 goes live !!
2026-01-29 04:32:08.155 DEBUG [src.node.waku_node] Starting Node...
2026-01-29 04:32:08.156 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-29 04:32:08.157 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-29 04:32:08.157 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.75.248
2026-01-29 04:32:08.157 DEBUG [src.node.docker_mananger] Generated ports ['27154', '27155', '27156', '27157', '27158']
2026-01-29 04:32:08.157 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-29 04:32:08.157 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-29 04:32:08.157 DEBUG [src.node.waku_node] Using volumes []
2026-01-29 04:32:08.158 DEBUG [src.node.docker_mananger] docker run -i -t -p 27154:27154 -p 27155:27155 -p 27156:27156 -p 27157:27157 -p 27158:27158 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=27156 --rest-port=27154 --tcp-port=27155 --discv5-udp-port=27157 --rest-address=0.0.0.0 --nat=extip:172.18.75.248 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e23d5fcc504bd1beb49dacddb27d07de0b99d8cb5db0d3dd1cce6dd3b1a3ee33 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=27158 --metrics-logging=true --relay=false --storenode=/ip4/172.18.228.13/tcp/37735/p2p/16Uiu2HAmLysSZVR5cZKEy5f645sxsbC1qTrdi2jARQULWFV4EtdQ --discv5-bootstrap-node=enr:-L24QIpLGEXJQGUc_WOpR7TJLf1U4Ih4Q0eXLnhCqjZaeAhrH_LAcBuhFVFZzQilu_DLvkatM5Y7Tmq1J3zAPfbGdywCgmlkgnY0gmlwhKwS5A2KbXVsdGlhZGRyc5YACASsEuQNBpNnAAoErBLkDQaTaN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDe7O391UkxsYnWyv5bbZVa7XiOeAg3YdPnqIET_FXhCODdGNwgpNng3VkcIKTaYV3YWt1Mgc
2026-01-29 04:32:08.343 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.75.248 waku 50cd7911669f4cb1de54dedbac105feaa7e3dddd470e8ef3a443e0e45d57be00
2026-01-29 04:32:08.372 DEBUG [src.node.docker_mananger] Container started with ID 50cd7911669f. Setting up logs at ./log/docker/node5_2026-01-29_04-31-04__14bf652a-78bb-4c68-8093-d2d81b06945d__wakuorg_nwaku:latest.log
2026-01-29 04:32:08.372 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 27154
2026-01-29 04:32:08.372 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-29 04:32:09.373 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:27154/health" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:32:09.377 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"READY"},{"Filter Client":"READY"}]}'
2026-01-29 04:32:09.377 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-29 04:32:09.378 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:27154/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:32:09.380 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.75.248/tcp/27155/p2p/16Uiu2HAmS82vHkTSwyQtdxYU5eTopeYRBtmyu3n2cpTrGnkMNkKo","/ip4/172.18.75.248/tcp/27156/ws/p2p/16Uiu2HAmS82vHkTSwyQtdxYU5eTopeYRBtmyu3n2cpTrGnkMNkKo"],"enrUri":"enr:-L24QCQIEGM01-1kmnE4RLAakVF_ZzPSsXH5kdyxGzSe05rZCEksRicABAuC_vPkHxY9fbMU1-T2D40h16xAg3S1IycCgmlkgnY0gmlwhKwSS_iKbXVsdGlhZGRyc5YACASsEkv4BmoTAAoErBJL-AZqFN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDyBWEQUGFQruOLBTUmns99k44C9eB716YQ7tW7ORIdXaDdGNwgmoTg3VkcIJqFYV3YWt1MgA"}'
2026-01-29 04:32:09.380 INFO [src.node.waku_node] REST service is ready !!
2026-01-29 04:32:09.381 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-01-29 04:32:11.381 DEBUG [tests.e2e.test_e2e] Node5 makes request to get stored messages
2026-01-29 04:32:11.381 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-01-29 04:32:11.382 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:27154/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F1&pageSize=50&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:32:11.417 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"166b6b94024ccb0e172a","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x8876cf971b65957bf5d73764dfa98491188f43e223a580b28a521e8f7520cc99"}]}'
2026-01-29 04:32:11.419 DEBUG [src.steps.store] messages length is 1
2026-01-29 04:32:11.424 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-01-29 04:32:11.425 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-01-29 04:32:11.425 DEBUG [src.node.waku_node] Stopping container with id fe83c3fcc1b0
2026-01-29 04:32:12.043 DEBUG [src.node.waku_node] Container stopped.
2026-01-29 04:32:12.043 DEBUG [src.node.waku_node] Stopping container with id c98fe28ddf49
2026-01-29 04:32:12.614 DEBUG [src.node.waku_node] Container stopped.
2026-01-29 04:32:12.614 DEBUG [src.node.waku_node] Stopping container with id 9a6f6ef22e48
2026-01-29 04:32:12.855 ERROR [src.node.docker_mananger] Max retries reached for container fe83c3fcc1b0. Exiting log stream.
2026-01-29 04:32:13.157 DEBUG [src.node.waku_node] Container stopped.
2026-01-29 04:32:13.160 DEBUG [src.node.waku_node] Stopping container with id a3f0ab148f8c
2026-01-29 04:32:13.426 ERROR [src.node.docker_mananger] Max retries reached for container c98fe28ddf49. Exiting log stream.
2026-01-29 04:32:13.669 DEBUG [src.node.waku_node] Container stopped.
2026-01-29 04:32:13.669 DEBUG [src.node.waku_node] Stopping container with id e4b8f31166ab
2026-01-29 04:32:13.970 ERROR [src.node.docker_mananger] Max retries reached for container 9a6f6ef22e48. Exiting log stream.
2026-01-29 04:32:14.196 DEBUG [src.node.waku_node] Container stopped.
2026-01-29 04:32:14.198 DEBUG [src.node.waku_node] Stopping container with id 50cd7911669f
2026-01-29 04:32:14.481 ERROR [src.node.docker_mananger] Max retries reached for container a3f0ab148f8c. Exiting log stream.
2026-01-29 04:32:14.737 DEBUG [src.node.waku_node] Container stopped.
2026-01-29 04:32:14.738 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-01-29 04:32:14.788 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-29 04:32:14.837 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-29 04:32:14.885 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-29 04:32:14.950 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-29 04:32:14.967 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-29 04:32:14.971 DEBUG [src.node.docker_mananger] No errors found in the waku logs.