180 lines
34 KiB
Plaintext

2026-03-25 04:41:41.381 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-25 04:41:41.382 DEBUG [tests.conftest] Running test: test_filter_get_message_after_one_peer_was_stopped with id: 2026-03-25_04-41-41__8c961c58-595e-4f78-bdf4-13b26184a59c
2026-03-25 04:41:41.382 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-25 04:41:41.382 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-25 04:41:41.383 DEBUG [src.steps.filter] Running fixture setup: setup_main_relay_node
2026-03-25 04:41:41.389 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-25 04:41:41.389 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-25_04-41-41__8c961c58-595e-4f78-bdf4-13b26184a59c__wakuorg_nwaku:latest.log
2026-03-25 04:41:41.389 DEBUG [src.node.waku_node] Starting Node...
2026-03-25 04:41:41.389 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-25 04:41:41.391 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-25 04:41:41.391 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.253.145
2026-03-25 04:41:41.391 DEBUG [src.node.docker_mananger] Generated ports ['14327', '14328', '14329', '14330', '14331']
2026-03-25 04:41:41.391 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-25 04:41:41.391 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-25 04:41:41.391 DEBUG [src.node.waku_node] Using volumes []
2026-03-25 04:41:41.391 DEBUG [src.node.docker_mananger] docker run -i -t -p 14327:14327 -p 14328:14328 -p 14329:14329 -p 14330:14330 -p 14331:14331 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=14329 --rest-port=14327 --tcp-port=14328 --discv5-udp-port=14330 --rest-address=0.0.0.0 --nat=extip:172.18.253.145 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ac1e481af30bdeba5cdcafeb1a23cdfed71d5f7a1f4d3f629e430cb62c8a9e52 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=14331 --metrics-logging=true --relay=true --filter=true
2026-03-25 04:41:41.584 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.253.145 waku f8c38b1fbea6cf83aff533f8a2d431ab1f7841841ec1ee2c7a983b677c4c60e7
2026-03-25 04:41:41.618 DEBUG [src.node.docker_mananger] Container started with ID f8c38b1fbea6. Setting up logs at ./log/docker/node1_2026-03-25_04-41-41__8c961c58-595e-4f78-bdf4-13b26184a59c__wakuorg_nwaku:latest.log
2026-03-25 04:41:41.618 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 14327
2026-03-25 04:41:41.618 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-25 04:41:41.647 ERROR [src.node.docker_mananger] Max retries reached for container aedfbb443949. Exiting log stream.
2026-03-25 04:41:42.173 ERROR [src.node.docker_mananger] Max retries reached for container d7123203f7ad. Exiting log stream.
2026-03-25 04:41:42.619 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14327/health" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:41:42.621 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-25 04:41:42.622 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-25 04:41:42.622 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14327/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:41:42.624 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.253.145/tcp/14328/p2p/16Uiu2HAm5KBQmkkXmEFLPrbZrwY8zfsfsD54Fmvvb3cyhtyHG73n","/ip4/172.18.253.145/tcp/14329/ws/p2p/16Uiu2HAm5KBQmkkXmEFLPrbZrwY8zfsfsD54Fmvvb3cyhtyHG73n"],"enrUri":"enr:-L24QIwC-Rlk5Fy2RdHLLaqAhzXo-fG1GJY2DU2JMPQtXw0FbWbIdmdyLW9iPnwAwmuImDQ4sC5aMs1yyF-YdKkOgBgCgmlkgnY0gmlwhKwS_ZGKbXVsdGlhZGRyc5YACASsEv2RBjf4AAoErBL9kQY3-d0DgnJzhQADAQAAiXNlY3AyNTZrMaECkusUui796cH2iuaSLFArIkx6hAuGcFyZN92PFJeftJGDdGNwgjf4g3VkcII3-oV3YWt1MgU"}'
2026-03-25 04:41:42.624 INFO [src.node.waku_node] REST service is ready !!
2026-03-25 04:41:42.625 DEBUG [src.steps.filter] Running fixture setup: setup_main_filter_node
2026-03-25 04:41:42.631 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-25 04:41:42.631 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-25_04-41-41__8c961c58-595e-4f78-bdf4-13b26184a59c__wakuorg_nwaku:latest.log
2026-03-25 04:41:42.631 DEBUG [src.node.waku_node] Starting Node...
2026-03-25 04:41:42.631 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-25 04:41:42.633 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-25 04:41:42.633 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.232.49
2026-03-25 04:41:42.633 DEBUG [src.node.docker_mananger] Generated ports ['13938', '13939', '13940', '13941', '13942']
2026-03-25 04:41:42.633 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-25 04:41:42.633 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-25 04:41:42.634 DEBUG [src.node.waku_node] Using volumes []
2026-03-25 04:41:42.634 DEBUG [src.node.docker_mananger] docker run -i -t -p 13938:13938 -p 13939:13939 -p 13940:13940 -p 13941:13941 -p 13942:13942 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13940 --rest-port=13938 --tcp-port=13939 --discv5-udp-port=13941 --rest-address=0.0.0.0 --nat=extip:172.18.232.49 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=5fffad1aafb38b8f60f2e9dda5e57c4cb99fab6fc09ec0cde2acbcdb4520d6e2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13942 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QIwC-Rlk5Fy2RdHLLaqAhzXo-fG1GJY2DU2JMPQtXw0FbWbIdmdyLW9iPnwAwmuImDQ4sC5aMs1yyF-YdKkOgBgCgmlkgnY0gmlwhKwS_ZGKbXVsdGlhZGRyc5YACASsEv2RBjf4AAoErBL9kQY3-d0DgnJzhQADAQAAiXNlY3AyNTZrMaECkusUui796cH2iuaSLFArIkx6hAuGcFyZN92PFJeftJGDdGNwgjf4g3VkcII3-oV3YWt1MgU --filternode=/ip4/172.18.253.145/tcp/14328/p2p/16Uiu2HAm5KBQmkkXmEFLPrbZrwY8zfsfsD54Fmvvb3cyhtyHG73n
2026-03-25 04:41:42.828 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.232.49 waku a38c2b45f4e81a0a4f42f499d18677027a9f067fb689de06685f196b8be26e0e
2026-03-25 04:41:42.859 DEBUG [src.node.docker_mananger] Container started with ID a38c2b45f4e8. Setting up logs at ./log/docker/node2_2026-03-25_04-41-41__8c961c58-595e-4f78-bdf4-13b26184a59c__wakuorg_nwaku:latest.log
2026-03-25 04:41:42.860 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 13938
2026-03-25 04:41:42.860 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-25 04:41:43.861 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13938/health" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:41:43.863 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-25 04:41:43.863 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-25 04:41:43.864 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13938/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:41:43.866 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.232.49/tcp/13939/p2p/16Uiu2HAm6sZb4A67iL6rZRKvwwzrixS8ScbSvcsvGn2L5sW9rfQX","/ip4/172.18.232.49/tcp/13940/ws/p2p/16Uiu2HAm6sZb4A67iL6rZRKvwwzrixS8ScbSvcsvGn2L5sW9rfQX"],"enrUri":"enr:-L24QPQjYGRgUUbeWlCr79yayK5HXFZCvqT9YmXgXMEQylEuKcdl25OTALnVIbe6dd0lri2Nw8j-GEeXIHmF9yozsUACgmlkgnY0gmlwhKwS6DGKbXVsdGlhZGRyc5YACASsEugxBjZzAAoErBLoMQY2dN0DgnJzhQADAQAAiXNlY3AyNTZrMaECqhJuAmT9j8vQBKVv_333QQw0LFSroMj97d5C-Mlp4XSDdGNwgjZzg3VkcII2dYV3YWt1MgA"}'
2026-03-25 04:41:43.866 INFO [src.node.waku_node] REST service is ready !!
2026-03-25 04:41:43.867 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13938/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.253.145/tcp/14328/p2p/16Uiu2HAm5KBQmkkXmEFLPrbZrwY8zfsfsD54Fmvvb3cyhtyHG73n"]'
2026-03-25 04:41:43.906 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:41:43.913 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-25 04:41:43.913 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-25_04-41-41__8c961c58-595e-4f78-bdf4-13b26184a59c__wakuorg_nwaku:latest.log
2026-03-25 04:41:43.914 DEBUG [src.node.waku_node] Starting Node...
2026-03-25 04:41:43.914 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-25 04:41:43.915 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-25 04:41:43.915 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.180.3
2026-03-25 04:41:43.915 DEBUG [src.node.docker_mananger] Generated ports ['26304', '26305', '26306', '26307', '26308']
2026-03-25 04:41:43.916 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-25 04:41:43.916 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-25 04:41:43.916 DEBUG [src.node.waku_node] Using volumes []
2026-03-25 04:41:43.916 DEBUG [src.node.docker_mananger] docker run -i -t -p 26304:26304 -p 26305:26305 -p 26306:26306 -p 26307:26307 -p 26308:26308 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=26306 --rest-port=26304 --tcp-port=26305 --discv5-udp-port=26307 --rest-address=0.0.0.0 --nat=extip:172.18.180.3 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bae2f564191cb5b9eff0bdabf7be7d87de4b9d41dba2ae5dcfdb1d7914eddeb3 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=26308 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QIwC-Rlk5Fy2RdHLLaqAhzXo-fG1GJY2DU2JMPQtXw0FbWbIdmdyLW9iPnwAwmuImDQ4sC5aMs1yyF-YdKkOgBgCgmlkgnY0gmlwhKwS_ZGKbXVsdGlhZGRyc5YACASsEv2RBjf4AAoErBL9kQY3-d0DgnJzhQADAQAAiXNlY3AyNTZrMaECkusUui796cH2iuaSLFArIkx6hAuGcFyZN92PFJeftJGDdGNwgjf4g3VkcII3-oV3YWt1MgU --filternode=/ip4/172.18.253.145/tcp/14328/p2p/16Uiu2HAm5KBQmkkXmEFLPrbZrwY8zfsfsD54Fmvvb3cyhtyHG73n
2026-03-25 04:41:44.127 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.180.3 waku 96278c52244e4bb75cf5fc8960a57efbfba7931839cb441ad82766ad317785fa
2026-03-25 04:41:44.163 DEBUG [src.node.docker_mananger] Container started with ID 96278c52244e. Setting up logs at ./log/docker/node3_2026-03-25_04-41-41__8c961c58-595e-4f78-bdf4-13b26184a59c__wakuorg_nwaku:latest.log
2026-03-25 04:41:44.163 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 26304
2026-03-25 04:41:44.163 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-25 04:41:45.164 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26304/health" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:41:45.167 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-25 04:41:45.167 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-25 04:41:45.167 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26304/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:41:45.169 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.180.3/tcp/26305/p2p/16Uiu2HAmN4tGHrLtr55w4TEyzLTo5jiLfNCB9WYo6mmLcEojUN3i","/ip4/172.18.180.3/tcp/26306/ws/p2p/16Uiu2HAmN4tGHrLtr55w4TEyzLTo5jiLfNCB9WYo6mmLcEojUN3i"],"enrUri":"enr:-L24QPgFbYc8nAe3L_H-7Nui043ark0mz0lpfN5qjCKgk2uxDrq1EQpJ4EvIk0TlW2bCD5d15pgm_kk9CVap0CvFgTcCgmlkgnY0gmlwhKwStAOKbXVsdGlhZGRyc5YACASsErQDBmbBAAoErBK0AwZmwt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDi9g9dmDbENrLrrWO-95DG7WkO_cOCmVOlpXEio5wIemDdGNwgmbBg3VkcIJmw4V3YWt1MgA"}'
2026-03-25 04:41:45.169 INFO [src.node.waku_node] REST service is ready !!
2026-03-25 04:41:45.170 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26304/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.253.145/tcp/14328/p2p/16Uiu2HAm5KBQmkkXmEFLPrbZrwY8zfsfsD54Fmvvb3cyhtyHG73n"]'
2026-03-25 04:41:45.201 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:41:45.215 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-25 04:41:45.215 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-25_04-41-41__8c961c58-595e-4f78-bdf4-13b26184a59c__wakuorg_nwaku:latest.log
2026-03-25 04:41:45.218 DEBUG [src.node.waku_node] Starting Node...
2026-03-25 04:41:45.219 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-25 04:41:45.223 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-25 04:41:45.224 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.139.22
2026-03-25 04:41:45.224 DEBUG [src.node.docker_mananger] Generated ports ['10019', '10020', '10021', '10022', '10023']
2026-03-25 04:41:45.224 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-25 04:41:45.226 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-25 04:41:45.226 DEBUG [src.node.waku_node] Using volumes []
2026-03-25 04:41:45.227 DEBUG [src.node.docker_mananger] docker run -i -t -p 10019:10019 -p 10020:10020 -p 10021:10021 -p 10022:10022 -p 10023:10023 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=10021 --rest-port=10019 --tcp-port=10020 --discv5-udp-port=10022 --rest-address=0.0.0.0 --nat=extip:172.18.139.22 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8edf8dce50b76e06ed7c7ce39a2fc0cef3a7bbc1fdc9a85aa3f9add6ab8737ab --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=10023 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QIwC-Rlk5Fy2RdHLLaqAhzXo-fG1GJY2DU2JMPQtXw0FbWbIdmdyLW9iPnwAwmuImDQ4sC5aMs1yyF-YdKkOgBgCgmlkgnY0gmlwhKwS_ZGKbXVsdGlhZGRyc5YACASsEv2RBjf4AAoErBL9kQY3-d0DgnJzhQADAQAAiXNlY3AyNTZrMaECkusUui796cH2iuaSLFArIkx6hAuGcFyZN92PFJeftJGDdGNwgjf4g3VkcII3-oV3YWt1MgU --filternode=/ip4/172.18.253.145/tcp/14328/p2p/16Uiu2HAm5KBQmkkXmEFLPrbZrwY8zfsfsD54Fmvvb3cyhtyHG73n
2026-03-25 04:41:45.421 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.139.22 waku 77f9017ee9d25f3ec009171e033f0d4f8139ff453c53890589d8d529b2dcbe11
2026-03-25 04:41:45.457 DEBUG [src.node.docker_mananger] Container started with ID 77f9017ee9d2. Setting up logs at ./log/docker/node4_2026-03-25_04-41-41__8c961c58-595e-4f78-bdf4-13b26184a59c__wakuorg_nwaku:latest.log
2026-03-25 04:41:45.457 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 10019
2026-03-25 04:41:45.457 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-25 04:41:46.458 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10019/health" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:41:46.460 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-25 04:41:46.461 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-25 04:41:46.461 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10019/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:41:46.463 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.139.22/tcp/10020/p2p/16Uiu2HAmPoEhCcbV3hfms5MmrazgRKnajtwoPCwNNS5PfFcKYLY2","/ip4/172.18.139.22/tcp/10021/ws/p2p/16Uiu2HAmPoEhCcbV3hfms5MmrazgRKnajtwoPCwNNS5PfFcKYLY2"],"enrUri":"enr:-L24QFPhEdrdfz7c-U3gwi1N9PjTUaqbODhR8uJI2zCWpdgdGqmce4sfAq0yqu8sAV2JheawsLI0q8gScgR6Sa0EtQMCgmlkgnY0gmlwhKwSixaKbXVsdGlhZGRyc5YACASsEosWBickAAoErBKLFgYnJd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDpY1rsaCzhK0w4sFmh_1szl4DluhsJnVFAPuSXnKkDAuDdGNwgickg3VkcIInJoV3YWt1MgA"}'
2026-03-25 04:41:46.463 INFO [src.node.waku_node] REST service is ready !!
2026-03-25 04:41:46.464 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10019/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.253.145/tcp/14328/p2p/16Uiu2HAm5KBQmkkXmEFLPrbZrwY8zfsfsD54Fmvvb3cyhtyHG73n"]'
2026-03-25 04:41:46.500 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:41:46.512 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-25 04:41:46.513 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-25_04-41-41__8c961c58-595e-4f78-bdf4-13b26184a59c__wakuorg_nwaku:latest.log
2026-03-25 04:41:46.513 DEBUG [src.node.waku_node] Starting Node...
2026-03-25 04:41:46.514 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-25 04:41:46.516 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-25 04:41:46.517 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.221.227
2026-03-25 04:41:46.517 DEBUG [src.node.docker_mananger] Generated ports ['15393', '15394', '15395', '15396', '15397']
2026-03-25 04:41:46.517 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-25 04:41:46.519 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-25 04:41:46.519 DEBUG [src.node.waku_node] Using volumes []
2026-03-25 04:41:46.520 DEBUG [src.node.docker_mananger] docker run -i -t -p 15393:15393 -p 15394:15394 -p 15395:15395 -p 15396:15396 -p 15397:15397 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=15395 --rest-port=15393 --tcp-port=15394 --discv5-udp-port=15396 --rest-address=0.0.0.0 --nat=extip:172.18.221.227 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=26dc33bd137c289aa87d5c0ce43a7e2def55bccabb1efda5ddca73b7f9dcb20a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=15397 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QIwC-Rlk5Fy2RdHLLaqAhzXo-fG1GJY2DU2JMPQtXw0FbWbIdmdyLW9iPnwAwmuImDQ4sC5aMs1yyF-YdKkOgBgCgmlkgnY0gmlwhKwS_ZGKbXVsdGlhZGRyc5YACASsEv2RBjf4AAoErBL9kQY3-d0DgnJzhQADAQAAiXNlY3AyNTZrMaECkusUui796cH2iuaSLFArIkx6hAuGcFyZN92PFJeftJGDdGNwgjf4g3VkcII3-oV3YWt1MgU --filternode=/ip4/172.18.253.145/tcp/14328/p2p/16Uiu2HAm5KBQmkkXmEFLPrbZrwY8zfsfsD54Fmvvb3cyhtyHG73n
2026-03-25 04:41:46.717 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.221.227 waku 4058b8e2e6a8b4c2c35a9a7c83459a09d3cb7335ed3519ae2c9f86cfad5744c1
2026-03-25 04:41:46.754 DEBUG [src.node.docker_mananger] Container started with ID 4058b8e2e6a8. Setting up logs at ./log/docker/node5_2026-03-25_04-41-41__8c961c58-595e-4f78-bdf4-13b26184a59c__wakuorg_nwaku:latest.log
2026-03-25 04:41:46.755 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 15393
2026-03-25 04:41:46.755 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-25 04:41:47.755 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15393/health" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:41:47.758 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-25 04:41:47.758 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-25 04:41:47.759 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15393/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:41:47.761 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.221.227/tcp/15394/p2p/16Uiu2HAmQLTuMGUC1zuGJKVcMvo68ynEVkB3oJ7XirPNMZoQSur9","/ip4/172.18.221.227/tcp/15395/ws/p2p/16Uiu2HAmQLTuMGUC1zuGJKVcMvo68ynEVkB3oJ7XirPNMZoQSur9"],"enrUri":"enr:-L24QOXgzvSj8xpFeufqN59iJgEUvb_cvUwlzU6NAhKB79f2IoVe0qO1rQDi9vTibde1gLTqtPSUUUQKaXrTQKSoc60CgmlkgnY0gmlwhKwS3eOKbXVsdGlhZGRyc5YACASsEt3jBjwiAAoErBLd4wY8I90DgnJzhQADAQAAiXNlY3AyNTZrMaEDrY1cm_BRAYJ3wzjoSQADJkBzNmHTYTc9TO_sEB8MyoqDdGNwgjwig3VkcII8JIV3YWt1MgA"}'
2026-03-25 04:41:47.761 INFO [src.node.waku_node] REST service is ready !!
2026-03-25 04:41:47.761 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:15393/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.253.145/tcp/14328/p2p/16Uiu2HAm5KBQmkkXmEFLPrbZrwY8zfsfsD54Fmvvb3cyhtyHG73n"]'
2026-03-25 04:41:47.796 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:41:47.797 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14327/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-25 04:41:47.804 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:41:47.806 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13938/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "c344ccdc-1b73-4cde-b08a-1d200ab011e0", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-25 04:41:47.821 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"c344ccdc-1b73-4cde-b08a-1d200ab011e0","statusDesc":"OK"}'
2026-03-25 04:41:47.822 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26304/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "aaa72805-41c9-4927-a0c0-d1ede3ead8bf", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-25 04:41:47.835 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"aaa72805-41c9-4927-a0c0-d1ede3ead8bf","statusDesc":"OK"}'
2026-03-25 04:41:47.836 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10019/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "ae044d22-7d89-48e9-97ec-5f1f56f1d00c", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-25 04:41:47.846 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"ae044d22-7d89-48e9-97ec-5f1f56f1d00c","statusDesc":"OK"}'
2026-03-25 04:41:47.847 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:15393/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "c5fcea7a-05ba-47fb-9fea-72368106b6aa", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-25 04:41:47.856 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"c5fcea7a-05ba-47fb-9fea-72368106b6aa","statusDesc":"OK"}'
2026-03-25 04:41:47.857 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14327/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-25 04:41:47.871 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:41:47.873 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-25 04:41:47.975 DEBUG [src.steps.filter] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-25 04:41:47.975 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13938/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:41:47.978 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774413707857341549,"ephemeral":false}]'
2026-03-25 04:41:47.979 DEBUG [src.steps.filter] Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
2026-03-25 04:41:47.980 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26304/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:41:47.982 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774413707857341549,"ephemeral":false}]'
2026-03-25 04:41:47.983 DEBUG [src.steps.filter] Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message
2026-03-25 04:41:47.984 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10019/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:41:47.986 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774413707857341549,"ephemeral":false}]'
2026-03-25 04:41:47.987 DEBUG [src.steps.filter] Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message
2026-03-25 04:41:47.987 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15393/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:41:47.990 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774413707857341549,"ephemeral":false}]'
2026-03-25 04:41:47.991 DEBUG [src.node.waku_node] Stopping container with id a38c2b45f4e8
2026-03-25 04:41:48.584 DEBUG [src.node.waku_node] Container stopped.
2026-03-25 04:41:48.587 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14327/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-25 04:41:48.594 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-25 04:41:48.595 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-25 04:41:48.695 DEBUG [src.steps.filter] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-25 04:41:48.695 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26304/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:41:48.698 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774413708587545116,"ephemeral":false}]'
2026-03-25 04:41:48.699 DEBUG [src.steps.filter] Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
2026-03-25 04:41:48.700 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10019/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:41:48.702 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774413708587545116,"ephemeral":false}]'
2026-03-25 04:41:48.703 DEBUG [src.steps.filter] Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message
2026-03-25 04:41:48.704 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15393/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-25 04:41:48.706 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774413708587545116,"ephemeral":false}]'
2026-03-25 04:41:48.709 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-25 04:41:48.710 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-25 04:41:48.710 DEBUG [src.node.waku_node] Stopping container with id f8c38b1fbea6
2026-03-25 04:41:49.284 DEBUG [src.node.waku_node] Container stopped.
2026-03-25 04:41:49.286 DEBUG [src.node.waku_node] Stopping container with id 96278c52244e
2026-03-25 04:41:49.399 ERROR [src.node.docker_mananger] Max retries reached for container a38c2b45f4e8. Exiting log stream.
2026-03-25 04:41:49.863 DEBUG [src.node.waku_node] Container stopped.
2026-03-25 04:41:49.864 DEBUG [src.node.waku_node] Stopping container with id 77f9017ee9d2
2026-03-25 04:41:50.097 ERROR [src.node.docker_mananger] Max retries reached for container f8c38b1fbea6. Exiting log stream.
2026-03-25 04:41:50.428 DEBUG [src.node.waku_node] Container stopped.
2026-03-25 04:41:50.428 DEBUG [src.node.waku_node] Stopping container with id 4058b8e2e6a8
2026-03-25 04:41:50.697 ERROR [src.node.docker_mananger] Max retries reached for container 96278c52244e. Exiting log stream.
2026-03-25 04:41:50.963 DEBUG [src.node.waku_node] Container stopped.
2026-03-25 04:41:50.966 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-25 04:41:50.980 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-25 04:41:50.985 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-25 04:41:50.993 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-25 04:41:50.998 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-25 04:41:51.002 DEBUG [src.node.docker_mananger] No errors found in the waku logs.