177 lines
34 KiB
Plaintext

2026-02-26 04:43:14.128 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-26 04:43:14.129 DEBUG [tests.conftest] Running test: test_filter_get_message_while_one_peer_is_paused with id: 2026-02-26_04-43-14__2ada227d-cc18-4025-a3be-a119e0589830
2026-02-26 04:43:14.129 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-26 04:43:14.129 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-02-26 04:43:14.129 DEBUG [src.steps.filter] Running fixture setup: setup_main_relay_node
2026-02-26 04:43:14.137 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-26 04:43:14.137 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-26_04-43-14__2ada227d-cc18-4025-a3be-a119e0589830__wakuorg_nwaku:latest.log
2026-02-26 04:43:14.137 DEBUG [src.node.waku_node] Starting Node...
2026-02-26 04:43:14.137 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-26 04:43:14.139 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-26 04:43:14.139 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.102.65
2026-02-26 04:43:14.139 DEBUG [src.node.docker_mananger] Generated ports ['35719', '35720', '35721', '35722', '35723']
2026-02-26 04:43:14.139 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-26 04:43:14.140 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-26 04:43:14.140 DEBUG [src.node.waku_node] Using volumes []
2026-02-26 04:43:14.140 DEBUG [src.node.docker_mananger] docker run -i -t -p 35719:35719 -p 35720:35720 -p 35721:35721 -p 35722:35722 -p 35723:35723 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=35721 --rest-port=35719 --tcp-port=35720 --discv5-udp-port=35722 --rest-address=0.0.0.0 --nat=extip:172.18.102.65 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=be244ef0c3c4f23a298b133aaeb6285c10c3e5884fa0fab725caedcdaca4cebb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=35723 --metrics-logging=true --relay=true --filter=true
2026-02-26 04:43:14.321 ERROR [src.node.docker_mananger] Max retries reached for container 0ce146e58547. Exiting log stream.
2026-02-26 04:43:14.337 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.102.65 waku 6cf8427319e0f6be4fc8eeed83430ffe68b760cfaa9cd2119fb41b83571b1ae6
2026-02-26 04:43:14.371 DEBUG [src.node.docker_mananger] Container started with ID 6cf8427319e0. Setting up logs at ./log/docker/node1_2026-02-26_04-43-14__2ada227d-cc18-4025-a3be-a119e0589830__wakuorg_nwaku:latest.log
2026-02-26 04:43:14.371 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 35719
2026-02-26 04:43:14.373 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-26 04:43:14.764 ERROR [src.node.docker_mananger] Max retries reached for container b6b478245034. Exiting log stream.
2026-02-26 04:43:15.373 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35719/health" -H "Content-Type: application/json" -d 'None'
2026-02-26 04:43:15.376 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-26 04:43:15.376 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-26 04:43:15.376 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35719/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-26 04:43:15.379 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.102.65/tcp/35720/p2p/16Uiu2HAkwKxtxvtr8TgEjNyCuDZ9yki1astes8GBZqHFoSui8vZT","/ip4/172.18.102.65/tcp/35721/ws/p2p/16Uiu2HAkwKxtxvtr8TgEjNyCuDZ9yki1astes8GBZqHFoSui8vZT"],"enrUri":"enr:-L24QM9Ql1hhA_NYHa2IIMlcgm7koMIC8KHJgi4zYHgOKFf7OvkmJo2lYvk_g6XwYeKE0EYDTtqGtYgQH74INNt_GiUCgmlkgnY0gmlwhKwSZkGKbXVsdGlhZGRyc5YACASsEmZBBouIAAoErBJmQQaLid0DgnJzhQADAQAAiXNlY3AyNTZrMaECHEEETv4c_6fXZ3UnwchwkkqFDjW6iMqAXSkRBaYlgDaDdGNwgouIg3VkcIKLioV3YWt1MgU"}'
2026-02-26 04:43:15.379 INFO [src.node.waku_node] REST service is ready !!
2026-02-26 04:43:15.379 DEBUG [src.steps.filter] Running fixture setup: setup_main_filter_node
2026-02-26 04:43:15.386 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-26 04:43:15.386 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-26_04-43-14__2ada227d-cc18-4025-a3be-a119e0589830__wakuorg_nwaku:latest.log
2026-02-26 04:43:15.386 DEBUG [src.node.waku_node] Starting Node...
2026-02-26 04:43:15.386 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-26 04:43:15.388 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-26 04:43:15.388 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.242.211
2026-02-26 04:43:15.388 DEBUG [src.node.docker_mananger] Generated ports ['60461', '60462', '60463', '60464', '60465']
2026-02-26 04:43:15.388 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-26 04:43:15.388 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-26 04:43:15.388 DEBUG [src.node.waku_node] Using volumes []
2026-02-26 04:43:15.388 DEBUG [src.node.docker_mananger] docker run -i -t -p 60461:60461 -p 60462:60462 -p 60463:60463 -p 60464:60464 -p 60465:60465 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=60463 --rest-port=60461 --tcp-port=60462 --discv5-udp-port=60464 --rest-address=0.0.0.0 --nat=extip:172.18.242.211 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=d8dad1d719a7b0e596ade2fbcb2a4cf3c97fdba66e0b8e270937fd4bcebb0f1c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=60465 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QM9Ql1hhA_NYHa2IIMlcgm7koMIC8KHJgi4zYHgOKFf7OvkmJo2lYvk_g6XwYeKE0EYDTtqGtYgQH74INNt_GiUCgmlkgnY0gmlwhKwSZkGKbXVsdGlhZGRyc5YACASsEmZBBouIAAoErBJmQQaLid0DgnJzhQADAQAAiXNlY3AyNTZrMaECHEEETv4c_6fXZ3UnwchwkkqFDjW6iMqAXSkRBaYlgDaDdGNwgouIg3VkcIKLioV3YWt1MgU --filternode=/ip4/172.18.102.65/tcp/35720/p2p/16Uiu2HAkwKxtxvtr8TgEjNyCuDZ9yki1astes8GBZqHFoSui8vZT
2026-02-26 04:43:15.589 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.242.211 waku 47b5fdd54500ae79fc02a9e117d852a11bfc75507453d82bfdfcf63d6ea14090
2026-02-26 04:43:15.623 DEBUG [src.node.docker_mananger] Container started with ID 47b5fdd54500. Setting up logs at ./log/docker/node2_2026-02-26_04-43-14__2ada227d-cc18-4025-a3be-a119e0589830__wakuorg_nwaku:latest.log
2026-02-26 04:43:15.623 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 60461
2026-02-26 04:43:15.623 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-26 04:43:16.623 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60461/health" -H "Content-Type: application/json" -d 'None'
2026-02-26 04:43:16.627 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-26 04:43:16.627 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-26 04:43:16.627 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60461/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-26 04:43:16.629 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.242.211/tcp/60462/p2p/16Uiu2HAkvAsDSw5DL2xqoKZeXdeDTt2EGPo5XRbfdBX8h8NYpN3x","/ip4/172.18.242.211/tcp/60463/ws/p2p/16Uiu2HAkvAsDSw5DL2xqoKZeXdeDTt2EGPo5XRbfdBX8h8NYpN3x"],"enrUri":"enr:-L24QD0ZkTUVYhqLILHnxWgvIczCWiCKNEQX42rbAfZcs4m4TetERLLi6A_Vez4AYo7zUDb6BJrOVkD_Cr0PrQhjd-oCgmlkgnY0gmlwhKwS8tOKbXVsdGlhZGRyc5YACASsEvLTBuwuAAoErBLy0wbsL90DgnJzhQADAQAAiXNlY3AyNTZrMaECCxCtwKm0f3uGjsJ-IGXcWDuRG55um6LGJFeAQTP-Z8eDdGNwguwug3VkcILsMIV3YWt1MgA"}'
2026-02-26 04:43:16.630 INFO [src.node.waku_node] REST service is ready !!
2026-02-26 04:43:16.630 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60461/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.102.65/tcp/35720/p2p/16Uiu2HAkwKxtxvtr8TgEjNyCuDZ9yki1astes8GBZqHFoSui8vZT"]'
2026-02-26 04:43:16.665 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-26 04:43:16.675 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-26 04:43:16.676 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-26_04-43-14__2ada227d-cc18-4025-a3be-a119e0589830__wakuorg_nwaku:latest.log
2026-02-26 04:43:16.676 DEBUG [src.node.waku_node] Starting Node...
2026-02-26 04:43:16.676 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-26 04:43:16.677 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-26 04:43:16.678 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.167.51
2026-02-26 04:43:16.678 DEBUG [src.node.docker_mananger] Generated ports ['63026', '63027', '63028', '63029', '63030']
2026-02-26 04:43:16.678 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-26 04:43:16.678 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-26 04:43:16.678 DEBUG [src.node.waku_node] Using volumes []
2026-02-26 04:43:16.678 DEBUG [src.node.docker_mananger] docker run -i -t -p 63026:63026 -p 63027:63027 -p 63028:63028 -p 63029:63029 -p 63030:63030 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63028 --rest-port=63026 --tcp-port=63027 --discv5-udp-port=63029 --rest-address=0.0.0.0 --nat=extip:172.18.167.51 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f8c2a447b5739b9cc6621478b2afdcd9edbacaaf8fad2486d9acceae6ec34a23 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63030 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QM9Ql1hhA_NYHa2IIMlcgm7koMIC8KHJgi4zYHgOKFf7OvkmJo2lYvk_g6XwYeKE0EYDTtqGtYgQH74INNt_GiUCgmlkgnY0gmlwhKwSZkGKbXVsdGlhZGRyc5YACASsEmZBBouIAAoErBJmQQaLid0DgnJzhQADAQAAiXNlY3AyNTZrMaECHEEETv4c_6fXZ3UnwchwkkqFDjW6iMqAXSkRBaYlgDaDdGNwgouIg3VkcIKLioV3YWt1MgU --filternode=/ip4/172.18.102.65/tcp/35720/p2p/16Uiu2HAkwKxtxvtr8TgEjNyCuDZ9yki1astes8GBZqHFoSui8vZT
2026-02-26 04:43:16.888 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.167.51 waku ee0d0372411d66628e5d255ccce631414b9fdf5bcbf70bb2be18f990c292b9f5
2026-02-26 04:43:16.921 DEBUG [src.node.docker_mananger] Container started with ID ee0d0372411d. Setting up logs at ./log/docker/node3_2026-02-26_04-43-14__2ada227d-cc18-4025-a3be-a119e0589830__wakuorg_nwaku:latest.log
2026-02-26 04:43:16.922 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 63026
2026-02-26 04:43:16.922 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-26 04:43:17.922 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63026/health" -H "Content-Type: application/json" -d 'None'
2026-02-26 04:43:17.925 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-26 04:43:17.925 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-26 04:43:17.926 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63026/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-26 04:43:17.928 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.167.51/tcp/63027/p2p/16Uiu2HAmR5DkZwuscnLuYbDAsh7fiQg4oX6Efob7p3hRvfEousjM","/ip4/172.18.167.51/tcp/63028/ws/p2p/16Uiu2HAmR5DkZwuscnLuYbDAsh7fiQg4oX6Efob7p3hRvfEousjM"],"enrUri":"enr:-L24QHMOeLX9Xr0Dlsn5U8yKSTfbx_mrAa5kGAm54Z3JJNtMfBVMi1LN4OWHtLBjLCTMn0P002MsuF6bDBJET5spJtQCgmlkgnY0gmlwhKwSpzOKbXVsdGlhZGRyc5YACASsEqczBvYzAAoErBKnMwb2NN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDuIFV43i8UWu_jGacuDzzkZ5n8-HpO_uDhw_9baKwHsCDdGNwgvYzg3VkcIL2NYV3YWt1MgA"}'
2026-02-26 04:43:17.928 INFO [src.node.waku_node] REST service is ready !!
2026-02-26 04:43:17.928 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63026/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.102.65/tcp/35720/p2p/16Uiu2HAkwKxtxvtr8TgEjNyCuDZ9yki1astes8GBZqHFoSui8vZT"]'
2026-02-26 04:43:17.964 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-26 04:43:17.979 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-26 04:43:17.979 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-02-26_04-43-14__2ada227d-cc18-4025-a3be-a119e0589830__wakuorg_nwaku:latest.log
2026-02-26 04:43:17.979 DEBUG [src.node.waku_node] Starting Node...
2026-02-26 04:43:17.980 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-26 04:43:17.983 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-26 04:43:17.983 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.29.174
2026-02-26 04:43:17.984 DEBUG [src.node.docker_mananger] Generated ports ['3437', '3438', '3439', '3440', '3441']
2026-02-26 04:43:17.984 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-26 04:43:17.984 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-26 04:43:17.984 DEBUG [src.node.waku_node] Using volumes []
2026-02-26 04:43:17.985 DEBUG [src.node.docker_mananger] docker run -i -t -p 3437:3437 -p 3438:3438 -p 3439:3439 -p 3440:3440 -p 3441:3441 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3439 --rest-port=3437 --tcp-port=3438 --discv5-udp-port=3440 --rest-address=0.0.0.0 --nat=extip:172.18.29.174 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8adee4e6d32a21cde3bdae92ca263fb6e1cbc259907cc16eeaa1b0d9abdbe365 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3441 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QM9Ql1hhA_NYHa2IIMlcgm7koMIC8KHJgi4zYHgOKFf7OvkmJo2lYvk_g6XwYeKE0EYDTtqGtYgQH74INNt_GiUCgmlkgnY0gmlwhKwSZkGKbXVsdGlhZGRyc5YACASsEmZBBouIAAoErBJmQQaLid0DgnJzhQADAQAAiXNlY3AyNTZrMaECHEEETv4c_6fXZ3UnwchwkkqFDjW6iMqAXSkRBaYlgDaDdGNwgouIg3VkcIKLioV3YWt1MgU --filternode=/ip4/172.18.102.65/tcp/35720/p2p/16Uiu2HAkwKxtxvtr8TgEjNyCuDZ9yki1astes8GBZqHFoSui8vZT
2026-02-26 04:43:18.183 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.29.174 waku 5f0e3b1c10504d177b4aeea5004fdda44c09a78a48b3233c8ce9c0bef757b6fe
2026-02-26 04:43:18.220 DEBUG [src.node.docker_mananger] Container started with ID 5f0e3b1c1050. Setting up logs at ./log/docker/node4_2026-02-26_04-43-14__2ada227d-cc18-4025-a3be-a119e0589830__wakuorg_nwaku:latest.log
2026-02-26 04:43:18.220 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 3437
2026-02-26 04:43:18.221 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-26 04:43:19.222 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3437/health" -H "Content-Type: application/json" -d 'None'
2026-02-26 04:43:19.225 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-26 04:43:19.225 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-26 04:43:19.225 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3437/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-26 04:43:19.227 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.29.174/tcp/3438/p2p/16Uiu2HAm4QV4URtJgnFK25PbQsdVyRtt3LPMj9MBGtM6NMYkuduJ","/ip4/172.18.29.174/tcp/3439/ws/p2p/16Uiu2HAm4QV4URtJgnFK25PbQsdVyRtt3LPMj9MBGtM6NMYkuduJ"],"enrUri":"enr:-L24QGv3dtLFsoLTNE-kYmmBpXWyvPkhF3cuHm3aaGlN7n4fWSDeEKvrMZbqorPvqHmo0pI77SqejZhoYdGtHdsWFMQCgmlkgnY0gmlwhKwSHa6KbXVsdGlhZGRyc5YACASsEh2uBg1uAAoErBIdrgYNb90DgnJzhQADAQAAiXNlY3AyNTZrMaEChWtBSY-QTvygqJng3CsvNne6J3Xi7x5nVOOWi8KMD5mDdGNwgg1ug3VkcIINcIV3YWt1MgA"}'
2026-02-26 04:43:19.228 INFO [src.node.waku_node] REST service is ready !!
2026-02-26 04:43:19.228 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3437/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.102.65/tcp/35720/p2p/16Uiu2HAkwKxtxvtr8TgEjNyCuDZ9yki1astes8GBZqHFoSui8vZT"]'
2026-02-26 04:43:19.258 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-26 04:43:19.272 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-26 04:43:19.272 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-02-26_04-43-14__2ada227d-cc18-4025-a3be-a119e0589830__wakuorg_nwaku:latest.log
2026-02-26 04:43:19.272 DEBUG [src.node.waku_node] Starting Node...
2026-02-26 04:43:19.272 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-26 04:43:19.277 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-26 04:43:19.279 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.198.113
2026-02-26 04:43:19.279 DEBUG [src.node.docker_mananger] Generated ports ['63056', '63057', '63058', '63059', '63060']
2026-02-26 04:43:19.279 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-26 04:43:19.280 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-26 04:43:19.280 DEBUG [src.node.waku_node] Using volumes []
2026-02-26 04:43:19.280 DEBUG [src.node.docker_mananger] docker run -i -t -p 63056:63056 -p 63057:63057 -p 63058:63058 -p 63059:63059 -p 63060:63060 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63058 --rest-port=63056 --tcp-port=63057 --discv5-udp-port=63059 --rest-address=0.0.0.0 --nat=extip:172.18.198.113 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dcfcba20bf513bae96c1bcdb7ac34ba938a36bf66cdefe3b602fbdeb5efd411c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63060 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QM9Ql1hhA_NYHa2IIMlcgm7koMIC8KHJgi4zYHgOKFf7OvkmJo2lYvk_g6XwYeKE0EYDTtqGtYgQH74INNt_GiUCgmlkgnY0gmlwhKwSZkGKbXVsdGlhZGRyc5YACASsEmZBBouIAAoErBJmQQaLid0DgnJzhQADAQAAiXNlY3AyNTZrMaECHEEETv4c_6fXZ3UnwchwkkqFDjW6iMqAXSkRBaYlgDaDdGNwgouIg3VkcIKLioV3YWt1MgU --filternode=/ip4/172.18.102.65/tcp/35720/p2p/16Uiu2HAkwKxtxvtr8TgEjNyCuDZ9yki1astes8GBZqHFoSui8vZT
2026-02-26 04:43:19.478 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.198.113 waku 00ff5f2bddccb9ad3b31f2011ff7baae1b9efc0a9c5d7988568bb93cee3832c0
2026-02-26 04:43:19.515 DEBUG [src.node.docker_mananger] Container started with ID 00ff5f2bddcc. Setting up logs at ./log/docker/node5_2026-02-26_04-43-14__2ada227d-cc18-4025-a3be-a119e0589830__wakuorg_nwaku:latest.log
2026-02-26 04:43:19.515 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 63056
2026-02-26 04:43:19.515 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-26 04:43:20.516 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63056/health" -H "Content-Type: application/json" -d 'None'
2026-02-26 04:43:20.519 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-26 04:43:20.519 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-26 04:43:20.519 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63056/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-26 04:43:20.522 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.198.113/tcp/63057/p2p/16Uiu2HAm2w4e3gN71bFJsUtXztnFYG4qaFDPQK2gWJd7Hed2B1zh","/ip4/172.18.198.113/tcp/63058/ws/p2p/16Uiu2HAm2w4e3gN71bFJsUtXztnFYG4qaFDPQK2gWJd7Hed2B1zh"],"enrUri":"enr:-L24QObNmGQjxrXiCMcjwmPDAdCczgMJrTk-gLLRwu8UK1P2HvRaPNghhEFHE2qVECE_112EkUb4KXyPcikKISE9rXgCgmlkgnY0gmlwhKwSxnGKbXVsdGlhZGRyc5YACASsEsZxBvZRAAoErBLGcQb2Ut0DgnJzhQADAQAAiXNlY3AyNTZrMaECb4lF7sHKffs9W6lbuiZv_U_eR1Z5NGrTWQo9kdKfo3KDdGNwgvZRg3VkcIL2U4V3YWt1MgA"}'
2026-02-26 04:43:20.522 INFO [src.node.waku_node] REST service is ready !!
2026-02-26 04:43:20.522 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63056/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.102.65/tcp/35720/p2p/16Uiu2HAkwKxtxvtr8TgEjNyCuDZ9yki1astes8GBZqHFoSui8vZT"]'
2026-02-26 04:43:20.558 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-26 04:43:20.561 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35719/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-26 04:43:20.567 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-26 04:43:20.569 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60461/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "15ddd4d8-0176-4a92-9132-8999aa6fea83", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-26 04:43:20.583 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"15ddd4d8-0176-4a92-9132-8999aa6fea83","statusDesc":"OK"}'
2026-02-26 04:43:20.583 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63026/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "e9839ef8-4b29-411e-835f-687d6642ef46", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-26 04:43:20.593 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"e9839ef8-4b29-411e-835f-687d6642ef46","statusDesc":"OK"}'
2026-02-26 04:43:20.594 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3437/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "307e0e4c-96a3-40e0-9f4b-ab24173d566a", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-26 04:43:20.603 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"307e0e4c-96a3-40e0-9f4b-ab24173d566a","statusDesc":"OK"}'
2026-02-26 04:43:20.604 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63056/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "b3e92bd6-d565-4fe0-a127-6a49c17456d4", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-26 04:43:20.614 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"b3e92bd6-d565-4fe0-a127-6a49c17456d4","statusDesc":"OK"}'
2026-02-26 04:43:20.614 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35719/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-26 04:43:20.630 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-26 04:43:20.631 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-02-26 04:43:20.731 DEBUG [src.steps.filter] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-02-26 04:43:20.732 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60461/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-26 04:43:20.735 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772081000614522963,"ephemeral":false}]'
2026-02-26 04:43:20.737 DEBUG [src.steps.filter] Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
2026-02-26 04:43:20.737 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63026/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-26 04:43:20.739 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772081000614522963,"ephemeral":false}]'
2026-02-26 04:43:20.741 DEBUG [src.steps.filter] Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message
2026-02-26 04:43:20.741 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3437/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-26 04:43:20.744 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772081000614522963,"ephemeral":false}]'
2026-02-26 04:43:20.746 DEBUG [src.steps.filter] Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message
2026-02-26 04:43:20.746 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63056/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-26 04:43:20.749 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772081000614522963,"ephemeral":false}]'
2026-02-26 04:43:20.750 DEBUG [src.node.waku_node] Pausing container with id 47b5fdd54500
2026-02-26 04:43:20.761 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35719/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-26 04:43:20.767 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-26 04:43:20.768 DEBUG [src.node.waku_node] Unpause container with id 47b5fdd54500
2026-02-26 04:43:20.777 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35719/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-26 04:43:20.784 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-26 04:43:20.784 DEBUG [src.libs.common] Sleeping for 0.5 seconds
2026-02-26 04:43:21.285 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60461/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-26 04:43:21.288 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772081000750537192,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772081000750613424,"ephemeral":false}]'
2026-02-26 04:43:21.290 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-26 04:43:21.291 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-26 04:43:21.291 DEBUG [src.node.waku_node] Stopping container with id 6cf8427319e0
2026-02-26 04:43:21.879 DEBUG [src.node.waku_node] Container stopped.
2026-02-26 04:43:21.879 DEBUG [src.node.waku_node] Stopping container with id 47b5fdd54500
2026-02-26 04:43:22.524 DEBUG [src.node.waku_node] Container stopped.
2026-02-26 04:43:22.525 DEBUG [src.node.waku_node] Stopping container with id ee0d0372411d
2026-02-26 04:43:22.752 ERROR [src.node.docker_mananger] Max retries reached for container 6cf8427319e0. Exiting log stream.
2026-02-26 04:43:23.143 DEBUG [src.node.waku_node] Container stopped.
2026-02-26 04:43:23.144 DEBUG [src.node.waku_node] Stopping container with id 5f0e3b1c1050
2026-02-26 04:43:23.342 ERROR [src.node.docker_mananger] Max retries reached for container 47b5fdd54500. Exiting log stream.
2026-02-26 04:43:23.711 DEBUG [src.node.waku_node] Container stopped.
2026-02-26 04:43:23.711 DEBUG [src.node.waku_node] Stopping container with id 00ff5f2bddcc
2026-02-26 04:43:23.956 ERROR [src.node.docker_mananger] Max retries reached for container ee0d0372411d. Exiting log stream.
2026-02-26 04:43:24.290 DEBUG [src.node.waku_node] Container stopped.
2026-02-26 04:43:24.291 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-26 04:43:24.319 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-26 04:43:24.324 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-26 04:43:24.329 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-26 04:43:24.334 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-26 04:43:24.339 DEBUG [src.node.docker_mananger] No errors found in the waku logs.