2026-02-25 20:22:16 +00:00

177 lines
34 KiB
Plaintext

2026-02-25 20:12:25.582 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-25 20:12:25.582 DEBUG [tests.conftest] Running test: test_filter_get_message_while_one_peer_is_paused with id: 2026-02-25_20-12-25__9115c195-f6eb-4686-ac59-1432d12ebf72
2026-02-25 20:12:25.583 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-25 20:12:25.583 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-02-25 20:12:25.583 DEBUG [src.steps.filter] Running fixture setup: setup_main_relay_node
2026-02-25 20:12:25.591 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 20:12:25.591 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-25_20-12-25__9115c195-f6eb-4686-ac59-1432d12ebf72__wakuorg_nwaku:latest.log
2026-02-25 20:12:25.592 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 20:12:25.592 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 20:12:25.593 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 20:12:25.594 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.102.225
2026-02-25 20:12:25.594 DEBUG [src.node.docker_mananger] Generated ports ['49621', '49622', '49623', '49624', '49625']
2026-02-25 20:12:25.594 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 20:12:25.594 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 20:12:25.594 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 20:12:25.594 DEBUG [src.node.docker_mananger] docker run -i -t -p 49621:49621 -p 49622:49622 -p 49623:49623 -p 49624:49624 -p 49625:49625 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=49623 --rest-port=49621 --tcp-port=49622 --discv5-udp-port=49624 --rest-address=0.0.0.0 --nat=extip:172.18.102.225 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a2dc2dedf191da39f36ed0d715a75275eeeab377f3ed9b20c4b20a64c9dfad1c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=49625 --metrics-logging=true --relay=true --filter=true
2026-02-25 20:12:25.763 ERROR [src.node.docker_mananger] Max retries reached for container 71e0d419b0f1. Exiting log stream.
2026-02-25 20:12:25.821 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.102.225 waku 1ab01f351274cbe61077fc55c3a7b94523b3431d25cb9cec31d39b42a36acd31
2026-02-25 20:12:25.863 DEBUG [src.node.docker_mananger] Container started with ID 1ab01f351274. Setting up logs at ./log/docker/node1_2026-02-25_20-12-25__9115c195-f6eb-4686-ac59-1432d12ebf72__wakuorg_nwaku:latest.log
2026-02-25 20:12:25.864 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 49621
2026-02-25 20:12:25.864 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 20:12:26.206 ERROR [src.node.docker_mananger] Max retries reached for container 658f90760ccd. Exiting log stream.
2026-02-25 20:12:26.865 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49621/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:12:26.867 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 20:12:26.868 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 20:12:26.868 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49621/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:12:26.870 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.102.225/tcp/49622/p2p/16Uiu2HAmP4Z3pT8i8qnpktK797UvsokAtCh2n9uEEGVsxwaUSZVX","/ip4/172.18.102.225/tcp/49623/ws/p2p/16Uiu2HAmP4Z3pT8i8qnpktK797UvsokAtCh2n9uEEGVsxwaUSZVX"],"enrUri":"enr:-L24QG1ZFRhED1XOdZ5_uQN_J7WMPvE-lBpLPInRmmxyyitYJwCIHtMqieXHS-2RoV6cG_f2vHuplVICKG2C8RmwlbsCgmlkgnY0gmlwhKwSZuGKbXVsdGlhZGRyc5YACASsEmbhBsHWAAoErBJm4QbB190DgnJzhQADAQAAiXNlY3AyNTZrMaEDmp4zU8YE-AtJCVS140fCE1W0LLicBMtJyWYhIkP1NC6DdGNwgsHWg3VkcILB2IV3YWt1MgU"}'
2026-02-25 20:12:26.870 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 20:12:26.871 DEBUG [src.steps.filter] Running fixture setup: setup_main_filter_node
2026-02-25 20:12:26.877 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 20:12:26.878 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-25_20-12-25__9115c195-f6eb-4686-ac59-1432d12ebf72__wakuorg_nwaku:latest.log
2026-02-25 20:12:26.878 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 20:12:26.878 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 20:12:26.879 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 20:12:26.879 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.192.52
2026-02-25 20:12:26.879 DEBUG [src.node.docker_mananger] Generated ports ['64759', '64760', '64761', '64762', '64763']
2026-02-25 20:12:26.880 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 20:12:26.880 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 20:12:26.880 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 20:12:26.880 DEBUG [src.node.docker_mananger] docker run -i -t -p 64759:64759 -p 64760:64760 -p 64761:64761 -p 64762:64762 -p 64763:64763 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=64761 --rest-port=64759 --tcp-port=64760 --discv5-udp-port=64762 --rest-address=0.0.0.0 --nat=extip:172.18.192.52 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=1feee4b86555aeb3d804cb5317c03dc3e57d9b3bd5ee41b81fa5b9b40e102254 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=64763 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QG1ZFRhED1XOdZ5_uQN_J7WMPvE-lBpLPInRmmxyyitYJwCIHtMqieXHS-2RoV6cG_f2vHuplVICKG2C8RmwlbsCgmlkgnY0gmlwhKwSZuGKbXVsdGlhZGRyc5YACASsEmbhBsHWAAoErBJm4QbB190DgnJzhQADAQAAiXNlY3AyNTZrMaEDmp4zU8YE-AtJCVS140fCE1W0LLicBMtJyWYhIkP1NC6DdGNwgsHWg3VkcILB2IV3YWt1MgU --filternode=/ip4/172.18.102.225/tcp/49622/p2p/16Uiu2HAmP4Z3pT8i8qnpktK797UvsokAtCh2n9uEEGVsxwaUSZVX
2026-02-25 20:12:27.080 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.192.52 waku d41a5d2ab76e442c5677808a859171eb9bcaa6c4adfc672f44ab6b9822e09b41
2026-02-25 20:12:27.116 DEBUG [src.node.docker_mananger] Container started with ID d41a5d2ab76e. Setting up logs at ./log/docker/node2_2026-02-25_20-12-25__9115c195-f6eb-4686-ac59-1432d12ebf72__wakuorg_nwaku:latest.log
2026-02-25 20:12:27.116 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 64759
2026-02-25 20:12:27.116 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 20:12:28.117 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64759/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:12:28.120 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 20:12:28.120 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 20:12:28.120 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64759/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:12:28.123 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.192.52/tcp/64760/p2p/16Uiu2HAm4ka8zkXp7tXof8fNCpCuet7KBQNGxgCtZCHbrKYAM8Vb","/ip4/172.18.192.52/tcp/64761/ws/p2p/16Uiu2HAm4ka8zkXp7tXof8fNCpCuet7KBQNGxgCtZCHbrKYAM8Vb"],"enrUri":"enr:-L24QIl8tWQBk0MQVm6-zbXeeW7RKMXn1FoJjWoTFwnls1iyX9kMbU6wjkHm6J2sQl_kOdFFToVV7sHYgOYQCn_aCkcCgmlkgnY0gmlwhKwSwDSKbXVsdGlhZGRyc5YACASsEsA0Bvz4AAoErBLANAb8-d0DgnJzhQADAQAAiXNlY3AyNTZrMaECipCc5vm5GeftrKPLvOD1oBfMio9mNcX2EI1AE0rTMoaDdGNwgvz4g3VkcIL8-oV3YWt1MgA"}'
2026-02-25 20:12:28.123 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 20:12:28.123 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64759/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.102.225/tcp/49622/p2p/16Uiu2HAmP4Z3pT8i8qnpktK797UvsokAtCh2n9uEEGVsxwaUSZVX"]'
2026-02-25 20:12:28.155 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:12:28.170 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 20:12:28.170 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-25_20-12-25__9115c195-f6eb-4686-ac59-1432d12ebf72__wakuorg_nwaku:latest.log
2026-02-25 20:12:28.171 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 20:12:28.171 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 20:12:28.173 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 20:12:28.173 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.81.106
2026-02-25 20:12:28.173 DEBUG [src.node.docker_mananger] Generated ports ['43243', '43244', '43245', '43246', '43247']
2026-02-25 20:12:28.173 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 20:12:28.174 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 20:12:28.175 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 20:12:28.175 DEBUG [src.node.docker_mananger] docker run -i -t -p 43243:43243 -p 43244:43244 -p 43245:43245 -p 43246:43246 -p 43247:43247 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=43245 --rest-port=43243 --tcp-port=43244 --discv5-udp-port=43246 --rest-address=0.0.0.0 --nat=extip:172.18.81.106 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f9b1fed655c1ef9323dcbdc5adbe12dbd0c2be9432deccfcbb88edaffd4dc26d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=43247 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QG1ZFRhED1XOdZ5_uQN_J7WMPvE-lBpLPInRmmxyyitYJwCIHtMqieXHS-2RoV6cG_f2vHuplVICKG2C8RmwlbsCgmlkgnY0gmlwhKwSZuGKbXVsdGlhZGRyc5YACASsEmbhBsHWAAoErBJm4QbB190DgnJzhQADAQAAiXNlY3AyNTZrMaEDmp4zU8YE-AtJCVS140fCE1W0LLicBMtJyWYhIkP1NC6DdGNwgsHWg3VkcILB2IV3YWt1MgU --filternode=/ip4/172.18.102.225/tcp/49622/p2p/16Uiu2HAmP4Z3pT8i8qnpktK797UvsokAtCh2n9uEEGVsxwaUSZVX
2026-02-25 20:12:28.387 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.81.106 waku 03131fca9814963692b4cb4b82f589909f159a7349d89313fca2cd4d2ee6fdf2
2026-02-25 20:12:28.421 DEBUG [src.node.docker_mananger] Container started with ID 03131fca9814. Setting up logs at ./log/docker/node3_2026-02-25_20-12-25__9115c195-f6eb-4686-ac59-1432d12ebf72__wakuorg_nwaku:latest.log
2026-02-25 20:12:28.421 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 43243
2026-02-25 20:12:28.421 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 20:12:29.422 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43243/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:12:29.425 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 20:12:29.425 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 20:12:29.425 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43243/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:12:29.428 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.81.106/tcp/43244/p2p/16Uiu2HAmKFcncG46uAxj6Q8tH5tF9xCFrDGJsmwR9jKnDjLaaz7v","/ip4/172.18.81.106/tcp/43245/ws/p2p/16Uiu2HAmKFcncG46uAxj6Q8tH5tF9xCFrDGJsmwR9jKnDjLaaz7v"],"enrUri":"enr:-L24QEPInl6YqqtRGh_HuswUiFJrsOKO86V6PhD4KnTeFwfJHdPmXrrarh0KNJ6FPN6NzwxfNjb0oCuHupjjO8RnifICgmlkgnY0gmlwhKwSUWqKbXVsdGlhZGRyc5YACASsElFqBqjsAAoErBJRagao7d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDYgURZ3UpvH5DDalxaa8ZMkp3-wK8wIYgydyWDm8YBS2DdGNwgqjsg3VkcIKo7oV3YWt1MgA"}'
2026-02-25 20:12:29.428 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 20:12:29.428 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43243/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.102.225/tcp/49622/p2p/16Uiu2HAmP4Z3pT8i8qnpktK797UvsokAtCh2n9uEEGVsxwaUSZVX"]'
2026-02-25 20:12:29.464 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:12:29.477 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 20:12:29.479 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-02-25_20-12-25__9115c195-f6eb-4686-ac59-1432d12ebf72__wakuorg_nwaku:latest.log
2026-02-25 20:12:29.480 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 20:12:29.481 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 20:12:29.484 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 20:12:29.485 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.53.253
2026-02-25 20:12:29.485 DEBUG [src.node.docker_mananger] Generated ports ['61915', '61916', '61917', '61918', '61919']
2026-02-25 20:12:29.485 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 20:12:29.485 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 20:12:29.489 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 20:12:29.489 DEBUG [src.node.docker_mananger] docker run -i -t -p 61915:61915 -p 61916:61916 -p 61917:61917 -p 61918:61918 -p 61919:61919 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=61917 --rest-port=61915 --tcp-port=61916 --discv5-udp-port=61918 --rest-address=0.0.0.0 --nat=extip:172.18.53.253 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cca1a1c13baf3edcdaecaa2d5a07b2afc8c5e5b54a14316cdbbcc4b84d3293fd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=61919 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QG1ZFRhED1XOdZ5_uQN_J7WMPvE-lBpLPInRmmxyyitYJwCIHtMqieXHS-2RoV6cG_f2vHuplVICKG2C8RmwlbsCgmlkgnY0gmlwhKwSZuGKbXVsdGlhZGRyc5YACASsEmbhBsHWAAoErBJm4QbB190DgnJzhQADAQAAiXNlY3AyNTZrMaEDmp4zU8YE-AtJCVS140fCE1W0LLicBMtJyWYhIkP1NC6DdGNwgsHWg3VkcILB2IV3YWt1MgU --filternode=/ip4/172.18.102.225/tcp/49622/p2p/16Uiu2HAmP4Z3pT8i8qnpktK797UvsokAtCh2n9uEEGVsxwaUSZVX
2026-02-25 20:12:29.700 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.53.253 waku 28d58c4efc9180be0965a7c756cc0332116ebead1aca8f82ea28e82d2a619553
2026-02-25 20:12:29.739 DEBUG [src.node.docker_mananger] Container started with ID 28d58c4efc91. Setting up logs at ./log/docker/node4_2026-02-25_20-12-25__9115c195-f6eb-4686-ac59-1432d12ebf72__wakuorg_nwaku:latest.log
2026-02-25 20:12:29.739 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 61915
2026-02-25 20:12:29.739 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 20:12:30.741 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61915/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:12:30.744 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 20:12:30.744 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 20:12:30.744 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61915/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:12:30.747 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.53.253/tcp/61916/p2p/16Uiu2HAm1exAySL3J9EHEUhVRgpuca351HovaZwLPaWkQKHVZVSt","/ip4/172.18.53.253/tcp/61917/ws/p2p/16Uiu2HAm1exAySL3J9EHEUhVRgpuca351HovaZwLPaWkQKHVZVSt"],"enrUri":"enr:-L24QOo0kk_lQflP2bXW4njWNgF60Fbr7Fg31y5xTuNkfyBEEKo80XaQwOztJnRtPYO17xPC8k0ufibJRtiDhIr_dm0CgmlkgnY0gmlwhKwSNf2KbXVsdGlhZGRyc5YACASsEjX9BvHcAAoErBI1_Qbx3d0DgnJzhQADAQAAiXNlY3AyNTZrMaECXIz7NgroVkKDNyITaMm3b9lNQdtHagUa28UDxDn65Y2DdGNwgvHcg3VkcILx3oV3YWt1MgA"}'
2026-02-25 20:12:30.747 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 20:12:30.747 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61915/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.102.225/tcp/49622/p2p/16Uiu2HAmP4Z3pT8i8qnpktK797UvsokAtCh2n9uEEGVsxwaUSZVX"]'
2026-02-25 20:12:30.786 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:12:30.797 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 20:12:30.797 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-02-25_20-12-25__9115c195-f6eb-4686-ac59-1432d12ebf72__wakuorg_nwaku:latest.log
2026-02-25 20:12:30.798 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 20:12:30.798 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 20:12:30.801 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 20:12:30.801 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.23.187
2026-02-25 20:12:30.802 DEBUG [src.node.docker_mananger] Generated ports ['17721', '17722', '17723', '17724', '17725']
2026-02-25 20:12:30.802 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 20:12:30.802 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 20:12:30.802 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 20:12:30.802 DEBUG [src.node.docker_mananger] docker run -i -t -p 17721:17721 -p 17722:17722 -p 17723:17723 -p 17724:17724 -p 17725:17725 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17723 --rest-port=17721 --tcp-port=17722 --discv5-udp-port=17724 --rest-address=0.0.0.0 --nat=extip:172.18.23.187 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fcaf4fa1dbb6bacb8dabb023b2c3aef35bfe0c5ba97cea02b6bbbdb4b6556d3c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17725 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QG1ZFRhED1XOdZ5_uQN_J7WMPvE-lBpLPInRmmxyyitYJwCIHtMqieXHS-2RoV6cG_f2vHuplVICKG2C8RmwlbsCgmlkgnY0gmlwhKwSZuGKbXVsdGlhZGRyc5YACASsEmbhBsHWAAoErBJm4QbB190DgnJzhQADAQAAiXNlY3AyNTZrMaEDmp4zU8YE-AtJCVS140fCE1W0LLicBMtJyWYhIkP1NC6DdGNwgsHWg3VkcILB2IV3YWt1MgU --filternode=/ip4/172.18.102.225/tcp/49622/p2p/16Uiu2HAmP4Z3pT8i8qnpktK797UvsokAtCh2n9uEEGVsxwaUSZVX
2026-02-25 20:12:31.008 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.23.187 waku c767610926c4fbc08d84a6106cec5a28a937f96c6a1158b06d906b124e9d70f9
2026-02-25 20:12:31.042 DEBUG [src.node.docker_mananger] Container started with ID c767610926c4. Setting up logs at ./log/docker/node5_2026-02-25_20-12-25__9115c195-f6eb-4686-ac59-1432d12ebf72__wakuorg_nwaku:latest.log
2026-02-25 20:12:31.043 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 17721
2026-02-25 20:12:31.043 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 20:12:32.043 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17721/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:12:32.046 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 20:12:32.047 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 20:12:32.047 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17721/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:12:32.049 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.23.187/tcp/17722/p2p/16Uiu2HAmG2k26hGB7U3meme6gx4ynzkvXqVgYn3iQGmmDGZvURkV","/ip4/172.18.23.187/tcp/17723/ws/p2p/16Uiu2HAmG2k26hGB7U3meme6gx4ynzkvXqVgYn3iQGmmDGZvURkV"],"enrUri":"enr:-L24QEgLJ9-w5Ip7DJv72_v_wmkseHdTmO08bZMrN1Ppt2NVLcdxv5Ml73RGereKF9Fv9ur4raJVyNIvsvfKWF6__2cCgmlkgnY0gmlwhKwSF7uKbXVsdGlhZGRyc5YACASsEhe7BkU6AAoErBIXuwZFO90DgnJzhQADAQAAiXNlY3AyNTZrMaEDMiWidWmBiw8TArNeQo5HZNOvK6C7joxiktjfCAl604KDdGNwgkU6g3VkcIJFPIV3YWt1MgA"}'
2026-02-25 20:12:32.049 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 20:12:32.050 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17721/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.102.225/tcp/49622/p2p/16Uiu2HAmP4Z3pT8i8qnpktK797UvsokAtCh2n9uEEGVsxwaUSZVX"]'
2026-02-25 20:12:32.088 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:12:32.089 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:49621/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 20:12:32.096 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:12:32.099 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64759/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "e03bafb7-3dd2-4fc3-ad22-9b933a5df963", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-25 20:12:32.113 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"e03bafb7-3dd2-4fc3-ad22-9b933a5df963","statusDesc":"OK"}'
2026-02-25 20:12:32.114 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43243/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "46f40ad0-944c-4280-acaa-03a67b1a7a93", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-25 20:12:32.131 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"46f40ad0-944c-4280-acaa-03a67b1a7a93","statusDesc":"OK"}'
2026-02-25 20:12:32.132 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61915/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "6c0c9934-b153-48e4-9595-4319f9d24cae", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-25 20:12:32.143 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"6c0c9934-b153-48e4-9595-4319f9d24cae","statusDesc":"OK"}'
2026-02-25 20:12:32.144 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17721/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "72d87765-6ee2-422c-aa00-9f41c08d7490", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-25 20:12:32.154 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"72d87765-6ee2-422c-aa00-9f41c08d7490","statusDesc":"OK"}'
2026-02-25 20:12:32.154 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:49621/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 20:12:32.171 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:12:32.172 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-02-25 20:12:32.273 DEBUG [src.steps.filter] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-02-25 20:12:32.273 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64759/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:12:32.276 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772050352154789275,"ephemeral":false}]'
2026-02-25 20:12:32.278 DEBUG [src.steps.filter] Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
2026-02-25 20:12:32.278 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43243/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:12:32.281 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772050352154789275,"ephemeral":false}]'
2026-02-25 20:12:32.282 DEBUG [src.steps.filter] Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message
2026-02-25 20:12:32.283 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61915/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:12:32.285 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772050352154789275,"ephemeral":false}]'
2026-02-25 20:12:32.287 DEBUG [src.steps.filter] Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message
2026-02-25 20:12:32.287 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17721/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:12:32.290 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772050352154789275,"ephemeral":false}]'
2026-02-25 20:12:32.291 DEBUG [src.node.waku_node] Pausing container with id d41a5d2ab76e
2026-02-25 20:12:32.312 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:49621/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 20:12:32.319 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:12:32.319 DEBUG [src.node.waku_node] Unpause container with id d41a5d2ab76e
2026-02-25 20:12:32.329 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:49621/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 20:12:32.336 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 20:12:32.336 DEBUG [src.libs.common] Sleeping for 0.5 seconds
2026-02-25 20:12:32.837 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64759/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-25 20:12:32.840 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772050352291852597,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772050352291926695,"ephemeral":false}]'
2026-02-25 20:12:32.841 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-25 20:12:32.842 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-25 20:12:32.843 DEBUG [src.node.waku_node] Stopping container with id 1ab01f351274
2026-02-25 20:12:33.449 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 20:12:33.450 DEBUG [src.node.waku_node] Stopping container with id d41a5d2ab76e
2026-02-25 20:12:34.104 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 20:12:34.107 DEBUG [src.node.waku_node] Stopping container with id 03131fca9814
2026-02-25 20:12:34.264 ERROR [src.node.docker_mananger] Max retries reached for container 1ab01f351274. Exiting log stream.
2026-02-25 20:12:34.719 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 20:12:34.719 DEBUG [src.node.waku_node] Stopping container with id 28d58c4efc91
2026-02-25 20:12:34.922 ERROR [src.node.docker_mananger] Max retries reached for container d41a5d2ab76e. Exiting log stream.
2026-02-25 20:12:35.293 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 20:12:35.293 DEBUG [src.node.waku_node] Stopping container with id c767610926c4
2026-02-25 20:12:35.532 ERROR [src.node.docker_mananger] Max retries reached for container 03131fca9814. Exiting log stream.
2026-02-25 20:12:35.868 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 20:12:35.871 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-25 20:12:35.885 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 20:12:35.889 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 20:12:35.894 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 20:12:35.902 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 20:12:35.906 DEBUG [src.node.docker_mananger] No errors found in the waku logs.