2026-03-18 09:27:31 +00:00

177 lines
35 KiB
Plaintext

2026-03-18 09:13:46.606 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-18 09:13:46.607 DEBUG [tests.conftest] Running test: test_filter_get_message_while_one_peer_is_paused with id: 2026-03-18_09-13-46__05bdd961-753a-47e0-8832-435dc4e0804c
2026-03-18 09:13:46.607 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-18 09:13:46.607 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-18 09:13:46.608 DEBUG [src.steps.filter] Running fixture setup: setup_main_relay_node
2026-03-18 09:13:46.615 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-18 09:13:46.615 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-18_09-13-46__05bdd961-753a-47e0-8832-435dc4e0804c__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:13:46.615 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 09:13:46.615 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 09:13:46.617 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 09:13:46.617 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.244.171
2026-03-18 09:13:46.617 DEBUG [src.node.docker_mananger] Generated ports ['54207', '54208', '54209', '54210', '54211']
2026-03-18 09:13:46.617 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 09:13:46.618 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 09:13:46.618 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 09:13:46.618 DEBUG [src.node.docker_mananger] docker run -i -t -p 54207:54207 -p 54208:54208 -p 54209:54209 -p 54210:54210 -p 54211:54211 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=54209 --rest-port=54207 --tcp-port=54208 --discv5-udp-port=54210 --rest-address=0.0.0.0 --nat=extip:172.18.244.171 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=f8327ef3e86ce88c1f66bfc4bcbac2038df2ad359fcb4756d7eedc95f5aa0d26 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=54211 --metrics-logging=true --relay=true --filter=true
2026-03-18 09:13:46.622 ERROR [src.node.docker_mananger] Max retries reached for container 3bf0ed3606ce. Exiting log stream.
2026-03-18 09:13:46.822 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.244.171 waku 1eb40d12c33de5e65f2c2e4a1ff6e5c2825f0d0648d9ce54b16cfa28bc0b49ae
2026-03-18 09:13:46.855 DEBUG [src.node.docker_mananger] Container started with ID 1eb40d12c33d. Setting up logs at ./log/docker/node1_2026-03-18_09-13-46__05bdd961-753a-47e0-8832-435dc4e0804c__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:13:46.856 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 54207
2026-03-18 09:13:46.857 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 09:13:47.407 ERROR [src.node.docker_mananger] Max retries reached for container 047434dc6604. Exiting log stream.
2026-03-18 09:13:47.858 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54207/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:13:47.861 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 09:13:47.862 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 09:13:47.862 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54207/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:13:47.864 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.244.171/tcp/54208/p2p/16Uiu2HAm8tR3T94nenxWUmCkUrgyvhkY2StLsAg2cE6ey8YD3Tun","/ip4/172.18.244.171/tcp/54209/ws/p2p/16Uiu2HAm8tR3T94nenxWUmCkUrgyvhkY2StLsAg2cE6ey8YD3Tun"],"enrUri":"enr:-L24QBLFdecMGPh-h6lkCY_PbL4sqjWqg9R3SfQnFxRb3QrcXvHASmUO8UrmP58n3ni8Y-lq8AuR06WDLhS_9I9WY3sCgmlkgnY0gmlwhKwS9KuKbXVsdGlhZGRyc5YACASsEvSrBtPAAAoErBL0qwbTwd0DgnJzhQDGAQAAiXNlY3AyNTZrMaECyAG4_0h7318qN60aNPbnlDMa-o99D9ig-x7Yuqspa82DdGNwgtPAg3VkcILTwoV3YWt1MgU"}'
2026-03-18 09:13:47.864 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 09:13:47.865 DEBUG [src.steps.filter] Running fixture setup: setup_main_filter_node
2026-03-18 09:13:47.872 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-18 09:13:47.872 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-18_09-13-46__05bdd961-753a-47e0-8832-435dc4e0804c__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:13:47.872 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 09:13:47.872 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 09:13:47.874 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 09:13:47.874 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.96.229
2026-03-18 09:13:47.874 DEBUG [src.node.docker_mananger] Generated ports ['20202', '20203', '20204', '20205', '20206']
2026-03-18 09:13:47.874 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 09:13:47.874 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 09:13:47.874 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 09:13:47.875 DEBUG [src.node.docker_mananger] docker run -i -t -p 20202:20202 -p 20203:20203 -p 20204:20204 -p 20205:20205 -p 20206:20206 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=20204 --rest-port=20202 --tcp-port=20203 --discv5-udp-port=20205 --rest-address=0.0.0.0 --nat=extip:172.18.96.229 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=ffa479d83bb69dd2effccaa60bf5ceeaa2df11465952d28c06090e3ff0b22c0a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=20206 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QBLFdecMGPh-h6lkCY_PbL4sqjWqg9R3SfQnFxRb3QrcXvHASmUO8UrmP58n3ni8Y-lq8AuR06WDLhS_9I9WY3sCgmlkgnY0gmlwhKwS9KuKbXVsdGlhZGRyc5YACASsEvSrBtPAAAoErBL0qwbTwd0DgnJzhQDGAQAAiXNlY3AyNTZrMaECyAG4_0h7318qN60aNPbnlDMa-o99D9ig-x7Yuqspa82DdGNwgtPAg3VkcILTwoV3YWt1MgU --filternode=/ip4/172.18.244.171/tcp/54208/p2p/16Uiu2HAm8tR3T94nenxWUmCkUrgyvhkY2StLsAg2cE6ey8YD3Tun
2026-03-18 09:13:48.075 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.96.229 waku f50ecec5ddf22163dddaf8d8b82ea25dec24fa4c02b40e9279349b79546e117d
2026-03-18 09:13:48.107 DEBUG [src.node.docker_mananger] Container started with ID f50ecec5ddf2. Setting up logs at ./log/docker/node2_2026-03-18_09-13-46__05bdd961-753a-47e0-8832-435dc4e0804c__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:13:48.108 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 20202
2026-03-18 09:13:48.108 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 09:13:49.108 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20202/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:13:49.112 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 09:13:49.112 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 09:13:49.112 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20202/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:13:49.114 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.96.229/tcp/20203/p2p/16Uiu2HAmQyi8piz1Q4CNSs45Wx8knhsWFUsNyKh6iKczyhnSt5V6","/ip4/172.18.96.229/tcp/20204/ws/p2p/16Uiu2HAmQyi8piz1Q4CNSs45Wx8knhsWFUsNyKh6iKczyhnSt5V6"],"enrUri":"enr:-L24QMHjLy3GOtvM0EfOtNNPAa3_lSxG_7Rizxl0ttVweYe3BYzxfxRGiHCHWlTFqttIEQg2YojjSlroNkoRzlzgTC4CgmlkgnY0gmlwhKwSYOWKbXVsdGlhZGRyc5YACASsEmDlBk7rAAoErBJg5QZO7N0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDtxfxt0t14kC1HYBa318KVhuMNPb6jUGloQQLZMgn8ZWDdGNwgk7rg3VkcIJO7YV3YWt1MgA"}'
2026-03-18 09:13:49.114 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 09:13:49.115 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20202/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.244.171/tcp/54208/p2p/16Uiu2HAm8tR3T94nenxWUmCkUrgyvhkY2StLsAg2cE6ey8YD3Tun"]'
2026-03-18 09:13:49.151 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:13:49.166 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-18 09:13:49.167 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-18_09-13-46__05bdd961-753a-47e0-8832-435dc4e0804c__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:13:49.167 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 09:13:49.167 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 09:13:49.168 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 09:13:49.169 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.195.208
2026-03-18 09:13:49.169 DEBUG [src.node.docker_mananger] Generated ports ['53776', '53777', '53778', '53779', '53780']
2026-03-18 09:13:49.169 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 09:13:49.169 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 09:13:49.169 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 09:13:49.170 DEBUG [src.node.docker_mananger] docker run -i -t -p 53776:53776 -p 53777:53777 -p 53778:53778 -p 53779:53779 -p 53780:53780 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=53778 --rest-port=53776 --tcp-port=53777 --discv5-udp-port=53779 --rest-address=0.0.0.0 --nat=extip:172.18.195.208 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=d81e119fa7ed7a6f8ecdb6674864ae850ee6f9efa90bdebe35c1555ae481bfe2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=53780 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QBLFdecMGPh-h6lkCY_PbL4sqjWqg9R3SfQnFxRb3QrcXvHASmUO8UrmP58n3ni8Y-lq8AuR06WDLhS_9I9WY3sCgmlkgnY0gmlwhKwS9KuKbXVsdGlhZGRyc5YACASsEvSrBtPAAAoErBL0qwbTwd0DgnJzhQDGAQAAiXNlY3AyNTZrMaECyAG4_0h7318qN60aNPbnlDMa-o99D9ig-x7Yuqspa82DdGNwgtPAg3VkcILTwoV3YWt1MgU --filternode=/ip4/172.18.244.171/tcp/54208/p2p/16Uiu2HAm8tR3T94nenxWUmCkUrgyvhkY2StLsAg2cE6ey8YD3Tun
2026-03-18 09:13:49.383 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.195.208 waku 08edaded73d983d1e78d8be034bb562293febc7d81bd353b5fb2a67e53bc34d5
2026-03-18 09:13:49.418 DEBUG [src.node.docker_mananger] Container started with ID 08edaded73d9. Setting up logs at ./log/docker/node3_2026-03-18_09-13-46__05bdd961-753a-47e0-8832-435dc4e0804c__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:13:49.418 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 53776
2026-03-18 09:13:49.418 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 09:13:50.420 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53776/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:13:50.423 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 09:13:50.423 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 09:13:50.423 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53776/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:13:50.426 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.195.208/tcp/53777/p2p/16Uiu2HAmHKPpBrMsqbpvVegWDfLQHBQaotirNXUyiSY2LmKqh8YB","/ip4/172.18.195.208/tcp/53778/ws/p2p/16Uiu2HAmHKPpBrMsqbpvVegWDfLQHBQaotirNXUyiSY2LmKqh8YB"],"enrUri":"enr:-L24QATdsBPBrRUDyirsMqo4Tg6_hbr32a0vv_s3V2MUQ43EbbZ2I_XGdd1XJlE-1dUlo16XjTa0frF0AogUt4f2XIUCgmlkgnY0gmlwhKwSw9CKbXVsdGlhZGRyc5YACASsEsPQBtIRAAoErBLD0AbSEt0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDRUVZWInofdh6-En0eDVAtL10vZ1HEwbr0xHRQsQZHwyDdGNwgtIRg3VkcILSE4V3YWt1MgA"}'
2026-03-18 09:13:50.426 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 09:13:50.426 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53776/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.244.171/tcp/54208/p2p/16Uiu2HAm8tR3T94nenxWUmCkUrgyvhkY2StLsAg2cE6ey8YD3Tun"]'
2026-03-18 09:13:50.460 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:13:50.472 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-18 09:13:50.473 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-18_09-13-46__05bdd961-753a-47e0-8832-435dc4e0804c__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:13:50.474 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 09:13:50.475 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 09:13:50.477 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 09:13:50.479 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.46.13
2026-03-18 09:13:50.479 DEBUG [src.node.docker_mananger] Generated ports ['56949', '56950', '56951', '56952', '56953']
2026-03-18 09:13:50.480 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 09:13:50.480 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 09:13:50.480 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 09:13:50.480 DEBUG [src.node.docker_mananger] docker run -i -t -p 56949:56949 -p 56950:56950 -p 56951:56951 -p 56952:56952 -p 56953:56953 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=56951 --rest-port=56949 --tcp-port=56950 --discv5-udp-port=56952 --rest-address=0.0.0.0 --nat=extip:172.18.46.13 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=fbfb98fbcb9f9ee9ebc4d87effabf663bc7ed6a23ecccd2cda0baea85e0eabca --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=56953 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QBLFdecMGPh-h6lkCY_PbL4sqjWqg9R3SfQnFxRb3QrcXvHASmUO8UrmP58n3ni8Y-lq8AuR06WDLhS_9I9WY3sCgmlkgnY0gmlwhKwS9KuKbXVsdGlhZGRyc5YACASsEvSrBtPAAAoErBL0qwbTwd0DgnJzhQDGAQAAiXNlY3AyNTZrMaECyAG4_0h7318qN60aNPbnlDMa-o99D9ig-x7Yuqspa82DdGNwgtPAg3VkcILTwoV3YWt1MgU --filternode=/ip4/172.18.244.171/tcp/54208/p2p/16Uiu2HAm8tR3T94nenxWUmCkUrgyvhkY2StLsAg2cE6ey8YD3Tun
2026-03-18 09:13:50.681 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.46.13 waku a756f134c351a6e9f9b1821af5bdfdd194f0245fb0c8441f182b096a8828e115
2026-03-18 09:13:50.717 DEBUG [src.node.docker_mananger] Container started with ID a756f134c351. Setting up logs at ./log/docker/node4_2026-03-18_09-13-46__05bdd961-753a-47e0-8832-435dc4e0804c__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:13:50.718 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 56949
2026-03-18 09:13:50.719 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 09:13:51.719 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56949/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:13:51.722 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 09:13:51.723 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 09:13:51.723 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56949/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:13:51.725 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.46.13/tcp/56950/p2p/16Uiu2HAm9HskdY783j9zK11SF8NxFoKBKpeVpWBPxodDFReGZiDa","/ip4/172.18.46.13/tcp/56951/ws/p2p/16Uiu2HAm9HskdY783j9zK11SF8NxFoKBKpeVpWBPxodDFReGZiDa"],"enrUri":"enr:-L24QLSR4FRhExxiXBrLa5SbXKCdI99LK6kv09amxKL7uCF-GFPMlca0nDySOytX_PjjerkxjanfXxJ4FYkmz6drqKwCgmlkgnY0gmlwhKwSLg2KbXVsdGlhZGRyc5YACASsEi4NBt52AAoErBIuDQbed90DgnJzhQDGAQAAiXNlY3AyNTZrMaECzgRIRvjhWCuYaGbIZSfWvTCudYB8KmNEKaa8gDINU62DdGNwgt52g3VkcILeeIV3YWt1MgA"}'
2026-03-18 09:13:51.725 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 09:13:51.726 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56949/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.244.171/tcp/54208/p2p/16Uiu2HAm8tR3T94nenxWUmCkUrgyvhkY2StLsAg2cE6ey8YD3Tun"]'
2026-03-18 09:13:51.766 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:13:51.780 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-18 09:13:51.781 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-18_09-13-46__05bdd961-753a-47e0-8832-435dc4e0804c__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:13:51.782 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 09:13:51.782 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 09:13:51.786 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 09:13:51.786 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.106.43
2026-03-18 09:13:51.786 DEBUG [src.node.docker_mananger] Generated ports ['18094', '18095', '18096', '18097', '18098']
2026-03-18 09:13:51.787 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 09:13:51.789 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 09:13:51.789 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 09:13:51.789 DEBUG [src.node.docker_mananger] docker run -i -t -p 18094:18094 -p 18095:18095 -p 18096:18096 -p 18097:18097 -p 18098:18098 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=18096 --rest-port=18094 --tcp-port=18095 --discv5-udp-port=18097 --rest-address=0.0.0.0 --nat=extip:172.18.106.43 --peer-exchange=true --discv5-discovery=true --cluster-id=198 --nodekey=ad9cc4dd02badde69551bbf925caaeee13b463deb8e00cb4dc728d363dcd3f4e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=18098 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QBLFdecMGPh-h6lkCY_PbL4sqjWqg9R3SfQnFxRb3QrcXvHASmUO8UrmP58n3ni8Y-lq8AuR06WDLhS_9I9WY3sCgmlkgnY0gmlwhKwS9KuKbXVsdGlhZGRyc5YACASsEvSrBtPAAAoErBL0qwbTwd0DgnJzhQDGAQAAiXNlY3AyNTZrMaECyAG4_0h7318qN60aNPbnlDMa-o99D9ig-x7Yuqspa82DdGNwgtPAg3VkcILTwoV3YWt1MgU --filternode=/ip4/172.18.244.171/tcp/54208/p2p/16Uiu2HAm8tR3T94nenxWUmCkUrgyvhkY2StLsAg2cE6ey8YD3Tun
2026-03-18 09:13:51.999 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.106.43 waku 269ba70ca4a454b812d8593ff763d403226b0b290cb1b6a2c8a5b096092a1fd6
2026-03-18 09:13:52.034 DEBUG [src.node.docker_mananger] Container started with ID 269ba70ca4a4. Setting up logs at ./log/docker/node5_2026-03-18_09-13-46__05bdd961-753a-47e0-8832-435dc4e0804c__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-18 09:13:52.034 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 18094
2026-03-18 09:13:52.034 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 09:13:53.035 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18094/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:13:53.038 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 09:13:53.039 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 09:13:53.039 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18094/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:13:53.042 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.106.43/tcp/18095/p2p/16Uiu2HAmK8izgiGWuY6EE7nvMgL2YR4YFaEpN4Ms1627YqZWB9Qf","/ip4/172.18.106.43/tcp/18096/ws/p2p/16Uiu2HAmK8izgiGWuY6EE7nvMgL2YR4YFaEpN4Ms1627YqZWB9Qf"],"enrUri":"enr:-L24QJUU_d1T6-mgynOCFD_ey_QLJORS_2zot2uE9ZyjWyRoUmPSKcV6R8phPnL4MMnxSpVWXR10ViInp5HgWuV95G0CgmlkgnY0gmlwhKwSaiuKbXVsdGlhZGRyc5YACASsEmorBkavAAoErBJqKwZGsN0DgnJzhQDGAQAAiXNlY3AyNTZrMaEDYEEFoFqhJ4NieLz0S3ypt-mCpUFr2vrimDWkcBpEqFyDdGNwgkavg3VkcIJGsYV3YWt1MgA"}'
2026-03-18 09:13:53.042 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 09:13:53.043 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18094/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.244.171/tcp/54208/p2p/16Uiu2HAm8tR3T94nenxWUmCkUrgyvhkY2StLsAg2cE6ey8YD3Tun"]'
2026-03-18 09:13:53.088 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:13:53.089 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54207/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/198/1"]'
2026-03-18 09:13:53.097 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:13:53.098 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20202/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "f5ffb28c-e415-4f46-b9a1-6136632a1407", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/198/1"}'
2026-03-18 09:13:53.110 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"f5ffb28c-e415-4f46-b9a1-6136632a1407","statusDesc":"OK"}'
2026-03-18 09:13:53.110 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53776/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "c01f1048-d5dd-42cb-b0e3-551a132cc1a9", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/198/1"}'
2026-03-18 09:13:53.123 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"c01f1048-d5dd-42cb-b0e3-551a132cc1a9","statusDesc":"OK"}'
2026-03-18 09:13:53.124 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56949/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "430063f4-d9ae-47f0-9ecd-4bcca7311b91", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/198/1"}'
2026-03-18 09:13:53.133 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"430063f4-d9ae-47f0-9ecd-4bcca7311b91","statusDesc":"OK"}'
2026-03-18 09:13:53.133 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18094/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "bef78d77-63ee-4544-8e80-49944067788c", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/198/1"}'
2026-03-18 09:13:53.142 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"bef78d77-63ee-4544-8e80-49944067788c","statusDesc":"OK"}'
2026-03-18 09:13:53.143 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54207/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 09:13:53.161 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:13:53.161 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-18 09:13:53.262 DEBUG [src.steps.filter] Checking that peer NODE_2:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-18 09:13:53.263 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20202/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:13:53.265 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773825233143650366,"ephemeral":false}]'
2026-03-18 09:13:53.267 DEBUG [src.steps.filter] Checking that peer NODE_3:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-18 09:13:53.267 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53776/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:13:53.270 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773825233143650366,"ephemeral":false}]'
2026-03-18 09:13:53.271 DEBUG [src.steps.filter] Checking that peer NODE_4:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-18 09:13:53.271 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56949/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:13:53.274 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773825233143650366,"ephemeral":false}]'
2026-03-18 09:13:53.275 DEBUG [src.steps.filter] Checking that peer NODE_5:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-18 09:13:53.276 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18094/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:13:53.278 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773825233143650366,"ephemeral":false}]'
2026-03-18 09:13:53.280 DEBUG [src.node.waku_node] Pausing container with id f50ecec5ddf2
2026-03-18 09:13:53.289 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54207/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 09:13:53.295 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:13:53.296 DEBUG [src.node.waku_node] Unpause container with id f50ecec5ddf2
2026-03-18 09:13:53.306 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54207/relay/v1/messages/%2Fwaku%2F2%2Frs%2F198%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 09:13:53.312 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 09:13:53.312 DEBUG [src.libs.common] Sleeping for 0.5 seconds
2026-03-18 09:13:53.813 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20202/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-18 09:13:53.816 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773825233280109903,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773825233280187358,"ephemeral":false}]'
2026-03-18 09:13:53.818 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-18 09:13:53.819 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-18 09:13:53.819 DEBUG [src.node.waku_node] Stopping container with id 1eb40d12c33d
2026-03-18 09:13:54.437 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 09:13:54.439 DEBUG [src.node.waku_node] Stopping container with id f50ecec5ddf2
2026-03-18 09:13:55.025 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 09:13:55.026 DEBUG [src.node.waku_node] Stopping container with id 08edaded73d9
2026-03-18 09:13:55.314 ERROR [src.node.docker_mananger] Max retries reached for container 1eb40d12c33d. Exiting log stream.
2026-03-18 09:13:55.593 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 09:13:55.595 DEBUG [src.node.waku_node] Stopping container with id a756f134c351
2026-03-18 09:13:55.864 ERROR [src.node.docker_mananger] Max retries reached for container f50ecec5ddf2. Exiting log stream.
2026-03-18 09:13:56.179 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 09:13:56.180 DEBUG [src.node.waku_node] Stopping container with id 269ba70ca4a4
2026-03-18 09:13:56.429 ERROR [src.node.docker_mananger] Max retries reached for container 08edaded73d9. Exiting log stream.
2026-03-18 09:13:56.749 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 09:13:56.753 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-18 09:13:56.780 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-18 09:13:56.788 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-18 09:13:56.797 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-18 09:13:56.803 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-18 09:13:56.808 DEBUG [src.node.docker_mananger] No errors found in the waku logs.