155 lines
30 KiB
Plaintext

2026-03-15 04:45:38.575 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-15 04:45:38.576 DEBUG [tests.conftest] Running test: test_ping_only_some_nodes_have_subscriptions with id: 2026-03-15_04-45-38__66520802-4597-432f-af81-68beb7a7bc78
2026-03-15 04:45:38.576 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-15 04:45:38.577 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-15 04:45:38.577 DEBUG [src.steps.filter] Running fixture setup: setup_main_relay_node
2026-03-15 04:45:38.584 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-15 04:45:38.584 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-15_04-45-38__66520802-4597-432f-af81-68beb7a7bc78__wakuorg_nwaku:latest.log
2026-03-15 04:45:38.585 DEBUG [src.node.waku_node] Starting Node...
2026-03-15 04:45:38.585 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-15 04:45:38.586 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-15 04:45:38.587 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.152.22
2026-03-15 04:45:38.587 DEBUG [src.node.docker_mananger] Generated ports ['25916', '25917', '25918', '25919', '25920']
2026-03-15 04:45:38.587 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-15 04:45:38.587 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-15 04:45:38.587 DEBUG [src.node.waku_node] Using volumes []
2026-03-15 04:45:38.587 DEBUG [src.node.docker_mananger] docker run -i -t -p 25916:25916 -p 25917:25917 -p 25918:25918 -p 25919:25919 -p 25920:25920 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=25918 --rest-port=25916 --tcp-port=25917 --discv5-udp-port=25919 --rest-address=0.0.0.0 --nat=extip:172.18.152.22 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a9e138d0f0daf7cfcd52470ce4b3df8cdcd6ce7c54274def1ea25aec9fef3ba6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=25920 --metrics-logging=true --relay=true --filter=true
2026-03-15 04:45:38.745 ERROR [src.node.docker_mananger] Max retries reached for container 2c02a622d5f7. Exiting log stream.
2026-03-15 04:45:38.796 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.152.22 waku 8fc56e50902874b760349b7b95e9b829bf26fdcd8abcf83a31d8de680272f256
2026-03-15 04:45:38.834 DEBUG [src.node.docker_mananger] Container started with ID 8fc56e509028. Setting up logs at ./log/docker/node1_2026-03-15_04-45-38__66520802-4597-432f-af81-68beb7a7bc78__wakuorg_nwaku:latest.log
2026-03-15 04:45:38.835 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 25916
2026-03-15 04:45:38.835 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-15 04:45:39.358 ERROR [src.node.docker_mananger] Max retries reached for container 045a8a875a8d. Exiting log stream.
2026-03-15 04:45:39.837 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25916/health" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:45:39.840 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-15 04:45:39.840 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-15 04:45:39.840 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25916/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:45:39.843 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.152.22/tcp/25917/p2p/16Uiu2HAmS3NDq3U9AReNXiu9YJ2EykLKPje9ayXTmXJLi4yV9xyn","/ip4/172.18.152.22/tcp/25918/ws/p2p/16Uiu2HAmS3NDq3U9AReNXiu9YJ2EykLKPje9ayXTmXJLi4yV9xyn"],"enrUri":"enr:-L24QJ_00TXhKlUtLL9HuKPgPVFqeIGzOCnDEKrtnWWnrxsoS4ul7rahUe6mOvfMi9hsgEIEWU-ZZzTrXJHOlPhRVtkCgmlkgnY0gmlwhKwSmBaKbXVsdGlhZGRyc5YACASsEpgWBmU9AAoErBKYFgZlPt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDxuNwGJdrzxTMUhnY2bHDyf8HyfXlbmn1A2w-HqpIH9mDdGNwgmU9g3VkcIJlP4V3YWt1MgU"}'
2026-03-15 04:45:39.844 INFO [src.node.waku_node] REST service is ready !!
2026-03-15 04:45:39.844 DEBUG [src.steps.filter] Running fixture setup: setup_main_filter_node
2026-03-15 04:45:39.852 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-15 04:45:39.852 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-15_04-45-38__66520802-4597-432f-af81-68beb7a7bc78__wakuorg_nwaku:latest.log
2026-03-15 04:45:39.852 DEBUG [src.node.waku_node] Starting Node...
2026-03-15 04:45:39.853 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-15 04:45:39.854 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-15 04:45:39.854 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.60.109
2026-03-15 04:45:39.855 DEBUG [src.node.docker_mananger] Generated ports ['3891', '3892', '3893', '3894', '3895']
2026-03-15 04:45:39.855 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-15 04:45:39.855 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-15 04:45:39.855 DEBUG [src.node.waku_node] Using volumes []
2026-03-15 04:45:39.855 DEBUG [src.node.docker_mananger] docker run -i -t -p 3891:3891 -p 3892:3892 -p 3893:3893 -p 3894:3894 -p 3895:3895 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3893 --rest-port=3891 --tcp-port=3892 --discv5-udp-port=3894 --rest-address=0.0.0.0 --nat=extip:172.18.60.109 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=eca55bfcf4bcf4a6ceab631baa5cadf88b6dba51c2a1ec59bfb39a503ebcdbed --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3895 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QJ_00TXhKlUtLL9HuKPgPVFqeIGzOCnDEKrtnWWnrxsoS4ul7rahUe6mOvfMi9hsgEIEWU-ZZzTrXJHOlPhRVtkCgmlkgnY0gmlwhKwSmBaKbXVsdGlhZGRyc5YACASsEpgWBmU9AAoErBKYFgZlPt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDxuNwGJdrzxTMUhnY2bHDyf8HyfXlbmn1A2w-HqpIH9mDdGNwgmU9g3VkcIJlP4V3YWt1MgU --filternode=/ip4/172.18.152.22/tcp/25917/p2p/16Uiu2HAmS3NDq3U9AReNXiu9YJ2EykLKPje9ayXTmXJLi4yV9xyn
2026-03-15 04:45:40.068 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.60.109 waku d2d24f158e05311f70aa55b71940c833a4464828f0f99a5ee21fc58769896fea
2026-03-15 04:45:40.107 DEBUG [src.node.docker_mananger] Container started with ID d2d24f158e05. Setting up logs at ./log/docker/node2_2026-03-15_04-45-38__66520802-4597-432f-af81-68beb7a7bc78__wakuorg_nwaku:latest.log
2026-03-15 04:45:40.107 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 3891
2026-03-15 04:45:40.107 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-15 04:45:41.108 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3891/health" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:45:41.111 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-15 04:45:41.111 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-15 04:45:41.111 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3891/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:45:41.114 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.60.109/tcp/3892/p2p/16Uiu2HAkwFoVyDapwjJXv3s9rTTEqoNZU26kC5j3x1GbSSESzBck","/ip4/172.18.60.109/tcp/3893/ws/p2p/16Uiu2HAkwFoVyDapwjJXv3s9rTTEqoNZU26kC5j3x1GbSSESzBck"],"enrUri":"enr:-L24QJrcfS2Iq5FdCd7vwB-pLuQkLZQDoXmvDHaXgSY7ZWMZFA1MK2ENqXWmROvf9AqrJGNsOYP9RMvgaKF3LwrUivQCgmlkgnY0gmlwhKwSPG2KbXVsdGlhZGRyc5YACASsEjxtBg80AAoErBI8bQYPNd0DgnJzhQADAQAAiXNlY3AyNTZrMaECGzARqGaaJLsTpWSd5ccmglnve1upmerHEJrQ85UtQNmDdGNwgg80g3VkcIIPNoV3YWt1MgA"}'
2026-03-15 04:45:41.114 INFO [src.node.waku_node] REST service is ready !!
2026-03-15 04:45:41.115 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3891/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.152.22/tcp/25917/p2p/16Uiu2HAmS3NDq3U9AReNXiu9YJ2EykLKPje9ayXTmXJLi4yV9xyn"]'
2026-03-15 04:45:41.149 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:45:41.156 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:25916/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-15 04:45:41.173 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:45:41.174 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3891/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "15c39497-7237-4578-9033-700db272ebbd", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-15 04:45:41.191 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"15c39497-7237-4578-9033-700db272ebbd","statusDesc":"OK"}'
2026-03-15 04:45:41.201 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-15 04:45:41.201 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-15_04-45-38__66520802-4597-432f-af81-68beb7a7bc78__wakuorg_nwaku:latest.log
2026-03-15 04:45:41.201 DEBUG [src.node.waku_node] Starting Node...
2026-03-15 04:45:41.201 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-15 04:45:41.203 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-15 04:45:41.203 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.196.41
2026-03-15 04:45:41.203 DEBUG [src.node.docker_mananger] Generated ports ['1885', '1886', '1887', '1888', '1889']
2026-03-15 04:45:41.203 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-15 04:45:41.204 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-15 04:45:41.204 DEBUG [src.node.waku_node] Using volumes []
2026-03-15 04:45:41.204 DEBUG [src.node.docker_mananger] docker run -i -t -p 1885:1885 -p 1886:1886 -p 1887:1887 -p 1888:1888 -p 1889:1889 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=1887 --rest-port=1885 --tcp-port=1886 --discv5-udp-port=1888 --rest-address=0.0.0.0 --nat=extip:172.18.196.41 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e53c8c655cb48b2bac6032ea22c8034c1bacafc694fb9bcfccbe3d7ded2f3d6b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=1889 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QJ_00TXhKlUtLL9HuKPgPVFqeIGzOCnDEKrtnWWnrxsoS4ul7rahUe6mOvfMi9hsgEIEWU-ZZzTrXJHOlPhRVtkCgmlkgnY0gmlwhKwSmBaKbXVsdGlhZGRyc5YACASsEpgWBmU9AAoErBKYFgZlPt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDxuNwGJdrzxTMUhnY2bHDyf8HyfXlbmn1A2w-HqpIH9mDdGNwgmU9g3VkcIJlP4V3YWt1MgU --filternode=/ip4/172.18.152.22/tcp/25917/p2p/16Uiu2HAmS3NDq3U9AReNXiu9YJ2EykLKPje9ayXTmXJLi4yV9xyn
2026-03-15 04:45:41.413 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.196.41 waku e04b680fca490dabbc595c5a2cd1288c952df56169734be2672d85e0f82235db
2026-03-15 04:45:41.450 DEBUG [src.node.docker_mananger] Container started with ID e04b680fca49. Setting up logs at ./log/docker/node3_2026-03-15_04-45-38__66520802-4597-432f-af81-68beb7a7bc78__wakuorg_nwaku:latest.log
2026-03-15 04:45:41.451 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 1885
2026-03-15 04:45:41.451 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-15 04:45:42.452 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1885/health" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:45:42.455 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-15 04:45:42.456 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-15 04:45:42.456 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1885/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:45:42.458 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.196.41/tcp/1886/p2p/16Uiu2HAmN5qZNd3qjEq8HQS5zcmE4GcAvuCf1of8JwqgdvMzWH5j","/ip4/172.18.196.41/tcp/1887/ws/p2p/16Uiu2HAmN5qZNd3qjEq8HQS5zcmE4GcAvuCf1of8JwqgdvMzWH5j"],"enrUri":"enr:-L24QCdq2huNThbgRHp4UQwhYjh-x2Nm9jphkWlDidI61hYZLgn-RnyXfVvpfWKStDQUJz0BB5AJGm7C6RuNb9ak56ECgmlkgnY0gmlwhKwSxCmKbXVsdGlhZGRyc5YACASsEsQpBgdeAAoErBLEKQYHX90DgnJzhQADAQAAiXNlY3AyNTZrMaEDjBbDBX0VedPRl_V-9IcDtiRg76mhhX95CigpWZU6HyqDdGNwggdeg3VkcIIHYIV3YWt1MgA"}'
2026-03-15 04:45:42.459 INFO [src.node.waku_node] REST service is ready !!
2026-03-15 04:45:42.459 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1885/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.152.22/tcp/25917/p2p/16Uiu2HAmS3NDq3U9AReNXiu9YJ2EykLKPje9ayXTmXJLi4yV9xyn"]'
2026-03-15 04:45:42.495 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:45:42.509 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-15 04:45:42.510 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-15_04-45-38__66520802-4597-432f-af81-68beb7a7bc78__wakuorg_nwaku:latest.log
2026-03-15 04:45:42.511 DEBUG [src.node.waku_node] Starting Node...
2026-03-15 04:45:42.511 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-15 04:45:42.514 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-15 04:45:42.515 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.98.83
2026-03-15 04:45:42.515 DEBUG [src.node.docker_mananger] Generated ports ['9221', '9222', '9223', '9224', '9225']
2026-03-15 04:45:42.516 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-15 04:45:42.516 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-15 04:45:42.516 DEBUG [src.node.waku_node] Using volumes []
2026-03-15 04:45:42.517 DEBUG [src.node.docker_mananger] docker run -i -t -p 9221:9221 -p 9222:9222 -p 9223:9223 -p 9224:9224 -p 9225:9225 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=9223 --rest-port=9221 --tcp-port=9222 --discv5-udp-port=9224 --rest-address=0.0.0.0 --nat=extip:172.18.98.83 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=5c3eb84f6edc9d8c7507464bccf4285bba90daf9a03d839bdb9c274af782df89 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=9225 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QJ_00TXhKlUtLL9HuKPgPVFqeIGzOCnDEKrtnWWnrxsoS4ul7rahUe6mOvfMi9hsgEIEWU-ZZzTrXJHOlPhRVtkCgmlkgnY0gmlwhKwSmBaKbXVsdGlhZGRyc5YACASsEpgWBmU9AAoErBKYFgZlPt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDxuNwGJdrzxTMUhnY2bHDyf8HyfXlbmn1A2w-HqpIH9mDdGNwgmU9g3VkcIJlP4V3YWt1MgU --filternode=/ip4/172.18.152.22/tcp/25917/p2p/16Uiu2HAmS3NDq3U9AReNXiu9YJ2EykLKPje9ayXTmXJLi4yV9xyn
2026-03-15 04:45:42.728 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.98.83 waku 62883e8bc268fe7c090c2ded50ab923593afaec6e2dccfea49fa61d6f7e6933a
2026-03-15 04:45:42.764 DEBUG [src.node.docker_mananger] Container started with ID 62883e8bc268. Setting up logs at ./log/docker/node4_2026-03-15_04-45-38__66520802-4597-432f-af81-68beb7a7bc78__wakuorg_nwaku:latest.log
2026-03-15 04:45:42.764 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 9221
2026-03-15 04:45:42.764 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-15 04:45:43.765 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9221/health" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:45:43.768 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-15 04:45:43.768 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-15 04:45:43.769 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9221/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:45:43.771 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.98.83/tcp/9222/p2p/16Uiu2HAmFyCA2q87ioCS4iv7anKiUTQLPo5QvfG78nu417MJ79pH","/ip4/172.18.98.83/tcp/9223/ws/p2p/16Uiu2HAmFyCA2q87ioCS4iv7anKiUTQLPo5QvfG78nu417MJ79pH"],"enrUri":"enr:-L24QINZ6Yb2lViolRZPDt0FDStFuINWNozvcZYX8rfv-_c1QFiU81Eo0f0xIxSeCD9M-ISe8eYJuWGF9w80x-nI-JoCgmlkgnY0gmlwhKwSYlOKbXVsdGlhZGRyc5YACASsEmJTBiQGAAoErBJiUwYkB90DgnJzhQADAQAAiXNlY3AyNTZrMaEDMTzdRC-q917eb3sKWaBKoYPOS6x1g0g68brTkbnpO9aDdGNwgiQGg3VkcIIkCIV3YWt1MgA"}'
2026-03-15 04:45:43.771 INFO [src.node.waku_node] REST service is ready !!
2026-03-15 04:45:43.772 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9221/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.152.22/tcp/25917/p2p/16Uiu2HAmS3NDq3U9AReNXiu9YJ2EykLKPje9ayXTmXJLi4yV9xyn"]'
2026-03-15 04:45:43.809 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:45:43.822 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-15 04:45:43.823 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-15_04-45-38__66520802-4597-432f-af81-68beb7a7bc78__wakuorg_nwaku:latest.log
2026-03-15 04:45:43.823 DEBUG [src.node.waku_node] Starting Node...
2026-03-15 04:45:43.823 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-15 04:45:43.826 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-15 04:45:43.829 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.25.61
2026-03-15 04:45:43.830 DEBUG [src.node.docker_mananger] Generated ports ['51987', '51988', '51989', '51990', '51991']
2026-03-15 04:45:43.830 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-15 04:45:43.830 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-15 04:45:43.830 DEBUG [src.node.waku_node] Using volumes []
2026-03-15 04:45:43.830 DEBUG [src.node.docker_mananger] docker run -i -t -p 51987:51987 -p 51988:51988 -p 51989:51989 -p 51990:51990 -p 51991:51991 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=51989 --rest-port=51987 --tcp-port=51988 --discv5-udp-port=51990 --rest-address=0.0.0.0 --nat=extip:172.18.25.61 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fb87d6370b1d03356eebe8b0cb1df3908dcb5887b9442fcd8bcbe8bf28d646de --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=51991 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QJ_00TXhKlUtLL9HuKPgPVFqeIGzOCnDEKrtnWWnrxsoS4ul7rahUe6mOvfMi9hsgEIEWU-ZZzTrXJHOlPhRVtkCgmlkgnY0gmlwhKwSmBaKbXVsdGlhZGRyc5YACASsEpgWBmU9AAoErBKYFgZlPt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDxuNwGJdrzxTMUhnY2bHDyf8HyfXlbmn1A2w-HqpIH9mDdGNwgmU9g3VkcIJlP4V3YWt1MgU --filternode=/ip4/172.18.152.22/tcp/25917/p2p/16Uiu2HAmS3NDq3U9AReNXiu9YJ2EykLKPje9ayXTmXJLi4yV9xyn
2026-03-15 04:45:44.045 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.25.61 waku 7c9fa944fd179273a74133e4051d2e287093a26af41eeca0bb96a91b16e10568
2026-03-15 04:45:44.082 DEBUG [src.node.docker_mananger] Container started with ID 7c9fa944fd17. Setting up logs at ./log/docker/node5_2026-03-15_04-45-38__66520802-4597-432f-af81-68beb7a7bc78__wakuorg_nwaku:latest.log
2026-03-15 04:45:44.082 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 51987
2026-03-15 04:45:44.083 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-15 04:45:45.084 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:51987/health" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:45:45.087 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-15 04:45:45.088 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-15 04:45:45.088 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:51987/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:45:45.091 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.25.61/tcp/51988/p2p/16Uiu2HAm1ZP2FdaAYzvi2q8UWtMXyYwDSEVwGNFQBDSHTM6y3U8G","/ip4/172.18.25.61/tcp/51989/ws/p2p/16Uiu2HAm1ZP2FdaAYzvi2q8UWtMXyYwDSEVwGNFQBDSHTM6y3U8G"],"enrUri":"enr:-L24QFfPfOPgU8wA8ROj8-3v6o2eE3KfVL97HLKu6i77lFhyJbyZcLF6D9mMjMji8MSn7phh6J7sjNh7vrMCwCiP3k4CgmlkgnY0gmlwhKwSGT2KbXVsdGlhZGRyc5YACASsEhk9BssUAAoErBIZPQbLFd0DgnJzhQADAQAAiXNlY3AyNTZrMaECWx-YEZHfINcRRZ0lX5ik1VVgo8d0O1TcFbU_zEIKuGGDdGNwgssUg3VkcILLFoV3YWt1MgA"}'
2026-03-15 04:45:45.091 INFO [src.node.waku_node] REST service is ready !!
2026-03-15 04:45:45.091 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:51987/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.152.22/tcp/25917/p2p/16Uiu2HAmS3NDq3U9AReNXiu9YJ2EykLKPje9ayXTmXJLi4yV9xyn"]'
2026-03-15 04:45:45.129 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-15 04:45:45.133 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3891/filter/v2/subscriptions/1" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:45:45.148 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-03-15 04:45:45.151 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1885/filter/v2/subscriptions/ba6f4da2-0ed3-4c22-9abf-3fd05bdf8271" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:45:45.163 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:1885/filter/v2/subscriptions/ba6f4da2-0ed3-4c22-9abf-3fd05bdf8271. Response content: b'{"requestId":"ba6f4da2-0ed3-4c22-9abf-3fd05bdf8271","statusDesc":"NOT_FOUND: peer has no subscriptions"}'
2026-03-15 04:45:45.169 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9221/filter/v2/subscriptions/274f85c8-1798-4e8a-8086-1242c611d669" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:45:45.179 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:9221/filter/v2/subscriptions/274f85c8-1798-4e8a-8086-1242c611d669. Response content: b'{"requestId":"274f85c8-1798-4e8a-8086-1242c611d669","statusDesc":"NOT_FOUND: peer has no subscriptions"}'
2026-03-15 04:45:45.180 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:51987/filter/v2/subscriptions/49774022-d296-4ad5-8282-227d5009d65d" -H "Content-Type: application/json" -d 'None'
2026-03-15 04:45:45.189 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:51987/filter/v2/subscriptions/49774022-d296-4ad5-8282-227d5009d65d. Response content: b'{"requestId":"49774022-d296-4ad5-8282-227d5009d65d","statusDesc":"NOT_FOUND: peer has no subscriptions"}'
2026-03-15 04:45:45.192 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-15 04:45:45.193 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-15 04:45:45.193 DEBUG [src.node.waku_node] Stopping container with id 8fc56e509028
2026-03-15 04:45:45.799 DEBUG [src.node.waku_node] Container stopped.
2026-03-15 04:45:45.800 DEBUG [src.node.waku_node] Stopping container with id d2d24f158e05
2026-03-15 04:45:46.394 DEBUG [src.node.waku_node] Container stopped.
2026-03-15 04:45:46.394 DEBUG [src.node.waku_node] Stopping container with id e04b680fca49
2026-03-15 04:45:46.618 ERROR [src.node.docker_mananger] Max retries reached for container 8fc56e509028. Exiting log stream.
2026-03-15 04:45:47.000 DEBUG [src.node.waku_node] Container stopped.
2026-03-15 04:45:47.000 DEBUG [src.node.waku_node] Stopping container with id 62883e8bc268
2026-03-15 04:45:47.210 ERROR [src.node.docker_mananger] Max retries reached for container d2d24f158e05. Exiting log stream.
2026-03-15 04:45:47.576 DEBUG [src.node.waku_node] Container stopped.
2026-03-15 04:45:47.576 DEBUG [src.node.waku_node] Stopping container with id 7c9fa944fd17
2026-03-15 04:45:47.816 ERROR [src.node.docker_mananger] Max retries reached for container e04b680fca49. Exiting log stream.
2026-03-15 04:45:48.250 DEBUG [src.node.waku_node] Container stopped.
2026-03-15 04:45:48.254 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-15 04:45:48.267 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-15 04:45:48.271 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-15 04:45:48.275 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-15 04:45:48.279 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-15 04:45:48.283 DEBUG [src.node.docker_mananger] No errors found in the waku logs.