2026-03-05 15:25:13 +00:00

92 lines
17 KiB
Plaintext

2026-03-05 15:06:23.808 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-05 15:06:23.808 DEBUG [tests.conftest] Running test: test_filter_get_message_after_node2_restarts with id: 2026-03-05_15-06-23__33ff9b15-f8bd-41d8-b065-a9e062503dbf
2026-03-05 15:06:23.808 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-05 15:06:23.809 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-05 15:06:23.809 DEBUG [src.steps.filter] Running fixture setup: setup_main_relay_node
2026-03-05 15:06:23.816 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-beta
2026-03-05 15:06:23.816 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-05_15-06-23__33ff9b15-f8bd-41d8-b065-a9e062503dbf__harbor.status.im_wakuorg_nwaku:v0.38.0-beta.log
2026-03-05 15:06:23.816 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 15:06:23.816 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 15:06:23.817 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 15:06:23.818 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.124.146
2026-03-05 15:06:23.818 DEBUG [src.node.docker_mananger] Generated ports ['14951', '14952', '14953', '14954', '14955']
2026-03-05 15:06:23.818 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 15:06:23.818 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 15:06:23.818 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 15:06:23.818 DEBUG [src.node.docker_mananger] docker run -i -t -p 14951:14951 -p 14952:14952 -p 14953:14953 -p 14954:14954 -p 14955:14955 harbor.status.im/wakuorg/nwaku:v0.38.0-beta --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=14953 --rest-port=14951 --tcp-port=14952 --discv5-udp-port=14954 --rest-address=0.0.0.0 --nat=extip:172.18.124.146 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e1ebbbffaacdbbdbdedeb6df7bb96ce6a94cbb48612a1adabddadecb0a63efdd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=14955 --metrics-logging=true --relay=true --filter=true
2026-03-05 15:06:24.003 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.124.146 waku 63818f3c46e8bb55032555afe0d1fe05c63f9ab1d636a4c5e077acdf70e499e5
2026-03-05 15:06:24.009 ERROR [src.node.docker_mananger] Max retries reached for container d023174dfb0c. Exiting log stream.
2026-03-05 15:06:24.039 DEBUG [src.node.docker_mananger] Container started with ID 63818f3c46e8. Setting up logs at ./log/docker/node1_2026-03-05_15-06-23__33ff9b15-f8bd-41d8-b065-a9e062503dbf__harbor.status.im_wakuorg_nwaku:v0.38.0-beta.log
2026-03-05 15:06:24.041 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-beta. REST: 14951
2026-03-05 15:06:24.042 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 15:06:24.456 ERROR [src.node.docker_mananger] Max retries reached for container f324cbfb1219. Exiting log stream.
2026-03-05 15:06:25.043 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14951/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 15:06:25.046 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 15:06:25.046 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 15:06:25.046 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14951/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 15:06:25.048 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.124.146/tcp/14952/p2p/16Uiu2HAmDvzP9PM1sFa7WPi92E4E7Ehm5K1yHu4yKR3VAnPPB18j","/ip4/172.18.124.146/tcp/14953/ws/p2p/16Uiu2HAmDvzP9PM1sFa7WPi92E4E7Ehm5K1yHu4yKR3VAnPPB18j"],"enrUri":"enr:-L24QH1GehbnTEv21YIMjHYUN2zvfCWFJVARjU80tDOr3nePU6Py633kXlUJBqj4SKqWgzs3IFKqg5Svgn5XxUKpABwCgmlkgnY0gmlwhKwSfJKKbXVsdGlhZGRyc5YACASsEnySBjpoAAoErBJ8kgY6ad0DgnJzhQADAQAAiXNlY3AyNTZrMaEDEvUEG3-N42lyNmGOD8JpftbrplEE3CrmBZrHZUVGGjCDdGNwgjpog3VkcII6aoV3YWt1MgU"}'
2026-03-05 15:06:25.049 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 15:06:25.049 DEBUG [src.steps.filter] Running fixture setup: setup_main_filter_node
2026-03-05 15:06:25.056 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-beta
2026-03-05 15:06:25.056 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-05_15-06-23__33ff9b15-f8bd-41d8-b065-a9e062503dbf__harbor.status.im_wakuorg_nwaku:v0.38.0-beta.log
2026-03-05 15:06:25.056 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 15:06:25.056 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 15:06:25.058 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 15:06:25.058 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.170.179
2026-03-05 15:06:25.058 DEBUG [src.node.docker_mananger] Generated ports ['20244', '20245', '20246', '20247', '20248']
2026-03-05 15:06:25.058 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 15:06:25.058 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 15:06:25.058 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 15:06:25.059 DEBUG [src.node.docker_mananger] docker run -i -t -p 20244:20244 -p 20245:20245 -p 20246:20246 -p 20247:20247 -p 20248:20248 harbor.status.im/wakuorg/nwaku:v0.38.0-beta --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=20246 --rest-port=20244 --tcp-port=20245 --discv5-udp-port=20247 --rest-address=0.0.0.0 --nat=extip:172.18.170.179 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=aa7213a1e433fb8e823fabf14e47cdc1bb629e30edb91f8be404a1b3619c6afb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=20248 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QH1GehbnTEv21YIMjHYUN2zvfCWFJVARjU80tDOr3nePU6Py633kXlUJBqj4SKqWgzs3IFKqg5Svgn5XxUKpABwCgmlkgnY0gmlwhKwSfJKKbXVsdGlhZGRyc5YACASsEnySBjpoAAoErBJ8kgY6ad0DgnJzhQADAQAAiXNlY3AyNTZrMaEDEvUEG3-N42lyNmGOD8JpftbrplEE3CrmBZrHZUVGGjCDdGNwgjpog3VkcII6aoV3YWt1MgU --filternode=/ip4/172.18.124.146/tcp/14952/p2p/16Uiu2HAmDvzP9PM1sFa7WPi92E4E7Ehm5K1yHu4yKR3VAnPPB18j
2026-03-05 15:06:25.254 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.170.179 waku 3b60a7530ff1d88812f5001fdb4269164368c4dfc8e7249b2ca17e68dd64bbc0
2026-03-05 15:06:25.285 DEBUG [src.node.docker_mananger] Container started with ID 3b60a7530ff1. Setting up logs at ./log/docker/node2_2026-03-05_15-06-23__33ff9b15-f8bd-41d8-b065-a9e062503dbf__harbor.status.im_wakuorg_nwaku:v0.38.0-beta.log
2026-03-05 15:06:25.285 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-beta. REST: 20244
2026-03-05 15:06:25.285 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 15:06:26.286 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20244/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 15:06:26.289 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 15:06:26.289 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 15:06:26.289 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20244/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 15:06:26.291 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.170.179/tcp/20245/p2p/16Uiu2HAmRC7GvUryAKBVqQ3Knf6CrJk1FhLKLnTNdiEcmkKGjwsL","/ip4/172.18.170.179/tcp/20246/ws/p2p/16Uiu2HAmRC7GvUryAKBVqQ3Knf6CrJk1FhLKLnTNdiEcmkKGjwsL"],"enrUri":"enr:-L24QDQq5tso9Br0p-JKkv9kdYXs-fOf37TBrbTWlOaOTIdQIvjOSbQxiALLzom6vVA7ffH5hZZkJIP0KTDTmqPM2bcCgmlkgnY0gmlwhKwSqrOKbXVsdGlhZGRyc5YACASsEqqzBk8VAAoErBKqswZPFt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDukUT9xTOJ4mEdQkYB5WbicNNirTmuf8ghTetXFVV6H-DdGNwgk8Vg3VkcIJPF4V3YWt1MgA"}'
2026-03-05 15:06:26.292 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 15:06:26.292 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20244/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.124.146/tcp/14952/p2p/16Uiu2HAmDvzP9PM1sFa7WPi92E4E7Ehm5K1yHu4yKR3VAnPPB18j"]'
2026-03-05 15:06:26.330 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 15:06:26.331 DEBUG [src.steps.filter] Running fixture setup: subscribe_main_nodes
2026-03-05 15:06:26.331 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14951/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-05 15:06:26.347 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 15:06:26.348 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20244/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "97e2880a-0675-4c98-8754-8a7e26f4a68f", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-05 15:06:26.362 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"97e2880a-0675-4c98-8754-8a7e26f4a68f","statusDesc":"OK"}'
2026-03-05 15:06:26.363 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14951/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 15:06:26.371 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 15:06:26.371 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-05 15:06:26.472 DEBUG [src.steps.filter] Checking that peer NODE_2:harbor.status.im/wakuorg/nwaku:v0.38.0-beta can find the published message
2026-03-05 15:06:26.472 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20244/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-05 15:06:26.475 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772723186363752067,"ephemeral":false}]'
2026-03-05 15:06:26.476 DEBUG [src.node.waku_node] Restarting container with id 3b60a7530ff1
2026-03-05 15:06:27.253 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20244/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 15:06:27.357 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20244/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 15:06:27.360 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 15:06:27.360 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 15:06:27.360 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20244/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 15:06:27.362 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.170.179/tcp/20245/p2p/16Uiu2HAmRC7GvUryAKBVqQ3Knf6CrJk1FhLKLnTNdiEcmkKGjwsL","/ip4/172.18.170.179/tcp/20246/ws/p2p/16Uiu2HAmRC7GvUryAKBVqQ3Knf6CrJk1FhLKLnTNdiEcmkKGjwsL"],"enrUri":"enr:-L24QDQq5tso9Br0p-JKkv9kdYXs-fOf37TBrbTWlOaOTIdQIvjOSbQxiALLzom6vVA7ffH5hZZkJIP0KTDTmqPM2bcCgmlkgnY0gmlwhKwSqrOKbXVsdGlhZGRyc5YACASsEqqzBk8VAAoErBKqswZPFt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDukUT9xTOJ4mEdQkYB5WbicNNirTmuf8ghTetXFVV6H-DdGNwgk8Vg3VkcIJPF4V3YWt1MgA"}'
2026-03-05 15:06:27.362 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 15:06:27.363 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-05 15:06:29.363 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14951/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-05 15:06:29.366 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 15:06:29.367 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20244/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "6b496297-b214-4481-9529-ae9319dc7f50", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-05 15:06:29.376 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"6b496297-b214-4481-9529-ae9319dc7f50","statusDesc":"OK"}'
2026-03-05 15:06:29.377 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14951/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-05 15:06:29.384 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 15:06:29.384 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-05 15:06:29.485 DEBUG [src.steps.filter] Checking that peer NODE_2:harbor.status.im/wakuorg/nwaku:v0.38.0-beta can find the published message
2026-03-05 15:06:29.485 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20244/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-05 15:06:29.488 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772723189377007056,"ephemeral":false}]'
2026-03-05 15:06:29.491 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-05 15:06:29.492 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-05 15:06:29.492 DEBUG [src.node.waku_node] Stopping container with id 63818f3c46e8
2026-03-05 15:06:30.040 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 15:06:30.041 DEBUG [src.node.waku_node] Stopping container with id 3b60a7530ff1
2026-03-05 15:06:30.585 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 15:06:30.587 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-05 15:06:30.604 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 15:06:30.619 DEBUG [src.node.docker_mananger] No errors found in the waku logs.