94 lines
16 KiB
Plaintext

2026-03-21 04:32:47.660 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-21 04:32:47.661 DEBUG [tests.conftest] Running test: test_single_pubsub_topic[/waku/2/rs/2/1] with id: 2026-03-21_04-32-47__5aea6f3f-a22d-41eb-8038-99093d5e7e4c
2026-03-21 04:32:47.661 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-21 04:32:47.661 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-21 04:32:47.661 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-21 04:32:47.669 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-21 04:32:47.670 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-21_04-32-47__5aea6f3f-a22d-41eb-8038-99093d5e7e4c__wakuorg_nwaku:latest.log
2026-03-21 04:32:47.670 DEBUG [src.node.waku_node] Starting Node...
2026-03-21 04:32:47.670 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-21 04:32:47.671 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-21 04:32:47.672 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.236.223
2026-03-21 04:32:47.672 DEBUG [src.node.docker_mananger] Generated ports ['20007', '20008', '20009', '20010', '20011']
2026-03-21 04:32:47.672 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-21 04:32:47.672 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-21 04:32:47.672 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-21 04:32:47.672 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-21 04:32:47.672 DEBUG [src.node.waku_node] Using volumes []
2026-03-21 04:32:47.672 DEBUG [src.node.docker_mananger] docker run -i -t -p 20007:20007 -p 20008:20008 -p 20009:20009 -p 20010:20010 -p 20011:20011 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=20009 --rest-port=20007 --tcp-port=20008 --discv5-udp-port=20010 --rest-address=0.0.0.0 --nat=extip:172.18.236.223 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=98ce1cfce7ffbe7defa1a9ee7cdaaabb8f21be8c703385a12153cf081b2996cf --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=20011 --metrics-logging=true --relay=true --filter=true
2026-03-21 04:32:47.861 ERROR [src.node.docker_mananger] Max retries reached for container 92fe18af5fa3. Exiting log stream.
2026-03-21 04:32:47.891 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.236.223 waku 72e691232fe2648539b236af55f47ca6fe1fa80a96da08e51e42d896810107e3
2026-03-21 04:32:47.928 DEBUG [src.node.docker_mananger] Container started with ID 72e691232fe2. Setting up logs at ./log/docker/node1_2026-03-21_04-32-47__5aea6f3f-a22d-41eb-8038-99093d5e7e4c__wakuorg_nwaku:latest.log
2026-03-21 04:32:47.930 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 20007
2026-03-21 04:32:47.930 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-21 04:32:48.437 ERROR [src.node.docker_mananger] Max retries reached for container 6eb99d7b1076. Exiting log stream.
2026-03-21 04:32:48.931 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20007/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:48.934 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:49.034 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20007/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:49.037 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:49.137 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20007/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:49.141 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:49.241 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20007/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:49.245 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:49.345 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20007/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:49.349 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:49.449 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20007/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:49.452 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:49.553 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20007/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:49.556 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:49.656 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20007/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:49.659 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-21 04:32:49.659 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-21 04:32:49.659 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20007/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:49.662 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.236.223/tcp/20008/p2p/16Uiu2HAmMvSvUbCh5nMhpjBrrW499szboG3pUgXof3d2UD7eJfcp","/ip4/172.18.236.223/tcp/20009/ws/p2p/16Uiu2HAmMvSvUbCh5nMhpjBrrW499szboG3pUgXof3d2UD7eJfcp"],"enrUri":"enr:-L24QKTYyOBW6iFA5rhsU7Kw2AQ-xsuhbkyduTBe2wh1mnH9OdjoHiJ8SHfR3AszCwBq5inwPXP-Q28R7fpWXoWaibwCgmlkgnY0gmlwhKwS7N-KbXVsdGlhZGRyc5YACASsEuzfBk4oAAoErBLs3wZOKd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDia7wkpQHHUjnji0exJFJQEI3SQDXW64BCiBFrTBvhK2DdGNwgk4og3VkcIJOKoV3YWt1MgU"}'
2026-03-21 04:32:49.662 INFO [src.node.waku_node] REST service is ready !!
2026-03-21 04:32:49.669 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-21 04:32:49.669 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-21_04-32-47__5aea6f3f-a22d-41eb-8038-99093d5e7e4c__wakuorg_nwaku:latest.log
2026-03-21 04:32:49.669 DEBUG [src.node.waku_node] Starting Node...
2026-03-21 04:32:49.670 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-21 04:32:49.671 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-21 04:32:49.671 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.7.138
2026-03-21 04:32:49.671 DEBUG [src.node.docker_mananger] Generated ports ['56951', '56952', '56953', '56954', '56955']
2026-03-21 04:32:49.671 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-21 04:32:49.672 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-21 04:32:49.672 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-21 04:32:49.672 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-21 04:32:49.672 DEBUG [src.node.waku_node] Using volumes []
2026-03-21 04:32:49.672 DEBUG [src.node.docker_mananger] docker run -i -t -p 56951:56951 -p 56952:56952 -p 56953:56953 -p 56954:56954 -p 56955:56955 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=56953 --rest-port=56951 --tcp-port=56952 --discv5-udp-port=56954 --rest-address=0.0.0.0 --nat=extip:172.18.7.138 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=ffacd7874ebfceedbf2de2ec539edee3ebc789bdd8be2f1a6adcc417baabb71f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=56955 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QKTYyOBW6iFA5rhsU7Kw2AQ-xsuhbkyduTBe2wh1mnH9OdjoHiJ8SHfR3AszCwBq5inwPXP-Q28R7fpWXoWaibwCgmlkgnY0gmlwhKwS7N-KbXVsdGlhZGRyc5YACASsEuzfBk4oAAoErBLs3wZOKd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDia7wkpQHHUjnji0exJFJQEI3SQDXW64BCiBFrTBvhK2DdGNwgk4og3VkcIJOKoV3YWt1MgU
2026-03-21 04:32:49.882 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.7.138 waku 152066d303b8f699b1e8527214489ffa8506dec0f71ccf1ee7883d8a760dc136
2026-03-21 04:32:49.924 DEBUG [src.node.docker_mananger] Container started with ID 152066d303b8. Setting up logs at ./log/docker/node2_2026-03-21_04-32-47__5aea6f3f-a22d-41eb-8038-99093d5e7e4c__wakuorg_nwaku:latest.log
2026-03-21 04:32:49.924 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 56951
2026-03-21 04:32:49.924 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-21 04:32:50.925 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56951/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:50.928 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:51.028 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56951/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:51.032 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-21 04:32:51.032 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-21 04:32:51.032 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56951/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:51.035 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.7.138/tcp/56952/p2p/16Uiu2HAmCbNJjmjMLpUJ52UPMzZHeN4Gbvfp8rAsBjnXmZV31UXC","/ip4/172.18.7.138/tcp/56953/ws/p2p/16Uiu2HAmCbNJjmjMLpUJ52UPMzZHeN4Gbvfp8rAsBjnXmZV31UXC"],"enrUri":"enr:-L24QB4xje3_v8y0XPvx9Cnb54H5uBQXb8KHP7zqSJqIF6LlcaWU-AAxiROxtS_PfgzblQX_8F9Pq2phgMaaWYmvYjUCgmlkgnY0gmlwhKwSB4qKbXVsdGlhZGRyc5YACASsEgeKBt54AAoErBIHigbeed0DgnJzhQACAQAAiXNlY3AyNTZrMaEC_xKAo8w-I1n-r8MSb0WWo6XH3Hfts4A5vJ5qf8H1_0ODdGNwgt54g3VkcILeeoV3YWt1MgE"}'
2026-03-21 04:32:51.035 INFO [src.node.waku_node] REST service is ready !!
2026-03-21 04:32:51.035 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56951/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.236.223/tcp/20008/p2p/16Uiu2HAmMvSvUbCh5nMhpjBrrW499szboG3pUgXof3d2UD7eJfcp"]'
2026-03-21 04:32:51.056 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:51.062 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20007/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/1"]'
2026-03-21 04:32:51.074 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:51.075 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56951/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/1"]'
2026-03-21 04:32:51.080 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:51.081 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:51.091 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:51.092 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-21 04:32:51.194 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:51.194 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20007/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:51.197 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067571081642628,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:51.199 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:51.199 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56951/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:51.201 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067571081642628,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:51.204 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-21 04:32:51.205 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-21 04:32:51.206 DEBUG [src.node.waku_node] Stopping container with id 72e691232fe2
2026-03-21 04:32:51.801 DEBUG [src.node.waku_node] Container stopped.
2026-03-21 04:32:51.801 DEBUG [src.node.waku_node] Stopping container with id 152066d303b8
2026-03-21 04:32:52.390 DEBUG [src.node.waku_node] Container stopped.
2026-03-21 04:32:52.391 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-21 04:32:52.432 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-21 04:32:52.461 DEBUG [src.node.docker_mananger] No errors found in the waku logs.