99 lines
16 KiB
Plaintext

2026-03-14 04:39:34.712 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-14 04:39:34.712 DEBUG [tests.conftest] Running test: test_single_pubsub_topic[/waku/2/rs/2/0] with id: 2026-03-14_04-39-34__ebc32385-3904-46a8-ab3e-89a5bf1057ad
2026-03-14 04:39:34.712 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-14 04:39:34.712 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-14 04:39:34.713 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-14 04:39:34.720 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:39:34.720 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-14_04-39-34__ebc32385-3904-46a8-ab3e-89a5bf1057ad__wakuorg_nwaku:latest.log
2026-03-14 04:39:34.720 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:39:34.721 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:39:34.722 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:39:34.722 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.121.97
2026-03-14 04:39:34.722 DEBUG [src.node.docker_mananger] Generated ports ['1700', '1701', '1702', '1703', '1704']
2026-03-14 04:39:34.722 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-14 04:39:34.722 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-14 04:39:34.722 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:39:34.722 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:39:34.723 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:39:34.723 DEBUG [src.node.docker_mananger] docker run -i -t -p 1700:1700 -p 1701:1701 -p 1702:1702 -p 1703:1703 -p 1704:1704 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=1702 --rest-port=1700 --tcp-port=1701 --discv5-udp-port=1703 --rest-address=0.0.0.0 --nat=extip:172.18.121.97 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=cfb530c06abed9adeef4f4afa0cf6baf1df069c166aa11abdcabaf90ccf4d78b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=1704 --metrics-logging=true --relay=true --filter=true
2026-03-14 04:39:34.918 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.121.97 waku 823160c97d1bd8e168dd174c3d79ea1ec757d1fe8a1fe0ee446ee108854de038
2026-03-14 04:39:34.940 ERROR [src.node.docker_mananger] Max retries reached for container c1c4370cff39. Exiting log stream.
2026-03-14 04:39:34.955 DEBUG [src.node.docker_mananger] Container started with ID 823160c97d1b. Setting up logs at ./log/docker/node1_2026-03-14_04-39-34__ebc32385-3904-46a8-ab3e-89a5bf1057ad__wakuorg_nwaku:latest.log
2026-03-14 04:39:34.956 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 1700
2026-03-14 04:39:34.956 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:39:35.437 ERROR [src.node.docker_mananger] Max retries reached for container 1d28965062fa. Exiting log stream.
2026-03-14 04:39:35.956 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1700/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:39:35.959 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:39:35.959 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:39:35.959 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1700/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:39:35.961 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.121.97/tcp/1701/p2p/16Uiu2HAm15CEt64hHodarm7HjSM7UNZSWvsTmwnbYnco9tBXDLEN","/ip4/172.18.121.97/tcp/1702/ws/p2p/16Uiu2HAm15CEt64hHodarm7HjSM7UNZSWvsTmwnbYnco9tBXDLEN"],"enrUri":"enr:-L24QD2QA7wa8K8cTGB5fETfNGj-7ro4jXdYPpewvFpb00VnLA8eXIGwXQNjXDX6NTawyX4SuQwRl6uyV0qP2Mv_eeQCgmlkgnY0gmlwhKwSeWGKbXVsdGlhZGRyc5YACASsEnlhBgalAAoErBJ5YQYGpt0DgnJzhQACAQAAiXNlY3AyNTZrMaECU-cjywj28D_bjuqaZZJYwPmBGBpe16ls1oeXrKGWEXODdGNwggalg3VkcIIGp4V3YWt1MgU"}'
2026-03-14 04:39:35.962 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:39:35.969 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:39:35.969 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-14_04-39-34__ebc32385-3904-46a8-ab3e-89a5bf1057ad__wakuorg_nwaku:latest.log
2026-03-14 04:39:35.969 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:39:35.969 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:39:35.970 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:39:35.971 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.76.79
2026-03-14 04:39:35.971 DEBUG [src.node.docker_mananger] Generated ports ['19841', '19842', '19843', '19844', '19845']
2026-03-14 04:39:35.971 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-14 04:39:35.971 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-14 04:39:35.971 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:39:35.971 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:39:35.972 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:39:35.972 DEBUG [src.node.docker_mananger] docker run -i -t -p 19841:19841 -p 19842:19842 -p 19843:19843 -p 19844:19844 -p 19845:19845 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=19843 --rest-port=19841 --tcp-port=19842 --discv5-udp-port=19844 --rest-address=0.0.0.0 --nat=extip:172.18.76.79 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=8440a3cd6eefaed7afd525aa52c52ea9d79ec7fd7dacf8e40eda7e6a1e041c55 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=19845 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QD2QA7wa8K8cTGB5fETfNGj-7ro4jXdYPpewvFpb00VnLA8eXIGwXQNjXDX6NTawyX4SuQwRl6uyV0qP2Mv_eeQCgmlkgnY0gmlwhKwSeWGKbXVsdGlhZGRyc5YACASsEnlhBgalAAoErBJ5YQYGpt0DgnJzhQACAQAAiXNlY3AyNTZrMaECU-cjywj28D_bjuqaZZJYwPmBGBpe16ls1oeXrKGWEXODdGNwggalg3VkcIIGp4V3YWt1MgU
2026-03-14 04:39:36.178 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.76.79 waku 12541e90d4c8e0e5508e797f931ba40d644041e15b721b55c173d0c92bf8ef3c
2026-03-14 04:39:36.213 DEBUG [src.node.docker_mananger] Container started with ID 12541e90d4c8. Setting up logs at ./log/docker/node2_2026-03-14_04-39-34__ebc32385-3904-46a8-ab3e-89a5bf1057ad__wakuorg_nwaku:latest.log
2026-03-14 04:39:36.213 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 19841
2026-03-14 04:39:36.214 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:39:37.214 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19841/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:39:37.217 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:39:37.317 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19841/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:39:37.319 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:39:37.420 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19841/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:39:37.422 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:39:37.523 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19841/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:39:37.525 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:39:37.626 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19841/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:39:37.628 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:39:37.728 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19841/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:39:37.730 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:39:37.831 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19841/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:39:37.833 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:39:37.933 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19841/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:39:37.935 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:39:38.036 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19841/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:39:38.038 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:39:38.139 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19841/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:39:38.141 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:39:38.241 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19841/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:39:38.244 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:39:38.244 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:39:38.244 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19841/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:39:38.246 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.76.79/tcp/19842/p2p/16Uiu2HAmP5VXDcaY5bQPVL4FrBFno84Jd1CJueXjedPPG6CbpEit","/ip4/172.18.76.79/tcp/19843/ws/p2p/16Uiu2HAmP5VXDcaY5bQPVL4FrBFno84Jd1CJueXjedPPG6CbpEit"],"enrUri":"enr:-L24QFw1-ckGE26LkwOLYblMCUnBCu4JLpQLAxl1resX8a5NdDzQWKXBqfRdzPd4-mnkBXnN2pqOJzbgY_Ywdb5MhfACgmlkgnY0gmlwhKwSTE-KbXVsdGlhZGRyc5YACASsEkxPBk2CAAoErBJMTwZNg90DgnJzhQACAQAAiXNlY3AyNTZrMaEDmtvK6ma9GWUurjgUclqABLINmlwZxugWfCUlbGkZcmmDdGNwgk2Cg3VkcIJNhIV3YWt1MgE"}'
2026-03-14 04:39:38.247 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:39:38.247 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19841/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.121.97/tcp/1701/p2p/16Uiu2HAm15CEt64hHodarm7HjSM7UNZSWvsTmwnbYnco9tBXDLEN"]'
2026-03-14 04:39:38.268 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:39:38.268 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1700/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-03-14 04:39:38.279 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:39:38.280 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19841/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-03-14 04:39:38.284 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:39:38.285 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1700/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-14 04:39:38.295 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:39:38.295 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-14 04:39:38.396 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-14 04:39:38.396 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1700/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:39:38.398 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773463176260360453,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773463178285184321,"ephemeral":false,"proof":""}]'
2026-03-14 04:39:38.408 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-14 04:39:38.410 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-14 04:39:38.410 DEBUG [src.node.waku_node] Stopping container with id 823160c97d1b
2026-03-14 04:39:39.017 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:39:39.019 DEBUG [src.node.waku_node] Stopping container with id 12541e90d4c8
2026-03-14 04:39:39.624 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:39:39.625 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-14 04:39:39.691 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-14 04:39:39.718 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-14 04:39:39.719 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-14 04:39:39.719 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-14 04:39:39.720 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-14_04-39-34__ebc32385-3904-46a8-ab3e-89a5bf1057ad__wakuorg_nwaku:latest.log
2026-03-14 04:39:39.721 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-14_04-39-34__ebc32385-3904-46a8-ab3e-89a5bf1057ad__wakuorg_nwaku:latest.log