95 lines
16 KiB
Plaintext

2026-03-18 04:40:50.614 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-18 04:40:50.614 DEBUG [tests.conftest] Running test: test_single_content_topic[/app/27/sometopic/someencoding] with id: 2026-03-18_04-40-50__db70d457-2880-4b87-8574-145052ad8f69
2026-03-18 04:40:50.615 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-18 04:40:50.615 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-18 04:40:50.615 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-18 04:40:50.623 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-18 04:40:50.623 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-18_04-40-50__db70d457-2880-4b87-8574-145052ad8f69__wakuorg_nwaku:latest.log
2026-03-18 04:40:50.624 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 04:40:50.624 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 04:40:50.625 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 04:40:50.625 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.112.232
2026-03-18 04:40:50.625 DEBUG [src.node.docker_mananger] Generated ports ['26027', '26028', '26029', '26030', '26031']
2026-03-18 04:40:50.626 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 04:40:50.626 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 04:40:50.626 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 04:40:50.626 DEBUG [src.node.docker_mananger] docker run -i -t -p 26027:26027 -p 26028:26028 -p 26029:26029 -p 26030:26030 -p 26031:26031 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=26029 --rest-port=26027 --tcp-port=26028 --discv5-udp-port=26030 --rest-address=0.0.0.0 --nat=extip:172.18.112.232 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=d27538bacc17d0cdbb26b87a73fd53ec628ac0aeccb9670a7dc0053cbc1faa4f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=26031 --metrics-logging=true --relay=true --filter=true --content-topic=/app/27/sometopic/someencoding
2026-03-18 04:40:50.812 ERROR [src.node.docker_mananger] Max retries reached for container 5a62ce2b6e11. Exiting log stream.
2026-03-18 04:40:50.830 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.112.232 waku 3f6b40193d93dab576e4847dc7445ec0ff0c71951f9bfe06d766f6119aa1f356
2026-03-18 04:40:50.865 DEBUG [src.node.docker_mananger] Container started with ID 3f6b40193d93. Setting up logs at ./log/docker/node1_2026-03-18_04-40-50__db70d457-2880-4b87-8574-145052ad8f69__wakuorg_nwaku:latest.log
2026-03-18 04:40:50.866 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 26027
2026-03-18 04:40:50.866 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 04:40:51.400 ERROR [src.node.docker_mananger] Max retries reached for container df07e4a0f7e4. Exiting log stream.
2026-03-18 04:40:51.867 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26027/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:40:51.871 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-18 04:40:51.971 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26027/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:40:51.974 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-18 04:40:52.074 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26027/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:40:52.077 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-18 04:40:52.178 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26027/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:40:52.181 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-18 04:40:52.281 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26027/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:40:52.284 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-18 04:40:52.384 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26027/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:40:52.387 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-18 04:40:52.488 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26027/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:40:52.490 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-18 04:40:52.591 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26027/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:40:52.593 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-18 04:40:52.694 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26027/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:40:52.697 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-18 04:40:52.797 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26027/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:40:52.800 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-18 04:40:52.900 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26027/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:40:52.903 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 04:40:52.903 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 04:40:52.904 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26027/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:40:52.906 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.112.232/tcp/26028/p2p/16Uiu2HAmNRReReKFsYcEkAUwLgEjeJMbtzDqe9TYTBPFvXvsfWxQ","/ip4/172.18.112.232/tcp/26029/ws/p2p/16Uiu2HAmNRReReKFsYcEkAUwLgEjeJMbtzDqe9TYTBPFvXvsfWxQ"],"enrUri":"enr:-L24QAzwQSbXJBUzNdDkC7aU1kfaWY9_pTu7LCQsquQxdgRKIbpoeER6dgfEx4C1dRaexf4hATLIJFJSwlCXEANDHxgCgmlkgnY0gmlwhKwScOiKbXVsdGlhZGRyc5YACASsEnDoBmWsAAoErBJw6AZlrd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDkRtW7zb4aZsVFMZTOKTYXFjaGQHh_UZvsnqqvNOfzNGDdGNwgmWsg3VkcIJlroV3YWt1MgU"}'
2026-03-18 04:40:52.906 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 04:40:52.914 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-18 04:40:52.914 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-18_04-40-50__db70d457-2880-4b87-8574-145052ad8f69__wakuorg_nwaku:latest.log
2026-03-18 04:40:52.914 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 04:40:52.914 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 04:40:52.916 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 04:40:52.916 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.59.136
2026-03-18 04:40:52.916 DEBUG [src.node.docker_mananger] Generated ports ['12837', '12838', '12839', '12840', '12841']
2026-03-18 04:40:52.916 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 04:40:52.916 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 04:40:52.917 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 04:40:52.917 DEBUG [src.node.docker_mananger] docker run -i -t -p 12837:12837 -p 12838:12838 -p 12839:12839 -p 12840:12840 -p 12841:12841 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=12839 --rest-port=12837 --tcp-port=12838 --discv5-udp-port=12840 --rest-address=0.0.0.0 --nat=extip:172.18.59.136 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=fddff0d71e4bb642edba49558484beed3d8cb4254bc902c5daa2b4bfabaf7fd0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=12841 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAzwQSbXJBUzNdDkC7aU1kfaWY9_pTu7LCQsquQxdgRKIbpoeER6dgfEx4C1dRaexf4hATLIJFJSwlCXEANDHxgCgmlkgnY0gmlwhKwScOiKbXVsdGlhZGRyc5YACASsEnDoBmWsAAoErBJw6AZlrd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDkRtW7zb4aZsVFMZTOKTYXFjaGQHh_UZvsnqqvNOfzNGDdGNwgmWsg3VkcIJlroV3YWt1MgU --content-topic=/app/27/sometopic/someencoding
2026-03-18 04:40:53.128 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.59.136 waku 27d04ef282c1133ff9a8aceb60dd7a2771889b594a5f4e3fe3e736502d25aca4
2026-03-18 04:40:53.165 DEBUG [src.node.docker_mananger] Container started with ID 27d04ef282c1. Setting up logs at ./log/docker/node2_2026-03-18_04-40-50__db70d457-2880-4b87-8574-145052ad8f69__wakuorg_nwaku:latest.log
2026-03-18 04:40:53.166 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 12837
2026-03-18 04:40:53.166 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 04:40:54.166 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12837/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:40:54.169 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 04:40:54.170 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 04:40:54.170 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12837/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:40:54.172 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.59.136/tcp/12838/p2p/16Uiu2HAm2UGcs17Z75Jj7UonpCveDzv9wXEJb5MkL1Jc8b8unKQz","/ip4/172.18.59.136/tcp/12839/ws/p2p/16Uiu2HAm2UGcs17Z75Jj7UonpCveDzv9wXEJb5MkL1Jc8b8unKQz"],"enrUri":"enr:-L24QGt3K_KuTF006EeouGJEitTsR9IblGPgyFzwlBTmCVMtZKVHgI4oDOrc0g5vIBcpoxcbVaCKqmDV0NG5_2R7SisCgmlkgnY0gmlwhKwSO4iKbXVsdGlhZGRyc5YACASsEjuIBjImAAoErBI7iAYyJ90DgnJzhQACAQAAiXNlY3AyNTZrMaECaKwi_g49GjdeiOPpXUbA2CDwrUmd8gPMP4VijmxzjJ-DdGNwgjImg3VkcIIyKIV3YWt1MgE"}'
2026-03-18 04:40:54.173 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 04:40:54.173 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12837/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.112.232/tcp/26028/p2p/16Uiu2HAmNRReReKFsYcEkAUwLgEjeJMbtzDqe9TYTBPFvXvsfWxQ"]'
2026-03-18 04:40:54.216 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:40:54.218 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26027/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/27/sometopic/someencoding"]'
2026-03-18 04:40:54.226 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:40:54.227 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12837/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/27/sometopic/someencoding"]'
2026-03-18 04:40:54.233 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:40:54.235 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26027/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/27/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:40:54.252 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:40:54.253 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-18 04:40:54.354 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-18 04:40:54.354 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26027/relay/v1/auto/messages/%2Fapp%2F27%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:40:54.357 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/27/sometopic/someencoding","version":0,"timestamp":1773808848989528833,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/27/sometopic/someencoding","version":0,"timestamp":1773808854235226005,"ephemeral":false,"proof":""}]'
2026-03-18 04:40:54.367 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-18 04:40:54.368 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-18 04:40:54.369 DEBUG [src.node.waku_node] Stopping container with id 3f6b40193d93
2026-03-18 04:40:54.975 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 04:40:54.975 DEBUG [src.node.waku_node] Stopping container with id 27d04ef282c1
2026-03-18 04:40:55.576 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 04:40:55.580 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-18 04:40:55.620 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-18 04:40:55.653 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-18 04:40:55.654 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-18 04:40:55.654 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-18 04:40:55.655 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-18_04-40-50__db70d457-2880-4b87-8574-145052ad8f69__wakuorg_nwaku:latest.log
2026-03-18 04:40:55.656 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-18_04-40-50__db70d457-2880-4b87-8574-145052ad8f69__wakuorg_nwaku:latest.log