83 lines
14 KiB
Plaintext

2026-03-19 04:42:05.441 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-19 04:42:05.442 DEBUG [tests.conftest] Running test: test_multiple_pubsub_topics_same_cluster with id: 2026-03-19_04-42-05__30a30890-7bce-4193-b2c5-16c84b5f4c08
2026-03-19 04:42:05.442 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-19 04:42:05.442 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-19 04:42:05.442 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-19 04:42:05.451 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-19 04:42:05.451 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-19_04-42-05__30a30890-7bce-4193-b2c5-16c84b5f4c08__wakuorg_nwaku:latest.log
2026-03-19 04:42:05.451 DEBUG [src.node.waku_node] Starting Node...
2026-03-19 04:42:05.451 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-19 04:42:05.453 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-19 04:42:05.453 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.69.6
2026-03-19 04:42:05.453 DEBUG [src.node.docker_mananger] Generated ports ['13157', '13158', '13159', '13160', '13161']
2026-03-19 04:42:05.453 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-19 04:42:05.453 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-19 04:42:05.453 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-19 04:42:05.454 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-19 04:42:05.454 DEBUG [src.node.waku_node] Using volumes []
2026-03-19 04:42:05.454 DEBUG [src.node.docker_mananger] docker run -i -t -p 13157:13157 -p 13158:13158 -p 13159:13159 -p 13160:13160 -p 13161:13161 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13159 --rest-port=13157 --tcp-port=13158 --discv5-udp-port=13160 --rest-address=0.0.0.0 --nat=extip:172.18.69.6 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=bf0a276c2effa749f2d0e33abfa1dfdf4ff139649b7dc9c1747fdcc79f06260b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13161 --metrics-logging=true --relay=true --filter=true
2026-03-19 04:42:05.643 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.69.6 waku e3eaab9f0da8d3112e6f6bd668f0eb3bbf0b9e28c13c534f5748b2102e5a6c4c
2026-03-19 04:42:05.651 ERROR [src.node.docker_mananger] Max retries reached for container 9c581563e9e4. Exiting log stream.
2026-03-19 04:42:05.683 DEBUG [src.node.docker_mananger] Container started with ID e3eaab9f0da8. Setting up logs at ./log/docker/node1_2026-03-19_04-42-05__30a30890-7bce-4193-b2c5-16c84b5f4c08__wakuorg_nwaku:latest.log
2026-03-19 04:42:05.683 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 13157
2026-03-19 04:42:05.684 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-19 04:42:06.238 ERROR [src.node.docker_mananger] Max retries reached for container 886ccf24e67d. Exiting log stream.
2026-03-19 04:42:06.686 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13157/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:42:06.698 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:42:06.799 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13157/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:42:06.802 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-19 04:42:06.802 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-19 04:42:06.803 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13157/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:42:06.805 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.69.6/tcp/13158/p2p/16Uiu2HAkzM6hu9Uq7B58Y87W9q5E68HYz6tT2VQ4dFiLiANRAPRv","/ip4/172.18.69.6/tcp/13159/ws/p2p/16Uiu2HAkzM6hu9Uq7B58Y87W9q5E68HYz6tT2VQ4dFiLiANRAPRv"],"enrUri":"enr:-L24QGsdCfgwADgabC1jAq_9_O1u9LwHZyTgt9Fs8GfoWLVHSOhouMhTiuBusJ1qZhjQCjayJzHcjKOCleoGe3RQKs4CgmlkgnY0gmlwhKwSRQaKbXVsdGlhZGRyc5YACASsEkUGBjNmAAoErBJFBgYzZ90DgnJzhQACAQAAiXNlY3AyNTZrMaECSR59A1MOisu7AuCPVsYG3QIpVB8jLBnNPWY5Q0NEXYWDdGNwgjNmg3VkcIIzaIV3YWt1MgU"}'
2026-03-19 04:42:06.805 INFO [src.node.waku_node] REST service is ready !!
2026-03-19 04:42:06.813 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-19 04:42:06.813 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-19_04-42-05__30a30890-7bce-4193-b2c5-16c84b5f4c08__wakuorg_nwaku:latest.log
2026-03-19 04:42:06.813 DEBUG [src.node.waku_node] Starting Node...
2026-03-19 04:42:06.813 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-19 04:42:06.815 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-19 04:42:06.815 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.156.182
2026-03-19 04:42:06.815 DEBUG [src.node.docker_mananger] Generated ports ['18819', '18820', '18821', '18822', '18823']
2026-03-19 04:42:06.815 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-19 04:42:06.815 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-19 04:42:06.815 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-19 04:42:06.815 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-19 04:42:06.816 DEBUG [src.node.waku_node] Using volumes []
2026-03-19 04:42:06.816 DEBUG [src.node.docker_mananger] docker run -i -t -p 18819:18819 -p 18820:18820 -p 18821:18821 -p 18822:18822 -p 18823:18823 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=18821 --rest-port=18819 --tcp-port=18820 --discv5-udp-port=18822 --rest-address=0.0.0.0 --nat=extip:172.18.156.182 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=5a6ab83ec6fc11d657d9c373d3cbd5ac441e968e8fd98df709acff973a7b9cbc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=18823 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QGsdCfgwADgabC1jAq_9_O1u9LwHZyTgt9Fs8GfoWLVHSOhouMhTiuBusJ1qZhjQCjayJzHcjKOCleoGe3RQKs4CgmlkgnY0gmlwhKwSRQaKbXVsdGlhZGRyc5YACASsEkUGBjNmAAoErBJFBgYzZ90DgnJzhQACAQAAiXNlY3AyNTZrMaECSR59A1MOisu7AuCPVsYG3QIpVB8jLBnNPWY5Q0NEXYWDdGNwgjNmg3VkcIIzaIV3YWt1MgU
2026-03-19 04:42:07.018 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.156.182 waku e10db81e047b8d7818bb3a93844d36157d32c96c4443eebd16fe4c1079a86aa3
2026-03-19 04:42:07.055 DEBUG [src.node.docker_mananger] Container started with ID e10db81e047b. Setting up logs at ./log/docker/node2_2026-03-19_04-42-05__30a30890-7bce-4193-b2c5-16c84b5f4c08__wakuorg_nwaku:latest.log
2026-03-19 04:42:07.055 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 18819
2026-03-19 04:42:07.056 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-19 04:42:08.056 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18819/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:42:08.059 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:42:08.159 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18819/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:42:08.166 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-19 04:42:08.167 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-19 04:42:08.169 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:18819/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:42:08.173 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.156.182/tcp/18820/p2p/16Uiu2HAmN4ikscGRyfGqy4UHZF8ymphQdnm8vhCxNiwEhtEHLsw6","/ip4/172.18.156.182/tcp/18821/ws/p2p/16Uiu2HAmN4ikscGRyfGqy4UHZF8ymphQdnm8vhCxNiwEhtEHLsw6"],"enrUri":"enr:-L24QHRR382QOQCbch6yFgMieKc0GPPkwIyZ12M3pNEbQLW_VC-K6AqQl860HR3BXYnDoV3OF8-xBWryP0uXcxUWZJICgmlkgnY0gmlwhKwSnLaKbXVsdGlhZGRyc5YACASsEpy2BkmEAAoErBKctgZJhd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDi819gVgejLGLpyKMVSWDs-zaNTaF7q0jPxnLAjqzQCGDdGNwgkmEg3VkcIJJhoV3YWt1MgE"}'
2026-03-19 04:42:08.173 INFO [src.node.waku_node] REST service is ready !!
2026-03-19 04:42:08.174 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18819/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.69.6/tcp/13158/p2p/16Uiu2HAkzM6hu9Uq7B58Y87W9q5E68HYz6tT2VQ4dFiLiANRAPRv"]'
2026-03-19 04:42:08.219 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:42:08.221 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13157/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-19 04:42:08.228 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:42:08.229 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:18819/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-19 04:42:08.233 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:42:08.235 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13157/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:42:08.249 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:42:08.250 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-19 04:42:08.351 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-19 04:42:08.351 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13157/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:42:08.353 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773895324713345749,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773895328234971882,"ephemeral":false,"proof":""}]'
2026-03-19 04:42:08.362 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-19 04:42:08.363 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-19 04:42:08.363 DEBUG [src.node.waku_node] Stopping container with id e3eaab9f0da8
2026-03-19 04:42:08.946 DEBUG [src.node.waku_node] Container stopped.
2026-03-19 04:42:08.947 DEBUG [src.node.waku_node] Stopping container with id e10db81e047b
2026-03-19 04:42:09.506 DEBUG [src.node.waku_node] Container stopped.
2026-03-19 04:42:09.510 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-19 04:42:09.541 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-19 04:42:09.575 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-19 04:42:09.576 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-19 04:42:09.577 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-19 04:42:09.581 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-19_04-42-05__30a30890-7bce-4193-b2c5-16c84b5f4c08__wakuorg_nwaku:latest.log
2026-03-19 04:42:09.583 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-19_04-42-05__30a30890-7bce-4193-b2c5-16c84b5f4c08__wakuorg_nwaku:latest.log