201 lines
36 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

INFO  tests.conftest:conftest.py:106 Fleet bootstrap inactive pass --fleet (or set FLEET_BOOTSTRAP=true) to connect local nodes to the waku.test fleet
DEBUG  tests.conftest:conftest.py:201 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:207 Running test: test_2_nodes_different_content_topic_different_shard with id: 2026-04-22_23-59-20__d0fcbfea-5513-4e85-b81a-d3b22e546fd2
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.steps.sharding:sharding.py:30 Running fixture setup: sharding_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/node1_2026-04-22_23-59-20__d0fcbfea-5513-4e85-b81a-d3b22e546fd2__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.98.62
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['20994', '20995', '20996', '20997', '20998']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 20994:20994 -p 20995:20995 -p 20996:20996 -p 20997:20997 -p 20998:20998 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=20996 --rest-port=20994 --tcp-port=20995 --discv5-udp-port=20997 --rest-address=0.0.0.0 --nat=extip:172.18.98.62 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=b78df65af37d5df2cf6d0ac66bada6c5badc485aa7abe4fdf6cdefdd121f8afb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=20998 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.98.62 waku c8bab4aca59809c9a17d76a8eb15539c44cfbff926d1d3fa103fbd0e3636f3a5
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID c8bab4aca598. Setting up logs at ./log/docker/node1_2026-04-22_23-59-20__d0fcbfea-5513-4e85-b81a-d3b22e546fd2__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 20994
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container d81741544cda. Exiting log stream.
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 88d9c28b4cde. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:20994/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:20994/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.98.62/tcp/20995/p2p/16Uiu2HAmQAb368sQitGRmXtgCPamnzJxRKaMAj3X5FZYiAbwkVsA","/ip4/172.18.98.62/tcp/20996/ws/p2p/16Uiu2HAmQAb368sQitGRmXtgCPamnzJxRKaMAj3X5FZYiAbwkVsA"],"enrUri":"enr:-L24QMKWbD3VzMZds8SsSKk17Se24Xuh1BWrIrCclVNqA6Syb_XqUot-9kVbjcMIQ6xZQZ7IA-pFdw20fC5n_Gc4c_ACgmlkgnY0gmlwhKwSYj6KbXVsdGlhZGRyc5YACASsEmI-BlIDAAoErBJiPgZSBN0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDqwWelRNdvSKWd2GnaUmhIedaOv0I-5hbSh8ZRCB0PmWDdGNwglIDg3VkcIJSBYV3YWt1MgU"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/node2_2026-04-22_23-59-20__d0fcbfea-5513-4e85-b81a-d3b22e546fd2__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.153.149
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['10400', '10401', '10402', '10403', '10404']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 10400:10400 -p 10401:10401 -p 10402:10402 -p 10403:10403 -p 10404:10404 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=10402 --rest-port=10400 --tcp-port=10401 --discv5-udp-port=10403 --rest-address=0.0.0.0 --nat=extip:172.18.153.149 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=e307f9d73dcb6fe3fd2ff4f04d861abcb4ceca2bb69eb10b1627f8aad379cbf4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=10404 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QMKWbD3VzMZds8SsSKk17Se24Xuh1BWrIrCclVNqA6Syb_XqUot-9kVbjcMIQ6xZQZ7IA-pFdw20fC5n_Gc4c_ACgmlkgnY0gmlwhKwSYj6KbXVsdGlhZGRyc5YACASsEmI-BlIDAAoErBJiPgZSBN0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDqwWelRNdvSKWd2GnaUmhIedaOv0I-5hbSh8ZRCB0PmWDdGNwglIDg3VkcIJSBYV3YWt1MgU --content-topic=/waku/2/content/test.js
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.153.149 waku 1e77ee8a857ced2016f12382b7c0ddeb4c3782850f0fc00a4a9717612bee37ac
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 1e77ee8a857c. Setting up logs at ./log/docker/node2_2026-04-22_23-59-20__d0fcbfea-5513-4e85-b81a-d3b22e546fd2__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 10400
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10400/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:10400/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.153.149/tcp/10401/p2p/16Uiu2HAm8s42zt1fsUJY7ytEouxdwEa9RxXFH2iDxCF3FqQFUXfX","/ip4/172.18.153.149/tcp/10402/ws/p2p/16Uiu2HAm8s42zt1fsUJY7ytEouxdwEa9RxXFH2iDxCF3FqQFUXfX"],"enrUri":"enr:-L24QO4nx3FCs2zzDPyp75lqeDn6FwetOyfiZH3HOSODLC5Cc1Rx_o2ZdbutUCR09H3nYuF50YEGW5uQkHtUCliMZVcCgmlkgnY0gmlwhKwSmZWKbXVsdGlhZGRyc5YACASsEpmVBiihAAoErBKZlQYoot0DgnJzhQDHAQAAiXNlY3AyNTZrMaECx6hjY1EyFcDQzY4oWwpTakbf60bM7882voYH3n4m7mqDdGNwgiihg3VkcIIoo4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:10400/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.98.62/tcp/20995/p2p/16Uiu2HAmQAb368sQitGRmXtgCPamnzJxRKaMAj3X5FZYiAbwkVsA"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:20994/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
ERROR  src.node.api_clients.base_client:base_client.py:16 HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:20994/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
DEBUG  tests.conftest:conftest.py:209 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:233 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id c8bab4aca598
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id 1e77ee8a857c
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  tests.conftest:conftest.py:248 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  tests.conftest:conftest.py:223 Running fixture teardown: attach_logs_on_fail
DEBUG  tests.conftest:conftest.py:224 Test failed, attempting to attach logs to the allure reports
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node1_2026-04-22_23-59-20__d0fcbfea-5513-4e85-b81a-d3b22e546fd2__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node2_2026-04-22_23-59-20__d0fcbfea-5513-4e85-b81a-d3b22e546fd2__wakuorg_nwaku:latest.log
INFO  tests.conftest:conftest.py:106 Fleet bootstrap inactive pass --fleet (or set FLEET_BOOTSTRAP=true) to connect local nodes to the waku.test fleet
DEBUG  tests.conftest:conftest.py:201 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:207 Running test: test_2_nodes_different_content_topic_different_shard with id: 2026-04-22_23-59-23__10b84742-90ee-43ad-a9b1-8671a7fd9ddb
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.steps.sharding:sharding.py:30 Running fixture setup: sharding_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/node1_2026-04-22_23-59-23__10b84742-90ee-43ad-a9b1-8671a7fd9ddb__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.117.51
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['21633', '21634', '21635', '21636', '21637']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 21633:21633 -p 21634:21634 -p 21635:21635 -p 21636:21636 -p 21637:21637 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=21635 --rest-port=21633 --tcp-port=21634 --discv5-udp-port=21636 --rest-address=0.0.0.0 --nat=extip:172.18.117.51 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=12c8d0ba8fcb09baed42affedf5dc448a4497fd5ee6992e4cd66a223221fb3d8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=21637 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.117.51 waku 43e8566bceb485390dbfb19da369c9b8649e17df7ca3ab3aa23b258bfb15d06c
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 43e8566bceb4. Setting up logs at ./log/docker/node1_2026-04-22_23-59-23__10b84742-90ee-43ad-a9b1-8671a7fd9ddb__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 21633
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container c8bab4aca598. Exiting log stream.
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 1e77ee8a857c. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:21633/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:21633/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.117.51/tcp/21634/p2p/16Uiu2HAmMHnif3q8N7cMN2B2GFf7THiy85mDk9jLJ3G8S95To4Tg","/ip4/172.18.117.51/tcp/21635/ws/p2p/16Uiu2HAmMHnif3q8N7cMN2B2GFf7THiy85mDk9jLJ3G8S95To4Tg"],"enrUri":"enr:-L24QFIQMAwxZhWhW8SyaV6ozgr8yWZhV6fcx9o5zR6WWP0icFnLq_vXdqc6yebvOAkkbWb_9ZxogoENaa1RdtpAsSYCgmlkgnY0gmlwhKwSdTOKbXVsdGlhZGRyc5YACASsEnUzBlSCAAoErBJ1MwZUg90DgnJzhQDHAQAAiXNlY3AyNTZrMaEDgErVXPZ79g-DywndB7GLfs6qJS47HRTfuH0l5LqD0EeDdGNwglSCg3VkcIJUhIV3YWt1MgU"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/node2_2026-04-22_23-59-23__10b84742-90ee-43ad-a9b1-8671a7fd9ddb__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.198.189
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['11618', '11619', '11620', '11621', '11622']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 11618:11618 -p 11619:11619 -p 11620:11620 -p 11621:11621 -p 11622:11622 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=11620 --rest-port=11618 --tcp-port=11619 --discv5-udp-port=11621 --rest-address=0.0.0.0 --nat=extip:172.18.198.189 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=723cc3bcded18e5d0ebdacaa8caddfba8c99eed062cbe622a43affc6b3240db6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=11622 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFIQMAwxZhWhW8SyaV6ozgr8yWZhV6fcx9o5zR6WWP0icFnLq_vXdqc6yebvOAkkbWb_9ZxogoENaa1RdtpAsSYCgmlkgnY0gmlwhKwSdTOKbXVsdGlhZGRyc5YACASsEnUzBlSCAAoErBJ1MwZUg90DgnJzhQDHAQAAiXNlY3AyNTZrMaEDgErVXPZ79g-DywndB7GLfs6qJS47HRTfuH0l5LqD0EeDdGNwglSCg3VkcIJUhIV3YWt1MgU --content-topic=/waku/2/content/test.js
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.198.189 waku b4e3343b0918ca49d4445d513595153c358c081d9f613b45777591cd4a5fd212
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID b4e3343b0918. Setting up logs at ./log/docker/node2_2026-04-22_23-59-23__10b84742-90ee-43ad-a9b1-8671a7fd9ddb__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 11618
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:11618/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:11618/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.198.189/tcp/11619/p2p/16Uiu2HAmHqr5XcUL7kifJ85AzAVMbQ55HLCi8QAETYEwMyRCJ6Hp","/ip4/172.18.198.189/tcp/11620/ws/p2p/16Uiu2HAmHqr5XcUL7kifJ85AzAVMbQ55HLCi8QAETYEwMyRCJ6Hp"],"enrUri":"enr:-L24QOoXgIqcRSShQlXvbwDkqgNja35VHiBM40H4lfXORIcnPynfpd4TRfxR_AEo_amOXefB83TOxc45MX6A8pbxlbcCgmlkgnY0gmlwhKwSxr2KbXVsdGlhZGRyc5YACASsEsa9Bi1jAAoErBLGvQYtZN0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDTRJ4e8L5TMvDOo_fXd8kWaAvnE0Ml8aFTIOH-WQ-zNuDdGNwgi1jg3VkcIItZYV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:11618/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.117.51/tcp/21634/p2p/16Uiu2HAmMHnif3q8N7cMN2B2GFf7THiy85mDk9jLJ3G8S95To4Tg"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:21633/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
ERROR  src.node.api_clients.base_client:base_client.py:16 HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:21633/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
DEBUG  tests.conftest:conftest.py:209 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:233 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id 43e8566bceb4
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id b4e3343b0918
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  tests.conftest:conftest.py:248 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  tests.conftest:conftest.py:223 Running fixture teardown: attach_logs_on_fail
DEBUG  tests.conftest:conftest.py:224 Test failed, attempting to attach logs to the allure reports
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node2_2026-04-22_23-59-23__10b84742-90ee-43ad-a9b1-8671a7fd9ddb__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node1_2026-04-22_23-59-23__10b84742-90ee-43ad-a9b1-8671a7fd9ddb__wakuorg_nwaku:latest.log
INFO  tests.conftest:conftest.py:106 Fleet bootstrap inactive pass --fleet (or set FLEET_BOOTSTRAP=true) to connect local nodes to the waku.test fleet
DEBUG  tests.conftest:conftest.py:201 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:207 Running test: test_2_nodes_different_content_topic_different_shard with id: 2026-04-22_23-59-27__ecbde20f-0c76-4312-b916-759c0759b580
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.steps.sharding:sharding.py:30 Running fixture setup: sharding_setup
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/node1_2026-04-22_23-59-27__ecbde20f-0c76-4312-b916-759c0759b580__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.35.194
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['30272', '30273', '30274', '30275', '30276']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 30272:30272 -p 30273:30273 -p 30274:30274 -p 30275:30275 -p 30276:30276 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=30274 --rest-port=30272 --tcp-port=30273 --discv5-udp-port=30275 --rest-address=0.0.0.0 --nat=extip:172.18.35.194 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=eaa5ddf3dd393473903bb910c4cca5184dc016c0bfdbb7c521fafc1c7ebc6f14 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=30276 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.35.194 waku 29e198caf7da85cd5f02552545cdcf94ebd0961f3e50089e835ba33628f6c8c4
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 29e198caf7da. Setting up logs at ./log/docker/node1_2026-04-22_23-59-27__ecbde20f-0c76-4312-b916-759c0759b580__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 30272
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 43e8566bceb4. Exiting log stream.
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container b4e3343b0918. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:30272/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:30272/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.35.194/tcp/30273/p2p/16Uiu2HAmNg7U27Ex39vUX1bMv3Hb4Mnj6xGnd6ogB72CDumNtZdX","/ip4/172.18.35.194/tcp/30274/ws/p2p/16Uiu2HAmNg7U27Ex39vUX1bMv3Hb4Mnj6xGnd6ogB72CDumNtZdX"],"enrUri":"enr:-L24QMUL_oouwVLV9SiXyz8wmVmP21DVNyQFBhTXHIQFH6AZHCdxa8-G2MxO3eNWiGpTiC7Y4xKxGYB5tcl0Z57vjVQCgmlkgnY0gmlwhKwSI8KKbXVsdGlhZGRyc5YACASsEiPCBnZBAAoErBIjwgZ2Qt0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDlN5_BuhyyvSavCHUgJz1HZKtEmE_U_1pPTEBXvcl7I6DdGNwgnZBg3VkcIJ2Q4V3YWt1MgU"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:108 WakuNode instance initialized with log path ./log/docker/node2_2026-04-22_23-59-27__ecbde20f-0c76-4312-b916-759c0759b580__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:116 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.22.52
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['58112', '58113', '58114', '58115', '58116']
DEBUG  src.node.waku_node:waku_node.py:606 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:211 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:217 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 58112:58112 -p 58113:58113 -p 58114:58114 -p 58115:58115 -p 58116:58116 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=58114 --rest-port=58112 --tcp-port=58113 --discv5-udp-port=58115 --rest-address=0.0.0.0 --nat=extip:172.18.22.52 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=40910eacbaba558c308e8fcdd3eaac613e45cc1f3fc6f96fabf1f27eaca715dd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=58116 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QMUL_oouwVLV9SiXyz8wmVmP21DVNyQFBhTXHIQFH6AZHCdxa8-G2MxO3eNWiGpTiC7Y4xKxGYB5tcl0Z57vjVQCgmlkgnY0gmlwhKwSI8KKbXVsdGlhZGRyc5YACASsEiPCBnZBAAoErBIjwgZ2Qt0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDlN5_BuhyyvSavCHUgJz1HZKtEmE_U_1pPTEBXvcl7I6DdGNwgnZBg3VkcIJ2Q4V3YWt1MgU --content-topic=/waku/2/content/test.js
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.22.52 waku 046cb790f549c5799c77228bca0441f3360153aa0eaa6ef7f9685296345e7d77
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 046cb790f549. Setting up logs at ./log/docker/node2_2026-04-22_23-59-27__ecbde20f-0c76-4312-b916-759c0759b580__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:228 Started container from image wakuorg/nwaku:latest. REST: 58112
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:58112/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
INFO  src.node.waku_node:waku_node.py:412 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:58112/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.22.52/tcp/58113/p2p/16Uiu2HAmGqaZyUkRz73aa3gqTpZ4pAWNLuVkMmez7ZcbvBMYBi2H","/ip4/172.18.22.52/tcp/58114/ws/p2p/16Uiu2HAmGqaZyUkRz73aa3gqTpZ4pAWNLuVkMmez7ZcbvBMYBi2H"],"enrUri":"enr:-L24QEsfQd9mvrW_3jhQJnFsJv5M5zQlcIB2UBsUF_FJoQioXcJqVeUQOUgyVeiSD6F4ofqoDKU4Z5h_yurhbKJIqAMCgmlkgnY0gmlwhKwSFjSKbXVsdGlhZGRyc5YACASsEhY0BuMBAAoErBIWNAbjAt0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDPiU_O8OGzjREhcK-HOzb8vm8eJkJz6IP9FuiLvGuAQ6DdGNwguMBg3VkcILjA4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:417 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:58112/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.35.194/tcp/30273/p2p/16Uiu2HAmNg7U27Ex39vUX1bMv3Hb4Mnj6xGnd6ogB72CDumNtZdX"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:30272/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
ERROR  src.node.api_clients.base_client:base_client.py:16 HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:30272/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
DEBUG  tests.conftest:conftest.py:209 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:233 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id 29e198caf7da
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:343 Stopping container with id 046cb790f549
DEBUG  src.node.waku_node:waku_node.py:355 Container stopped.
DEBUG  tests.conftest:conftest.py:248 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  tests.conftest:conftest.py:223 Running fixture teardown: attach_logs_on_fail
DEBUG  tests.conftest:conftest.py:224 Test failed, attempting to attach logs to the allure reports
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node2_2026-04-22_23-59-27__ecbde20f-0c76-4312-b916-759c0759b580__wakuorg_nwaku:latest.log
DEBUG  src.libs.common:common.py:42 Attaching file ./log/docker/node1_2026-04-22_23-59-27__ecbde20f-0c76-4312-b916-759c0759b580__wakuorg_nwaku:latest.log