185 lines
32 KiB
Plaintext

2026-03-09 04:38:44.826 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-09 04:38:44.826 DEBUG [tests.conftest] Running test: test_subscribe_and_publish_on_another_content_topic_from_same_shard with id: 2026-03-09_04-38-44__5beebcef-eab7-4a81-90c9-57d6bad52adc
2026-03-09 04:38:44.827 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-09 04:38:44.827 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-09 04:38:44.827 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-09 04:38:44.835 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-09 04:38:44.835 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-09_04-38-44__5beebcef-eab7-4a81-90c9-57d6bad52adc__wakuorg_nwaku:latest.log
2026-03-09 04:38:44.835 DEBUG [src.node.waku_node] Starting Node...
2026-03-09 04:38:44.835 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-09 04:38:44.837 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-09 04:38:44.837 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.119.48
2026-03-09 04:38:44.837 DEBUG [src.node.docker_mananger] Generated ports ['6885', '6886', '6887', '6888', '6889']
2026-03-09 04:38:44.837 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-09 04:38:44.837 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-09 04:38:44.837 DEBUG [src.node.waku_node] Using volumes []
2026-03-09 04:38:44.837 DEBUG [src.node.docker_mananger] docker run -i -t -p 6885:6885 -p 6886:6886 -p 6887:6887 -p 6888:6888 -p 6889:6889 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=6887 --rest-port=6885 --tcp-port=6886 --discv5-udp-port=6888 --rest-address=0.0.0.0 --nat=extip:172.18.119.48 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=de4bbac9d5f389fb9fbea5b5eafaa8e39c56324c37a9e7f40be58eb5e2218b49 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=6889 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-09 04:38:45.036 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.119.48 waku 88861f5f3c4f68f6a4ccaf0e307560147f006ddfe8f094b4b6f600450d5d29e6
2026-03-09 04:38:45.071 DEBUG [src.node.docker_mananger] Container started with ID 88861f5f3c4f. Setting up logs at ./log/docker/node1_2026-03-09_04-38-44__5beebcef-eab7-4a81-90c9-57d6bad52adc__wakuorg_nwaku:latest.log
2026-03-09 04:38:45.071 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 6885
2026-03-09 04:38:45.071 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-09 04:38:45.101 ERROR [src.node.docker_mananger] Max retries reached for container d54f1b29da36. Exiting log stream.
2026-03-09 04:38:45.627 ERROR [src.node.docker_mananger] Max retries reached for container 3e031c969515. Exiting log stream.
2026-03-09 04:38:46.072 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6885/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:46.074 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-09 04:38:46.175 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6885/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:46.178 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-09 04:38:46.278 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6885/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:46.280 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-09 04:38:46.281 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-09 04:38:46.281 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6885/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:46.285 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.119.48/tcp/6886/p2p/16Uiu2HAmF5x9ShTtXhcSouwvywTBDCxm7wCTa1fo94PZ92ykEwV9","/ip4/172.18.119.48/tcp/6887/ws/p2p/16Uiu2HAmF5x9ShTtXhcSouwvywTBDCxm7wCTa1fo94PZ92ykEwV9"],"enrUri":"enr:-L24QJHH8j2jyhZ6seD-o1gVdr6xbcGABrc208RTyMAUndZjNYjBrlWWJOPRSdYTu0pC9fFa0kgk97cDbCHp1sb8w-4CgmlkgnY0gmlwhKwSdzCKbXVsdGlhZGRyc5YACASsEncwBhrmAAoErBJ3MAYa590DgnJzhQACAQAAiXNlY3AyNTZrMaEDJBxm2Cso_vDTpi6iSL3ajyi_ZX6cJ6Bc0tBZZul9rvCDdGNwghrmg3VkcIIa6IV3YWt1MgU"}'
2026-03-09 04:38:46.285 INFO [src.node.waku_node] REST service is ready !!
2026-03-09 04:38:46.293 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-09 04:38:46.293 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-09_04-38-44__5beebcef-eab7-4a81-90c9-57d6bad52adc__wakuorg_nwaku:latest.log
2026-03-09 04:38:46.293 DEBUG [src.node.waku_node] Starting Node...
2026-03-09 04:38:46.293 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-09 04:38:46.294 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-09 04:38:46.295 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.28.37
2026-03-09 04:38:46.295 DEBUG [src.node.docker_mananger] Generated ports ['37824', '37825', '37826', '37827', '37828']
2026-03-09 04:38:46.295 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-09 04:38:46.295 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-09 04:38:46.295 DEBUG [src.node.waku_node] Using volumes []
2026-03-09 04:38:46.295 DEBUG [src.node.docker_mananger] docker run -i -t -p 37824:37824 -p 37825:37825 -p 37826:37826 -p 37827:37827 -p 37828:37828 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=37826 --rest-port=37824 --tcp-port=37825 --discv5-udp-port=37827 --rest-address=0.0.0.0 --nat=extip:172.18.28.37 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=cddbf8a2f21c1aa8ea6d9b7fa64fb2e7bbbaeba3def3fec312ee2f3349bae3fe --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=37828 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QJHH8j2jyhZ6seD-o1gVdr6xbcGABrc208RTyMAUndZjNYjBrlWWJOPRSdYTu0pC9fFa0kgk97cDbCHp1sb8w-4CgmlkgnY0gmlwhKwSdzCKbXVsdGlhZGRyc5YACASsEncwBhrmAAoErBJ3MAYa590DgnJzhQACAQAAiXNlY3AyNTZrMaEDJBxm2Cso_vDTpi6iSL3ajyi_ZX6cJ6Bc0tBZZul9rvCDdGNwghrmg3VkcIIa6IV3YWt1MgU --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-09 04:38:46.513 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.28.37 waku d9c00364c85ae63000e9bff1c13510d7c4cefdeaca1116f68565d2d7736d5e2a
2026-03-09 04:38:46.550 DEBUG [src.node.docker_mananger] Container started with ID d9c00364c85a. Setting up logs at ./log/docker/node2_2026-03-09_04-38-44__5beebcef-eab7-4a81-90c9-57d6bad52adc__wakuorg_nwaku:latest.log
2026-03-09 04:38:46.550 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 37824
2026-03-09 04:38:46.550 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-09 04:38:47.552 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37824/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:47.554 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-09 04:38:47.655 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37824/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:47.657 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-09 04:38:47.658 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-09 04:38:47.658 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37824/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:47.661 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.28.37/tcp/37825/p2p/16Uiu2HAmKo5sqfni2UUZwUXiLfNaXbLfVU2efWiq2vm61NeRqiwg","/ip4/172.18.28.37/tcp/37826/ws/p2p/16Uiu2HAmKo5sqfni2UUZwUXiLfNaXbLfVU2efWiq2vm61NeRqiwg"],"enrUri":"enr:-L24QF5XUuMhFW1bv3LA_EatXtZqOrKC-qIAQ2bjW_7qbK4iAZ8gIbugHHn_O6u1LQsymzXxUWD2Jt3I6yNJJUPQ86wCgmlkgnY0gmlwhKwSHCWKbXVsdGlhZGRyc5YACASsEhwlBpPBAAoErBIcJQaTwt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDahS0PExnygOuWAoIqzc9n-wevEpv_CdBrs24HSdQRIeDdGNwgpPBg3VkcIKTw4V3YWt1MgE"}'
2026-03-09 04:38:47.661 INFO [src.node.waku_node] REST service is ready !!
2026-03-09 04:38:47.662 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37824/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.119.48/tcp/6886/p2p/16Uiu2HAmF5x9ShTtXhcSouwvywTBDCxm7wCTa1fo94PZ92ykEwV9"]'
2026-03-09 04:38:47.706 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:38:47.708 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6885/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/newsService/1.0/weekly/protobuf"]'
2026-03-09 04:38:47.720 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:38:47.721 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37824/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/newsService/1.0/weekly/protobuf"]'
2026-03-09 04:38:47.729 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:38:47.731 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6885/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/newsService/1.0/weekly/protobuf", "timestamp": '$(date +%s%N)'}'
2026-03-09 04:38:47.743 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:38:47.743 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-09 04:38:47.845 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-09 04:38:47.845 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6885/relay/v1/auto/messages/%2FnewsService%2F1.0%2Fweekly%2Fprotobuf" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:47.848 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/newsService/1.0/weekly/protobuf","version":0,"timestamp":1773031127731150361,"ephemeral":false,"proof":""}]'
2026-03-09 04:38:47.849 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-09 04:38:47.849 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37824/relay/v1/auto/messages/%2FnewsService%2F1.0%2Fweekly%2Fprotobuf" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:47.852 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/newsService/1.0/weekly/protobuf","version":0,"timestamp":1773031127731150361,"ephemeral":false,"proof":""}]'
2026-03-09 04:38:47.853 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6885/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-09 04:38:47.862 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:38:47.863 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-09 04:38:47.963 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-09 04:38:47.964 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6885/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:47.966 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773031125204721991,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773031127853653367,"ephemeral":false,"proof":""}]'
2026-03-09 04:38:48.020 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-09 04:38:48.021 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-09 04:38:48.021 DEBUG [src.node.waku_node] Stopping container with id 88861f5f3c4f
2026-03-09 04:38:48.601 DEBUG [src.node.waku_node] Container stopped.
2026-03-09 04:38:48.603 DEBUG [src.node.waku_node] Stopping container with id d9c00364c85a
2026-03-09 04:38:49.213 DEBUG [src.node.waku_node] Container stopped.
2026-03-09 04:38:49.219 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-09 04:38:49.270 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-09 04:38:49.313 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-09 04:38:49.315 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-09 04:38:49.316 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-09 04:38:49.318 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-09_04-38-44__5beebcef-eab7-4a81-90c9-57d6bad52adc__wakuorg_nwaku:latest.log
2026-03-09 04:38:49.324 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-09_04-38-44__5beebcef-eab7-4a81-90c9-57d6bad52adc__wakuorg_nwaku:latest.log
2026-03-09 04:38:49.338 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-09 04:38:49.340 DEBUG [tests.conftest] Running test: test_subscribe_and_publish_on_another_content_topic_from_same_shard with id: 2026-03-09_04-38-49__889f5bce-af6d-4bfd-8501-a97abd8f257e
2026-03-09 04:38:49.341 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-09 04:38:49.341 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-09 04:38:49.342 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-09 04:38:49.354 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-09 04:38:49.355 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-09_04-38-49__889f5bce-af6d-4bfd-8501-a97abd8f257e__wakuorg_nwaku:latest.log
2026-03-09 04:38:49.356 DEBUG [src.node.waku_node] Starting Node...
2026-03-09 04:38:49.356 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-09 04:38:49.359 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-09 04:38:49.360 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.211.154
2026-03-09 04:38:49.360 DEBUG [src.node.docker_mananger] Generated ports ['34365', '34366', '34367', '34368', '34369']
2026-03-09 04:38:49.360 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-09 04:38:49.361 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-09 04:38:49.361 DEBUG [src.node.waku_node] Using volumes []
2026-03-09 04:38:49.361 DEBUG [src.node.docker_mananger] docker run -i -t -p 34365:34365 -p 34366:34366 -p 34367:34367 -p 34368:34368 -p 34369:34369 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=34367 --rest-port=34365 --tcp-port=34366 --discv5-udp-port=34368 --rest-address=0.0.0.0 --nat=extip:172.18.211.154 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=60e678932d27e93ad22da5512ee7df8f4ebfc260171b8acddd0ed81b3ddd16ec --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=34369 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-09 04:38:49.420 ERROR [src.node.docker_mananger] Max retries reached for container 88861f5f3c4f. Exiting log stream.
2026-03-09 04:38:49.577 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.211.154 waku 5ea2d3e4dc686860e0f11da4645e84351be54ae3ce2ab0a61f8825086a7d3f6e
2026-03-09 04:38:49.614 DEBUG [src.node.docker_mananger] Container started with ID 5ea2d3e4dc68. Setting up logs at ./log/docker/node1_2026-03-09_04-38-49__889f5bce-af6d-4bfd-8501-a97abd8f257e__wakuorg_nwaku:latest.log
2026-03-09 04:38:49.615 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 34365
2026-03-09 04:38:49.615 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-09 04:38:50.304 ERROR [src.node.docker_mananger] Max retries reached for container d9c00364c85a. Exiting log stream.
2026-03-09 04:38:50.616 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34365/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:50.618 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-09 04:38:50.719 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34365/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:50.721 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-09 04:38:50.822 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34365/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:50.824 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-09 04:38:50.924 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34365/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:50.927 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-09 04:38:50.927 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-09 04:38:50.927 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34365/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:50.930 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.211.154/tcp/34366/p2p/16Uiu2HAkwLu5kuTfbexF6exzGbErhWXd23hrFMfpmQPy8inx9tVU","/ip4/172.18.211.154/tcp/34367/ws/p2p/16Uiu2HAkwLu5kuTfbexF6exzGbErhWXd23hrFMfpmQPy8inx9tVU"],"enrUri":"enr:-L24QK22yqKyl70tBsAGOHmhgOrulIRnKAw3tDjLUdMFJH-0RJ6-L5ooQlpiGO29k56P0V4kvn2PW35Ycy0mrs-xYY0CgmlkgnY0gmlwhKwS05qKbXVsdGlhZGRyc5YACASsEtOaBoY-AAoErBLTmgaGP90DgnJzhQACAQAAiXNlY3AyNTZrMaECHH5JBKOh0uGwBc_SzCUjwL8wxcI32AeTh6jKzd-P2y-DdGNwgoY-g3VkcIKGQIV3YWt1MgU"}'
2026-03-09 04:38:50.930 INFO [src.node.waku_node] REST service is ready !!
2026-03-09 04:38:50.937 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-09 04:38:50.937 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-09_04-38-49__889f5bce-af6d-4bfd-8501-a97abd8f257e__wakuorg_nwaku:latest.log
2026-03-09 04:38:50.937 DEBUG [src.node.waku_node] Starting Node...
2026-03-09 04:38:50.937 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-09 04:38:50.938 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-09 04:38:50.939 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.211.242
2026-03-09 04:38:50.939 DEBUG [src.node.docker_mananger] Generated ports ['8114', '8115', '8116', '8117', '8118']
2026-03-09 04:38:50.939 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-09 04:38:50.939 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-09 04:38:50.939 DEBUG [src.node.waku_node] Using volumes []
2026-03-09 04:38:50.939 DEBUG [src.node.docker_mananger] docker run -i -t -p 8114:8114 -p 8115:8115 -p 8116:8116 -p 8117:8117 -p 8118:8118 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=8116 --rest-port=8114 --tcp-port=8115 --discv5-udp-port=8117 --rest-address=0.0.0.0 --nat=extip:172.18.211.242 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=9235fa99bcc7a1bdbf2d3b73446ace837ecb9db080dacbc3eb2fa0ae17ca55b4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=8118 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QK22yqKyl70tBsAGOHmhgOrulIRnKAw3tDjLUdMFJH-0RJ6-L5ooQlpiGO29k56P0V4kvn2PW35Ycy0mrs-xYY0CgmlkgnY0gmlwhKwS05qKbXVsdGlhZGRyc5YACASsEtOaBoY-AAoErBLTmgaGP90DgnJzhQACAQAAiXNlY3AyNTZrMaECHH5JBKOh0uGwBc_SzCUjwL8wxcI32AeTh6jKzd-P2y-DdGNwgoY-g3VkcIKGQIV3YWt1MgU --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-09 04:38:51.149 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.211.242 waku 0e1ed073aeca2bc26ce3e5cfe97fe657190c8233f41cd6ebd2e711571aab9890
2026-03-09 04:38:51.184 DEBUG [src.node.docker_mananger] Container started with ID 0e1ed073aeca. Setting up logs at ./log/docker/node2_2026-03-09_04-38-49__889f5bce-af6d-4bfd-8501-a97abd8f257e__wakuorg_nwaku:latest.log
2026-03-09 04:38:51.185 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 8114
2026-03-09 04:38:51.185 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-09 04:38:52.185 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8114/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:52.189 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-09 04:38:52.290 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8114/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:52.292 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-09 04:38:52.393 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8114/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:52.397 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-09 04:38:52.497 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8114/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:52.500 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-09 04:38:52.500 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-09 04:38:52.501 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8114/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:52.503 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.211.242/tcp/8115/p2p/16Uiu2HAmS8SNqPNHw36T2q7umdE9TbQsjdezkqrZjbrY9YNoBLuk","/ip4/172.18.211.242/tcp/8116/ws/p2p/16Uiu2HAmS8SNqPNHw36T2q7umdE9TbQsjdezkqrZjbrY9YNoBLuk"],"enrUri":"enr:-L24QNPNhmHnJiwExgY-OugpjX38eL-InNNFjFn9CKSXNZW9D4gLZXSvZWgOVhEHTmaU83fHyMauddu0seXgUf4VTQ0CgmlkgnY0gmlwhKwS0_KKbXVsdGlhZGRyc5YACASsEtPyBh-zAAoErBLT8gYftN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDyDAKUWLmRmr-gaHLo7nFPdDMae0szBaD5np3kbF-kO-DdGNwgh-zg3VkcIIftYV3YWt1MgE"}'
2026-03-09 04:38:52.503 INFO [src.node.waku_node] REST service is ready !!
2026-03-09 04:38:52.504 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:8114/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.211.154/tcp/34366/p2p/16Uiu2HAkwLu5kuTfbexF6exzGbErhWXd23hrFMfpmQPy8inx9tVU"]'
2026-03-09 04:38:52.526 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:38:52.530 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34365/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/newsService/1.0/weekly/protobuf"]'
2026-03-09 04:38:52.543 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:38:52.544 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:8114/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/newsService/1.0/weekly/protobuf"]'
2026-03-09 04:38:52.547 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:38:52.548 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34365/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/newsService/1.0/weekly/protobuf", "timestamp": '$(date +%s%N)'}'
2026-03-09 04:38:52.560 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:38:52.563 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-09 04:38:52.664 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-09 04:38:52.665 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34365/relay/v1/auto/messages/%2FnewsService%2F1.0%2Fweekly%2Fprotobuf" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:52.667 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/newsService/1.0/weekly/protobuf","version":0,"timestamp":1773031132548079380,"ephemeral":false,"proof":""}]'
2026-03-09 04:38:52.669 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-09 04:38:52.669 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8114/relay/v1/auto/messages/%2FnewsService%2F1.0%2Fweekly%2Fprotobuf" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:52.671 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/newsService/1.0/weekly/protobuf","version":0,"timestamp":1773031132548079380,"ephemeral":false,"proof":""}]'
2026-03-09 04:38:52.673 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34365/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-09 04:38:52.682 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:38:52.682 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-09 04:38:52.782 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-09 04:38:52.783 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34365/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:38:52.786 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773031128895718964,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773031132673351793,"ephemeral":false,"proof":""}]'
2026-03-09 04:38:52.795 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-09 04:38:52.796 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-09 04:38:52.796 DEBUG [src.node.waku_node] Stopping container with id 5ea2d3e4dc68
2026-03-09 04:38:53.395 DEBUG [src.node.waku_node] Container stopped.
2026-03-09 04:38:53.398 DEBUG [src.node.waku_node] Stopping container with id 0e1ed073aeca
2026-03-09 04:38:53.961 DEBUG [src.node.waku_node] Container stopped.
2026-03-09 04:38:53.963 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-09 04:38:54.002 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-09 04:38:54.039 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-09 04:38:54.040 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-09 04:38:54.040 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-09 04:38:54.042 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-09_04-38-49__889f5bce-af6d-4bfd-8501-a97abd8f257e__wakuorg_nwaku:latest.log
2026-03-09 04:38:54.043 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-09_04-38-49__889f5bce-af6d-4bfd-8501-a97abd8f257e__wakuorg_nwaku:latest.log