155 lines
27 KiB
Plaintext

2026-03-16 04:56:40.134 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-16 04:56:40.134 DEBUG [tests.conftest] Running test: test_unsubscribe_from_all_content_topics with id: 2026-03-16_04-56-40__615b1c7d-bf38-43f2-89ab-d69a3bdd1125
2026-03-16 04:56:40.134 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-16 04:56:40.135 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-16 04:56:40.135 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-16 04:56:40.143 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:56:40.143 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-16_04-56-40__615b1c7d-bf38-43f2-89ab-d69a3bdd1125__wakuorg_nwaku:latest.log
2026-03-16 04:56:40.144 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:56:40.144 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:56:40.146 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:56:40.146 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.245.86
2026-03-16 04:56:40.146 DEBUG [src.node.docker_mananger] Generated ports ['58688', '58689', '58690', '58691', '58692']
2026-03-16 04:56:40.147 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:56:40.147 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:56:40.147 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:56:40.147 DEBUG [src.node.docker_mananger] docker run -i -t -p 58688:58688 -p 58689:58689 -p 58690:58690 -p 58691:58691 -p 58692:58692 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=58690 --rest-port=58688 --tcp-port=58689 --discv5-udp-port=58691 --rest-address=0.0.0.0 --nat=extip:172.18.245.86 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=e4a9f08efb07a1cfdb8e4ce279e9d87e259c0326c26bdeeb82e5df6bbe70f9fd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=58692 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-16 04:56:40.343 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.245.86 waku 6d5b2eae6c164c169327a5182aebf536c5f45aa73c10513024a00a67b1138b5a
2026-03-16 04:56:40.378 DEBUG [src.node.docker_mananger] Container started with ID 6d5b2eae6c16. Setting up logs at ./log/docker/node1_2026-03-16_04-56-40__615b1c7d-bf38-43f2-89ab-d69a3bdd1125__wakuorg_nwaku:latest.log
2026-03-16 04:56:40.378 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 58688
2026-03-16 04:56:40.378 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:56:40.417 ERROR [src.node.docker_mananger] Max retries reached for container 0a411a896100. Exiting log stream.
2026-03-16 04:56:40.853 ERROR [src.node.docker_mananger] Max retries reached for container c47261c4b171. Exiting log stream.
2026-03-16 04:56:41.379 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58688/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:56:41.394 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:56:41.495 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58688/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:56:41.498 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:56:41.498 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:56:41.498 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58688/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:56:41.500 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.245.86/tcp/58689/p2p/16Uiu2HAmFtQEEN5qkQhY4i6xtb3E87G4GkBqyShdMqS8HB4dKd6M","/ip4/172.18.245.86/tcp/58690/ws/p2p/16Uiu2HAmFtQEEN5qkQhY4i6xtb3E87G4GkBqyShdMqS8HB4dKd6M"],"enrUri":"enr:-L24QCP4hRbv0xYrG2PfHoyUMJzXY4LKuor-TDG-3QVE24u_eyu0DMSp4dpKJiddiqdkMCGRP2b2MZHo6kh8Br-8XDwCgmlkgnY0gmlwhKwS9VaKbXVsdGlhZGRyc5YACASsEvVWBuVBAAoErBL1VgblQt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDMAKcTrMQNXJJEZhw99yz0xeoiAqhNVE-yVRRTkpVP7aDdGNwguVBg3VkcILlQ4V3YWt1MgU"}'
2026-03-16 04:56:41.501 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:56:41.508 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:56:41.508 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-16_04-56-40__615b1c7d-bf38-43f2-89ab-d69a3bdd1125__wakuorg_nwaku:latest.log
2026-03-16 04:56:41.508 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:56:41.508 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:56:41.510 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:56:41.510 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.125.158
2026-03-16 04:56:41.510 DEBUG [src.node.docker_mananger] Generated ports ['6253', '6254', '6255', '6256', '6257']
2026-03-16 04:56:41.510 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:56:41.510 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:56:41.510 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:56:41.511 DEBUG [src.node.docker_mananger] docker run -i -t -p 6253:6253 -p 6254:6254 -p 6255:6255 -p 6256:6256 -p 6257:6257 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=6255 --rest-port=6253 --tcp-port=6254 --discv5-udp-port=6256 --rest-address=0.0.0.0 --nat=extip:172.18.125.158 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=f2eb22bcd0e12fa3bb2cfe4dcf187fe63294ca22b22284f22ddbe3bdaefb36de --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=6257 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QCP4hRbv0xYrG2PfHoyUMJzXY4LKuor-TDG-3QVE24u_eyu0DMSp4dpKJiddiqdkMCGRP2b2MZHo6kh8Br-8XDwCgmlkgnY0gmlwhKwS9VaKbXVsdGlhZGRyc5YACASsEvVWBuVBAAoErBL1VgblQt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDMAKcTrMQNXJJEZhw99yz0xeoiAqhNVE-yVRRTkpVP7aDdGNwguVBg3VkcILlQ4V3YWt1MgU --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-16 04:56:41.714 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.125.158 waku a96d1673fe9d8161183dd623aa5fb592a04e8b349937a66aa29f5c8264537375
2026-03-16 04:56:41.755 DEBUG [src.node.docker_mananger] Container started with ID a96d1673fe9d. Setting up logs at ./log/docker/node2_2026-03-16_04-56-40__615b1c7d-bf38-43f2-89ab-d69a3bdd1125__wakuorg_nwaku:latest.log
2026-03-16 04:56:41.756 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 6253
2026-03-16 04:56:41.756 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:56:42.757 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6253/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:56:42.760 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:56:42.760 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:56:42.760 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6253/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:56:42.762 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.125.158/tcp/6254/p2p/16Uiu2HAkwPZg5ELx9mbcb34dtJj4wRyRdWJf9j3fzaHDQb5gb7f6","/ip4/172.18.125.158/tcp/6255/ws/p2p/16Uiu2HAkwPZg5ELx9mbcb34dtJj4wRyRdWJf9j3fzaHDQb5gb7f6"],"enrUri":"enr:-L24QC4QDFXkp7_0ltY3etNrK5_D-ETA6Dlv-wRp8t40vSe5TtNya3s7n6tTkJDO-eIyDnvYGOZ8E9XLguZgdlxcPMMCgmlkgnY0gmlwhKwSfZ6KbXVsdGlhZGRyc5YACASsEn2eBhhuAAoErBJ9ngYYb90DgnJzhQACAQAAiXNlY3AyNTZrMaECHS0VIy0VzizgD4zNr_T0TrUt8X260yDKtnvPpSHGgrmDdGNwghhug3VkcIIYcIV3YWt1MgE"}'
2026-03-16 04:56:42.763 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:56:42.763 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6253/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.245.86/tcp/58689/p2p/16Uiu2HAmFtQEEN5qkQhY4i6xtb3E87G4GkBqyShdMqS8HB4dKd6M"]'
2026-03-16 04:56:42.790 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:56:42.792 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58688/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-16 04:56:42.796 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:56:42.797 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6253/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-16 04:56:42.801 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:56:42.803 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58688/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:56:42.812 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:56:42.814 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 04:56:42.914 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-16 04:56:42.915 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58688/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:56:42.919 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773636998881201064,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773636998864439649,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637002803128149,"ephemeral":false,"proof":""}]'
2026-03-16 04:56:42.929 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-16 04:56:42.930 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-16 04:56:42.931 DEBUG [src.node.waku_node] Stopping container with id 6d5b2eae6c16
2026-03-16 04:56:43.500 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:56:43.500 DEBUG [src.node.waku_node] Stopping container with id a96d1673fe9d
2026-03-16 04:56:44.096 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:56:44.099 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-16 04:56:44.130 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:56:44.159 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:56:44.161 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-16 04:56:44.162 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-16 04:56:44.162 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-16_04-56-40__615b1c7d-bf38-43f2-89ab-d69a3bdd1125__wakuorg_nwaku:latest.log
2026-03-16 04:56:44.163 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-16_04-56-40__615b1c7d-bf38-43f2-89ab-d69a3bdd1125__wakuorg_nwaku:latest.log
2026-03-16 04:56:44.167 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-16 04:56:44.168 DEBUG [tests.conftest] Running test: test_unsubscribe_from_all_content_topics with id: 2026-03-16_04-56-44__1ff977dd-3830-4f89-b4c1-c81534c956c1
2026-03-16 04:56:44.168 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-16 04:56:44.168 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-16 04:56:44.168 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-16 04:56:44.175 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:56:44.175 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-16_04-56-44__1ff977dd-3830-4f89-b4c1-c81534c956c1__wakuorg_nwaku:latest.log
2026-03-16 04:56:44.176 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:56:44.176 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:56:44.177 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:56:44.178 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.171.85
2026-03-16 04:56:44.178 DEBUG [src.node.docker_mananger] Generated ports ['15572', '15573', '15574', '15575', '15576']
2026-03-16 04:56:44.178 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:56:44.178 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:56:44.178 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:56:44.178 DEBUG [src.node.docker_mananger] docker run -i -t -p 15572:15572 -p 15573:15573 -p 15574:15574 -p 15575:15575 -p 15576:15576 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=15574 --rest-port=15572 --tcp-port=15573 --discv5-udp-port=15575 --rest-address=0.0.0.0 --nat=extip:172.18.171.85 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=7ea8b6be1f2050a66d27cc9fb6c38cbd3eae8be67df4c1af28a847bcbde8fdf1 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=15576 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-16 04:56:44.364 ERROR [src.node.docker_mananger] Max retries reached for container 6d5b2eae6c16. Exiting log stream.
2026-03-16 04:56:44.369 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.171.85 waku 5319c64d3daf18d125f56d94e4111c6faaa832d61f25a2bf07cb8080c5027332
2026-03-16 04:56:44.406 DEBUG [src.node.docker_mananger] Container started with ID 5319c64d3daf. Setting up logs at ./log/docker/node1_2026-03-16_04-56-44__1ff977dd-3830-4f89-b4c1-c81534c956c1__wakuorg_nwaku:latest.log
2026-03-16 04:56:44.407 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 15572
2026-03-16 04:56:44.407 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:56:44.941 ERROR [src.node.docker_mananger] Max retries reached for container a96d1673fe9d. Exiting log stream.
2026-03-16 04:56:45.408 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15572/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:56:45.433 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:56:45.533 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15572/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:56:45.537 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:56:45.537 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:56:45.537 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15572/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:56:45.539 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.171.85/tcp/15573/p2p/16Uiu2HAmQ5FaRk1sGLWNpXJCiV8JS6b9XYFpktmD7N2soJTim465","/ip4/172.18.171.85/tcp/15574/ws/p2p/16Uiu2HAmQ5FaRk1sGLWNpXJCiV8JS6b9XYFpktmD7N2soJTim465"],"enrUri":"enr:-L24QFpzSOqfxTZrU9daMbgg1AoStj2lvsBimX-miRwL2jlbHp4Y0hZEVGUzWnV22LYZ1IRZrXJk65KyONFIbJ7iCzECgmlkgnY0gmlwhKwSq1WKbXVsdGlhZGRyc5YACASsEqtVBjzVAAoErBKrVQY81t0DgnJzhQACAQAAiXNlY3AyNTZrMaEDqae2V7yh7iaovrCXXf_gd48eZjv88lTAgQOaIckiToKDdGNwgjzVg3VkcII814V3YWt1MgU"}'
2026-03-16 04:56:45.540 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:56:45.549 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:56:45.550 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-16_04-56-44__1ff977dd-3830-4f89-b4c1-c81534c956c1__wakuorg_nwaku:latest.log
2026-03-16 04:56:45.550 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:56:45.550 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:56:45.553 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:56:45.553 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.69.139
2026-03-16 04:56:45.553 DEBUG [src.node.docker_mananger] Generated ports ['64311', '64312', '64313', '64314', '64315']
2026-03-16 04:56:45.554 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:56:45.554 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:56:45.554 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:56:45.554 DEBUG [src.node.docker_mananger] docker run -i -t -p 64311:64311 -p 64312:64312 -p 64313:64313 -p 64314:64314 -p 64315:64315 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=64313 --rest-port=64311 --tcp-port=64312 --discv5-udp-port=64314 --rest-address=0.0.0.0 --nat=extip:172.18.69.139 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=efbcc1acc16cd276daae70df58fadf2b6db678c3009cf40e9fcdeabbfc8b6eab --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=64315 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFpzSOqfxTZrU9daMbgg1AoStj2lvsBimX-miRwL2jlbHp4Y0hZEVGUzWnV22LYZ1IRZrXJk65KyONFIbJ7iCzECgmlkgnY0gmlwhKwSq1WKbXVsdGlhZGRyc5YACASsEqtVBjzVAAoErBKrVQY81t0DgnJzhQACAQAAiXNlY3AyNTZrMaEDqae2V7yh7iaovrCXXf_gd48eZjv88lTAgQOaIckiToKDdGNwgjzVg3VkcII814V3YWt1MgU --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-16 04:56:45.763 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.69.139 waku b1fd1255c5c8acb3b034f7af7066b707502435802127eb0e744c91eeb2844d5a
2026-03-16 04:56:45.800 DEBUG [src.node.docker_mananger] Container started with ID b1fd1255c5c8. Setting up logs at ./log/docker/node2_2026-03-16_04-56-44__1ff977dd-3830-4f89-b4c1-c81534c956c1__wakuorg_nwaku:latest.log
2026-03-16 04:56:45.800 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 64311
2026-03-16 04:56:45.801 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:56:46.801 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64311/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:56:46.816 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:56:46.917 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64311/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:56:46.922 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:56:46.922 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:56:46.923 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64311/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:56:46.925 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.69.139/tcp/64312/p2p/16Uiu2HAm486JQRBC2MqfaetKGq19vcN81VtTeZAkHQ7p7785wp7y","/ip4/172.18.69.139/tcp/64313/ws/p2p/16Uiu2HAm486JQRBC2MqfaetKGq19vcN81VtTeZAkHQ7p7785wp7y"],"enrUri":"enr:-L24QFgNN8wBunoSwksVJFr2hDYW6E1AJnRAk6znZFnKi3Q0JNKmGtDZFRmk5a0vwBIHzF5vcCgGpvc1nWksS936cIwCgmlkgnY0gmlwhKwSRYuKbXVsdGlhZGRyc5YACASsEkWLBvs4AAoErBJFiwb7Od0DgnJzhQACAQAAiXNlY3AyNTZrMaECgTg6PCjZAOt3ryIxgxAIZmcxiDHHHNyyRzmoVPYktsCDdGNwgvs4g3VkcIL7OoV3YWt1MgE"}'
2026-03-16 04:56:46.925 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:56:46.926 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64311/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.171.85/tcp/15573/p2p/16Uiu2HAmQ5FaRk1sGLWNpXJCiV8JS6b9XYFpktmD7N2soJTim465"]'
2026-03-16 04:56:46.948 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:56:46.949 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:15572/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-16 04:56:46.956 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:56:46.957 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64311/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-16 04:56:46.963 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:56:46.964 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:15572/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:56:46.978 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:56:46.979 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 04:56:47.079 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-16 04:56:47.079 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15572/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:56:47.083 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637002803128149,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773637006964276665,"ephemeral":false,"proof":""}]'
2026-03-16 04:56:47.092 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-16 04:56:47.093 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-16 04:56:47.094 DEBUG [src.node.waku_node] Stopping container with id 5319c64d3daf
2026-03-16 04:56:47.649 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:56:47.649 DEBUG [src.node.waku_node] Stopping container with id b1fd1255c5c8
2026-03-16 04:56:48.227 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:56:48.231 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-16 04:56:48.262 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:56:48.290 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:56:48.292 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-16 04:56:48.292 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-16 04:56:48.293 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-16_04-56-44__1ff977dd-3830-4f89-b4c1-c81534c956c1__wakuorg_nwaku:latest.log
2026-03-16 04:56:48.294 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-16_04-56-44__1ff977dd-3830-4f89-b4c1-c81534c956c1__wakuorg_nwaku:latest.log