167 lines
29 KiB
Plaintext

2026-03-23 04:49:43.628 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-23 04:49:43.629 DEBUG [tests.conftest] Running test: test_single_content_topic[/toychat/2/huilong/proto] with id: 2026-03-23_04-49-43__9fb834ea-8054-405d-b953-54bcc11d4487
2026-03-23 04:49:43.629 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-23 04:49:43.629 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-23 04:49:43.630 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-23 04:49:43.638 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-23 04:49:43.638 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-23_04-49-43__9fb834ea-8054-405d-b953-54bcc11d4487__wakuorg_nwaku:latest.log
2026-03-23 04:49:43.638 DEBUG [src.node.waku_node] Starting Node...
2026-03-23 04:49:43.638 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-23 04:49:43.640 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-23 04:49:43.640 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.217.198
2026-03-23 04:49:43.640 DEBUG [src.node.docker_mananger] Generated ports ['46501', '46502', '46503', '46504', '46505']
2026-03-23 04:49:43.640 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-23 04:49:43.640 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-23 04:49:43.641 DEBUG [src.node.waku_node] Using volumes []
2026-03-23 04:49:43.641 DEBUG [src.node.docker_mananger] docker run -i -t -p 46501:46501 -p 46502:46502 -p 46503:46503 -p 46504:46504 -p 46505:46505 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=46503 --rest-port=46501 --tcp-port=46502 --discv5-udp-port=46504 --rest-address=0.0.0.0 --nat=extip:172.18.217.198 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=cc86dbf9d5adeedd01873ba110a719ae7abfd9c18eedfe6d0f786ef4249221d2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=46505 --metrics-logging=true --relay=true --filter=true --content-topic=/toychat/2/huilong/proto
2026-03-23 04:49:43.844 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.217.198 waku 29b4eec537e9094fe25238f71642efbdb8bc196505b8b8b2e23b623c3c983fd1
2026-03-23 04:49:43.882 DEBUG [src.node.docker_mananger] Container started with ID 29b4eec537e9. Setting up logs at ./log/docker/node1_2026-03-23_04-49-43__9fb834ea-8054-405d-b953-54bcc11d4487__wakuorg_nwaku:latest.log
2026-03-23 04:49:43.883 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 46501
2026-03-23 04:49:43.883 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-23 04:49:44.437 ERROR [src.node.docker_mananger] Max retries reached for container 4c16f6277418. Exiting log stream.
2026-03-23 04:49:44.883 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46501/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:44.888 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-23 04:49:44.988 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46501/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:44.991 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-23 04:49:45.092 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46501/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:45.139 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-23 04:49:45.243 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46501/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:45.246 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-23 04:49:45.246 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-23 04:49:45.246 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46501/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:45.249 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.217.198/tcp/46502/p2p/16Uiu2HAmD2tGCUckkCfNEMMHR6AdQ2yy9SAAe7TcEtHWiGHD2t8W","/ip4/172.18.217.198/tcp/46503/ws/p2p/16Uiu2HAmD2tGCUckkCfNEMMHR6AdQ2yy9SAAe7TcEtHWiGHD2t8W"],"enrUri":"enr:-L24QOGI7wJzL5wy--IBYdE_ff957HCQsDbfR29UJSUxt84gWuTPAKu6Lbvw8qXN_ExuWZ1IyF50_MOXpIj3EeLr4JkCgmlkgnY0gmlwhKwS2caKbXVsdGlhZGRyc5YACASsEtnGBrWmAAoErBLZxga1p90DgnJzhQACAQAAiXNlY3AyNTZrMaEDBZvk8ogMoRxAF2olM0S0D2Za6Lb_IbIAs78583xlngeDdGNwgrWmg3VkcIK1qIV3YWt1MgU"}'
2026-03-23 04:49:45.249 INFO [src.node.waku_node] REST service is ready !!
2026-03-23 04:49:45.256 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-23 04:49:45.256 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-23_04-49-43__9fb834ea-8054-405d-b953-54bcc11d4487__wakuorg_nwaku:latest.log
2026-03-23 04:49:45.257 DEBUG [src.node.waku_node] Starting Node...
2026-03-23 04:49:45.257 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-23 04:49:45.258 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-23 04:49:45.258 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.253.34
2026-03-23 04:49:45.259 DEBUG [src.node.docker_mananger] Generated ports ['60331', '60332', '60333', '60334', '60335']
2026-03-23 04:49:45.259 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-23 04:49:45.259 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-23 04:49:45.259 DEBUG [src.node.waku_node] Using volumes []
2026-03-23 04:49:45.259 DEBUG [src.node.docker_mananger] docker run -i -t -p 60331:60331 -p 60332:60332 -p 60333:60333 -p 60334:60334 -p 60335:60335 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=60333 --rest-port=60331 --tcp-port=60332 --discv5-udp-port=60334 --rest-address=0.0.0.0 --nat=extip:172.18.253.34 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=c3d7c6cbe36c623e578bbea6cb04ee52f5addac9618b560b2c085978f1c767ca --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=60335 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QOGI7wJzL5wy--IBYdE_ff957HCQsDbfR29UJSUxt84gWuTPAKu6Lbvw8qXN_ExuWZ1IyF50_MOXpIj3EeLr4JkCgmlkgnY0gmlwhKwS2caKbXVsdGlhZGRyc5YACASsEtnGBrWmAAoErBLZxga1p90DgnJzhQACAQAAiXNlY3AyNTZrMaEDBZvk8ogMoRxAF2olM0S0D2Za6Lb_IbIAs78583xlngeDdGNwgrWmg3VkcIK1qIV3YWt1MgU --content-topic=/toychat/2/huilong/proto
2026-03-23 04:49:45.473 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.253.34 waku d5f130a1f51b8cff79c4c4224d7fa4da217581781cb83f93820e2602f06bffeb
2026-03-23 04:49:45.516 DEBUG [src.node.docker_mananger] Container started with ID d5f130a1f51b. Setting up logs at ./log/docker/node2_2026-03-23_04-49-43__9fb834ea-8054-405d-b953-54bcc11d4487__wakuorg_nwaku:latest.log
2026-03-23 04:49:45.516 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 60331
2026-03-23 04:49:45.517 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-23 04:49:46.518 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60331/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:46.521 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-23 04:49:46.622 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60331/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:46.627 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-23 04:49:46.629 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-23 04:49:46.630 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60331/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:46.635 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.253.34/tcp/60332/p2p/16Uiu2HAmVVer3WpqYbGywx3XnAA3gizwzf4X2L2uAEa7M7kJiMZ2","/ip4/172.18.253.34/tcp/60333/ws/p2p/16Uiu2HAmVVer3WpqYbGywx3XnAA3gizwzf4X2L2uAEa7M7kJiMZ2"],"enrUri":"enr:-L24QIfZ2Y3RIwB1vjXo0I6foxMn-rz4jCm4sXQyctc2_0DhIVCsImMIo8dRspyY6_FpEb6M5AdgLgFq-EGY5zq1_cACgmlkgnY0gmlwhKwS_SKKbXVsdGlhZGRyc5YACASsEv0iBuusAAoErBL9Igbrrd0DgnJzhQACAQAAiXNlY3AyNTZrMaED-jJlnucZ8HlP7RRgw3TLOuXv8rtgDDxNlAgimLu0MemDdGNwguusg3VkcILrroV3YWt1MgE"}'
2026-03-23 04:49:46.636 INFO [src.node.waku_node] REST service is ready !!
2026-03-23 04:49:46.636 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60331/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.217.198/tcp/46502/p2p/16Uiu2HAmD2tGCUckkCfNEMMHR6AdQ2yy9SAAe7TcEtHWiGHD2t8W"]'
2026-03-23 04:49:46.689 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:49:46.690 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:46501/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/toychat/2/huilong/proto"]'
2026-03-23 04:49:46.700 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:49:46.701 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60331/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/toychat/2/huilong/proto"]'
2026-03-23 04:49:46.706 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:49:46.707 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:46501/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/toychat/2/huilong/proto", "timestamp": '$(date +%s%N)'}'
2026-03-23 04:49:46.729 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:49:46.729 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-23 04:49:46.830 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-23 04:49:46.830 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46501/relay/v1/auto/messages/%2Ftoychat%2F2%2Fhuilong%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:46.834 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1774241386242364116,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1774241386707189244,"ephemeral":false,"proof":""}]'
2026-03-23 04:49:46.891 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-23 04:49:46.892 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-23 04:49:46.892 DEBUG [src.node.waku_node] Stopping container with id 29b4eec537e9
2026-03-23 04:49:47.506 DEBUG [src.node.waku_node] Container stopped.
2026-03-23 04:49:47.509 DEBUG [src.node.waku_node] Stopping container with id d5f130a1f51b
2026-03-23 04:49:48.116 DEBUG [src.node.waku_node] Container stopped.
2026-03-23 04:49:48.117 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-23 04:49:48.167 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-23 04:49:48.205 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-23 04:49:48.208 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-23 04:49:48.208 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-23 04:49:48.209 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-23_04-49-43__9fb834ea-8054-405d-b953-54bcc11d4487__wakuorg_nwaku:latest.log
2026-03-23 04:49:48.210 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-23_04-49-43__9fb834ea-8054-405d-b953-54bcc11d4487__wakuorg_nwaku:latest.log
2026-03-23 04:49:48.215 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-23 04:49:48.215 DEBUG [tests.conftest] Running test: test_single_content_topic[/toychat/2/huilong/proto] with id: 2026-03-23_04-49-48__52750d43-46f5-4860-afdd-02ab42347abc
2026-03-23 04:49:48.215 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-23 04:49:48.216 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-23 04:49:48.216 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-23 04:49:48.224 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-23 04:49:48.225 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-23_04-49-48__52750d43-46f5-4860-afdd-02ab42347abc__wakuorg_nwaku:latest.log
2026-03-23 04:49:48.225 DEBUG [src.node.waku_node] Starting Node...
2026-03-23 04:49:48.225 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-23 04:49:48.227 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-23 04:49:48.227 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.145.123
2026-03-23 04:49:48.227 DEBUG [src.node.docker_mananger] Generated ports ['53226', '53227', '53228', '53229', '53230']
2026-03-23 04:49:48.227 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-23 04:49:48.227 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-23 04:49:48.228 DEBUG [src.node.waku_node] Using volumes []
2026-03-23 04:49:48.228 DEBUG [src.node.docker_mananger] docker run -i -t -p 53226:53226 -p 53227:53227 -p 53228:53228 -p 53229:53229 -p 53230:53230 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=53228 --rest-port=53226 --tcp-port=53227 --discv5-udp-port=53229 --rest-address=0.0.0.0 --nat=extip:172.18.145.123 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=2d49dd34edb7c50ede8dd1cbacaa54dceaa0dc00c67bbba8262ed28c868cc34a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=53230 --metrics-logging=true --relay=true --filter=true --content-topic=/toychat/2/huilong/proto
2026-03-23 04:49:48.412 ERROR [src.node.docker_mananger] Max retries reached for container 29b4eec537e9. Exiting log stream.
2026-03-23 04:49:48.426 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.145.123 waku d832063dd270800a83b596d535f813053edbaf4d0e724b6b3164910b5103e540
2026-03-23 04:49:48.465 DEBUG [src.node.docker_mananger] Container started with ID d832063dd270. Setting up logs at ./log/docker/node1_2026-03-23_04-49-48__52750d43-46f5-4860-afdd-02ab42347abc__wakuorg_nwaku:latest.log
2026-03-23 04:49:48.466 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 53226
2026-03-23 04:49:48.466 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-23 04:49:49.020 ERROR [src.node.docker_mananger] Max retries reached for container d5f130a1f51b. Exiting log stream.
2026-03-23 04:49:49.466 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53226/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:49.469 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-23 04:49:49.569 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53226/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:49.572 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-23 04:49:49.673 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53226/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:49.676 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-23 04:49:49.776 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53226/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:49.779 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-23 04:49:49.779 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-23 04:49:49.779 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53226/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:49.782 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.145.123/tcp/53227/p2p/16Uiu2HAmKtbZaUwLA8wXt8rEA1oKdg8JWekMxZu7zapqa98bfUrG","/ip4/172.18.145.123/tcp/53228/ws/p2p/16Uiu2HAmKtbZaUwLA8wXt8rEA1oKdg8JWekMxZu7zapqa98bfUrG"],"enrUri":"enr:-L24QFenMcx9IuhtPnPkpztiG1KTuDfgze5iGBToj_XMOBS_IHscwSgz_uwiu7nBMFOc_DTkwRr1FYEcX5RPfZ9xxDMCgmlkgnY0gmlwhKwSkXuKbXVsdGlhZGRyc5YACASsEpF7Bs_rAAoErBKRewbP7N0DgnJzhQACAQAAiXNlY3AyNTZrMaEDa34sVemIjHbvPuoAgmRaLl0dxI5A7hz_C8BxOeFeMeWDdGNwgs_rg3VkcILP7YV3YWt1MgU"}'
2026-03-23 04:49:49.782 INFO [src.node.waku_node] REST service is ready !!
2026-03-23 04:49:49.790 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-23 04:49:49.790 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-23_04-49-48__52750d43-46f5-4860-afdd-02ab42347abc__wakuorg_nwaku:latest.log
2026-03-23 04:49:49.790 DEBUG [src.node.waku_node] Starting Node...
2026-03-23 04:49:49.790 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-23 04:49:49.792 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-23 04:49:49.792 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.133.81
2026-03-23 04:49:49.792 DEBUG [src.node.docker_mananger] Generated ports ['1487', '1488', '1489', '1490', '1491']
2026-03-23 04:49:49.792 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-23 04:49:49.793 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-23 04:49:49.793 DEBUG [src.node.waku_node] Using volumes []
2026-03-23 04:49:49.793 DEBUG [src.node.docker_mananger] docker run -i -t -p 1487:1487 -p 1488:1488 -p 1489:1489 -p 1490:1490 -p 1491:1491 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=1489 --rest-port=1487 --tcp-port=1488 --discv5-udp-port=1490 --rest-address=0.0.0.0 --nat=extip:172.18.133.81 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=e7de6f2efdb1a76aea90ce77fcaf0e832cf8fdd1cebceb29c4bbdddb36e7a6d1 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=1491 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFenMcx9IuhtPnPkpztiG1KTuDfgze5iGBToj_XMOBS_IHscwSgz_uwiu7nBMFOc_DTkwRr1FYEcX5RPfZ9xxDMCgmlkgnY0gmlwhKwSkXuKbXVsdGlhZGRyc5YACASsEpF7Bs_rAAoErBKRewbP7N0DgnJzhQACAQAAiXNlY3AyNTZrMaEDa34sVemIjHbvPuoAgmRaLl0dxI5A7hz_C8BxOeFeMeWDdGNwgs_rg3VkcILP7YV3YWt1MgU --content-topic=/toychat/2/huilong/proto
2026-03-23 04:49:50.005 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.133.81 waku fce50f987c52c6e6311767fb4b7827a65b531f31288b619e264828694e75c3ca
2026-03-23 04:49:50.043 DEBUG [src.node.docker_mananger] Container started with ID fce50f987c52. Setting up logs at ./log/docker/node2_2026-03-23_04-49-48__52750d43-46f5-4860-afdd-02ab42347abc__wakuorg_nwaku:latest.log
2026-03-23 04:49:50.044 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 1487
2026-03-23 04:49:50.044 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-23 04:49:51.045 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1487/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:51.048 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-23 04:49:51.149 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1487/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:51.151 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-23 04:49:51.252 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1487/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:51.255 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-23 04:49:51.356 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1487/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:51.359 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-23 04:49:51.359 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-23 04:49:51.360 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1487/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:51.362 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.133.81/tcp/1488/p2p/16Uiu2HAmFcTy4sAtKbAk9JfPV3qd7i7oy7gtfFC31WxHgwKRJNJy","/ip4/172.18.133.81/tcp/1489/ws/p2p/16Uiu2HAmFcTy4sAtKbAk9JfPV3qd7i7oy7gtfFC31WxHgwKRJNJy"],"enrUri":"enr:-L24QEuPQ7xK_76f-a48BYcz6Y_dinv5w64zBQ7P0qrGfhiqV7glNqMMlOGhjKVuMNdFPCD-sdGa2frzkSeLdZnMddACgmlkgnY0gmlwhKwShVGKbXVsdGlhZGRyc5YACASsEoVRBgXQAAoErBKFUQYF0d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDK-2LeeuZm5AgkMDj8Xd2KWp5vMeQRvRckpnozen9GG6DdGNwggXQg3VkcIIF0oV3YWt1MgE"}'
2026-03-23 04:49:51.363 INFO [src.node.waku_node] REST service is ready !!
2026-03-23 04:49:51.363 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1487/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.145.123/tcp/53227/p2p/16Uiu2HAmKtbZaUwLA8wXt8rEA1oKdg8JWekMxZu7zapqa98bfUrG"]'
2026-03-23 04:49:51.399 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:49:51.400 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53226/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/toychat/2/huilong/proto"]'
2026-03-23 04:49:51.407 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:49:51.408 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1487/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/toychat/2/huilong/proto"]'
2026-03-23 04:49:51.412 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:49:51.413 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53226/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/toychat/2/huilong/proto", "timestamp": '$(date +%s%N)'}'
2026-03-23 04:49:51.422 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:49:51.422 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-23 04:49:51.523 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-23 04:49:51.523 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53226/relay/v1/auto/messages/%2Ftoychat%2F2%2Fhuilong%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:51.526 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1774241391412999846,"ephemeral":false,"proof":""}]'
2026-03-23 04:49:51.528 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-23 04:49:51.528 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1487/relay/v1/auto/messages/%2Ftoychat%2F2%2Fhuilong%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:49:51.530 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1774241391412999846,"ephemeral":false,"proof":""}]'
2026-03-23 04:49:51.533 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-23 04:49:51.534 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-23 04:49:51.535 DEBUG [src.node.waku_node] Stopping container with id d832063dd270
2026-03-23 04:49:52.179 DEBUG [src.node.waku_node] Container stopped.
2026-03-23 04:49:52.181 DEBUG [src.node.waku_node] Stopping container with id fce50f987c52
2026-03-23 04:49:52.816 DEBUG [src.node.waku_node] Container stopped.
2026-03-23 04:49:52.818 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-23 04:49:52.861 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-23 04:49:52.899 DEBUG [src.node.docker_mananger] No errors found in the waku logs.