2026-03-16 12:56:34 +00:00

403 lines
74 KiB
Plaintext

2026-03-16 12:37:22.219 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-16 12:37:22.220 DEBUG [tests.conftest] Running test: test_resubscribe_to_unsubscribed_content_topics with id: 2026-03-16_12-37-22__c9297c3b-3392-40f4-87c9-c0dbf82427f7
2026-03-16 12:37:22.220 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-16 12:37:22.220 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-16 12:37:22.221 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-16 12:37:22.228 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-16 12:37:22.228 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-16_12-37-22__c9297c3b-3392-40f4-87c9-c0dbf82427f7__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:22.228 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 12:37:22.229 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 12:37:22.230 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 12:37:22.230 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.184.77
2026-03-16 12:37:22.230 DEBUG [src.node.docker_mananger] Generated ports ['38484', '38485', '38486', '38487', '38488']
2026-03-16 12:37:22.231 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 12:37:22.231 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 12:37:22.231 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 12:37:22.231 DEBUG [src.node.docker_mananger] docker run -i -t -p 38484:38484 -p 38485:38485 -p 38486:38486 -p 38487:38487 -p 38488:38488 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=38486 --rest-port=38484 --tcp-port=38485 --discv5-udp-port=38487 --rest-address=0.0.0.0 --nat=extip:172.18.184.77 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=f7fbb0e4f5ad75cb2da9ef0f8635a3ba31d1cae3c80bbeb70c9a475bb3d37044 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=38488 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-16 12:37:22.435 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.184.77 waku 4bf232217231909e202605543d904d90f3a4e080fdf470a2ad01a960fc10d231
2026-03-16 12:37:22.463 ERROR [src.node.docker_mananger] Max retries reached for container e4b8d8dfdbf1. Exiting log stream.
2026-03-16 12:37:22.472 DEBUG [src.node.docker_mananger] Container started with ID 4bf232217231. Setting up logs at ./log/docker/node1_2026-03-16_12-37-22__c9297c3b-3392-40f4-87c9-c0dbf82427f7__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:22.472 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 38484
2026-03-16 12:37:22.472 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 12:37:22.996 ERROR [src.node.docker_mananger] Max retries reached for container 72f258b0f53b. Exiting log stream.
2026-03-16 12:37:23.473 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38484/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:23.475 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 12:37:23.576 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38484/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:23.600 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 12:37:23.701 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38484/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:23.704 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 12:37:23.704 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 12:37:23.704 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38484/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:23.707 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.184.77/tcp/38485/p2p/16Uiu2HAmF7TCuEqEw4KizA5M9uNVNzmeYzT35rczuFgiWXpqCNBp","/ip4/172.18.184.77/tcp/38486/ws/p2p/16Uiu2HAmF7TCuEqEw4KizA5M9uNVNzmeYzT35rczuFgiWXpqCNBp"],"enrUri":"enr:-L24QLYMr7A0C9tRWUF10xMRatRFS2Dv__zeZ1Hf7lBNUAByfCZ15MX7wh7gkztshNXWoL4fVEcVi503HtRHtv-XCvECgmlkgnY0gmlwhKwSuE2KbXVsdGlhZGRyc5YACASsErhNBpZVAAoErBK4TQaWVt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDJH7XIYNwGISvglan2-dINTehMUQlTJcCgs-YQ6OIFH-DdGNwgpZVg3VkcIKWV4V3YWt1MgU"}'
2026-03-16 12:37:23.707 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 12:37:23.714 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-16 12:37:23.714 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-16_12-37-22__c9297c3b-3392-40f4-87c9-c0dbf82427f7__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:23.714 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 12:37:23.714 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 12:37:23.716 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 12:37:23.716 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.223.104
2026-03-16 12:37:23.716 DEBUG [src.node.docker_mananger] Generated ports ['23743', '23744', '23745', '23746', '23747']
2026-03-16 12:37:23.716 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 12:37:23.716 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 12:37:23.716 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 12:37:23.717 DEBUG [src.node.docker_mananger] docker run -i -t -p 23743:23743 -p 23744:23744 -p 23745:23745 -p 23746:23746 -p 23747:23747 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=23745 --rest-port=23743 --tcp-port=23744 --discv5-udp-port=23746 --rest-address=0.0.0.0 --nat=extip:172.18.223.104 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=8ee6afc6863cbfabefdfa2496abb55218debe48c19abb7ec0b396d38bda8b96f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=23747 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QLYMr7A0C9tRWUF10xMRatRFS2Dv__zeZ1Hf7lBNUAByfCZ15MX7wh7gkztshNXWoL4fVEcVi503HtRHtv-XCvECgmlkgnY0gmlwhKwSuE2KbXVsdGlhZGRyc5YACASsErhNBpZVAAoErBK4TQaWVt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDJH7XIYNwGISvglan2-dINTehMUQlTJcCgs-YQ6OIFH-DdGNwgpZVg3VkcIKWV4V3YWt1MgU --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-16 12:37:23.926 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.223.104 waku f9f5d2d414074fda3acc9dc096484d6a34a5b980c7b2ba618713b6622396dd51
2026-03-16 12:37:23.964 DEBUG [src.node.docker_mananger] Container started with ID f9f5d2d41407. Setting up logs at ./log/docker/node2_2026-03-16_12-37-22__c9297c3b-3392-40f4-87c9-c0dbf82427f7__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:23.965 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 23743
2026-03-16 12:37:23.965 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 12:37:24.965 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23743/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:24.968 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 12:37:24.968 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 12:37:24.968 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23743/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:24.971 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.223.104/tcp/23744/p2p/16Uiu2HAkwuf6EgMRZtvwEZHYgaJrf5LDCxVJtDdcVFRPdwtGe3zZ","/ip4/172.18.223.104/tcp/23745/ws/p2p/16Uiu2HAkwuf6EgMRZtvwEZHYgaJrf5LDCxVJtDdcVFRPdwtGe3zZ"],"enrUri":"enr:-L24QEYX10_C41uk6wKmE6ZyBv-qmucsOdN3-7fGEZ3zKZLHXy03LKgCdHQEZNGBjeR37GAlABRu4Xondr2a43h0YFcCgmlkgnY0gmlwhKwS32iKbXVsdGlhZGRyc5YACASsEt9oBlzAAAoErBLfaAZcwd0DgnJzhQACAQAAiXNlY3AyNTZrMaECJOKhpC2skje9N-yiWlhi7jXOgbWXAE30_ug1k09Z-2qDdGNwglzAg3VkcIJcwoV3YWt1MgE"}'
2026-03-16 12:37:24.971 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 12:37:24.972 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23743/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.184.77/tcp/38485/p2p/16Uiu2HAmF7TCuEqEw4KizA5M9uNVNzmeYzT35rczuFgiWXpqCNBp"]'
2026-03-16 12:37:24.999 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:25.002 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38484/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-16 12:37:25.018 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:25.021 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23743/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-16 12:37:25.026 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:25.026 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38484/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:25.036 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:25.038 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:25.138 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:25.139 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38484/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:25.142 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773664643505391583,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773664644609691836,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773664645026624351,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:25.189 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-16 12:37:25.190 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-16 12:37:25.190 DEBUG [src.node.waku_node] Stopping container with id 4bf232217231
2026-03-16 12:37:25.750 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 12:37:25.751 DEBUG [src.node.waku_node] Stopping container with id f9f5d2d41407
2026-03-16 12:37:26.327 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 12:37:26.329 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-16 12:37:26.375 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 12:37:26.409 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 12:37:26.410 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-16 12:37:26.410 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-16 12:37:26.411 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-16_12-37-22__c9297c3b-3392-40f4-87c9-c0dbf82427f7__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:26.412 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-16_12-37-22__c9297c3b-3392-40f4-87c9-c0dbf82427f7__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:26.416 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-16 12:37:26.416 DEBUG [tests.conftest] Running test: test_resubscribe_to_unsubscribed_content_topics with id: 2026-03-16_12-37-26__7c54e399-0fa7-4a77-ab67-f12f13ea8ba7
2026-03-16 12:37:26.416 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-16 12:37:26.417 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-16 12:37:26.417 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-16 12:37:26.425 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-16 12:37:26.425 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-16_12-37-26__7c54e399-0fa7-4a77-ab67-f12f13ea8ba7__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:26.426 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 12:37:26.426 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 12:37:26.427 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 12:37:26.427 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.44.27
2026-03-16 12:37:26.427 DEBUG [src.node.docker_mananger] Generated ports ['19928', '19929', '19930', '19931', '19932']
2026-03-16 12:37:26.428 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 12:37:26.428 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 12:37:26.428 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 12:37:26.428 DEBUG [src.node.docker_mananger] docker run -i -t -p 19928:19928 -p 19929:19929 -p 19930:19930 -p 19931:19931 -p 19932:19932 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=19930 --rest-port=19928 --tcp-port=19929 --discv5-udp-port=19931 --rest-address=0.0.0.0 --nat=extip:172.18.44.27 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=1fbdf0beffcecda506e13a5a4914ecbdd7f6fb7f0e00b52c49eae6e64613363f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=19932 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-16 12:37:26.612 ERROR [src.node.docker_mananger] Max retries reached for container 4bf232217231. Exiting log stream.
2026-03-16 12:37:26.620 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.44.27 waku 9e58e308526e70c1f7c0b52e15636f72b8ece838f488db59cb387550d78f97c8
2026-03-16 12:37:26.660 DEBUG [src.node.docker_mananger] Container started with ID 9e58e308526e. Setting up logs at ./log/docker/node1_2026-03-16_12-37-26__7c54e399-0fa7-4a77-ab67-f12f13ea8ba7__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:26.661 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 19928
2026-03-16 12:37:26.662 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 12:37:27.188 ERROR [src.node.docker_mananger] Max retries reached for container f9f5d2d41407. Exiting log stream.
2026-03-16 12:37:27.662 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19928/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:27.665 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 12:37:27.765 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19928/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:27.768 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 12:37:27.868 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19928/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:27.871 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 12:37:27.971 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19928/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:27.974 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 12:37:28.075 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19928/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:28.104 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 12:37:28.204 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19928/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:28.207 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 12:37:28.207 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 12:37:28.208 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19928/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:28.210 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.44.27/tcp/19929/p2p/16Uiu2HAmKq1ixCews98csvdR27QNj2S9tyYJomFbcSYnamQyeRBg","/ip4/172.18.44.27/tcp/19930/ws/p2p/16Uiu2HAmKq1ixCews98csvdR27QNj2S9tyYJomFbcSYnamQyeRBg"],"enrUri":"enr:-L24QCdHyOlzUeYjAp2_rhzIjvJCoxN7pL-HXsn6hNn1lcj6Ox2kX8l30tZAMYgSwSZfLA3fiBkKBZ7IqC9SEuWauPgCgmlkgnY0gmlwhKwSLBuKbXVsdGlhZGRyc5YACASsEiwbBk3ZAAoErBIsGwZN2t0DgnJzhQACAQAAiXNlY3AyNTZrMaEDapMrakai2IpViTEPoCI0N3yFb6qQZZmgHigTDshyDvODdGNwgk3Zg3VkcIJN24V3YWt1MgU"}'
2026-03-16 12:37:28.210 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 12:37:28.217 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-16 12:37:28.218 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-16_12-37-26__7c54e399-0fa7-4a77-ab67-f12f13ea8ba7__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:28.218 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 12:37:28.218 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 12:37:28.219 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 12:37:28.219 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.222.13
2026-03-16 12:37:28.220 DEBUG [src.node.docker_mananger] Generated ports ['3601', '3602', '3603', '3604', '3605']
2026-03-16 12:37:28.220 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 12:37:28.220 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 12:37:28.220 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 12:37:28.220 DEBUG [src.node.docker_mananger] docker run -i -t -p 3601:3601 -p 3602:3602 -p 3603:3603 -p 3604:3604 -p 3605:3605 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3603 --rest-port=3601 --tcp-port=3602 --discv5-udp-port=3604 --rest-address=0.0.0.0 --nat=extip:172.18.222.13 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=c3e0303084d3fa2fafd52abcca6dbb5fa7d8ddda4ba5b88a1bbebefd7cccafe7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3605 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QCdHyOlzUeYjAp2_rhzIjvJCoxN7pL-HXsn6hNn1lcj6Ox2kX8l30tZAMYgSwSZfLA3fiBkKBZ7IqC9SEuWauPgCgmlkgnY0gmlwhKwSLBuKbXVsdGlhZGRyc5YACASsEiwbBk3ZAAoErBIsGwZN2t0DgnJzhQACAQAAiXNlY3AyNTZrMaEDapMrakai2IpViTEPoCI0N3yFb6qQZZmgHigTDshyDvODdGNwgk3Zg3VkcIJN24V3YWt1MgU --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-16 12:37:28.425 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.222.13 waku e842abd0ff79094ec269f5820c03652190e4eeff4bd52f9478f16b7fa6103a1f
2026-03-16 12:37:28.461 DEBUG [src.node.docker_mananger] Container started with ID e842abd0ff79. Setting up logs at ./log/docker/node2_2026-03-16_12-37-26__7c54e399-0fa7-4a77-ab67-f12f13ea8ba7__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:28.461 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 3601
2026-03-16 12:37:28.463 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 12:37:29.463 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3601/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:29.481 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 12:37:29.583 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3601/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:29.586 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 12:37:29.587 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 12:37:29.587 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3601/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:29.589 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.222.13/tcp/3602/p2p/16Uiu2HAm2Niv3y45ZGXtDKVt3hH2vfBa6XBibuvpwBt3LRa5gY4g","/ip4/172.18.222.13/tcp/3603/ws/p2p/16Uiu2HAm2Niv3y45ZGXtDKVt3hH2vfBa6XBibuvpwBt3LRa5gY4g"],"enrUri":"enr:-L24QGZ7-_RyBpdra9ZyEUerin4fhPLJtqNmZ__HbhtQizrPKfQzCM63KFpHytbYqFR0vjNGm8TYasjW_OLqgmIvgckCgmlkgnY0gmlwhKwS3g2KbXVsdGlhZGRyc5YACASsEt4NBg4SAAoErBLeDQYOE90DgnJzhQACAQAAiXNlY3AyNTZrMaECZ0BinjoNXqozjZv0M2qzg600LcSYx9YbZyGSqecYB6mDdGNwgg4Sg3VkcIIOFIV3YWt1MgE"}'
2026-03-16 12:37:29.590 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 12:37:29.590 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3601/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.44.27/tcp/19929/p2p/16Uiu2HAmKq1ixCews98csvdR27QNj2S9tyYJomFbcSYnamQyeRBg"]'
2026-03-16 12:37:29.616 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:29.619 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19928/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-16 12:37:29.629 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:29.630 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3601/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-16 12:37:29.644 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:29.648 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19928/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:29.662 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:29.662 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:29.763 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:29.764 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19928/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:29.767 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773664645026624351,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773664649648095469,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:29.776 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-16 12:37:29.777 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-16 12:37:29.777 DEBUG [src.node.waku_node] Stopping container with id 9e58e308526e
2026-03-16 12:37:30.385 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 12:37:30.385 DEBUG [src.node.waku_node] Stopping container with id e842abd0ff79
2026-03-16 12:37:30.954 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 12:37:30.957 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-16 12:37:30.989 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 12:37:31.024 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 12:37:31.028 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-16 12:37:31.028 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-16 12:37:31.030 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-16_12-37-26__7c54e399-0fa7-4a77-ab67-f12f13ea8ba7__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:31.034 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-16_12-37-26__7c54e399-0fa7-4a77-ab67-f12f13ea8ba7__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:31.050 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-16 12:37:31.051 DEBUG [tests.conftest] Running test: test_resubscribe_to_unsubscribed_content_topics with id: 2026-03-16_12-37-31__cdbbd181-9634-4b99-9ff3-31c4169420f6
2026-03-16 12:37:31.053 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-16 12:37:31.053 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-16 12:37:31.054 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-16 12:37:31.067 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-16 12:37:31.068 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-16_12-37-31__cdbbd181-9634-4b99-9ff3-31c4169420f6__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:31.068 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 12:37:31.068 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 12:37:31.072 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 12:37:31.072 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.45.52
2026-03-16 12:37:31.072 DEBUG [src.node.docker_mananger] Generated ports ['20933', '20934', '20935', '20936', '20937']
2026-03-16 12:37:31.072 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 12:37:31.073 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 12:37:31.073 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 12:37:31.074 DEBUG [src.node.docker_mananger] docker run -i -t -p 20933:20933 -p 20934:20934 -p 20935:20935 -p 20936:20936 -p 20937:20937 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=20935 --rest-port=20933 --tcp-port=20934 --discv5-udp-port=20936 --rest-address=0.0.0.0 --nat=extip:172.18.45.52 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=efec6ae9a3efda55da26002cae55c2ccbe6cdf2fcac77e1e45b2cdadcf65daae --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=20937 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-16 12:37:31.230 ERROR [src.node.docker_mananger] Max retries reached for container 9e58e308526e. Exiting log stream.
2026-03-16 12:37:31.290 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.45.52 waku 3d25f228c62c349d938240aedcdeca37836824f484444f4f4f885b892d83675b
2026-03-16 12:37:31.325 DEBUG [src.node.docker_mananger] Container started with ID 3d25f228c62c. Setting up logs at ./log/docker/node1_2026-03-16_12-37-31__cdbbd181-9634-4b99-9ff3-31c4169420f6__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:31.326 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 20933
2026-03-16 12:37:31.326 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 12:37:31.978 ERROR [src.node.docker_mananger] Max retries reached for container e842abd0ff79. Exiting log stream.
2026-03-16 12:37:32.326 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:32.329 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 12:37:32.430 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:32.478 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 12:37:32.579 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:32.581 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 12:37:32.582 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 12:37:32.582 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:32.584 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.45.52/tcp/20934/p2p/16Uiu2HAmHqJqUYXyQRdAKM71JACcqEfpBX24iAGctPPqSYJ81PfV","/ip4/172.18.45.52/tcp/20935/ws/p2p/16Uiu2HAmHqJqUYXyQRdAKM71JACcqEfpBX24iAGctPPqSYJ81PfV"],"enrUri":"enr:-L24QK-vZuQcosSD1gBTaG-NUCkCsiLbg5D2AFiap4L1YURXAgob4ua6T7FewfwT84KxsswcGgtQ-lYNAdlon6UvERECgmlkgnY0gmlwhKwSLTSKbXVsdGlhZGRyc5YACASsEi00BlHGAAoErBItNAZRx90DgnJzhQACAQAAiXNlY3AyNTZrMaEDTO8lFgI6FAt0h3vcwL0GnzXsA-lCjHfDVWcLxaawySCDdGNwglHGg3VkcIJRyIV3YWt1MgU"}'
2026-03-16 12:37:32.585 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 12:37:32.592 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-16 12:37:32.592 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-16_12-37-31__cdbbd181-9634-4b99-9ff3-31c4169420f6__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:32.592 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 12:37:32.592 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 12:37:32.594 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 12:37:32.594 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.65.185
2026-03-16 12:37:32.594 DEBUG [src.node.docker_mananger] Generated ports ['60604', '60605', '60606', '60607', '60608']
2026-03-16 12:37:32.594 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 12:37:32.595 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 12:37:32.595 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 12:37:32.595 DEBUG [src.node.docker_mananger] docker run -i -t -p 60604:60604 -p 60605:60605 -p 60606:60606 -p 60607:60607 -p 60608:60608 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=60606 --rest-port=60604 --tcp-port=60605 --discv5-udp-port=60607 --rest-address=0.0.0.0 --nat=extip:172.18.65.185 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=f79ccac4dfefcbda7c0b56a02406c3880396e46ee54cc315951da1fc4aedaee3 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=60608 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QK-vZuQcosSD1gBTaG-NUCkCsiLbg5D2AFiap4L1YURXAgob4ua6T7FewfwT84KxsswcGgtQ-lYNAdlon6UvERECgmlkgnY0gmlwhKwSLTSKbXVsdGlhZGRyc5YACASsEi00BlHGAAoErBItNAZRx90DgnJzhQACAQAAiXNlY3AyNTZrMaEDTO8lFgI6FAt0h3vcwL0GnzXsA-lCjHfDVWcLxaawySCDdGNwglHGg3VkcIJRyIV3YWt1MgU --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-16 12:37:32.786 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.65.185 waku ab6108a59a4a4611a6058ef232af6efff3e7deead854885d0d74fc6fd96fa67d
2026-03-16 12:37:32.825 DEBUG [src.node.docker_mananger] Container started with ID ab6108a59a4a. Setting up logs at ./log/docker/node2_2026-03-16_12-37-31__cdbbd181-9634-4b99-9ff3-31c4169420f6__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:32.826 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 60604
2026-03-16 12:37:32.826 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 12:37:33.827 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60604/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:33.848 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 12:37:33.949 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60604/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:33.952 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 12:37:33.952 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 12:37:33.952 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60604/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:33.955 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.65.185/tcp/60605/p2p/16Uiu2HAmQndSvfdZ3s6sd8XnE8t8GMey9iqbpZB37KFv3gX2kt3M","/ip4/172.18.65.185/tcp/60606/ws/p2p/16Uiu2HAmQndSvfdZ3s6sd8XnE8t8GMey9iqbpZB37KFv3gX2kt3M"],"enrUri":"enr:-L24QFemLOffcrXqn5FM_HHDl7TfATQeWpZKnBLe4i67VI0DCZeEpzau93BZ1JmZ47G-Rph_Hh7E8TnE5vGEyNSP92oCgmlkgnY0gmlwhKwSQbmKbXVsdGlhZGRyc5YACASsEkG5Buy9AAoErBJBuQbsvt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDtEFBM2Z4ANWEtLdOoIMmZONAp3Y0MScUAmVXInzRGvyDdGNwguy9g3VkcILsv4V3YWt1MgE"}'
2026-03-16 12:37:33.955 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 12:37:33.955 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60604/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.45.52/tcp/20934/p2p/16Uiu2HAmHqJqUYXyQRdAKM71JACcqEfpBX24iAGctPPqSYJ81PfV"]'
2026-03-16 12:37:33.976 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:33.978 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-16 12:37:33.988 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:33.989 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60604/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-16 12:37:33.996 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:33.997 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:34.006 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:34.007 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:34.108 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:34.109 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:34.111 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773664653997220420,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:34.113 DEBUG [src.steps.sharding] Checking that peer NODE_2:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:34.113 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60604/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:34.116 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773664653997220420,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:34.117 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/waku/2/content/test.js", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:34.127 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:34.128 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:34.229 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:34.229 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Fwaku%2F2%2Fcontent%2Ftest.js" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:34.232 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/waku/2/content/test.js","version":0,"timestamp":1773664654117730996,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:34.234 DEBUG [src.steps.sharding] Checking that peer NODE_2:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:34.234 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60604/relay/v1/auto/messages/%2Fwaku%2F2%2Fcontent%2Ftest.js" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:34.239 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/waku/2/content/test.js","version":0,"timestamp":1773664654117730996,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:34.241 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/22/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:34.250 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:34.251 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:34.351 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:34.352 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Fapp%2F22%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:34.354 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/22/sometopic/someencoding","version":0,"timestamp":1773664654241293742,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:34.356 DEBUG [src.steps.sharding] Checking that peer NODE_2:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:34.357 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60604/relay/v1/auto/messages/%2Fapp%2F22%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:34.361 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/22/sometopic/someencoding","version":0,"timestamp":1773664654241293742,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:34.363 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/toychat/2/huilong/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:34.394 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:34.395 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:34.496 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:34.496 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Ftoychat%2F2%2Fhuilong%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:34.499 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1773664654363279308,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:34.500 DEBUG [src.steps.sharding] Checking that peer NODE_2:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:34.501 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60604/relay/v1/auto/messages/%2Ftoychat%2F2%2Fhuilong%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:34.503 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1773664654363279308,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:34.505 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/statusim/1/community/cbor", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:34.513 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:34.514 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:34.615 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:34.615 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Fstatusim%2F1%2Fcommunity%2Fcbor" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:34.618 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/statusim/1/community/cbor","version":0,"timestamp":1773664654505134967,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:34.620 DEBUG [src.steps.sharding] Checking that peer NODE_2:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:34.620 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60604/relay/v1/auto/messages/%2Fstatusim%2F1%2Fcommunity%2Fcbor" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:34.622 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/statusim/1/community/cbor","version":0,"timestamp":1773664654505134967,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:34.624 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/27/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:34.632 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:34.633 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:34.734 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:34.734 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Fapp%2F27%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:34.737 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/27/sometopic/someencoding","version":0,"timestamp":1773664654624598319,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:34.739 DEBUG [src.steps.sharding] Checking that peer NODE_2:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:34.739 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60604/relay/v1/auto/messages/%2Fapp%2F27%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:34.741 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/27/sometopic/someencoding","version":0,"timestamp":1773664654624598319,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:34.743 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/29/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:34.752 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:34.753 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:34.854 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:34.855 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Fapp%2F29%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:34.857 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/29/sometopic/someencoding","version":0,"timestamp":1773664654743309854,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:34.859 DEBUG [src.steps.sharding] Checking that peer NODE_2:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:34.859 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60604/relay/v1/auto/messages/%2Fapp%2F29%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:34.861 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/29/sometopic/someencoding","version":0,"timestamp":1773664654743309854,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:34.863 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/20/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:34.872 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:34.872 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:34.973 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:34.973 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Fapp%2F20%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:34.976 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/20/sometopic/someencoding","version":0,"timestamp":1773664654863465384,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:34.978 DEBUG [src.steps.sharding] Checking that peer NODE_2:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:34.978 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60604/relay/v1/auto/messages/%2Fapp%2F20%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:34.980 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/20/sometopic/someencoding","version":0,"timestamp":1773664654863465384,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:34.982 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:20933/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-16 12:37:35.031 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:35.032 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:60604/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-16 12:37:35.077 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:35.078 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:35.087 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:35.087 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:35.187 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:35.188 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:35.190 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:20933/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto. Response content: b'/myapp/1/latest/proto'
2026-03-16 12:37:35.192 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/waku/2/content/test.js", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:35.198 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:35.199 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:35.299 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:35.299 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Fwaku%2F2%2Fcontent%2Ftest.js" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:35.302 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:20933/relay/v1/auto/messages/%2Fwaku%2F2%2Fcontent%2Ftest.js. Response content: b'/waku/2/content/test.js'
2026-03-16 12:37:35.304 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/22/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:35.310 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:35.311 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:35.411 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:35.411 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Fapp%2F22%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:35.414 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:20933/relay/v1/auto/messages/%2Fapp%2F22%2Fsometopic%2Fsomeencoding. Response content: b'/app/22/sometopic/someencoding'
2026-03-16 12:37:35.415 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/toychat/2/huilong/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:35.422 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:35.422 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:35.522 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:35.523 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Ftoychat%2F2%2Fhuilong%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:35.525 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:20933/relay/v1/auto/messages/%2Ftoychat%2F2%2Fhuilong%2Fproto. Response content: b'/toychat/2/huilong/proto'
2026-03-16 12:37:35.527 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/statusim/1/community/cbor", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:35.533 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:35.534 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:35.634 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:35.634 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Fstatusim%2F1%2Fcommunity%2Fcbor" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:35.637 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:20933/relay/v1/auto/messages/%2Fstatusim%2F1%2Fcommunity%2Fcbor. Response content: b'/statusim/1/community/cbor'
2026-03-16 12:37:35.639 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/27/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:35.645 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:35.646 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:35.746 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:35.747 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Fapp%2F27%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:35.749 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:20933/relay/v1/auto/messages/%2Fapp%2F27%2Fsometopic%2Fsomeencoding. Response content: b'/app/27/sometopic/someencoding'
2026-03-16 12:37:35.751 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/29/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:35.758 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:35.758 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:35.858 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:35.859 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Fapp%2F29%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:35.862 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:20933/relay/v1/auto/messages/%2Fapp%2F29%2Fsometopic%2Fsomeencoding. Response content: b'/app/29/sometopic/someencoding'
2026-03-16 12:37:35.863 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/20/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:35.870 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:35.870 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:35.970 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:35.971 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Fapp%2F20%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:35.973 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:20933/relay/v1/auto/messages/%2Fapp%2F20%2Fsometopic%2Fsomeencoding. Response content: b'/app/20/sometopic/someencoding'
2026-03-16 12:37:35.975 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-16 12:37:36.006 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:36.007 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60604/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-16 12:37:36.045 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:36.047 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:36.060 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:36.060 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:36.161 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:36.161 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:36.164 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773664656047012755,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:36.166 DEBUG [src.steps.sharding] Checking that peer NODE_2:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:36.166 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60604/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:36.168 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773664656047012755,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:36.170 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/waku/2/content/test.js", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:36.178 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:36.178 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:36.279 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:36.280 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Fwaku%2F2%2Fcontent%2Ftest.js" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:36.282 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/waku/2/content/test.js","version":0,"timestamp":1773664656170366703,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:36.284 DEBUG [src.steps.sharding] Checking that peer NODE_2:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:36.284 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60604/relay/v1/auto/messages/%2Fwaku%2F2%2Fcontent%2Ftest.js" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:36.286 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/waku/2/content/test.js","version":0,"timestamp":1773664656170366703,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:36.288 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/22/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:36.297 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:36.297 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:36.397 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:36.398 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Fapp%2F22%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:36.403 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/22/sometopic/someencoding","version":0,"timestamp":1773664656288471220,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:36.405 DEBUG [src.steps.sharding] Checking that peer NODE_2:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:36.405 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60604/relay/v1/auto/messages/%2Fapp%2F22%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:36.409 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/22/sometopic/someencoding","version":0,"timestamp":1773664656288471220,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:36.411 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20933/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/toychat/2/huilong/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:36.421 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:36.421 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 12:37:36.524 DEBUG [src.steps.sharding] Checking that peer NODE_1:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:36.526 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20933/relay/v1/auto/messages/%2Ftoychat%2F2%2Fhuilong%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:36.530 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1773664656411229494,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:36.532 DEBUG [src.steps.sharding] Checking that peer NODE_2:harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the published message
2026-03-16 12:37:36.533 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60604/relay/v1/auto/messages/%2Ftoychat%2F2%2Fhuilong%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:36.538 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1773664656411229494,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1773664655415699168,"ephemeral":false,"proof":""}]'
2026-03-16 12:37:36.550 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-16 12:37:36.551 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-16 12:37:36.552 DEBUG [src.node.waku_node] Stopping container with id 3d25f228c62c
2026-03-16 12:37:37.143 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 12:37:37.145 DEBUG [src.node.waku_node] Stopping container with id ab6108a59a4a
2026-03-16 12:37:37.725 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 12:37:37.726 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-16 12:37:37.792 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 12:37:37.861 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 12:37:37.863 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-16 12:37:37.863 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-16 12:37:37.863 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-16_12-37-31__cdbbd181-9634-4b99-9ff3-31c4169420f6__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:37.865 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-16_12-37-31__cdbbd181-9634-4b99-9ff3-31c4169420f6__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log