271 lines
48 KiB
Plaintext

2026-03-19 04:41:47.145 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-19 04:41:47.146 DEBUG [tests.conftest] Running test: test_resubscribe_to_unsubscribed_content_topics with id: 2026-03-19_04-41-47__c2732f18-37f2-4c60-bce9-c3a956e4e6ca
2026-03-19 04:41:47.146 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-19 04:41:47.146 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-19 04:41:47.147 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-19 04:41:47.154 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-19 04:41:47.154 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-19_04-41-47__c2732f18-37f2-4c60-bce9-c3a956e4e6ca__wakuorg_nwaku:latest.log
2026-03-19 04:41:47.154 DEBUG [src.node.waku_node] Starting Node...
2026-03-19 04:41:47.154 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-19 04:41:47.156 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-19 04:41:47.156 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.184.15
2026-03-19 04:41:47.156 DEBUG [src.node.docker_mananger] Generated ports ['38399', '38400', '38401', '38402', '38403']
2026-03-19 04:41:47.156 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-19 04:41:47.156 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-19 04:41:47.156 DEBUG [src.node.waku_node] Using volumes []
2026-03-19 04:41:47.157 DEBUG [src.node.docker_mananger] docker run -i -t -p 38399:38399 -p 38400:38400 -p 38401:38401 -p 38402:38402 -p 38403:38403 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=38401 --rest-port=38399 --tcp-port=38400 --discv5-udp-port=38402 --rest-address=0.0.0.0 --nat=extip:172.18.184.15 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=5f9d4db9c0afa1c16f3b0bc14ad6a80c8bb92ae5ce7ae6ee6e2b28e7b7c3f252 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=38403 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-19 04:41:47.346 ERROR [src.node.docker_mananger] Max retries reached for container 4f303aa7ee7d. Exiting log stream.
2026-03-19 04:41:47.348 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.184.15 waku e94dcc15b902eba1a1e21a268ac19a325a63d69c80ec93756bf158c9f81ccc60
2026-03-19 04:41:47.382 DEBUG [src.node.docker_mananger] Container started with ID e94dcc15b902. Setting up logs at ./log/docker/node1_2026-03-19_04-41-47__c2732f18-37f2-4c60-bce9-c3a956e4e6ca__wakuorg_nwaku:latest.log
2026-03-19 04:41:47.382 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 38399
2026-03-19 04:41:47.382 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-19 04:41:47.918 ERROR [src.node.docker_mananger] Max retries reached for container 4562e435e4df. Exiting log stream.
2026-03-19 04:41:48.383 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38399/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:48.395 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:48.495 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38399/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:48.497 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-19 04:41:48.498 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-19 04:41:48.498 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38399/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:48.500 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.184.15/tcp/38400/p2p/16Uiu2HAm1E7cPFgxd7EwrjdPqf2TjC5KDEjGbiqCCRencJXiThGu","/ip4/172.18.184.15/tcp/38401/ws/p2p/16Uiu2HAm1E7cPFgxd7EwrjdPqf2TjC5KDEjGbiqCCRencJXiThGu"],"enrUri":"enr:-L24QOczfsTjx988SuR3Xj93XH_aiadSFiqqkotZGZQ2kJxZTK5taIeuvKgqYkzBbey6UADCHDYR2ZPI74LpdjnDYIUCgmlkgnY0gmlwhKwSuA-KbXVsdGlhZGRyc5YACASsErgPBpYAAAoErBK4DwaWAd0DgnJzhQACAQAAiXNlY3AyNTZrMaECVjAh_aH-srRyIg6NIe3ZSeI58yztvrKfcg9yKibdSlqDdGNwgpYAg3VkcIKWAoV3YWt1MgU"}'
2026-03-19 04:41:48.501 INFO [src.node.waku_node] REST service is ready !!
2026-03-19 04:41:48.507 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-19 04:41:48.508 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-19_04-41-47__c2732f18-37f2-4c60-bce9-c3a956e4e6ca__wakuorg_nwaku:latest.log
2026-03-19 04:41:48.508 DEBUG [src.node.waku_node] Starting Node...
2026-03-19 04:41:48.508 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-19 04:41:48.512 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-19 04:41:48.512 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.77.45
2026-03-19 04:41:48.513 DEBUG [src.node.docker_mananger] Generated ports ['54273', '54274', '54275', '54276', '54277']
2026-03-19 04:41:48.513 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-19 04:41:48.514 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-19 04:41:48.514 DEBUG [src.node.waku_node] Using volumes []
2026-03-19 04:41:48.514 DEBUG [src.node.docker_mananger] docker run -i -t -p 54273:54273 -p 54274:54274 -p 54275:54275 -p 54276:54276 -p 54277:54277 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=54275 --rest-port=54273 --tcp-port=54274 --discv5-udp-port=54276 --rest-address=0.0.0.0 --nat=extip:172.18.77.45 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=9b4dce61582931a3957ab06e24be9e96daef57cc42f6762bdfd4cf1d47fddb2b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=54277 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QOczfsTjx988SuR3Xj93XH_aiadSFiqqkotZGZQ2kJxZTK5taIeuvKgqYkzBbey6UADCHDYR2ZPI74LpdjnDYIUCgmlkgnY0gmlwhKwSuA-KbXVsdGlhZGRyc5YACASsErgPBpYAAAoErBK4DwaWAd0DgnJzhQACAQAAiXNlY3AyNTZrMaECVjAh_aH-srRyIg6NIe3ZSeI58yztvrKfcg9yKibdSlqDdGNwgpYAg3VkcIKWAoV3YWt1MgU --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-19 04:41:48.722 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.77.45 waku 8c6b3681ae8aa3c25972f0a5a49774c17e5501133fe36c97f3f7c5f4e96541a6
2026-03-19 04:41:48.769 DEBUG [src.node.docker_mananger] Container started with ID 8c6b3681ae8a. Setting up logs at ./log/docker/node2_2026-03-19_04-41-47__c2732f18-37f2-4c60-bce9-c3a956e4e6ca__wakuorg_nwaku:latest.log
2026-03-19 04:41:48.769 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 54273
2026-03-19 04:41:48.770 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-19 04:41:49.770 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54273/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:49.773 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:49.874 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54273/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:49.876 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:49.977 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54273/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:49.980 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:50.080 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54273/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:50.082 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-19 04:41:50.083 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-19 04:41:50.083 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54273/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:50.085 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.77.45/tcp/54274/p2p/16Uiu2HAmUwzohRrSRiaf49hnENyKUCWB1tLop9Y28SYi2SwLUmEk","/ip4/172.18.77.45/tcp/54275/ws/p2p/16Uiu2HAmUwzohRrSRiaf49hnENyKUCWB1tLop9Y28SYi2SwLUmEk"],"enrUri":"enr:-L24QLi-_hwZpAJCgF7uHSTyHzxc1OUytAoOx_pReClH76FhXEmQUnRkFkOnlYdcDkXzEXVG5f7-H4Nh8bMOXvH5a2ICgmlkgnY0gmlwhKwSTS2KbXVsdGlhZGRyc5YACASsEk0tBtQCAAoErBJNLQbUA90DgnJzhQACAQAAiXNlY3AyNTZrMaED8hZhICNPe-8u4TDTRTtAvHwHZcbG6KoHTuDvWYUz0TWDdGNwgtQCg3VkcILUBIV3YWt1MgE"}'
2026-03-19 04:41:50.085 INFO [src.node.waku_node] REST service is ready !!
2026-03-19 04:41:50.086 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54273/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.184.15/tcp/38400/p2p/16Uiu2HAm1E7cPFgxd7EwrjdPqf2TjC5KDEjGbiqCCRencJXiThGu"]'
2026-03-19 04:41:50.108 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:41:50.110 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38399/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-19 04:41:50.122 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:41:50.123 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54273/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-19 04:41:50.130 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:41:50.131 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38399/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:41:50.143 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:41:50.143 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-19 04:41:50.244 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-19 04:41:50.245 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38399/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:50.248 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773895306468647827,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773895310130851217,"ephemeral":false,"proof":""}]'
2026-03-19 04:41:50.292 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-19 04:41:50.293 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-19 04:41:50.294 DEBUG [src.node.waku_node] Stopping container with id e94dcc15b902
2026-03-19 04:41:50.899 DEBUG [src.node.waku_node] Container stopped.
2026-03-19 04:41:50.900 DEBUG [src.node.waku_node] Stopping container with id 8c6b3681ae8a
2026-03-19 04:41:51.463 DEBUG [src.node.waku_node] Container stopped.
2026-03-19 04:41:51.465 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-19 04:41:51.536 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-19 04:41:51.565 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-19 04:41:51.567 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-19 04:41:51.569 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-19 04:41:51.570 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-19_04-41-47__c2732f18-37f2-4c60-bce9-c3a956e4e6ca__wakuorg_nwaku:latest.log
2026-03-19 04:41:51.575 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-19_04-41-47__c2732f18-37f2-4c60-bce9-c3a956e4e6ca__wakuorg_nwaku:latest.log
2026-03-19 04:41:51.591 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-19 04:41:51.592 DEBUG [tests.conftest] Running test: test_resubscribe_to_unsubscribed_content_topics with id: 2026-03-19_04-41-51__a82b5d7c-7f48-4c6b-8899-2c2274f1df41
2026-03-19 04:41:51.593 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-19 04:41:51.593 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-19 04:41:51.593 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-19 04:41:51.606 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-19 04:41:51.606 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-19_04-41-51__a82b5d7c-7f48-4c6b-8899-2c2274f1df41__wakuorg_nwaku:latest.log
2026-03-19 04:41:51.607 DEBUG [src.node.waku_node] Starting Node...
2026-03-19 04:41:51.608 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-19 04:41:51.609 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-19 04:41:51.610 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.176.1
2026-03-19 04:41:51.611 DEBUG [src.node.docker_mananger] Generated ports ['42106', '42107', '42108', '42109', '42110']
2026-03-19 04:41:51.611 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-19 04:41:51.612 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-19 04:41:51.613 DEBUG [src.node.waku_node] Using volumes []
2026-03-19 04:41:51.614 DEBUG [src.node.docker_mananger] docker run -i -t -p 42106:42106 -p 42107:42107 -p 42108:42108 -p 42109:42109 -p 42110:42110 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=42108 --rest-port=42106 --tcp-port=42107 --discv5-udp-port=42109 --rest-address=0.0.0.0 --nat=extip:172.18.176.1 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=6cd9b53f1ce89ec2ea6a3e6fdc6d9631441cbab9bb0e0b36fbdd69e10a315d72 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=42110 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-19 04:41:51.818 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.176.1 waku ceda96557ae5995506b47bffd0435d7b62a16fa1fed4b6f2055ed50717347dc6
2026-03-19 04:41:51.854 DEBUG [src.node.docker_mananger] Container started with ID ceda96557ae5. Setting up logs at ./log/docker/node1_2026-03-19_04-41-51__a82b5d7c-7f48-4c6b-8899-2c2274f1df41__wakuorg_nwaku:latest.log
2026-03-19 04:41:51.856 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 42106
2026-03-19 04:41:51.856 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-19 04:41:51.868 ERROR [src.node.docker_mananger] Max retries reached for container e94dcc15b902. Exiting log stream.
2026-03-19 04:41:52.498 ERROR [src.node.docker_mananger] Max retries reached for container 8c6b3681ae8a. Exiting log stream.
2026-03-19 04:41:52.856 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42106/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:52.859 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:52.959 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42106/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:52.962 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:53.062 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42106/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:53.065 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:53.165 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42106/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:53.167 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:53.268 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42106/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:53.272 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:53.372 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42106/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:53.375 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:53.475 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42106/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:53.478 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:53.578 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42106/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:53.581 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:53.682 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42106/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:53.707 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:53.807 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42106/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:53.809 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-19 04:41:53.809 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-19 04:41:53.810 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42106/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:53.812 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.176.1/tcp/42107/p2p/16Uiu2HAmQhLGLqVXJo4p9FgfPsBPoVKT1YAPMaTYuCmm4oeAKW1B","/ip4/172.18.176.1/tcp/42108/ws/p2p/16Uiu2HAmQhLGLqVXJo4p9FgfPsBPoVKT1YAPMaTYuCmm4oeAKW1B"],"enrUri":"enr:-L24QA43YGjR1M7RgtaYW8aqCTiQpWsleNfthRcLYUFAz341ewqyMGGQ9QnDACMZYiVAN2JrpLTKcGIwHtmYbV7M-1sCgmlkgnY0gmlwhKwSsAGKbXVsdGlhZGRyc5YACASsErABBqR7AAoErBKwAQakfN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDsuXsIA30gBvJIkXd_3Kj5MJDDKiviodjKLFoTn27CJ6DdGNwgqR7g3VkcIKkfYV3YWt1MgU"}'
2026-03-19 04:41:53.812 INFO [src.node.waku_node] REST service is ready !!
2026-03-19 04:41:53.819 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-19 04:41:53.820 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-19_04-41-51__a82b5d7c-7f48-4c6b-8899-2c2274f1df41__wakuorg_nwaku:latest.log
2026-03-19 04:41:53.820 DEBUG [src.node.waku_node] Starting Node...
2026-03-19 04:41:53.820 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-19 04:41:53.821 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-19 04:41:53.821 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.106.198
2026-03-19 04:41:53.821 DEBUG [src.node.docker_mananger] Generated ports ['24311', '24312', '24313', '24314', '24315']
2026-03-19 04:41:53.821 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-19 04:41:53.822 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-19 04:41:53.822 DEBUG [src.node.waku_node] Using volumes []
2026-03-19 04:41:53.822 DEBUG [src.node.docker_mananger] docker run -i -t -p 24311:24311 -p 24312:24312 -p 24313:24313 -p 24314:24314 -p 24315:24315 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24313 --rest-port=24311 --tcp-port=24312 --discv5-udp-port=24314 --rest-address=0.0.0.0 --nat=extip:172.18.106.198 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=67ded1d8c12bdea29c2cecd43e43deb02f2d9d6bdd50d9cdaf24b546b547e874 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24315 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QA43YGjR1M7RgtaYW8aqCTiQpWsleNfthRcLYUFAz341ewqyMGGQ9QnDACMZYiVAN2JrpLTKcGIwHtmYbV7M-1sCgmlkgnY0gmlwhKwSsAGKbXVsdGlhZGRyc5YACASsErABBqR7AAoErBKwAQakfN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDsuXsIA30gBvJIkXd_3Kj5MJDDKiviodjKLFoTn27CJ6DdGNwgqR7g3VkcIKkfYV3YWt1MgU --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-19 04:41:54.015 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.106.198 waku 3ecc92d946bc68882eb390ac9177e7d0433559e01e66f3de208251e9ecf19432
2026-03-19 04:41:54.052 DEBUG [src.node.docker_mananger] Container started with ID 3ecc92d946bc. Setting up logs at ./log/docker/node2_2026-03-19_04-41-51__a82b5d7c-7f48-4c6b-8899-2c2274f1df41__wakuorg_nwaku:latest.log
2026-03-19 04:41:54.052 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 24311
2026-03-19 04:41:54.052 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-19 04:41:55.053 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24311/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:55.056 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:55.156 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24311/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:55.159 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:55.259 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24311/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:55.262 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:55.362 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24311/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:55.368 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:55.469 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24311/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:55.471 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-19 04:41:55.472 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-19 04:41:55.472 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24311/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:55.475 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.106.198/tcp/24312/p2p/16Uiu2HAmMPs2cvPmoDvK5PFcrpKSiBuKo2hStzA5oWsZfJVGTHYr","/ip4/172.18.106.198/tcp/24313/ws/p2p/16Uiu2HAmMPs2cvPmoDvK5PFcrpKSiBuKo2hStzA5oWsZfJVGTHYr"],"enrUri":"enr:-L24QMJDURUqL1mHV-lGJA6yj0UIuZnlJgUjI3Q-DGFm3hj-REVS-6HfnD898FVKOjISNabzXHTtho_iROUK_VJs85kCgmlkgnY0gmlwhKwSasaKbXVsdGlhZGRyc5YACASsEmrGBl74AAoErBJqxgZe-d0DgnJzhQACAQAAiXNlY3AyNTZrMaEDgdkw-cb2-FMU8wTQ0h7iH7-TfDkScWGDIG_xveJ-dDeDdGNwgl74g3VkcIJe-oV3YWt1MgE"}'
2026-03-19 04:41:55.475 INFO [src.node.waku_node] REST service is ready !!
2026-03-19 04:41:55.475 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24311/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.176.1/tcp/42107/p2p/16Uiu2HAmQhLGLqVXJo4p9FgfPsBPoVKT1YAPMaTYuCmm4oeAKW1B"]'
2026-03-19 04:41:55.507 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:41:55.508 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42106/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-19 04:41:55.518 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:41:55.518 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24311/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-19 04:41:55.524 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:41:55.524 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42106/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:41:55.534 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:41:55.534 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-19 04:41:55.634 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-19 04:41:55.635 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42106/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:55.638 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"L3dha3UvMi9ycy8yLzA=","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773895311641005764,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773895315524466490,"ephemeral":false,"proof":""}]'
2026-03-19 04:41:55.648 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-19 04:41:55.649 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-19 04:41:55.649 DEBUG [src.node.waku_node] Stopping container with id ceda96557ae5
2026-03-19 04:41:56.220 DEBUG [src.node.waku_node] Container stopped.
2026-03-19 04:41:56.220 DEBUG [src.node.waku_node] Stopping container with id 3ecc92d946bc
2026-03-19 04:41:56.793 DEBUG [src.node.waku_node] Container stopped.
2026-03-19 04:41:56.797 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-19 04:41:56.832 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-19 04:41:56.860 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-19 04:41:56.862 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-19 04:41:56.862 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-19 04:41:56.862 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-19_04-41-51__a82b5d7c-7f48-4c6b-8899-2c2274f1df41__wakuorg_nwaku:latest.log
2026-03-19 04:41:56.864 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-19_04-41-51__a82b5d7c-7f48-4c6b-8899-2c2274f1df41__wakuorg_nwaku:latest.log
2026-03-19 04:41:56.867 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-19 04:41:56.868 DEBUG [tests.conftest] Running test: test_resubscribe_to_unsubscribed_content_topics with id: 2026-03-19_04-41-56__196cbe89-9ca6-40a9-be1a-ebb2ada54dd7
2026-03-19 04:41:56.868 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-19 04:41:56.868 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-19 04:41:56.869 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-19 04:41:56.876 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-19 04:41:56.876 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-19_04-41-56__196cbe89-9ca6-40a9-be1a-ebb2ada54dd7__wakuorg_nwaku:latest.log
2026-03-19 04:41:56.877 DEBUG [src.node.waku_node] Starting Node...
2026-03-19 04:41:56.877 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-19 04:41:56.878 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-19 04:41:56.878 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.162.166
2026-03-19 04:41:56.879 DEBUG [src.node.docker_mananger] Generated ports ['10222', '10223', '10224', '10225', '10226']
2026-03-19 04:41:56.879 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-19 04:41:56.879 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-19 04:41:56.879 DEBUG [src.node.waku_node] Using volumes []
2026-03-19 04:41:56.879 DEBUG [src.node.docker_mananger] docker run -i -t -p 10222:10222 -p 10223:10223 -p 10224:10224 -p 10225:10225 -p 10226:10226 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=10224 --rest-port=10222 --tcp-port=10223 --discv5-udp-port=10225 --rest-address=0.0.0.0 --nat=extip:172.18.162.166 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=ecf0ed7ce1dec6dd6ce1ffacf81ef947c0eed6adfa96a24fffb2adc7e1fc753d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=10226 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-19 04:41:57.064 ERROR [src.node.docker_mananger] Max retries reached for container ceda96557ae5. Exiting log stream.
2026-03-19 04:41:57.067 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.162.166 waku fa7495552a1dfc8896fa99283d31f6eb09fcec68f2d7ee6fa1c2550ebd1a5ce4
2026-03-19 04:41:57.103 DEBUG [src.node.docker_mananger] Container started with ID fa7495552a1d. Setting up logs at ./log/docker/node1_2026-03-19_04-41-56__196cbe89-9ca6-40a9-be1a-ebb2ada54dd7__wakuorg_nwaku:latest.log
2026-03-19 04:41:57.103 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 10222
2026-03-19 04:41:57.103 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-19 04:41:57.606 ERROR [src.node.docker_mananger] Max retries reached for container 3ecc92d946bc. Exiting log stream.
2026-03-19 04:41:58.104 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10222/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:58.106 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:58.207 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10222/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:58.209 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:58.310 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10222/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:58.312 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:58.413 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10222/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:58.455 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:58.557 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10222/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:58.559 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-19 04:41:58.560 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-19 04:41:58.561 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10222/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:58.564 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.162.166/tcp/10223/p2p/16Uiu2HAm3xr2mGr6LqFYV4QubJajLSSA6xhKFgKY7jK832R6dtic","/ip4/172.18.162.166/tcp/10224/ws/p2p/16Uiu2HAm3xr2mGr6LqFYV4QubJajLSSA6xhKFgKY7jK832R6dtic"],"enrUri":"enr:-L24QDz2Z9V1UzgaH3donemgr_kaX13azRYX07islRNVY-REaUC2biVXqoA2idvzHLus9YtJfeHz1kjxahExC5HM19kCgmlkgnY0gmlwhKwSoqaKbXVsdGlhZGRyc5YACASsEqKmBifvAAoErBKipgYn8N0DgnJzhQACAQAAiXNlY3AyNTZrMaECftndjX8CmvvMa_AUFjTnaIhBnjS4qrWgZ6ichLnte8mDdGNwgifvg3VkcIIn8YV3YWt1MgU"}'
2026-03-19 04:41:58.565 INFO [src.node.waku_node] REST service is ready !!
2026-03-19 04:41:58.572 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-19 04:41:58.572 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-19_04-41-56__196cbe89-9ca6-40a9-be1a-ebb2ada54dd7__wakuorg_nwaku:latest.log
2026-03-19 04:41:58.572 DEBUG [src.node.waku_node] Starting Node...
2026-03-19 04:41:58.572 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-19 04:41:58.574 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-19 04:41:58.574 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.179.190
2026-03-19 04:41:58.574 DEBUG [src.node.docker_mananger] Generated ports ['23600', '23601', '23602', '23603', '23604']
2026-03-19 04:41:58.574 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-19 04:41:58.574 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-19 04:41:58.574 DEBUG [src.node.waku_node] Using volumes []
2026-03-19 04:41:58.574 DEBUG [src.node.docker_mananger] docker run -i -t -p 23600:23600 -p 23601:23601 -p 23602:23602 -p 23603:23603 -p 23604:23604 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=23602 --rest-port=23600 --tcp-port=23601 --discv5-udp-port=23603 --rest-address=0.0.0.0 --nat=extip:172.18.179.190 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=3a07d3ba1e2ebcad0a1492cf2ab2ec9b7a31ee2da9e3c2baf5fff78b3ff5d153 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=23604 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QDz2Z9V1UzgaH3donemgr_kaX13azRYX07islRNVY-REaUC2biVXqoA2idvzHLus9YtJfeHz1kjxahExC5HM19kCgmlkgnY0gmlwhKwSoqaKbXVsdGlhZGRyc5YACASsEqKmBifvAAoErBKipgYn8N0DgnJzhQACAQAAiXNlY3AyNTZrMaECftndjX8CmvvMa_AUFjTnaIhBnjS4qrWgZ6ichLnte8mDdGNwgifvg3VkcIIn8YV3YWt1MgU --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-19 04:41:58.765 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.179.190 waku 61c60376db05bbebdd6ed27b7b6aabe3bfab3de02b5a54fc6650aa7b682cc101
2026-03-19 04:41:58.803 DEBUG [src.node.docker_mananger] Container started with ID 61c60376db05. Setting up logs at ./log/docker/node2_2026-03-19_04-41-56__196cbe89-9ca6-40a9-be1a-ebb2ada54dd7__wakuorg_nwaku:latest.log
2026-03-19 04:41:58.804 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 23600
2026-03-19 04:41:58.804 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-19 04:41:59.805 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23600/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:59.807 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:41:59.908 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23600/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:41:59.910 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:42:00.011 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23600/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:42:00.014 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-19 04:42:00.114 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23600/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:42:00.117 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-19 04:42:00.117 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-19 04:42:00.117 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:23600/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:42:00.119 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.179.190/tcp/23601/p2p/16Uiu2HAkxSijtp6PnVjmuxGpH24Mxj2XJn1eFxxJ6jx6aMzU9Kij","/ip4/172.18.179.190/tcp/23602/ws/p2p/16Uiu2HAkxSijtp6PnVjmuxGpH24Mxj2XJn1eFxxJ6jx6aMzU9Kij"],"enrUri":"enr:-L24QGNIEPE-xM1dfKz4k1yw3v6LK6EGQ_GKpg-bFdv5MmksJ1gXX82LKC3uGCIDF_r7B7ISmN_vb2Npyv-rwfEBfEICgmlkgnY0gmlwhKwSs76KbXVsdGlhZGRyc5YACASsErO-BlwxAAoErBKzvgZcMt0DgnJzhQACAQAAiXNlY3AyNTZrMaECLNfDQmT2bUlNuigvaPe8uCSAzh3WrOPrEO8jGI0IKwyDdGNwglwxg3VkcIJcM4V3YWt1MgE"}'
2026-03-19 04:42:00.120 INFO [src.node.waku_node] REST service is ready !!
2026-03-19 04:42:00.120 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23600/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.162.166/tcp/10223/p2p/16Uiu2HAm3xr2mGr6LqFYV4QubJajLSSA6xhKFgKY7jK832R6dtic"]'
2026-03-19 04:42:00.145 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:42:00.150 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10222/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-19 04:42:00.158 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:42:00.160 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:23600/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-19 04:42:00.166 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:42:00.167 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10222/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-19 04:42:00.177 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:42:00.178 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-19 04:42:00.278 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-19 04:42:00.279 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10222/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:42:00.282 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773895319848942270,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773895320167755113,"ephemeral":false,"proof":""}]'
2026-03-19 04:42:00.295 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-19 04:42:00.296 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-19 04:42:00.296 DEBUG [src.node.waku_node] Stopping container with id fa7495552a1d
2026-03-19 04:42:00.881 DEBUG [src.node.waku_node] Container stopped.
2026-03-19 04:42:00.883 DEBUG [src.node.waku_node] Stopping container with id 61c60376db05
2026-03-19 04:42:01.481 DEBUG [src.node.waku_node] Container stopped.
2026-03-19 04:42:01.482 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-19 04:42:01.513 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-19 04:42:01.543 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-19 04:42:01.546 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-19 04:42:01.546 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-19 04:42:01.548 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-19_04-41-56__196cbe89-9ca6-40a9-be1a-ebb2ada54dd7__wakuorg_nwaku:latest.log
2026-03-19 04:42:01.553 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-19_04-41-56__196cbe89-9ca6-40a9-be1a-ebb2ada54dd7__wakuorg_nwaku:latest.log