296 lines
55 KiB
Plaintext

2026-03-29 04:50:26.889 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-29 04:50:26.889 DEBUG [tests.conftest] Running test: test_start_node_with_50_pubsub_topics with id: 2026-03-29_04-50-26__7eee4b77-8563-4c5a-881b-9c07eb96228a
2026-03-29 04:50:26.889 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-29 04:50:26.890 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-29 04:50:26.890 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-29 04:50:26.897 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-29 04:50:26.897 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-29_04-50-26__7eee4b77-8563-4c5a-881b-9c07eb96228a__wakuorg_nwaku:latest.log
2026-03-29 04:50:26.897 DEBUG [src.node.waku_node] Starting Node...
2026-03-29 04:50:26.897 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-29 04:50:26.899 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-29 04:50:26.899 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.127.52
2026-03-29 04:50:26.899 DEBUG [src.node.docker_mananger] Generated ports ['12393', '12394', '12395', '12396', '12397']
2026-03-29 04:50:26.899 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-29 04:50:26.900 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-29 04:50:26.900 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-29 04:50:26.900 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-29 04:50:26.900 DEBUG [src.node.waku_node] Using volumes []
2026-03-29 04:50:26.900 DEBUG [src.node.docker_mananger] docker run -i -t -p 12393:12393 -p 12394:12394 -p 12395:12395 -p 12396:12396 -p 12397:12397 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=12395 --rest-port=12393 --tcp-port=12394 --discv5-udp-port=12396 --rest-address=0.0.0.0 --nat=extip:172.18.127.52 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=aa014afbfefecbde39cc1cbaffecd49dd47b7102a1f2b746ebab8e55bdfc6adb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=12397 --metrics-logging=true --relay=true --filter=true
2026-03-29 04:50:27.099 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.127.52 waku 867128c59fcde2a1f0101ec264cc60496670984c420263ceb6b149eaf21ab235
2026-03-29 04:50:27.133 DEBUG [src.node.docker_mananger] Container started with ID 867128c59fcd. Setting up logs at ./log/docker/node1_2026-03-29_04-50-26__7eee4b77-8563-4c5a-881b-9c07eb96228a__wakuorg_nwaku:latest.log
2026-03-29 04:50:27.134 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 12393
2026-03-29 04:50:27.134 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-29 04:50:27.209 ERROR [src.node.docker_mananger] Max retries reached for container af8168772921. Exiting log stream.
2026-03-29 04:50:27.695 ERROR [src.node.docker_mananger] Max retries reached for container 040730a27a12. Exiting log stream.
2026-03-29 04:50:28.135 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12393/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:28.138 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-29 04:50:28.138 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-29 04:50:28.138 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12393/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:28.147 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.127.52/tcp/12394/p2p/16Uiu2HAm7HaozPNUTpPzQJ9zV63MMxkKie76WcSUY5oQ6c526388","/ip4/172.18.127.52/tcp/12395/ws/p2p/16Uiu2HAm7HaozPNUTpPzQJ9zV63MMxkKie76WcSUY5oQ6c526388"],"enrUri":"enr:-L24QHH3A336oXhaPMXEfIs_4LQDb_a7CC0L_VA_iI8P4WZ9Fd-eXsIFdirN_KfpY9bN7xAT_w8M2a0lOIf8kBn8lMkCgmlkgnY0gmlwhKwSfzSKbXVsdGlhZGRyc5YACASsEn80BjBqAAoErBJ_NAYwa90DgnJzhQACAQAAiXNlY3AyNTZrMaECsDnAg9N2zfHQnj8d6L757pM546LgBm_zs7aJqY_pbH2DdGNwgjBqg3VkcIIwbIV3YWt1MgU"}'
2026-03-29 04:50:28.149 INFO [src.node.waku_node] REST service is ready !!
2026-03-29 04:50:28.157 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-29 04:50:28.158 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-29_04-50-26__7eee4b77-8563-4c5a-881b-9c07eb96228a__wakuorg_nwaku:latest.log
2026-03-29 04:50:28.159 DEBUG [src.node.waku_node] Starting Node...
2026-03-29 04:50:28.159 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-29 04:50:28.162 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-29 04:50:28.162 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.186.7
2026-03-29 04:50:28.162 DEBUG [src.node.docker_mananger] Generated ports ['12079', '12080', '12081', '12082', '12083']
2026-03-29 04:50:28.162 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-29 04:50:28.163 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-29 04:50:28.163 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-29 04:50:28.163 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-29 04:50:28.163 DEBUG [src.node.waku_node] Using volumes []
2026-03-29 04:50:28.163 DEBUG [src.node.docker_mananger] docker run -i -t -p 12079:12079 -p 12080:12080 -p 12081:12081 -p 12082:12082 -p 12083:12083 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=12081 --rest-port=12079 --tcp-port=12080 --discv5-udp-port=12082 --rest-address=0.0.0.0 --nat=extip:172.18.186.7 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=a5beb0dd1dcc1de3ac4252cd6fec85de9fb7dab01c83a1a86fcababf50ce44b2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=12083 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QHH3A336oXhaPMXEfIs_4LQDb_a7CC0L_VA_iI8P4WZ9Fd-eXsIFdirN_KfpY9bN7xAT_w8M2a0lOIf8kBn8lMkCgmlkgnY0gmlwhKwSfzSKbXVsdGlhZGRyc5YACASsEn80BjBqAAoErBJ_NAYwa90DgnJzhQACAQAAiXNlY3AyNTZrMaECsDnAg9N2zfHQnj8d6L757pM546LgBm_zs7aJqY_pbH2DdGNwgjBqg3VkcIIwbIV3YWt1MgU
2026-03-29 04:50:28.352 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.186.7 waku 56c127c29dd514af353d5fd1dfa7aacde61914429baea8f211318e7e5a55677c
2026-03-29 04:50:28.386 DEBUG [src.node.docker_mananger] Container started with ID 56c127c29dd5. Setting up logs at ./log/docker/node2_2026-03-29_04-50-26__7eee4b77-8563-4c5a-881b-9c07eb96228a__wakuorg_nwaku:latest.log
2026-03-29 04:50:28.386 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 12079
2026-03-29 04:50:28.387 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-29 04:50:29.388 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12079/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:29.391 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-29 04:50:29.491 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12079/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:29.494 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-29 04:50:29.494 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-29 04:50:29.494 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12079/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:29.497 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.186.7/tcp/12080/p2p/16Uiu2HAmDEyvmTDFaf1Ro1cJ8Msu45hj3oGtPaNfGDPnCAWsqRrM","/ip4/172.18.186.7/tcp/12081/ws/p2p/16Uiu2HAmDEyvmTDFaf1Ro1cJ8Msu45hj3oGtPaNfGDPnCAWsqRrM"],"enrUri":"enr:-L24QMhsa2NcQ_UB1JY2K159-Qw2Vb2esVT61qP6n5xPHtcrMDvJVDFbdcJN5r1F6ZqvMf87IKuhOw1EUzHRwChEVbQCgmlkgnY0gmlwhKwSugeKbXVsdGlhZGRyc5YACASsEroHBi8wAAoErBK6BwYvMd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDCLVE-irGhdc-ngQb2MLfaBJEf2BGd9P81C2bk3BeSw6DdGNwgi8wg3VkcIIvMoV3YWt1MgE"}'
2026-03-29 04:50:29.497 INFO [src.node.waku_node] REST service is ready !!
2026-03-29 04:50:29.497 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12079/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.127.52/tcp/12394/p2p/16Uiu2HAm7HaozPNUTpPzQJ9zV63MMxkKie76WcSUY5oQ6c526388"]'
2026-03-29 04:50:29.521 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 04:50:29.523 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12393/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7", "/waku/2/rs/2/8", "/waku/2/rs/2/9", "/waku/2/rs/2/10", "/waku/2/rs/2/11", "/waku/2/rs/2/12", "/waku/2/rs/2/13", "/waku/2/rs/2/14", "/waku/2/rs/2/15", "/waku/2/rs/2/16", "/waku/2/rs/2/17", "/waku/2/rs/2/18", "/waku/2/rs/2/19", "/waku/2/rs/2/20", "/waku/2/rs/2/21", "/waku/2/rs/2/22", "/waku/2/rs/2/23", "/waku/2/rs/2/24", "/waku/2/rs/2/25", "/waku/2/rs/2/26", "/waku/2/rs/2/27", "/waku/2/rs/2/28", "/waku/2/rs/2/29", "/waku/2/rs/2/30", "/waku/2/rs/2/31", "/waku/2/rs/2/32", "/waku/2/rs/2/33", "/waku/2/rs/2/34", "/waku/2/rs/2/35", "/waku/2/rs/2/36", "/waku/2/rs/2/37", "/waku/2/rs/2/38", "/waku/2/rs/2/39", "/waku/2/rs/2/40", "/waku/2/rs/2/41", "/waku/2/rs/2/42", "/waku/2/rs/2/43", "/waku/2/rs/2/44", "/waku/2/rs/2/45", "/waku/2/rs/2/46", "/waku/2/rs/2/47", "/waku/2/rs/2/48", "/waku/2/rs/2/49"]'
2026-03-29 04:50:29.632 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 04:50:29.633 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12079/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7", "/waku/2/rs/2/8", "/waku/2/rs/2/9", "/waku/2/rs/2/10", "/waku/2/rs/2/11", "/waku/2/rs/2/12", "/waku/2/rs/2/13", "/waku/2/rs/2/14", "/waku/2/rs/2/15", "/waku/2/rs/2/16", "/waku/2/rs/2/17", "/waku/2/rs/2/18", "/waku/2/rs/2/19", "/waku/2/rs/2/20", "/waku/2/rs/2/21", "/waku/2/rs/2/22", "/waku/2/rs/2/23", "/waku/2/rs/2/24", "/waku/2/rs/2/25", "/waku/2/rs/2/26", "/waku/2/rs/2/27", "/waku/2/rs/2/28", "/waku/2/rs/2/29", "/waku/2/rs/2/30", "/waku/2/rs/2/31", "/waku/2/rs/2/32", "/waku/2/rs/2/33", "/waku/2/rs/2/34", "/waku/2/rs/2/35", "/waku/2/rs/2/36", "/waku/2/rs/2/37", "/waku/2/rs/2/38", "/waku/2/rs/2/39", "/waku/2/rs/2/40", "/waku/2/rs/2/41", "/waku/2/rs/2/42", "/waku/2/rs/2/43", "/waku/2/rs/2/44", "/waku/2/rs/2/45", "/waku/2/rs/2/46", "/waku/2/rs/2/47", "/waku/2/rs/2/48", "/waku/2/rs/2/49"]'
2026-03-29 04:50:29.778 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 04:50:29.779 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12393/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-29 04:50:29.796 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 04:50:29.796 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-29 04:50:29.896 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-29 04:50:29.897 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12393/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:29.899 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774759829779447361,"ephemeral":false,"proof":""}]'
2026-03-29 04:50:29.901 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-29 04:50:29.901 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12079/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:29.903 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774759829779447361,"ephemeral":false,"proof":""}]'
2026-03-29 04:50:29.905 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12393/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-29 04:50:29.911 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 04:50:29.911 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-29 04:50:30.012 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-29 04:50:30.012 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12393/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:30.015 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774759829905321800,"ephemeral":false,"proof":""}]'
2026-03-29 04:50:30.016 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-29 04:50:30.017 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12079/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:30.019 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774759829905321800,"ephemeral":false,"proof":""}]'
2026-03-29 04:50:30.021 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12393/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-29 04:50:30.026 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 04:50:30.026 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-29 04:50:30.127 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-29 04:50:30.128 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12393/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:30.130 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774759830021056688,"ephemeral":false,"proof":""}]'
2026-03-29 04:50:30.132 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-29 04:50:30.132 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12079/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:30.135 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774759830021056688,"ephemeral":false,"proof":""}]'
2026-03-29 04:50:30.137 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12393/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-29 04:50:30.144 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 04:50:30.144 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-29 04:50:30.244 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-29 04:50:30.245 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12393/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:30.248 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1774759829818394257,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774759830136880772,"ephemeral":false,"proof":""}]'
2026-03-29 04:50:30.258 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-29 04:50:30.259 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-29 04:50:30.259 DEBUG [src.node.waku_node] Stopping container with id 867128c59fcd
2026-03-29 04:50:30.808 DEBUG [src.node.waku_node] Container stopped.
2026-03-29 04:50:30.809 DEBUG [src.node.waku_node] Stopping container with id 56c127c29dd5
2026-03-29 04:50:31.292 DEBUG [src.node.waku_node] Container stopped.
2026-03-29 04:50:31.296 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-29 04:50:31.344 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-29 04:50:31.389 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-29 04:50:31.390 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-29 04:50:31.390 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-29 04:50:31.391 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-29_04-50-26__7eee4b77-8563-4c5a-881b-9c07eb96228a__wakuorg_nwaku:latest.log
2026-03-29 04:50:31.392 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-29_04-50-26__7eee4b77-8563-4c5a-881b-9c07eb96228a__wakuorg_nwaku:latest.log
2026-03-29 04:50:31.397 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-29 04:50:31.397 DEBUG [tests.conftest] Running test: test_start_node_with_50_pubsub_topics with id: 2026-03-29_04-50-31__ae1538b2-7157-448c-8f84-e6d5205f71c0
2026-03-29 04:50:31.397 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-29 04:50:31.397 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-29 04:50:31.398 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-29 04:50:31.405 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-29 04:50:31.405 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-29_04-50-31__ae1538b2-7157-448c-8f84-e6d5205f71c0__wakuorg_nwaku:latest.log
2026-03-29 04:50:31.406 DEBUG [src.node.waku_node] Starting Node...
2026-03-29 04:50:31.406 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-29 04:50:31.407 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-29 04:50:31.407 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.40.12
2026-03-29 04:50:31.407 DEBUG [src.node.docker_mananger] Generated ports ['46358', '46359', '46360', '46361', '46362']
2026-03-29 04:50:31.408 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-29 04:50:31.408 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-29 04:50:31.408 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-29 04:50:31.408 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-29 04:50:31.408 DEBUG [src.node.waku_node] Using volumes []
2026-03-29 04:50:31.408 DEBUG [src.node.docker_mananger] docker run -i -t -p 46358:46358 -p 46359:46359 -p 46360:46360 -p 46361:46361 -p 46362:46362 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=46360 --rest-port=46358 --tcp-port=46359 --discv5-udp-port=46361 --rest-address=0.0.0.0 --nat=extip:172.18.40.12 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=01038afa6dfcf24ed58f87ff6acec5bcf7f600eb3d02a5df8dfa7186efdad1f2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=46362 --metrics-logging=true --relay=true --filter=true
2026-03-29 04:50:31.599 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.40.12 waku bda3b87c3d2f3eb9f9b333a2a75c406adb9097f95e38f1a9a86313c7ab1c1b20
2026-03-29 04:50:31.624 ERROR [src.node.docker_mananger] Max retries reached for container 867128c59fcd. Exiting log stream.
2026-03-29 04:50:31.635 DEBUG [src.node.docker_mananger] Container started with ID bda3b87c3d2f. Setting up logs at ./log/docker/node1_2026-03-29_04-50-31__ae1538b2-7157-448c-8f84-e6d5205f71c0__wakuorg_nwaku:latest.log
2026-03-29 04:50:31.637 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 46358
2026-03-29 04:50:31.637 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-29 04:50:32.110 ERROR [src.node.docker_mananger] Max retries reached for container 56c127c29dd5. Exiting log stream.
2026-03-29 04:50:32.637 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46358/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:32.641 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-29 04:50:32.641 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-29 04:50:32.641 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46358/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:32.652 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.40.12/tcp/46359/p2p/16Uiu2HAm6wP5zaM5yMRwA91Ts66uEszjdFicSPg2DspkM6XzDSJ1","/ip4/172.18.40.12/tcp/46360/ws/p2p/16Uiu2HAm6wP5zaM5yMRwA91Ts66uEszjdFicSPg2DspkM6XzDSJ1"],"enrUri":"enr:-L24QIjdc7jHs3Q3gcb1UjNqh70P4v6hhHzsNPGA_bZspC_5MDXIj7Qp3cjET5RiQrhvXoAzn7FtFSPW_wQlXGR3ey8CgmlkgnY0gmlwhKwSKAyKbXVsdGlhZGRyc5YACASsEigMBrUXAAoErBIoDAa1GN0DgnJzhQACAQAAiXNlY3AyNTZrMaECqwzhHkzOZgM_0AA1JJOFsgVGPq76JALc6KjNsgqCsc6DdGNwgrUXg3VkcIK1GYV3YWt1MgU"}'
2026-03-29 04:50:32.654 INFO [src.node.waku_node] REST service is ready !!
2026-03-29 04:50:32.664 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-29 04:50:32.664 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-29_04-50-31__ae1538b2-7157-448c-8f84-e6d5205f71c0__wakuorg_nwaku:latest.log
2026-03-29 04:50:32.664 DEBUG [src.node.waku_node] Starting Node...
2026-03-29 04:50:32.664 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-29 04:50:32.665 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-29 04:50:32.666 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.124.131
2026-03-29 04:50:32.666 DEBUG [src.node.docker_mananger] Generated ports ['24530', '24531', '24532', '24533', '24534']
2026-03-29 04:50:32.666 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-29 04:50:32.666 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-29 04:50:32.666 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-29 04:50:32.666 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-29 04:50:32.666 DEBUG [src.node.waku_node] Using volumes []
2026-03-29 04:50:32.667 DEBUG [src.node.docker_mananger] docker run -i -t -p 24530:24530 -p 24531:24531 -p 24532:24532 -p 24533:24533 -p 24534:24534 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24532 --rest-port=24530 --tcp-port=24531 --discv5-udp-port=24533 --rest-address=0.0.0.0 --nat=extip:172.18.124.131 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=9ea6b8ec38a4db2e5c4553785dabefc3bd0e966d24dbfbf7eebd7b50dd2adaa8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24534 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QIjdc7jHs3Q3gcb1UjNqh70P4v6hhHzsNPGA_bZspC_5MDXIj7Qp3cjET5RiQrhvXoAzn7FtFSPW_wQlXGR3ey8CgmlkgnY0gmlwhKwSKAyKbXVsdGlhZGRyc5YACASsEigMBrUXAAoErBIoDAa1GN0DgnJzhQACAQAAiXNlY3AyNTZrMaECqwzhHkzOZgM_0AA1JJOFsgVGPq76JALc6KjNsgqCsc6DdGNwgrUXg3VkcIK1GYV3YWt1MgU
2026-03-29 04:50:32.873 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.124.131 waku bcfd789d544235545af1d067f5b5dfe179b784587b72d85c3b042e689aafea43
2026-03-29 04:50:32.907 DEBUG [src.node.docker_mananger] Container started with ID bcfd789d5442. Setting up logs at ./log/docker/node2_2026-03-29_04-50-31__ae1538b2-7157-448c-8f84-e6d5205f71c0__wakuorg_nwaku:latest.log
2026-03-29 04:50:32.907 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 24530
2026-03-29 04:50:32.907 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-29 04:50:33.908 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24530/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:33.910 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-29 04:50:33.911 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-29 04:50:33.911 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24530/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:33.913 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.124.131/tcp/24531/p2p/16Uiu2HAkugPnzPU7idqun6AfDzZ1XGfCgfeP6EeQqadQSDX7u3XA","/ip4/172.18.124.131/tcp/24532/ws/p2p/16Uiu2HAkugPnzPU7idqun6AfDzZ1XGfCgfeP6EeQqadQSDX7u3XA"],"enrUri":"enr:-L24QKieDZh-0IPUpg4HK2k7vCtA3xiVM7u36dOPY93c0yFXAv4FkPrSpR61074_MHv3km3_s9gGWkwvvx87k8EVBusCgmlkgnY0gmlwhKwSfIOKbXVsdGlhZGRyc5YACASsEnyDBl_TAAoErBJ8gwZf1N0DgnJzhQACAQAAiXNlY3AyNTZrMaECA8VpB3TTezUAChiR7jmFLUsd2EAfIBfMXhINxyKrTN2DdGNwgl_Tg3VkcIJf1YV3YWt1MgE"}'
2026-03-29 04:50:33.914 INFO [src.node.waku_node] REST service is ready !!
2026-03-29 04:50:33.914 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24530/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.40.12/tcp/46359/p2p/16Uiu2HAm6wP5zaM5yMRwA91Ts66uEszjdFicSPg2DspkM6XzDSJ1"]'
2026-03-29 04:50:33.965 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 04:50:33.967 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:46358/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7", "/waku/2/rs/2/8", "/waku/2/rs/2/9", "/waku/2/rs/2/10", "/waku/2/rs/2/11", "/waku/2/rs/2/12", "/waku/2/rs/2/13", "/waku/2/rs/2/14", "/waku/2/rs/2/15", "/waku/2/rs/2/16", "/waku/2/rs/2/17", "/waku/2/rs/2/18", "/waku/2/rs/2/19", "/waku/2/rs/2/20", "/waku/2/rs/2/21", "/waku/2/rs/2/22", "/waku/2/rs/2/23", "/waku/2/rs/2/24", "/waku/2/rs/2/25", "/waku/2/rs/2/26", "/waku/2/rs/2/27", "/waku/2/rs/2/28", "/waku/2/rs/2/29", "/waku/2/rs/2/30", "/waku/2/rs/2/31", "/waku/2/rs/2/32", "/waku/2/rs/2/33", "/waku/2/rs/2/34", "/waku/2/rs/2/35", "/waku/2/rs/2/36", "/waku/2/rs/2/37", "/waku/2/rs/2/38", "/waku/2/rs/2/39", "/waku/2/rs/2/40", "/waku/2/rs/2/41", "/waku/2/rs/2/42", "/waku/2/rs/2/43", "/waku/2/rs/2/44", "/waku/2/rs/2/45", "/waku/2/rs/2/46", "/waku/2/rs/2/47", "/waku/2/rs/2/48", "/waku/2/rs/2/49"]'
2026-03-29 04:50:34.070 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 04:50:34.071 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24530/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7", "/waku/2/rs/2/8", "/waku/2/rs/2/9", "/waku/2/rs/2/10", "/waku/2/rs/2/11", "/waku/2/rs/2/12", "/waku/2/rs/2/13", "/waku/2/rs/2/14", "/waku/2/rs/2/15", "/waku/2/rs/2/16", "/waku/2/rs/2/17", "/waku/2/rs/2/18", "/waku/2/rs/2/19", "/waku/2/rs/2/20", "/waku/2/rs/2/21", "/waku/2/rs/2/22", "/waku/2/rs/2/23", "/waku/2/rs/2/24", "/waku/2/rs/2/25", "/waku/2/rs/2/26", "/waku/2/rs/2/27", "/waku/2/rs/2/28", "/waku/2/rs/2/29", "/waku/2/rs/2/30", "/waku/2/rs/2/31", "/waku/2/rs/2/32", "/waku/2/rs/2/33", "/waku/2/rs/2/34", "/waku/2/rs/2/35", "/waku/2/rs/2/36", "/waku/2/rs/2/37", "/waku/2/rs/2/38", "/waku/2/rs/2/39", "/waku/2/rs/2/40", "/waku/2/rs/2/41", "/waku/2/rs/2/42", "/waku/2/rs/2/43", "/waku/2/rs/2/44", "/waku/2/rs/2/45", "/waku/2/rs/2/46", "/waku/2/rs/2/47", "/waku/2/rs/2/48", "/waku/2/rs/2/49"]'
2026-03-29 04:50:34.188 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 04:50:34.189 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:46358/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-29 04:50:34.240 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 04:50:34.243 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-29 04:50:34.343 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-29 04:50:34.343 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46358/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:34.346 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774759833494328957,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774759833576869808,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774759834189286948,"ephemeral":false,"proof":""}]'
2026-03-29 04:50:34.354 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-29 04:50:34.355 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-29 04:50:34.355 DEBUG [src.node.waku_node] Stopping container with id bda3b87c3d2f
2026-03-29 04:50:34.819 DEBUG [src.node.waku_node] Container stopped.
2026-03-29 04:50:34.821 DEBUG [src.node.waku_node] Stopping container with id bcfd789d5442
2026-03-29 04:50:35.279 DEBUG [src.node.waku_node] Container stopped.
2026-03-29 04:50:35.283 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-29 04:50:35.328 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-29 04:50:35.378 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-29 04:50:35.381 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-29 04:50:35.381 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-29 04:50:35.384 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-29_04-50-31__ae1538b2-7157-448c-8f84-e6d5205f71c0__wakuorg_nwaku:latest.log
2026-03-29 04:50:35.388 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-29_04-50-31__ae1538b2-7157-448c-8f84-e6d5205f71c0__wakuorg_nwaku:latest.log
2026-03-29 04:50:35.401 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-29 04:50:35.402 DEBUG [tests.conftest] Running test: test_start_node_with_50_pubsub_topics with id: 2026-03-29_04-50-35__d54d4bd4-c097-410a-b7f1-e0169d520ea5
2026-03-29 04:50:35.403 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-29 04:50:35.403 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-29 04:50:35.403 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-29 04:50:35.414 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-29 04:50:35.414 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-29_04-50-35__d54d4bd4-c097-410a-b7f1-e0169d520ea5__wakuorg_nwaku:latest.log
2026-03-29 04:50:35.414 DEBUG [src.node.waku_node] Starting Node...
2026-03-29 04:50:35.415 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-29 04:50:35.416 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-29 04:50:35.418 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.160.208
2026-03-29 04:50:35.418 DEBUG [src.node.docker_mananger] Generated ports ['40213', '40214', '40215', '40216', '40217']
2026-03-29 04:50:35.418 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-29 04:50:35.418 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-29 04:50:35.418 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-29 04:50:35.419 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-29 04:50:35.419 DEBUG [src.node.waku_node] Using volumes []
2026-03-29 04:50:35.419 DEBUG [src.node.docker_mananger] docker run -i -t -p 40213:40213 -p 40214:40214 -p 40215:40215 -p 40216:40216 -p 40217:40217 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=40215 --rest-port=40213 --tcp-port=40214 --discv5-udp-port=40216 --rest-address=0.0.0.0 --nat=extip:172.18.160.208 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=a53ecdf5d6c3249e1d9d5fa43adeaf45d7ca79fdeef134cb8aa70405dad37910 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=40217 --metrics-logging=true --relay=true --filter=true
2026-03-29 04:50:35.636 ERROR [src.node.docker_mananger] Max retries reached for container bda3b87c3d2f. Exiting log stream.
2026-03-29 04:50:35.641 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.160.208 waku c3894af67322e70eafa192e649e5999db7130e1e2dbfebe934a1430f0f289eeb
2026-03-29 04:50:35.675 DEBUG [src.node.docker_mananger] Container started with ID c3894af67322. Setting up logs at ./log/docker/node1_2026-03-29_04-50-35__d54d4bd4-c097-410a-b7f1-e0169d520ea5__wakuorg_nwaku:latest.log
2026-03-29 04:50:35.676 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 40213
2026-03-29 04:50:35.676 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-29 04:50:36.354 ERROR [src.node.docker_mananger] Max retries reached for container bcfd789d5442. Exiting log stream.
2026-03-29 04:50:36.677 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:36.680 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-29 04:50:36.780 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:36.783 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-29 04:50:36.883 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:36.885 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-29 04:50:36.986 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:36.989 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-29 04:50:37.089 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:37.092 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-29 04:50:37.192 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:37.195 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-29 04:50:37.295 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:37.298 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-29 04:50:37.398 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:37.401 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-29 04:50:37.501 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:37.503 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-29 04:50:37.604 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:37.606 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-29 04:50:37.706 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:37.709 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-29 04:50:37.809 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:37.811 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-29 04:50:37.912 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:37.914 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-29 04:50:38.014 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:38.017 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-29 04:50:38.117 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:38.120 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-29 04:50:38.220 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:38.222 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-29 04:50:38.323 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:38.325 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-29 04:50:38.325 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-29 04:50:38.326 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:38.328 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.160.208/tcp/40214/p2p/16Uiu2HAm7fNQLFL9bzwdiKD97YHwXNj3PSUDK4WRsprFhj2bLmWX","/ip4/172.18.160.208/tcp/40215/ws/p2p/16Uiu2HAm7fNQLFL9bzwdiKD97YHwXNj3PSUDK4WRsprFhj2bLmWX"],"enrUri":"enr:-L24QGyvvysa8czMRUt02asHD4kw7qwe4Xe6lwat68z9_r7QUL7LHvJcXOB0hqVFd2N_o_a98P_3pfG7MRRe85CjA3wCgmlkgnY0gmlwhKwSoNCKbXVsdGlhZGRyc5YACASsEqDQBp0WAAoErBKg0AadF90DgnJzhQACAQAAiXNlY3AyNTZrMaECtc6ACuaF_hFeSg_Q3w06DOXVtl9hlF0Ykdn-ylU5ahiDdGNwgp0Wg3VkcIKdGIV3YWt1MgU"}'
2026-03-29 04:50:38.328 INFO [src.node.waku_node] REST service is ready !!
2026-03-29 04:50:38.335 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-29 04:50:38.335 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-29_04-50-35__d54d4bd4-c097-410a-b7f1-e0169d520ea5__wakuorg_nwaku:latest.log
2026-03-29 04:50:38.335 DEBUG [src.node.waku_node] Starting Node...
2026-03-29 04:50:38.335 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-29 04:50:38.337 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-29 04:50:38.337 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.31.136
2026-03-29 04:50:38.337 DEBUG [src.node.docker_mananger] Generated ports ['32512', '32513', '32514', '32515', '32516']
2026-03-29 04:50:38.337 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-29 04:50:38.337 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-29 04:50:38.337 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-29 04:50:38.338 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-29 04:50:38.338 DEBUG [src.node.waku_node] Using volumes []
2026-03-29 04:50:38.338 DEBUG [src.node.docker_mananger] docker run -i -t -p 32512:32512 -p 32513:32513 -p 32514:32514 -p 32515:32515 -p 32516:32516 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32514 --rest-port=32512 --tcp-port=32513 --discv5-udp-port=32515 --rest-address=0.0.0.0 --nat=extip:172.18.31.136 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=abecaac1a9a53b98ec81be9b78d8d44716d89c1e387bff0224a4b0db7f8fb6ef --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32516 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QGyvvysa8czMRUt02asHD4kw7qwe4Xe6lwat68z9_r7QUL7LHvJcXOB0hqVFd2N_o_a98P_3pfG7MRRe85CjA3wCgmlkgnY0gmlwhKwSoNCKbXVsdGlhZGRyc5YACASsEqDQBp0WAAoErBKg0AadF90DgnJzhQACAQAAiXNlY3AyNTZrMaECtc6ACuaF_hFeSg_Q3w06DOXVtl9hlF0Ykdn-ylU5ahiDdGNwgp0Wg3VkcIKdGIV3YWt1MgU
2026-03-29 04:50:38.547 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.31.136 waku 97cc7e0f3d15a24f79d970f8beedad1055d2ef961fa172c384ccc054f28f8d62
2026-03-29 04:50:38.582 DEBUG [src.node.docker_mananger] Container started with ID 97cc7e0f3d15. Setting up logs at ./log/docker/node2_2026-03-29_04-50-35__d54d4bd4-c097-410a-b7f1-e0169d520ea5__wakuorg_nwaku:latest.log
2026-03-29 04:50:38.582 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 32512
2026-03-29 04:50:38.583 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-29 04:50:39.583 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32512/health" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:39.588 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-29 04:50:39.589 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-29 04:50:39.589 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32512/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:39.593 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.31.136/tcp/32513/p2p/16Uiu2HAmKHP8EhXaPLTBbJfgC2bBboecMeTXqx2qPCPHbJTNc5qa","/ip4/172.18.31.136/tcp/32514/ws/p2p/16Uiu2HAmKHP8EhXaPLTBbJfgC2bBboecMeTXqx2qPCPHbJTNc5qa"],"enrUri":"enr:-L24QDiewG5QSDcSYvtCXKPaQxH8XmxP060cNwcPuWSRm-PnRnZOxYlmm2nU0t1MsbBOzFL1cWhgIRI8EWtdBQ6PrlcCgmlkgnY0gmlwhKwSH4iKbXVsdGlhZGRyc5YACASsEh-IBn8BAAoErBIfiAZ_At0DgnJzhQACAQAAiXNlY3AyNTZrMaEDYnjIS5Z3fdaWSF2-RyGMimigFWJ22FgualCY7SnlrtmDdGNwgn8Bg3VkcIJ_A4V3YWt1MgE"}'
2026-03-29 04:50:39.593 INFO [src.node.waku_node] REST service is ready !!
2026-03-29 04:50:39.593 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32512/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.160.208/tcp/40214/p2p/16Uiu2HAm7fNQLFL9bzwdiKD97YHwXNj3PSUDK4WRsprFhj2bLmWX"]'
2026-03-29 04:50:39.640 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 04:50:39.643 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:40213/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7", "/waku/2/rs/2/8", "/waku/2/rs/2/9", "/waku/2/rs/2/10", "/waku/2/rs/2/11", "/waku/2/rs/2/12", "/waku/2/rs/2/13", "/waku/2/rs/2/14", "/waku/2/rs/2/15", "/waku/2/rs/2/16", "/waku/2/rs/2/17", "/waku/2/rs/2/18", "/waku/2/rs/2/19", "/waku/2/rs/2/20", "/waku/2/rs/2/21", "/waku/2/rs/2/22", "/waku/2/rs/2/23", "/waku/2/rs/2/24", "/waku/2/rs/2/25", "/waku/2/rs/2/26", "/waku/2/rs/2/27", "/waku/2/rs/2/28", "/waku/2/rs/2/29", "/waku/2/rs/2/30", "/waku/2/rs/2/31", "/waku/2/rs/2/32", "/waku/2/rs/2/33", "/waku/2/rs/2/34", "/waku/2/rs/2/35", "/waku/2/rs/2/36", "/waku/2/rs/2/37", "/waku/2/rs/2/38", "/waku/2/rs/2/39", "/waku/2/rs/2/40", "/waku/2/rs/2/41", "/waku/2/rs/2/42", "/waku/2/rs/2/43", "/waku/2/rs/2/44", "/waku/2/rs/2/45", "/waku/2/rs/2/46", "/waku/2/rs/2/47", "/waku/2/rs/2/48", "/waku/2/rs/2/49"]'
2026-03-29 04:50:39.738 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 04:50:39.740 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32512/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7", "/waku/2/rs/2/8", "/waku/2/rs/2/9", "/waku/2/rs/2/10", "/waku/2/rs/2/11", "/waku/2/rs/2/12", "/waku/2/rs/2/13", "/waku/2/rs/2/14", "/waku/2/rs/2/15", "/waku/2/rs/2/16", "/waku/2/rs/2/17", "/waku/2/rs/2/18", "/waku/2/rs/2/19", "/waku/2/rs/2/20", "/waku/2/rs/2/21", "/waku/2/rs/2/22", "/waku/2/rs/2/23", "/waku/2/rs/2/24", "/waku/2/rs/2/25", "/waku/2/rs/2/26", "/waku/2/rs/2/27", "/waku/2/rs/2/28", "/waku/2/rs/2/29", "/waku/2/rs/2/30", "/waku/2/rs/2/31", "/waku/2/rs/2/32", "/waku/2/rs/2/33", "/waku/2/rs/2/34", "/waku/2/rs/2/35", "/waku/2/rs/2/36", "/waku/2/rs/2/37", "/waku/2/rs/2/38", "/waku/2/rs/2/39", "/waku/2/rs/2/40", "/waku/2/rs/2/41", "/waku/2/rs/2/42", "/waku/2/rs/2/43", "/waku/2/rs/2/44", "/waku/2/rs/2/45", "/waku/2/rs/2/46", "/waku/2/rs/2/47", "/waku/2/rs/2/48", "/waku/2/rs/2/49"]'
2026-03-29 04:50:39.858 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 04:50:39.860 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:40213/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-29 04:50:39.898 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-29 04:50:39.898 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-29 04:50:39.999 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-29 04:50:39.999 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40213/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-29 04:50:40.001 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774759839494275305,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774759839859735754,"ephemeral":false,"proof":""}]'
2026-03-29 04:50:40.009 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-29 04:50:40.010 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-29 04:50:40.010 DEBUG [src.node.waku_node] Stopping container with id c3894af67322
2026-03-29 04:50:40.489 DEBUG [src.node.waku_node] Container stopped.
2026-03-29 04:50:40.490 DEBUG [src.node.waku_node] Stopping container with id 97cc7e0f3d15
2026-03-29 04:50:40.958 DEBUG [src.node.waku_node] Container stopped.
2026-03-29 04:50:40.959 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-29 04:50:41.009 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-29 04:50:41.051 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-29 04:50:41.053 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-29 04:50:41.053 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-29 04:50:41.055 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-29_04-50-35__d54d4bd4-c097-410a-b7f1-e0169d520ea5__wakuorg_nwaku:latest.log
2026-03-29 04:50:41.057 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-29_04-50-35__d54d4bd4-c097-410a-b7f1-e0169d520ea5__wakuorg_nwaku:latest.log