188 lines
32 KiB
Plaintext

2026-03-05 04:34:03.140 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-05 04:34:03.140 DEBUG [tests.conftest] Running test: test_single_content_topic[/app/27/sometopic/someencoding] with id: 2026-03-05_04-34-03__c6905ff8-72d1-4f66-a8a3-772796479c5a
2026-03-05 04:34:03.141 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-05 04:34:03.141 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-05 04:34:03.141 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-05 04:34:03.149 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:34:03.149 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-05_04-34-03__c6905ff8-72d1-4f66-a8a3-772796479c5a__wakuorg_nwaku:latest.log
2026-03-05 04:34:03.149 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:34:03.149 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:34:03.151 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:34:03.151 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.118.33
2026-03-05 04:34:03.151 DEBUG [src.node.docker_mananger] Generated ports ['32472', '32473', '32474', '32475', '32476']
2026-03-05 04:34:03.151 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:34:03.152 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:34:03.152 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:34:03.152 DEBUG [src.node.docker_mananger] docker run -i -t -p 32472:32472 -p 32473:32473 -p 32474:32474 -p 32475:32475 -p 32476:32476 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32474 --rest-port=32472 --tcp-port=32473 --discv5-udp-port=32475 --rest-address=0.0.0.0 --nat=extip:172.18.118.33 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=ee00acc30acfd83fe07964fdcb1d39b5fdaea3ae105a061aca203d6f32afcd79 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32476 --metrics-logging=true --relay=true --filter=true --content-topic=/app/27/sometopic/someencoding
2026-03-05 04:34:03.338 ERROR [src.node.docker_mananger] Max retries reached for container 0d12a57ccb64. Exiting log stream.
2026-03-05 04:34:03.348 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.118.33 waku 94437daacdd0671cb407bb6db5b005db6838388d4b47e6d411dd9d422aef27ec
2026-03-05 04:34:03.384 DEBUG [src.node.docker_mananger] Container started with ID 94437daacdd0. Setting up logs at ./log/docker/node1_2026-03-05_04-34-03__c6905ff8-72d1-4f66-a8a3-772796479c5a__wakuorg_nwaku:latest.log
2026-03-05 04:34:03.384 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 32472
2026-03-05 04:34:03.385 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:34:03.920 ERROR [src.node.docker_mananger] Max retries reached for container 97fab3626a3a. Exiting log stream.
2026-03-05 04:34:04.385 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32472/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:04.388 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:04.489 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32472/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:04.491 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:04.592 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32472/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:04.594 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:34:04.595 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:34:04.595 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32472/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:04.597 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.118.33/tcp/32473/p2p/16Uiu2HAmQzC1KXZ2Y1H6WgcbpA2KoKiQscSoSfi52wkj4HQCHB74","/ip4/172.18.118.33/tcp/32474/ws/p2p/16Uiu2HAmQzC1KXZ2Y1H6WgcbpA2KoKiQscSoSfi52wkj4HQCHB74"],"enrUri":"enr:-L24QG03XE_XqKSxO0NPr2S0wEm3-zABwNS2n4UgK2jX-5aqUgdTtIybN_toGKeE0uRVC8_SYWdFEwPwnMIc45XLI9QCgmlkgnY0gmlwhKwSdiGKbXVsdGlhZGRyc5YACASsEnYhBn7ZAAoErBJ2IQZ-2t0DgnJzhQACAQAAiXNlY3AyNTZrMaEDtzd1JvxRfCFm5wPJCfcR2ptWbxa5B5CnbeRIx1KzU9eDdGNwgn7Zg3VkcIJ-24V3YWt1MgU"}'
2026-03-05 04:34:04.598 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:34:04.605 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:34:04.605 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-05_04-34-03__c6905ff8-72d1-4f66-a8a3-772796479c5a__wakuorg_nwaku:latest.log
2026-03-05 04:34:04.605 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:34:04.605 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:34:04.607 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:34:04.607 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.50.197
2026-03-05 04:34:04.607 DEBUG [src.node.docker_mananger] Generated ports ['54085', '54086', '54087', '54088', '54089']
2026-03-05 04:34:04.607 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:34:04.607 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:34:04.607 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:34:04.608 DEBUG [src.node.docker_mananger] docker run -i -t -p 54085:54085 -p 54086:54086 -p 54087:54087 -p 54088:54088 -p 54089:54089 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=54087 --rest-port=54085 --tcp-port=54086 --discv5-udp-port=54088 --rest-address=0.0.0.0 --nat=extip:172.18.50.197 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=19bfaedd801e0321addafe7471dfbfb0faac149e1cad3a4b8a4ddd46c0d2c0eb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=54089 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QG03XE_XqKSxO0NPr2S0wEm3-zABwNS2n4UgK2jX-5aqUgdTtIybN_toGKeE0uRVC8_SYWdFEwPwnMIc45XLI9QCgmlkgnY0gmlwhKwSdiGKbXVsdGlhZGRyc5YACASsEnYhBn7ZAAoErBJ2IQZ-2t0DgnJzhQACAQAAiXNlY3AyNTZrMaEDtzd1JvxRfCFm5wPJCfcR2ptWbxa5B5CnbeRIx1KzU9eDdGNwgn7Zg3VkcIJ-24V3YWt1MgU --content-topic=/app/27/sometopic/someencoding
2026-03-05 04:34:04.808 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.50.197 waku 910a10b877c84c77711adcef01ba6414c794cbcb40799eb60008cd52512b01cc
2026-03-05 04:34:04.843 DEBUG [src.node.docker_mananger] Container started with ID 910a10b877c8. Setting up logs at ./log/docker/node2_2026-03-05_04-34-03__c6905ff8-72d1-4f66-a8a3-772796479c5a__wakuorg_nwaku:latest.log
2026-03-05 04:34:04.843 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 54085
2026-03-05 04:34:04.843 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:34:05.844 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54085/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:05.871 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:05.972 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54085/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:05.977 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:34:05.978 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:34:05.979 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54085/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:05.987 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.50.197/tcp/54086/p2p/16Uiu2HAm81koXDevqU7DhBDW9gSSmsbmwKrXcSCf9hPdX8MMG7NN","/ip4/172.18.50.197/tcp/54087/ws/p2p/16Uiu2HAm81koXDevqU7DhBDW9gSSmsbmwKrXcSCf9hPdX8MMG7NN"],"enrUri":"enr:-L24QEN5Mhm4QNdxs20hY9ksdy2m-x0Cd5jDo54vF-AO9UDIUWrdBO06HO4dBcpnZNpF1eZFvi94Za4qeyGhgi9I2v0CgmlkgnY0gmlwhKwSMsWKbXVsdGlhZGRyc5YACASsEjLFBtNGAAoErBIyxQbTR90DgnJzhQACAQAAiXNlY3AyNTZrMaECuwdxoz8KAO_XFKnu3Ebo518IlLRzActsyt_WlMdTuIeDdGNwgtNGg3VkcILTSIV3YWt1MgE"}'
2026-03-05 04:34:05.988 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:34:05.992 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54085/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.118.33/tcp/32473/p2p/16Uiu2HAmQzC1KXZ2Y1H6WgcbpA2KoKiQscSoSfi52wkj4HQCHB74"]'
2026-03-05 04:34:06.029 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:06.031 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32472/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/27/sometopic/someencoding"]'
2026-03-05 04:34:06.037 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:06.039 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54085/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/27/sometopic/someencoding"]'
2026-03-05 04:34:06.043 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:06.044 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32472/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/27/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:34:06.055 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:06.055 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-05 04:34:06.156 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-05 04:34:06.156 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32472/relay/v1/auto/messages/%2Fapp%2F27%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:06.159 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/27/sometopic/someencoding","version":0,"timestamp":1772685243640870286,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/27/sometopic/someencoding","version":0,"timestamp":1772685246044451299,"ephemeral":false,"proof":""}]'
2026-03-05 04:34:06.205 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-05 04:34:06.206 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-05 04:34:06.206 DEBUG [src.node.waku_node] Stopping container with id 94437daacdd0
2026-03-05 04:34:06.838 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:34:06.838 DEBUG [src.node.waku_node] Stopping container with id 910a10b877c8
2026-03-05 04:34:07.411 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:34:07.412 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-05 04:34:07.462 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:34:07.500 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:34:07.501 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-05 04:34:07.502 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-05 04:34:07.502 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-05_04-34-03__c6905ff8-72d1-4f66-a8a3-772796479c5a__wakuorg_nwaku:latest.log
2026-03-05 04:34:07.503 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-05_04-34-03__c6905ff8-72d1-4f66-a8a3-772796479c5a__wakuorg_nwaku:latest.log
2026-03-05 04:34:07.508 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-05 04:34:07.508 DEBUG [tests.conftest] Running test: test_single_content_topic[/app/27/sometopic/someencoding] with id: 2026-03-05_04-34-07__c3431a34-5557-40a5-8355-1da471b2005c
2026-03-05 04:34:07.508 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-05 04:34:07.509 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-05 04:34:07.509 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-05 04:34:07.516 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:34:07.517 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-05_04-34-07__c3431a34-5557-40a5-8355-1da471b2005c__wakuorg_nwaku:latest.log
2026-03-05 04:34:07.517 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:34:07.517 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:34:07.519 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:34:07.519 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.143.252
2026-03-05 04:34:07.519 DEBUG [src.node.docker_mananger] Generated ports ['43130', '43131', '43132', '43133', '43134']
2026-03-05 04:34:07.519 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:34:07.519 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:34:07.519 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:34:07.520 DEBUG [src.node.docker_mananger] docker run -i -t -p 43130:43130 -p 43131:43131 -p 43132:43132 -p 43133:43133 -p 43134:43134 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=43132 --rest-port=43130 --tcp-port=43131 --discv5-udp-port=43133 --rest-address=0.0.0.0 --nat=extip:172.18.143.252 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=8dc4714f8541ecd1c6446eae2c7826efedc8b6fa51d35f6cbe3cabafbc27cc85 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=43134 --metrics-logging=true --relay=true --filter=true --content-topic=/app/27/sometopic/someencoding
2026-03-05 04:34:07.704 ERROR [src.node.docker_mananger] Max retries reached for container 94437daacdd0. Exiting log stream.
2026-03-05 04:34:07.720 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.143.252 waku 0a826c1ec876ccc3c176e9e14a181d8009d05f620aed3946feb2ea21111ec80a
2026-03-05 04:34:07.755 DEBUG [src.node.docker_mananger] Container started with ID 0a826c1ec876. Setting up logs at ./log/docker/node1_2026-03-05_04-34-07__c3431a34-5557-40a5-8355-1da471b2005c__wakuorg_nwaku:latest.log
2026-03-05 04:34:07.755 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 43130
2026-03-05 04:34:07.755 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:34:08.274 ERROR [src.node.docker_mananger] Max retries reached for container 910a10b877c8. Exiting log stream.
2026-03-05 04:34:08.756 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43130/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:08.761 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:08.862 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43130/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:08.864 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:08.965 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43130/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:08.967 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:09.067 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43130/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:09.070 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:09.170 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43130/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:09.173 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:09.273 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43130/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:09.320 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:09.421 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43130/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:09.424 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:34:09.424 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:34:09.424 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43130/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:09.427 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.143.252/tcp/43131/p2p/16Uiu2HAm2JbMReS8B92T56iJAtm3LLnYwpmnErhc3fUCMS9YngNq","/ip4/172.18.143.252/tcp/43132/ws/p2p/16Uiu2HAm2JbMReS8B92T56iJAtm3LLnYwpmnErhc3fUCMS9YngNq"],"enrUri":"enr:-L24QAs7_heBOnzYCrHnvXP2wLNGEFU8CmK6_nx7L1Oct6HMOQnaecVzE3zAsP1hz3ygOg-6W5mZMEP33s_HopWRq-wCgmlkgnY0gmlwhKwSj_yKbXVsdGlhZGRyc5YACASsEo_8Bqh7AAoErBKP_AaofN0DgnJzhQACAQAAiXNlY3AyNTZrMaECZjGC0kAIPJjnCZfByKOUqCB5Tp-p_MPdcie6JZ3YD6aDdGNwgqh7g3VkcIKofYV3YWt1MgU"}'
2026-03-05 04:34:09.427 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:34:09.434 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-05 04:34:09.434 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-05_04-34-07__c3431a34-5557-40a5-8355-1da471b2005c__wakuorg_nwaku:latest.log
2026-03-05 04:34:09.434 DEBUG [src.node.waku_node] Starting Node...
2026-03-05 04:34:09.434 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-05 04:34:09.436 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-05 04:34:09.436 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.120.14
2026-03-05 04:34:09.436 DEBUG [src.node.docker_mananger] Generated ports ['32117', '32118', '32119', '32120', '32121']
2026-03-05 04:34:09.436 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-05 04:34:09.436 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-05 04:34:09.436 DEBUG [src.node.waku_node] Using volumes []
2026-03-05 04:34:09.436 DEBUG [src.node.docker_mananger] docker run -i -t -p 32117:32117 -p 32118:32118 -p 32119:32119 -p 32120:32120 -p 32121:32121 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32119 --rest-port=32117 --tcp-port=32118 --discv5-udp-port=32120 --rest-address=0.0.0.0 --nat=extip:172.18.120.14 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=a0cb390b0e03975ecad79c04f071da9bdcdda8ac3dc4161dade1642efcedb920 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32121 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAs7_heBOnzYCrHnvXP2wLNGEFU8CmK6_nx7L1Oct6HMOQnaecVzE3zAsP1hz3ygOg-6W5mZMEP33s_HopWRq-wCgmlkgnY0gmlwhKwSj_yKbXVsdGlhZGRyc5YACASsEo_8Bqh7AAoErBKP_AaofN0DgnJzhQACAQAAiXNlY3AyNTZrMaECZjGC0kAIPJjnCZfByKOUqCB5Tp-p_MPdcie6JZ3YD6aDdGNwgqh7g3VkcIKofYV3YWt1MgU --content-topic=/app/27/sometopic/someencoding
2026-03-05 04:34:09.630 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.120.14 waku 8dc421ee42c3a29b92a68d5a9862c4a76c3449075ac95dcf373bde6055f17375
2026-03-05 04:34:09.662 DEBUG [src.node.docker_mananger] Container started with ID 8dc421ee42c3. Setting up logs at ./log/docker/node2_2026-03-05_04-34-07__c3431a34-5557-40a5-8355-1da471b2005c__wakuorg_nwaku:latest.log
2026-03-05 04:34:09.663 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 32117
2026-03-05 04:34:09.664 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-05 04:34:10.664 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32117/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:10.667 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:10.768 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32117/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:10.770 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:10.871 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32117/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:10.874 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:10.974 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32117/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:10.979 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:11.080 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32117/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:11.084 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:11.185 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32117/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:11.188 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:11.288 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32117/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:11.291 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:11.391 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32117/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:11.394 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:11.494 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32117/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:11.497 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:11.598 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32117/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:11.600 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:11.701 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32117/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:11.740 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-05 04:34:11.840 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32117/health" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:11.843 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-05 04:34:11.843 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-05 04:34:11.844 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32117/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:11.846 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.120.14/tcp/32118/p2p/16Uiu2HAmM7WPBaGdVVHqH1qa5U1doCaUjq1gznYsFejDi6Zp6YW7","/ip4/172.18.120.14/tcp/32119/ws/p2p/16Uiu2HAmM7WPBaGdVVHqH1qa5U1doCaUjq1gznYsFejDi6Zp6YW7"],"enrUri":"enr:-L24QBOb8pe_cpcGWCZgURBJ10gTuzxfD7BXAEZn5YrPuaGZD2V5zSqva2FbQ--grKX3ulxqYJ8xS8M2XIP0zvwqDXUCgmlkgnY0gmlwhKwSeA6KbXVsdGlhZGRyc5YACASsEngOBn12AAoErBJ4DgZ9d90DgnJzhQACAQAAiXNlY3AyNTZrMaEDfaiN8VHT2yRwkuSK6pfVhYNn_hLuE793EjKYQMrVvGyDdGNwgn12g3VkcIJ9eIV3YWt1MgE"}'
2026-03-05 04:34:11.846 INFO [src.node.waku_node] REST service is ready !!
2026-03-05 04:34:11.847 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32117/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.143.252/tcp/43131/p2p/16Uiu2HAm2JbMReS8B92T56iJAtm3LLnYwpmnErhc3fUCMS9YngNq"]'
2026-03-05 04:34:11.876 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:11.877 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43130/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/27/sometopic/someencoding"]'
2026-03-05 04:34:11.883 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:11.884 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32117/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/27/sometopic/someencoding"]'
2026-03-05 04:34:11.889 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:11.890 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43130/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/27/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-05 04:34:11.900 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-05 04:34:11.901 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-05 04:34:12.002 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-05 04:34:12.002 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43130/relay/v1/auto/messages/%2Fapp%2F27%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:12.005 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/27/sometopic/someencoding","version":0,"timestamp":1772685251890391578,"ephemeral":false,"proof":""}]'
2026-03-05 04:34:12.007 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-05 04:34:12.007 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32117/relay/v1/auto/messages/%2Fapp%2F27%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-05 04:34:12.010 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/27/sometopic/someencoding","version":0,"timestamp":1772685251890391578,"ephemeral":false,"proof":""}]'
2026-03-05 04:34:12.013 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-05 04:34:12.014 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-05 04:34:12.014 DEBUG [src.node.waku_node] Stopping container with id 0a826c1ec876
2026-03-05 04:34:12.621 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:34:12.623 DEBUG [src.node.waku_node] Stopping container with id 8dc421ee42c3
2026-03-05 04:34:13.240 DEBUG [src.node.waku_node] Container stopped.
2026-03-05 04:34:13.243 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-05 04:34:13.283 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-05 04:34:13.314 DEBUG [src.node.docker_mananger] No errors found in the waku logs.