273 lines
46 KiB
Plaintext

2026-03-21 04:32:37.512 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-21 04:32:37.512 DEBUG [tests.conftest] Running test: test_subscribe_one_by_one_to_different_pubsub_topics_and_send_messages with id: 2026-03-21_04-32-37__83c1d878-eeb2-42cd-8611-fba23da1732b
2026-03-21 04:32:37.512 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-21 04:32:37.512 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-21 04:32:37.513 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-21 04:32:37.520 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-21 04:32:37.520 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-21_04-32-37__83c1d878-eeb2-42cd-8611-fba23da1732b__wakuorg_nwaku:latest.log
2026-03-21 04:32:37.520 DEBUG [src.node.waku_node] Starting Node...
2026-03-21 04:32:37.520 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-21 04:32:37.522 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-21 04:32:37.522 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.117.158
2026-03-21 04:32:37.522 DEBUG [src.node.docker_mananger] Generated ports ['12499', '12500', '12501', '12502', '12503']
2026-03-21 04:32:37.522 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-21 04:32:37.522 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-21 04:32:37.522 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-21 04:32:37.523 DEBUG [src.node.waku_node] Using volumes []
2026-03-21 04:32:37.523 DEBUG [src.node.docker_mananger] docker run -i -t -p 12499:12499 -p 12500:12500 -p 12501:12501 -p 12502:12502 -p 12503:12503 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=12501 --rest-port=12499 --tcp-port=12500 --discv5-udp-port=12502 --rest-address=0.0.0.0 --nat=extip:172.18.117.158 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=4c8e6eecc04ae21ba406bece2b58cb69eaac5fdac1f138140d04dcfa7ad1965a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=12503 --metrics-logging=true --relay=true --filter=true
2026-03-21 04:32:37.707 ERROR [src.node.docker_mananger] Max retries reached for container 520f7727dda7. Exiting log stream.
2026-03-21 04:32:37.716 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.117.158 waku 4088a72a406d0f954db595876a7f763083e07be2bd279e7a1ac4330e0643cd86
2026-03-21 04:32:37.753 DEBUG [src.node.docker_mananger] Container started with ID 4088a72a406d. Setting up logs at ./log/docker/node1_2026-03-21_04-32-37__83c1d878-eeb2-42cd-8611-fba23da1732b__wakuorg_nwaku:latest.log
2026-03-21 04:32:37.755 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 12499
2026-03-21 04:32:37.755 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-21 04:32:38.231 ERROR [src.node.docker_mananger] Max retries reached for container 550a93c13aa2. Exiting log stream.
2026-03-21 04:32:38.755 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12499/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:38.758 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:38.858 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12499/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:38.861 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:38.961 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12499/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:38.964 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:39.065 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12499/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:39.068 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:39.169 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12499/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:39.171 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:39.272 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12499/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:39.280 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:39.380 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12499/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:39.383 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:39.484 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12499/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:39.524 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:39.625 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12499/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:39.627 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-21 04:32:39.628 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-21 04:32:39.628 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12499/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:39.630 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.117.158/tcp/12500/p2p/16Uiu2HAmCVibdkLShnW6Yemc7EMLTzPS7azfhf3TD2ca9U55mPf5","/ip4/172.18.117.158/tcp/12501/ws/p2p/16Uiu2HAmCVibdkLShnW6Yemc7EMLTzPS7azfhf3TD2ca9U55mPf5"],"enrUri":"enr:-L24QAZJOVrhlbk9iHKLFCeP7PyYuPqGfZOICdWknVpxk53KA6oxD_NVli7yfDca3pv73WYFVb2SvfFUnisbN1dm5XICgmlkgnY0gmlwhKwSdZ6KbXVsdGlhZGRyc5YACASsEnWeBjDUAAoErBJ1ngYw1d0DgnJzhQACAQAAiXNlY3AyNTZrMaEC_Z_2Cv-3o-EopFqgyLJX0dR-k-NiR6VVjBEJKZEYYxiDdGNwgjDUg3VkcIIw1oV3YWt1MgU"}'
2026-03-21 04:32:39.630 INFO [src.node.waku_node] REST service is ready !!
2026-03-21 04:32:39.637 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-21 04:32:39.637 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-21_04-32-37__83c1d878-eeb2-42cd-8611-fba23da1732b__wakuorg_nwaku:latest.log
2026-03-21 04:32:39.637 DEBUG [src.node.waku_node] Starting Node...
2026-03-21 04:32:39.637 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-21 04:32:39.639 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-21 04:32:39.639 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.1.168
2026-03-21 04:32:39.639 DEBUG [src.node.docker_mananger] Generated ports ['4597', '4598', '4599', '4600', '4601']
2026-03-21 04:32:39.639 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-21 04:32:39.639 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-21 04:32:39.639 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-21 04:32:39.639 DEBUG [src.node.waku_node] Using volumes []
2026-03-21 04:32:39.640 DEBUG [src.node.docker_mananger] docker run -i -t -p 4597:4597 -p 4598:4598 -p 4599:4599 -p 4600:4600 -p 4601:4601 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=4599 --rest-port=4597 --tcp-port=4598 --discv5-udp-port=4600 --rest-address=0.0.0.0 --nat=extip:172.18.1.168 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=4c6d35589b137bde1d7b70cdab20043cec239070ac57adbdafc1dea4db263b84 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=4601 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAZJOVrhlbk9iHKLFCeP7PyYuPqGfZOICdWknVpxk53KA6oxD_NVli7yfDca3pv73WYFVb2SvfFUnisbN1dm5XICgmlkgnY0gmlwhKwSdZ6KbXVsdGlhZGRyc5YACASsEnWeBjDUAAoErBJ1ngYw1d0DgnJzhQACAQAAiXNlY3AyNTZrMaEC_Z_2Cv-3o-EopFqgyLJX0dR-k-NiR6VVjBEJKZEYYxiDdGNwgjDUg3VkcIIw1oV3YWt1MgU
2026-03-21 04:32:39.849 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.1.168 waku d1faa1641ca1da5fefa549a6e7f71b3f59336db48b1f2e18c9d9b4d0adfcb918
2026-03-21 04:32:39.889 DEBUG [src.node.docker_mananger] Container started with ID d1faa1641ca1. Setting up logs at ./log/docker/node2_2026-03-21_04-32-37__83c1d878-eeb2-42cd-8611-fba23da1732b__wakuorg_nwaku:latest.log
2026-03-21 04:32:39.890 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 4597
2026-03-21 04:32:39.890 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-21 04:32:40.890 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4597/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:40.893 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:40.994 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4597/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:40.997 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:41.097 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4597/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:41.100 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-21 04:32:41.100 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-21 04:32:41.100 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4597/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:41.102 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.1.168/tcp/4598/p2p/16Uiu2HAm9b5PZYJizm9chk338uU6z5MAYoLdrTG3wV4AkL91Z6V1","/ip4/172.18.1.168/tcp/4599/ws/p2p/16Uiu2HAm9b5PZYJizm9chk338uU6z5MAYoLdrTG3wV4AkL91Z6V1"],"enrUri":"enr:-L24QNhZ8sworveoyyhYYBsN41aWOvS8sgiQhVSImr90aa2gHixjPDqu1xsyv-haYsB5CPr_-t9g18WDIU8IKj9nGY0CgmlkgnY0gmlwhKwSAaiKbXVsdGlhZGRyc5YACASsEgGoBhH2AAoErBIBqAYR990DgnJzhQACAQAAiXNlY3AyNTZrMaEC0mxQVNXNedpLSAXaLc9Gd-4nEXPXiJKhlsAzt1s9q0yDdGNwghH2g3VkcIIR-IV3YWt1MgE"}'
2026-03-21 04:32:41.103 INFO [src.node.waku_node] REST service is ready !!
2026-03-21 04:32:41.103 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:4597/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.117.158/tcp/12500/p2p/16Uiu2HAmCVibdkLShnW6Yemc7EMLTzPS7azfhf3TD2ca9U55mPf5"]'
2026-03-21 04:32:41.129 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:41.130 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12499/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-03-21 04:32:41.137 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:41.139 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:4597/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-03-21 04:32:41.148 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:41.149 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12499/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:41.159 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:41.160 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-21 04:32:41.263 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:41.263 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12499/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:41.266 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067560582360581,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067561149087369,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:41.277 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-21 04:32:41.281 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-21 04:32:41.281 DEBUG [src.node.waku_node] Stopping container with id 4088a72a406d
2026-03-21 04:32:41.886 DEBUG [src.node.waku_node] Container stopped.
2026-03-21 04:32:41.886 DEBUG [src.node.waku_node] Stopping container with id d1faa1641ca1
2026-03-21 04:32:42.457 DEBUG [src.node.waku_node] Container stopped.
2026-03-21 04:32:42.459 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-21 04:32:42.510 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-21 04:32:42.543 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-21 04:32:42.544 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-21 04:32:42.545 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-21 04:32:42.550 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-21_04-32-37__83c1d878-eeb2-42cd-8611-fba23da1732b__wakuorg_nwaku:latest.log
2026-03-21 04:32:42.554 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-21_04-32-37__83c1d878-eeb2-42cd-8611-fba23da1732b__wakuorg_nwaku:latest.log
2026-03-21 04:32:42.568 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-21 04:32:42.569 DEBUG [tests.conftest] Running test: test_subscribe_one_by_one_to_different_pubsub_topics_and_send_messages with id: 2026-03-21_04-32-42__16466de5-988c-4201-a17e-d41c1edee963
2026-03-21 04:32:42.570 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-21 04:32:42.570 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-21 04:32:42.570 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-21 04:32:42.580 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-21 04:32:42.581 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-21_04-32-42__16466de5-988c-4201-a17e-d41c1edee963__wakuorg_nwaku:latest.log
2026-03-21 04:32:42.581 DEBUG [src.node.waku_node] Starting Node...
2026-03-21 04:32:42.582 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-21 04:32:42.585 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-21 04:32:42.585 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.153.78
2026-03-21 04:32:42.585 DEBUG [src.node.docker_mananger] Generated ports ['44355', '44356', '44357', '44358', '44359']
2026-03-21 04:32:42.586 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-21 04:32:42.586 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-21 04:32:42.586 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-21 04:32:42.586 DEBUG [src.node.waku_node] Using volumes []
2026-03-21 04:32:42.586 DEBUG [src.node.docker_mananger] docker run -i -t -p 44355:44355 -p 44356:44356 -p 44357:44357 -p 44358:44358 -p 44359:44359 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=44357 --rest-port=44355 --tcp-port=44356 --discv5-udp-port=44358 --rest-address=0.0.0.0 --nat=extip:172.18.153.78 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=da35c13df8da6eac811dec2a17ac3ef74cc22c25a9af90b1099ed8b7076e2880 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=44359 --metrics-logging=true --relay=true --filter=true
2026-03-21 04:32:42.753 ERROR [src.node.docker_mananger] Max retries reached for container 4088a72a406d. Exiting log stream.
2026-03-21 04:32:42.802 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.153.78 waku 2cad5a0d2d16be5664ee90e276c49298a8df1195ade527b043ec1a46ede42ca2
2026-03-21 04:32:42.838 DEBUG [src.node.docker_mananger] Container started with ID 2cad5a0d2d16. Setting up logs at ./log/docker/node1_2026-03-21_04-32-42__16466de5-988c-4201-a17e-d41c1edee963__wakuorg_nwaku:latest.log
2026-03-21 04:32:42.838 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 44355
2026-03-21 04:32:42.838 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-21 04:32:43.507 ERROR [src.node.docker_mananger] Max retries reached for container d1faa1641ca1. Exiting log stream.
2026-03-21 04:32:43.839 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44355/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:43.841 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:43.942 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44355/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:43.967 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:44.068 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44355/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:44.073 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-21 04:32:44.073 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-21 04:32:44.074 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44355/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:44.078 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.153.78/tcp/44356/p2p/16Uiu2HAmEzkBqpgjqaxBR39tybPH2rEuAi3hW1v95B892CBG2bSf","/ip4/172.18.153.78/tcp/44357/ws/p2p/16Uiu2HAmEzkBqpgjqaxBR39tybPH2rEuAi3hW1v95B892CBG2bSf"],"enrUri":"enr:-L24QLdQ3gYgZk7myv0sOz4ixJIGPyTfRCi8yT_m9pRBtnHCNdDsOhGubQpiPltAGYgGPOdkwvupUPaJWXXS7VYUxv0CgmlkgnY0gmlwhKwSmU6KbXVsdGlhZGRyc5YACASsEplOBq1EAAoErBKZTgatRd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDIsb528WQKKpQsc4Q8lzIyaSZxJ02p7A9Dtns2q5X0DCDdGNwgq1Eg3VkcIKtRoV3YWt1MgU"}'
2026-03-21 04:32:44.078 INFO [src.node.waku_node] REST service is ready !!
2026-03-21 04:32:44.087 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-21 04:32:44.087 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-21_04-32-42__16466de5-988c-4201-a17e-d41c1edee963__wakuorg_nwaku:latest.log
2026-03-21 04:32:44.087 DEBUG [src.node.waku_node] Starting Node...
2026-03-21 04:32:44.087 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-21 04:32:44.088 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-21 04:32:44.089 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.220.69
2026-03-21 04:32:44.089 DEBUG [src.node.docker_mananger] Generated ports ['56296', '56297', '56298', '56299', '56300']
2026-03-21 04:32:44.089 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-21 04:32:44.089 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-21 04:32:44.089 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-21 04:32:44.089 DEBUG [src.node.waku_node] Using volumes []
2026-03-21 04:32:44.089 DEBUG [src.node.docker_mananger] docker run -i -t -p 56296:56296 -p 56297:56297 -p 56298:56298 -p 56299:56299 -p 56300:56300 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=56298 --rest-port=56296 --tcp-port=56297 --discv5-udp-port=56299 --rest-address=0.0.0.0 --nat=extip:172.18.220.69 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=cebafce89aded954b4c23b960acb32ebaeed33c3441d90b817a9a0e2220b2ec4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=56300 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QLdQ3gYgZk7myv0sOz4ixJIGPyTfRCi8yT_m9pRBtnHCNdDsOhGubQpiPltAGYgGPOdkwvupUPaJWXXS7VYUxv0CgmlkgnY0gmlwhKwSmU6KbXVsdGlhZGRyc5YACASsEplOBq1EAAoErBKZTgatRd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDIsb528WQKKpQsc4Q8lzIyaSZxJ02p7A9Dtns2q5X0DCDdGNwgq1Eg3VkcIKtRoV3YWt1MgU
2026-03-21 04:32:44.311 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.220.69 waku efbed055f056c575100dc7e2fa24c6c1d7782d400d7abbcee5e944c7cb8927fc
2026-03-21 04:32:44.351 DEBUG [src.node.docker_mananger] Container started with ID efbed055f056. Setting up logs at ./log/docker/node2_2026-03-21_04-32-42__16466de5-988c-4201-a17e-d41c1edee963__wakuorg_nwaku:latest.log
2026-03-21 04:32:44.352 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 56296
2026-03-21 04:32:44.353 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-21 04:32:45.353 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56296/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:45.356 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:45.456 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56296/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:45.459 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:45.560 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56296/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:45.571 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-21 04:32:45.672 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56296/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:45.674 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-21 04:32:45.675 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-21 04:32:45.675 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56296/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:45.677 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.220.69/tcp/56297/p2p/16Uiu2HAm8u9WZsYfPJ9qRgdLPmBYWvFs7hxagqkG8ee87bqhLZ7d","/ip4/172.18.220.69/tcp/56298/ws/p2p/16Uiu2HAm8u9WZsYfPJ9qRgdLPmBYWvFs7hxagqkG8ee87bqhLZ7d"],"enrUri":"enr:-L24QG7zpwzlwd70fA-917iv8kMkG5f_nJqeH69hWBCqoWCabTjFqpIuZDYspqMT74zCVmzIv5uD4cEOWhBGJ0heg4oCgmlkgnY0gmlwhKwS3EWKbXVsdGlhZGRyc5YACASsEtxFBtvpAAoErBLcRQbb6t0DgnJzhQACAQAAiXNlY3AyNTZrMaECyDG9pnx38e2kOZI-7j4E3QzN3xIf7hkfVLmDRJnVh_iDdGNwgtvpg3VkcILb64V3YWt1MgE"}'
2026-03-21 04:32:45.677 INFO [src.node.waku_node] REST service is ready !!
2026-03-21 04:32:45.678 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56296/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.153.78/tcp/44356/p2p/16Uiu2HAmEzkBqpgjqaxBR39tybPH2rEuAi3hW1v95B892CBG2bSf"]'
2026-03-21 04:32:45.700 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:45.703 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44355/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-03-21 04:32:45.711 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:45.711 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56296/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-03-21 04:32:45.715 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:45.717 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:45.732 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:45.733 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-21 04:32:45.833 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:45.833 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:45.836 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067565717059487,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:45.838 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:45.838 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56296/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:45.841 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067565717059487,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:45.843 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44355/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/1"]'
2026-03-21 04:32:45.845 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:45.845 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56296/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/1"]'
2026-03-21 04:32:45.848 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:45.848 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:45.857 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:45.857 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-21 04:32:45.958 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:45.959 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:45.961 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067565848637226,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:45.963 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:45.963 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56296/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:45.965 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067565848637226,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:45.967 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44355/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/2"]'
2026-03-21 04:32:45.969 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:45.970 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56296/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/2"]'
2026-03-21 04:32:45.972 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:45.973 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:45.981 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:45.981 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-21 04:32:46.082 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:46.082 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:46.085 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067565972875127,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:46.087 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:46.087 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56296/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:46.091 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067565972875127,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:46.092 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44355/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/3"]'
2026-03-21 04:32:46.095 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:46.095 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56296/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/3"]'
2026-03-21 04:32:46.097 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:46.098 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:46.107 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:46.108 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-21 04:32:46.208 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:46.208 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:46.211 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067566098386241,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:46.213 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:46.213 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56296/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:46.215 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067566098386241,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:46.217 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44355/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/4"]'
2026-03-21 04:32:46.220 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:46.220 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56296/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/4"]'
2026-03-21 04:32:46.223 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:46.223 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:46.232 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:46.232 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-21 04:32:46.333 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:46.335 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:46.338 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067566223708785,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:46.340 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:46.340 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56296/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:46.344 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067566223708785,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:46.345 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44355/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/5"]'
2026-03-21 04:32:46.348 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:46.349 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56296/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/5"]'
2026-03-21 04:32:46.351 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:46.352 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:46.362 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:46.362 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-21 04:32:46.462 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:46.463 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:46.465 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067566352113681,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:46.467 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:46.467 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56296/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:46.469 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067566352113681,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:46.472 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44355/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/6"]'
2026-03-21 04:32:46.476 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:46.476 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56296/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/6"]'
2026-03-21 04:32:46.478 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:46.479 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:46.487 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:46.487 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-21 04:32:46.588 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:46.588 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:46.591 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067566479140870,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:46.592 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:46.593 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56296/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:46.597 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067566479140870,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:46.598 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44355/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/7"]'
2026-03-21 04:32:46.600 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:46.601 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56296/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/7"]'
2026-03-21 04:32:46.603 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:46.604 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:46.612 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:46.613 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-21 04:32:46.714 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:46.714 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44355/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:46.716 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067566603944571,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:46.718 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-21 04:32:46.718 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56296/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:32:46.721 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1774067566603944571,"ephemeral":false,"proof":""}]'
2026-03-21 04:32:46.723 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-21 04:32:46.725 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-21 04:32:46.725 DEBUG [src.node.waku_node] Stopping container with id 2cad5a0d2d16
2026-03-21 04:32:47.350 DEBUG [src.node.waku_node] Container stopped.
2026-03-21 04:32:47.351 DEBUG [src.node.waku_node] Stopping container with id efbed055f056
2026-03-21 04:32:47.963 DEBUG [src.node.waku_node] Container stopped.
2026-03-21 04:32:47.965 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-21 04:32:48.009 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-21 04:32:48.046 DEBUG [src.node.docker_mananger] No errors found in the waku logs.