157 lines
27 KiB
Plaintext

2026-03-08 04:33:55.641 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-08 04:33:55.641 DEBUG [tests.conftest] Running test: test_2_nodes_different_content_topic_different_shard with id: 2026-03-08_04-33-55__e3744908-1cf2-4791-a53e-aca00b42b786
2026-03-08 04:33:55.641 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-08 04:33:55.642 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-08 04:33:55.642 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-08 04:33:55.649 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-08 04:33:55.650 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-08_04-33-55__e3744908-1cf2-4791-a53e-aca00b42b786__wakuorg_nwaku:latest.log
2026-03-08 04:33:55.650 DEBUG [src.node.waku_node] Starting Node...
2026-03-08 04:33:55.651 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-08 04:33:55.653 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-08 04:33:55.653 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.206.16
2026-03-08 04:33:55.653 DEBUG [src.node.docker_mananger] Generated ports ['28430', '28431', '28432', '28433', '28434']
2026-03-08 04:33:55.654 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-08 04:33:55.654 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-08 04:33:55.654 DEBUG [src.node.waku_node] Using volumes []
2026-03-08 04:33:55.654 DEBUG [src.node.docker_mananger] docker run -i -t -p 28430:28430 -p 28431:28431 -p 28432:28432 -p 28433:28433 -p 28434:28434 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=28432 --rest-port=28430 --tcp-port=28431 --discv5-udp-port=28433 --rest-address=0.0.0.0 --nat=extip:172.18.206.16 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=ebe91ddaadaaccd8bafe0aebabf49b8b0ffdcfc9e9eedd042e80ca48017b0304 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=28434 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
2026-03-08 04:33:55.844 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.206.16 waku faa2a0811a910e24e6adf5c9ce783dcf0cabf23656c8efb6f24f94427d107365
2026-03-08 04:33:55.857 ERROR [src.node.docker_mananger] Max retries reached for container 33582f2e3a97. Exiting log stream.
2026-03-08 04:33:55.881 DEBUG [src.node.docker_mananger] Container started with ID faa2a0811a91. Setting up logs at ./log/docker/node1_2026-03-08_04-33-55__e3744908-1cf2-4791-a53e-aca00b42b786__wakuorg_nwaku:latest.log
2026-03-08 04:33:55.881 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 28430
2026-03-08 04:33:55.882 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-08 04:33:56.402 ERROR [src.node.docker_mananger] Max retries reached for container 3c34701352d4. Exiting log stream.
2026-03-08 04:33:56.882 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28430/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:56.888 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:33:56.889 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:33:56.889 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28430/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:56.892 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.206.16/tcp/28431/p2p/16Uiu2HAm7yK6SGhrUsv8KR7yUpkYa9vA7mAUdP8C7EMnRtrr8BKr","/ip4/172.18.206.16/tcp/28432/ws/p2p/16Uiu2HAm7yK6SGhrUsv8KR7yUpkYa9vA7mAUdP8C7EMnRtrr8BKr"],"enrUri":"enr:-L24QAq2yUm0Q4Lu82fmyNy2GORegm81P8o3oNRVp0afrhYvco2RWDp70HWzDPwM_O3jElXBNpBoxo3lEwOvNN5qSYsCgmlkgnY0gmlwhKwSzhCKbXVsdGlhZGRyc5YACASsEs4QBm8PAAoErBLOEAZvEN0DgnJzhQACAQAAiXNlY3AyNTZrMaECumc2t18V8hGliNAkgpmaRV4wNouW6b2y8DDUXSapBjWDdGNwgm8Pg3VkcIJvEYV3YWt1MgU"}'
2026-03-08 04:33:56.892 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:33:56.899 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-08 04:33:56.899 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-08_04-33-55__e3744908-1cf2-4791-a53e-aca00b42b786__wakuorg_nwaku:latest.log
2026-03-08 04:33:56.899 DEBUG [src.node.waku_node] Starting Node...
2026-03-08 04:33:56.900 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-08 04:33:56.901 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-08 04:33:56.901 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.17.40
2026-03-08 04:33:56.901 DEBUG [src.node.docker_mananger] Generated ports ['65500', '65501', '65502', '65503', '65504']
2026-03-08 04:33:56.901 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-08 04:33:56.902 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-08 04:33:56.902 DEBUG [src.node.waku_node] Using volumes []
2026-03-08 04:33:56.902 DEBUG [src.node.docker_mananger] docker run -i -t -p 65500:65500 -p 65501:65501 -p 65502:65502 -p 65503:65503 -p 65504:65504 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=65502 --rest-port=65500 --tcp-port=65501 --discv5-udp-port=65503 --rest-address=0.0.0.0 --nat=extip:172.18.17.40 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=afa4cca6152d70aed3daae7aee9fdb94f970a1ede1cbf017b800e47a5a753c4b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=65504 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAq2yUm0Q4Lu82fmyNy2GORegm81P8o3oNRVp0afrhYvco2RWDp70HWzDPwM_O3jElXBNpBoxo3lEwOvNN5qSYsCgmlkgnY0gmlwhKwSzhCKbXVsdGlhZGRyc5YACASsEs4QBm8PAAoErBLOEAZvEN0DgnJzhQACAQAAiXNlY3AyNTZrMaECumc2t18V8hGliNAkgpmaRV4wNouW6b2y8DDUXSapBjWDdGNwgm8Pg3VkcIJvEYV3YWt1MgU --content-topic=/waku/2/content/test.js
2026-03-08 04:33:57.119 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.17.40 waku c6cb7bfe5593e2318b05de096d23c27c4ba67c5e526d22ebaa135f2927e9bf5e
2026-03-08 04:33:57.154 DEBUG [src.node.docker_mananger] Container started with ID c6cb7bfe5593. Setting up logs at ./log/docker/node2_2026-03-08_04-33-55__e3744908-1cf2-4791-a53e-aca00b42b786__wakuorg_nwaku:latest.log
2026-03-08 04:33:57.155 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 65500
2026-03-08 04:33:57.155 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-08 04:33:58.155 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:65500/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:58.158 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:33:58.158 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:33:58.158 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:65500/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:58.161 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.17.40/tcp/65501/p2p/16Uiu2HAmVVGLKGAG29mxPfvUFfaRK9eSgeuWrwoE1JWa1czobkBV","/ip4/172.18.17.40/tcp/65502/ws/p2p/16Uiu2HAmVVGLKGAG29mxPfvUFfaRK9eSgeuWrwoE1JWa1czobkBV"],"enrUri":"enr:-L24QH04HBI22jaiCVKDWxYuRw3Z53JbPqO5OYBvKgesKbuTDQEXJ18wcNmZrzovc8GR-Hf5ZcojqDSgzEBQuB057eoCgmlkgnY0gmlwhKwSESiKbXVsdGlhZGRyc5YACASsEhEoBv_dAAoErBIRKAb_3t0DgnJzhQACAQAAiXNlY3AyNTZrMaED-hjxIdrJ8NgmmE8ZBMCadRpPXD69OD5u3xHBTGBeu_yDdGNwgv_dg3VkcIL_34V3YWt1MgE"}'
2026-03-08 04:33:58.161 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:33:58.162 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:65500/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.206.16/tcp/28431/p2p/16Uiu2HAm7yK6SGhrUsv8KR7yUpkYa9vA7mAUdP8C7EMnRtrr8BKr"]'
2026-03-08 04:33:58.196 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:33:58.198 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:28430/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-08 04:33:58.206 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:33:58.207 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:65500/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/content/test.js"]'
2026-03-08 04:33:58.210 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:33:58.211 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:28430/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:33:58.224 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:33:58.224 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-08 04:33:58.324 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-08 04:33:58.325 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28430/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:33:58.328 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772944434552366669,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772944434338986389,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772944438211595987,"ephemeral":false,"proof":""}]'
2026-03-08 04:33:58.374 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-08 04:33:58.375 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-08 04:33:58.375 DEBUG [src.node.waku_node] Stopping container with id faa2a0811a91
2026-03-08 04:33:58.940 DEBUG [src.node.waku_node] Container stopped.
2026-03-08 04:33:58.941 DEBUG [src.node.waku_node] Stopping container with id c6cb7bfe5593
2026-03-08 04:33:59.496 DEBUG [src.node.waku_node] Container stopped.
2026-03-08 04:33:59.500 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-08 04:33:59.535 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-08 04:33:59.562 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-08 04:33:59.564 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-08 04:33:59.565 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-08 04:33:59.565 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-08_04-33-55__e3744908-1cf2-4791-a53e-aca00b42b786__wakuorg_nwaku:latest.log
2026-03-08 04:33:59.567 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-08_04-33-55__e3744908-1cf2-4791-a53e-aca00b42b786__wakuorg_nwaku:latest.log
2026-03-08 04:33:59.571 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-08 04:33:59.571 DEBUG [tests.conftest] Running test: test_2_nodes_different_content_topic_different_shard with id: 2026-03-08_04-33-59__e16a34a4-edc4-4492-9a8c-ccbb2fcfcfec
2026-03-08 04:33:59.571 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-08 04:33:59.572 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-08 04:33:59.572 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-08 04:33:59.579 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-08 04:33:59.580 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-08_04-33-59__e16a34a4-edc4-4492-9a8c-ccbb2fcfcfec__wakuorg_nwaku:latest.log
2026-03-08 04:33:59.580 DEBUG [src.node.waku_node] Starting Node...
2026-03-08 04:33:59.580 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-08 04:33:59.581 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-08 04:33:59.581 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.5.97
2026-03-08 04:33:59.581 DEBUG [src.node.docker_mananger] Generated ports ['35685', '35686', '35687', '35688', '35689']
2026-03-08 04:33:59.582 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-08 04:33:59.582 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-08 04:33:59.582 DEBUG [src.node.waku_node] Using volumes []
2026-03-08 04:33:59.582 DEBUG [src.node.docker_mananger] docker run -i -t -p 35685:35685 -p 35686:35686 -p 35687:35687 -p 35688:35688 -p 35689:35689 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=35687 --rest-port=35685 --tcp-port=35686 --discv5-udp-port=35688 --rest-address=0.0.0.0 --nat=extip:172.18.5.97 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=5b53c4d3c811d33d4defdc4a6dbb5f143c6bdf29f340f1cae2501eaf29fea6bd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=35689 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
2026-03-08 04:33:59.769 ERROR [src.node.docker_mananger] Max retries reached for container faa2a0811a91. Exiting log stream.
2026-03-08 04:33:59.771 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.5.97 waku 62646eca5741f42d20153a6ff95ba4f97838cf46d40f2ab6f44433ae8d78b011
2026-03-08 04:33:59.811 DEBUG [src.node.docker_mananger] Container started with ID 62646eca5741. Setting up logs at ./log/docker/node1_2026-03-08_04-33-59__e16a34a4-edc4-4492-9a8c-ccbb2fcfcfec__wakuorg_nwaku:latest.log
2026-03-08 04:33:59.811 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 35685
2026-03-08 04:33:59.811 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-08 04:34:00.312 ERROR [src.node.docker_mananger] Max retries reached for container c6cb7bfe5593. Exiting log stream.
2026-03-08 04:34:00.813 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35685/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:34:00.816 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-08 04:34:00.917 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35685/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:34:00.919 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-08 04:34:01.020 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35685/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:34:01.022 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-08 04:34:01.123 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35685/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:34:01.138 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-08 04:34:01.240 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35685/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:34:01.243 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:34:01.243 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:34:01.243 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35685/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:34:01.246 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.5.97/tcp/35686/p2p/16Uiu2HAm9zhEiLPi1BDhm7JDX94ZgLtsiryUkcLBiNRmdkKqykt1","/ip4/172.18.5.97/tcp/35687/ws/p2p/16Uiu2HAm9zhEiLPi1BDhm7JDX94ZgLtsiryUkcLBiNRmdkKqykt1"],"enrUri":"enr:-L24QO84KCQgH4-BrYTgwrn3V5nY-Itp8u7MFB7fhM3ch7jIZtUqZqYRSF3FbpOHvjx58-PpW4_KUBm3xV2f4Hky33QCgmlkgnY0gmlwhKwSBWGKbXVsdGlhZGRyc5YACASsEgVhBotmAAoErBIFYQaLZ90DgnJzhQACAQAAiXNlY3AyNTZrMaEC2Hk0ikfcMDoT1N2bJ9dmmAR9shpJYKf4VMHk32pPUFqDdGNwgotmg3VkcIKLaIV3YWt1MgU"}'
2026-03-08 04:34:01.246 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:34:01.255 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-08 04:34:01.255 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-08_04-33-59__e16a34a4-edc4-4492-9a8c-ccbb2fcfcfec__wakuorg_nwaku:latest.log
2026-03-08 04:34:01.255 DEBUG [src.node.waku_node] Starting Node...
2026-03-08 04:34:01.255 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-08 04:34:01.257 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-08 04:34:01.257 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.194.0
2026-03-08 04:34:01.257 DEBUG [src.node.docker_mananger] Generated ports ['3873', '3874', '3875', '3876', '3877']
2026-03-08 04:34:01.257 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-08 04:34:01.257 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-08 04:34:01.258 DEBUG [src.node.waku_node] Using volumes []
2026-03-08 04:34:01.258 DEBUG [src.node.docker_mananger] docker run -i -t -p 3873:3873 -p 3874:3874 -p 3875:3875 -p 3876:3876 -p 3877:3877 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3875 --rest-port=3873 --tcp-port=3874 --discv5-udp-port=3876 --rest-address=0.0.0.0 --nat=extip:172.18.194.0 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=326e299bc07eed16bbecc3bddd911a6d4b80797a60bdceebdf1fc8a47d3efb05 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3877 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QO84KCQgH4-BrYTgwrn3V5nY-Itp8u7MFB7fhM3ch7jIZtUqZqYRSF3FbpOHvjx58-PpW4_KUBm3xV2f4Hky33QCgmlkgnY0gmlwhKwSBWGKbXVsdGlhZGRyc5YACASsEgVhBotmAAoErBIFYQaLZ90DgnJzhQACAQAAiXNlY3AyNTZrMaEC2Hk0ikfcMDoT1N2bJ9dmmAR9shpJYKf4VMHk32pPUFqDdGNwgotmg3VkcIKLaIV3YWt1MgU --content-topic=/waku/2/content/test.js
2026-03-08 04:34:01.462 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.194.0 waku 0f8edfaff3f008f0c12095e87e11d9b16131eb4a96c29424380983367f460e20
2026-03-08 04:34:01.504 DEBUG [src.node.docker_mananger] Container started with ID 0f8edfaff3f0. Setting up logs at ./log/docker/node2_2026-03-08_04-33-59__e16a34a4-edc4-4492-9a8c-ccbb2fcfcfec__wakuorg_nwaku:latest.log
2026-03-08 04:34:01.505 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 3873
2026-03-08 04:34:01.505 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-08 04:34:02.506 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3873/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:34:02.517 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:34:02.518 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:34:02.518 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3873/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:34:02.520 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.194.0/tcp/3874/p2p/16Uiu2HAm1qkYPGDEHusZibFTeyVHFT7DKeJM4F7uvwY5jJdzk15j","/ip4/172.18.194.0/tcp/3875/ws/p2p/16Uiu2HAm1qkYPGDEHusZibFTeyVHFT7DKeJM4F7uvwY5jJdzk15j"],"enrUri":"enr:-L24QNOLGIs3WRedBd_PPprDRRJ480DoyzWjb1p8SQJF8vqrCO-SXorW28fbPoUX-HRX30j3bDuk-Zh_dGWI3qWcgVwCgmlkgnY0gmlwhKwSwgCKbXVsdGlhZGRyc5YACASsEsIABg8iAAoErBLCAAYPI90DgnJzhQACAQAAiXNlY3AyNTZrMaECX1E4GkUXgyOXgk4zSg0vEavlyIvOq-c-RsVtKjZFxhqDdGNwgg8ig3VkcIIPJIV3YWt1MgE"}'
2026-03-08 04:34:02.520 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:34:02.521 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3873/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.5.97/tcp/35686/p2p/16Uiu2HAm9zhEiLPi1BDhm7JDX94ZgLtsiryUkcLBiNRmdkKqykt1"]'
2026-03-08 04:34:02.559 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:34:02.563 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35685/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-08 04:34:02.569 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:34:02.569 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3873/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/content/test.js"]'
2026-03-08 04:34:02.577 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:34:02.578 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35685/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:34:02.588 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:34:02.588 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-08 04:34:02.689 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-08 04:34:02.689 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35685/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:34:02.694 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772944439640110175,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772944442577911942,"ephemeral":false,"proof":""}]'
2026-03-08 04:34:02.704 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-08 04:34:02.705 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-08 04:34:02.705 DEBUG [src.node.waku_node] Stopping container with id 62646eca5741
2026-03-08 04:34:03.311 DEBUG [src.node.waku_node] Container stopped.
2026-03-08 04:34:03.312 DEBUG [src.node.waku_node] Stopping container with id 0f8edfaff3f0
2026-03-08 04:34:03.895 DEBUG [src.node.waku_node] Container stopped.
2026-03-08 04:34:03.897 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-08 04:34:03.961 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-08 04:34:03.986 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-08 04:34:03.987 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-08 04:34:03.987 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-08 04:34:03.988 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-08_04-33-59__e16a34a4-edc4-4492-9a8c-ccbb2fcfcfec__wakuorg_nwaku:latest.log
2026-03-08 04:34:03.989 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-08_04-33-59__e16a34a4-edc4-4492-9a8c-ccbb2fcfcfec__wakuorg_nwaku:latest.log