2025-12-21 04:24:08.429 DEBUG [tests.conftest] Running fixture setup: test_id 2025-12-21 04:24:08.430 DEBUG [tests.conftest] Running test: test_publish_with_missing_payload with id: 2025-12-21_04-24-08__8e2431b3-0ca9-4b56-94af-f1cd5ebc6cbe 2025-12-21 04:24:08.430 DEBUG [src.steps.common] Running fixture setup: common_setup 2025-12-21 04:24:08.430 DEBUG [src.steps.relay] Running fixture setup: relay_setup 2025-12-21 04:24:08.430 DEBUG [src.steps.relay] Running fixture setup: setup_main_relay_nodes 2025-12-21 04:24:08.436 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest 2025-12-21 04:24:08.436 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2025-12-21_04-24-08__8e2431b3-0ca9-4b56-94af-f1cd5ebc6cbe__wakuorg_nwaku:latest.log 2025-12-21 04:24:08.437 DEBUG [src.node.waku_node] Starting Node... 2025-12-21 04:24:08.437 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku 2025-12-21 04:24:08.438 DEBUG [src.node.docker_mananger] Network waku already exists 2025-12-21 04:24:08.438 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.43.205 2025-12-21 04:24:08.438 DEBUG [src.node.docker_mananger] Generated ports ['35879', '35880', '35881', '35882', '35883'] 2025-12-21 04:24:08.438 DEBUG [src.node.waku_node] RLN credentials were not set 2025-12-21 04:24:08.439 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN 2025-12-21 04:24:08.439 DEBUG [src.node.waku_node] Using volumes [] 2025-12-21 04:24:08.439 DEBUG [src.node.docker_mananger] docker run -i -t -p 35879:35879 -p 35880:35880 -p 35881:35881 -p 35882:35882 -p 35883:35883 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=35881 --rest-port=35879 --tcp-port=35880 --discv5-udp-port=35882 --rest-address=0.0.0.0 --nat=extip:172.18.43.205 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=b2fef6ed93ced691eadebdaffddc9277c5f582faab0e2862c69dfe4f94e4fcef --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=35883 --metrics-logging=true --relay=true 2025-12-21 04:24:08.617 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.43.205 waku 01e45ffad1565cf966d3338b5ffedfdfbf523b4fa1fe01e2054458b961b6230b 2025-12-21 04:24:08.652 DEBUG [src.node.docker_mananger] Container started with ID 01e45ffad156. Setting up logs at ./log/docker/node1_2025-12-21_04-24-08__8e2431b3-0ca9-4b56-94af-f1cd5ebc6cbe__wakuorg_nwaku:latest.log 2025-12-21 04:24:08.652 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 35879 2025-12-21 04:24:08.653 DEBUG [src.libs.common] Sleeping for 1 seconds 2025-12-21 04:24:08.711 ERROR [src.node.docker_mananger] Max retries reached for container 21d705150c92. Exiting log stream. 2025-12-21 04:24:09.227 ERROR [src.node.docker_mananger] Max retries reached for container eb8bd997ff9f. Exiting log stream. 2025-12-21 04:24:09.654 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35879/health" -H "Content-Type: application/json" -d 'None' 2025-12-21 04:24:09.657 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}' 2025-12-21 04:24:09.657 INFO [src.node.waku_node] Node protocols are initialized !! 2025-12-21 04:24:09.657 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35879/debug/v1/info" -H "Content-Type: application/json" -d 'None' 2025-12-21 04:24:09.659 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.43.205/tcp/35880/p2p/16Uiu2HAmQSSEXajG9zENtVHJtRBpWgedkcxnaX6D3FkMhyY5pwxN","/ip4/172.18.43.205/tcp/35881/ws/p2p/16Uiu2HAmQSSEXajG9zENtVHJtRBpWgedkcxnaX6D3FkMhyY5pwxN"],"enrUri":"enr:-L24QJlHIs3-VzRdMu1g6eYiGYMd55dKI8pwEfDmG0yfgep2EAi2RzLLl_S9Wxj4sFjwAbZpZf1fGLnv4bCCx7FbRskCgmlkgnY0gmlwhKwSK82KbXVsdGlhZGRyc5YACASsEivNBowoAAoErBIrzQaMKd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDrxT1hbczQyJg7b5ULMTs857FG7Idgi3hy_fGDk2gLhuDdGNwgowog3VkcIKMKoV3YWt1MgE"}' 2025-12-21 04:24:09.660 INFO [src.node.waku_node] REST service is ready !! 2025-12-21 04:24:09.666 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest 2025-12-21 04:24:09.666 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2025-12-21_04-24-08__8e2431b3-0ca9-4b56-94af-f1cd5ebc6cbe__wakuorg_nwaku:latest.log 2025-12-21 04:24:09.666 DEBUG [src.node.waku_node] Starting Node... 2025-12-21 04:24:09.666 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku 2025-12-21 04:24:09.667 DEBUG [src.node.docker_mananger] Network waku already exists 2025-12-21 04:24:09.667 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.138.159 2025-12-21 04:24:09.668 DEBUG [src.node.docker_mananger] Generated ports ['37763', '37764', '37765', '37766', '37767'] 2025-12-21 04:24:09.668 DEBUG [src.node.waku_node] RLN credentials were not set 2025-12-21 04:24:09.668 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN 2025-12-21 04:24:09.668 DEBUG [src.node.waku_node] Using volumes [] 2025-12-21 04:24:09.668 DEBUG [src.node.docker_mananger] docker run -i -t -p 37763:37763 -p 37764:37764 -p 37765:37765 -p 37766:37766 -p 37767:37767 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=37765 --rest-port=37763 --tcp-port=37764 --discv5-udp-port=37766 --rest-address=0.0.0.0 --nat=extip:172.18.138.159 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bf99c3cf303a601f2f54ba3a0e556abc4cc974b67e6defb24fe92f7d7f6e4967 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=37767 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QJlHIs3-VzRdMu1g6eYiGYMd55dKI8pwEfDmG0yfgep2EAi2RzLLl_S9Wxj4sFjwAbZpZf1fGLnv4bCCx7FbRskCgmlkgnY0gmlwhKwSK82KbXVsdGlhZGRyc5YACASsEivNBowoAAoErBIrzQaMKd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDrxT1hbczQyJg7b5ULMTs857FG7Idgi3hy_fGDk2gLhuDdGNwgowog3VkcIKMKoV3YWt1MgE 2025-12-21 04:24:09.842 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.138.159 waku 23b13a515342e92565026a1956618c50a27d0a88858cf81313041df6c3a060f7 2025-12-21 04:24:09.871 DEBUG [src.node.docker_mananger] Container started with ID 23b13a515342. Setting up logs at ./log/docker/node2_2025-12-21_04-24-08__8e2431b3-0ca9-4b56-94af-f1cd5ebc6cbe__wakuorg_nwaku:latest.log 2025-12-21 04:24:09.872 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 37763 2025-12-21 04:24:09.872 DEBUG [src.libs.common] Sleeping for 1 seconds 2025-12-21 04:24:10.875 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37763/health" -H "Content-Type: application/json" -d 'None' 2025-12-21 04:24:10.892 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}' 2025-12-21 04:24:10.894 INFO [src.node.waku_node] Node protocols are initialized !! 2025-12-21 04:24:10.894 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37763/debug/v1/info" -H "Content-Type: application/json" -d 'None' 2025-12-21 04:24:10.898 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.138.159/tcp/37764/p2p/16Uiu2HAmQzu6BEQTFvMjbnVnQNZ3RXg5kmSzzGwnvk6WdvBoC9F7","/ip4/172.18.138.159/tcp/37765/ws/p2p/16Uiu2HAmQzu6BEQTFvMjbnVnQNZ3RXg5kmSzzGwnvk6WdvBoC9F7"],"enrUri":"enr:-L24QFBSPBZjCV5pDgHQ4m2L16JzYLkksZU4hD3lNt995b5vBb1y1dzQyyv8IiLRpg7IYNl7YpEk89kSxBzdp50T6-cCgmlkgnY0gmlwhKwSip-KbXVsdGlhZGRyc5YACASsEoqfBpOEAAoErBKKnwaThd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDt2XpQcjVXB5ISmZFiMthq9onO9z8eAcLuJMjXZ29hWqDdGNwgpOEg3VkcIKThoV3YWt1MgE"}' 2025-12-21 04:24:10.899 INFO [src.node.waku_node] REST service is ready !! 2025-12-21 04:24:10.899 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37763/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.43.205/tcp/35880/p2p/16Uiu2HAmQSSEXajG9zENtVHJtRBpWgedkcxnaX6D3FkMhyY5pwxN"]' 2025-12-21 04:24:10.903 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-21 04:24:10.903 DEBUG [src.steps.relay] Running fixture setup: subscribe_main_relay_nodes 2025-12-21 04:24:10.903 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35879/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]' 2025-12-21 04:24:10.907 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-21 04:24:10.907 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37763/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]' 2025-12-21 04:24:10.911 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-21 04:24:10.912 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35879/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}' 2025-12-21 04:24:10.917 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-21 04:24:10.918 DEBUG [src.libs.common] Sleeping for 0.1 seconds 2025-12-21 04:24:11.018 DEBUG [src.steps.relay] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message 2025-12-21 04:24:11.019 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35879/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None' 2025-12-21 04:24:11.021 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1766291050912590336,"ephemeral":false,"proof":""}]' 2025-12-21 04:24:11.023 DEBUG [src.steps.relay] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message 2025-12-21 04:24:11.023 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37763/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None' 2025-12-21 04:24:11.025 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1766291050912590336,"ephemeral":false,"proof":""}]' 2025-12-21 04:24:11.026 INFO [src.steps.relay] WARM UP successful!! 2025-12-21 04:24:11.027 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35879/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}' 2025-12-21 04:24:11.029 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:35879/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1. Response content: b'Invalid content body, could not decode: Unable to deserialize data: ' 2025-12-21 04:24:11.031 DEBUG [tests.conftest] Running fixture teardown: test_setup 2025-12-21 04:24:11.032 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes 2025-12-21 04:24:11.032 DEBUG [src.node.waku_node] Stopping container with id 01e45ffad156 2025-12-21 04:24:11.530 DEBUG [src.node.waku_node] Container stopped. 2025-12-21 04:24:11.531 DEBUG [src.node.waku_node] Stopping container with id 23b13a515342 2025-12-21 04:24:12.013 DEBUG [src.node.waku_node] Container stopped. 2025-12-21 04:24:12.015 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors 2025-12-21 04:24:12.020 DEBUG [src.node.docker_mananger] No errors found in the waku logs. 2025-12-21 04:24:12.025 DEBUG [src.node.docker_mananger] No errors found in the waku logs.