DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id DEBUG  tests.conftest:conftest.py:57 Running test: test_store_with_non_hex_hash with id: 2025-12-18_04-20-01__8947ec25-625d-4953-af39-c3e77b1b1313 DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup DEBUG  src.steps.store:store.py:31 Running fixture setup: store_setup DEBUG  src.steps.store:store.py:39 Running fixture setup: node_setup DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/publishing_node1_2025-12-18_04-20-01__8947ec25-625d-4953-af39-c3e77b1b1313__wakuorg_nwaku:latest.log DEBUG  src.node.waku_node:waku_node.py:90 Starting Node... DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.10.84 DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['21289', '21290', '21291', '21292', '21293'] DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN DEBUG  src.node.waku_node:waku_node.py:178 Using volumes [] DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 21289:21289 -p 21290:21290 -p 21291:21291 -p 21292:21292 -p 21293:21293 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=21291 --rest-port=21289 --tcp-port=21290 --discv5-udp-port=21292 --rest-address=0.0.0.0 --nat=extip:172.18.10.84 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8a5ebfda9b89f8cfc05cb420e40bb93c6c6eea11755bc317a8f8ab56abbaa4b7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=21293 --metrics-logging=true --store=true --relay=true DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.10.84 waku 8432d75c3ef7a237bfd2440f9ab8c79cb1eb1d76a9c479a6eb12fcfb4de1e432 DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 8432d75c3ef7. Setting up logs at ./log/docker/publishing_node1_2025-12-18_04-20-01__8947ec25-625d-4953-af39-c3e77b1b1313__wakuorg_nwaku:latest.log DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 21289 DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container e8dcbac335b4. Exiting log stream. ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 11a630f38e62. Exiting log stream. INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:21289/health" -H "Content-Type: application/json" -d 'None' INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}' INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !! INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:21289/debug/v1/info" -H "Content-Type: application/json" -d 'None' INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.10.84/tcp/21290/p2p/16Uiu2HAm31dB4JiKY4tKAvrXvE1DY4H7ZtQe7ZStHFJbEttbEW7g","/ip4/172.18.10.84/tcp/21291/ws/p2p/16Uiu2HAm31dB4JiKY4tKAvrXvE1DY4H7ZtQe7ZStHFJbEttbEW7g"],"enrUri":"enr:-L24QIw8ajWM1QGwHSPVyf-ZndgCEBQeDAab7oBLMrYfAhBsEHdH9QcSkVX_kE6Fs7SPPBd7B9QjBQirSGPw3mng0LYCgmlkgnY0gmlwhKwSClSKbXVsdGlhZGRyc5YACASsEgpUBlMqAAoErBIKVAZTK90DgnJzhQADAQAAiXNlY3AyNTZrMaECcLRiK6HL6v2QvpDHKY5lgPmPi2Zxm_z6X2Cgg11G6N-DdGNwglMqg3VkcIJTLIV3YWt1MgM"}' INFO  src.node.waku_node:waku_node.py:292 REST service is ready !! DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/store_node1_2025-12-18_04-20-01__8947ec25-625d-4953-af39-c3e77b1b1313__wakuorg_nwaku:latest.log DEBUG  src.node.waku_node:waku_node.py:90 Starting Node... DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.89.41 DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['21497', '21498', '21499', '21500', '21501'] DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN DEBUG  src.node.waku_node:waku_node.py:178 Using volumes [] DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 21497:21497 -p 21498:21498 -p 21499:21499 -p 21500:21500 -p 21501:21501 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=21499 --rest-port=21497 --tcp-port=21498 --discv5-udp-port=21500 --rest-address=0.0.0.0 --nat=extip:172.18.89.41 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cd1e38f315eb60871b2ab8e89812d0221662d59b9e560cb60de5a8cc56f962d9 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=21501 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QIw8ajWM1QGwHSPVyf-ZndgCEBQeDAab7oBLMrYfAhBsEHdH9QcSkVX_kE6Fs7SPPBd7B9QjBQirSGPw3mng0LYCgmlkgnY0gmlwhKwSClSKbXVsdGlhZGRyc5YACASsEgpUBlMqAAoErBIKVAZTK90DgnJzhQADAQAAiXNlY3AyNTZrMaECcLRiK6HL6v2QvpDHKY5lgPmPi2Zxm_z6X2Cgg11G6N-DdGNwglMqg3VkcIJTLIV3YWt1MgM --storenode=/ip4/172.18.10.84/tcp/21290/p2p/16Uiu2HAm31dB4JiKY4tKAvrXvE1DY4H7ZtQe7ZStHFJbEttbEW7g --store=true --relay=true DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.89.41 waku 21c832358be5b82237198b6b96a162e397a53e12a4019d3b537bb14446e5fec5 DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 21c832358be5. Setting up logs at ./log/docker/store_node1_2025-12-18_04-20-01__8947ec25-625d-4953-af39-c3e77b1b1313__wakuorg_nwaku:latest.log DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 21497 DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:21497/health" -H "Content-Type: application/json" -d 'None' INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"READY"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"READY"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}' INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !! INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:21497/debug/v1/info" -H "Content-Type: application/json" -d 'None' INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.89.41/tcp/21498/p2p/16Uiu2HAmRAAyHiYK2Mtu9ccJdrBUWkp2QAgMFXUk8F4mRJGmNiqx","/ip4/172.18.89.41/tcp/21499/ws/p2p/16Uiu2HAmRAAyHiYK2Mtu9ccJdrBUWkp2QAgMFXUk8F4mRJGmNiqx"],"enrUri":"enr:-L24QBjpku5I62tlrv2pfgDUbPDBOsXRbPY0PqlZIM-iOCJHCGGkqHm5249fMyrdHOZDZMFgPp3-GkEO6ptulThH91cCgmlkgnY0gmlwhKwSWSmKbXVsdGlhZGRyc5YACASsElkpBlP6AAoErBJZKQZT-90DgnJzhQADAQAAiXNlY3AyNTZrMaEDucYYbRzXcR7rEh8AaISJbn3Cex0g4piqJmU89O69ToODdGNwglP6g3VkcIJT_IV3YWt1MgM"}' INFO  src.node.waku_node:waku_node.py:292 REST service is ready !! INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:21497/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.10.84/tcp/21290/p2p/16Uiu2HAm31dB4JiKY4tKAvrXvE1DY4H7ZtQe7ZStHFJbEttbEW7g"]' INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK' INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:21289/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]' INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK' INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:21497/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]' INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK' DEBUG  src.steps.store:store.py:132 Relaying message INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:21289/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV8w", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}' INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK' DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds DEBUG  src.steps.store:store.py:132 Relaying message INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:21289/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV8x", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}' INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK' DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds DEBUG  src.steps.store:store.py:132 Relaying message INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:21289/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV8y", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}' INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK' DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds DEBUG  src.steps.store:store.py:132 Relaying message INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:21289/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV8z", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}' INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK' DEBUG  src.libs.common:common.py:47 Sleeping for 0.2 seconds INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:21289/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&hashes=test&pageSize=50&ascending=true" -H "Content-Type: application/json" -d 'None' ERROR  src.node.api_clients.base_client:base_client.py:16 HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:21289/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&hashes=test&pageSize=50&ascending=true. Response content: b'Exception converting hex string to bytes: t is not a hexadecimal character' INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:21497/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&hashes=test&pageSize=50&ascending=true" -H "Content-Type: application/json" -d 'None' ERROR  src.node.api_clients.base_client:base_client.py:16 HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:21497/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&hashes=test&pageSize=50&ascending=true. Response content: b'Exception converting hex string to bytes: t is not a hexadecimal character' DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 8432d75c3ef7 DEBUG  src.node.waku_node:waku_node.py:241 Container stopped. DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 21c832358be5 DEBUG  src.node.waku_node:waku_node.py:241 Container stopped. DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs. DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.