2025-12-11 04:14:05.892 DEBUG [tests.conftest] Running fixture setup: test_id 2025-12-11 04:14:05.893 DEBUG [tests.conftest] Running test: test_light_push_with_missing_content_topic with id: 2025-12-11_04-14-05__1a682a92-cdb6-4e0a-b943-013dd06f6150 2025-12-11 04:14:05.893 DEBUG [src.steps.common] Running fixture setup: common_setup 2025-12-11 04:14:05.893 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup 2025-12-11 04:14:05.900 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest 2025-12-11 04:14:05.900 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node1_2025-12-11_04-14-05__1a682a92-cdb6-4e0a-b943-013dd06f6150__wakuorg_nwaku:latest.log 2025-12-11 04:14:05.901 DEBUG [src.node.waku_node] Starting Node... 2025-12-11 04:14:05.901 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku 2025-12-11 04:14:05.902 DEBUG [src.node.docker_mananger] Network waku already exists 2025-12-11 04:14:05.902 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.226.216 2025-12-11 04:14:05.902 DEBUG [src.node.docker_mananger] Generated ports ['30012', '30013', '30014', '30015', '30016'] 2025-12-11 04:14:05.903 DEBUG [src.node.waku_node] RLN credentials were not set 2025-12-11 04:14:05.903 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN 2025-12-11 04:14:05.903 DEBUG [src.node.waku_node] Using volumes [] 2025-12-11 04:14:05.903 DEBUG [src.node.docker_mananger] docker run -i -t -p 30012:30012 -p 30013:30013 -p 30014:30014 -p 30015:30015 -p 30016:30016 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=30014 --rest-port=30012 --tcp-port=30013 --discv5-udp-port=30015 --rest-address=0.0.0.0 --nat=extip:172.18.226.216 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=038af6f67d02b3e0c0aadaab91fd4ebad03f4ed98b86eeeadb35c6fcd9c9f284 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=30016 --metrics-logging=true --lightpush=true --relay=true 2025-12-11 04:14:06.087 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.226.216 waku c4ebce408b05240dd9b38c8e91ea429cbc19c93b210d832d2a03c3b190656ebb 2025-12-11 04:14:06.092 ERROR [src.node.docker_mananger] Max retries reached for container 26f6bb9cc2dc. Exiting log stream. 2025-12-11 04:14:06.118 DEBUG [src.node.docker_mananger] Container started with ID c4ebce408b05. Setting up logs at ./log/docker/receiving_node1_2025-12-11_04-14-05__1a682a92-cdb6-4e0a-b943-013dd06f6150__wakuorg_nwaku:latest.log 2025-12-11 04:14:06.118 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 30012 2025-12-11 04:14:06.120 DEBUG [src.libs.common] Sleeping for 1 seconds 2025-12-11 04:14:06.637 ERROR [src.node.docker_mananger] Max retries reached for container 1db7e96479b0. Exiting log stream. 2025-12-11 04:14:07.120 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30012/health" -H "Content-Type: application/json" -d 'None' 2025-12-11 04:14:07.123 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}' 2025-12-11 04:14:07.124 INFO [src.node.waku_node] Node protocols are initialized !! 2025-12-11 04:14:07.124 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30012/debug/v1/info" -H "Content-Type: application/json" -d 'None' 2025-12-11 04:14:07.126 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.226.216/tcp/30013/p2p/16Uiu2HAmGmof38142372Z7DG2xciu8k1HNoHk8JwezYVDPgh9NVR","/ip4/172.18.226.216/tcp/30014/ws/p2p/16Uiu2HAmGmof38142372Z7DG2xciu8k1HNoHk8JwezYVDPgh9NVR"],"enrUri":"enr:-L24QFrescW5J6ERxuoDo9_elFT0vBgsgaotdFZcJ0lKkGJeAAT9k7vws2NtSqhUwz4kNYwgGx4Ao84RZgkKeAfckwICgmlkgnY0gmlwhKwS4tiKbXVsdGlhZGRyc5YACASsEuLYBnU9AAoErBLi2AZ1Pt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDPS24u8FliOWq14XNOofbOwC-uE5XUgJCrqx6g61pVwSDdGNwgnU9g3VkcIJ1P4V3YWt1Mgk"}' 2025-12-11 04:14:07.126 INFO [src.node.waku_node] REST service is ready !! 2025-12-11 04:14:07.133 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest 2025-12-11 04:14:07.133 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node2_2025-12-11_04-14-05__1a682a92-cdb6-4e0a-b943-013dd06f6150__wakuorg_nwaku:latest.log 2025-12-11 04:14:07.133 DEBUG [src.node.waku_node] Starting Node... 2025-12-11 04:14:07.134 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku 2025-12-11 04:14:07.135 DEBUG [src.node.docker_mananger] Network waku already exists 2025-12-11 04:14:07.135 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.160.92 2025-12-11 04:14:07.135 DEBUG [src.node.docker_mananger] Generated ports ['59079', '59080', '59081', '59082', '59083'] 2025-12-11 04:14:07.135 DEBUG [src.node.waku_node] RLN credentials were not set 2025-12-11 04:14:07.136 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN 2025-12-11 04:14:07.136 DEBUG [src.node.waku_node] Using volumes [] 2025-12-11 04:14:07.136 DEBUG [src.node.docker_mananger] docker run -i -t -p 59079:59079 -p 59080:59080 -p 59081:59081 -p 59082:59082 -p 59083:59083 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=59081 --rest-port=59079 --tcp-port=59080 --discv5-udp-port=59082 --rest-address=0.0.0.0 --nat=extip:172.18.160.92 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=0a6e47bb6abaf395ac25bde9b85c1ceed19096e4d1ff685bfb38cbef6ecbcaff --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=59083 --metrics-logging=true --lightpush=false --relay=true 2025-12-11 04:14:07.326 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.160.92 waku 96e63466039433b95ddbb7ef6a4a3d87f7b113cccb22b75d5046899c20693cf6 2025-12-11 04:14:07.357 DEBUG [src.node.docker_mananger] Container started with ID 96e634660394. Setting up logs at ./log/docker/receiving_node2_2025-12-11_04-14-05__1a682a92-cdb6-4e0a-b943-013dd06f6150__wakuorg_nwaku:latest.log 2025-12-11 04:14:07.357 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 59079 2025-12-11 04:14:07.357 DEBUG [src.libs.common] Sleeping for 1 seconds 2025-12-11 04:14:08.358 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59079/health" -H "Content-Type: application/json" -d 'None' 2025-12-11 04:14:08.361 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}' 2025-12-11 04:14:08.361 INFO [src.node.waku_node] Node protocols are initialized !! 2025-12-11 04:14:08.361 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59079/debug/v1/info" -H "Content-Type: application/json" -d 'None' 2025-12-11 04:14:08.364 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.160.92/tcp/59080/p2p/16Uiu2HAm3EWnVX9TfVSvGUmu4JxYRsjEfp8UDx1DQhTYH9pNgVD3","/ip4/172.18.160.92/tcp/59081/ws/p2p/16Uiu2HAm3EWnVX9TfVSvGUmu4JxYRsjEfp8UDx1DQhTYH9pNgVD3"],"enrUri":"enr:-L24QC3QHXdZm5UJI5Y69k2FmQm8kfrRpMkyfCaubwsDn-FlOb105m0bO3jjezdcRXCiJGHMZphl_HhRN5KqmM-HDKYCgmlkgnY0gmlwhKwSoFyKbXVsdGlhZGRyc5YACASsEqBcBubIAAoErBKgXAbmyd0DgnJzhQADAQAAiXNlY3AyNTZrMaECdAG1udr7b6CAbVkl4QWVJyPAt999lrP_N71PpM2CDnKDdGNwgubIg3VkcILmyoV3YWt1MgE"}' 2025-12-11 04:14:08.364 INFO [src.node.waku_node] REST service is ready !! 2025-12-11 04:14:08.364 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59079/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.226.216/tcp/30013/p2p/16Uiu2HAmGmof38142372Z7DG2xciu8k1HNoHk8JwezYVDPgh9NVR"]' 2025-12-11 04:14:08.395 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-11 04:14:08.404 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest 2025-12-11 04:14:08.404 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node1_2025-12-11_04-14-05__1a682a92-cdb6-4e0a-b943-013dd06f6150__wakuorg_nwaku:latest.log 2025-12-11 04:14:08.404 DEBUG [src.node.waku_node] Starting Node... 2025-12-11 04:14:08.405 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku 2025-12-11 04:14:08.407 DEBUG [src.node.docker_mananger] Network waku already exists 2025-12-11 04:14:08.410 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.10.78 2025-12-11 04:14:08.411 DEBUG [src.node.docker_mananger] Generated ports ['29887', '29888', '29889', '29890', '29891'] 2025-12-11 04:14:08.411 DEBUG [src.node.waku_node] RLN credentials were not set 2025-12-11 04:14:08.411 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN 2025-12-11 04:14:08.412 DEBUG [src.node.waku_node] Using volumes [] 2025-12-11 04:14:08.412 DEBUG [src.node.docker_mananger] docker run -i -t -p 29887:29887 -p 29888:29888 -p 29889:29889 -p 29890:29890 -p 29891:29891 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=29889 --rest-port=29887 --tcp-port=29888 --discv5-udp-port=29890 --rest-address=0.0.0.0 --nat=extip:172.18.10.78 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c5a9d5d89df5aef2a64abd4beffb7df50eabe0ebcfd9efdbed37b5bb2addacf0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=29891 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QFrescW5J6ERxuoDo9_elFT0vBgsgaotdFZcJ0lKkGJeAAT9k7vws2NtSqhUwz4kNYwgGx4Ao84RZgkKeAfckwICgmlkgnY0gmlwhKwS4tiKbXVsdGlhZGRyc5YACASsEuLYBnU9AAoErBLi2AZ1Pt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDPS24u8FliOWq14XNOofbOwC-uE5XUgJCrqx6g61pVwSDdGNwgnU9g3VkcIJ1P4V3YWt1Mgk --lightpushnode=/ip4/172.18.226.216/tcp/30013/p2p/16Uiu2HAmGmof38142372Z7DG2xciu8k1HNoHk8JwezYVDPgh9NVR --lightpush=true --relay=false 2025-12-11 04:14:08.607 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.10.78 waku 0e690892fdce0ada2e3ac8cee1e0e8cf15e7281f3ba562992605480ec6a0628c 2025-12-11 04:14:08.639 DEBUG [src.node.docker_mananger] Container started with ID 0e690892fdce. Setting up logs at ./log/docker/lightpush_node1_2025-12-11_04-14-05__1a682a92-cdb6-4e0a-b943-013dd06f6150__wakuorg_nwaku:latest.log 2025-12-11 04:14:08.639 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 29887 2025-12-11 04:14:08.640 DEBUG [src.libs.common] Sleeping for 1 seconds 2025-12-11 04:14:09.640 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29887/health" -H "Content-Type: application/json" -d 'None' 2025-12-11 04:14:09.644 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}' 2025-12-11 04:14:09.644 INFO [src.node.waku_node] Node protocols are initialized !! 2025-12-11 04:14:09.644 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29887/debug/v1/info" -H "Content-Type: application/json" -d 'None' 2025-12-11 04:14:09.647 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.10.78/tcp/29888/p2p/16Uiu2HAmUX5Vrp3Q8HJWEysLtrh8u1r75NqFACfkt5TPfh8wdNUf","/ip4/172.18.10.78/tcp/29889/ws/p2p/16Uiu2HAmUX5Vrp3Q8HJWEysLtrh8u1r75NqFACfkt5TPfh8wdNUf"],"enrUri":"enr:-L24QD7WM842fKghRQ2AQXo1a8WH0UIBOLyVUycxSsGNa_mdFsJCVyY75k9WN-Fq6QCf80VWjOKRW4oa75afS2V2h1kCgmlkgnY0gmlwhKwSCk6KbXVsdGlhZGRyc5YACASsEgpOBnTAAAoErBIKTgZ0wd0DgnJzhQADAQAAiXNlY3AyNTZrMaED67QqORO2NSiu-G9XbK9ieISIcVk6maF_1YeayCsi-5iDdGNwgnTAg3VkcIJ0woV3YWt1Mgg"}' 2025-12-11 04:14:09.647 INFO [src.node.waku_node] REST service is ready !! 2025-12-11 04:14:09.647 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:29887/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.226.216/tcp/30013/p2p/16Uiu2HAmGmof38142372Z7DG2xciu8k1HNoHk8JwezYVDPgh9NVR"]' 2025-12-11 04:14:09.675 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-11 04:14:09.677 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:29887/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.160.92/tcp/59080/p2p/16Uiu2HAm3EWnVX9TfVSvGUmu4JxYRsjEfp8UDx1DQhTYH9pNgVD3"]' 2025-12-11 04:14:09.700 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-11 04:14:09.700 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30012/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]' 2025-12-11 04:14:09.714 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-11 04:14:09.716 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59079/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]' 2025-12-11 04:14:09.722 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK' 2025-12-11 04:14:09.728 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:29887/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "timestamp": 1765426449727938816}}' 2025-12-11 04:14:09.731 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:29887/lightpush/v1/message. Response content: b'Invalid content body, could not decode: Unable to deserialize data: ' 2025-12-11 04:14:09.733 DEBUG [tests.conftest] Running fixture teardown: test_setup 2025-12-11 04:14:09.734 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes 2025-12-11 04:14:09.734 DEBUG [src.node.waku_node] Stopping container with id c4ebce408b05 2025-12-11 04:14:10.278 DEBUG [src.node.waku_node] Container stopped. 2025-12-11 04:14:10.278 DEBUG [src.node.waku_node] Stopping container with id 96e634660394 2025-12-11 04:14:10.808 DEBUG [src.node.waku_node] Container stopped. 2025-12-11 04:14:10.809 DEBUG [src.node.waku_node] Stopping container with id 0e690892fdce 2025-12-11 04:14:11.092 ERROR [src.node.docker_mananger] Max retries reached for container c4ebce408b05. Exiting log stream. 2025-12-11 04:14:11.326 DEBUG [src.node.waku_node] Container stopped. 2025-12-11 04:14:11.327 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors 2025-12-11 04:14:11.335 DEBUG [src.node.docker_mananger] No errors found in the waku logs. 2025-12-11 04:14:11.348 DEBUG [src.node.docker_mananger] No errors found in the waku logs. 2025-12-11 04:14:11.354 DEBUG [src.node.docker_mananger] No errors found in the waku logs.