97 lines
18 KiB
Plaintext

2026-03-08 04:35:13.663 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-08 04:35:13.664 DEBUG [tests.conftest] Running test: test_light_push_with_missing_pubsub_topics with id: 2026-03-08_04-35-13__de671f52-92f0-4893-b331-0e56ad3b358c
2026-03-08 04:35:13.664 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-08 04:35:13.664 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-08 04:35:13.671 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-08 04:35:13.671 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-03-08_04-35-13__de671f52-92f0-4893-b331-0e56ad3b358c__wakuorg_nwaku:latest.log
2026-03-08 04:35:13.671 DEBUG [src.node.waku_node] Starting Node...
2026-03-08 04:35:13.672 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-08 04:35:13.674 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-08 04:35:13.674 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.22.211
2026-03-08 04:35:13.674 DEBUG [src.node.docker_mananger] Generated ports ['1303', '1304', '1305', '1306', '1307']
2026-03-08 04:35:13.674 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-08 04:35:13.674 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-08 04:35:13.675 DEBUG [src.node.waku_node] Using volumes []
2026-03-08 04:35:13.675 DEBUG [src.node.docker_mananger] docker run -i -t -p 1303:1303 -p 1304:1304 -p 1305:1305 -p 1306:1306 -p 1307:1307 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=1305 --rest-port=1303 --tcp-port=1304 --discv5-udp-port=1306 --rest-address=0.0.0.0 --nat=extip:172.18.22.211 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8efd257ab229acdcbe5ac06ba9f2aec8e23fb22596a6d6eb09b8d3adfecaa225 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=1307 --metrics-logging=true --lightpush=true --relay=true
2026-03-08 04:35:13.836 ERROR [src.node.docker_mananger] Max retries reached for container ae167ef2f91d. Exiting log stream.
2026-03-08 04:35:13.861 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.22.211 waku 8274ff9a6a7565a0e890ef7df26765be59c66d3c4572e79349d98088cb3149f6
2026-03-08 04:35:13.894 DEBUG [src.node.docker_mananger] Container started with ID 8274ff9a6a75. Setting up logs at ./log/docker/receiving_node1_2026-03-08_04-35-13__de671f52-92f0-4893-b331-0e56ad3b358c__wakuorg_nwaku:latest.log
2026-03-08 04:35:13.894 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 1303
2026-03-08 04:35:13.896 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-08 04:35:14.286 ERROR [src.node.docker_mananger] Max retries reached for container ea83e1d029ad. Exiting log stream.
2026-03-08 04:35:14.896 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1303/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:35:14.899 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:35:14.899 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:35:14.899 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1303/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:35:14.902 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.22.211/tcp/1304/p2p/16Uiu2HAkxMbf6Le8ANLEUw9MddfUD5m3RaihTEabi5GQvj8sSPP6","/ip4/172.18.22.211/tcp/1305/ws/p2p/16Uiu2HAkxMbf6Le8ANLEUw9MddfUD5m3RaihTEabi5GQvj8sSPP6"],"enrUri":"enr:-L24QJKBTyBLb72P5GsqfptL0gVJkKRGnLp7d6cJ0dkYmSreA-iLYJNMlSearl3r5GQWAiKheG2veR1HhN2iHlgIdVwCgmlkgnY0gmlwhKwSFtOKbXVsdGlhZGRyc5YACASsEhbTBgUYAAoErBIW0wYFGd0DgnJzhQADAQAAiXNlY3AyNTZrMaECK4fZpCjJUjqoCRjn-xNgTmWZYFK4rLYvKuyLmQ0PAIGDdGNwggUYg3VkcIIFGoV3YWt1Mgk"}'
2026-03-08 04:35:14.902 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:35:14.909 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-08 04:35:14.909 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-03-08_04-35-13__de671f52-92f0-4893-b331-0e56ad3b358c__wakuorg_nwaku:latest.log
2026-03-08 04:35:14.909 DEBUG [src.node.waku_node] Starting Node...
2026-03-08 04:35:14.909 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-08 04:35:14.910 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-08 04:35:14.911 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.37.244
2026-03-08 04:35:14.911 DEBUG [src.node.docker_mananger] Generated ports ['38772', '38773', '38774', '38775', '38776']
2026-03-08 04:35:14.911 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-08 04:35:14.911 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-08 04:35:14.911 DEBUG [src.node.waku_node] Using volumes []
2026-03-08 04:35:14.911 DEBUG [src.node.docker_mananger] docker run -i -t -p 38772:38772 -p 38773:38773 -p 38774:38774 -p 38775:38775 -p 38776:38776 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=38774 --rest-port=38772 --tcp-port=38773 --discv5-udp-port=38775 --rest-address=0.0.0.0 --nat=extip:172.18.37.244 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a1cf590d73bb94e4b3e38fdcefa4448408a4d9fe922e4483b3ecbe94428f3d76 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=38776 --metrics-logging=true --lightpush=false --relay=true
2026-03-08 04:35:15.101 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.37.244 waku a76bc7c558aa08a80d9020d04de5d7c61553e5245867d3e24db16506415839f4
2026-03-08 04:35:15.136 DEBUG [src.node.docker_mananger] Container started with ID a76bc7c558aa. Setting up logs at ./log/docker/receiving_node2_2026-03-08_04-35-13__de671f52-92f0-4893-b331-0e56ad3b358c__wakuorg_nwaku:latest.log
2026-03-08 04:35:15.136 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 38772
2026-03-08 04:35:15.137 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-08 04:35:16.137 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38772/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:35:16.140 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:35:16.140 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:35:16.140 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38772/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:35:16.142 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.37.244/tcp/38773/p2p/16Uiu2HAm2HE27bynuK6jXywNrXteaJeEND7kdSuxYaLQaawEoSVi","/ip4/172.18.37.244/tcp/38774/ws/p2p/16Uiu2HAm2HE27bynuK6jXywNrXteaJeEND7kdSuxYaLQaawEoSVi"],"enrUri":"enr:-L24QAA1C649OhJdr67eUud5s489M80M2n-ejDvjgxPavdeYbpppYWzZOCANq90LTO-pCb_Xdd6SLRr_KDAOfVxygZYCgmlkgnY0gmlwhKwSJfSKbXVsdGlhZGRyc5YACASsEiX0Bpd1AAoErBIl9AaXdt0DgnJzhQADAQAAiXNlY3AyNTZrMaECZdfPGJFT_Y5ehZbbpXIRwh4Nyc0VzRG1Z15zEsRO9YWDdGNwgpd1g3VkcIKXd4V3YWt1MgE"}'
2026-03-08 04:35:16.143 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:35:16.143 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38772/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.22.211/tcp/1304/p2p/16Uiu2HAkxMbf6Le8ANLEUw9MddfUD5m3RaihTEabi5GQvj8sSPP6"]'
2026-03-08 04:35:16.181 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:35:16.190 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-08 04:35:16.190 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-03-08_04-35-13__de671f52-92f0-4893-b331-0e56ad3b358c__wakuorg_nwaku:latest.log
2026-03-08 04:35:16.190 DEBUG [src.node.waku_node] Starting Node...
2026-03-08 04:35:16.190 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-08 04:35:16.192 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-08 04:35:16.192 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.171.25
2026-03-08 04:35:16.192 DEBUG [src.node.docker_mananger] Generated ports ['44731', '44732', '44733', '44734', '44735']
2026-03-08 04:35:16.192 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-08 04:35:16.192 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-08 04:35:16.192 DEBUG [src.node.waku_node] Using volumes []
2026-03-08 04:35:16.193 DEBUG [src.node.docker_mananger] docker run -i -t -p 44731:44731 -p 44732:44732 -p 44733:44733 -p 44734:44734 -p 44735:44735 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=44733 --rest-port=44731 --tcp-port=44732 --discv5-udp-port=44734 --rest-address=0.0.0.0 --nat=extip:172.18.171.25 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=1bb836e21e367fb8a9ca7c0cf8bd1a7fddf3339bb2f6acbd1fafb230d0bd4624 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=44735 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QJKBTyBLb72P5GsqfptL0gVJkKRGnLp7d6cJ0dkYmSreA-iLYJNMlSearl3r5GQWAiKheG2veR1HhN2iHlgIdVwCgmlkgnY0gmlwhKwSFtOKbXVsdGlhZGRyc5YACASsEhbTBgUYAAoErBIW0wYFGd0DgnJzhQADAQAAiXNlY3AyNTZrMaECK4fZpCjJUjqoCRjn-xNgTmWZYFK4rLYvKuyLmQ0PAIGDdGNwggUYg3VkcIIFGoV3YWt1Mgk --lightpushnode=/ip4/172.18.22.211/tcp/1304/p2p/16Uiu2HAkxMbf6Le8ANLEUw9MddfUD5m3RaihTEabi5GQvj8sSPP6 --lightpush=true --relay=true
2026-03-08 04:35:16.401 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.171.25 waku fb1ee687d06cedcb261f6f0d19773728e6bbabaf5a110264dedad46b5ada2466
2026-03-08 04:35:16.435 DEBUG [src.node.docker_mananger] Container started with ID fb1ee687d06c. Setting up logs at ./log/docker/lightpush_node1_2026-03-08_04-35-13__de671f52-92f0-4893-b331-0e56ad3b358c__wakuorg_nwaku:latest.log
2026-03-08 04:35:16.435 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 44731
2026-03-08 04:35:16.436 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-08 04:35:17.436 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44731/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:35:17.439 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:35:17.439 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:35:17.439 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44731/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:35:17.441 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.171.25/tcp/44732/p2p/16Uiu2HAkzaqxHpBwfkL3sveM5xshZKD3BEnBeKZuHozTcogf1XV4","/ip4/172.18.171.25/tcp/44733/ws/p2p/16Uiu2HAkzaqxHpBwfkL3sveM5xshZKD3BEnBeKZuHozTcogf1XV4"],"enrUri":"enr:-L24QPwrbExEdaoc6xBhxbk6v3opPDH9nTja2xiTdQdFsXhPWgQixv61VZoJ2iKIkr2Qg_075RX2XnrvSe0QnWVkRp0CgmlkgnY0gmlwhKwSqxmKbXVsdGlhZGRyc5YACASsEqsZBq68AAoErBKrGQauvd0DgnJzhQADAQAAiXNlY3AyNTZrMaECTKPwjQ5vfOtVOhSq3uCpgRDLrDkTXHc-H5am0Mm8V1ODdGNwgq68g3VkcIKuvoV3YWt1Mgk"}'
2026-03-08 04:35:17.442 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:35:17.442 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44731/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.22.211/tcp/1304/p2p/16Uiu2HAkxMbf6Le8ANLEUw9MddfUD5m3RaihTEabi5GQvj8sSPP6"]'
2026-03-08 04:35:17.502 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:35:17.503 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44731/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.37.244/tcp/38773/p2p/16Uiu2HAm2HE27bynuK6jXywNrXteaJeEND7kdSuxYaLQaawEoSVi"]'
2026-03-08 04:35:17.537 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:35:17.538 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1303/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-08 04:35:17.543 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:35:17.545 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38772/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-08 04:35:17.550 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:35:17.550 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44731/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-08 04:35:17.559 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:35:17.560 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44731/lightpush/v1/message" -H "Content-Type: application/json" -d '{"message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1772944517560322288}}'
2026-03-08 04:35:17.574 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:35:17.577 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-08 04:35:17.578 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-08 04:35:17.578 DEBUG [src.node.waku_node] Stopping container with id 8274ff9a6a75
2026-03-08 04:35:18.189 DEBUG [src.node.waku_node] Container stopped.
2026-03-08 04:35:18.189 DEBUG [src.node.waku_node] Stopping container with id a76bc7c558aa
2026-03-08 04:35:18.755 DEBUG [src.node.waku_node] Container stopped.
2026-03-08 04:35:18.755 DEBUG [src.node.waku_node] Stopping container with id fb1ee687d06c
2026-03-08 04:35:19.002 ERROR [src.node.docker_mananger] Max retries reached for container 8274ff9a6a75. Exiting log stream.
2026-03-08 04:35:19.281 DEBUG [src.node.waku_node] Container stopped.
2026-03-08 04:35:19.283 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-08 04:35:19.293 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-08 04:35:19.301 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-08 04:35:19.309 DEBUG [src.node.docker_mananger] No errors found in the waku logs.