98 lines
18 KiB
Plaintext

2026-03-07 04:34:18.355 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-07 04:34:18.355 DEBUG [tests.conftest] Running test: test_light_push_on_non_subscribed_pubsub_topic with id: 2026-03-07_04-34-18__f1d1dbbf-3d8a-42fe-b321-331be2b305d6
2026-03-07 04:34:18.356 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-07 04:34:18.356 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-07 04:34:18.362 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:34:18.362 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-03-07_04-34-18__f1d1dbbf-3d8a-42fe-b321-331be2b305d6__wakuorg_nwaku:latest.log
2026-03-07 04:34:18.363 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:34:18.363 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:34:18.364 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:34:18.364 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.30.103
2026-03-07 04:34:18.364 DEBUG [src.node.docker_mananger] Generated ports ['2534', '2535', '2536', '2537', '2538']
2026-03-07 04:34:18.364 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:34:18.365 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:34:18.365 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:34:18.365 DEBUG [src.node.docker_mananger] docker run -i -t -p 2534:2534 -p 2535:2535 -p 2536:2536 -p 2537:2537 -p 2538:2538 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=2536 --rest-port=2534 --tcp-port=2535 --discv5-udp-port=2537 --rest-address=0.0.0.0 --nat=extip:172.18.30.103 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=6ec8ade4cda5524a984bdde5f4aab2c7affe6aa6b5be6df0bedfff0aaa532ac4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=2538 --metrics-logging=true --lightpush=true --relay=true
2026-03-07 04:34:18.518 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.30.103 waku b957279aa3e9993e5fbc3e8e36aab1e21d6274c982c608e90a3c288bca9e356c
2026-03-07 04:34:18.551 DEBUG [src.node.docker_mananger] Container started with ID b957279aa3e9. Setting up logs at ./log/docker/receiving_node1_2026-03-07_04-34-18__f1d1dbbf-3d8a-42fe-b321-331be2b305d6__wakuorg_nwaku:latest.log
2026-03-07 04:34:18.551 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 2534
2026-03-07 04:34:18.552 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:34:18.654 ERROR [src.node.docker_mananger] Max retries reached for container 9678e6fb2f9a. Exiting log stream.
2026-03-07 04:34:19.155 ERROR [src.node.docker_mananger] Max retries reached for container 87adec3bf122. Exiting log stream.
2026-03-07 04:34:19.552 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2534/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:34:19.555 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:34:19.555 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:34:19.555 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2534/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:34:19.558 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.30.103/tcp/2535/p2p/16Uiu2HAmN7BZwAaUtZmPJzRnXcJWnHsbifNMXq1igizQr78jrjuY","/ip4/172.18.30.103/tcp/2536/ws/p2p/16Uiu2HAmN7BZwAaUtZmPJzRnXcJWnHsbifNMXq1igizQr78jrjuY"],"enrUri":"enr:-L24QN2vvxyCA1_QHnqkPkg1v-w65Dc3GTc0IYzvH4Jd11aFf-4CGgcJIaXd8IjxcPIXYEhivfpm7NJSHmw2Ref52eMCgmlkgnY0gmlwhKwSHmeKbXVsdGlhZGRyc5YACASsEh5nBgnnAAoErBIeZwYJ6N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDjG73thZZ7UiFJV-t44EodVU3BR-M0n62IdccCOvvBneDdGNwggnng3VkcIIJ6YV3YWt1Mgk"}'
2026-03-07 04:34:19.558 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:34:19.564 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:34:19.564 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-03-07_04-34-18__f1d1dbbf-3d8a-42fe-b321-331be2b305d6__wakuorg_nwaku:latest.log
2026-03-07 04:34:19.564 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:34:19.564 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:34:19.566 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:34:19.566 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.197.174
2026-03-07 04:34:19.566 DEBUG [src.node.docker_mananger] Generated ports ['33003', '33004', '33005', '33006', '33007']
2026-03-07 04:34:19.566 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:34:19.566 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:34:19.567 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:34:19.567 DEBUG [src.node.docker_mananger] docker run -i -t -p 33003:33003 -p 33004:33004 -p 33005:33005 -p 33006:33006 -p 33007:33007 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=33005 --rest-port=33003 --tcp-port=33004 --discv5-udp-port=33006 --rest-address=0.0.0.0 --nat=extip:172.18.197.174 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=781c64bc2b7fbe829e6baa1ddc2caa6aef04dabcfc35f52e83c79aaca8eb4d9e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=33007 --metrics-logging=true --lightpush=false --relay=true
2026-03-07 04:34:19.723 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.197.174 waku 7044288f3987afe55abb70ed658b9b1dfea821fd3155bc867842f3de191b996f
2026-03-07 04:34:19.752 DEBUG [src.node.docker_mananger] Container started with ID 7044288f3987. Setting up logs at ./log/docker/receiving_node2_2026-03-07_04-34-18__f1d1dbbf-3d8a-42fe-b321-331be2b305d6__wakuorg_nwaku:latest.log
2026-03-07 04:34:19.752 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 33003
2026-03-07 04:34:19.753 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:34:20.753 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33003/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:34:20.756 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:34:20.756 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:34:20.756 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33003/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:34:20.759 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.197.174/tcp/33004/p2p/16Uiu2HAmAGC7f3EEAmC1aYB5sNtdJmooDnsuE6CRYyjhVtranxcf","/ip4/172.18.197.174/tcp/33005/ws/p2p/16Uiu2HAmAGC7f3EEAmC1aYB5sNtdJmooDnsuE6CRYyjhVtranxcf"],"enrUri":"enr:-L24QGZrhQUJrTM1nI5dEFEMFyH9Wx-n4o_2hkNw2_25CkaEHLOndWKmb7mg0R9caTgFxYgjvNWYE00WVF0RjXteV8ECgmlkgnY0gmlwhKwSxa6KbXVsdGlhZGRyc5YACASsEsWuBoDsAAoErBLFrgaA7d0DgnJzhQADAQAAiXNlY3AyNTZrMaEC3HGR-N0groqG6V66v_LOLFDuevlrZ9G63tS4Jheur0iDdGNwgoDsg3VkcIKA7oV3YWt1MgE"}'
2026-03-07 04:34:20.759 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:34:20.759 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33003/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.30.103/tcp/2535/p2p/16Uiu2HAmN7BZwAaUtZmPJzRnXcJWnHsbifNMXq1igizQr78jrjuY"]'
2026-03-07 04:34:20.792 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:34:20.803 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:34:20.804 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-03-07_04-34-18__f1d1dbbf-3d8a-42fe-b321-331be2b305d6__wakuorg_nwaku:latest.log
2026-03-07 04:34:20.804 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:34:20.804 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:34:20.806 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:34:20.806 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.40.83
2026-03-07 04:34:20.806 DEBUG [src.node.docker_mananger] Generated ports ['27532', '27533', '27534', '27535', '27536']
2026-03-07 04:34:20.806 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:34:20.806 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:34:20.806 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:34:20.806 DEBUG [src.node.docker_mananger] docker run -i -t -p 27532:27532 -p 27533:27533 -p 27534:27534 -p 27535:27535 -p 27536:27536 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=27534 --rest-port=27532 --tcp-port=27533 --discv5-udp-port=27535 --rest-address=0.0.0.0 --nat=extip:172.18.40.83 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=aba2ef00153d48fd18bb7bb8841ad0e31bba35f2c62a22cd2f2ff9b056270cda --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=27536 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QN2vvxyCA1_QHnqkPkg1v-w65Dc3GTc0IYzvH4Jd11aFf-4CGgcJIaXd8IjxcPIXYEhivfpm7NJSHmw2Ref52eMCgmlkgnY0gmlwhKwSHmeKbXVsdGlhZGRyc5YACASsEh5nBgnnAAoErBIeZwYJ6N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDjG73thZZ7UiFJV-t44EodVU3BR-M0n62IdccCOvvBneDdGNwggnng3VkcIIJ6YV3YWt1Mgk --lightpushnode=/ip4/172.18.30.103/tcp/2535/p2p/16Uiu2HAmN7BZwAaUtZmPJzRnXcJWnHsbifNMXq1igizQr78jrjuY --lightpush=true --relay=true
2026-03-07 04:34:20.976 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.40.83 waku 15a3d031d79b0802dec1d0d7642433f29e7321858d94321922a0de76bfd18dae
2026-03-07 04:34:21.003 DEBUG [src.node.docker_mananger] Container started with ID 15a3d031d79b. Setting up logs at ./log/docker/lightpush_node1_2026-03-07_04-34-18__f1d1dbbf-3d8a-42fe-b321-331be2b305d6__wakuorg_nwaku:latest.log
2026-03-07 04:34:21.004 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 27532
2026-03-07 04:34:21.004 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:34:22.004 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:27532/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:34:22.007 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:34:22.007 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:34:22.007 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:27532/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:34:22.009 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.40.83/tcp/27533/p2p/16Uiu2HAmBYDu36mQscrKz62QktRoWs7SUvPV3AgHKjf1ACsbq3co","/ip4/172.18.40.83/tcp/27534/ws/p2p/16Uiu2HAmBYDu36mQscrKz62QktRoWs7SUvPV3AgHKjf1ACsbq3co"],"enrUri":"enr:-L24QNGymvY96DPJy2QWjYI8VaNDTnOomk8XGxByfN3wenDtJaOi7YUEgC9tYRlpJqxUMWzU_SsD9UfLT-e84eZiPbgCgmlkgnY0gmlwhKwSKFOKbXVsdGlhZGRyc5YACASsEihTBmuNAAoErBIoUwZrjt0DgnJzhQADAQAAiXNlY3AyNTZrMaEC72iQwj5VqXsLR_AoEYuEKVGGZBzH6zqkn7Vuc2WVloSDdGNwgmuNg3VkcIJrj4V3YWt1Mgk"}'
2026-03-07 04:34:22.010 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:34:22.010 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27532/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.30.103/tcp/2535/p2p/16Uiu2HAmN7BZwAaUtZmPJzRnXcJWnHsbifNMXq1igizQr78jrjuY"]'
2026-03-07 04:34:22.054 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:34:22.054 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27532/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.197.174/tcp/33004/p2p/16Uiu2HAmAGC7f3EEAmC1aYB5sNtdJmooDnsuE6CRYyjhVtranxcf"]'
2026-03-07 04:34:22.084 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:34:22.086 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2534/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-07 04:34:22.090 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:34:22.091 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33003/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-07 04:34:22.093 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:34:22.094 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27532/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-07 04:34:22.096 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:34:22.097 DEBUG [src.steps.light_push] Lightpushing message
2026-03-07 04:34:22.097 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27532/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/1", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1772858062097526546}}'
2026-03-07 04:34:22.105 ERROR [src.node.api_clients.base_client] HTTP error occurred: 503 Server Error: Service Unavailable for url: http://127.0.0.1:27532/lightpush/v1/message. Response content: b'Failed to request a message push: not_published_to_any_peer'
2026-03-07 04:34:22.107 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-07 04:34:22.108 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-07 04:34:22.108 DEBUG [src.node.waku_node] Stopping container with id b957279aa3e9
2026-03-07 04:34:22.577 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:34:22.578 DEBUG [src.node.waku_node] Stopping container with id 7044288f3987
2026-03-07 04:34:23.091 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:34:23.092 DEBUG [src.node.waku_node] Stopping container with id 15a3d031d79b
2026-03-07 04:34:23.390 ERROR [src.node.docker_mananger] Max retries reached for container b957279aa3e9. Exiting log stream.
2026-03-07 04:34:23.596 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:34:23.598 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-07 04:34:23.606 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:34:23.613 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:34:23.621 DEBUG [src.node.docker_mananger] No errors found in the waku logs.