2026-02-04 17:29:28 +00:00

97 lines
18 KiB
Plaintext

2026-02-04 17:12:01.856 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-04 17:12:01.857 DEBUG [tests.conftest] Running test: test_light_push_while_peer_is_paused with id: 2026-02-04_17-12-01__4a4288f8-2130-4535-860f-d1ecfa0d607d
2026-02-04 17:12:01.857 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-04 17:12:01.857 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-02-04 17:12:01.863 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-04 17:12:01.864 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-02-04_17-12-01__4a4288f8-2130-4535-860f-d1ecfa0d607d__wakuorg_nwaku:latest.log
2026-02-04 17:12:01.864 DEBUG [src.node.waku_node] Starting Node...
2026-02-04 17:12:01.864 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-04 17:12:01.865 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-04 17:12:01.865 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.162.46
2026-02-04 17:12:01.865 DEBUG [src.node.docker_mananger] Generated ports ['29368', '29369', '29370', '29371', '29372']
2026-02-04 17:12:01.866 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-04 17:12:01.866 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-04 17:12:01.866 DEBUG [src.node.waku_node] Using volumes []
2026-02-04 17:12:01.866 DEBUG [src.node.docker_mananger] docker run -i -t -p 29368:29368 -p 29369:29369 -p 29370:29370 -p 29371:29371 -p 29372:29372 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=29370 --rest-port=29368 --tcp-port=29369 --discv5-udp-port=29371 --rest-address=0.0.0.0 --nat=extip:172.18.162.46 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=b0cea157f6c4af0ca1dd7d4704be93b5fc66db314eb4eefbad5e5e5a73a9d59b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=29372 --metrics-logging=true --lightpush=true --relay=true
2026-02-04 17:12:02.045 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.162.46 waku d5a61f4bb29e2c6d61162d1431711e71cab9502461b34bb152c3afbc0b7614d5
2026-02-04 17:12:02.078 DEBUG [src.node.docker_mananger] Container started with ID d5a61f4bb29e. Setting up logs at ./log/docker/receiving_node1_2026-02-04_17-12-01__4a4288f8-2130-4535-860f-d1ecfa0d607d__wakuorg_nwaku:latest.log
2026-02-04 17:12:02.079 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 29368
2026-02-04 17:12:02.079 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-04 17:12:02.130 ERROR [src.node.docker_mananger] Max retries reached for container beadf33f59e1. Exiting log stream.
2026-02-04 17:12:02.660 ERROR [src.node.docker_mananger] Max retries reached for container a3126b3c0d9b. Exiting log stream.
2026-02-04 17:12:03.080 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29368/health" -H "Content-Type: application/json" -d 'None'
2026-02-04 17:12:03.085 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-02-04 17:12:03.086 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-04 17:12:03.086 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29368/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-04 17:12:03.089 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.162.46/tcp/29369/p2p/16Uiu2HAmPx4x3wdX9DYemdyArRa7YKsWZTE5k9DY16fJj11SzvgJ","/ip4/172.18.162.46/tcp/29370/ws/p2p/16Uiu2HAmPx4x3wdX9DYemdyArRa7YKsWZTE5k9DY16fJj11SzvgJ"],"enrUri":"enr:-L24QHGPOmTQ3tEKMMtFVH9NMLPj618bTzYae2LZrDt3JD0oMqvi-D7KPrF3B91OMsLbhj__4hpQOcvh3q10ObviyuQCgmlkgnY0gmlwhKwSoi6KbXVsdGlhZGRyc5YACASsEqIuBnK5AAoErBKiLgZyut0DgnJzhQADAQAAiXNlY3AyNTZrMaEDp9ChZBR-Z-fU0f7Gs1vG0Qou33oUKTf0JaT5dwYURNODdGNwgnK5g3VkcIJyu4V3YWt1Mgk"}'
2026-02-04 17:12:03.089 INFO [src.node.waku_node] REST service is ready !!
2026-02-04 17:12:03.096 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-04 17:12:03.096 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-02-04_17-12-01__4a4288f8-2130-4535-860f-d1ecfa0d607d__wakuorg_nwaku:latest.log
2026-02-04 17:12:03.096 DEBUG [src.node.waku_node] Starting Node...
2026-02-04 17:12:03.096 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-04 17:12:03.098 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-04 17:12:03.098 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.133.177
2026-02-04 17:12:03.098 DEBUG [src.node.docker_mananger] Generated ports ['22024', '22025', '22026', '22027', '22028']
2026-02-04 17:12:03.098 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-04 17:12:03.098 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-04 17:12:03.098 DEBUG [src.node.waku_node] Using volumes []
2026-02-04 17:12:03.099 DEBUG [src.node.docker_mananger] docker run -i -t -p 22024:22024 -p 22025:22025 -p 22026:22026 -p 22027:22027 -p 22028:22028 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=22026 --rest-port=22024 --tcp-port=22025 --discv5-udp-port=22027 --rest-address=0.0.0.0 --nat=extip:172.18.133.177 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e9101a360409f85adaffefb9c7d4bf345fd1a7be4c6844ebb9d4afd1dfbabfdc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=22028 --metrics-logging=true --lightpush=false --relay=true
2026-02-04 17:12:03.279 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.133.177 waku 506e97661d838e7b1277f96b42a9acff97e9efeee95ee403f52c0bae5fcce073
2026-02-04 17:12:03.309 DEBUG [src.node.docker_mananger] Container started with ID 506e97661d83. Setting up logs at ./log/docker/receiving_node2_2026-02-04_17-12-01__4a4288f8-2130-4535-860f-d1ecfa0d607d__wakuorg_nwaku:latest.log
2026-02-04 17:12:03.309 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 22024
2026-02-04 17:12:03.310 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-04 17:12:04.310 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22024/health" -H "Content-Type: application/json" -d 'None'
2026-02-04 17:12:04.314 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-02-04 17:12:04.314 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-04 17:12:04.314 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22024/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-04 17:12:04.317 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.133.177/tcp/22025/p2p/16Uiu2HAmFWnQDk33nbAfh1K5vw6GqxDTpRgD8B6GfwVQoRpNAa1T","/ip4/172.18.133.177/tcp/22026/ws/p2p/16Uiu2HAmFWnQDk33nbAfh1K5vw6GqxDTpRgD8B6GfwVQoRpNAa1T"],"enrUri":"enr:-L24QJqv_8y0UhTIo_R7aO5CQquKQXttq0hoDRI2_qxr6Y-OOx-SEosmIRb4_2XqPccUMQcujzeBwG5naEjccaYWqmUCgmlkgnY0gmlwhKwShbGKbXVsdGlhZGRyc5YACASsEoWxBlYJAAoErBKFsQZWCt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDKnjnKrah5AujMLWeQ4VD8dnP_Mx99s64D0vKDg9SJ9aDdGNwglYJg3VkcIJWC4V3YWt1MgE"}'
2026-02-04 17:12:04.317 INFO [src.node.waku_node] REST service is ready !!
2026-02-04 17:12:04.318 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22024/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.162.46/tcp/29369/p2p/16Uiu2HAmPx4x3wdX9DYemdyArRa7YKsWZTE5k9DY16fJj11SzvgJ"]'
2026-02-04 17:12:04.349 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 17:12:04.361 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-04 17:12:04.362 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-02-04_17-12-01__4a4288f8-2130-4535-860f-d1ecfa0d607d__wakuorg_nwaku:latest.log
2026-02-04 17:12:04.362 DEBUG [src.node.waku_node] Starting Node...
2026-02-04 17:12:04.362 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-04 17:12:04.367 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-04 17:12:04.368 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.94.170
2026-02-04 17:12:04.369 DEBUG [src.node.docker_mananger] Generated ports ['13495', '13496', '13497', '13498', '13499']
2026-02-04 17:12:04.369 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-04 17:12:04.370 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-04 17:12:04.370 DEBUG [src.node.waku_node] Using volumes []
2026-02-04 17:12:04.370 DEBUG [src.node.docker_mananger] docker run -i -t -p 13495:13495 -p 13496:13496 -p 13497:13497 -p 13498:13498 -p 13499:13499 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13497 --rest-port=13495 --tcp-port=13496 --discv5-udp-port=13498 --rest-address=0.0.0.0 --nat=extip:172.18.94.170 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ba4d7debe6a4a6b1d9edf9bd2cf2dc6a3bb2e4a0aedbc2e35b5e70f1a8c047da --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13499 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QHGPOmTQ3tEKMMtFVH9NMLPj618bTzYae2LZrDt3JD0oMqvi-D7KPrF3B91OMsLbhj__4hpQOcvh3q10ObviyuQCgmlkgnY0gmlwhKwSoi6KbXVsdGlhZGRyc5YACASsEqIuBnK5AAoErBKiLgZyut0DgnJzhQADAQAAiXNlY3AyNTZrMaEDp9ChZBR-Z-fU0f7Gs1vG0Qou33oUKTf0JaT5dwYURNODdGNwgnK5g3VkcIJyu4V3YWt1Mgk --lightpushnode=/ip4/172.18.162.46/tcp/29369/p2p/16Uiu2HAmPx4x3wdX9DYemdyArRa7YKsWZTE5k9DY16fJj11SzvgJ --lightpush=true --relay=true
2026-02-04 17:12:04.554 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.94.170 waku bef6388279b93fabcb7adce1e36b8ee31b24fd12c2e19b2ca2a6dd1e287d70c8
2026-02-04 17:12:04.585 DEBUG [src.node.docker_mananger] Container started with ID bef6388279b9. Setting up logs at ./log/docker/lightpush_node1_2026-02-04_17-12-01__4a4288f8-2130-4535-860f-d1ecfa0d607d__wakuorg_nwaku:latest.log
2026-02-04 17:12:04.586 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 13495
2026-02-04 17:12:04.587 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-04 17:12:05.588 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13495/health" -H "Content-Type: application/json" -d 'None'
2026-02-04 17:12:05.591 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-02-04 17:12:05.592 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-04 17:12:05.592 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13495/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-04 17:12:05.594 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.94.170/tcp/13496/p2p/16Uiu2HAm1qdCVeEXjmC4vngsSZZS793THezCW8fcpAPH4NjKbGNN","/ip4/172.18.94.170/tcp/13497/ws/p2p/16Uiu2HAm1qdCVeEXjmC4vngsSZZS793THezCW8fcpAPH4NjKbGNN"],"enrUri":"enr:-L24QOrzf8czanG5KmRa62UJTLv835UsvFcgZdNlrcLe-UUoK3A5Ugsjrs_IrX-Z2D_uNuNkDT6srKxF0GPopTjXhYMCgmlkgnY0gmlwhKwSXqqKbXVsdGlhZGRyc5YACASsEl6qBjS4AAoErBJeqgY0ud0DgnJzhQADAQAAiXNlY3AyNTZrMaECX0jqnetMnQmJiWOD4fSfObyaPBUqf7epNjb9DOlf9WODdGNwgjS4g3VkcII0uoV3YWt1Mgk"}'
2026-02-04 17:12:05.594 INFO [src.node.waku_node] REST service is ready !!
2026-02-04 17:12:05.595 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13495/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.162.46/tcp/29369/p2p/16Uiu2HAmPx4x3wdX9DYemdyArRa7YKsWZTE5k9DY16fJj11SzvgJ"]'
2026-02-04 17:12:05.636 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 17:12:05.638 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13495/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.133.177/tcp/22025/p2p/16Uiu2HAmFWnQDk33nbAfh1K5vw6GqxDTpRgD8B6GfwVQoRpNAa1T"]'
2026-02-04 17:12:05.663 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 17:12:05.664 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:29368/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-02-04 17:12:05.669 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 17:12:05.670 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22024/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-02-04 17:12:05.674 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 17:12:05.677 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13495/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-02-04 17:12:05.681 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-04 17:12:05.684 DEBUG [src.node.waku_node] Stopping container with id d5a61f4bb29e
2026-02-04 17:12:06.221 DEBUG [src.node.waku_node] Container stopped.
2026-02-04 17:12:06.221 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13495/lightpush/v1/message" -H "Content-Type: application/json" -d '{"pubsubTopic": "/waku/2/rs/3/0", "message": {"payload": "TGlnaHQgcHVzaCB3b3JrcyEh", "contentTopic": "/myapp/1/latest/proto", "timestamp": 1770225125684810300}}'
2026-02-04 17:12:07.035 ERROR [src.node.docker_mananger] Max retries reached for container d5a61f4bb29e. Exiting log stream.
2026-02-04 17:12:11.230 ERROR [src.node.api_clients.base_client] HTTP error occurred: 503 Server Error: Service Unavailable for url: http://127.0.0.1:13495/lightpush/v1/message. Response content: b'Failed to request a message push: dial_failure'
2026-02-04 17:12:11.232 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-04 17:12:11.233 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-04 17:12:11.233 DEBUG [src.node.waku_node] Stopping container with id 506e97661d83
2026-02-04 17:12:11.733 DEBUG [src.node.waku_node] Container stopped.
2026-02-04 17:12:11.733 DEBUG [src.node.waku_node] Stopping container with id bef6388279b9
2026-02-04 17:12:12.253 DEBUG [src.node.waku_node] Container stopped.
2026-02-04 17:12:12.256 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-04 17:12:12.263 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-04 17:12:12.270 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-04 17:12:12.277 DEBUG [src.node.docker_mananger] No errors found in the waku logs.