99 lines
18 KiB
Plaintext

2026-03-22 04:40:22.972 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-22 04:40:22.972 DEBUG [tests.conftest] Running test: test_light_push_with_payload_of_1_MB with id: 2026-03-22_04-40-22__84d97455-bf71-43f8-af29-d0791f7f54fd
2026-03-22 04:40:22.972 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-22 04:40:22.973 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-22 04:40:22.980 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-22 04:40:22.980 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-03-22_04-40-22__84d97455-bf71-43f8-af29-d0791f7f54fd__wakuorg_nwaku:latest.log
2026-03-22 04:40:22.980 DEBUG [src.node.waku_node] Starting Node...
2026-03-22 04:40:22.980 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-22 04:40:22.982 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-22 04:40:22.982 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.198.102
2026-03-22 04:40:22.982 DEBUG [src.node.docker_mananger] Generated ports ['51265', '51266', '51267', '51268', '51269']
2026-03-22 04:40:22.982 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-22 04:40:22.982 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-22 04:40:22.982 DEBUG [src.node.waku_node] Using volumes []
2026-03-22 04:40:22.983 DEBUG [src.node.docker_mananger] docker run -i -t -p 51265:51265 -p 51266:51266 -p 51267:51267 -p 51268:51268 -p 51269:51269 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=51267 --rest-port=51265 --tcp-port=51266 --discv5-udp-port=51268 --rest-address=0.0.0.0 --nat=extip:172.18.198.102 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cfbfa19ca7e5e651a68c7adccf0a077cce7c40351425fbfdbf3ebe23c1cfbebb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=51269 --metrics-logging=true --lightpush=true --relay=true
2026-03-22 04:40:23.166 ERROR [src.node.docker_mananger] Max retries reached for container 3e38e75700fd. Exiting log stream.
2026-03-22 04:40:23.179 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.198.102 waku 184a76a48ad2f48e31aba1a2643badbfeaf267c4f6f360bfccc8e883c175dd18
2026-03-22 04:40:23.214 DEBUG [src.node.docker_mananger] Container started with ID 184a76a48ad2. Setting up logs at ./log/docker/receiving_node1_2026-03-22_04-40-22__84d97455-bf71-43f8-af29-d0791f7f54fd__wakuorg_nwaku:latest.log
2026-03-22 04:40:23.215 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 51265
2026-03-22 04:40:23.216 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-22 04:40:23.674 ERROR [src.node.docker_mananger] Max retries reached for container af80a244553b. Exiting log stream.
2026-03-22 04:40:24.216 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:51265/health" -H "Content-Type: application/json" -d 'None'
2026-03-22 04:40:24.219 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-22 04:40:24.219 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-22 04:40:24.219 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:51265/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-22 04:40:24.222 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.198.102/tcp/51266/p2p/16Uiu2HAmKjVeZEwb86t62uJQcDJ8zQpYhFQmKMpKpKL89XgvPr4o","/ip4/172.18.198.102/tcp/51267/ws/p2p/16Uiu2HAmKjVeZEwb86t62uJQcDJ8zQpYhFQmKMpKpKL89XgvPr4o"],"enrUri":"enr:-L24QDFDKJeb89VB8m2qeHmEYncP7tieh5x_lh8C_SqI24SkKIHitR7Yoi1ToJkyRM70BfkGuYjXtzW8fjtJ97Ygoc8CgmlkgnY0gmlwhKwSxmaKbXVsdGlhZGRyc5YACASsEsZmBshCAAoErBLGZgbIQ90DgnJzhQADAQAAiXNlY3AyNTZrMaEDaSlCPMYf2UdV6Rarg5JI_-Poouvod5Ost4WFkhi3qGCDdGNwgshCg3VkcILIRIV3YWt1Mgk"}'
2026-03-22 04:40:24.222 INFO [src.node.waku_node] REST service is ready !!
2026-03-22 04:40:24.230 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-22 04:40:24.230 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-03-22_04-40-22__84d97455-bf71-43f8-af29-d0791f7f54fd__wakuorg_nwaku:latest.log
2026-03-22 04:40:24.230 DEBUG [src.node.waku_node] Starting Node...
2026-03-22 04:40:24.230 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-22 04:40:24.232 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-22 04:40:24.232 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.227.82
2026-03-22 04:40:24.232 DEBUG [src.node.docker_mananger] Generated ports ['56385', '56386', '56387', '56388', '56389']
2026-03-22 04:40:24.232 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-22 04:40:24.232 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-22 04:40:24.233 DEBUG [src.node.waku_node] Using volumes []
2026-03-22 04:40:24.233 DEBUG [src.node.docker_mananger] docker run -i -t -p 56385:56385 -p 56386:56386 -p 56387:56387 -p 56388:56388 -p 56389:56389 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=56387 --rest-port=56385 --tcp-port=56386 --discv5-udp-port=56388 --rest-address=0.0.0.0 --nat=extip:172.18.227.82 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=79afbcf9b9bbe55bbf809cc9bce693aea574dccedd1eaa93fa47e11bd618e2cd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=56389 --metrics-logging=true --lightpush=false --relay=true
2026-03-22 04:40:24.436 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.227.82 waku da8a4238cb544f97e8147c212000a92723dfc53d979328979a7fa08f2ce33fd7
2026-03-22 04:40:24.474 DEBUG [src.node.docker_mananger] Container started with ID da8a4238cb54. Setting up logs at ./log/docker/receiving_node2_2026-03-22_04-40-22__84d97455-bf71-43f8-af29-d0791f7f54fd__wakuorg_nwaku:latest.log
2026-03-22 04:40:24.474 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 56385
2026-03-22 04:40:24.474 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-22 04:40:25.475 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56385/health" -H "Content-Type: application/json" -d 'None'
2026-03-22 04:40:25.478 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-22 04:40:25.478 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-22 04:40:25.479 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56385/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-22 04:40:25.481 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.227.82/tcp/56386/p2p/16Uiu2HAkxsmheyjBZogd8pKYmDxWjZQF9i9Xyi6fkkHfR439E66X","/ip4/172.18.227.82/tcp/56387/ws/p2p/16Uiu2HAkxsmheyjBZogd8pKYmDxWjZQF9i9Xyi6fkkHfR439E66X"],"enrUri":"enr:-L24QG2ZxLl_mEhyPs3Ti1kPvPfdHuxE7hD4wUGnX2ydklK-AdtnUHli65FsTx2uBF3P31f4ZjKrBzUAxf1QNMxhEZwCgmlkgnY0gmlwhKwS41KKbXVsdGlhZGRyc5YACASsEuNSBtxCAAoErBLjUgbcQ90DgnJzhQADAQAAiXNlY3AyNTZrMaECM0KhpWRJ8c61jgvVRg3_DU-z08WQa9vLBfRQBSAjw3yDdGNwgtxCg3VkcILcRIV3YWt1MgE"}'
2026-03-22 04:40:25.481 INFO [src.node.waku_node] REST service is ready !!
2026-03-22 04:40:25.482 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56385/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.198.102/tcp/51266/p2p/16Uiu2HAmKjVeZEwb86t62uJQcDJ8zQpYhFQmKMpKpKL89XgvPr4o"]'
2026-03-22 04:40:25.517 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-22 04:40:25.528 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-22 04:40:25.528 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-03-22_04-40-22__84d97455-bf71-43f8-af29-d0791f7f54fd__wakuorg_nwaku:latest.log
2026-03-22 04:40:25.528 DEBUG [src.node.waku_node] Starting Node...
2026-03-22 04:40:25.529 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-22 04:40:25.530 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-22 04:40:25.530 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.37.31
2026-03-22 04:40:25.531 DEBUG [src.node.docker_mananger] Generated ports ['1656', '1657', '1658', '1659', '1660']
2026-03-22 04:40:25.531 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-22 04:40:25.531 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-22 04:40:25.531 DEBUG [src.node.waku_node] Using volumes []
2026-03-22 04:40:25.531 DEBUG [src.node.docker_mananger] docker run -i -t -p 1656:1656 -p 1657:1657 -p 1658:1658 -p 1659:1659 -p 1660:1660 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=1658 --rest-port=1656 --tcp-port=1657 --discv5-udp-port=1659 --rest-address=0.0.0.0 --nat=extip:172.18.37.31 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=edaf6cbd726a5c8cfbe575be33cf77bc4cb32f5fe485197174ac7394ee345c8e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=1660 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QDFDKJeb89VB8m2qeHmEYncP7tieh5x_lh8C_SqI24SkKIHitR7Yoi1ToJkyRM70BfkGuYjXtzW8fjtJ97Ygoc8CgmlkgnY0gmlwhKwSxmaKbXVsdGlhZGRyc5YACASsEsZmBshCAAoErBLGZgbIQ90DgnJzhQADAQAAiXNlY3AyNTZrMaEDaSlCPMYf2UdV6Rarg5JI_-Poouvod5Ost4WFkhi3qGCDdGNwgshCg3VkcILIRIV3YWt1Mgk --lightpushnode=/ip4/172.18.198.102/tcp/51266/p2p/16Uiu2HAmKjVeZEwb86t62uJQcDJ8zQpYhFQmKMpKpKL89XgvPr4o --lightpush=true --relay=true
2026-03-22 04:40:25.740 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.37.31 waku 066db3dfe846431be6eb2731dcedc93279de4afeae7fc355fd90eee731d1c68d
2026-03-22 04:40:25.782 DEBUG [src.node.docker_mananger] Container started with ID 066db3dfe846. Setting up logs at ./log/docker/lightpush_node1_2026-03-22_04-40-22__84d97455-bf71-43f8-af29-d0791f7f54fd__wakuorg_nwaku:latest.log
2026-03-22 04:40:25.783 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 1656
2026-03-22 04:40:25.784 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-22 04:40:26.784 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1656/health" -H "Content-Type: application/json" -d 'None'
2026-03-22 04:40:26.794 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-22 04:40:26.794 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-22 04:40:26.798 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:1656/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-22 04:40:26.821 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.37.31/tcp/1657/p2p/16Uiu2HAmRCdSDtm8MgxkEo9kErjyaTLsdQmn89WCNW4XpUsZhJzm","/ip4/172.18.37.31/tcp/1658/ws/p2p/16Uiu2HAmRCdSDtm8MgxkEo9kErjyaTLsdQmn89WCNW4XpUsZhJzm"],"enrUri":"enr:-L24QB_IQ39BNXf-StqywFelcZhqRtYRzdXuVjGfigpnfSGCQKJH_w2mdAsYEmsVRI9jVZpK8wmHdmIe44w4Q-EeZIcCgmlkgnY0gmlwhKwSJR-KbXVsdGlhZGRyc5YACASsEiUfBgZ5AAoErBIlHwYGet0DgnJzhQADAQAAiXNlY3AyNTZrMaEDumcuLu3VWMv-LezYLfnapFSj-Gk9Z2jh5NjompLw7DqDdGNwggZ5g3VkcIIGe4V3YWt1Mgk"}'
2026-03-22 04:40:26.823 INFO [src.node.waku_node] REST service is ready !!
2026-03-22 04:40:26.825 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1656/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.198.102/tcp/51266/p2p/16Uiu2HAmKjVeZEwb86t62uJQcDJ8zQpYhFQmKMpKpKL89XgvPr4o"]'
2026-03-22 04:40:26.831 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-22 04:40:26.831 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1656/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.227.82/tcp/56386/p2p/16Uiu2HAkxsmheyjBZogd8pKYmDxWjZQF9i9Xyi6fkkHfR439E66X"]'
2026-03-22 04:40:26.855 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-22 04:40:26.857 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:51265/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-22 04:40:26.865 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-22 04:40:26.866 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56385/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-22 04:40:26.872 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-22 04:40:26.872 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:1656/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-22 04:40:26.877 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-22 04:40:26.879 DEBUG [tests.light_push.test_publish] Running test with payload length of 1048576 bytes
2026-03-22 04:40:26.893 DEBUG [src.steps.light_push] Lightpushing message
2026-03-22 04:40:26.902 INFO [src.node.api_clients.base_client] Log line was discarded because it's longer than max_log_line_length=5000
2026-03-22 04:40:27.856 ERROR [src.node.api_clients.base_client] HTTP error occurred: 503 Server Error: Service Unavailable for url: http://127.0.0.1:1656/lightpush/v1/message. Response content: b'Failed to request a message push: Message size exceeded maximum of 153600 bytes'
2026-03-22 04:40:27.859 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-22 04:40:27.860 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-22 04:40:27.860 DEBUG [src.node.waku_node] Stopping container with id 184a76a48ad2
2026-03-22 04:40:28.459 DEBUG [src.node.waku_node] Container stopped.
2026-03-22 04:40:28.460 DEBUG [src.node.waku_node] Stopping container with id da8a4238cb54
2026-03-22 04:40:29.028 DEBUG [src.node.waku_node] Container stopped.
2026-03-22 04:40:29.028 DEBUG [src.node.waku_node] Stopping container with id 066db3dfe846
2026-03-22 04:40:29.317 ERROR [src.node.docker_mananger] Max retries reached for container 184a76a48ad2. Exiting log stream.
2026-03-22 04:40:29.561 DEBUG [src.node.waku_node] Container stopped.
2026-03-22 04:40:29.564 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-22 04:40:29.590 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-22 04:40:29.603 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-22 04:40:29.750 DEBUG [src.node.docker_mananger] No errors found in the waku logs.