99 lines
18 KiB
Plaintext

2026-03-14 04:34:39.600 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-14 04:34:39.601 DEBUG [tests.conftest] Running test: test_light_push_with_payload_of_1_MB with id: 2026-03-14_04-34-39__b1e0891c-1412-4774-990d-d07821b47975
2026-03-14 04:34:39.601 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-14 04:34:39.601 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-14 04:34:39.608 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:34:39.608 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-03-14_04-34-39__b1e0891c-1412-4774-990d-d07821b47975__wakuorg_nwaku:latest.log
2026-03-14 04:34:39.608 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:34:39.608 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:34:39.610 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:34:39.610 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.226.188
2026-03-14 04:34:39.610 DEBUG [src.node.docker_mananger] Generated ports ['45212', '45213', '45214', '45215', '45216']
2026-03-14 04:34:39.610 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:34:39.610 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:34:39.611 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:34:39.611 DEBUG [src.node.docker_mananger] docker run -i -t -p 45212:45212 -p 45213:45213 -p 45214:45214 -p 45215:45215 -p 45216:45216 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=45214 --rest-port=45212 --tcp-port=45213 --discv5-udp-port=45215 --rest-address=0.0.0.0 --nat=extip:172.18.226.188 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=2dad2adab9f30beff801e9950ad5ffdfa2d6d9ceeaf4ebc5c0c6d3fb933ffaec --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=45216 --metrics-logging=true --lightpush=true --relay=true
2026-03-14 04:34:39.751 ERROR [src.node.docker_mananger] Max retries reached for container 9568387f1d20. Exiting log stream.
2026-03-14 04:34:39.804 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.226.188 waku 1e48e10073732e060af9ff8f1d3920042b2212330e7f550927730fecc92b4a23
2026-03-14 04:34:39.837 DEBUG [src.node.docker_mananger] Container started with ID 1e48e1007373. Setting up logs at ./log/docker/receiving_node1_2026-03-14_04-34-39__b1e0891c-1412-4774-990d-d07821b47975__wakuorg_nwaku:latest.log
2026-03-14 04:34:39.837 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 45212
2026-03-14 04:34:39.838 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:34:40.332 ERROR [src.node.docker_mananger] Max retries reached for container 5474eb748fe9. Exiting log stream.
2026-03-14 04:34:40.838 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45212/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:34:40.841 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:34:40.841 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:34:40.842 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45212/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:34:40.844 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.226.188/tcp/45213/p2p/16Uiu2HAkzAKY7zwAKQGz7pirBZ47GzvWBq5EhFPNHnXnGGXAZYZj","/ip4/172.18.226.188/tcp/45214/ws/p2p/16Uiu2HAkzAKY7zwAKQGz7pirBZ47GzvWBq5EhFPNHnXnGGXAZYZj"],"enrUri":"enr:-L24QBkBtuv5siCaLSEtOT5ntA6ZQXEoLt7GkgF_OaIvd8thWtx8LSQSZxVqBvvKxqPisyf3x7M3zCmQXXmvHKe199ACgmlkgnY0gmlwhKwS4ryKbXVsdGlhZGRyc5YACASsEuK8BrCdAAoErBLivAawnt0DgnJzhQADAQAAiXNlY3AyNTZrMaECRlubop65mHsM9H5yKJmfinusI8TwHZwCtFTuY-7Q-laDdGNwgrCdg3VkcIKwn4V3YWt1Mgk"}'
2026-03-14 04:34:40.844 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:34:40.851 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:34:40.851 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-03-14_04-34-39__b1e0891c-1412-4774-990d-d07821b47975__wakuorg_nwaku:latest.log
2026-03-14 04:34:40.851 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:34:40.851 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:34:40.853 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:34:40.853 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.166.93
2026-03-14 04:34:40.853 DEBUG [src.node.docker_mananger] Generated ports ['38540', '38541', '38542', '38543', '38544']
2026-03-14 04:34:40.853 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:34:40.853 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:34:40.854 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:34:40.854 DEBUG [src.node.docker_mananger] docker run -i -t -p 38540:38540 -p 38541:38541 -p 38542:38542 -p 38543:38543 -p 38544:38544 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=38542 --rest-port=38540 --tcp-port=38541 --discv5-udp-port=38543 --rest-address=0.0.0.0 --nat=extip:172.18.166.93 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dfec6f8d4316020ef2cfe1aea5daec7cfcf3504b9ccb4f22e47a8e7dbd5f9587 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=38544 --metrics-logging=true --lightpush=false --relay=true
2026-03-14 04:34:41.040 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.166.93 waku 77024163f3cc0113f3fb19b7488d0a49fbccc1ff4a8bd4fa4141e463c8d85615
2026-03-14 04:34:41.076 DEBUG [src.node.docker_mananger] Container started with ID 77024163f3cc. Setting up logs at ./log/docker/receiving_node2_2026-03-14_04-34-39__b1e0891c-1412-4774-990d-d07821b47975__wakuorg_nwaku:latest.log
2026-03-14 04:34:41.077 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 38540
2026-03-14 04:34:41.077 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:34:42.077 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38540/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:34:42.080 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:34:42.081 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:34:42.081 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38540/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:34:42.083 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.166.93/tcp/38541/p2p/16Uiu2HAm2vdfo49VU5Pt2YHQCXWt4cqwTzPBsCSYRRXWsz9De9kC","/ip4/172.18.166.93/tcp/38542/ws/p2p/16Uiu2HAm2vdfo49VU5Pt2YHQCXWt4cqwTzPBsCSYRRXWsz9De9kC"],"enrUri":"enr:-L24QG74nFC8yo4SlP50eEE5sp-ljqIkOzRnEfaVMnLLcY_0JwCSvg2q7UvVJ7Flyk7bDN4J_NFNXKkcg8KPVdEOg9ICgmlkgnY0gmlwhKwSpl2KbXVsdGlhZGRyc5YACASsEqZdBpaNAAoErBKmXQaWjt0DgnJzhQADAQAAiXNlY3AyNTZrMaECb20KJw9NSukotW5Mk57HdES_4LMaPIzStbMXOq_dLrGDdGNwgpaNg3VkcIKWj4V3YWt1MgE"}'
2026-03-14 04:34:42.083 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:34:42.084 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38540/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.226.188/tcp/45213/p2p/16Uiu2HAkzAKY7zwAKQGz7pirBZ47GzvWBq5EhFPNHnXnGGXAZYZj"]'
2026-03-14 04:34:42.122 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:34:42.131 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:34:42.131 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-03-14_04-34-39__b1e0891c-1412-4774-990d-d07821b47975__wakuorg_nwaku:latest.log
2026-03-14 04:34:42.131 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:34:42.132 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:34:42.133 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:34:42.133 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.167.68
2026-03-14 04:34:42.133 DEBUG [src.node.docker_mananger] Generated ports ['63220', '63221', '63222', '63223', '63224']
2026-03-14 04:34:42.134 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:34:42.134 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:34:42.134 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:34:42.134 DEBUG [src.node.docker_mananger] docker run -i -t -p 63220:63220 -p 63221:63221 -p 63222:63222 -p 63223:63223 -p 63224:63224 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63222 --rest-port=63220 --tcp-port=63221 --discv5-udp-port=63223 --rest-address=0.0.0.0 --nat=extip:172.18.167.68 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bb7f21ffd4b48e0ea1cdd416b3aa7e53defafcea9afd55cefde71885c39c9324 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63224 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QBkBtuv5siCaLSEtOT5ntA6ZQXEoLt7GkgF_OaIvd8thWtx8LSQSZxVqBvvKxqPisyf3x7M3zCmQXXmvHKe199ACgmlkgnY0gmlwhKwS4ryKbXVsdGlhZGRyc5YACASsEuK8BrCdAAoErBLivAawnt0DgnJzhQADAQAAiXNlY3AyNTZrMaECRlubop65mHsM9H5yKJmfinusI8TwHZwCtFTuY-7Q-laDdGNwgrCdg3VkcIKwn4V3YWt1Mgk --lightpushnode=/ip4/172.18.226.188/tcp/45213/p2p/16Uiu2HAkzAKY7zwAKQGz7pirBZ47GzvWBq5EhFPNHnXnGGXAZYZj --lightpush=true --relay=true
2026-03-14 04:34:42.335 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.167.68 waku bb63a25ccecf9f486fe6963c3ac1ba2de44ade5947d3643b2359a7c378759405
2026-03-14 04:34:42.371 DEBUG [src.node.docker_mananger] Container started with ID bb63a25ccecf. Setting up logs at ./log/docker/lightpush_node1_2026-03-14_04-34-39__b1e0891c-1412-4774-990d-d07821b47975__wakuorg_nwaku:latest.log
2026-03-14 04:34:42.372 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 63220
2026-03-14 04:34:42.372 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:34:43.372 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63220/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:34:43.376 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:34:43.376 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:34:43.376 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63220/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:34:43.379 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.167.68/tcp/63221/p2p/16Uiu2HAm62kQvgabymdzdbpiybDuEWApKccwxrUpdaKyqEGTPYQL","/ip4/172.18.167.68/tcp/63222/ws/p2p/16Uiu2HAm62kQvgabymdzdbpiybDuEWApKccwxrUpdaKyqEGTPYQL"],"enrUri":"enr:-L24QIrQRFjVgl7yJzvglhcx_CbrodIpxy7_VGfQ-JpXFY2PZlN_13GFfMnAn_o7doZJ3NIFQMOwS1_4E2nx8VtyFr0CgmlkgnY0gmlwhKwSp0SKbXVsdGlhZGRyc5YACASsEqdEBvb1AAoErBKnRAb29t0DgnJzhQADAQAAiXNlY3AyNTZrMaECnZE12gNYl7TPk2eQsMX6umTbCgx-73vI6rzG-UtV3VWDdGNwgvb1g3VkcIL294V3YWt1Mgk"}'
2026-03-14 04:34:43.379 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:34:43.380 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63220/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.226.188/tcp/45213/p2p/16Uiu2HAkzAKY7zwAKQGz7pirBZ47GzvWBq5EhFPNHnXnGGXAZYZj"]'
2026-03-14 04:34:43.416 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:34:43.417 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63220/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.166.93/tcp/38541/p2p/16Uiu2HAm2vdfo49VU5Pt2YHQCXWt4cqwTzPBsCSYRRXWsz9De9kC"]'
2026-03-14 04:34:43.453 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:34:43.453 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45212/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-14 04:34:43.462 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:34:43.463 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38540/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-14 04:34:43.466 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:34:43.467 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63220/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-14 04:34:43.469 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:34:43.470 DEBUG [tests.light_push.test_publish] Running test with payload length of 1048576 bytes
2026-03-14 04:34:43.483 DEBUG [src.steps.light_push] Lightpushing message
2026-03-14 04:34:43.492 INFO [src.node.api_clients.base_client] Log line was discarded because it's longer than max_log_line_length=5000
2026-03-14 04:34:44.453 ERROR [src.node.api_clients.base_client] HTTP error occurred: 503 Server Error: Service Unavailable for url: http://127.0.0.1:63220/lightpush/v1/message. Response content: b'Failed to request a message push: Message size exceeded maximum of 153600 bytes'
2026-03-14 04:34:44.456 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-14 04:34:44.457 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-14 04:34:44.457 DEBUG [src.node.waku_node] Stopping container with id 1e48e1007373
2026-03-14 04:34:45.044 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:34:45.045 DEBUG [src.node.waku_node] Stopping container with id 77024163f3cc
2026-03-14 04:34:45.625 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:34:45.627 DEBUG [src.node.waku_node] Stopping container with id bb63a25ccecf
2026-03-14 04:34:45.906 ERROR [src.node.docker_mananger] Max retries reached for container 1e48e1007373. Exiting log stream.
2026-03-14 04:34:46.225 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:34:46.227 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-14 04:34:46.244 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-14 04:34:46.259 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-14 04:34:46.398 DEBUG [src.node.docker_mananger] No errors found in the waku logs.