99 lines
18 KiB
Plaintext

2026-03-19 04:40:22.012 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-19 04:40:22.012 DEBUG [tests.conftest] Running test: test_light_push_with_payload_of_1_MB with id: 2026-03-19_04-40-22__8f9d6fd2-3a6a-41c3-907d-ad1b2e3304c4
2026-03-19 04:40:22.013 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-19 04:40:22.013 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-19 04:40:22.021 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-19 04:40:22.021 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node1_2026-03-19_04-40-22__8f9d6fd2-3a6a-41c3-907d-ad1b2e3304c4__wakuorg_nwaku:latest.log
2026-03-19 04:40:22.021 DEBUG [src.node.waku_node] Starting Node...
2026-03-19 04:40:22.021 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-19 04:40:22.023 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-19 04:40:22.023 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.90.222
2026-03-19 04:40:22.023 DEBUG [src.node.docker_mananger] Generated ports ['24409', '24410', '24411', '24412', '24413']
2026-03-19 04:40:22.023 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-19 04:40:22.023 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-19 04:40:22.024 DEBUG [src.node.waku_node] Using volumes []
2026-03-19 04:40:22.024 DEBUG [src.node.docker_mananger] docker run -i -t -p 24409:24409 -p 24410:24410 -p 24411:24411 -p 24412:24412 -p 24413:24413 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24411 --rest-port=24409 --tcp-port=24410 --discv5-udp-port=24412 --rest-address=0.0.0.0 --nat=extip:172.18.90.222 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a1db2d0ace5c1c9ade3e15db89b9ed2d0dd9f0d9e47edebd06adbcf2d22dbfcd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24413 --metrics-logging=true --lightpush=true --relay=true
2026-03-19 04:40:22.040 ERROR [src.node.docker_mananger] Max retries reached for container 5ea0fd7f2400. Exiting log stream.
2026-03-19 04:40:22.227 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.90.222 waku ad20602da489410ad3a08c3e7587c5b53a6b73d4592c3cae123fb83c7656ca78
2026-03-19 04:40:22.261 DEBUG [src.node.docker_mananger] Container started with ID ad20602da489. Setting up logs at ./log/docker/receiving_node1_2026-03-19_04-40-22__8f9d6fd2-3a6a-41c3-907d-ad1b2e3304c4__wakuorg_nwaku:latest.log
2026-03-19 04:40:22.262 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 24409
2026-03-19 04:40:22.262 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-19 04:40:22.741 ERROR [src.node.docker_mananger] Max retries reached for container db6cf0846bda. Exiting log stream.
2026-03-19 04:40:23.263 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24409/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:40:23.266 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-19 04:40:23.267 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-19 04:40:23.267 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24409/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:40:23.269 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.90.222/tcp/24410/p2p/16Uiu2HAmRjQh41a7JZ9Hr8H4MvgjaAuv1StGRwSPGQeRsDV1K2jB","/ip4/172.18.90.222/tcp/24411/ws/p2p/16Uiu2HAmRjQh41a7JZ9Hr8H4MvgjaAuv1StGRwSPGQeRsDV1K2jB"],"enrUri":"enr:-L24QAOO98dXs-Fhore9sD1v1e99OFtn2iwg__lm87ZCRJ0oJKv-BzNwVKgVBIQYX_XukkXCoqF5DtTipMx3GsoyyhgCgmlkgnY0gmlwhKwSWt6KbXVsdGlhZGRyc5YACASsElreBl9aAAoErBJa3gZfW90DgnJzhQADAQAAiXNlY3AyNTZrMaEDwknGgzbPDjqnRDjHXjCev6WXzRh64YmI2JUPnGNI8QKDdGNwgl9ag3VkcIJfXIV3YWt1Mgk"}'
2026-03-19 04:40:23.269 INFO [src.node.waku_node] REST service is ready !!
2026-03-19 04:40:23.277 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-19 04:40:23.277 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/receiving_node2_2026-03-19_04-40-22__8f9d6fd2-3a6a-41c3-907d-ad1b2e3304c4__wakuorg_nwaku:latest.log
2026-03-19 04:40:23.277 DEBUG [src.node.waku_node] Starting Node...
2026-03-19 04:40:23.278 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-19 04:40:23.279 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-19 04:40:23.279 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.147.195
2026-03-19 04:40:23.279 DEBUG [src.node.docker_mananger] Generated ports ['53755', '53756', '53757', '53758', '53759']
2026-03-19 04:40:23.279 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-19 04:40:23.279 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-19 04:40:23.280 DEBUG [src.node.waku_node] Using volumes []
2026-03-19 04:40:23.280 DEBUG [src.node.docker_mananger] docker run -i -t -p 53755:53755 -p 53756:53756 -p 53757:53757 -p 53758:53758 -p 53759:53759 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=53757 --rest-port=53755 --tcp-port=53756 --discv5-udp-port=53758 --rest-address=0.0.0.0 --nat=extip:172.18.147.195 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=da0b84b28d2300025800d0aaef0b7c89ce2fc2ba6d1b8bdac35ace953ac2aaae --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=53759 --metrics-logging=true --lightpush=false --relay=true
2026-03-19 04:40:23.484 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.147.195 waku 3f8646fd48e20a3f72bcc71fe8630f7c8671492babd6de35af85654de5dc6339
2026-03-19 04:40:23.519 DEBUG [src.node.docker_mananger] Container started with ID 3f8646fd48e2. Setting up logs at ./log/docker/receiving_node2_2026-03-19_04-40-22__8f9d6fd2-3a6a-41c3-907d-ad1b2e3304c4__wakuorg_nwaku:latest.log
2026-03-19 04:40:23.520 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 53755
2026-03-19 04:40:23.520 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-19 04:40:24.520 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53755/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:40:24.523 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-19 04:40:24.524 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-19 04:40:24.524 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53755/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:40:24.526 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.147.195/tcp/53756/p2p/16Uiu2HAm4rY3SCVpy5Cog4cyNzRcQT4q6Qot6gAahE3EnGz2KWUd","/ip4/172.18.147.195/tcp/53757/ws/p2p/16Uiu2HAm4rY3SCVpy5Cog4cyNzRcQT4q6Qot6gAahE3EnGz2KWUd"],"enrUri":"enr:-L24QAKJwWcbb5nak4CkwMFb0iKGg-161DfPvGWvE-myqoN5H5h0BjPj082u_XEGX-piqXEqjXQd_RPmZrKQUrVbpXgCgmlkgnY0gmlwhKwSk8OKbXVsdGlhZGRyc5YACASsEpPDBtH8AAoErBKTwwbR_d0DgnJzhQADAQAAiXNlY3AyNTZrMaECjBe6Wat9JvzA9YsimeBVMu1KCfZkWhorpH_VTyD4kxaDdGNwgtH8g3VkcILR_oV3YWt1MgE"}'
2026-03-19 04:40:24.526 INFO [src.node.waku_node] REST service is ready !!
2026-03-19 04:40:24.527 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53755/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.90.222/tcp/24410/p2p/16Uiu2HAmRjQh41a7JZ9Hr8H4MvgjaAuv1StGRwSPGQeRsDV1K2jB"]'
2026-03-19 04:40:24.558 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:24.573 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-19 04:40:24.573 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/lightpush_node1_2026-03-19_04-40-22__8f9d6fd2-3a6a-41c3-907d-ad1b2e3304c4__wakuorg_nwaku:latest.log
2026-03-19 04:40:24.573 DEBUG [src.node.waku_node] Starting Node...
2026-03-19 04:40:24.574 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-19 04:40:24.575 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-19 04:40:24.575 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.210.252
2026-03-19 04:40:24.575 DEBUG [src.node.docker_mananger] Generated ports ['12459', '12460', '12461', '12462', '12463']
2026-03-19 04:40:24.576 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-19 04:40:24.576 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-19 04:40:24.576 DEBUG [src.node.waku_node] Using volumes []
2026-03-19 04:40:24.576 DEBUG [src.node.docker_mananger] docker run -i -t -p 12459:12459 -p 12460:12460 -p 12461:12461 -p 12462:12462 -p 12463:12463 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=12461 --rest-port=12459 --tcp-port=12460 --discv5-udp-port=12462 --rest-address=0.0.0.0 --nat=extip:172.18.210.252 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=77d5ea8ab6f9ff16faaaa997c8ebf9d7f29a7ec356edfea393ef8ffb5a93dadc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=12463 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QAOO98dXs-Fhore9sD1v1e99OFtn2iwg__lm87ZCRJ0oJKv-BzNwVKgVBIQYX_XukkXCoqF5DtTipMx3GsoyyhgCgmlkgnY0gmlwhKwSWt6KbXVsdGlhZGRyc5YACASsElreBl9aAAoErBJa3gZfW90DgnJzhQADAQAAiXNlY3AyNTZrMaEDwknGgzbPDjqnRDjHXjCev6WXzRh64YmI2JUPnGNI8QKDdGNwgl9ag3VkcIJfXIV3YWt1Mgk --lightpushnode=/ip4/172.18.90.222/tcp/24410/p2p/16Uiu2HAmRjQh41a7JZ9Hr8H4MvgjaAuv1StGRwSPGQeRsDV1K2jB --lightpush=true --relay=true
2026-03-19 04:40:24.780 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.210.252 waku 1e1395357969334a82a175da11cde89e79dd298aa1a93c8b2501b0e7eb942637
2026-03-19 04:40:24.816 DEBUG [src.node.docker_mananger] Container started with ID 1e1395357969. Setting up logs at ./log/docker/lightpush_node1_2026-03-19_04-40-22__8f9d6fd2-3a6a-41c3-907d-ad1b2e3304c4__wakuorg_nwaku:latest.log
2026-03-19 04:40:24.817 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 12459
2026-03-19 04:40:24.817 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-19 04:40:25.818 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12459/health" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:40:25.822 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Legacy Lightpush":"NOT_READY","desc":"Node has no relay peers to fullfill push requests"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-19 04:40:25.822 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-19 04:40:25.822 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12459/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-19 04:40:25.825 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.210.252/tcp/12460/p2p/16Uiu2HAmJbwmTCiWXoyaJNTzqyWoXxxQkEsTcdv8EzjMy7CgtmiZ","/ip4/172.18.210.252/tcp/12461/ws/p2p/16Uiu2HAmJbwmTCiWXoyaJNTzqyWoXxxQkEsTcdv8EzjMy7CgtmiZ"],"enrUri":"enr:-L24QPGAH1oMdd45BBqeioolPC2jAsxdxXYvuNsZfW_SmkIgfUtElfzAFrrKv1eAiDJtaU9L_ghd0lvSjbl306RHwasCgmlkgnY0gmlwhKwS0vyKbXVsdGlhZGRyc5YACASsEtL8BjCsAAoErBLS_AYwrd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDWF51RAZWRZcaGmQZbTofXpaxqI9S5JIOlM4jdZo1MmKDdGNwgjCsg3VkcIIwroV3YWt1Mgk"}'
2026-03-19 04:40:25.825 INFO [src.node.waku_node] REST service is ready !!
2026-03-19 04:40:25.825 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12459/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.90.222/tcp/24410/p2p/16Uiu2HAmRjQh41a7JZ9Hr8H4MvgjaAuv1StGRwSPGQeRsDV1K2jB"]'
2026-03-19 04:40:25.860 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:25.861 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12459/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.147.195/tcp/53756/p2p/16Uiu2HAm4rY3SCVpy5Cog4cyNzRcQT4q6Qot6gAahE3EnGz2KWUd"]'
2026-03-19 04:40:25.889 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:25.891 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24409/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-19 04:40:25.895 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:25.896 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53755/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-19 04:40:25.900 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:25.902 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12459/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-19 04:40:25.905 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-19 04:40:25.909 DEBUG [tests.light_push.test_publish] Running test with payload length of 1048576 bytes
2026-03-19 04:40:25.926 DEBUG [src.steps.light_push] Lightpushing message
2026-03-19 04:40:25.937 INFO [src.node.api_clients.base_client] Log line was discarded because it's longer than max_log_line_length=5000
2026-03-19 04:40:26.873 ERROR [src.node.api_clients.base_client] HTTP error occurred: 503 Server Error: Service Unavailable for url: http://127.0.0.1:12459/lightpush/v1/message. Response content: b'Failed to request a message push: Message size exceeded maximum of 153600 bytes'
2026-03-19 04:40:26.876 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-19 04:40:26.877 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-19 04:40:26.877 DEBUG [src.node.waku_node] Stopping container with id ad20602da489
2026-03-19 04:40:27.524 DEBUG [src.node.waku_node] Container stopped.
2026-03-19 04:40:27.524 DEBUG [src.node.waku_node] Stopping container with id 3f8646fd48e2
2026-03-19 04:40:28.140 DEBUG [src.node.waku_node] Container stopped.
2026-03-19 04:40:28.143 DEBUG [src.node.waku_node] Stopping container with id 1e1395357969
2026-03-19 04:40:28.342 ERROR [src.node.docker_mananger] Max retries reached for container ad20602da489. Exiting log stream.
2026-03-19 04:40:28.740 DEBUG [src.node.waku_node] Container stopped.
2026-03-19 04:40:28.745 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-19 04:40:28.759 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-19 04:40:28.774 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-19 04:40:28.933 DEBUG [src.node.docker_mananger] No errors found in the waku logs.