80 lines
13 KiB
Plaintext

2026-03-07 04:31:27.751 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-07 04:31:27.751 DEBUG [tests.conftest] Running test: test_retrieve_messages_without_subscribing_via_api with id: 2026-03-07_04-31-27__0bac12cd-9832-49a5-b1d1-82f847afaeb5
2026-03-07 04:31:27.752 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-07 04:31:27.752 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-07 04:31:27.752 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-07 04:31:27.761 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:31:27.761 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-07_04-31-27__0bac12cd-9832-49a5-b1d1-82f847afaeb5__wakuorg_nwaku:latest.log
2026-03-07 04:31:27.761 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:31:27.761 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:31:27.763 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:31:27.763 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.180.31
2026-03-07 04:31:27.763 DEBUG [src.node.docker_mananger] Generated ports ['37963', '37964', '37965', '37966', '37967']
2026-03-07 04:31:27.763 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-07 04:31:27.763 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-07 04:31:27.763 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:31:27.763 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:31:27.764 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:31:27.764 DEBUG [src.node.docker_mananger] docker run -i -t -p 37963:37963 -p 37964:37964 -p 37965:37965 -p 37966:37966 -p 37967:37967 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=37965 --rest-port=37963 --tcp-port=37964 --discv5-udp-port=37966 --rest-address=0.0.0.0 --nat=extip:172.18.180.31 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=d3de7b3f4704ebee33f9fae2dad3af1eb4b8cdcce3ca2df7cd1cc4eb10acacbb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=37967 --metrics-logging=true --relay=true --filter=true
2026-03-07 04:31:27.946 ERROR [src.node.docker_mananger] Max retries reached for container 3cf913978bdf. Exiting log stream.
2026-03-07 04:31:27.966 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.180.31 waku 828225a0862732937ac967f7c7e567d6193c2c5641f5306658114c301027a13d
2026-03-07 04:31:28.002 DEBUG [src.node.docker_mananger] Container started with ID 828225a08627. Setting up logs at ./log/docker/node1_2026-03-07_04-31-27__0bac12cd-9832-49a5-b1d1-82f847afaeb5__wakuorg_nwaku:latest.log
2026-03-07 04:31:28.002 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 37963
2026-03-07 04:31:28.003 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:31:28.526 ERROR [src.node.docker_mananger] Max retries reached for container 9911fb622c38. Exiting log stream.
2026-03-07 04:31:29.003 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37963/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:29.006 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:29.106 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37963/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:29.109 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:29.210 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37963/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:29.213 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:29.314 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37963/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:29.317 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:31:29.317 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:31:29.318 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37963/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:29.320 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.180.31/tcp/37964/p2p/16Uiu2HAmV5csK4iSNpzNmzY7Y6kq1a6vmMFCVb996FuviZfCA62L","/ip4/172.18.180.31/tcp/37965/ws/p2p/16Uiu2HAmV5csK4iSNpzNmzY7Y6kq1a6vmMFCVb996FuviZfCA62L"],"enrUri":"enr:-L24QOhuIpdD6z0wj7hSZuNQQNJlWhiFK87xIHtkTeuAuNUWWYBv5H7ksXL1ZKEQUu9UuSpTyoZHoEg4OdPUSSEI2oUCgmlkgnY0gmlwhKwStB-KbXVsdGlhZGRyc5YACASsErQfBpRMAAoErBK0HwaUTd0DgnJzhQACAQAAiXNlY3AyNTZrMaED9Ao4icgVAPeKNygFMD_ZDiNroVqt7JGOUms3PiEOZlmDdGNwgpRMg3VkcIKUToV3YWt1MgU"}'
2026-03-07 04:31:29.321 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:31:29.328 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:31:29.328 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-07_04-31-27__0bac12cd-9832-49a5-b1d1-82f847afaeb5__wakuorg_nwaku:latest.log
2026-03-07 04:31:29.328 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:31:29.328 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:31:29.330 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:31:29.330 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.208.188
2026-03-07 04:31:29.330 DEBUG [src.node.docker_mananger] Generated ports ['57246', '57247', '57248', '57249', '57250']
2026-03-07 04:31:29.330 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-07 04:31:29.330 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-07 04:31:29.330 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:31:29.330 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:31:29.331 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:31:29.331 DEBUG [src.node.docker_mananger] docker run -i -t -p 57246:57246 -p 57247:57247 -p 57248:57248 -p 57249:57249 -p 57250:57250 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=57248 --rest-port=57246 --tcp-port=57247 --discv5-udp-port=57249 --rest-address=0.0.0.0 --nat=extip:172.18.208.188 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=b22eb3bb6441cb6b56ecfcca84fca61cc83e6b8feddca9f3beb1abaee96d6cc6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=57250 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QOhuIpdD6z0wj7hSZuNQQNJlWhiFK87xIHtkTeuAuNUWWYBv5H7ksXL1ZKEQUu9UuSpTyoZHoEg4OdPUSSEI2oUCgmlkgnY0gmlwhKwStB-KbXVsdGlhZGRyc5YACASsErQfBpRMAAoErBK0HwaUTd0DgnJzhQACAQAAiXNlY3AyNTZrMaED9Ao4icgVAPeKNygFMD_ZDiNroVqt7JGOUms3PiEOZlmDdGNwgpRMg3VkcIKUToV3YWt1MgU
2026-03-07 04:31:29.552 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.208.188 waku 605bf295506dd2f1cd193e4ad55ea10d660258490f8c03320c5c32aae0997966
2026-03-07 04:31:29.591 DEBUG [src.node.docker_mananger] Container started with ID 605bf295506d. Setting up logs at ./log/docker/node2_2026-03-07_04-31-27__0bac12cd-9832-49a5-b1d1-82f847afaeb5__wakuorg_nwaku:latest.log
2026-03-07 04:31:29.592 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 57246
2026-03-07 04:31:29.592 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:31:30.593 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57246/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:30.596 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:31:30.596 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:31:30.596 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57246/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:30.599 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.208.188/tcp/57247/p2p/16Uiu2HAmFEBJGWYLw1u8TMhA7rBGbJAq9Ye49xU9bkG7FH1N7KXp","/ip4/172.18.208.188/tcp/57248/ws/p2p/16Uiu2HAmFEBJGWYLw1u8TMhA7rBGbJAq9Ye49xU9bkG7FH1N7KXp"],"enrUri":"enr:-L24QAzWuTaf6cMBXoRXDomR5XAPSDh4nRM4bIDefiW0lhQZEgCYND3Sygd8wmh-j98rUzG5Ii0dDS1i51KPwAimetoCgmlkgnY0gmlwhKwS0LyKbXVsdGlhZGRyc5YACASsEtC8Bt-fAAoErBLQvAbfoN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDJjfrXM_pxoKb7VGY0-EphEgErcNgOlvFau_sH48AocODdGNwgt-fg3VkcILfoYV3YWt1MgE"}'
2026-03-07 04:31:30.599 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:31:30.599 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57246/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.180.31/tcp/37964/p2p/16Uiu2HAmV5csK4iSNpzNmzY7Y6kq1a6vmMFCVb996FuviZfCA62L"]'
2026-03-07 04:31:30.633 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:30.635 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37963/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:31:30.649 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:30.650 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-07 04:31:30.750 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:30.751 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37963/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:30.753 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857890635366207,"ephemeral":false,"proof":""}]'
2026-03-07 04:31:30.756 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:30.756 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57246/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:30.758 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857890635366207,"ephemeral":false,"proof":""}]'
2026-03-07 04:31:30.761 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-07 04:31:30.762 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-07 04:31:30.762 DEBUG [src.node.waku_node] Stopping container with id 828225a08627
2026-03-07 04:31:31.370 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:31:31.372 DEBUG [src.node.waku_node] Stopping container with id 605bf295506d
2026-03-07 04:31:31.973 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:31:31.976 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-07 04:31:32.014 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:31:32.044 DEBUG [src.node.docker_mananger] No errors found in the waku logs.