83 lines
14 KiB
Plaintext

2026-03-07 04:32:37.794 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-07 04:32:37.794 DEBUG [tests.conftest] Running test: test_messages_with_timestamps_far_from_now with id: 2026-03-07_04-32-37__3d8d14e0-14db-4d82-9064-d987a82745a3
2026-03-07 04:32:37.795 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-07 04:32:37.795 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-07 04:32:37.795 DEBUG [src.steps.store] Running fixture setup: node_setup
2026-03-07 04:32:37.801 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:32:37.801 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/publishing_node1_2026-03-07_04-32-37__3d8d14e0-14db-4d82-9064-d987a82745a3__wakuorg_nwaku:latest.log
2026-03-07 04:32:37.801 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:32:37.801 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:32:37.802 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:32:37.802 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.124.222
2026-03-07 04:32:37.803 DEBUG [src.node.docker_mananger] Generated ports ['12266', '12267', '12268', '12269', '12270']
2026-03-07 04:32:37.803 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:32:37.803 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:32:37.803 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:32:37.803 DEBUG [src.node.docker_mananger] docker run -i -t -p 12266:12266 -p 12267:12267 -p 12268:12268 -p 12269:12269 -p 12270:12270 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=12268 --rest-port=12266 --tcp-port=12267 --discv5-udp-port=12269 --rest-address=0.0.0.0 --nat=extip:172.18.124.222 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=6d8bcf6cc824cc4f3dcf7183a66035d9745eb166e5e986bdc28d09ef97dd76c3 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=12270 --metrics-logging=true --store=true --relay=true
2026-03-07 04:32:37.963 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.124.222 waku 0d664a7b5f7e02d86c7bcd443271b819ac09c3422d0f5fa0187ed9a380b77fa9
2026-03-07 04:32:37.990 DEBUG [src.node.docker_mananger] Container started with ID 0d664a7b5f7e. Setting up logs at ./log/docker/publishing_node1_2026-03-07_04-32-37__3d8d14e0-14db-4d82-9064-d987a82745a3__wakuorg_nwaku:latest.log
2026-03-07 04:32:37.990 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 12266
2026-03-07 04:32:37.990 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:32:38.101 ERROR [src.node.docker_mananger] Max retries reached for container 728cb429e148. Exiting log stream.
2026-03-07 04:32:38.584 ERROR [src.node.docker_mananger] Max retries reached for container 1b6fc7fe48a9. Exiting log stream.
2026-03-07 04:32:38.991 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12266/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:32:38.994 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:32:38.994 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:32:38.994 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12266/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:32:38.996 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.124.222/tcp/12267/p2p/16Uiu2HAmTyqyyVjj9FYMWf3LhvMEP8db74Yy2AiafqE5Emaf4yXi","/ip4/172.18.124.222/tcp/12268/ws/p2p/16Uiu2HAmTyqyyVjj9FYMWf3LhvMEP8db74Yy2AiafqE5Emaf4yXi"],"enrUri":"enr:-L24QMw6MW7RqysghIlHs7PnerzFhkvhJyf2SN9lOp8chisYQOaFs4u7zgH2pN0td51Zu-lkI5YdEi2uRJgwTtd3JNMCgmlkgnY0gmlwhKwSfN6KbXVsdGlhZGRyc5YACASsEnzeBi_rAAoErBJ83gYv7N0DgnJzhQADAQAAiXNlY3AyNTZrMaED47Pgy4JFTuSv9KPws-XDM4_gtdv0oxAU1PYz6jCmgM2DdGNwgi_rg3VkcIIv7YV3YWt1MgM"}'
2026-03-07 04:32:38.996 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:32:39.003 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:32:39.003 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/store_node1_2026-03-07_04-32-37__3d8d14e0-14db-4d82-9064-d987a82745a3__wakuorg_nwaku:latest.log
2026-03-07 04:32:39.003 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:32:39.003 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:32:39.005 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:32:39.005 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.106.76
2026-03-07 04:32:39.005 DEBUG [src.node.docker_mananger] Generated ports ['3967', '3968', '3969', '3970', '3971']
2026-03-07 04:32:39.005 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:32:39.005 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:32:39.005 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:32:39.005 DEBUG [src.node.docker_mananger] docker run -i -t -p 3967:3967 -p 3968:3968 -p 3969:3969 -p 3970:3970 -p 3971:3971 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3969 --rest-port=3967 --tcp-port=3968 --discv5-udp-port=3970 --rest-address=0.0.0.0 --nat=extip:172.18.106.76 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bb2bac14afb8afa5d9733c8b44c764eaa94e8a4e39397f9a2f4d3eb83c01cd0b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3971 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QMw6MW7RqysghIlHs7PnerzFhkvhJyf2SN9lOp8chisYQOaFs4u7zgH2pN0td51Zu-lkI5YdEi2uRJgwTtd3JNMCgmlkgnY0gmlwhKwSfN6KbXVsdGlhZGRyc5YACASsEnzeBi_rAAoErBJ83gYv7N0DgnJzhQADAQAAiXNlY3AyNTZrMaED47Pgy4JFTuSv9KPws-XDM4_gtdv0oxAU1PYz6jCmgM2DdGNwgi_rg3VkcIIv7YV3YWt1MgM --storenode=/ip4/172.18.124.222/tcp/12267/p2p/16Uiu2HAmTyqyyVjj9FYMWf3LhvMEP8db74Yy2AiafqE5Emaf4yXi --store=true --relay=true
2026-03-07 04:32:39.157 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.106.76 waku 1c4358d7c2ecfce555349026af3b41b48b4c6e5075e39a6b5b9294711d9a4fef
2026-03-07 04:32:39.182 DEBUG [src.node.docker_mananger] Container started with ID 1c4358d7c2ec. Setting up logs at ./log/docker/store_node1_2026-03-07_04-32-37__3d8d14e0-14db-4d82-9064-d987a82745a3__wakuorg_nwaku:latest.log
2026-03-07 04:32:39.182 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 3967
2026-03-07 04:32:39.183 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:32:40.183 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3967/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:32:40.186 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:32:40.186 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:32:40.186 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3967/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:32:40.188 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.106.76/tcp/3968/p2p/16Uiu2HAmK1pFhe4x7KRnoFJ1XqodjakpsKFfmuRusZLAZZXc6MqW","/ip4/172.18.106.76/tcp/3969/ws/p2p/16Uiu2HAmK1pFhe4x7KRnoFJ1XqodjakpsKFfmuRusZLAZZXc6MqW"],"enrUri":"enr:-L24QDkJcWSk9M6Cm-ToOzkn_kABp-dvu-OK3TOb7GT-skGycs4q34Zckb7pap6A4tM3kvNr2X_Gw40nrm3n0l68EfICgmlkgnY0gmlwhKwSakyKbXVsdGlhZGRyc5YACASsEmpMBg-AAAoErBJqTAYPgd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDXnvnDq0CqZLgb_xZ6PFSyPbas8NC8u9ozRD6hJuQRYWDdGNwgg-Ag3VkcIIPgoV3YWt1MgM"}'
2026-03-07 04:32:40.189 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:32:40.189 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3967/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.124.222/tcp/12267/p2p/16Uiu2HAmTyqyyVjj9FYMWf3LhvMEP8db74Yy2AiafqE5Emaf4yXi"]'
2026-03-07 04:32:40.191 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:32:40.192 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12266/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-07 04:32:40.194 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:32:40.194 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3967/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-07 04:32:40.196 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:32:40.196 DEBUG [tests.store.test_time_filter] Running test with payload 20 sec Past
2026-03-07 04:32:40.197 DEBUG [src.steps.store] Relaying message
2026-03-07 04:32:40.197 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12266/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:32:40.201 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:32:40.202 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-07 04:32:40.403 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-07 04:32:40.403 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12266/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=5&ascending=true&pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:32:40.406 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[]}'
2026-03-07 04:32:40.406 DEBUG [src.steps.store] messages length is 0
2026-03-07 04:32:40.407 DEBUG [tests.store.test_time_filter] Running test with payload 40 sec Future
2026-03-07 04:32:40.407 DEBUG [src.steps.store] Relaying message
2026-03-07 04:32:40.407 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12266/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:32:40.411 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:32:40.411 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-07 04:32:40.612 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-07 04:32:40.612 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12266/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=5&ascending=true&pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:32:40.615 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[]}'
2026-03-07 04:32:40.615 DEBUG [src.steps.store] messages length is 0
2026-03-07 04:32:40.617 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-07 04:32:40.618 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-07 04:32:40.618 DEBUG [src.node.waku_node] Stopping container with id 0d664a7b5f7e
2026-03-07 04:32:41.107 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:32:41.109 DEBUG [src.node.waku_node] Stopping container with id 1c4358d7c2ec
2026-03-07 04:32:41.586 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:32:41.588 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-07 04:32:41.595 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:32:41.600 DEBUG [src.node.docker_mananger] No errors found in the waku logs.