101 lines
16 KiB
Plaintext

2026-03-20 04:41:18.688 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-20 04:41:18.689 DEBUG [tests.conftest] Running test: test_cant_publish_on_not_subscribed_shard with id: 2026-03-20_04-41-18__27dc2e5c-e023-4d70-a3aa-7f2b251a692e
2026-03-20 04:41:18.689 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-20 04:41:18.690 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-20 04:41:18.691 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-20 04:41:18.702 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-20 04:41:18.702 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-20_04-41-18__27dc2e5c-e023-4d70-a3aa-7f2b251a692e__wakuorg_nwaku:latest.log
2026-03-20 04:41:18.702 DEBUG [src.node.waku_node] Starting Node...
2026-03-20 04:41:18.702 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-20 04:41:18.704 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-20 04:41:18.705 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.66.222
2026-03-20 04:41:18.706 DEBUG [src.node.docker_mananger] Generated ports ['3741', '3742', '3743', '3744', '3745']
2026-03-20 04:41:18.706 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-20 04:41:18.707 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-20 04:41:18.707 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-20 04:41:18.708 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-20 04:41:18.708 DEBUG [src.node.waku_node] Using volumes []
2026-03-20 04:41:18.708 DEBUG [src.node.docker_mananger] docker run -i -t -p 3741:3741 -p 3742:3742 -p 3743:3743 -p 3744:3744 -p 3745:3745 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3743 --rest-port=3741 --tcp-port=3742 --discv5-udp-port=3744 --rest-address=0.0.0.0 --nat=extip:172.18.66.222 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=b2f7fb86bcdca8f4dcc7ded44f0f2e5efd2efefb0eeea1addfb92e0ebd5dacef --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3745 --metrics-logging=true --relay=true --filter=true
2026-03-20 04:41:18.881 ERROR [src.node.docker_mananger] Max retries reached for container fbd5a63287f6. Exiting log stream.
2026-03-20 04:41:18.925 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.66.222 waku 81850c7894f0ea08c82717b1ca9020be87f80ae5b0192da32c38b75d6002769a
2026-03-20 04:41:18.959 DEBUG [src.node.docker_mananger] Container started with ID 81850c7894f0. Setting up logs at ./log/docker/node1_2026-03-20_04-41-18__27dc2e5c-e023-4d70-a3aa-7f2b251a692e__wakuorg_nwaku:latest.log
2026-03-20 04:41:18.959 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 3741
2026-03-20 04:41:18.960 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-20 04:41:19.622 ERROR [src.node.docker_mananger] Max retries reached for container 8aa703195b73. Exiting log stream.
2026-03-20 04:41:19.961 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3741/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:41:19.964 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-20 04:41:20.064 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3741/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:41:20.067 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-20 04:41:20.067 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-20 04:41:20.067 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3741/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:41:20.071 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.66.222/tcp/3742/p2p/16Uiu2HAm1s5q2vnJMd1MtbV5Wgy2gRPXsgMRXAAPXVAW7iPdN5a8","/ip4/172.18.66.222/tcp/3743/ws/p2p/16Uiu2HAm1s5q2vnJMd1MtbV5Wgy2gRPXsgMRXAAPXVAW7iPdN5a8"],"enrUri":"enr:-L24QFl7WH9UztmnaAgtPaqXjxmAmTKvi8B-Z37OBLGTj2fxLz6I7kSsvgSv7P6FCqDDGdeQuiPr47fYFRHNlHd05pUCgmlkgnY0gmlwhKwSQt6KbXVsdGlhZGRyc5YACASsEkLeBg6eAAoErBJC3gYOn90DgnJzhQACAQAAiXNlY3AyNTZrMaECX6ibn8O2VT-UF655EdnQDFjEDG855hDzUqBsKuwkOZmDdGNwgg6eg3VkcIIOoIV3YWt1MgU"}'
2026-03-20 04:41:20.071 INFO [src.node.waku_node] REST service is ready !!
2026-03-20 04:41:20.079 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-20 04:41:20.079 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-20_04-41-18__27dc2e5c-e023-4d70-a3aa-7f2b251a692e__wakuorg_nwaku:latest.log
2026-03-20 04:41:20.079 DEBUG [src.node.waku_node] Starting Node...
2026-03-20 04:41:20.079 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-20 04:41:20.081 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-20 04:41:20.081 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.215.166
2026-03-20 04:41:20.081 DEBUG [src.node.docker_mananger] Generated ports ['43504', '43505', '43506', '43507', '43508']
2026-03-20 04:41:20.081 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-20 04:41:20.081 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-20 04:41:20.081 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-20 04:41:20.081 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-20 04:41:20.082 DEBUG [src.node.waku_node] Using volumes []
2026-03-20 04:41:20.082 DEBUG [src.node.docker_mananger] docker run -i -t -p 43504:43504 -p 43505:43505 -p 43506:43506 -p 43507:43507 -p 43508:43508 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=43506 --rest-port=43504 --tcp-port=43505 --discv5-udp-port=43507 --rest-address=0.0.0.0 --nat=extip:172.18.215.166 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=f0cef9fd5baefe7a360d79ff2be5de9e42044a3ff6d0c7db1dbb5fffafc7dd98 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=43508 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFl7WH9UztmnaAgtPaqXjxmAmTKvi8B-Z37OBLGTj2fxLz6I7kSsvgSv7P6FCqDDGdeQuiPr47fYFRHNlHd05pUCgmlkgnY0gmlwhKwSQt6KbXVsdGlhZGRyc5YACASsEkLeBg6eAAoErBJC3gYOn90DgnJzhQACAQAAiXNlY3AyNTZrMaECX6ibn8O2VT-UF655EdnQDFjEDG855hDzUqBsKuwkOZmDdGNwgg6eg3VkcIIOoIV3YWt1MgU
2026-03-20 04:41:20.292 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.215.166 waku 2683e90be550a109d5a3b82e99fea6a6efab7b5090415d27e90c6580afc16201
2026-03-20 04:41:20.327 DEBUG [src.node.docker_mananger] Container started with ID 2683e90be550. Setting up logs at ./log/docker/node2_2026-03-20_04-41-18__27dc2e5c-e023-4d70-a3aa-7f2b251a692e__wakuorg_nwaku:latest.log
2026-03-20 04:41:20.328 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 43504
2026-03-20 04:41:20.328 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-20 04:41:21.328 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43504/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:41:21.331 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-20 04:41:21.431 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43504/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:41:21.433 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-20 04:41:21.534 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43504/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:41:21.536 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-20 04:41:21.636 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43504/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:41:21.638 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-20 04:41:21.739 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43504/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:41:21.741 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-20 04:41:21.842 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43504/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:41:21.844 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-20 04:41:21.944 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43504/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:41:21.946 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-20 04:41:22.047 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43504/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:41:22.049 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-20 04:41:22.149 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43504/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:41:22.152 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-20 04:41:22.253 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43504/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:41:22.255 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-20 04:41:22.355 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43504/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:41:22.358 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-20 04:41:22.358 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-20 04:41:22.358 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:43504/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:41:22.360 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.215.166/tcp/43505/p2p/16Uiu2HAmDtW7qxD2tJv8NqACXtCoqSMTDz3my1CdSbSqpPM5LhWn","/ip4/172.18.215.166/tcp/43506/ws/p2p/16Uiu2HAmDtW7qxD2tJv8NqACXtCoqSMTDz3my1CdSbSqpPM5LhWn"],"enrUri":"enr:-L24QBxZNOaXZN34qDI3KIxLpR3JIuLeawxMESoQU86wdxzPPc0IYdG6KNsegW5WIFPDzIxbyvrRE74RcWZXv5PyJbQCgmlkgnY0gmlwhKwS16aKbXVsdGlhZGRyc5YACASsEtemBqnxAAoErBLXpgap8t0DgnJzhQACAQAAiXNlY3AyNTZrMaEDElHlfUDf1TybPXv43Vu6R4u7EInAIfvmUUnKVj-NCxeDdGNwgqnxg3VkcIKp84V3YWt1MgE"}'
2026-03-20 04:41:22.360 INFO [src.node.waku_node] REST service is ready !!
2026-03-20 04:41:22.361 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43504/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.66.222/tcp/3742/p2p/16Uiu2HAm1s5q2vnJMd1MtbV5Wgy2gRPXsgMRXAAPXVAW7iPdN5a8"]'
2026-03-20 04:41:22.384 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:41:22.387 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3741/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-03-20 04:41:22.398 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:41:22.398 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:43504/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0"]'
2026-03-20 04:41:22.403 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:41:22.404 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3741/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:41:22.418 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:41:22.418 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-20 04:41:22.518 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-20 04:41:22.518 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3741/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:41:22.521 ERROR [src.node.api_clients.base_client] HTTP error occurred: 404 Client Error: Not Found for url: http://127.0.0.1:3741/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1. Response content: b''
2026-03-20 04:41:22.572 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-20 04:41:22.573 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-20 04:41:22.573 DEBUG [src.node.waku_node] Stopping container with id 81850c7894f0
2026-03-20 04:41:23.194 DEBUG [src.node.waku_node] Container stopped.
2026-03-20 04:41:23.196 DEBUG [src.node.waku_node] Stopping container with id 2683e90be550
2026-03-20 04:41:23.813 DEBUG [src.node.waku_node] Container stopped.
2026-03-20 04:41:23.814 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-20 04:41:23.879 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-20 04:41:23.904 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-20 04:41:23.905 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-20 04:41:23.905 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-20 04:41:23.906 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-20_04-41-18__27dc2e5c-e023-4d70-a3aa-7f2b251a692e__wakuorg_nwaku:latest.log
2026-03-20 04:41:23.907 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-20_04-41-18__27dc2e5c-e023-4d70-a3aa-7f2b251a692e__wakuorg_nwaku:latest.log