103 lines
18 KiB
Plaintext

2026-03-14 04:35:11.579 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-14 04:35:11.580 DEBUG [tests.conftest] Running test: test_subscribe_and_publish_on_another_content_topic_from_same_shard with id: 2026-03-14_04-35-11__33bffb21-0773-4f9c-893d-d51bc2862c80
2026-03-14 04:35:11.580 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-14 04:35:11.580 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-14 04:35:11.580 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-14 04:35:11.589 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:35:11.589 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-14_04-35-11__33bffb21-0773-4f9c-893d-d51bc2862c80__wakuorg_nwaku:latest.log
2026-03-14 04:35:11.589 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:35:11.589 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:35:11.590 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:35:11.591 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.252.11
2026-03-14 04:35:11.591 DEBUG [src.node.docker_mananger] Generated ports ['31051', '31052', '31053', '31054', '31055']
2026-03-14 04:35:11.591 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:35:11.591 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:35:11.591 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:35:11.591 DEBUG [src.node.docker_mananger] docker run -i -t -p 31051:31051 -p 31052:31052 -p 31053:31053 -p 31054:31054 -p 31055:31055 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=31053 --rest-port=31051 --tcp-port=31052 --discv5-udp-port=31054 --rest-address=0.0.0.0 --nat=extip:172.18.252.11 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=90bff779a8e19a92138f6e4cde9bbc9cdea8df122190b8f7b410fec39dc74df8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=31055 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-14 04:35:11.783 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.252.11 waku 61b4ba0b0da0a634e78f4b10d3b9ced2915a4750ec2fa8935523b6300924784e
2026-03-14 04:35:11.823 ERROR [src.node.docker_mananger] Max retries reached for container 62408357e9f1. Exiting log stream.
2026-03-14 04:35:11.823 DEBUG [src.node.docker_mananger] Container started with ID 61b4ba0b0da0. Setting up logs at ./log/docker/node1_2026-03-14_04-35-11__33bffb21-0773-4f9c-893d-d51bc2862c80__wakuorg_nwaku:latest.log
2026-03-14 04:35:11.824 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 31051
2026-03-14 04:35:11.824 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:35:12.380 ERROR [src.node.docker_mananger] Max retries reached for container 4f2ec1b233e4. Exiting log stream.
2026-03-14 04:35:12.824 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31051/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:35:12.827 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:35:12.827 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:35:12.828 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31051/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:35:12.830 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.252.11/tcp/31052/p2p/16Uiu2HAmVHuVN6dYyQ1SBx4DnGPqzCTRBrTZhYEYTQhZMc7Cd3WD","/ip4/172.18.252.11/tcp/31053/ws/p2p/16Uiu2HAmVHuVN6dYyQ1SBx4DnGPqzCTRBrTZhYEYTQhZMc7Cd3WD"],"enrUri":"enr:-L24QDoQEaKp59lGDchdyWem9EhO3viotG0qrjwZDL6Kx-PpYLDe8NV2GkD_S0ckNwtV4VxPtb0UIDY1VPMlJOD6NmkCgmlkgnY0gmlwhKwS_AuKbXVsdGlhZGRyc5YACASsEvwLBnlMAAoErBL8CwZ5Td0DgnJzhQACAQAAiXNlY3AyNTZrMaED9y_8ElBQRjmcMsmxNEVFaeDKh4_7tk7Y6GgUy3DNWLaDdGNwgnlMg3VkcIJ5ToV3YWt1MgU"}'
2026-03-14 04:35:12.830 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:35:12.837 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-14 04:35:12.837 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-14_04-35-11__33bffb21-0773-4f9c-893d-d51bc2862c80__wakuorg_nwaku:latest.log
2026-03-14 04:35:12.838 DEBUG [src.node.waku_node] Starting Node...
2026-03-14 04:35:12.838 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-14 04:35:12.839 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-14 04:35:12.839 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.189.63
2026-03-14 04:35:12.839 DEBUG [src.node.docker_mananger] Generated ports ['10614', '10615', '10616', '10617', '10618']
2026-03-14 04:35:12.839 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-14 04:35:12.840 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-14 04:35:12.840 DEBUG [src.node.waku_node] Using volumes []
2026-03-14 04:35:12.840 DEBUG [src.node.docker_mananger] docker run -i -t -p 10614:10614 -p 10615:10615 -p 10616:10616 -p 10617:10617 -p 10618:10618 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=10616 --rest-port=10614 --tcp-port=10615 --discv5-udp-port=10617 --rest-address=0.0.0.0 --nat=extip:172.18.189.63 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=50aa5444de80f7dcf4feedb012a1a559ec11d00b7ecdd2aed4cf5cceae8b63ce --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=10618 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QDoQEaKp59lGDchdyWem9EhO3viotG0qrjwZDL6Kx-PpYLDe8NV2GkD_S0ckNwtV4VxPtb0UIDY1VPMlJOD6NmkCgmlkgnY0gmlwhKwS_AuKbXVsdGlhZGRyc5YACASsEvwLBnlMAAoErBL8CwZ5Td0DgnJzhQACAQAAiXNlY3AyNTZrMaED9y_8ElBQRjmcMsmxNEVFaeDKh4_7tk7Y6GgUy3DNWLaDdGNwgnlMg3VkcIJ5ToV3YWt1MgU --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-14 04:35:13.043 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.189.63 waku 9d5bde6ec05621229c0e17b33b22f9ef423f2fb75651243d971c953d77016fc3
2026-03-14 04:35:13.079 DEBUG [src.node.docker_mananger] Container started with ID 9d5bde6ec056. Setting up logs at ./log/docker/node2_2026-03-14_04-35-11__33bffb21-0773-4f9c-893d-d51bc2862c80__wakuorg_nwaku:latest.log
2026-03-14 04:35:13.080 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 10614
2026-03-14 04:35:13.080 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-14 04:35:14.080 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10614/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:35:14.083 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:35:14.184 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10614/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:35:14.186 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:35:14.286 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10614/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:35:14.289 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:35:14.389 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10614/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:35:14.392 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:35:14.492 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10614/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:35:14.495 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:35:14.595 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10614/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:35:14.598 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:35:14.698 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10614/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:35:14.701 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:35:14.801 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10614/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:35:14.805 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:35:14.905 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10614/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:35:14.907 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:35:15.008 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10614/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:35:15.021 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-14 04:35:15.122 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10614/health" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:35:15.124 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-14 04:35:15.124 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-14 04:35:15.125 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10614/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:35:15.127 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.189.63/tcp/10615/p2p/16Uiu2HAmCtKXVUaQDcdpi9KUiQzausZaG8AYpYa1869dazvMP1Wy","/ip4/172.18.189.63/tcp/10616/ws/p2p/16Uiu2HAmCtKXVUaQDcdpi9KUiQzausZaG8AYpYa1869dazvMP1Wy"],"enrUri":"enr:-L24QDX3bGCI5BhB_SWtYU_ZT_zl1tQcrCSCpzwDJgvC3VTQNChcYWktx_UDgbQBzUBkuGO6h4AcHJdcSOEYCXRFBnYCgmlkgnY0gmlwhKwSvT-KbXVsdGlhZGRyc5YACASsEr0_Bil3AAoErBK9PwYpeN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDA2o7luaKEF82bcqDc-JYPDTNfjNqAE86kdKmc182RFqDdGNwgil3g3VkcIIpeYV3YWt1MgE"}'
2026-03-14 04:35:15.127 INFO [src.node.waku_node] REST service is ready !!
2026-03-14 04:35:15.127 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10614/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.252.11/tcp/31052/p2p/16Uiu2HAmVHuVN6dYyQ1SBx4DnGPqzCTRBrTZhYEYTQhZMc7Cd3WD"]'
2026-03-14 04:35:15.147 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:35:15.148 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31051/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/newsService/1.0/weekly/protobuf"]'
2026-03-14 04:35:15.159 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:35:15.161 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10614/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/newsService/1.0/weekly/protobuf"]'
2026-03-14 04:35:15.165 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:35:15.166 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31051/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/newsService/1.0/weekly/protobuf", "timestamp": '$(date +%s%N)'}'
2026-03-14 04:35:15.176 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:35:15.177 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-14 04:35:15.278 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-14 04:35:15.278 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31051/relay/v1/auto/messages/%2FnewsService%2F1.0%2Fweekly%2Fprotobuf" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:35:15.281 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/newsService/1.0/weekly/protobuf","version":0,"timestamp":1773462915166461603,"ephemeral":false,"proof":""}]'
2026-03-14 04:35:15.282 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-14 04:35:15.283 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10614/relay/v1/auto/messages/%2FnewsService%2F1.0%2Fweekly%2Fprotobuf" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:35:15.285 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/newsService/1.0/weekly/protobuf","version":0,"timestamp":1773462915166461603,"ephemeral":false,"proof":""}]'
2026-03-14 04:35:15.287 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31051/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-14 04:35:15.296 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-14 04:35:15.297 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-14 04:35:15.397 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-14 04:35:15.398 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31051/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:35:15.400 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773462915287262331,"ephemeral":false,"proof":""}]'
2026-03-14 04:35:15.402 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-14 04:35:15.402 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10614/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-14 04:35:15.405 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773462915287262331,"ephemeral":false,"proof":""}]'
2026-03-14 04:35:15.407 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-14 04:35:15.408 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-14 04:35:15.409 DEBUG [src.node.waku_node] Stopping container with id 61b4ba0b0da0
2026-03-14 04:35:16.022 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:35:16.024 DEBUG [src.node.waku_node] Stopping container with id 9d5bde6ec056
2026-03-14 04:35:16.632 DEBUG [src.node.waku_node] Container stopped.
2026-03-14 04:35:16.634 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-14 04:35:16.692 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-14 04:35:16.718 DEBUG [src.node.docker_mananger] No errors found in the waku logs.