87 lines
15 KiB
Plaintext

2026-01-31 04:38:50.693 DEBUG [tests.conftest] Running fixture setup: test_id
2026-01-31 04:38:50.693 DEBUG [tests.conftest] Running test: test_subscribe_and_publish_on_another_shard with id: 2026-01-31_04-38-50__7d3e16f9-72cd-431a-8e8d-2ae3e8eb23c0
2026-01-31 04:38:50.693 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-01-31 04:38:50.693 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-01-31 04:38:50.694 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-01-31 04:38:50.700 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-31 04:38:50.700 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-01-31_04-38-50__7d3e16f9-72cd-431a-8e8d-2ae3e8eb23c0__wakuorg_nwaku:latest.log
2026-01-31 04:38:50.701 DEBUG [src.node.waku_node] Starting Node...
2026-01-31 04:38:50.701 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-31 04:38:50.702 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-31 04:38:50.702 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.52.179
2026-01-31 04:38:50.702 DEBUG [src.node.docker_mananger] Generated ports ['45921', '45922', '45923', '45924', '45925']
2026-01-31 04:38:50.703 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-01-31 04:38:50.703 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-01-31 04:38:50.703 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-31 04:38:50.703 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-31 04:38:50.703 DEBUG [src.node.waku_node] Using volumes []
2026-01-31 04:38:50.703 DEBUG [src.node.docker_mananger] docker run -i -t -p 45921:45921 -p 45922:45922 -p 45923:45923 -p 45924:45924 -p 45925:45925 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=45923 --rest-port=45921 --tcp-port=45922 --discv5-udp-port=45924 --rest-address=0.0.0.0 --nat=extip:172.18.52.179 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=0cca8bac55deced1f3cdc963ed4e5e198452e00143327994fa2fc87dccd3c607 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=45925 --metrics-logging=true --relay=true --filter=true
2026-01-31 04:38:50.887 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.52.179 waku 50e40733633217e51670134f61c8149fd5afc796ef3f74e5f5884f66a7cf076c
2026-01-31 04:38:50.916 DEBUG [src.node.docker_mananger] Container started with ID 50e407336332. Setting up logs at ./log/docker/node1_2026-01-31_04-38-50__7d3e16f9-72cd-431a-8e8d-2ae3e8eb23c0__wakuorg_nwaku:latest.log
2026-01-31 04:38:50.918 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 45921
2026-01-31 04:38:50.918 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-31 04:38:50.968 ERROR [src.node.docker_mananger] Max retries reached for container f24ed79453bb. Exiting log stream.
2026-01-31 04:38:51.467 ERROR [src.node.docker_mananger] Max retries reached for container cb890bf7bad0. Exiting log stream.
2026-01-31 04:38:51.918 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45921/health" -H "Content-Type: application/json" -d 'None'
2026-01-31 04:38:51.922 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-01-31 04:38:51.922 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-31 04:38:51.922 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45921/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-31 04:38:51.925 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.52.179/tcp/45922/p2p/16Uiu2HAmKbenHuoh4WgL6zeNreiMrPYLmW5om5ZNUGu2GL26hwAK","/ip4/172.18.52.179/tcp/45923/ws/p2p/16Uiu2HAmKbenHuoh4WgL6zeNreiMrPYLmW5om5ZNUGu2GL26hwAK"],"enrUri":"enr:-L24QHkxDYC2_3d8WQyaVuqkN-Xi6PaufxcWDLGYI-hEx7-Fc_RH20-FxoEHiapp7KUhHV7XgK4ngWRHdzPdiEIZjBsCgmlkgnY0gmlwhKwSNLOKbXVsdGlhZGRyc5YACASsEjSzBrNiAAoErBI0swazY90DgnJzhQACAQAAiXNlY3AyNTZrMaEDZybwfOtaHKPsh1ktgq9uNIz9f72QyBdHDdWy_7ED1iSDdGNwgrNig3VkcIKzZIV3YWt1MgU"}'
2026-01-31 04:38:51.925 INFO [src.node.waku_node] REST service is ready !!
2026-01-31 04:38:51.931 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-31 04:38:51.931 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-01-31_04-38-50__7d3e16f9-72cd-431a-8e8d-2ae3e8eb23c0__wakuorg_nwaku:latest.log
2026-01-31 04:38:51.931 DEBUG [src.node.waku_node] Starting Node...
2026-01-31 04:38:51.932 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-31 04:38:51.933 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-31 04:38:51.933 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.84.186
2026-01-31 04:38:51.933 DEBUG [src.node.docker_mananger] Generated ports ['4523', '4524', '4525', '4526', '4527']
2026-01-31 04:38:51.933 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-01-31 04:38:51.933 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-01-31 04:38:51.934 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-31 04:38:51.934 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-31 04:38:51.934 DEBUG [src.node.waku_node] Using volumes []
2026-01-31 04:38:51.934 DEBUG [src.node.docker_mananger] docker run -i -t -p 4523:4523 -p 4524:4524 -p 4525:4525 -p 4526:4526 -p 4527:4527 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=4525 --rest-port=4523 --tcp-port=4524 --discv5-udp-port=4526 --rest-address=0.0.0.0 --nat=extip:172.18.84.186 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=5cb1bdbfca56a5ccc1ec1aed8ea85c237c824dad40eeced98c74096fb2deebfb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=4527 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QHkxDYC2_3d8WQyaVuqkN-Xi6PaufxcWDLGYI-hEx7-Fc_RH20-FxoEHiapp7KUhHV7XgK4ngWRHdzPdiEIZjBsCgmlkgnY0gmlwhKwSNLOKbXVsdGlhZGRyc5YACASsEjSzBrNiAAoErBI0swazY90DgnJzhQACAQAAiXNlY3AyNTZrMaEDZybwfOtaHKPsh1ktgq9uNIz9f72QyBdHDdWy_7ED1iSDdGNwgrNig3VkcIKzZIV3YWt1MgU
2026-01-31 04:38:52.107 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.84.186 waku 909d42e60bca0b13a36a2dada96e9e609c7bdf992a00640e52b85af2bea66572
2026-01-31 04:38:52.140 DEBUG [src.node.docker_mananger] Container started with ID 909d42e60bca. Setting up logs at ./log/docker/node2_2026-01-31_04-38-50__7d3e16f9-72cd-431a-8e8d-2ae3e8eb23c0__wakuorg_nwaku:latest.log
2026-01-31 04:38:52.141 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 4523
2026-01-31 04:38:52.142 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-31 04:38:53.142 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4523/health" -H "Content-Type: application/json" -d 'None'
2026-01-31 04:38:53.151 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-01-31 04:38:53.153 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-31 04:38:53.153 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4523/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-31 04:38:53.159 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.84.186/tcp/4524/p2p/16Uiu2HAmU7gApZMoiU3JsCD2ytcc66YPFNWYo845Kh53H8wN4TVb","/ip4/172.18.84.186/tcp/4525/ws/p2p/16Uiu2HAmU7gApZMoiU3JsCD2ytcc66YPFNWYo845Kh53H8wN4TVb"],"enrUri":"enr:-L24QFX8W_VyzdZumaBYYAznfDjzw_A5r0uJu2n1DkGBxZEvDG6HP6-0F_Z60DLu2juC7h0NgbLiJb_6c-Z7DW0Yik8CgmlkgnY0gmlwhKwSVLqKbXVsdGlhZGRyc5YACASsElS6BhGsAAoErBJUugYRrd0DgnJzhQACAQAAiXNlY3AyNTZrMaED5bVt0bxLeG4Y_GimroQVvQ4AEzILRAm6fC83DCOh-mqDdGNwghGsg3VkcIIRroV3YWt1MgE"}'
2026-01-31 04:38:53.159 INFO [src.node.waku_node] REST service is ready !!
2026-01-31 04:38:53.160 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:4523/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.52.179/tcp/45922/p2p/16Uiu2HAmKbenHuoh4WgL6zeNreiMrPYLmW5om5ZNUGu2GL26hwAK"]'
2026-01-31 04:38:53.162 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-31 04:38:53.163 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45921/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/1"]'
2026-01-31 04:38:53.167 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-31 04:38:53.167 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:4523/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/1"]'
2026-01-31 04:38:53.171 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-31 04:38:53.172 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45921/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-31 04:38:53.178 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-31 04:38:53.178 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-01-31 04:38:53.278 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-01-31 04:38:53.279 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45921/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-01-31 04:38:53.281 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769834333172323623,"ephemeral":false,"proof":""}]'
2026-01-31 04:38:53.282 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-01-31 04:38:53.282 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4523/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-01-31 04:38:53.285 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769834333172323623,"ephemeral":false,"proof":""}]'
2026-01-31 04:38:53.286 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45921/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-01-31 04:38:53.290 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-31 04:38:53.291 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-01-31 04:38:53.391 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-01-31 04:38:53.392 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45921/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-01-31 04:38:53.394 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769834333286508112,"ephemeral":false,"proof":""}]'
2026-01-31 04:38:53.395 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-01-31 04:38:53.396 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4523/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-01-31 04:38:53.398 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1769834333286508112,"ephemeral":false,"proof":""}]'
2026-01-31 04:38:53.400 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-01-31 04:38:53.401 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-01-31 04:38:53.402 DEBUG [src.node.waku_node] Stopping container with id 50e407336332
2026-01-31 04:38:53.923 DEBUG [src.node.waku_node] Container stopped.
2026-01-31 04:38:53.925 DEBUG [src.node.waku_node] Stopping container with id 909d42e60bca
2026-01-31 04:38:54.459 DEBUG [src.node.waku_node] Container stopped.
2026-01-31 04:38:54.461 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-01-31 04:38:54.466 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-31 04:38:54.471 DEBUG [src.node.docker_mananger] No errors found in the waku logs.