87 lines
15 KiB
Plaintext

2026-02-02 04:49:06.338 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-02 04:49:06.338 DEBUG [tests.conftest] Running test: test_subscribe_and_publish_on_another_shard with id: 2026-02-02_04-49-06__d16ecb3d-5494-4daf-8806-fd8353e1d33e
2026-02-02 04:49:06.339 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-02 04:49:06.339 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-02 04:49:06.339 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-02-02 04:49:06.347 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-02 04:49:06.347 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-02_04-49-06__d16ecb3d-5494-4daf-8806-fd8353e1d33e__wakuorg_nwaku:latest.log
2026-02-02 04:49:06.348 DEBUG [src.node.waku_node] Starting Node...
2026-02-02 04:49:06.348 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-02 04:49:06.349 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-02 04:49:06.349 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.124.92
2026-02-02 04:49:06.350 DEBUG [src.node.docker_mananger] Generated ports ['12623', '12624', '12625', '12626', '12627']
2026-02-02 04:49:06.350 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-02-02 04:49:06.350 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-02 04:49:06.350 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-02 04:49:06.350 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-02 04:49:06.350 DEBUG [src.node.waku_node] Using volumes []
2026-02-02 04:49:06.350 DEBUG [src.node.docker_mananger] docker run -i -t -p 12623:12623 -p 12624:12624 -p 12625:12625 -p 12626:12626 -p 12627:12627 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=12625 --rest-port=12623 --tcp-port=12624 --discv5-udp-port=12626 --rest-address=0.0.0.0 --nat=extip:172.18.124.92 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=6ca0965c4e9ca6fc6cbdebcf5de6cfd30cdda25da9515be6acbebfc61be58dd5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=12627 --metrics-logging=true --relay=true --filter=true
2026-02-02 04:49:06.535 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.124.92 waku 6e953144eb7493e2b8d2eacd04cad519f405ee73914f689aea34b7a4d62ad9c4
2026-02-02 04:49:06.567 DEBUG [src.node.docker_mananger] Container started with ID 6e953144eb74. Setting up logs at ./log/docker/node1_2026-02-02_04-49-06__d16ecb3d-5494-4daf-8806-fd8353e1d33e__wakuorg_nwaku:latest.log
2026-02-02 04:49:06.568 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 12623
2026-02-02 04:49:06.568 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-02 04:49:06.575 ERROR [src.node.docker_mananger] Max retries reached for container a95b73bec0dd. Exiting log stream.
2026-02-02 04:49:07.126 ERROR [src.node.docker_mananger] Max retries reached for container f62a9789b22f. Exiting log stream.
2026-02-02 04:49:07.569 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12623/health" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:49:07.572 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-02-02 04:49:07.572 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-02 04:49:07.572 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12623/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:49:07.575 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.124.92/tcp/12624/p2p/16Uiu2HAmJeKAmYFQhYcM8xvebfnNPPjFZ9wDZ8ARu7hrgz6spHLr","/ip4/172.18.124.92/tcp/12625/ws/p2p/16Uiu2HAmJeKAmYFQhYcM8xvebfnNPPjFZ9wDZ8ARu7hrgz6spHLr"],"enrUri":"enr:-L24QGY2lvk390fiJKPq_DW0ga6umByqM5I1xgjeP-SknMPCUFqWNYYu9nx3Ua9YwRouh7P_cfi5Gq63kLcuUEq9F9gCgmlkgnY0gmlwhKwSfFyKbXVsdGlhZGRyc5YACASsEnxcBjFQAAoErBJ8XAYxUd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDWPnRqpDCLmBiAWrgMiO7KbaWcDJh0Emm8YIINQ9Q1BeDdGNwgjFQg3VkcIIxUoV3YWt1MgU"}'
2026-02-02 04:49:07.575 INFO [src.node.waku_node] REST service is ready !!
2026-02-02 04:49:07.582 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-02 04:49:07.582 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-02_04-49-06__d16ecb3d-5494-4daf-8806-fd8353e1d33e__wakuorg_nwaku:latest.log
2026-02-02 04:49:07.582 DEBUG [src.node.waku_node] Starting Node...
2026-02-02 04:49:07.582 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-02 04:49:07.584 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-02 04:49:07.584 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.248.95
2026-02-02 04:49:07.584 DEBUG [src.node.docker_mananger] Generated ports ['17649', '17650', '17651', '17652', '17653']
2026-02-02 04:49:07.584 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-02-02 04:49:07.584 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-02 04:49:07.584 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-02 04:49:07.584 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-02 04:49:07.584 DEBUG [src.node.waku_node] Using volumes []
2026-02-02 04:49:07.585 DEBUG [src.node.docker_mananger] docker run -i -t -p 17649:17649 -p 17650:17650 -p 17651:17651 -p 17652:17652 -p 17653:17653 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17651 --rest-port=17649 --tcp-port=17650 --discv5-udp-port=17652 --rest-address=0.0.0.0 --nat=extip:172.18.248.95 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=bc1bcd4e593fb1bbb1df346d818e5feef0e16d6d23508d5f3a83afd7fedc729c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17653 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QGY2lvk390fiJKPq_DW0ga6umByqM5I1xgjeP-SknMPCUFqWNYYu9nx3Ua9YwRouh7P_cfi5Gq63kLcuUEq9F9gCgmlkgnY0gmlwhKwSfFyKbXVsdGlhZGRyc5YACASsEnxcBjFQAAoErBJ8XAYxUd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDWPnRqpDCLmBiAWrgMiO7KbaWcDJh0Emm8YIINQ9Q1BeDdGNwgjFQg3VkcIIxUoV3YWt1MgU
2026-02-02 04:49:07.782 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.248.95 waku a2bada6f26db288c12420b2e141d10bb1e6fc37d904eb70bc2c7cb9a212347b6
2026-02-02 04:49:07.814 DEBUG [src.node.docker_mananger] Container started with ID a2bada6f26db. Setting up logs at ./log/docker/node2_2026-02-02_04-49-06__d16ecb3d-5494-4daf-8806-fd8353e1d33e__wakuorg_nwaku:latest.log
2026-02-02 04:49:07.814 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 17649
2026-02-02 04:49:07.815 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-02 04:49:08.815 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17649/health" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:49:08.829 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-02-02 04:49:08.831 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-02 04:49:08.831 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17649/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:49:08.835 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.248.95/tcp/17650/p2p/16Uiu2HAmD2Q3Z9agEVTUCo7ASgtuREo55sxRXX3GVshoD6KdkUa2","/ip4/172.18.248.95/tcp/17651/ws/p2p/16Uiu2HAmD2Q3Z9agEVTUCo7ASgtuREo55sxRXX3GVshoD6KdkUa2"],"enrUri":"enr:-L24QAvfZawtwkHxDFq0idtZYN_NPpKgKXEzmuImzSkG8ODzWTev11--AAgDVRfvp-S2U6Yh74_SLj5VqrGhEbEj7X8CgmlkgnY0gmlwhKwS-F-KbXVsdGlhZGRyc5YACASsEvhfBkTyAAoErBL4XwZE890DgnJzhQACAQAAiXNlY3AyNTZrMaEDBXv89rRq7a8M2jrWgoLqcY4-vZncbt8kRXogCnKqXb-DdGNwgkTyg3VkcIJE9IV3YWt1MgE"}'
2026-02-02 04:49:08.835 INFO [src.node.waku_node] REST service is ready !!
2026-02-02 04:49:08.836 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17649/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.124.92/tcp/12624/p2p/16Uiu2HAmJeKAmYFQhYcM8xvebfnNPPjFZ9wDZ8ARu7hrgz6spHLr"]'
2026-02-02 04:49:08.839 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:49:08.840 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12623/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/1"]'
2026-02-02 04:49:08.844 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:49:08.845 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17649/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/1"]'
2026-02-02 04:49:08.849 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:49:08.850 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12623/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-02 04:49:08.856 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:49:08.857 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-02-02 04:49:08.957 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-02-02 04:49:08.958 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12623/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:49:08.960 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1770007748850682733,"ephemeral":false,"proof":""}]'
2026-02-02 04:49:08.962 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-02-02 04:49:08.962 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17649/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:49:08.965 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1770007748850682733,"ephemeral":false,"proof":""}]'
2026-02-02 04:49:08.966 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12623/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-02 04:49:08.971 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:49:08.971 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-02-02 04:49:09.071 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-02-02 04:49:09.072 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12623/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:49:09.074 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1770007748966592746,"ephemeral":false,"proof":""}]'
2026-02-02 04:49:09.076 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-02-02 04:49:09.076 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17649/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:49:09.078 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1770007748966592746,"ephemeral":false,"proof":""}]'
2026-02-02 04:49:09.081 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-02 04:49:09.082 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-02 04:49:09.082 DEBUG [src.node.waku_node] Stopping container with id 6e953144eb74
2026-02-02 04:49:09.621 DEBUG [src.node.waku_node] Container stopped.
2026-02-02 04:49:09.622 DEBUG [src.node.waku_node] Stopping container with id a2bada6f26db
2026-02-02 04:49:10.143 DEBUG [src.node.waku_node] Container stopped.
2026-02-02 04:49:10.144 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-02 04:49:10.150 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-02 04:49:10.157 DEBUG [src.node.docker_mananger] No errors found in the waku logs.