83 lines
14 KiB
Plaintext

2026-03-10 04:34:08.092 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-10 04:34:08.092 DEBUG [tests.conftest] Running test: test_subscribe_and_publish_on_another_content_topic_from_another_shard with id: 2026-03-10_04-34-08__66ad9f89-247c-4870-9fdc-eb7407c89f16
2026-03-10 04:34:08.093 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-10 04:34:08.093 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-10 04:34:08.093 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-10 04:34:08.100 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-10 04:34:08.100 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-10_04-34-08__66ad9f89-247c-4870-9fdc-eb7407c89f16__wakuorg_nwaku:latest.log
2026-03-10 04:34:08.101 DEBUG [src.node.waku_node] Starting Node...
2026-03-10 04:34:08.101 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-10 04:34:08.102 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-10 04:34:08.102 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.6.221
2026-03-10 04:34:08.102 DEBUG [src.node.docker_mananger] Generated ports ['49813', '49814', '49815', '49816', '49817']
2026-03-10 04:34:08.103 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-10 04:34:08.103 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-10 04:34:08.103 DEBUG [src.node.waku_node] Using volumes []
2026-03-10 04:34:08.103 DEBUG [src.node.docker_mananger] docker run -i -t -p 49813:49813 -p 49814:49814 -p 49815:49815 -p 49816:49816 -p 49817:49817 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=49815 --rest-port=49813 --tcp-port=49814 --discv5-udp-port=49816 --rest-address=0.0.0.0 --nat=extip:172.18.6.221 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=1daa6c2bbb36b28e042f16d996c62cbdcbb6aaea2ba7a1c1f9f7da09161db0de --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=49817 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-10 04:34:08.310 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.6.221 waku 1fb783b9cac06939061c6881fc4cd6ed0109fc5531fde7b081fcdf7ee30dccc6
2026-03-10 04:34:08.348 DEBUG [src.node.docker_mananger] Container started with ID 1fb783b9cac0. Setting up logs at ./log/docker/node1_2026-03-10_04-34-08__66ad9f89-247c-4870-9fdc-eb7407c89f16__wakuorg_nwaku:latest.log
2026-03-10 04:34:08.349 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 49813
2026-03-10 04:34:08.349 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-10 04:34:08.898 ERROR [src.node.docker_mananger] Max retries reached for container 80fd4f7852cb. Exiting log stream.
2026-03-10 04:34:09.350 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49813/health" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:34:09.352 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-10 04:34:09.353 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-10 04:34:09.353 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49813/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:34:09.355 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.6.221/tcp/49814/p2p/16Uiu2HAm2EAvGCkQL8ypLfY5xNFThW9B6pJqFeZTVDvCJNKKWdUu","/ip4/172.18.6.221/tcp/49815/ws/p2p/16Uiu2HAm2EAvGCkQL8ypLfY5xNFThW9B6pJqFeZTVDvCJNKKWdUu"],"enrUri":"enr:-L24QG1rWZxWs2roBxbn8JhFQrIRftyobQLco-ud2LEzWaK9Ps5TxEPKbnxCpz98SjYcKa6T7T4-u_XF9eNkXX9gJe4CgmlkgnY0gmlwhKwSBt2KbXVsdGlhZGRyc5YACASsEgbdBsKWAAoErBIG3QbCl90DgnJzhQACAQAAiXNlY3AyNTZrMaECZQ-PczVPHqR4JQH8A98YrUMj2NV1dLn_7ayRvAqMuQqDdGNwgsKWg3VkcILCmIV3YWt1MgU"}'
2026-03-10 04:34:09.355 INFO [src.node.waku_node] REST service is ready !!
2026-03-10 04:34:09.363 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-10 04:34:09.364 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-10_04-34-08__66ad9f89-247c-4870-9fdc-eb7407c89f16__wakuorg_nwaku:latest.log
2026-03-10 04:34:09.364 DEBUG [src.node.waku_node] Starting Node...
2026-03-10 04:34:09.364 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-10 04:34:09.366 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-10 04:34:09.366 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.89.208
2026-03-10 04:34:09.366 DEBUG [src.node.docker_mananger] Generated ports ['2281', '2282', '2283', '2284', '2285']
2026-03-10 04:34:09.366 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-10 04:34:09.367 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-10 04:34:09.367 DEBUG [src.node.waku_node] Using volumes []
2026-03-10 04:34:09.367 DEBUG [src.node.docker_mananger] docker run -i -t -p 2281:2281 -p 2282:2282 -p 2283:2283 -p 2284:2284 -p 2285:2285 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=2283 --rest-port=2281 --tcp-port=2282 --discv5-udp-port=2284 --rest-address=0.0.0.0 --nat=extip:172.18.89.208 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=b3eb9becfffd844751bf0d2c0795e80eef42c3c6ba1d1c4c4855d2cd455b41b5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=2285 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QG1rWZxWs2roBxbn8JhFQrIRftyobQLco-ud2LEzWaK9Ps5TxEPKbnxCpz98SjYcKa6T7T4-u_XF9eNkXX9gJe4CgmlkgnY0gmlwhKwSBt2KbXVsdGlhZGRyc5YACASsEgbdBsKWAAoErBIG3QbCl90DgnJzhQACAQAAiXNlY3AyNTZrMaECZQ-PczVPHqR4JQH8A98YrUMj2NV1dLn_7ayRvAqMuQqDdGNwgsKWg3VkcILCmIV3YWt1MgU --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-10 04:34:09.573 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.89.208 waku f90f16bd110b0a92d0ca1792ebf3e5f8c740b80f7d00186be838200cd67987e2
2026-03-10 04:34:09.610 DEBUG [src.node.docker_mananger] Container started with ID f90f16bd110b. Setting up logs at ./log/docker/node2_2026-03-10_04-34-08__66ad9f89-247c-4870-9fdc-eb7407c89f16__wakuorg_nwaku:latest.log
2026-03-10 04:34:09.610 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 2281
2026-03-10 04:34:09.611 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-10 04:34:10.611 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2281/health" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:34:10.615 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-10 04:34:10.616 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-10 04:34:10.617 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2281/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:34:10.620 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.89.208/tcp/2282/p2p/16Uiu2HAmTX4MbpAigYJugWsyJpdiouH96Lp2HgCCmkgNaMnzZ8pJ","/ip4/172.18.89.208/tcp/2283/ws/p2p/16Uiu2HAmTX4MbpAigYJugWsyJpdiouH96Lp2HgCCmkgNaMnzZ8pJ"],"enrUri":"enr:-L24QMjybE1uVuJ7NsQP6HSJFyY9GtUhey4hoU2PjWrMH-ZNI69ZaPB91vXn82aZtWRdKc_V0fH9q_FK_ICycmIjD-4CgmlkgnY0gmlwhKwSWdCKbXVsdGlhZGRyc5YACASsElnQBgjqAAoErBJZ0AYI690DgnJzhQACAQAAiXNlY3AyNTZrMaED3NcvsZK2eXlKjZ37mErPUeikPvQKY2htAbsieqRHH-ODdGNwggjqg3VkcIII7IV3YWt1MgE"}'
2026-03-10 04:34:10.621 INFO [src.node.waku_node] REST service is ready !!
2026-03-10 04:34:10.621 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2281/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.6.221/tcp/49814/p2p/16Uiu2HAm2EAvGCkQL8ypLfY5xNFThW9B6pJqFeZTVDvCJNKKWdUu"]'
2026-03-10 04:34:10.640 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:34:10.642 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:49813/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/toychat/2/huilong/proto"]'
2026-03-10 04:34:10.655 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:34:10.656 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2281/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/toychat/2/huilong/proto"]'
2026-03-10 04:34:10.663 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:34:10.664 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:49813/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/toychat/2/huilong/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:34:10.674 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:34:10.674 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-10 04:34:10.775 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-10 04:34:10.776 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49813/relay/v1/auto/messages/%2Ftoychat%2F2%2Fhuilong%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:34:10.778 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1773117250664058241,"ephemeral":false,"proof":""}]'
2026-03-10 04:34:10.780 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-10 04:34:10.780 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2281/relay/v1/auto/messages/%2Ftoychat%2F2%2Fhuilong%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:34:10.783 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1773117250664058241,"ephemeral":false,"proof":""}]'
2026-03-10 04:34:10.784 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:49813/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:34:10.794 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:34:10.794 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-10 04:34:10.895 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-10 04:34:10.895 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49813/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:34:10.898 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773117250716862245,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773117250784493534,"ephemeral":false,"proof":""}]'
2026-03-10 04:34:10.958 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-10 04:34:10.959 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-10 04:34:10.959 DEBUG [src.node.waku_node] Stopping container with id 1fb783b9cac0
2026-03-10 04:34:11.531 DEBUG [src.node.waku_node] Container stopped.
2026-03-10 04:34:11.532 DEBUG [src.node.waku_node] Stopping container with id f90f16bd110b
2026-03-10 04:34:12.111 DEBUG [src.node.waku_node] Container stopped.
2026-03-10 04:34:12.113 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-10 04:34:12.145 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-10 04:34:12.185 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-10 04:34:12.186 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-10 04:34:12.186 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-10 04:34:12.187 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-10_04-34-08__66ad9f89-247c-4870-9fdc-eb7407c89f16__wakuorg_nwaku:latest.log
2026-03-10 04:34:12.188 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-10_04-34-08__66ad9f89-247c-4870-9fdc-eb7407c89f16__wakuorg_nwaku:latest.log