101 lines
18 KiB
Plaintext

2026-03-08 04:41:46.866 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-08 04:41:46.866 DEBUG [tests.conftest] Running test: test_multiple_content_topics_and_multiple_pubsub_topics with id: 2026-03-08_04-41-46__981b8105-2b40-4201-a97c-cbcb97050223
2026-03-08 04:41:46.867 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-08 04:41:46.867 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-08 04:41:46.867 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-08 04:41:46.875 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-08 04:41:46.875 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-08_04-41-46__981b8105-2b40-4201-a97c-cbcb97050223__wakuorg_nwaku:latest.log
2026-03-08 04:41:46.875 DEBUG [src.node.waku_node] Starting Node...
2026-03-08 04:41:46.875 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-08 04:41:46.877 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-08 04:41:46.877 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.139.37
2026-03-08 04:41:46.877 DEBUG [src.node.docker_mananger] Generated ports ['13936', '13937', '13938', '13939', '13940']
2026-03-08 04:41:46.877 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-08 04:41:46.877 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-08 04:41:46.877 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-08 04:41:46.878 DEBUG [src.node.waku_node] Using volumes []
2026-03-08 04:41:46.878 DEBUG [src.node.docker_mananger] docker run -i -t -p 13936:13936 -p 13937:13937 -p 13938:13938 -p 13939:13939 -p 13940:13940 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=13938 --rest-port=13936 --tcp-port=13937 --discv5-udp-port=13939 --rest-address=0.0.0.0 --nat=extip:172.18.139.37 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=aefb2767abc9e3ae5fc70d2ebe62cfd93cec6030cded5aee9eaecfadcd5fd246 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=13940 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --content-topic=/waku/2/content/test.js --content-topic=/app/22/sometopic/someencoding --content-topic=/toychat/2/huilong/proto --content-topic=/statusim/1/community/cbor --content-topic=/app/27/sometopic/someencoding --content-topic=/app/29/sometopic/someencoding --content-topic=/app/20/sometopic/someencoding
2026-03-08 04:41:47.026 ERROR [src.node.docker_mananger] Max retries reached for container c6f66f8e2a58. Exiting log stream.
2026-03-08 04:41:47.072 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.139.37 waku 4393737444f6994ec32f9d12c7cbec2872fdcd6e818901c39d480bdb0c01e3c8
2026-03-08 04:41:47.112 DEBUG [src.node.docker_mananger] Container started with ID 4393737444f6. Setting up logs at ./log/docker/node1_2026-03-08_04-41-46__981b8105-2b40-4201-a97c-cbcb97050223__wakuorg_nwaku:latest.log
2026-03-08 04:41:47.114 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 13936
2026-03-08 04:41:47.114 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-08 04:41:47.593 ERROR [src.node.docker_mananger] Max retries reached for container b00a64724f53. Exiting log stream.
2026-03-08 04:41:48.114 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13936/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:41:48.117 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-08 04:41:48.217 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13936/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:41:48.221 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-08 04:41:48.321 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13936/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:41:48.325 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:41:48.325 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:41:48.325 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13936/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:41:48.328 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.139.37/tcp/13937/p2p/16Uiu2HAm1nKGVoGb8r9NdMvW2AJai8AZGoqBUYJg5W7zqNuAnWTs","/ip4/172.18.139.37/tcp/13938/ws/p2p/16Uiu2HAm1nKGVoGb8r9NdMvW2AJai8AZGoqBUYJg5W7zqNuAnWTs"],"enrUri":"enr:-L24QL7bnjrxofxdFu_3YbUAGyCyXU38rKy1ZXq-ArKXWLsiKUSo5MTiZFp4G9MiPIIFsBBafKDe9IZwNyEm7j_RivcCgmlkgnY0gmlwhKwSiyWKbXVsdGlhZGRyc5YACASsEoslBjZxAAoErBKLJQY2ct0DgnJzhQACAQAAiXNlY3AyNTZrMaECXm_mP9zQuRgEZ9VEJ37Sh6NxsAt8K0Z0l8Qz6sAmyoKDdGNwgjZxg3VkcII2c4V3YWt1MgU"}'
2026-03-08 04:41:48.328 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:41:48.336 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-08 04:41:48.336 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-08_04-41-46__981b8105-2b40-4201-a97c-cbcb97050223__wakuorg_nwaku:latest.log
2026-03-08 04:41:48.336 DEBUG [src.node.waku_node] Starting Node...
2026-03-08 04:41:48.337 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-08 04:41:48.338 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-08 04:41:48.338 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.168.102
2026-03-08 04:41:48.338 DEBUG [src.node.docker_mananger] Generated ports ['32361', '32362', '32363', '32364', '32365']
2026-03-08 04:41:48.339 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-08 04:41:48.339 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-08 04:41:48.339 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-08 04:41:48.339 DEBUG [src.node.waku_node] Using volumes []
2026-03-08 04:41:48.339 DEBUG [src.node.docker_mananger] docker run -i -t -p 32361:32361 -p 32362:32362 -p 32363:32363 -p 32364:32364 -p 32365:32365 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32363 --rest-port=32361 --tcp-port=32362 --discv5-udp-port=32364 --rest-address=0.0.0.0 --nat=extip:172.18.168.102 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=8bafd75a2cdfaa6ab0f1cb1becb92d8607764c795f9daa62e15d645baafc9b1f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32365 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QL7bnjrxofxdFu_3YbUAGyCyXU38rKy1ZXq-ArKXWLsiKUSo5MTiZFp4G9MiPIIFsBBafKDe9IZwNyEm7j_RivcCgmlkgnY0gmlwhKwSiyWKbXVsdGlhZGRyc5YACASsEoslBjZxAAoErBKLJQY2ct0DgnJzhQACAQAAiXNlY3AyNTZrMaECXm_mP9zQuRgEZ9VEJ37Sh6NxsAt8K0Z0l8Qz6sAmyoKDdGNwgjZxg3VkcII2c4V3YWt1MgU --content-topic=/myapp/1/latest/proto --content-topic=/waku/2/content/test.js --content-topic=/app/22/sometopic/someencoding --content-topic=/toychat/2/huilong/proto --content-topic=/statusim/1/community/cbor --content-topic=/app/27/sometopic/someencoding --content-topic=/app/29/sometopic/someencoding --content-topic=/app/20/sometopic/someencoding
2026-03-08 04:41:48.561 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.168.102 waku 15867b3db1ae3dc66e81751ed2def9bff7c70a9201b9454777ce17005ff536b3
2026-03-08 04:41:48.605 DEBUG [src.node.docker_mananger] Container started with ID 15867b3db1ae. Setting up logs at ./log/docker/node2_2026-03-08_04-41-46__981b8105-2b40-4201-a97c-cbcb97050223__wakuorg_nwaku:latest.log
2026-03-08 04:41:48.606 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 32361
2026-03-08 04:41:48.606 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-08 04:41:49.607 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32361/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:41:49.610 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-08 04:41:49.710 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32361/health" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:41:49.713 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-08 04:41:49.713 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-08 04:41:49.713 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32361/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:41:49.716 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.168.102/tcp/32362/p2p/16Uiu2HAmR1bVJEodgKmwgYTzK1q4Q9jsavFdn6PMzLJkk7i7Aars","/ip4/172.18.168.102/tcp/32363/ws/p2p/16Uiu2HAmR1bVJEodgKmwgYTzK1q4Q9jsavFdn6PMzLJkk7i7Aars"],"enrUri":"enr:-L24QP0BZRAi0Tob6HAZIingnatZmk1TIjQzWn3y928a8Eb5IXZG_s117h5Nj6RZSQg0rGheEtTkGt0SnJ9Z0w5gP2gCgmlkgnY0gmlwhKwSqGaKbXVsdGlhZGRyc5YACASsEqhmBn5qAAoErBKoZgZ-a90DgnJzhQACAQAAiXNlY3AyNTZrMaEDt5OXDPtzSTatz9SERMXnjAAx9WBpmmSQvXO8CqRgr1iDdGNwgn5qg3VkcIJ-bIV3YWt1MgE"}'
2026-03-08 04:41:49.716 INFO [src.node.waku_node] REST service is ready !!
2026-03-08 04:41:49.716 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32361/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.139.37/tcp/13937/p2p/16Uiu2HAm1nKGVoGb8r9NdMvW2AJai8AZGoqBUYJg5W7zqNuAnWTs"]'
2026-03-08 04:41:49.746 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:41:49.749 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13936/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-08 04:41:49.753 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:41:49.754 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32361/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto", "/waku/2/content/test.js", "/app/22/sometopic/someencoding", "/toychat/2/huilong/proto", "/statusim/1/community/cbor", "/app/27/sometopic/someencoding", "/app/29/sometopic/someencoding", "/app/20/sometopic/someencoding"]'
2026-03-08 04:41:49.760 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:41:49.761 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13936/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:41:49.777 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:41:49.778 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-08 04:41:49.878 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-08 04:41:49.879 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13936/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:41:49.881 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772944909761054618,"ephemeral":false,"proof":""}]'
2026-03-08 04:41:49.883 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-08 04:41:49.883 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32361/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:41:49.886 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772944909761054618,"ephemeral":false,"proof":""}]'
2026-03-08 04:41:49.888 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13936/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/waku/2/content/test.js", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:41:49.897 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:41:49.898 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-08 04:41:49.998 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-08 04:41:49.999 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13936/relay/v1/auto/messages/%2Fwaku%2F2%2Fcontent%2Ftest.js" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:41:50.002 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/waku/2/content/test.js","version":0,"timestamp":1772944909888137000,"ephemeral":false,"proof":""}]'
2026-03-08 04:41:50.004 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-08 04:41:50.004 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32361/relay/v1/auto/messages/%2Fwaku%2F2%2Fcontent%2Ftest.js" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:41:50.006 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/waku/2/content/test.js","version":0,"timestamp":1772944909888137000,"ephemeral":false,"proof":""}]'
2026-03-08 04:41:50.008 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:13936/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/22/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-08 04:41:50.017 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-08 04:41:50.017 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-08 04:41:50.117 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-08 04:41:50.118 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:13936/relay/v1/auto/messages/%2Fapp%2F22%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-08 04:41:50.124 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/22/sometopic/someencoding","version":0,"timestamp":1772944904854341505,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/22/sometopic/someencoding","version":0,"timestamp":1772944910008433460,"ephemeral":false,"proof":""}]'
2026-03-08 04:41:50.140 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-08 04:41:50.141 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-08 04:41:50.141 DEBUG [src.node.waku_node] Stopping container with id 4393737444f6
2026-03-08 04:41:50.781 DEBUG [src.node.waku_node] Container stopped.
2026-03-08 04:41:50.781 DEBUG [src.node.waku_node] Stopping container with id 15867b3db1ae
2026-03-08 04:41:51.394 DEBUG [src.node.waku_node] Container stopped.
2026-03-08 04:41:51.395 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-08 04:41:51.438 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-08 04:41:51.474 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-08 04:41:51.475 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-08 04:41:51.476 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-08 04:41:51.478 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-08_04-41-46__981b8105-2b40-4201-a97c-cbcb97050223__wakuorg_nwaku:latest.log
2026-03-08 04:41:51.482 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-08_04-41-46__981b8105-2b40-4201-a97c-cbcb97050223__wakuorg_nwaku:latest.log