logos-messaging/logos-messaging-interop-tests
1
0
Fork 0
mirror of https://github.com/logos-messaging/logos-messaging-interop-tests.git synced 2026-04-18 09:43:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
logos-messaging-interop-tests/nim/1116/data/attachments/d7d3e3bb502fbefd.txt

280 lines
48 KiB
Plaintext
Raw Blame History

2026-03-16 04:52:50.791 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-16 04:52:50.792 DEBUG [tests.conftest] Running test: test_subscribe_one_by_one_to_different_content_topics_and_send_messages with id: 2026-03-16_04-52-50__cac38368-88ee-4efb-9968-25967f4bcb4f
2026-03-16 04:52:50.792 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-16 04:52:50.792 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-16 04:52:50.793 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-16 04:52:50.801 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:52:50.802 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-16_04-52-50__cac38368-88ee-4efb-9968-25967f4bcb4f__wakuorg_nwaku:latest.log
2026-03-16 04:52:50.802 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:52:50.802 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:52:50.804 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:52:50.804 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.161.224
2026-03-16 04:52:50.804 DEBUG [src.node.docker_mananger] Generated ports ['61686', '61687', '61688', '61689', '61690']
2026-03-16 04:52:50.804 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:52:50.804 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:52:50.804 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:52:50.805 DEBUG [src.node.docker_mananger] docker run -i -t -p 61686:61686 -p 61687:61687 -p 61688:61688 -p 61689:61689 -p 61690:61690 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=61688 --rest-port=61686 --tcp-port=61687 --discv5-udp-port=61689 --rest-address=0.0.0.0 --nat=extip:172.18.161.224 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=ff3d18fb99ec1161eafa1d9f162a1b668ffa9dc6ad3cbebced42a0442aa85e4e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=61690 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-16 04:52:50.990 ERROR [src.node.docker_mananger] Max retries reached for container 4a29019d71b7. Exiting log stream.
2026-03-16 04:52:51.023 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.161.224 waku fb19093922242aa46551ebeef9cf4be1d7fc46591397e4e6e8726926d76a325a
2026-03-16 04:52:51.063 DEBUG [src.node.docker_mananger] Container started with ID fb1909392224. Setting up logs at ./log/docker/node1_2026-03-16_04-52-50__cac38368-88ee-4efb-9968-25967f4bcb4f__wakuorg_nwaku:latest.log
2026-03-16 04:52:51.064 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 61686
2026-03-16 04:52:51.064 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:52:51.517 ERROR [src.node.docker_mananger] Max retries reached for container 66db25935272. Exiting log stream.
2026-03-16 04:52:52.064 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61686/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:52.068 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:52:52.068 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:52:52.068 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61686/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:52.071 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.161.224/tcp/61687/p2p/16Uiu2HAmE9umWosKj2mdyYEo7Zw5nX6VorkZQuUe5aKqjhC4rvj6","/ip4/172.18.161.224/tcp/61688/ws/p2p/16Uiu2HAmE9umWosKj2mdyYEo7Zw5nX6VorkZQuUe5aKqjhC4rvj6"],"enrUri":"enr:-L24QAk4FylVpN-XPZTPDlotFI1jUIHwNn1dTNEEUSSSVYZiCZMMyh1IvrIdayLqYd0aDQn_hPmMle-XVdSEQXEqp04CgmlkgnY0gmlwhKwSoeCKbXVsdGlhZGRyc5YACASsEqHgBvD3AAoErBKh4Abw-N0DgnJzhQACAQAAiXNlY3AyNTZrMaEDFkRZYMMZm98y_RgQeg3Qpa6Us66eLWO0XPOqbhnhI7WDdGNwgvD3g3VkcILw-YV3YWt1MgU"}'
2026-03-16 04:52:52.071 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:52:52.080 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:52:52.080 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-16_04-52-50__cac38368-88ee-4efb-9968-25967f4bcb4f__wakuorg_nwaku:latest.log
2026-03-16 04:52:52.080 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:52:52.080 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:52:52.082 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:52:52.082 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.82.159
2026-03-16 04:52:52.082 DEBUG [src.node.docker_mananger] Generated ports ['10673', '10674', '10675', '10676', '10677']
2026-03-16 04:52:52.082 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:52:52.082 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:52:52.082 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:52:52.083 DEBUG [src.node.docker_mananger] docker run -i -t -p 10673:10673 -p 10674:10674 -p 10675:10675 -p 10676:10676 -p 10677:10677 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=10675 --rest-port=10673 --tcp-port=10674 --discv5-udp-port=10676 --rest-address=0.0.0.0 --nat=extip:172.18.82.159 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=ebba6b3b55face320e863affa33483d1eeeb34d7cd7a0c0494daccf9835a6e0d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=10677 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAk4FylVpN-XPZTPDlotFI1jUIHwNn1dTNEEUSSSVYZiCZMMyh1IvrIdayLqYd0aDQn_hPmMle-XVdSEQXEqp04CgmlkgnY0gmlwhKwSoeCKbXVsdGlhZGRyc5YACASsEqHgBvD3AAoErBKh4Abw-N0DgnJzhQACAQAAiXNlY3AyNTZrMaEDFkRZYMMZm98y_RgQeg3Qpa6Us66eLWO0XPOqbhnhI7WDdGNwgvD3g3VkcILw-YV3YWt1MgU --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-16 04:52:52.316 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.82.159 waku b388d17a56968f3e19c73b899144687c417555d482295ddc8708db81523b1681
2026-03-16 04:52:52.351 DEBUG [src.node.docker_mananger] Container started with ID b388d17a5696. Setting up logs at ./log/docker/node2_2026-03-16_04-52-50__cac38368-88ee-4efb-9968-25967f4bcb4f__wakuorg_nwaku:latest.log
2026-03-16 04:52:52.351 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 10673
2026-03-16 04:52:52.351 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:52:53.352 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10673/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:53.355 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:52:53.355 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:52:53.356 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10673/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:53.358 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.82.159/tcp/10674/p2p/16Uiu2HAmAitMG4v2aM2fz1mg8jCCQZxskkSV3D9gF6ouQsBGcVK2","/ip4/172.18.82.159/tcp/10675/ws/p2p/16Uiu2HAmAitMG4v2aM2fz1mg8jCCQZxskkSV3D9gF6ouQsBGcVK2"],"enrUri":"enr:-L24QNEBLIxhDMC_Voeek3Mzr0GhyhW75bDvqQtj4QxNI7BEYyEMhogjaLbPnVfUKQHpj7dBdmj6y2n4ZLxkrNTt2M4CgmlkgnY0gmlwhKwSUp-KbXVsdGlhZGRyc5YACASsElKfBimyAAoErBJSnwYps90DgnJzhQACAQAAiXNlY3AyNTZrMaEC40gqIqbluz8EaeQ_UOAYetT8GPAv8aZemqs0FEE-Ia2DdGNwgimyg3VkcIIptIV3YWt1MgE"}'
2026-03-16 04:52:53.359 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:52:53.359 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10673/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.161.224/tcp/61687/p2p/16Uiu2HAmE9umWosKj2mdyYEo7Zw5nX6VorkZQuUe5aKqjhC4rvj6"]'
2026-03-16 04:52:53.386 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:53.387 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61686/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:52:53.391 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:53.392 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10673/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:52:53.397 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:53.399 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61686/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:52:53.417 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:53.419 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 04:52:53.520 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-16 04:52:53.521 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61686/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:53.524 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773636773399471061,"ephemeral":false,"proof":""}]'
2026-03-16 04:52:53.525 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-16 04:52:53.526 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10673/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:53.528 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773636773399471061,"ephemeral":false,"proof":""}]'
2026-03-16 04:52:53.531 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61686/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/content/test.js"]'
2026-03-16 04:52:53.534 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:53.535 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10673/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/content/test.js"]'
2026-03-16 04:52:53.537 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:53.538 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61686/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/waku/2/content/test.js", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:52:53.548 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:53.548 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 04:52:53.649 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-16 04:52:53.649 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61686/relay/v1/auto/messages/%2Fwaku%2F2%2Fcontent%2Ftest.js" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:53.652 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/waku/2/content/test.js","version":0,"timestamp":1773636773538153824,"ephemeral":false,"proof":""}]'
2026-03-16 04:52:53.654 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-16 04:52:53.654 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10673/relay/v1/auto/messages/%2Fwaku%2F2%2Fcontent%2Ftest.js" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:53.657 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/waku/2/content/test.js","version":0,"timestamp":1773636773538153824,"ephemeral":false,"proof":""}]'
2026-03-16 04:52:53.659 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61686/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/22/sometopic/someencoding"]'
2026-03-16 04:52:53.662 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:53.662 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10673/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/22/sometopic/someencoding"]'
2026-03-16 04:52:53.665 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:53.665 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61686/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/22/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:52:53.676 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:53.677 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 04:52:53.777 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-16 04:52:53.778 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61686/relay/v1/auto/messages/%2Fapp%2F22%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:53.781 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/22/sometopic/someencoding","version":0,"timestamp":1773636773665409503,"ephemeral":false,"proof":""}]'
2026-03-16 04:52:53.783 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-16 04:52:53.783 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10673/relay/v1/auto/messages/%2Fapp%2F22%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:53.786 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/22/sometopic/someencoding","version":0,"timestamp":1773636773665409503,"ephemeral":false,"proof":""}]'
2026-03-16 04:52:53.787 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61686/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/toychat/2/huilong/proto"]'
2026-03-16 04:52:53.790 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:53.790 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10673/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/toychat/2/huilong/proto"]'
2026-03-16 04:52:53.793 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:53.793 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61686/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/toychat/2/huilong/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:52:53.804 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:53.805 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 04:52:53.905 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-16 04:52:53.906 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61686/relay/v1/auto/messages/%2Ftoychat%2F2%2Fhuilong%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:53.915 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1773636773793700640,"ephemeral":false,"proof":""}]'
2026-03-16 04:52:53.917 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-16 04:52:53.917 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10673/relay/v1/auto/messages/%2Ftoychat%2F2%2Fhuilong%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:53.920 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1773636773793700640,"ephemeral":false,"proof":""}]'
2026-03-16 04:52:53.921 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61686/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/statusim/1/community/cbor"]'
2026-03-16 04:52:53.924 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:53.924 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10673/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/statusim/1/community/cbor"]'
2026-03-16 04:52:53.926 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:53.927 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61686/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/statusim/1/community/cbor", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:52:53.938 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:53.939 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 04:52:54.039 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-16 04:52:54.040 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61686/relay/v1/auto/messages/%2Fstatusim%2F1%2Fcommunity%2Fcbor" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:54.061 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/statusim/1/community/cbor","version":0,"timestamp":1773636773927323297,"ephemeral":false,"proof":""}]'
2026-03-16 04:52:54.067 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-16 04:52:54.069 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10673/relay/v1/auto/messages/%2Fstatusim%2F1%2Fcommunity%2Fcbor" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:54.094 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/statusim/1/community/cbor","version":0,"timestamp":1773636773927323297,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/statusim/1/community/cbor","version":0,"timestamp":1773636768960283712,"ephemeral":false,"proof":""}]'
2026-03-16 04:52:54.111 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-16 04:52:54.118 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-16 04:52:54.118 DEBUG [src.node.waku_node] Stopping container with id fb1909392224
2026-03-16 04:52:54.750 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:52:54.752 DEBUG [src.node.waku_node] Stopping container with id b388d17a5696
2026-03-16 04:52:55.377 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:52:55.379 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-16 04:52:55.420 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:52:55.462 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:52:55.463 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-16 04:52:55.463 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-16 04:52:55.464 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-16_04-52-50__cac38368-88ee-4efb-9968-25967f4bcb4f__wakuorg_nwaku:latest.log
2026-03-16 04:52:55.465 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-16_04-52-50__cac38368-88ee-4efb-9968-25967f4bcb4f__wakuorg_nwaku:latest.log
2026-03-16 04:52:55.470 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-16 04:52:55.471 DEBUG [tests.conftest] Running test: test_subscribe_one_by_one_to_different_content_topics_and_send_messages with id: 2026-03-16_04-52-55__e38fac3d-c5ee-4bbf-a697-3369c35b5a58
2026-03-16 04:52:55.471 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-16 04:52:55.471 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-16 04:52:55.472 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-16 04:52:55.480 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:52:55.480 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-16_04-52-55__e38fac3d-c5ee-4bbf-a697-3369c35b5a58__wakuorg_nwaku:latest.log
2026-03-16 04:52:55.480 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:52:55.480 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:52:55.482 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:52:55.482 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.153.241
2026-03-16 04:52:55.482 DEBUG [src.node.docker_mananger] Generated ports ['5703', '5704', '5705', '5706', '5707']
2026-03-16 04:52:55.482 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:52:55.483 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:52:55.483 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:52:55.483 DEBUG [src.node.docker_mananger] docker run -i -t -p 5703:5703 -p 5704:5704 -p 5705:5705 -p 5706:5706 -p 5707:5707 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=5705 --rest-port=5703 --tcp-port=5704 --discv5-udp-port=5706 --rest-address=0.0.0.0 --nat=extip:172.18.153.241 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=bceef208bf7a7ecce06aac834b0cb8b23582defa6fe22cc765a14b7ebab90e59 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=5707 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-16 04:52:55.567 ERROR [src.node.docker_mananger] Max retries reached for container fb1909392224. Exiting log stream.
2026-03-16 04:52:55.682 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.153.241 waku 03cb409c49ae2edc3e3f26fbaf9180135ce17f9cb02f1de59aba3693899af1af
2026-03-16 04:52:55.722 DEBUG [src.node.docker_mananger] Container started with ID 03cb409c49ae. Setting up logs at ./log/docker/node1_2026-03-16_04-52-55__e38fac3d-c5ee-4bbf-a697-3369c35b5a58__wakuorg_nwaku:latest.log
2026-03-16 04:52:55.722 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 5703
2026-03-16 04:52:55.723 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:52:56.273 ERROR [src.node.docker_mananger] Max retries reached for container b388d17a5696. Exiting log stream.
2026-03-16 04:52:56.724 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5703/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:56.727 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:52:56.727 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:52:56.727 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5703/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:56.730 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.153.241/tcp/5704/p2p/16Uiu2HAmM2Mqbvb2taaPQVc7LUTsr8KzDzNxkweCSLxA6eWjnxXv","/ip4/172.18.153.241/tcp/5705/ws/p2p/16Uiu2HAmM2Mqbvb2taaPQVc7LUTsr8KzDzNxkweCSLxA6eWjnxXv"],"enrUri":"enr:-L24QJ_eTpgsXGoTLF3h5qQ8_ONiehsGsIU8Fw3xy-X48uxTXUQBp5DLYdgJ-w6sxmQTRI6j_e45ialcNwZY20HBNI8CgmlkgnY0gmlwhKwSmfGKbXVsdGlhZGRyc5YACASsEpnxBhZIAAoErBKZ8QYWSd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDfFb9OBvfS4yT5pK0S2gQo7YEEeIJeViTdhdV4pNi6UWDdGNwghZIg3VkcIIWSoV3YWt1MgU"}'
2026-03-16 04:52:56.730 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:52:56.738 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:52:56.738 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-16_04-52-55__e38fac3d-c5ee-4bbf-a697-3369c35b5a58__wakuorg_nwaku:latest.log
2026-03-16 04:52:56.738 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:52:56.738 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:52:56.739 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:52:56.740 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.13.72
2026-03-16 04:52:56.740 DEBUG [src.node.docker_mananger] Generated ports ['33663', '33664', '33665', '33666', '33667']
2026-03-16 04:52:56.740 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:52:56.740 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:52:56.740 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:52:56.740 DEBUG [src.node.docker_mananger] docker run -i -t -p 33663:33663 -p 33664:33664 -p 33665:33665 -p 33666:33666 -p 33667:33667 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=33665 --rest-port=33663 --tcp-port=33664 --discv5-udp-port=33666 --rest-address=0.0.0.0 --nat=extip:172.18.13.72 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=d653ad4bbcdbde3c8f218cabf26a9c87adf8aedae5aebfc1a94c2fb9a70c38cb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=33667 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QJ_eTpgsXGoTLF3h5qQ8_ONiehsGsIU8Fw3xy-X48uxTXUQBp5DLYdgJ-w6sxmQTRI6j_e45ialcNwZY20HBNI8CgmlkgnY0gmlwhKwSmfGKbXVsdGlhZGRyc5YACASsEpnxBhZIAAoErBKZ8QYWSd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDfFb9OBvfS4yT5pK0S2gQo7YEEeIJeViTdhdV4pNi6UWDdGNwghZIg3VkcIIWSoV3YWt1MgU --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-16 04:52:56.960 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.13.72 waku d77df5f82fbc098dd42938666b7189c25d60085090ad4b1ceaf6f6b43561a080
2026-03-16 04:52:57.000 DEBUG [src.node.docker_mananger] Container started with ID d77df5f82fbc. Setting up logs at ./log/docker/node2_2026-03-16_04-52-55__e38fac3d-c5ee-4bbf-a697-3369c35b5a58__wakuorg_nwaku:latest.log
2026-03-16 04:52:57.001 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 33663
2026-03-16 04:52:57.001 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:52:58.001 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33663/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:58.004 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:52:58.005 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:52:58.005 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:33663/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:58.007 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.13.72/tcp/33664/p2p/16Uiu2HAkzKanxMmFQjWDUBGdNNLtNuypQkvdek32mCeTkSft3he6","/ip4/172.18.13.72/tcp/33665/ws/p2p/16Uiu2HAkzKanxMmFQjWDUBGdNNLtNuypQkvdek32mCeTkSft3he6"],"enrUri":"enr:-L24QPEdA3XN2AaJiNcoEZ2AxY1VcTIRdjvnnTdwHlir08geMKVXW5Re3Cbkd2ok7AwIYXPM27JeBmptMfG-9V-N8sECgmlkgnY0gmlwhKwSDUiKbXVsdGlhZGRyc5YACASsEg1IBoOAAAoErBINSAaDgd0DgnJzhQACAQAAiXNlY3AyNTZrMaECSLsVwIMFr8KcrNc7g4qJwTu-koOnYZuBl0OZUOMdUgeDdGNwgoOAg3VkcIKDgoV3YWt1MgE"}'
2026-03-16 04:52:58.008 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:52:58.008 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33663/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.153.241/tcp/5704/p2p/16Uiu2HAmM2Mqbvb2taaPQVc7LUTsr8KzDzNxkweCSLxA6eWjnxXv"]'
2026-03-16 04:52:58.042 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:58.044 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5703/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:52:58.049 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:58.050 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:33663/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:52:58.054 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:58.055 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:5703/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:52:58.066 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:52:58.066 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 04:52:58.167 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-16 04:52:58.167 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:5703/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:52:58.170 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773636775478590903,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773636778055277006,"ephemeral":false,"proof":""}]'
2026-03-16 04:52:58.179 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-16 04:52:58.181 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-16 04:52:58.181 DEBUG [src.node.waku_node] Stopping container with id 03cb409c49ae
2026-03-16 04:52:58.831 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:52:58.831 DEBUG [src.node.waku_node] Stopping container with id d77df5f82fbc
2026-03-16 04:52:59.440 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:52:59.441 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-16 04:52:59.479 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:52:59.510 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:52:59.512 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-16 04:52:59.512 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-16 04:52:59.513 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-16_04-52-55__e38fac3d-c5ee-4bbf-a697-3369c35b5a58__wakuorg_nwaku:latest.log
2026-03-16 04:52:59.514 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-16_04-52-55__e38fac3d-c5ee-4bbf-a697-3369c35b5a58__wakuorg_nwaku:latest.log
2026-03-16 04:52:59.518 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-16 04:52:59.519 DEBUG [tests.conftest] Running test: test_subscribe_one_by_one_to_different_content_topics_and_send_messages with id: 2026-03-16_04-52-59__0f5a8733-27af-4f8b-84d1-3b0cb18b04d1
2026-03-16 04:52:59.519 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-16 04:52:59.519 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-16 04:52:59.519 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-16 04:52:59.527 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:52:59.527 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-16_04-52-59__0f5a8733-27af-4f8b-84d1-3b0cb18b04d1__wakuorg_nwaku:latest.log
2026-03-16 04:52:59.528 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:52:59.528 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:52:59.529 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:52:59.530 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.219.212
2026-03-16 04:52:59.530 DEBUG [src.node.docker_mananger] Generated ports ['50804', '50805', '50806', '50807', '50808']
2026-03-16 04:52:59.530 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:52:59.530 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:52:59.530 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:52:59.530 DEBUG [src.node.docker_mananger] docker run -i -t -p 50804:50804 -p 50805:50805 -p 50806:50806 -p 50807:50807 -p 50808:50808 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=50806 --rest-port=50804 --tcp-port=50805 --discv5-udp-port=50807 --rest-address=0.0.0.0 --nat=extip:172.18.219.212 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=6badbb69be138fb41d0b3a9badef94acfa31f73e2c911fdccd1b0a79a784ab95 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=50808 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-16 04:52:59.716 ERROR [src.node.docker_mananger] Max retries reached for container 03cb409c49ae. Exiting log stream.
2026-03-16 04:52:59.730 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.219.212 waku e2a17e935f2da69df66e4e34b0c9a3f0383ec3b1c2c763e1a650cb9a1690849e
2026-03-16 04:52:59.769 DEBUG [src.node.docker_mananger] Container started with ID e2a17e935f2d. Setting up logs at ./log/docker/node1_2026-03-16_04-52-59__0f5a8733-27af-4f8b-84d1-3b0cb18b04d1__wakuorg_nwaku:latest.log
2026-03-16 04:52:59.769 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 50804
2026-03-16 04:52:59.769 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:53:00.322 ERROR [src.node.docker_mananger] Max retries reached for container d77df5f82fbc. Exiting log stream.
2026-03-16 04:53:00.770 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50804/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:53:00.773 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:53:00.773 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:53:00.774 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50804/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:53:00.777 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.219.212/tcp/50805/p2p/16Uiu2HAmFWfCenK1dCdxh4oMADiGb8Lyg3RU7xWPu69tSAH1wbip","/ip4/172.18.219.212/tcp/50806/ws/p2p/16Uiu2HAmFWfCenK1dCdxh4oMADiGb8Lyg3RU7xWPu69tSAH1wbip"],"enrUri":"enr:-L24QOOFbDlL0Z136QtDMkN_6UOTNH5_FcC-dAHwYJK0iXZxLa2jd_eRQ1MoUdXnyHFfEc49Z84r1U3tv6wprqpgZpkCgmlkgnY0gmlwhKwS29SKbXVsdGlhZGRyc5YACASsEtvUBsZ1AAoErBLb1AbGdt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDKnDDNlRPBAaW4acCtBdBm5UBObkUnzEzQ4gvs7WOXHGDdGNwgsZ1g3VkcILGd4V3YWt1MgU"}'
2026-03-16 04:53:00.777 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:53:00.785 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-16 04:53:00.786 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-16_04-52-59__0f5a8733-27af-4f8b-84d1-3b0cb18b04d1__wakuorg_nwaku:latest.log
2026-03-16 04:53:00.786 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 04:53:00.786 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 04:53:00.788 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 04:53:00.788 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.26.155
2026-03-16 04:53:00.788 DEBUG [src.node.docker_mananger] Generated ports ['28408', '28409', '28410', '28411', '28412']
2026-03-16 04:53:00.788 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 04:53:00.789 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 04:53:00.789 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 04:53:00.789 DEBUG [src.node.docker_mananger] docker run -i -t -p 28408:28408 -p 28409:28409 -p 28410:28410 -p 28411:28411 -p 28412:28412 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=28410 --rest-port=28408 --tcp-port=28409 --discv5-udp-port=28411 --rest-address=0.0.0.0 --nat=extip:172.18.26.155 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=dbf1efee4ba47ceea29a569fedfcf7a9ca2bb7b8b6aca5adcd5efed7bee0e297 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=28412 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QOOFbDlL0Z136QtDMkN_6UOTNH5_FcC-dAHwYJK0iXZxLa2jd_eRQ1MoUdXnyHFfEc49Z84r1U3tv6wprqpgZpkCgmlkgnY0gmlwhKwS29SKbXVsdGlhZGRyc5YACASsEtvUBsZ1AAoErBLb1AbGdt0DgnJzhQACAQAAiXNlY3AyNTZrMaEDKnDDNlRPBAaW4acCtBdBm5UBObkUnzEzQ4gvs7WOXHGDdGNwgsZ1g3VkcILGd4V3YWt1MgU --content-topic=/myapp/1/latest/proto --num-shards-in-network=8
2026-03-16 04:53:01.016 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.26.155 waku 1164b2f91e10df24d6d4a1463ee21050eb21ca6539aeea8ca56cf60d0ec64981
2026-03-16 04:53:01.058 DEBUG [src.node.docker_mananger] Container started with ID 1164b2f91e10. Setting up logs at ./log/docker/node2_2026-03-16_04-52-59__0f5a8733-27af-4f8b-84d1-3b0cb18b04d1__wakuorg_nwaku:latest.log
2026-03-16 04:53:01.059 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 28408
2026-03-16 04:53:01.059 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 04:53:02.059 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28408/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:53:02.070 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-16 04:53:02.170 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28408/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:53:02.173 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 04:53:02.173 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 04:53:02.173 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:28408/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:53:02.176 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.26.155/tcp/28409/p2p/16Uiu2HAkwDYjS1MRT9YV3jRePK1kxiUzrqo8veyHGjb6S6nMsJNT","/ip4/172.18.26.155/tcp/28410/ws/p2p/16Uiu2HAkwDYjS1MRT9YV3jRePK1kxiUzrqo8veyHGjb6S6nMsJNT"],"enrUri":"enr:-L24QFEJu2ogcoPdsQxLWbrFBqGRlOMhbeywTvvev9sKWOOdF3CPt2sGYyKIFve6RrheU9WZs01Lmm4gA5oxUoa0CgACgmlkgnY0gmlwhKwSGpuKbXVsdGlhZGRyc5YACASsEhqbBm75AAoErBIamwZu-t0DgnJzhQACAQAAiXNlY3AyNTZrMaECGpw1kNoRzBCT05jtpwCZNJkYb5vaVx_HxxO-HBybcTCDdGNwgm75g3VkcIJu-4V3YWt1MgE"}'
2026-03-16 04:53:02.177 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 04:53:02.178 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:28408/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.219.212/tcp/50805/p2p/16Uiu2HAmFWfCenK1dCdxh4oMADiGb8Lyg3RU7xWPu69tSAH1wbip"]'
2026-03-16 04:53:02.206 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:02.207 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50804/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:53:02.213 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:02.213 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:28408/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-03-16 04:53:02.217 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:02.218 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50804/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 04:53:02.229 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 04:53:02.231 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-16 04:53:02.331 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-16 04:53:02.332 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50804/relay/v1/auto/messages/%2Fmyapp%2F1%2Flatest%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-16 04:53:02.335 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773636778055277006,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773636779827098620,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773636782218131846,"ephemeral":false,"proof":""}]'
2026-03-16 04:53:02.350 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-16 04:53:02.351 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-16 04:53:02.352 DEBUG [src.node.waku_node] Stopping container with id e2a17e935f2d
2026-03-16 04:53:02.972 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:53:02.974 DEBUG [src.node.waku_node] Stopping container with id 1164b2f91e10
2026-03-16 04:53:03.576 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 04:53:03.579 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-16 04:53:03.645 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:53:03.675 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 04:53:03.675 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-16 04:53:03.676 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-16 04:53:03.676 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-16_04-52-59__0f5a8733-27af-4f8b-84d1-3b0cb18b04d1__wakuorg_nwaku:latest.log
2026-03-16 04:53:03.677 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-16_04-52-59__0f5a8733-27af-4f8b-84d1-3b0cb18b04d1__wakuorg_nwaku:latest.log
Reference in New Issue View Git Blame Copy Permalink