logos-messaging/logos-messaging-interop-tests
1
0
Fork 0
mirror of https://github.com/logos-messaging/logos-messaging-interop-tests.git synced 2026-05-04 17:43:17 +00:00
Code Issues Packages Projects Releases Wiki Activity
logos-messaging-interop-tests/nim/1118/data/attachments/d9e4a6ca719d35b.txt

291 lines
50 KiB
Plaintext
Raw Blame History

2026-03-17 04:39:00.931 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-17 04:39:00.932 DEBUG [tests.conftest] Running test: test_multiple_pubsub_topics_same_cluster with id: 2026-03-17_04-39-00__9cc48bc7-9191-45f8-8a5e-fdfbe73b81a8
2026-03-17 04:39:00.932 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-17 04:39:00.932 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-17 04:39:00.932 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-17 04:39:00.940 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-17 04:39:00.940 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-17_04-39-00__9cc48bc7-9191-45f8-8a5e-fdfbe73b81a8__wakuorg_nwaku:latest.log
2026-03-17 04:39:00.940 DEBUG [src.node.waku_node] Starting Node...
2026-03-17 04:39:00.941 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-17 04:39:00.942 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-17 04:39:00.942 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.175.76
2026-03-17 04:39:00.943 DEBUG [src.node.docker_mananger] Generated ports ['31392', '31393', '31394', '31395', '31396']
2026-03-17 04:39:00.943 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-17 04:39:00.943 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-17 04:39:00.943 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-17 04:39:00.943 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-17 04:39:00.943 DEBUG [src.node.waku_node] Using volumes []
2026-03-17 04:39:00.943 DEBUG [src.node.docker_mananger] docker run -i -t -p 31392:31392 -p 31393:31393 -p 31394:31394 -p 31395:31395 -p 31396:31396 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=31394 --rest-port=31392 --tcp-port=31393 --discv5-udp-port=31395 --rest-address=0.0.0.0 --nat=extip:172.18.175.76 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=d3e95e4cae638816c58dd31c56a1f65aedfa812be28b5fccbb1bfdcdfe0b543a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=31396 --metrics-logging=true --relay=true --filter=true
2026-03-17 04:39:01.147 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.175.76 waku ebc9958c1db84ab78456f4c5df634c53ad50caedf0c38f5b5c53fc06f841e6a4
2026-03-17 04:39:01.168 ERROR [src.node.docker_mananger] Max retries reached for container 68e9c38f4b27. Exiting log stream.
2026-03-17 04:39:01.185 DEBUG [src.node.docker_mananger] Container started with ID ebc9958c1db8. Setting up logs at ./log/docker/node1_2026-03-17_04-39-00__9cc48bc7-9191-45f8-8a5e-fdfbe73b81a8__wakuorg_nwaku:latest.log
2026-03-17 04:39:01.185 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 31392
2026-03-17 04:39:01.186 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-17 04:39:01.729 ERROR [src.node.docker_mananger] Max retries reached for container 9def09ac1e80. Exiting log stream.
2026-03-17 04:39:02.186 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31392/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:02.190 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-17 04:39:02.191 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-17 04:39:02.191 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31392/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:02.194 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.175.76/tcp/31393/p2p/16Uiu2HAm7NanYVPxEiGuGBauCfKTnUhDQQ1ZLcgb6pF4WXg6yUc8","/ip4/172.18.175.76/tcp/31394/ws/p2p/16Uiu2HAm7NanYVPxEiGuGBauCfKTnUhDQQ1ZLcgb6pF4WXg6yUc8"],"enrUri":"enr:-L24QF0FyaYX1DlXiQUE6-jVEyjncFl9WIigSSyw6BmgtvAdAv8omkutotezlpS6Ab7rhPhb9skZU4r1VcEW4xUSpegCgmlkgnY0gmlwhKwSr0yKbXVsdGlhZGRyc5YACASsEq9MBnqhAAoErBKvTAZ6ot0DgnJzhQACAQAAiXNlY3AyNTZrMaECsYGgu0pIyYh2OtMA_VOnIRp4Y__IagEA9HVwR2sjrzGDdGNwgnqhg3VkcIJ6o4V3YWt1MgU"}'
2026-03-17 04:39:02.194 INFO [src.node.waku_node] REST service is ready !!
2026-03-17 04:39:02.201 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-17 04:39:02.201 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-17_04-39-00__9cc48bc7-9191-45f8-8a5e-fdfbe73b81a8__wakuorg_nwaku:latest.log
2026-03-17 04:39:02.201 DEBUG [src.node.waku_node] Starting Node...
2026-03-17 04:39:02.201 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-17 04:39:02.203 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-17 04:39:02.203 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.243.168
2026-03-17 04:39:02.203 DEBUG [src.node.docker_mananger] Generated ports ['17224', '17225', '17226', '17227', '17228']
2026-03-17 04:39:02.203 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-17 04:39:02.204 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-17 04:39:02.204 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-17 04:39:02.204 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-17 04:39:02.204 DEBUG [src.node.waku_node] Using volumes []
2026-03-17 04:39:02.204 DEBUG [src.node.docker_mananger] docker run -i -t -p 17224:17224 -p 17225:17225 -p 17226:17226 -p 17227:17227 -p 17228:17228 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17226 --rest-port=17224 --tcp-port=17225 --discv5-udp-port=17227 --rest-address=0.0.0.0 --nat=extip:172.18.243.168 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=4ffe2a739fb76cf5bb8d01fc3abab29fdb53bc0abcb8076bca6b7a3cbab1b9f0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17228 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QF0FyaYX1DlXiQUE6-jVEyjncFl9WIigSSyw6BmgtvAdAv8omkutotezlpS6Ab7rhPhb9skZU4r1VcEW4xUSpegCgmlkgnY0gmlwhKwSr0yKbXVsdGlhZGRyc5YACASsEq9MBnqhAAoErBKvTAZ6ot0DgnJzhQACAQAAiXNlY3AyNTZrMaECsYGgu0pIyYh2OtMA_VOnIRp4Y__IagEA9HVwR2sjrzGDdGNwgnqhg3VkcIJ6o4V3YWt1MgU
2026-03-17 04:39:02.428 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.243.168 waku 8838f9b69d6fbd8f00e4fa92c20408cba9af72102cb06f0a144203ffcfa30522
2026-03-17 04:39:02.464 DEBUG [src.node.docker_mananger] Container started with ID 8838f9b69d6f. Setting up logs at ./log/docker/node2_2026-03-17_04-39-00__9cc48bc7-9191-45f8-8a5e-fdfbe73b81a8__wakuorg_nwaku:latest.log
2026-03-17 04:39:02.464 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 17224
2026-03-17 04:39:02.465 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-17 04:39:03.465 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17224/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:03.468 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-17 04:39:03.469 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-17 04:39:03.469 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17224/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:03.472 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.243.168/tcp/17225/p2p/16Uiu2HAkvg392cFNAobhGNkTBeguQzCGGPQv8YRDAg5LXsso3vyB","/ip4/172.18.243.168/tcp/17226/ws/p2p/16Uiu2HAkvg392cFNAobhGNkTBeguQzCGGPQv8YRDAg5LXsso3vyB"],"enrUri":"enr:-L24QA-JKqQbpfevtwbjtcVsxNFVTwlo81zeSfZf--KNxz2cEprDj1HqT74GpN54nsXhRzCRBUW11UtsymK6Z0VrqZQCgmlkgnY0gmlwhKwS86iKbXVsdGlhZGRyc5YACASsEvOoBkNJAAoErBLzqAZDSt0DgnJzhQACAQAAiXNlY3AyNTZrMaECEom-OX4yrWfiSH1ygZ6aUJ4nA4yYkOuutD_-qyqj_h6DdGNwgkNJg3VkcIJDS4V3YWt1MgE"}'
2026-03-17 04:39:03.472 INFO [src.node.waku_node] REST service is ready !!
2026-03-17 04:39:03.473 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17224/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.175.76/tcp/31393/p2p/16Uiu2HAm7NanYVPxEiGuGBauCfKTnUhDQQ1ZLcgb6pF4WXg6yUc8"]'
2026-03-17 04:39:03.503 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:39:03.508 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31392/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-17 04:39:03.514 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:39:03.515 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:17224/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-17 04:39:03.523 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:39:03.524 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31392/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-17 04:39:03.533 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:39:03.535 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-17 04:39:03.636 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-17 04:39:03.637 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31392/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:03.639 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722343523832687,"ephemeral":false,"proof":""}]'
2026-03-17 04:39:03.641 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-17 04:39:03.641 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:03.643 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722343523832687,"ephemeral":false,"proof":""}]'
2026-03-17 04:39:03.645 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31392/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-17 04:39:03.654 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:39:03.654 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-17 04:39:03.755 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-17 04:39:03.755 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31392/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:03.758 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722343645465200,"ephemeral":false,"proof":""}]'
2026-03-17 04:39:03.760 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-17 04:39:03.760 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:03.762 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722343645465200,"ephemeral":false,"proof":""}]'
2026-03-17 04:39:03.764 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31392/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-17 04:39:03.773 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:39:03.774 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-17 04:39:03.874 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-17 04:39:03.875 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31392/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:03.877 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722343764639414,"ephemeral":false,"proof":""}]'
2026-03-17 04:39:03.879 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-17 04:39:03.879 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:03.881 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722343764639414,"ephemeral":false,"proof":""}]'
2026-03-17 04:39:03.883 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31392/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-17 04:39:03.894 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:39:03.894 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-17 04:39:03.995 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-17 04:39:03.995 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31392/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:03.998 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722343883287055,"ephemeral":false,"proof":""}]'
2026-03-17 04:39:04.000 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-17 04:39:04.000 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:04.002 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722343883287055,"ephemeral":false,"proof":""}]'
2026-03-17 04:39:04.004 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31392/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-17 04:39:04.013 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:39:04.014 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-17 04:39:04.114 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-17 04:39:04.115 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31392/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:04.117 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722344004100283,"ephemeral":false,"proof":""}]'
2026-03-17 04:39:04.119 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-17 04:39:04.119 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:04.121 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722344004100283,"ephemeral":false,"proof":""}]'
2026-03-17 04:39:04.123 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31392/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-17 04:39:04.133 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:39:04.134 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-17 04:39:04.234 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-17 04:39:04.234 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31392/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:04.237 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722344123455213,"ephemeral":false,"proof":""}]'
2026-03-17 04:39:04.238 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-17 04:39:04.239 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:17224/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:04.241 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722344123455213,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/27/sometopic/someencoding","version":0,"timestamp":1773722342589349285,"ephemeral":false,"proof":""}]'
2026-03-17 04:39:04.250 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-17 04:39:04.251 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-17 04:39:04.251 DEBUG [src.node.waku_node] Stopping container with id ebc9958c1db8
2026-03-17 04:39:04.866 DEBUG [src.node.waku_node] Container stopped.
2026-03-17 04:39:04.866 DEBUG [src.node.waku_node] Stopping container with id 8838f9b69d6f
2026-03-17 04:39:05.419 DEBUG [src.node.waku_node] Container stopped.
2026-03-17 04:39:05.422 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-17 04:39:05.466 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-17 04:39:05.508 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-17 04:39:05.510 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-17 04:39:05.510 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-17 04:39:05.511 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-17_04-39-00__9cc48bc7-9191-45f8-8a5e-fdfbe73b81a8__wakuorg_nwaku:latest.log
2026-03-17 04:39:05.512 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-17_04-39-00__9cc48bc7-9191-45f8-8a5e-fdfbe73b81a8__wakuorg_nwaku:latest.log
2026-03-17 04:39:05.517 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-17 04:39:05.517 DEBUG [tests.conftest] Running test: test_multiple_pubsub_topics_same_cluster with id: 2026-03-17_04-39-05__d787b033-fbfc-4129-a49f-1fd7322c35aa
2026-03-17 04:39:05.518 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-17 04:39:05.518 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-17 04:39:05.518 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-17 04:39:05.526 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-17 04:39:05.526 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-17_04-39-05__d787b033-fbfc-4129-a49f-1fd7322c35aa__wakuorg_nwaku:latest.log
2026-03-17 04:39:05.526 DEBUG [src.node.waku_node] Starting Node...
2026-03-17 04:39:05.527 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-17 04:39:05.528 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-17 04:39:05.528 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.165.75
2026-03-17 04:39:05.528 DEBUG [src.node.docker_mananger] Generated ports ['6878', '6879', '6880', '6881', '6882']
2026-03-17 04:39:05.528 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-17 04:39:05.529 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-17 04:39:05.529 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-17 04:39:05.529 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-17 04:39:05.529 DEBUG [src.node.waku_node] Using volumes []
2026-03-17 04:39:05.529 DEBUG [src.node.docker_mananger] docker run -i -t -p 6878:6878 -p 6879:6879 -p 6880:6880 -p 6881:6881 -p 6882:6882 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=6880 --rest-port=6878 --tcp-port=6879 --discv5-udp-port=6881 --rest-address=0.0.0.0 --nat=extip:172.18.165.75 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=275d2ff0c3aa71d6f2f07a2fb8e00894ec3d60dabc4e5caa59c3dd4cd0d2dd69 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=6882 --metrics-logging=true --relay=true --filter=true
2026-03-17 04:39:05.713 ERROR [src.node.docker_mananger] Max retries reached for container ebc9958c1db8. Exiting log stream.
2026-03-17 04:39:05.739 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.165.75 waku f42002f58c5a9d02bca438d60391d48da71fea5a07333bdf10c6816fb1918cf4
2026-03-17 04:39:05.777 DEBUG [src.node.docker_mananger] Container started with ID f42002f58c5a. Setting up logs at ./log/docker/node1_2026-03-17_04-39-05__d787b033-fbfc-4129-a49f-1fd7322c35aa__wakuorg_nwaku:latest.log
2026-03-17 04:39:05.777 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 6878
2026-03-17 04:39:05.777 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-17 04:39:06.236 ERROR [src.node.docker_mananger] Max retries reached for container 8838f9b69d6f. Exiting log stream.
2026-03-17 04:39:06.778 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6878/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:06.784 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-17 04:39:06.784 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-17 04:39:06.784 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6878/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:06.789 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.165.75/tcp/6879/p2p/16Uiu2HAmDqGGirVR4xW6oF76EH24KshvFqoATMDS1xbFfWeHytyq","/ip4/172.18.165.75/tcp/6880/ws/p2p/16Uiu2HAmDqGGirVR4xW6oF76EH24KshvFqoATMDS1xbFfWeHytyq"],"enrUri":"enr:-L24QM8tUN8LnQad4g2FdWzt8iBOC1dG99jw1617uI_l8XmLRWfEy9Af5dah0N-oOuxv9jmJRYF3mFf5YAPn7oW9lNkCgmlkgnY0gmlwhKwSpUuKbXVsdGlhZGRyc5YACASsEqVLBhrfAAoErBKlSwYa4N0DgnJzhQACAQAAiXNlY3AyNTZrMaEDEX1_SqZbR72u2HwG7FgFrIZP1fTHrPcv8zLLz_vK5yyDdGNwghrfg3VkcIIa4YV3YWt1MgU"}'
2026-03-17 04:39:06.790 INFO [src.node.waku_node] REST service is ready !!
2026-03-17 04:39:06.797 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-17 04:39:06.797 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-17_04-39-05__d787b033-fbfc-4129-a49f-1fd7322c35aa__wakuorg_nwaku:latest.log
2026-03-17 04:39:06.797 DEBUG [src.node.waku_node] Starting Node...
2026-03-17 04:39:06.797 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-17 04:39:06.799 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-17 04:39:06.799 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.88.208
2026-03-17 04:39:06.799 DEBUG [src.node.docker_mananger] Generated ports ['40074', '40075', '40076', '40077', '40078']
2026-03-17 04:39:06.799 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-17 04:39:06.800 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-17 04:39:06.800 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-17 04:39:06.800 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-17 04:39:06.800 DEBUG [src.node.waku_node] Using volumes []
2026-03-17 04:39:06.800 DEBUG [src.node.docker_mananger] docker run -i -t -p 40074:40074 -p 40075:40075 -p 40076:40076 -p 40077:40077 -p 40078:40078 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=40076 --rest-port=40074 --tcp-port=40075 --discv5-udp-port=40077 --rest-address=0.0.0.0 --nat=extip:172.18.88.208 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=eb84496acefd5afe08f113ce9293e36839badd83025a57cef590ab7ca31725a9 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=40078 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QM8tUN8LnQad4g2FdWzt8iBOC1dG99jw1617uI_l8XmLRWfEy9Af5dah0N-oOuxv9jmJRYF3mFf5YAPn7oW9lNkCgmlkgnY0gmlwhKwSpUuKbXVsdGlhZGRyc5YACASsEqVLBhrfAAoErBKlSwYa4N0DgnJzhQACAQAAiXNlY3AyNTZrMaEDEX1_SqZbR72u2HwG7FgFrIZP1fTHrPcv8zLLz_vK5yyDdGNwghrfg3VkcIIa4YV3YWt1MgU
2026-03-17 04:39:07.024 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.88.208 waku 648ec685358523d6e006ca85bcb87937d744ba767db8fdb6d9fbec3e6159c0a0
2026-03-17 04:39:07.063 DEBUG [src.node.docker_mananger] Container started with ID 648ec6853585. Setting up logs at ./log/docker/node2_2026-03-17_04-39-05__d787b033-fbfc-4129-a49f-1fd7322c35aa__wakuorg_nwaku:latest.log
2026-03-17 04:39:07.065 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 40074
2026-03-17 04:39:07.065 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-17 04:39:08.065 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40074/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:08.068 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-17 04:39:08.169 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40074/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:08.172 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-17 04:39:08.172 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-17 04:39:08.172 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:40074/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:08.175 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.88.208/tcp/40075/p2p/16Uiu2HAmRcqjJEPCD5YChE87rh7agoapcGJpzRc2aL4GWCsTsoxT","/ip4/172.18.88.208/tcp/40076/ws/p2p/16Uiu2HAmRcqjJEPCD5YChE87rh7agoapcGJpzRc2aL4GWCsTsoxT"],"enrUri":"enr:-L24QI3nfTu5Npk_xgK3D-4CGTBMNs9Gu-UO-Kkea_pJ5lANcnFmOhu43SAlG577p4RTYdYBZmHor_c7z7665SRttZICgmlkgnY0gmlwhKwSWNCKbXVsdGlhZGRyc5YACASsEljQBpyLAAoErBJY0AacjN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDwJsFaSpngeBCT-hUGch6G9TI09daWukUkuUMbTLz5_iDdGNwgpyLg3VkcIKcjYV3YWt1MgE"}'
2026-03-17 04:39:08.175 INFO [src.node.waku_node] REST service is ready !!
2026-03-17 04:39:08.176 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:40074/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.165.75/tcp/6879/p2p/16Uiu2HAmDqGGirVR4xW6oF76EH24KshvFqoATMDS1xbFfWeHytyq"]'
2026-03-17 04:39:08.207 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:39:08.208 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6878/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-17 04:39:08.215 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:39:08.215 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:40074/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-17 04:39:08.221 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:39:08.222 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6878/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-17 04:39:08.233 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:39:08.233 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-17 04:39:08.334 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-17 04:39:08.334 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6878/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:08.337 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"L3dha3UvMi9ycy8yLzA=","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722346874624532,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722348221916444,"ephemeral":false,"proof":""}]'
2026-03-17 04:39:08.345 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-17 04:39:08.346 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-17 04:39:08.346 DEBUG [src.node.waku_node] Stopping container with id f42002f58c5a
2026-03-17 04:39:08.919 DEBUG [src.node.waku_node] Container stopped.
2026-03-17 04:39:08.921 DEBUG [src.node.waku_node] Stopping container with id 648ec6853585
2026-03-17 04:39:09.513 DEBUG [src.node.waku_node] Container stopped.
2026-03-17 04:39:09.516 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-17 04:39:09.558 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-17 04:39:09.590 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-17 04:39:09.592 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-17 04:39:09.593 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-17 04:39:09.593 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-17_04-39-05__d787b033-fbfc-4129-a49f-1fd7322c35aa__wakuorg_nwaku:latest.log
2026-03-17 04:39:09.594 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-17_04-39-05__d787b033-fbfc-4129-a49f-1fd7322c35aa__wakuorg_nwaku:latest.log
2026-03-17 04:39:09.599 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-17 04:39:09.599 DEBUG [tests.conftest] Running test: test_multiple_pubsub_topics_same_cluster with id: 2026-03-17_04-39-09__53b65aad-0196-4dbd-b9fd-20d182109d36
2026-03-17 04:39:09.599 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-17 04:39:09.600 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-17 04:39:09.600 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-17 04:39:09.608 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-17 04:39:09.608 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-17_04-39-09__53b65aad-0196-4dbd-b9fd-20d182109d36__wakuorg_nwaku:latest.log
2026-03-17 04:39:09.608 DEBUG [src.node.waku_node] Starting Node...
2026-03-17 04:39:09.609 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-17 04:39:09.610 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-17 04:39:09.610 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.229.35
2026-03-17 04:39:09.611 DEBUG [src.node.docker_mananger] Generated ports ['19457', '19458', '19459', '19460', '19461']
2026-03-17 04:39:09.611 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-17 04:39:09.611 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-17 04:39:09.611 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-17 04:39:09.611 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-17 04:39:09.611 DEBUG [src.node.waku_node] Using volumes []
2026-03-17 04:39:09.611 DEBUG [src.node.docker_mananger] docker run -i -t -p 19457:19457 -p 19458:19458 -p 19459:19459 -p 19460:19460 -p 19461:19461 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=19459 --rest-port=19457 --tcp-port=19458 --discv5-udp-port=19460 --rest-address=0.0.0.0 --nat=extip:172.18.229.35 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=7a7f41b49ccecaccbfe64fdec2afaf1afef1cdaa0cdddf6a00c605ca41542b3d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=19461 --metrics-logging=true --relay=true --filter=true
2026-03-17 04:39:09.795 ERROR [src.node.docker_mananger] Max retries reached for container f42002f58c5a. Exiting log stream.
2026-03-17 04:39:09.810 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.229.35 waku dfd0f1eb22f7d617ba05e1d58c5ed5c19c1fc085fac83cb0444773ba9bbceb5d
2026-03-17 04:39:09.847 DEBUG [src.node.docker_mananger] Container started with ID dfd0f1eb22f7. Setting up logs at ./log/docker/node1_2026-03-17_04-39-09__53b65aad-0196-4dbd-b9fd-20d182109d36__wakuorg_nwaku:latest.log
2026-03-17 04:39:09.849 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 19457
2026-03-17 04:39:09.849 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-17 04:39:10.368 ERROR [src.node.docker_mananger] Max retries reached for container 648ec6853585. Exiting log stream.
2026-03-17 04:39:10.849 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19457/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:10.853 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-17 04:39:10.954 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19457/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:10.957 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-17 04:39:11.057 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19457/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:11.060 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-17 04:39:11.161 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19457/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:11.163 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-17 04:39:11.163 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-17 04:39:11.164 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19457/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:11.166 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.229.35/tcp/19458/p2p/16Uiu2HAkwvaRE9ymfyry4o4D9s6dn2n3Ee3k44SGU1qsDozhNA37","/ip4/172.18.229.35/tcp/19459/ws/p2p/16Uiu2HAkwvaRE9ymfyry4o4D9s6dn2n3Ee3k44SGU1qsDozhNA37"],"enrUri":"enr:-L24QGnDXiRYrUhkI8MvbBwSkfLVl49kh5bcAUdQxaJPBkO_dMoYevMLDNTPTSjjHRXgfRLUUn-RFLtPOhbmoK4TpuwCgmlkgnY0gmlwhKwS5SOKbXVsdGlhZGRyc5YACASsEuUjBkwCAAoErBLlIwZMA90DgnJzhQACAQAAiXNlY3AyNTZrMaECJR7tzlBjXzxupYyPcikLS_k6x6rWwZDOGReVmYR_LqaDdGNwgkwCg3VkcIJMBIV3YWt1MgU"}'
2026-03-17 04:39:11.166 INFO [src.node.waku_node] REST service is ready !!
2026-03-17 04:39:11.174 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-17 04:39:11.175 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-17_04-39-09__53b65aad-0196-4dbd-b9fd-20d182109d36__wakuorg_nwaku:latest.log
2026-03-17 04:39:11.175 DEBUG [src.node.waku_node] Starting Node...
2026-03-17 04:39:11.176 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-17 04:39:11.178 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-17 04:39:11.178 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.106.84
2026-03-17 04:39:11.179 DEBUG [src.node.docker_mananger] Generated ports ['21941', '21942', '21943', '21944', '21945']
2026-03-17 04:39:11.179 DEBUG [src.node.waku_node] Cluster id was resolved to: 2
2026-03-17 04:39:11.180 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-17 04:39:11.180 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-17 04:39:11.180 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-17 04:39:11.180 DEBUG [src.node.waku_node] Using volumes []
2026-03-17 04:39:11.180 DEBUG [src.node.docker_mananger] docker run -i -t -p 21941:21941 -p 21942:21942 -p 21943:21943 -p 21944:21944 -p 21945:21945 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=21943 --rest-port=21941 --tcp-port=21942 --discv5-udp-port=21944 --rest-address=0.0.0.0 --nat=extip:172.18.106.84 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=2f60b1c398e1422227fad39a9aeabeddd30c29e6765a6ca1b4c2ebfabe6f0a3e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=21945 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QGnDXiRYrUhkI8MvbBwSkfLVl49kh5bcAUdQxaJPBkO_dMoYevMLDNTPTSjjHRXgfRLUUn-RFLtPOhbmoK4TpuwCgmlkgnY0gmlwhKwS5SOKbXVsdGlhZGRyc5YACASsEuUjBkwCAAoErBLlIwZMA90DgnJzhQACAQAAiXNlY3AyNTZrMaECJR7tzlBjXzxupYyPcikLS_k6x6rWwZDOGReVmYR_LqaDdGNwgkwCg3VkcIJMBIV3YWt1MgU
2026-03-17 04:39:11.394 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.106.84 waku a32f2cefe7e9e7c1d1a56d6685218c96eb12167ca0663b9b2c63e6e936449fd7
2026-03-17 04:39:11.432 DEBUG [src.node.docker_mananger] Container started with ID a32f2cefe7e9. Setting up logs at ./log/docker/node2_2026-03-17_04-39-09__53b65aad-0196-4dbd-b9fd-20d182109d36__wakuorg_nwaku:latest.log
2026-03-17 04:39:11.432 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 21941
2026-03-17 04:39:11.432 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-17 04:39:12.433 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21941/health" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:12.436 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-17 04:39:12.436 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-17 04:39:12.436 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21941/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:12.439 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.106.84/tcp/21942/p2p/16Uiu2HAmC9RCECGzowJ91s2pyjzMK69QKebhPq4tnkvg4EKa9YuQ","/ip4/172.18.106.84/tcp/21943/ws/p2p/16Uiu2HAmC9RCECGzowJ91s2pyjzMK69QKebhPq4tnkvg4EKa9YuQ"],"enrUri":"enr:-L24QIPafHbUIYBAdn4Ih8IDxvaPpgwMiRDRSvxxA0xqiR0wM3lFjfNPa2urmX5IuRGJV7LP0avheKozWB7_Z9mRIhwCgmlkgnY0gmlwhKwSalSKbXVsdGlhZGRyc5YACASsEmpUBlW2AAoErBJqVAZVt90DgnJzhQACAQAAiXNlY3AyNTZrMaEC-GyqqnaY-O3TTfTxqWjKhWInJUowoabYJV2_veqd5ouDdGNwglW2g3VkcIJVuIV3YWt1MgE"}'
2026-03-17 04:39:12.439 INFO [src.node.waku_node] REST service is ready !!
2026-03-17 04:39:12.441 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21941/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.229.35/tcp/19458/p2p/16Uiu2HAkwvaRE9ymfyry4o4D9s6dn2n3Ee3k44SGU1qsDozhNA37"]'
2026-03-17 04:39:12.463 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:39:12.466 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19457/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-17 04:39:12.480 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:39:12.482 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21941/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-17 04:39:12.492 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:39:12.493 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19457/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-17 04:39:12.504 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-17 04:39:12.505 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-17 04:39:12.606 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-17 04:39:12.607 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19457/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-17 04:39:12.609 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722348221916444,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722351313211397,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773722352493374167,"ephemeral":false,"proof":""}]'
2026-03-17 04:39:12.617 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-17 04:39:12.619 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-17 04:39:12.619 DEBUG [src.node.waku_node] Stopping container with id dfd0f1eb22f7
2026-03-17 04:39:13.180 DEBUG [src.node.waku_node] Container stopped.
2026-03-17 04:39:13.181 DEBUG [src.node.waku_node] Stopping container with id a32f2cefe7e9
2026-03-17 04:39:13.752 DEBUG [src.node.waku_node] Container stopped.
2026-03-17 04:39:13.754 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-17 04:39:13.788 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-17 04:39:13.817 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-17 04:39:13.819 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-17 04:39:13.819 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-17 04:39:13.821 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-17_04-39-09__53b65aad-0196-4dbd-b9fd-20d182109d36__wakuorg_nwaku:latest.log
2026-03-17 04:39:13.822 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-17_04-39-09__53b65aad-0196-4dbd-b9fd-20d182109d36__wakuorg_nwaku:latest.log
Reference in New Issue View Git Blame Copy Permalink