logos-messaging/logos-messaging-interop-tests
1
0
Fork 0
mirror of https://github.com/logos-messaging/logos-messaging-interop-tests.git synced 2026-04-21 11:13:13 +00:00
Code Issues Packages Projects Releases Wiki Activity
logos-messaging-interop-tests/nim/1106/data/attachments/2b071bb2fb63eaf0.txt

306 lines
54 KiB
Plaintext
Raw Blame History

2026-03-06 04:32:59.071 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-06 04:32:59.071 DEBUG [tests.conftest] Running test: test_resubscribe_to_unsubscribed_pubsub_topics with id: 2026-03-06_04-32-59__69503cc7-f29b-40fa-bd4a-e3dd000dee6f
2026-03-06 04:32:59.071 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-06 04:32:59.071 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-06 04:32:59.072 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-06 04:32:59.078 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-06 04:32:59.078 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-06_04-32-59__69503cc7-f29b-40fa-bd4a-e3dd000dee6f__wakuorg_nwaku:latest.log
2026-03-06 04:32:59.078 DEBUG [src.node.waku_node] Starting Node...
2026-03-06 04:32:59.078 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-06 04:32:59.080 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-06 04:32:59.080 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.157.113
2026-03-06 04:32:59.080 DEBUG [src.node.docker_mananger] Generated ports ['48021', '48022', '48023', '48024', '48025']
2026-03-06 04:32:59.080 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-06 04:32:59.080 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-06 04:32:59.080 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-06 04:32:59.080 DEBUG [src.node.waku_node] Using volumes []
2026-03-06 04:32:59.081 DEBUG [src.node.docker_mananger] docker run -i -t -p 48021:48021 -p 48022:48022 -p 48023:48023 -p 48024:48024 -p 48025:48025 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=48023 --rest-port=48021 --tcp-port=48022 --discv5-udp-port=48024 --rest-address=0.0.0.0 --nat=extip:172.18.157.113 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=1dbbcadcf13a5f7e73afccbac960b7febe6ee6fee24e1a7c54cf9d4b69acd97c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=48025 --metrics-logging=true --relay=true --filter=true
2026-03-06 04:32:59.234 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.157.113 waku 0fe008744a167c867e83283131beda366b83bb3a690f4ac1b5fc90937f5b7a69
2026-03-06 04:32:59.259 DEBUG [src.node.docker_mananger] Container started with ID 0fe008744a16. Setting up logs at ./log/docker/node1_2026-03-06_04-32-59__69503cc7-f29b-40fa-bd4a-e3dd000dee6f__wakuorg_nwaku:latest.log
2026-03-06 04:32:59.261 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 48021
2026-03-06 04:32:59.261 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-06 04:32:59.878 ERROR [src.node.docker_mananger] Max retries reached for container cd38883134a0. Exiting log stream.
2026-03-06 04:33:00.261 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48021/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:00.264 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:00.365 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48021/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:00.367 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:00.468 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48021/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:00.470 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:00.571 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48021/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:00.573 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-06 04:33:00.574 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-06 04:33:00.574 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48021/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:00.576 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.157.113/tcp/48022/p2p/16Uiu2HAmA8hbRqp4ncXmKoP9XK1KWHJuKs2U4F7wdvoM2vWGZ275","/ip4/172.18.157.113/tcp/48023/ws/p2p/16Uiu2HAmA8hbRqp4ncXmKoP9XK1KWHJuKs2U4F7wdvoM2vWGZ275"],"enrUri":"enr:-L24QIeAvwOuIzEPSZvF6vPDJCb0Y0Xag6eENv37bDa2qfV_Vrbm8MKNl20tQ4c7rerKlFanAAaBc_q7wvsIkp3OHgACgmlkgnY0gmlwhKwSnXGKbXVsdGlhZGRyc5YACASsEp1xBruWAAoErBKdcQa7l90DgnJzhQACAQAAiXNlY3AyNTZrMaEC2oZBbCrfmx35jOxzL_PT0WVXsag6VwpfhSz5PLbFVFSDdGNwgruWg3VkcIK7mIV3YWt1MgU"}'
2026-03-06 04:33:00.576 INFO [src.node.waku_node] REST service is ready !!
2026-03-06 04:33:00.585 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-06 04:33:00.585 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-06_04-32-59__69503cc7-f29b-40fa-bd4a-e3dd000dee6f__wakuorg_nwaku:latest.log
2026-03-06 04:33:00.586 DEBUG [src.node.waku_node] Starting Node...
2026-03-06 04:33:00.586 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-06 04:33:00.587 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-06 04:33:00.587 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.211.102
2026-03-06 04:33:00.587 DEBUG [src.node.docker_mananger] Generated ports ['29727', '29728', '29729', '29730', '29731']
2026-03-06 04:33:00.587 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-06 04:33:00.587 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-06 04:33:00.588 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-06 04:33:00.588 DEBUG [src.node.waku_node] Using volumes []
2026-03-06 04:33:00.588 DEBUG [src.node.docker_mananger] docker run -i -t -p 29727:29727 -p 29728:29728 -p 29729:29729 -p 29730:29730 -p 29731:29731 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=29729 --rest-port=29727 --tcp-port=29728 --discv5-udp-port=29730 --rest-address=0.0.0.0 --nat=extip:172.18.211.102 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=2828585eefa99444ae4e68dfceb4f19abb59e71fff06a2fcfff97c72fef9adaa --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=29731 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QIeAvwOuIzEPSZvF6vPDJCb0Y0Xag6eENv37bDa2qfV_Vrbm8MKNl20tQ4c7rerKlFanAAaBc_q7wvsIkp3OHgACgmlkgnY0gmlwhKwSnXGKbXVsdGlhZGRyc5YACASsEp1xBruWAAoErBKdcQa7l90DgnJzhQACAQAAiXNlY3AyNTZrMaEC2oZBbCrfmx35jOxzL_PT0WVXsag6VwpfhSz5PLbFVFSDdGNwgruWg3VkcIK7mIV3YWt1MgU
2026-03-06 04:33:00.743 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.211.102 waku 0f9a14cba31982ea68b53712fc5400856feb9d52a9c755c5d7b85ff359899991
2026-03-06 04:33:00.777 DEBUG [src.node.docker_mananger] Container started with ID 0f9a14cba319. Setting up logs at ./log/docker/node2_2026-03-06_04-32-59__69503cc7-f29b-40fa-bd4a-e3dd000dee6f__wakuorg_nwaku:latest.log
2026-03-06 04:33:00.777 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 29727
2026-03-06 04:33:00.778 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-06 04:33:01.780 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29727/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:01.784 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:01.884 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29727/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:01.887 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-06 04:33:01.887 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-06 04:33:01.887 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29727/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:01.889 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.211.102/tcp/29728/p2p/16Uiu2HAkv43HAQAksT1KAxxL2UHb2yyMAwJa2qqKRcoRDUwTW5xZ","/ip4/172.18.211.102/tcp/29729/ws/p2p/16Uiu2HAkv43HAQAksT1KAxxL2UHb2yyMAwJa2qqKRcoRDUwTW5xZ"],"enrUri":"enr:-L24QH73sgpvKdhLVpANdl4c-XH_Ga5FuFJroiAGNRx9GfiNFklElxo8C0eVvoPmIy1jf4_rR38F39p4uHQiRWkr-awCgmlkgnY0gmlwhKwS02aKbXVsdGlhZGRyc5YACASsEtNmBnQgAAoErBLTZgZ0Id0DgnJzhQACAQAAiXNlY3AyNTZrMaECCVD-FYme3s31Ydq5mJ4gXMXZnBZWgVop-Aq6AdIOUc6DdGNwgnQgg3VkcIJ0IoV3YWt1MgE"}'
2026-03-06 04:33:01.889 INFO [src.node.waku_node] REST service is ready !!
2026-03-06 04:33:01.890 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:29727/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.157.113/tcp/48022/p2p/16Uiu2HAmA8hbRqp4ncXmKoP9XK1KWHJuKs2U4F7wdvoM2vWGZ275"]'
2026-03-06 04:33:01.913 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:01.915 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48021/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-06 04:33:01.926 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:01.927 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:29727/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-06 04:33:01.932 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:01.933 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48021/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-06 04:33:01.944 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:01.944 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-06 04:33:02.044 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-06 04:33:02.045 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48021/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:02.047 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771581933274358,"ephemeral":false,"proof":""}]'
2026-03-06 04:33:02.049 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-06 04:33:02.049 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29727/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:02.052 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771581933274358,"ephemeral":false,"proof":""}]'
2026-03-06 04:33:02.053 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48021/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-06 04:33:02.062 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:02.062 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-06 04:33:02.162 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-06 04:33:02.163 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48021/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:02.165 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771582053713181,"ephemeral":false,"proof":""}]'
2026-03-06 04:33:02.167 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-06 04:33:02.168 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29727/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:02.172 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771582053713181,"ephemeral":false,"proof":""}]'
2026-03-06 04:33:02.173 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48021/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-06 04:33:02.183 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:02.184 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-06 04:33:02.285 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-06 04:33:02.285 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48021/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:02.287 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771582173743970,"ephemeral":false,"proof":""}]'
2026-03-06 04:33:02.289 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-06 04:33:02.289 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29727/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:02.292 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771582173743970,"ephemeral":false,"proof":""}]'
2026-03-06 04:33:02.294 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48021/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-06 04:33:02.302 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:02.302 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-06 04:33:02.403 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-06 04:33:02.403 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48021/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:02.406 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1772771582055981081,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1772771582045807017,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771582293904406,"ephemeral":false,"proof":""}]'
2026-03-06 04:33:02.443 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-06 04:33:02.444 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-06 04:33:02.445 DEBUG [src.node.waku_node] Stopping container with id 0fe008744a16
2026-03-06 04:33:02.928 DEBUG [src.node.waku_node] Container stopped.
2026-03-06 04:33:02.929 DEBUG [src.node.waku_node] Stopping container with id 0f9a14cba319
2026-03-06 04:33:03.412 DEBUG [src.node.waku_node] Container stopped.
2026-03-06 04:33:03.414 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-06 04:33:03.455 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-06 04:33:03.486 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-06 04:33:03.487 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-06 04:33:03.487 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-06 04:33:03.487 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-06_04-32-59__69503cc7-f29b-40fa-bd4a-e3dd000dee6f__wakuorg_nwaku:latest.log
2026-03-06 04:33:03.488 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-06_04-32-59__69503cc7-f29b-40fa-bd4a-e3dd000dee6f__wakuorg_nwaku:latest.log
2026-03-06 04:33:03.493 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-06 04:33:03.493 DEBUG [tests.conftest] Running test: test_resubscribe_to_unsubscribed_pubsub_topics with id: 2026-03-06_04-33-03__a677f03c-ad5f-43e2-a32b-5df817f58a49
2026-03-06 04:33:03.493 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-06 04:33:03.493 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-06 04:33:03.494 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-06 04:33:03.501 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-06 04:33:03.501 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-06_04-33-03__a677f03c-ad5f-43e2-a32b-5df817f58a49__wakuorg_nwaku:latest.log
2026-03-06 04:33:03.501 DEBUG [src.node.waku_node] Starting Node...
2026-03-06 04:33:03.501 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-06 04:33:03.503 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-06 04:33:03.503 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.10.186
2026-03-06 04:33:03.503 DEBUG [src.node.docker_mananger] Generated ports ['38946', '38947', '38948', '38949', '38950']
2026-03-06 04:33:03.503 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-06 04:33:03.503 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-06 04:33:03.503 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-06 04:33:03.503 DEBUG [src.node.waku_node] Using volumes []
2026-03-06 04:33:03.504 DEBUG [src.node.docker_mananger] docker run -i -t -p 38946:38946 -p 38947:38947 -p 38948:38948 -p 38949:38949 -p 38950:38950 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=38948 --rest-port=38946 --tcp-port=38947 --discv5-udp-port=38949 --rest-address=0.0.0.0 --nat=extip:172.18.10.186 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=debd7c2f5093dbc0f158749d9e0cd9cc87acd2e64ada278abfdcfdba2e94b6a8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=38950 --metrics-logging=true --relay=true --filter=true
2026-03-06 04:33:03.657 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.10.186 waku 8ac98df4c51c307f30c4b29a418ece48f970f79a1a1688ceb7b461be095756d1
2026-03-06 04:33:03.692 DEBUG [src.node.docker_mananger] Container started with ID 8ac98df4c51c. Setting up logs at ./log/docker/node1_2026-03-06_04-33-03__a677f03c-ad5f-43e2-a32b-5df817f58a49__wakuorg_nwaku:latest.log
2026-03-06 04:33:03.692 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 38946
2026-03-06 04:33:03.693 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-06 04:33:03.746 ERROR [src.node.docker_mananger] Max retries reached for container 0fe008744a16. Exiting log stream.
2026-03-06 04:33:04.225 ERROR [src.node.docker_mananger] Max retries reached for container 0f9a14cba319. Exiting log stream.
2026-03-06 04:33:04.693 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38946/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:04.697 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:04.798 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38946/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:04.802 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-06 04:33:04.802 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-06 04:33:04.802 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38946/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:04.804 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.10.186/tcp/38947/p2p/16Uiu2HAkv79CupHwdtxJcgomadkP6gqzkhFATYNofHg2SLmBDD9R","/ip4/172.18.10.186/tcp/38948/ws/p2p/16Uiu2HAkv79CupHwdtxJcgomadkP6gqzkhFATYNofHg2SLmBDD9R"],"enrUri":"enr:-L24QAWyDC30b-IigrVuHMB0qWwDnyfOHt15hJ8HmNtjoqXubAnJQts1F8bIXVzoowfA9SFIsJFZDQn7uCxPVxI8RXgCgmlkgnY0gmlwhKwSCrqKbXVsdGlhZGRyc5YACASsEgq6BpgjAAoErBIKugaYJN0DgnJzhQACAQAAiXNlY3AyNTZrMaECChxvsEW1PhY-fa01r9moGZi6x3-OA0bAR9FheUOf99iDdGNwgpgjg3VkcIKYJYV3YWt1MgU"}'
2026-03-06 04:33:04.805 INFO [src.node.waku_node] REST service is ready !!
2026-03-06 04:33:04.811 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-06 04:33:04.811 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-06_04-33-03__a677f03c-ad5f-43e2-a32b-5df817f58a49__wakuorg_nwaku:latest.log
2026-03-06 04:33:04.811 DEBUG [src.node.waku_node] Starting Node...
2026-03-06 04:33:04.812 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-06 04:33:04.813 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-06 04:33:04.813 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.51.77
2026-03-06 04:33:04.813 DEBUG [src.node.docker_mananger] Generated ports ['57763', '57764', '57765', '57766', '57767']
2026-03-06 04:33:04.813 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-06 04:33:04.814 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-06 04:33:04.814 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-06 04:33:04.814 DEBUG [src.node.waku_node] Using volumes []
2026-03-06 04:33:04.814 DEBUG [src.node.docker_mananger] docker run -i -t -p 57763:57763 -p 57764:57764 -p 57765:57765 -p 57766:57766 -p 57767:57767 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=57765 --rest-port=57763 --tcp-port=57764 --discv5-udp-port=57766 --rest-address=0.0.0.0 --nat=extip:172.18.51.77 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=9f9efbb08c24bdafee0efd5fe4fab1ac7783cafa10f06eaa7aba01812cae30a5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=57767 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAWyDC30b-IigrVuHMB0qWwDnyfOHt15hJ8HmNtjoqXubAnJQts1F8bIXVzoowfA9SFIsJFZDQn7uCxPVxI8RXgCgmlkgnY0gmlwhKwSCrqKbXVsdGlhZGRyc5YACASsEgq6BpgjAAoErBIKugaYJN0DgnJzhQACAQAAiXNlY3AyNTZrMaECChxvsEW1PhY-fa01r9moGZi6x3-OA0bAR9FheUOf99iDdGNwgpgjg3VkcIKYJYV3YWt1MgU
2026-03-06 04:33:04.993 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.51.77 waku f3184d9e4229d250d1ead289d4b082bb517a98ad9c2e67888ee00413253e9f44
2026-03-06 04:33:05.022 DEBUG [src.node.docker_mananger] Container started with ID f3184d9e4229. Setting up logs at ./log/docker/node2_2026-03-06_04-33-03__a677f03c-ad5f-43e2-a32b-5df817f58a49__wakuorg_nwaku:latest.log
2026-03-06 04:33:05.022 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 57763
2026-03-06 04:33:05.022 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-06 04:33:06.023 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57763/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:06.025 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:06.126 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57763/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:06.129 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:06.229 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57763/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:06.232 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:06.333 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57763/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:06.339 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-06 04:33:06.339 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-06 04:33:06.339 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57763/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:06.342 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.51.77/tcp/57764/p2p/16Uiu2HAm4bicpPfXXBgT2GEH59AMiE161sSiv1tvkKhNFx1cSfR2","/ip4/172.18.51.77/tcp/57765/ws/p2p/16Uiu2HAm4bicpPfXXBgT2GEH59AMiE161sSiv1tvkKhNFx1cSfR2"],"enrUri":"enr:-L24QP6C_LbCvY4SbQFETLpI5BxG_WUsG1JAZCdxx9s4Y9Z3OxGWqH2iD09ZJ8C4tSoCyYMhWRODw7OimKCwcVodfJICgmlkgnY0gmlwhKwSM02KbXVsdGlhZGRyc5YACASsEjNNBuGkAAoErBIzTQbhpd0DgnJzhQACAQAAiXNlY3AyNTZrMaECiEv5Pz_1svqdfx3QvGNFToYpIxVR5tvGjPz-0O53z6GDdGNwguGkg3VkcILhpoV3YWt1MgE"}'
2026-03-06 04:33:06.342 INFO [src.node.waku_node] REST service is ready !!
2026-03-06 04:33:06.342 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57763/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.10.186/tcp/38947/p2p/16Uiu2HAkv79CupHwdtxJcgomadkP6gqzkhFATYNofHg2SLmBDD9R"]'
2026-03-06 04:33:06.362 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:06.365 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38946/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-06 04:33:06.372 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:06.374 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57763/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-06 04:33:06.383 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:06.383 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38946/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-06 04:33:06.391 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:06.392 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-06 04:33:06.492 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-06 04:33:06.493 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38946/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:06.496 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771582822157854,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771586383433293,"ephemeral":false,"proof":""}]'
2026-03-06 04:33:06.504 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-06 04:33:06.505 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-06 04:33:06.505 DEBUG [src.node.waku_node] Stopping container with id 8ac98df4c51c
2026-03-06 04:33:07.010 DEBUG [src.node.waku_node] Container stopped.
2026-03-06 04:33:07.011 DEBUG [src.node.waku_node] Stopping container with id f3184d9e4229
2026-03-06 04:33:07.498 DEBUG [src.node.waku_node] Container stopped.
2026-03-06 04:33:07.500 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-06 04:33:07.538 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-06 04:33:07.564 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-06 04:33:07.565 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-06 04:33:07.565 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-06 04:33:07.565 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-06_04-33-03__a677f03c-ad5f-43e2-a32b-5df817f58a49__wakuorg_nwaku:latest.log
2026-03-06 04:33:07.566 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-06_04-33-03__a677f03c-ad5f-43e2-a32b-5df817f58a49__wakuorg_nwaku:latest.log
2026-03-06 04:33:07.569 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-06 04:33:07.570 DEBUG [tests.conftest] Running test: test_resubscribe_to_unsubscribed_pubsub_topics with id: 2026-03-06_04-33-07__1d560f13-e9b1-4044-a912-bbbddd7bf19d
2026-03-06 04:33:07.570 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-06 04:33:07.570 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-06 04:33:07.571 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-06 04:33:07.578 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-06 04:33:07.578 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-06_04-33-07__1d560f13-e9b1-4044-a912-bbbddd7bf19d__wakuorg_nwaku:latest.log
2026-03-06 04:33:07.579 DEBUG [src.node.waku_node] Starting Node...
2026-03-06 04:33:07.579 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-06 04:33:07.580 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-06 04:33:07.580 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.44.38
2026-03-06 04:33:07.580 DEBUG [src.node.docker_mananger] Generated ports ['24292', '24293', '24294', '24295', '24296']
2026-03-06 04:33:07.580 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-06 04:33:07.580 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-06 04:33:07.581 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-06 04:33:07.581 DEBUG [src.node.waku_node] Using volumes []
2026-03-06 04:33:07.581 DEBUG [src.node.docker_mananger] docker run -i -t -p 24292:24292 -p 24293:24293 -p 24294:24294 -p 24295:24295 -p 24296:24296 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24294 --rest-port=24292 --tcp-port=24293 --discv5-udp-port=24295 --rest-address=0.0.0.0 --nat=extip:172.18.44.38 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=ce13ed1114ebbe11bb1b08714bb66951dad44e37d763c4bf4ca381ee71e11a95 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24296 --metrics-logging=true --relay=true --filter=true
2026-03-06 04:33:07.737 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.44.38 waku 1107fefa6734ddc4c37a77adc15431d596deca51a5fa2c818c4886200ca759fe
2026-03-06 04:33:07.768 DEBUG [src.node.docker_mananger] Container started with ID 1107fefa6734. Setting up logs at ./log/docker/node1_2026-03-06_04-33-07__1d560f13-e9b1-4044-a912-bbbddd7bf19d__wakuorg_nwaku:latest.log
2026-03-06 04:33:07.768 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 24292
2026-03-06 04:33:07.769 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-06 04:33:07.826 ERROR [src.node.docker_mananger] Max retries reached for container 8ac98df4c51c. Exiting log stream.
2026-03-06 04:33:08.350 ERROR [src.node.docker_mananger] Max retries reached for container f3184d9e4229. Exiting log stream.
2026-03-06 04:33:08.769 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24292/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:08.771 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:08.872 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24292/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:08.874 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-06 04:33:08.875 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-06 04:33:08.875 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24292/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:08.877 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.44.38/tcp/24293/p2p/16Uiu2HAm2ba3XeUmbbHTLkaqeGDRBLFv7jP5S1pqhjapnRg6LR7w","/ip4/172.18.44.38/tcp/24294/ws/p2p/16Uiu2HAm2ba3XeUmbbHTLkaqeGDRBLFv7jP5S1pqhjapnRg6LR7w"],"enrUri":"enr:-L24QGl4eJWKVIdE-QKLrBHcWY-dZbvODoEADm-K30yBVyV3ABdwzZoYkUCw04pxwXLeLaOVTjq08HZlEOgsaJ-xeP8CgmlkgnY0gmlwhKwSLCaKbXVsdGlhZGRyc5YACASsEiwmBl7lAAoErBIsJgZe5t0DgnJzhQACAQAAiXNlY3AyNTZrMaECaornueVUK_DeAHfPWXWQaKbS_gbvnPqSZJYVYrfkOhqDdGNwgl7lg3VkcIJe54V3YWt1MgU"}'
2026-03-06 04:33:08.878 INFO [src.node.waku_node] REST service is ready !!
2026-03-06 04:33:08.884 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-06 04:33:08.884 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-06_04-33-07__1d560f13-e9b1-4044-a912-bbbddd7bf19d__wakuorg_nwaku:latest.log
2026-03-06 04:33:08.884 DEBUG [src.node.waku_node] Starting Node...
2026-03-06 04:33:08.884 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-06 04:33:08.886 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-06 04:33:08.886 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.145.1
2026-03-06 04:33:08.886 DEBUG [src.node.docker_mananger] Generated ports ['25471', '25472', '25473', '25474', '25475']
2026-03-06 04:33:08.886 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-06 04:33:08.886 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-06 04:33:08.886 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-06 04:33:08.886 DEBUG [src.node.waku_node] Using volumes []
2026-03-06 04:33:08.886 DEBUG [src.node.docker_mananger] docker run -i -t -p 25471:25471 -p 25472:25472 -p 25473:25473 -p 25474:25474 -p 25475:25475 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=25473 --rest-port=25471 --tcp-port=25472 --discv5-udp-port=25474 --rest-address=0.0.0.0 --nat=extip:172.18.145.1 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=edda52d286e37e5d5acde0f56db0dc22ef2bd2a22b5f23be091ffa3f04c85517 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=25475 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QGl4eJWKVIdE-QKLrBHcWY-dZbvODoEADm-K30yBVyV3ABdwzZoYkUCw04pxwXLeLaOVTjq08HZlEOgsaJ-xeP8CgmlkgnY0gmlwhKwSLCaKbXVsdGlhZGRyc5YACASsEiwmBl7lAAoErBIsJgZe5t0DgnJzhQACAQAAiXNlY3AyNTZrMaECaornueVUK_DeAHfPWXWQaKbS_gbvnPqSZJYVYrfkOhqDdGNwgl7lg3VkcIJe54V3YWt1MgU
2026-03-06 04:33:09.047 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.145.1 waku 7b9545e460bbdc9a7433cb12fbbed35a7548161e76cb550f44127b80111d9d95
2026-03-06 04:33:09.080 DEBUG [src.node.docker_mananger] Container started with ID 7b9545e460bb. Setting up logs at ./log/docker/node2_2026-03-06_04-33-07__1d560f13-e9b1-4044-a912-bbbddd7bf19d__wakuorg_nwaku:latest.log
2026-03-06 04:33:09.080 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 25471
2026-03-06 04:33:09.080 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-06 04:33:10.081 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25471/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:10.083 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:10.184 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25471/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:10.189 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:10.290 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25471/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:10.292 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:10.393 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25471/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:10.395 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:10.496 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25471/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:10.498 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:10.599 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25471/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:10.601 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-06 04:33:10.701 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25471/health" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:10.707 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-06 04:33:10.708 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-06 04:33:10.708 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25471/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:10.711 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.145.1/tcp/25472/p2p/16Uiu2HAmQjDwPREy5F94beTZdMsVvbo1HgpVnfgmbLaX7CM9mH4C","/ip4/172.18.145.1/tcp/25473/ws/p2p/16Uiu2HAmQjDwPREy5F94beTZdMsVvbo1HgpVnfgmbLaX7CM9mH4C"],"enrUri":"enr:-L24QOKA-lNwZ1GjbPWvMXttO-mvena4-Mwc6MouE9i-UFQ5LF2_XIIRSQtcx-7idpUoLgvdIgfwhj5KMiWCzvOuDRQCgmlkgnY0gmlwhKwSkQGKbXVsdGlhZGRyc5YACASsEpEBBmOAAAoErBKRAQZjgd0DgnJzhQACAQAAiXNlY3AyNTZrMaEDs2HuI0Lyt8E5BPrAhQ5UUZsfaKWdvauCNMM1JYPeQpmDdGNwgmOAg3VkcIJjgoV3YWt1MgE"}'
2026-03-06 04:33:10.711 INFO [src.node.waku_node] REST service is ready !!
2026-03-06 04:33:10.711 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:25471/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.44.38/tcp/24293/p2p/16Uiu2HAm2ba3XeUmbbHTLkaqeGDRBLFv7jP5S1pqhjapnRg6LR7w"]'
2026-03-06 04:33:10.729 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:10.733 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24292/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-06 04:33:10.740 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:10.742 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:25471/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-06 04:33:10.747 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:10.748 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24292/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-06 04:33:10.762 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:10.762 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-06 04:33:10.862 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-06 04:33:10.863 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24292/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:10.865 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771590748595796,"ephemeral":false,"proof":""}]'
2026-03-06 04:33:10.867 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-06 04:33:10.867 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25471/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:10.872 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771590748595796,"ephemeral":false,"proof":""}]'
2026-03-06 04:33:10.874 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24292/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-06 04:33:10.881 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:10.882 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-06 04:33:10.983 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-06 04:33:10.983 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24292/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:10.986 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771590873995405,"ephemeral":false,"proof":""}]'
2026-03-06 04:33:10.988 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-06 04:33:10.988 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25471/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:10.990 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771590873995405,"ephemeral":false,"proof":""}]'
2026-03-06 04:33:10.993 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24292/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-06 04:33:11.002 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-06 04:33:11.003 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-06 04:33:11.104 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-06 04:33:11.104 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24292/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:11.107 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771590993587967,"ephemeral":false,"proof":""}]'
2026-03-06 04:33:11.108 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-06 04:33:11.108 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:25471/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-06 04:33:11.110 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/newsService/1.0/weekly/protobuf","version":0,"timestamp":1772771586626672357,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/newsService/1.0/weekly/protobuf","version":0,"timestamp":1772771587634017431,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/newsService/1.0/alerts/xml","version":0,"timestamp":1772771586767273270,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/newsService/1.0/updates/json","version":0,"timestamp":1772771587857844810,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/newsService/1.0/alerts/xml","version":0,"timestamp":1772771587746811280,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772771590993587967,"ephemeral":false,"proof":""}]'
2026-03-06 04:33:11.120 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-06 04:33:11.121 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-06 04:33:11.121 DEBUG [src.node.waku_node] Stopping container with id 1107fefa6734
2026-03-06 04:33:11.678 DEBUG [src.node.waku_node] Container stopped.
2026-03-06 04:33:11.679 DEBUG [src.node.waku_node] Stopping container with id 7b9545e460bb
2026-03-06 04:33:12.168 DEBUG [src.node.waku_node] Container stopped.
2026-03-06 04:33:12.171 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-06 04:33:12.207 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-06 04:33:12.247 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-06 04:33:12.247 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-06 04:33:12.247 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-06 04:33:12.248 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-06_04-33-07__1d560f13-e9b1-4044-a912-bbbddd7bf19d__wakuorg_nwaku:latest.log
2026-03-06 04:33:12.249 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-06_04-33-07__1d560f13-e9b1-4044-a912-bbbddd7bf19d__wakuorg_nwaku:latest.log
Reference in New Issue View Git Blame Copy Permalink