logos-messaging/logos-messaging-interop-tests
1
0
Fork 0
mirror of https://github.com/logos-messaging/logos-messaging-interop-tests.git synced 2026-05-05 18:09:25 +00:00
Code Issues Packages Projects Releases Wiki Activity
logos-messaging-interop-tests/nim/1107/data/attachments/63fe6afacfa27a68.txt

308 lines
54 KiB
Plaintext
Raw Blame History

2026-03-07 04:31:07.355 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-07 04:31:07.355 DEBUG [tests.conftest] Running test: test_resubscribe_to_unsubscribed_pubsub_topics with id: 2026-03-07_04-31-07__0897e0fe-ad36-4e44-87a6-30d2bb008023
2026-03-07 04:31:07.356 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-07 04:31:07.356 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-07 04:31:07.356 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-07 04:31:07.364 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:31:07.364 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-07_04-31-07__0897e0fe-ad36-4e44-87a6-30d2bb008023__wakuorg_nwaku:latest.log
2026-03-07 04:31:07.364 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:31:07.364 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:31:07.365 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:31:07.366 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.101.70
2026-03-07 04:31:07.366 DEBUG [src.node.docker_mananger] Generated ports ['53500', '53501', '53502', '53503', '53504']
2026-03-07 04:31:07.366 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-07 04:31:07.366 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:31:07.366 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:31:07.366 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:31:07.366 DEBUG [src.node.docker_mananger] docker run -i -t -p 53500:53500 -p 53501:53501 -p 53502:53502 -p 53503:53503 -p 53504:53504 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=53502 --rest-port=53500 --tcp-port=53501 --discv5-udp-port=53503 --rest-address=0.0.0.0 --nat=extip:172.18.101.70 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=416dc772e15c753fa9207aafe396178ec2dcd99a2be1b0f34e507cbedf99178b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=53504 --metrics-logging=true --relay=true --filter=true
2026-03-07 04:31:07.573 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.101.70 waku cae1f99648cffbc0d375c2c096054f1e81e1977b6eac19f83d9b95d9cef800f9
2026-03-07 04:31:07.608 DEBUG [src.node.docker_mananger] Container started with ID cae1f99648cf. Setting up logs at ./log/docker/node1_2026-03-07_04-31-07__0897e0fe-ad36-4e44-87a6-30d2bb008023__wakuorg_nwaku:latest.log
2026-03-07 04:31:07.608 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 53500
2026-03-07 04:31:07.609 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:31:08.167 ERROR [src.node.docker_mananger] Max retries reached for container 2a33d3ad7ab7. Exiting log stream.
2026-03-07 04:31:08.610 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53500/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:08.613 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:08.714 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53500/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:08.735 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:08.836 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53500/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:08.838 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:31:08.838 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:31:08.838 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53500/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:08.841 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.101.70/tcp/53501/p2p/16Uiu2HAkwLvZkWMqJSziTHpm367BeCHJqbjQ9W4h7Atsg6aGn98x","/ip4/172.18.101.70/tcp/53502/ws/p2p/16Uiu2HAkwLvZkWMqJSziTHpm367BeCHJqbjQ9W4h7Atsg6aGn98x"],"enrUri":"enr:-L24QOUYiavl6FsBdINi9MPDOoRb0csrX2aBm03Izb2K533-T49mfxuJ-OV8-N4SqpwIGH_C9yZVCWjHdjgzxfkz4tACgmlkgnY0gmlwhKwSZUaKbXVsdGlhZGRyc5YACASsEmVGBtD9AAoErBJlRgbQ_t0DgnJzhQACAQAAiXNlY3AyNTZrMaECHH_2Lu-VAMJlOkp25jiLChszdPqBE9VHsHfhbxoePkWDdGNwgtD9g3VkcILQ_4V3YWt1MgU"}'
2026-03-07 04:31:08.841 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:31:08.848 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:31:08.848 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-07_04-31-07__0897e0fe-ad36-4e44-87a6-30d2bb008023__wakuorg_nwaku:latest.log
2026-03-07 04:31:08.848 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:31:08.848 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:31:08.849 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:31:08.849 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.212.150
2026-03-07 04:31:08.849 DEBUG [src.node.docker_mananger] Generated ports ['55982', '55983', '55984', '55985', '55986']
2026-03-07 04:31:08.850 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-07 04:31:08.850 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:31:08.850 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:31:08.850 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:31:08.850 DEBUG [src.node.docker_mananger] docker run -i -t -p 55982:55982 -p 55983:55983 -p 55984:55984 -p 55985:55985 -p 55986:55986 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=55984 --rest-port=55982 --tcp-port=55983 --discv5-udp-port=55985 --rest-address=0.0.0.0 --nat=extip:172.18.212.150 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=3a50add4ddef54d22bedb7b0e9fd4186f08fa256d86d4aa5f92aa41e6b8eceae --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=55986 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QOUYiavl6FsBdINi9MPDOoRb0csrX2aBm03Izb2K533-T49mfxuJ-OV8-N4SqpwIGH_C9yZVCWjHdjgzxfkz4tACgmlkgnY0gmlwhKwSZUaKbXVsdGlhZGRyc5YACASsEmVGBtD9AAoErBJlRgbQ_t0DgnJzhQACAQAAiXNlY3AyNTZrMaECHH_2Lu-VAMJlOkp25jiLChszdPqBE9VHsHfhbxoePkWDdGNwgtD9g3VkcILQ_4V3YWt1MgU
2026-03-07 04:31:09.046 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.212.150 waku 8ade2a4b5e47a05ede94548f921a1d43ada02d0a20d340503bc0127789c983a4
2026-03-07 04:31:09.079 DEBUG [src.node.docker_mananger] Container started with ID 8ade2a4b5e47. Setting up logs at ./log/docker/node2_2026-03-07_04-31-07__0897e0fe-ad36-4e44-87a6-30d2bb008023__wakuorg_nwaku:latest.log
2026-03-07 04:31:09.079 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 55982
2026-03-07 04:31:09.079 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:31:10.080 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55982/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:10.085 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:10.186 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55982/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:10.190 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:10.290 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55982/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:10.319 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:10.419 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55982/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:10.422 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:31:10.422 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:31:10.422 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55982/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:10.424 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.212.150/tcp/55983/p2p/16Uiu2HAmNgsdMWfmQ5ft1gNcJrwtrcBQzVKdAC9JK55j8uasdfSJ","/ip4/172.18.212.150/tcp/55984/ws/p2p/16Uiu2HAmNgsdMWfmQ5ft1gNcJrwtrcBQzVKdAC9JK55j8uasdfSJ"],"enrUri":"enr:-L24QI_k6I9FLnsvMx-FkKL5aAAx4EuuGHElSJpnFMYfejsBMdReJ35p0s-1e2z8_MKQXHFCYnnEzTrVKg_YT1UIvHQCgmlkgnY0gmlwhKwS1JaKbXVsdGlhZGRyc5YACASsEtSWBtqvAAoErBLUlgbasN0DgnJzhQACAQAAiXNlY3AyNTZrMaEDlRBt27ZwoNXMKD7pFqZdmjnj5sgfSplGnF_b9cR1TfODdGNwgtqvg3VkcILasYV3YWt1MgE"}'
2026-03-07 04:31:10.425 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:31:10.425 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55982/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.101.70/tcp/53501/p2p/16Uiu2HAkwLvZkWMqJSziTHpm367BeCHJqbjQ9W4h7Atsg6aGn98x"]'
2026-03-07 04:31:10.460 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:10.461 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53500/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-07 04:31:10.469 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:10.469 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55982/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-07 04:31:10.472 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:10.472 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53500/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:31:10.481 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:10.482 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-07 04:31:10.582 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:10.583 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53500/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:10.585 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857870472567226,"ephemeral":false,"proof":""}]'
2026-03-07 04:31:10.587 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:10.588 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55982/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:10.593 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857870472567226,"ephemeral":false,"proof":""}]'
2026-03-07 04:31:10.597 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53500/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:31:10.609 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:10.610 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-07 04:31:10.711 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:10.711 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53500/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:10.714 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857870596845212,"ephemeral":false,"proof":""}]'
2026-03-07 04:31:10.715 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:10.716 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55982/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:10.718 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857870596845212,"ephemeral":false,"proof":""}]'
2026-03-07 04:31:10.719 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53500/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:31:10.729 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:10.729 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-07 04:31:10.829 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:10.829 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53500/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:10.832 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857870719747665,"ephemeral":false,"proof":""}]'
2026-03-07 04:31:10.833 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:10.834 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55982/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:10.836 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857870719747665,"ephemeral":false,"proof":""}]'
2026-03-07 04:31:10.838 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53500/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:31:10.846 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:10.847 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-07 04:31:10.948 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:10.948 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53500/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:10.950 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857870837896542,"ephemeral":false,"proof":""}]'
2026-03-07 04:31:10.952 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:10.952 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55982/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:10.954 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857870837896542,"ephemeral":false,"proof":""}]'
2026-03-07 04:31:10.956 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53500/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:31:10.964 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:10.965 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-07 04:31:11.065 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:11.067 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53500/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:11.074 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857870956288163,"ephemeral":false,"proof":""}]'
2026-03-07 04:31:11.077 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:11.077 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55982/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:11.082 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857870956288163,"ephemeral":false,"proof":""}]'
2026-03-07 04:31:11.084 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:53500/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:31:11.095 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:11.096 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-07 04:31:11.196 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:11.196 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:53500/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:11.199 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857871084565682,"ephemeral":false,"proof":""}]'
2026-03-07 04:31:11.200 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:11.200 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55982/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:11.203 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/27/sometopic/someencoding","version":0,"timestamp":1772857869432937095,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857871084565682,"ephemeral":false,"proof":""}]'
2026-03-07 04:31:11.245 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-07 04:31:11.246 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-07 04:31:11.246 DEBUG [src.node.waku_node] Stopping container with id cae1f99648cf
2026-03-07 04:31:11.831 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:31:11.832 DEBUG [src.node.waku_node] Stopping container with id 8ade2a4b5e47
2026-03-07 04:31:12.406 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:31:12.411 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-07 04:31:12.452 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:31:12.488 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:31:12.492 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-07 04:31:12.493 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-07 04:31:12.495 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-07_04-31-07__0897e0fe-ad36-4e44-87a6-30d2bb008023__wakuorg_nwaku:latest.log
2026-03-07 04:31:12.498 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-07_04-31-07__0897e0fe-ad36-4e44-87a6-30d2bb008023__wakuorg_nwaku:latest.log
2026-03-07 04:31:12.522 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-07 04:31:12.524 DEBUG [tests.conftest] Running test: test_resubscribe_to_unsubscribed_pubsub_topics with id: 2026-03-07_04-31-12__788b6f7a-3b51-4960-9e7b-20f0b653a4e4
2026-03-07 04:31:12.525 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-07 04:31:12.526 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-07 04:31:12.526 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-07 04:31:12.536 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:31:12.536 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-07_04-31-12__788b6f7a-3b51-4960-9e7b-20f0b653a4e4__wakuorg_nwaku:latest.log
2026-03-07 04:31:12.536 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:31:12.537 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:31:12.539 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:31:12.539 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.237.106
2026-03-07 04:31:12.539 DEBUG [src.node.docker_mananger] Generated ports ['34443', '34444', '34445', '34446', '34447']
2026-03-07 04:31:12.539 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-07 04:31:12.540 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:31:12.540 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:31:12.541 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:31:12.541 DEBUG [src.node.docker_mananger] docker run -i -t -p 34443:34443 -p 34444:34444 -p 34445:34445 -p 34446:34446 -p 34447:34447 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=34445 --rest-port=34443 --tcp-port=34444 --discv5-udp-port=34446 --rest-address=0.0.0.0 --nat=extip:172.18.237.106 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=e4ab4fcc64ffd73ecad0d271fe3863bed614e9e34afdab712ce9917fff8a7c3c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=34447 --metrics-logging=true --relay=true --filter=true
2026-03-07 04:31:12.695 ERROR [src.node.docker_mananger] Max retries reached for container cae1f99648cf. Exiting log stream.
2026-03-07 04:31:12.749 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.237.106 waku d95e10a1fac95bdc86f8cb59d1cc87c7d95e4c70aa092ae1a95110de39b49da3
2026-03-07 04:31:12.784 DEBUG [src.node.docker_mananger] Container started with ID d95e10a1fac9. Setting up logs at ./log/docker/node1_2026-03-07_04-31-12__788b6f7a-3b51-4960-9e7b-20f0b653a4e4__wakuorg_nwaku:latest.log
2026-03-07 04:31:12.784 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 34443
2026-03-07 04:31:12.785 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:31:13.440 ERROR [src.node.docker_mananger] Max retries reached for container 8ade2a4b5e47. Exiting log stream.
2026-03-07 04:31:13.786 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34443/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:13.788 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:13.889 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34443/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:13.908 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:14.009 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34443/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:14.011 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:31:14.011 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:31:14.011 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34443/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:14.014 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.237.106/tcp/34444/p2p/16Uiu2HAm9bMzsNebDbykpxQjmVsXRXWvUxM7u2MVHcvNT2DpvvWP","/ip4/172.18.237.106/tcp/34445/ws/p2p/16Uiu2HAm9bMzsNebDbykpxQjmVsXRXWvUxM7u2MVHcvNT2DpvvWP"],"enrUri":"enr:-L24QM6ammpDL3eV9-wOY-aNTLmbUPAsJ1Bw3_fvFmBe-1DNeKeu4h14zooJdJ6DJ0y2UQ83U544o8iH-NwFsEHZYEACgmlkgnY0gmlwhKwS7WqKbXVsdGlhZGRyc5YACASsEu1qBoaMAAoErBLtagaGjd0DgnJzhQACAQAAiXNlY3AyNTZrMaEC0n8X5u429AO8sxEj3283UlMyBcq_siQtsnpgXUY1LRSDdGNwgoaMg3VkcIKGjoV3YWt1MgU"}'
2026-03-07 04:31:14.014 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:31:14.020 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:31:14.021 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-07_04-31-12__788b6f7a-3b51-4960-9e7b-20f0b653a4e4__wakuorg_nwaku:latest.log
2026-03-07 04:31:14.021 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:31:14.021 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:31:14.022 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:31:14.022 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.143.131
2026-03-07 04:31:14.022 DEBUG [src.node.docker_mananger] Generated ports ['20232', '20233', '20234', '20235', '20236']
2026-03-07 04:31:14.022 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-07 04:31:14.023 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:31:14.023 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:31:14.023 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:31:14.023 DEBUG [src.node.docker_mananger] docker run -i -t -p 20232:20232 -p 20233:20233 -p 20234:20234 -p 20235:20235 -p 20236:20236 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=20234 --rest-port=20232 --tcp-port=20233 --discv5-udp-port=20235 --rest-address=0.0.0.0 --nat=extip:172.18.143.131 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=c6abdb47cee5af7c5efefd8cc58cb0dc6fac4a2cfe7f5ddf8b711b41dd12afb0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=20236 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QM6ammpDL3eV9-wOY-aNTLmbUPAsJ1Bw3_fvFmBe-1DNeKeu4h14zooJdJ6DJ0y2UQ83U544o8iH-NwFsEHZYEACgmlkgnY0gmlwhKwS7WqKbXVsdGlhZGRyc5YACASsEu1qBoaMAAoErBLtagaGjd0DgnJzhQACAQAAiXNlY3AyNTZrMaEC0n8X5u429AO8sxEj3283UlMyBcq_siQtsnpgXUY1LRSDdGNwgoaMg3VkcIKGjoV3YWt1MgU
2026-03-07 04:31:14.211 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.143.131 waku 247e49e0a750465f081d2597a0d2b16efd5800887aa949c97557cb1c186ae07d
2026-03-07 04:31:14.244 DEBUG [src.node.docker_mananger] Container started with ID 247e49e0a750. Setting up logs at ./log/docker/node2_2026-03-07_04-31-12__788b6f7a-3b51-4960-9e7b-20f0b653a4e4__wakuorg_nwaku:latest.log
2026-03-07 04:31:14.245 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 20232
2026-03-07 04:31:14.245 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:31:15.245 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20232/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:15.248 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:15.349 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20232/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:15.351 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:15.451 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20232/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:15.453 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:15.554 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20232/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:15.556 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:15.657 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20232/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:15.659 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:15.759 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20232/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:15.761 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:15.862 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20232/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:15.879 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:15.979 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20232/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:15.982 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:31:15.982 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:31:15.982 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20232/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:15.985 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.143.131/tcp/20233/p2p/16Uiu2HAkzF9rWdgvFVmbGV8YLoy53H52TsBWAME28Rh7nCxpyQGh","/ip4/172.18.143.131/tcp/20234/ws/p2p/16Uiu2HAkzF9rWdgvFVmbGV8YLoy53H52TsBWAME28Rh7nCxpyQGh"],"enrUri":"enr:-L24QOV2VksPi8n31aV9l7KdAu0pG5gFD2thVNuEEAIvs15fJ5p7CBq1pPIAJ-XS1guzdyW2z8YiHiDQQCiJe8-OVX0CgmlkgnY0gmlwhKwSj4OKbXVsdGlhZGRyc5YACASsEo-DBk8JAAoErBKPgwZPCt0DgnJzhQACAQAAiXNlY3AyNTZrMaECR5iQP-dFR_yRYzEgfJmJFn-KA4cmyCRPAu3L4NZy0RqDdGNwgk8Jg3VkcIJPC4V3YWt1MgE"}'
2026-03-07 04:31:15.985 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:31:15.985 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20232/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.237.106/tcp/34444/p2p/16Uiu2HAm9bMzsNebDbykpxQjmVsXRXWvUxM7u2MVHcvNT2DpvvWP"]'
2026-03-07 04:31:16.004 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:16.006 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34443/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-07 04:31:16.019 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:16.020 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20232/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-07 04:31:16.029 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:16.029 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34443/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:31:16.041 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:16.041 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-07 04:31:16.141 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:16.141 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34443/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:16.144 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857874226943259,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857875633129955,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857876029524583,"ephemeral":false,"proof":""}]'
2026-03-07 04:31:16.153 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-07 04:31:16.154 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-07 04:31:16.154 DEBUG [src.node.waku_node] Stopping container with id d95e10a1fac9
2026-03-07 04:31:16.746 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:31:16.746 DEBUG [src.node.waku_node] Stopping container with id 247e49e0a750
2026-03-07 04:31:17.305 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:31:17.306 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-07 04:31:17.337 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:31:17.362 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:31:17.363 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-07 04:31:17.363 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-07 04:31:17.364 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-07_04-31-12__788b6f7a-3b51-4960-9e7b-20f0b653a4e4__wakuorg_nwaku:latest.log
2026-03-07 04:31:17.366 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-07_04-31-12__788b6f7a-3b51-4960-9e7b-20f0b653a4e4__wakuorg_nwaku:latest.log
2026-03-07 04:31:17.369 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-07 04:31:17.370 DEBUG [tests.conftest] Running test: test_resubscribe_to_unsubscribed_pubsub_topics with id: 2026-03-07_04-31-17__26c1bcd5-04a5-4032-8672-b11af0630587
2026-03-07 04:31:17.370 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-07 04:31:17.370 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-07 04:31:17.371 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-07 04:31:17.378 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:31:17.378 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-07_04-31-17__26c1bcd5-04a5-4032-8672-b11af0630587__wakuorg_nwaku:latest.log
2026-03-07 04:31:17.378 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:31:17.378 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:31:17.379 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:31:17.380 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.131.98
2026-03-07 04:31:17.380 DEBUG [src.node.docker_mananger] Generated ports ['62967', '62968', '62969', '62970', '62971']
2026-03-07 04:31:17.380 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-07 04:31:17.380 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:31:17.380 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:31:17.380 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:31:17.380 DEBUG [src.node.docker_mananger] docker run -i -t -p 62967:62967 -p 62968:62968 -p 62969:62969 -p 62970:62970 -p 62971:62971 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=62969 --rest-port=62967 --tcp-port=62968 --discv5-udp-port=62970 --rest-address=0.0.0.0 --nat=extip:172.18.131.98 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=fa80b87d3c9dd6ebdbc2a972925acbe94e3ef03ff8dd1b4cc4e0fde86bef9cd2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=62971 --metrics-logging=true --relay=true --filter=true
2026-03-07 04:31:17.568 ERROR [src.node.docker_mananger] Max retries reached for container d95e10a1fac9. Exiting log stream.
2026-03-07 04:31:17.572 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.131.98 waku cad0db0ff07eeb3653718eaedc0a58145e254892764ce0d79a264261ece348b2
2026-03-07 04:31:17.607 DEBUG [src.node.docker_mananger] Container started with ID cad0db0ff07e. Setting up logs at ./log/docker/node1_2026-03-07_04-31-17__26c1bcd5-04a5-4032-8672-b11af0630587__wakuorg_nwaku:latest.log
2026-03-07 04:31:17.607 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 62967
2026-03-07 04:31:17.608 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:31:18.148 ERROR [src.node.docker_mananger] Max retries reached for container 247e49e0a750. Exiting log stream.
2026-03-07 04:31:18.609 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62967/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:18.612 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:18.712 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62967/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:18.739 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-07 04:31:18.839 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62967/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:18.842 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:31:18.842 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:31:18.842 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62967/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:18.844 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.131.98/tcp/62968/p2p/16Uiu2HAmTa5rBeXyfsfLTX1zeUiJWZA1ihkbaCH9Rv7CCEvzq59X","/ip4/172.18.131.98/tcp/62969/ws/p2p/16Uiu2HAmTa5rBeXyfsfLTX1zeUiJWZA1ihkbaCH9Rv7CCEvzq59X"],"enrUri":"enr:-L24QHR0DApVeh10AM2Enr90jxJUEnIwCXgejSlYedTZ9POjT1z1YYT48-wEvvTGjmzY1SkPePV4Z0i5WHqMJcTgDBgCgmlkgnY0gmlwhKwSg2KKbXVsdGlhZGRyc5YACASsEoNiBvX4AAoErBKDYgb1-d0DgnJzhQACAQAAiXNlY3AyNTZrMaED3Z2d3aSd0ARxrZNMy5_cF3NFSMsgxR6KFzYEabSZQG6DdGNwgvX4g3VkcIL1-oV3YWt1MgU"}'
2026-03-07 04:31:18.844 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:31:18.852 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:31:18.853 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-07_04-31-17__26c1bcd5-04a5-4032-8672-b11af0630587__wakuorg_nwaku:latest.log
2026-03-07 04:31:18.854 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:31:18.854 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:31:18.856 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:31:18.857 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.126.76
2026-03-07 04:31:18.857 DEBUG [src.node.docker_mananger] Generated ports ['35830', '35831', '35832', '35833', '35834']
2026-03-07 04:31:18.858 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-07 04:31:18.858 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:31:18.858 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:31:18.858 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:31:18.858 DEBUG [src.node.docker_mananger] docker run -i -t -p 35830:35830 -p 35831:35831 -p 35832:35832 -p 35833:35833 -p 35834:35834 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=35832 --rest-port=35830 --tcp-port=35831 --discv5-udp-port=35833 --rest-address=0.0.0.0 --nat=extip:172.18.126.76 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=a09edf7eebb3c3b1a5e7f7304eca59fc980a5bc5ce25e90ecccecab2b0a3b88b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=35834 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QHR0DApVeh10AM2Enr90jxJUEnIwCXgejSlYedTZ9POjT1z1YYT48-wEvvTGjmzY1SkPePV4Z0i5WHqMJcTgDBgCgmlkgnY0gmlwhKwSg2KKbXVsdGlhZGRyc5YACASsEoNiBvX4AAoErBKDYgb1-d0DgnJzhQACAQAAiXNlY3AyNTZrMaED3Z2d3aSd0ARxrZNMy5_cF3NFSMsgxR6KFzYEabSZQG6DdGNwgvX4g3VkcIL1-oV3YWt1MgU
2026-03-07 04:31:19.063 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.126.76 waku 8dc4668760d47651ac844f8100b7bc7c8e5548cfe6c65aec82e5d568bdae9b83
2026-03-07 04:31:19.094 DEBUG [src.node.docker_mananger] Container started with ID 8dc4668760d4. Setting up logs at ./log/docker/node2_2026-03-07_04-31-17__26c1bcd5-04a5-4032-8672-b11af0630587__wakuorg_nwaku:latest.log
2026-03-07 04:31:19.095 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 35830
2026-03-07 04:31:19.095 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:31:20.095 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35830/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:20.098 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:31:20.098 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:31:20.098 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35830/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:20.101 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.126.76/tcp/35831/p2p/16Uiu2HAmJTKkTjggVub355T9cGJ3uWch5CmLuHYUznzfPjYh9FjX","/ip4/172.18.126.76/tcp/35832/ws/p2p/16Uiu2HAmJTKkTjggVub355T9cGJ3uWch5CmLuHYUznzfPjYh9FjX"],"enrUri":"enr:-L24QNznO8uFGwIEWWL1hQvqDrQCXpo9e1gmhSCRgKtWlcBjXflTHvdhOroL-LuK4looBZfEPyL9JLufAeN9Wa__R5ICgmlkgnY0gmlwhKwSfkyKbXVsdGlhZGRyc5YACASsEn5MBov3AAoErBJ-TAaL-N0DgnJzhQACAQAAiXNlY3AyNTZrMaEDVikWQnLzLKUcy8PBv3sbkNfbQ7ymnlt5yxldB5q45TqDdGNwgov3g3VkcIKL-YV3YWt1MgE"}'
2026-03-07 04:31:20.101 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:31:20.101 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35830/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.131.98/tcp/62968/p2p/16Uiu2HAmTa5rBeXyfsfLTX1zeUiJWZA1ihkbaCH9Rv7CCEvzq59X"]'
2026-03-07 04:31:20.133 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:20.137 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62967/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-07 04:31:20.147 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:20.148 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35830/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-07 04:31:20.157 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:20.158 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62967/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:31:20.168 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:20.169 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-07 04:31:20.270 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:20.271 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62967/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:20.273 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857879147260147,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857878249930563,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857876029524583,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857879688479002,"ephemeral":false,"proof":""},{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772857880158258134,"ephemeral":false,"proof":""}]'
2026-03-07 04:31:20.282 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-07 04:31:20.283 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-07 04:31:20.283 DEBUG [src.node.waku_node] Stopping container with id cad0db0ff07e
2026-03-07 04:31:20.910 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:31:20.910 DEBUG [src.node.waku_node] Stopping container with id 8dc4668760d4
2026-03-07 04:31:21.481 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:31:21.485 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-07 04:31:21.522 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:31:21.552 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:31:21.553 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-07 04:31:21.554 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-07 04:31:21.554 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-07_04-31-17__26c1bcd5-04a5-4032-8672-b11af0630587__wakuorg_nwaku:latest.log
2026-03-07 04:31:21.555 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-07_04-31-17__26c1bcd5-04a5-4032-8672-b11af0630587__wakuorg_nwaku:latest.log
Reference in New Issue View Git Blame Copy Permalink