146 lines
27 KiB
Plaintext

2026-03-18 04:53:58.525 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-18 04:53:58.526 DEBUG [tests.conftest] Running test: test_sync_with_one_node_with_delayed_start with id: 2026-03-18_04-53-58__0697d675-a5a9-45de-9751-3d2654e9a810
2026-03-18 04:53:58.527 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-18 04:53:58.536 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-18 04:53:58.537 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-18_04-53-58__0697d675-a5a9-45de-9751-3d2654e9a810__wakuorg_nwaku:latest.log
2026-03-18 04:53:58.545 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-18 04:53:58.545 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-18_04-53-58__0697d675-a5a9-45de-9751-3d2654e9a810__wakuorg_nwaku:latest.log
2026-03-18 04:53:58.552 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-18 04:53:58.552 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-18_04-53-58__0697d675-a5a9-45de-9751-3d2654e9a810__wakuorg_nwaku:latest.log
2026-03-18 04:53:58.553 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-18 04:53:58.555 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 04:53:58.555 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 04:53:58.556 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 04:53:58.556 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.81.202
2026-03-18 04:53:58.556 DEBUG [src.node.docker_mananger] Generated ports ['21989', '21990', '21991', '21992', '21993']
2026-03-18 04:53:58.557 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 04:53:58.557 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 04:53:58.557 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 04:53:58.557 DEBUG [src.node.docker_mananger] docker run -i -t -p 21989:21989 -p 21990:21990 -p 21991:21991 -p 21992:21992 -p 21993:21993 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=21991 --rest-port=21989 --tcp-port=21990 --discv5-udp-port=21992 --rest-address=0.0.0.0 --nat=extip:172.18.81.202 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=10dfdeec6ce0efa1702c9bc4a2af1ed05dcdafa1d4affddb1d41ceed5c613b0d --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=21993 --metrics-logging=true --relay=true
2026-03-18 04:53:58.746 ERROR [src.node.docker_mananger] Max retries reached for container 6da67b8a2a67. Exiting log stream.
2026-03-18 04:53:58.752 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.81.202 waku fec67e533b9f1658a5f99914933d8aba34993e23f06197c4c578dd0870d781f9
2026-03-18 04:53:58.789 DEBUG [src.node.docker_mananger] Container started with ID fec67e533b9f. Setting up logs at ./log/docker/node1_2026-03-18_04-53-58__0697d675-a5a9-45de-9751-3d2654e9a810__wakuorg_nwaku:latest.log
2026-03-18 04:53:58.790 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 21989
2026-03-18 04:53:58.791 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 04:53:59.365 ERROR [src.node.docker_mananger] Max retries reached for container e244ea1857dd. Exiting log stream.
2026-03-18 04:53:59.793 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21989/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:53:59.796 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 04:53:59.797 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 04:53:59.797 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21989/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:53:59.799 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.81.202/tcp/21990/p2p/16Uiu2HAmSvDo4oikvYN5GLdB5DftGZwjPCxd7ePmQuYn6AzzcxSd","/ip4/172.18.81.202/tcp/21991/ws/p2p/16Uiu2HAmSvDo4oikvYN5GLdB5DftGZwjPCxd7ePmQuYn6AzzcxSd"],"enrUri":"enr:-L24QBM0j6JzRUKR3DiOxI3G6Y6ds_v3PwwG9XKCnbuofrjwdv5HbMnVn0XqEA0ux9IEbj7fM_YhU4C0epLd1qFJ28UCgmlkgnY0gmlwhKwSUcqKbXVsdGlhZGRyc5YACASsElHKBlXmAAoErBJRygZV590DgnJzhQADAQAAiXNlY3AyNTZrMaED0-qH4BUMxrAfkZJi9n4aiztAUFF_C0ISJy52qPrY7PKDdGNwglXmg3VkcIJV6IV3YWt1MhM"}'
2026-03-18 04:53:59.800 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 04:53:59.800 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 04:53:59.800 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 04:53:59.801 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 04:53:59.802 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.36.253
2026-03-18 04:53:59.802 DEBUG [src.node.docker_mananger] Generated ports ['46385', '46386', '46387', '46388', '46389']
2026-03-18 04:53:59.802 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 04:53:59.802 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 04:53:59.802 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 04:53:59.802 DEBUG [src.node.docker_mananger] docker run -i -t -p 46385:46385 -p 46386:46386 -p 46387:46387 -p 46388:46388 -p 46389:46389 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=46387 --rest-port=46385 --tcp-port=46386 --discv5-udp-port=46388 --rest-address=0.0.0.0 --nat=extip:172.18.36.253 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=d8ad5ff9ac08483a9dcadab2be00caf3ac83d7a1e6b6fc4ee06f8bdcab73e7ca --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=46389 --metrics-logging=true --relay=true --storenode=/ip4/172.18.81.202/tcp/21990/p2p/16Uiu2HAmSvDo4oikvYN5GLdB5DftGZwjPCxd7ePmQuYn6AzzcxSd --discv5-bootstrap-node=enr:-L24QBM0j6JzRUKR3DiOxI3G6Y6ds_v3PwwG9XKCnbuofrjwdv5HbMnVn0XqEA0ux9IEbj7fM_YhU4C0epLd1qFJ28UCgmlkgnY0gmlwhKwSUcqKbXVsdGlhZGRyc5YACASsElHKBlXmAAoErBJRygZV590DgnJzhQADAQAAiXNlY3AyNTZrMaED0-qH4BUMxrAfkZJi9n4aiztAUFF_C0ISJy52qPrY7PKDdGNwglXmg3VkcIJV6IV3YWt1MhM
2026-03-18 04:54:00.008 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.36.253 waku 3a26976ed781acea0a1bf5d7fb1665eb8e80795887d52b9e52fce88b00f5434c
2026-03-18 04:54:00.044 DEBUG [src.node.docker_mananger] Container started with ID 3a26976ed781. Setting up logs at ./log/docker/node2_2026-03-18_04-53-58__0697d675-a5a9-45de-9751-3d2654e9a810__wakuorg_nwaku:latest.log
2026-03-18 04:54:00.045 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 46385
2026-03-18 04:54:00.045 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 04:54:01.046 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46385/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:54:01.050 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 04:54:01.050 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 04:54:01.050 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46385/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:54:01.053 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.36.253/tcp/46386/p2p/16Uiu2HAkwkwnXTNjMYaLepAsNyA52uMhWZtvw11QE7b92Rf1NAvg","/ip4/172.18.36.253/tcp/46387/ws/p2p/16Uiu2HAkwkwnXTNjMYaLepAsNyA52uMhWZtvw11QE7b92Rf1NAvg"],"enrUri":"enr:-L24QEDuNjzCjKxEw6zYJUEc-43EexWewq-PGODqdB83hhO_Wm6y4PSp5SDm_s13NH3dg2uWvwSf_Q69Tm34lfbHdxMCgmlkgnY0gmlwhKwSJP2KbXVsdGlhZGRyc5YACASsEiT9BrUyAAoErBIk_Qa1M90DgnJzhQADAQAAiXNlY3AyNTZrMaECIqdH4_BHCOjqTdFfteCkmcB1-QCvAyaAh9ohjtT5yfWDdGNwgrUyg3VkcIK1NIV3YWt1MhM"}'
2026-03-18 04:54:01.053 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 04:54:01.053 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:46385/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.81.202/tcp/21990/p2p/16Uiu2HAmSvDo4oikvYN5GLdB5DftGZwjPCxd7ePmQuYn6AzzcxSd"]'
2026-03-18 04:54:01.056 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:54:01.056 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21989/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-18 04:54:01.059 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:54:01.059 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:46385/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-18 04:54:01.061 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:54:01.062 DEBUG [src.steps.store] Relaying message
2026-03-18 04:54:01.062 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21989/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:54:01.067 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:54:01.067 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:54:01.268 DEBUG [src.steps.store] Relaying message
2026-03-18 04:54:01.269 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21989/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:54:01.274 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:54:01.274 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:54:01.475 DEBUG [src.steps.store] Relaying message
2026-03-18 04:54:01.475 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21989/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:54:01.482 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:54:01.482 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:54:01.683 DEBUG [src.steps.store] Relaying message
2026-03-18 04:54:01.683 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21989/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:54:01.690 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:54:01.690 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:54:01.891 DEBUG [src.steps.store] Relaying message
2026-03-18 04:54:01.891 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21989/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:54:01.897 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:54:01.898 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:54:02.099 DEBUG [src.steps.store] Relaying message
2026-03-18 04:54:02.099 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21989/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:54:02.106 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:54:02.106 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:54:02.307 DEBUG [src.steps.store] Relaying message
2026-03-18 04:54:02.307 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21989/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:54:02.313 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:54:02.314 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:54:02.515 DEBUG [src.steps.store] Relaying message
2026-03-18 04:54:02.515 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21989/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:54:02.521 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:54:02.521 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:54:02.722 DEBUG [src.steps.store] Relaying message
2026-03-18 04:54:02.722 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21989/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:54:02.728 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:54:02.728 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:54:02.929 DEBUG [src.steps.store] Relaying message
2026-03-18 04:54:02.929 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21989/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-18 04:54:02.935 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:54:02.936 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-18 04:54:03.136 DEBUG [src.node.waku_node] Starting Node...
2026-03-18 04:54:03.136 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-18 04:54:03.138 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-18 04:54:03.138 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.198.165
2026-03-18 04:54:03.138 DEBUG [src.node.docker_mananger] Generated ports ['21828', '21829', '21830', '21831', '21832']
2026-03-18 04:54:03.139 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-18 04:54:03.139 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-18 04:54:03.139 DEBUG [src.node.waku_node] Using volumes []
2026-03-18 04:54:03.139 DEBUG [src.node.docker_mananger] docker run -i -t -p 21828:21828 -p 21829:21829 -p 21830:21830 -p 21831:21831 -p 21832:21832 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=21830 --rest-port=21828 --tcp-port=21829 --discv5-udp-port=21831 --rest-address=0.0.0.0 --nat=extip:172.18.198.165 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dcf6fb33feb8ff6cd89f6dc320c4d05ca2ddf59476ebeb95c640bd50500a0da2 --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=21832 --metrics-logging=true --relay=true --storenode=/ip4/172.18.36.253/tcp/46386/p2p/16Uiu2HAkwkwnXTNjMYaLepAsNyA52uMhWZtvw11QE7b92Rf1NAvg --discv5-bootstrap-node=enr:-L24QEDuNjzCjKxEw6zYJUEc-43EexWewq-PGODqdB83hhO_Wm6y4PSp5SDm_s13NH3dg2uWvwSf_Q69Tm34lfbHdxMCgmlkgnY0gmlwhKwSJP2KbXVsdGlhZGRyc5YACASsEiT9BrUyAAoErBIk_Qa1M90DgnJzhQADAQAAiXNlY3AyNTZrMaECIqdH4_BHCOjqTdFfteCkmcB1-QCvAyaAh9ohjtT5yfWDdGNwgrUyg3VkcIK1NIV3YWt1MhM
2026-03-18 04:54:03.345 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.198.165 waku b8cca6b98b967c64534825e0d1261e7eab62b1839e1bd212926e4a93e01172d7
2026-03-18 04:54:03.385 DEBUG [src.node.docker_mananger] Container started with ID b8cca6b98b96. Setting up logs at ./log/docker/node3_2026-03-18_04-53-58__0697d675-a5a9-45de-9751-3d2654e9a810__wakuorg_nwaku:latest.log
2026-03-18 04:54:03.386 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 21828
2026-03-18 04:54:03.386 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 04:54:04.386 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21828/health" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:54:04.389 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-18 04:54:04.390 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-18 04:54:04.390 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21828/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:54:04.392 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.198.165/tcp/21829/p2p/16Uiu2HAmJeMRrUTRRbhBUtnc5Tgi4KHJiQx2TDEF8tnxCWwNmmoB","/ip4/172.18.198.165/tcp/21830/ws/p2p/16Uiu2HAmJeMRrUTRRbhBUtnc5Tgi4KHJiQx2TDEF8tnxCWwNmmoB"],"enrUri":"enr:-L24QOk8uW9nv-3HsZCPC52OfxfhzbvIps_i7oe-DZyeWPpqMtA4oPrl1ARb-LHSMjCDt-NdRmtY8W2480t-VNGE8kACgmlkgnY0gmlwhKwSxqWKbXVsdGlhZGRyc5YACASsEsalBlVFAAoErBLGpQZVRt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDWPxf3xqI1lUAInhYur2YQXiB-ifD24lSiIUZV0e3Q1aDdGNwglVFg3VkcIJVR4V3YWt1MgE"}'
2026-03-18 04:54:04.392 INFO [src.node.waku_node] REST service is ready !!
2026-03-18 04:54:04.392 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21828/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.36.253/tcp/46386/p2p/16Uiu2HAkwkwnXTNjMYaLepAsNyA52uMhWZtvw11QE7b92Rf1NAvg"]'
2026-03-18 04:54:04.447 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:54:04.448 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21828/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-18 04:54:04.452 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-18 04:54:04.453 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-18 04:54:05.453 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-18 04:54:05.454 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21989/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:54:05.457 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xee31b9b3801b86e1c50b63e681ad978c4250769b60a4fd5c28ca32b8cbb35b01"},{"messageHash":"0xc1ddc6148783144ef934e0b25e927c71c63bde80c4f70fca108f3e5e8d9547a3"},{"messageHash":"0x198aef572829873f4319b358d808348a84f5e66ac175a6e274620cf82dde0515"},{"messageHash":"0x30d47badc351d1c1f628cb1479e42e024fd6155e587d4f8cc9919d380de2544b"},{"messageHash":"0x9e213d3d76a5f6b0149896d26791dad55255991714a4acf8aa670b2137679bb4"},{"messageHash":"0xf7051097b714324e92296b320bd985a50e144f00a69f886de4f352fa9e5ae3af"},{"messageHash":"0xad97ac8018eb34f8567fcff162a201deb707d17ccdddb1637fb98b59b449ff35"},{"messageHash":"0x29c089347d3c09f8565712e67db4b093b0c012138c39ec425e491fa483a10fb3"},{"messageHash":"0x552a91c718e0fe4d3f29ebfbaf48fc749abce2e5ad9608bf1d372fd7d045d12a"},{"messageHash":"0x4c8aaac30707caf9ee3151cb2f39261ceb97034b4c3a2ffe78b5df3d62e52701"}]}'
2026-03-18 04:54:05.457 DEBUG [src.steps.store] messages length is 10
2026-03-18 04:54:05.459 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-18 04:54:05.459 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46385/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:54:05.462 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xee31b9b3801b86e1c50b63e681ad978c4250769b60a4fd5c28ca32b8cbb35b01"},{"messageHash":"0xc1ddc6148783144ef934e0b25e927c71c63bde80c4f70fca108f3e5e8d9547a3"},{"messageHash":"0x198aef572829873f4319b358d808348a84f5e66ac175a6e274620cf82dde0515"},{"messageHash":"0x30d47badc351d1c1f628cb1479e42e024fd6155e587d4f8cc9919d380de2544b"},{"messageHash":"0x9e213d3d76a5f6b0149896d26791dad55255991714a4acf8aa670b2137679bb4"},{"messageHash":"0xf7051097b714324e92296b320bd985a50e144f00a69f886de4f352fa9e5ae3af"},{"messageHash":"0xad97ac8018eb34f8567fcff162a201deb707d17ccdddb1637fb98b59b449ff35"},{"messageHash":"0x29c089347d3c09f8565712e67db4b093b0c012138c39ec425e491fa483a10fb3"},{"messageHash":"0x552a91c718e0fe4d3f29ebfbaf48fc749abce2e5ad9608bf1d372fd7d045d12a"},{"messageHash":"0x4c8aaac30707caf9ee3151cb2f39261ceb97034b4c3a2ffe78b5df3d62e52701"}]}'
2026-03-18 04:54:05.462 DEBUG [src.steps.store] messages length is 10
2026-03-18 04:54:05.463 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-03-18 04:54:05.464 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21828/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-18 04:54:05.472 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"5380c8ac3c638d362fa4","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0xee31b9b3801b86e1c50b63e681ad978c4250769b60a4fd5c28ca32b8cbb35b01"},{"messageHash":"0xc1ddc6148783144ef934e0b25e927c71c63bde80c4f70fca108f3e5e8d9547a3"},{"messageHash":"0x198aef572829873f4319b358d808348a84f5e66ac175a6e274620cf82dde0515"},{"messageHash":"0x30d47badc351d1c1f628cb1479e42e024fd6155e587d4f8cc9919d380de2544b"},{"messageHash":"0x9e213d3d76a5f6b0149896d26791dad55255991714a4acf8aa670b2137679bb4"},{"messageHash":"0xf7051097b714324e92296b320bd985a50e144f00a69f886de4f352fa9e5ae3af"},{"messageHash":"0xad97ac8018eb34f8567fcff162a201deb707d17ccdddb1637fb98b59b449ff35"},{"messageHash":"0x29c089347d3c09f8565712e67db4b093b0c012138c39ec425e491fa483a10fb3"},{"messageHash":"0x552a91c718e0fe4d3f29ebfbaf48fc749abce2e5ad9608bf1d372fd7d045d12a"},{"messageHash":"0x4c8aaac30707caf9ee3151cb2f39261ceb97034b4c3a2ffe78b5df3d62e52701"}]}'
2026-03-18 04:54:05.472 DEBUG [src.steps.store] messages length is 10
2026-03-18 04:54:05.474 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-18 04:54:05.476 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-18 04:54:05.476 DEBUG [src.node.waku_node] Stopping container with id fec67e533b9f
2026-03-18 04:54:06.063 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 04:54:06.064 DEBUG [src.node.waku_node] Stopping container with id 3a26976ed781
2026-03-18 04:54:06.651 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 04:54:06.654 DEBUG [src.node.waku_node] Stopping container with id b8cca6b98b96
2026-03-18 04:54:06.875 ERROR [src.node.docker_mananger] Max retries reached for container fec67e533b9f. Exiting log stream.
2026-03-18 04:54:07.251 DEBUG [src.node.waku_node] Container stopped.
2026-03-18 04:54:07.252 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-18 04:54:07.260 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-18 04:54:07.272 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-18 04:54:07.279 DEBUG [src.node.docker_mananger] No errors found in the waku logs.