203 lines
38 KiB
Plaintext
Raw Blame History

This file contains invisible Unicode characters

This file contains invisible Unicode characters that are indistinguishable to humans but may be processed differently by a computer. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

DEBUG  tests.conftest:conftest.py:51 Running fixture setup: test_id
DEBUG  tests.conftest:conftest.py:57 Running test: test_relay_get_message_after_one_peer_was_stopped with id: 2026-02-07_04-31-11__08fb0f5f-f6dd-45bb-8db0-5506408d5ad4
DEBUG  src.steps.common:common.py:19 Running fixture setup: common_setup
DEBUG  src.steps.relay:relay.py:28 Running fixture setup: relay_setup
DEBUG  src.steps.relay:relay.py:34 Running fixture setup: setup_main_relay_nodes
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node1_2026-02-07_04-31-11__08fb0f5f-f6dd-45bb-8db0-5506408d5ad4__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.56.233
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['49570', '49571', '49572', '49573', '49574']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 49570:49570 -p 49571:49571 -p 49572:49572 -p 49573:49573 -p 49574:49574 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=49572 --rest-port=49570 --tcp-port=49571 --discv5-udp-port=49573 --rest-address=0.0.0.0 --nat=extip:172.18.56.233 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=aab3e4978af726bd24bf02dbf0bfb3a1badcbfd9b4cb8fb1af0b71dc35c0db1d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=49574 --metrics-logging=true --relay=true
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.56.233 waku 220eac323419ae2ce4a7dbf05e099b80ec0ae3dba5af7be3661cbc5dbc5f9f73
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 220eac323419. Setting up logs at ./log/docker/node1_2026-02-07_04-31-11__08fb0f5f-f6dd-45bb-8db0-5506408d5ad4__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 49570
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container c8e22732664f. Exiting log stream.
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 5a2fd636ab75. Exiting log stream.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:49570/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:49570/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.56.233/tcp/49571/p2p/16Uiu2HAm3cYFo6o2ZVAMf35BYUAxdgmVNnkyqP8CpvMfjum5mBYr","/ip4/172.18.56.233/tcp/49572/ws/p2p/16Uiu2HAm3cYFo6o2ZVAMf35BYUAxdgmVNnkyqP8CpvMfjum5mBYr"],"enrUri":"enr:-L24QFjlF-IyadeZcPDEfNIZw_keVQafs4HvkVU9xeHlnAWnGdfYySReoBiN_gHJd0EYJEewvrBxaFicKlnvdEQyxDECgmlkgnY0gmlwhKwSOOmKbXVsdGlhZGRyc5YACASsEjjpBsGjAAoErBI46QbBpN0DgnJzhQADAQAAiXNlY3AyNTZrMaECeaYmkHB6cy1ShBSxi6zhpZwX3baW7MFi5bqlfsyufT-DdGNwgsGjg3VkcILBpYV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node2_2026-02-07_04-31-11__08fb0f5f-f6dd-45bb-8db0-5506408d5ad4__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.179.243
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['64719', '64720', '64721', '64722', '64723']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 64719:64719 -p 64720:64720 -p 64721:64721 -p 64722:64722 -p 64723:64723 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=64721 --rest-port=64719 --tcp-port=64720 --discv5-udp-port=64722 --rest-address=0.0.0.0 --nat=extip:172.18.179.243 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a8685e30c0cea3f1fa0929eca3a1b3d7cbdeb2f1abac7cbb07a96bb0fcdb666d --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=64723 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFjlF-IyadeZcPDEfNIZw_keVQafs4HvkVU9xeHlnAWnGdfYySReoBiN_gHJd0EYJEewvrBxaFicKlnvdEQyxDECgmlkgnY0gmlwhKwSOOmKbXVsdGlhZGRyc5YACASsEjjpBsGjAAoErBI46QbBpN0DgnJzhQADAQAAiXNlY3AyNTZrMaECeaYmkHB6cy1ShBSxi6zhpZwX3baW7MFi5bqlfsyufT-DdGNwgsGjg3VkcILBpYV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.179.243 waku b8b849f02971d4ad34422f6caab140ceae2b4df2398d2e7409bdb50521771433
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID b8b849f02971. Setting up logs at ./log/docker/node2_2026-02-07_04-31-11__08fb0f5f-f6dd-45bb-8db0-5506408d5ad4__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 64719
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:64719/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:64719/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.179.243/tcp/64720/p2p/16Uiu2HAmGwwmiPitMeH7J8XFT6ahdtDrDhFURbLJQj39wLXEuGSn","/ip4/172.18.179.243/tcp/64721/ws/p2p/16Uiu2HAmGwwmiPitMeH7J8XFT6ahdtDrDhFURbLJQj39wLXEuGSn"],"enrUri":"enr:-L24QAUO4BydAgpNBfx_TASU1AdoQ62k1GrCBNpwAu2Yv2G3JqNTE4WScpw9yjq58Feac_rYjx8yxkJK5VwnuhYAJFACgmlkgnY0gmlwhKwSs_OKbXVsdGlhZGRyc5YACASsErPzBvzQAAoErBKz8wb80d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDP8a0m-ITp-3VzDVjNrz5WPAHTFuiVfozZA6uV7W7Z2ODdGNwgvzQg3VkcIL80oV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:64719/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.56.233/tcp/49571/p2p/16Uiu2HAm3cYFo6o2ZVAMf35BYUAxdgmVNnkyqP8CpvMfjum5mBYr"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.steps.relay:relay.py:46 Running fixture setup: setup_optional_relay_nodes
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node3_2026-02-07_04-31-11__08fb0f5f-f6dd-45bb-8db0-5506408d5ad4__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.99.152
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['44121', '44122', '44123', '44124', '44125']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 44121:44121 -p 44122:44122 -p 44123:44123 -p 44124:44124 -p 44125:44125 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=44123 --rest-port=44121 --tcp-port=44122 --discv5-udp-port=44124 --rest-address=0.0.0.0 --nat=extip:172.18.99.152 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=db9e7b06157cdca837aecadb3fe57134f1b3ebdcdfff73e69512b4dca542b80c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=44125 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFjlF-IyadeZcPDEfNIZw_keVQafs4HvkVU9xeHlnAWnGdfYySReoBiN_gHJd0EYJEewvrBxaFicKlnvdEQyxDECgmlkgnY0gmlwhKwSOOmKbXVsdGlhZGRyc5YACASsEjjpBsGjAAoErBI46QbBpN0DgnJzhQADAQAAiXNlY3AyNTZrMaECeaYmkHB6cy1ShBSxi6zhpZwX3baW7MFi5bqlfsyufT-DdGNwgsGjg3VkcILBpYV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.99.152 waku 53443c4bc746c2f160da6615bc054035909f11a6b4c91e4df0b63198c98c5e67
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 53443c4bc746. Setting up logs at ./log/docker/node3_2026-02-07_04-31-11__08fb0f5f-f6dd-45bb-8db0-5506408d5ad4__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 44121
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:44121/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:44121/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.99.152/tcp/44122/p2p/16Uiu2HAmHmARHW1rMH6w1KpXQJg6PtSRgtxbCMEBVsVLTTS8mKGv","/ip4/172.18.99.152/tcp/44123/ws/p2p/16Uiu2HAmHmARHW1rMH6w1KpXQJg6PtSRgtxbCMEBVsVLTTS8mKGv"],"enrUri":"enr:-L24QG8KeSNLa93HzeFJe4uYYOx1KbTr2m6o35BXBUyFZNinTeFhKwh8iPSqbbTO9qgyKx1kwP0Iu22Jz1Nid0WWOykCgmlkgnY0gmlwhKwSY5iKbXVsdGlhZGRyc5YACASsEmOYBqxaAAoErBJjmAasW90DgnJzhQADAQAAiXNlY3AyNTZrMaEDS99N7f0_IifT0dA6XXc8MSAbu3-aZp581jb9wCbsDZODdGNwgqxag3VkcIKsXIV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:44121/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.56.233/tcp/49571/p2p/16Uiu2HAm3cYFo6o2ZVAMf35BYUAxdgmVNnkyqP8CpvMfjum5mBYr"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node4_2026-02-07_04-31-11__08fb0f5f-f6dd-45bb-8db0-5506408d5ad4__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.49.241
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['4993', '4994', '4995', '4996', '4997']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 4993:4993 -p 4994:4994 -p 4995:4995 -p 4996:4996 -p 4997:4997 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=4995 --rest-port=4993 --tcp-port=4994 --discv5-udp-port=4996 --rest-address=0.0.0.0 --nat=extip:172.18.49.241 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=eb54f1fb889f34cfcfb7d81ba9add9ea6dcdadeb3bafe93d1a2edec09eb3e479 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=4997 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFjlF-IyadeZcPDEfNIZw_keVQafs4HvkVU9xeHlnAWnGdfYySReoBiN_gHJd0EYJEewvrBxaFicKlnvdEQyxDECgmlkgnY0gmlwhKwSOOmKbXVsdGlhZGRyc5YACASsEjjpBsGjAAoErBI46QbBpN0DgnJzhQADAQAAiXNlY3AyNTZrMaECeaYmkHB6cy1ShBSxi6zhpZwX3baW7MFi5bqlfsyufT-DdGNwgsGjg3VkcILBpYV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.49.241 waku a1e76ef1508d651c3bc96f1aa50757265ae8d31a0a7f626a44bab750153d3f4f
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID a1e76ef1508d. Setting up logs at ./log/docker/node4_2026-02-07_04-31-11__08fb0f5f-f6dd-45bb-8db0-5506408d5ad4__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 4993
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4993/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4993/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.49.241/tcp/4994/p2p/16Uiu2HAmBAdxEfBicAFbYHqLmWQxfoE69V95GV1AZrsvvReafobi","/ip4/172.18.49.241/tcp/4995/ws/p2p/16Uiu2HAmBAdxEfBicAFbYHqLmWQxfoE69V95GV1AZrsvvReafobi"],"enrUri":"enr:-L24QPCrMuWnMNkJ-JaTKitkGnQD-tNFOwtc52y35VmvpwaDfK8q1ActZPeOHVz34UgYR44m9J6_XtqYpU3i7Uw7XIECgmlkgnY0gmlwhKwSMfGKbXVsdGlhZGRyc5YACASsEjHxBhOCAAoErBIx8QYTg90DgnJzhQADAQAAiXNlY3AyNTZrMaEC6eD8ptShLhegi3hV9XMV5_h_8qTcevElNUPxrPF6FPWDdGNwghOCg3VkcIIThIV3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:4993/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.56.233/tcp/49571/p2p/16Uiu2HAm3cYFo6o2ZVAMf35BYUAxdgmVNnkyqP8CpvMfjum5mBYr"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.node.docker_mananger:docker_mananger.py:19 Docker client initialized with image wakuorg/nwaku:latest
DEBUG  src.node.waku_node:waku_node.py:86 WakuNode instance initialized with log path ./log/docker/node5_2026-02-07_04-31-11__08fb0f5f-f6dd-45bb-8db0-5506408d5ad4__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:90 Starting Node...
DEBUG  src.node.docker_mananger:docker_mananger.py:22 Attempting to create or retrieve network waku
DEBUG  src.node.docker_mananger:docker_mananger.py:25 Network waku already exists
DEBUG  src.node.docker_mananger:docker_mananger.py:108 Generated random external IP 172.18.18.118
DEBUG  src.node.docker_mananger:docker_mananger.py:101 Generated ports ['17596', '17597', '17598', '17599', '17600']
DEBUG  src.node.waku_node:waku_node.py:439 RLN credentials were not set
INFO  src.node.waku_node:waku_node.py:176 RLN credentials not set or credential store not available, starting without RLN
DEBUG  src.node.waku_node:waku_node.py:178 Using volumes []
DEBUG  src.node.docker_mananger:docker_mananger.py:49 docker run -i -t -p 17596:17596 -p 17597:17597 -p 17598:17598 -p 17599:17599 -p 17600:17600 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=17598 --rest-port=17596 --tcp-port=17597 --discv5-udp-port=17599 --rest-address=0.0.0.0 --nat=extip:172.18.18.118 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=36f3ccede5ff6ca9cacbf19776f0a81c5fb5d09ed9fe9dea37ae5dbdc6b44d0a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=17600 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFjlF-IyadeZcPDEfNIZw_keVQafs4HvkVU9xeHlnAWnGdfYySReoBiN_gHJd0EYJEewvrBxaFicKlnvdEQyxDECgmlkgnY0gmlwhKwSOOmKbXVsdGlhZGRyc5YACASsEjjpBsGjAAoErBI46QbBpN0DgnJzhQADAQAAiXNlY3AyNTZrMaECeaYmkHB6cy1ShBSxi6zhpZwX3baW7MFi5bqlfsyufT-DdGNwgsGjg3VkcILBpYV3YWt1MgE
DEBUG  src.node.docker_mananger:docker_mananger.py:55 docker network connect --ip 172.18.18.118 waku 67100546350cf8f3b5555b0d13cb647b019ae498fb1e7d5f50b27c767a871f20
DEBUG  src.node.docker_mananger:docker_mananger.py:58 Container started with ID 67100546350c. Setting up logs at ./log/docker/node5_2026-02-07_04-31-11__08fb0f5f-f6dd-45bb-8db0-5506408d5ad4__wakuorg_nwaku:latest.log
DEBUG  src.node.waku_node:waku_node.py:190 Started container from image wakuorg/nwaku:latest. REST: 17596
DEBUG  src.libs.common:common.py:47 Sleeping for 1 seconds
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:17596/health" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
INFO  src.node.waku_node:waku_node.py:287 Node protocols are initialized !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:17596/debug/v1/info" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.18.118/tcp/17597/p2p/16Uiu2HAmQ6QSrsxsY2GDAgftMYCvrzrioNui4b1mds8Ej91nM6pf","/ip4/172.18.18.118/tcp/17598/ws/p2p/16Uiu2HAmQ6QSrsxsY2GDAgftMYCvrzrioNui4b1mds8Ej91nM6pf"],"enrUri":"enr:-L24QOCvFLnPyEr7fksz9r7NFBC9v71SpjUR6o4YcHHupHaJEmJVIJGNhYCmnNhpqvXcp9JLxNj8gGj8yPtlW4Lo5rACgmlkgnY0gmlwhKwSEnaKbXVsdGlhZGRyc5YACASsEhJ2BkS9AAoErBISdgZEvt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDqfNSaIrWsjuw9VUZCAo3nQ8w_-u7YqYOamksqe4EWXCDdGNwgkS9g3VkcIJEv4V3YWt1MgE"}'
INFO  src.node.waku_node:waku_node.py:292 REST service is ready !!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:17596/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.56.233/tcp/49571/p2p/16Uiu2HAm3cYFo6o2ZVAMf35BYUAxdgmVNnkyqP8CpvMfjum5mBYr"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.steps.relay:relay.py:59 Running fixture setup: subscribe_main_relay_nodes
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:49570/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:64719/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.steps.relay:relay.py:64 Running fixture setup: subscribe_optional_relay_nodes
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:44121/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:4993/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:17596/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:49570/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.relay:relay.py:123 Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:49570/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1770438677831114752,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.relay:relay.py:123 Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:64719/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1770438677831114752,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.relay:relay.py:123 Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:44121/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1770438677831114752,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.relay:relay.py:123 Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4993/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1770438677831114752,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.relay:relay.py:123 Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:17596/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1770438677831114752,"ephemeral":false,"proof":""}]'
INFO  src.steps.relay:relay.py:71 WARM UP successful!!
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:49570/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.relay:relay.py:123 Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:49570/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1770438677958680443,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.relay:relay.py:123 Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:64719/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1770438677958680443,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.relay:relay.py:123 Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:44121/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1770438677958680443,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.relay:relay.py:123 Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4993/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1770438677958680443,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.relay:relay.py:123 Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:17596/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1770438677958680443,"ephemeral":false,"proof":""}]'
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id b8b849f02971
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X POST "http://127.0.0.1:49570/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'OK'
DEBUG  src.libs.common:common.py:47 Sleeping for 0.1 seconds
DEBUG  src.steps.relay:relay.py:123 Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:44121/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1770438678561575936,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.relay:relay.py:123 Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:4993/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1770438678561575936,"ephemeral":false,"proof":""}]'
DEBUG  src.steps.relay:relay.py:123 Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
INFO  src.node.api_clients.base_client:base_client.py:37 curl -v -X GET "http://127.0.0.1:17596/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
INFO  src.node.api_clients.base_client:base_client.py:22 Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1770438678561575936,"ephemeral":false,"proof":""}]'
DEBUG  tests.conftest:conftest.py:59 Running fixture teardown: test_setup
DEBUG  tests.conftest:conftest.py:83 Running fixture teardown: close_open_nodes
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 220eac323419
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 53443c4bc746
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container b8b849f02971. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id a1e76ef1508d
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 220eac323419. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  src.node.waku_node:waku_node.py:234 Stopping container with id 67100546350c
ERROR  src.node.docker_mananger:docker_mananger.py:89 Max retries reached for container 53443c4bc746. Exiting log stream.
DEBUG  src.node.waku_node:waku_node.py:241 Container stopped.
DEBUG  tests.conftest:conftest.py:98 Running fixture teardown: check_waku_log_errors
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.
DEBUG  src.node.docker_mananger:docker_mananger.py:144 No errors found in the waku logs.