2026-02-25 07:41:35 +00:00

225 lines
44 KiB
Plaintext

2026-02-25 07:22:45.645 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-25 07:22:45.645 DEBUG [tests.conftest] Running test: test_filter_3_senders_multiple_msg_1_receiver with id: 2026-02-25_07-22-45__928a67ea-cb64-4b2b-8472-cf59ea135cab
2026-02-25 07:22:45.646 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-25 07:22:45.646 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-02-25 07:22:45.646 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-02-25 07:22:45.653 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 07:22:45.653 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-25_07-22-45__928a67ea-cb64-4b2b-8472-cf59ea135cab__wakuorg_nwaku:latest.log
2026-02-25 07:22:45.658 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 07:22:45.658 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-25_07-22-45__928a67ea-cb64-4b2b-8472-cf59ea135cab__wakuorg_nwaku:latest.log
2026-02-25 07:22:45.664 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 07:22:45.664 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-25_07-22-45__928a67ea-cb64-4b2b-8472-cf59ea135cab__wakuorg_nwaku:latest.log
2026-02-25 07:22:45.665 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-25 07:22:45.665 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-02-25 07:22:45.671 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 07:22:45.671 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-02-25_07-22-45__928a67ea-cb64-4b2b-8472-cf59ea135cab__wakuorg_nwaku:latest.log
2026-02-25 07:22:45.676 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 07:22:45.677 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-02-25_07-22-45__928a67ea-cb64-4b2b-8472-cf59ea135cab__wakuorg_nwaku:latest.log
2026-02-25 07:22:45.677 DEBUG [tests.e2e.test_e2e] Start 5 nodes
2026-02-25 07:22:45.677 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 07:22:45.677 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 07:22:45.678 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 07:22:45.678 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.54.163
2026-02-25 07:22:45.679 DEBUG [src.node.docker_mananger] Generated ports ['65492', '65493', '65494', '65495', '65496']
2026-02-25 07:22:45.679 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 07:22:45.679 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 07:22:45.679 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 07:22:45.679 DEBUG [src.node.docker_mananger] docker run -i -t -p 65492:65492 -p 65493:65493 -p 65494:65494 -p 65495:65495 -p 65496:65496 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=65494 --rest-port=65492 --tcp-port=65493 --discv5-udp-port=65495 --rest-address=0.0.0.0 --nat=extip:172.18.54.163 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dcc07aab4fe893fe49ad5b57f04a5c41ad3b5158d646e25bab1c1ce2c6bf46c6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=65496 --metrics-logging=true --relay=true --store=false
2026-02-25 07:22:45.861 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.54.163 waku 6b02d4cdf6d0aa28e3bbbb76fe9eb1ad36cc1f4983ffbaf49a474372a8f02e55
2026-02-25 07:22:45.896 DEBUG [src.node.docker_mananger] Container started with ID 6b02d4cdf6d0. Setting up logs at ./log/docker/node1_2026-02-25_07-22-45__928a67ea-cb64-4b2b-8472-cf59ea135cab__wakuorg_nwaku:latest.log
2026-02-25 07:22:45.896 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 65492
2026-02-25 07:22:45.896 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 07:22:45.922 ERROR [src.node.docker_mananger] Max retries reached for container c0acfacc04de. Exiting log stream.
2026-02-25 07:22:46.395 ERROR [src.node.docker_mananger] Max retries reached for container c2690a3f868b. Exiting log stream.
2026-02-25 07:22:46.897 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:65492/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:22:46.900 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 07:22:46.900 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 07:22:46.900 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:65492/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:22:46.902 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.54.163/tcp/65493/p2p/16Uiu2HAmKirbw1yYxHYgcPW22R2ss8YRai4BZrZbbvMULnT31oGr","/ip4/172.18.54.163/tcp/65494/ws/p2p/16Uiu2HAmKirbw1yYxHYgcPW22R2ss8YRai4BZrZbbvMULnT31oGr"],"enrUri":"enr:-L24QNcFWzOXHhIjYYglxUqm_csq1lGPceZ4lk_7B1HEgI2yDWkqNPu1ps85Rep-owOK_qfvb_aLtXQ7XohcghYwqc4CgmlkgnY0gmlwhKwSNqOKbXVsdGlhZGRyc5YACASsEjajBv_VAAoErBI2owb_1t0DgnJzhQADAQAAiXNlY3AyNTZrMaEDaP9fHVQLOE2X-c8--XkWfmCI4ioN4X48WSYxM3jTtC-DdGNwgv_Vg3VkcIL_14V3YWt1MgE"}'
2026-02-25 07:22:46.903 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 07:22:46.903 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 07:22:46.903 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 07:22:46.904 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 07:22:46.905 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.5.194
2026-02-25 07:22:46.905 DEBUG [src.node.docker_mananger] Generated ports ['31862', '31863', '31864', '31865', '31866']
2026-02-25 07:22:46.905 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 07:22:46.905 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 07:22:46.905 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 07:22:46.905 DEBUG [src.node.docker_mananger] docker run -i -t -p 31862:31862 -p 31863:31863 -p 31864:31864 -p 31865:31865 -p 31866:31866 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=31864 --rest-port=31862 --tcp-port=31863 --discv5-udp-port=31865 --rest-address=0.0.0.0 --nat=extip:172.18.5.194 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c4ff04ff3c0c907d0f74dc6b7150bf1aad525d1379c1dfcc31fe5160b30c3e0e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=31866 --metrics-logging=true --relay=true --store=false --discv5-bootstrap-node=enr:-L24QNcFWzOXHhIjYYglxUqm_csq1lGPceZ4lk_7B1HEgI2yDWkqNPu1ps85Rep-owOK_qfvb_aLtXQ7XohcghYwqc4CgmlkgnY0gmlwhKwSNqOKbXVsdGlhZGRyc5YACASsEjajBv_VAAoErBI2owb_1t0DgnJzhQADAQAAiXNlY3AyNTZrMaEDaP9fHVQLOE2X-c8--XkWfmCI4ioN4X48WSYxM3jTtC-DdGNwgv_Vg3VkcIL_14V3YWt1MgE
2026-02-25 07:22:47.098 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.5.194 waku 8a7ef03e37efa321fdb19e7582f9e3086607c9fe1f839f03a964f9521246fc4e
2026-02-25 07:22:47.130 DEBUG [src.node.docker_mananger] Container started with ID 8a7ef03e37ef. Setting up logs at ./log/docker/node2_2026-02-25_07-22-45__928a67ea-cb64-4b2b-8472-cf59ea135cab__wakuorg_nwaku:latest.log
2026-02-25 07:22:47.130 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 31862
2026-02-25 07:22:47.130 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 07:22:48.132 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31862/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:22:48.156 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 07:22:48.159 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 07:22:48.160 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31862/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:22:48.163 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.5.194/tcp/31863/p2p/16Uiu2HAmGGVJHBQu36sqcfGPSDze5fEmwGd7Th68Ejxo8QuyEEKe","/ip4/172.18.5.194/tcp/31864/ws/p2p/16Uiu2HAmGGVJHBQu36sqcfGPSDze5fEmwGd7Th68Ejxo8QuyEEKe"],"enrUri":"enr:-L24QAcVZAFLI7zhf6ja9KZlbM10mTllaOwrCL-u3Vz8OVL8fuR0plwbwRDmxKzFm3aXUand8YCqH3MH0JNW7x7C2pACgmlkgnY0gmlwhKwSBcKKbXVsdGlhZGRyc5YACASsEgXCBnx3AAoErBIFwgZ8eN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDNase7gif_wv5-WuAxYiCEef1T9gvWzg7taOKmtXx4FWDdGNwgnx3g3VkcIJ8eYV3YWt1MgE"}'
2026-02-25 07:22:48.163 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 07:22:48.163 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 07:22:48.163 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 07:22:48.165 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 07:22:48.165 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.19.225
2026-02-25 07:22:48.165 DEBUG [src.node.docker_mananger] Generated ports ['54011', '54012', '54013', '54014', '54015']
2026-02-25 07:22:48.165 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 07:22:48.166 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 07:22:48.166 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 07:22:48.166 DEBUG [src.node.docker_mananger] docker run -i -t -p 54011:54011 -p 54012:54012 -p 54013:54013 -p 54014:54014 -p 54015:54015 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=54013 --rest-port=54011 --tcp-port=54012 --discv5-udp-port=54014 --rest-address=0.0.0.0 --nat=extip:172.18.19.225 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=6c393ede4adfd9dfbadcf5ccdf5461eff5cdda6e4fd129f5c7c0f61f279fce36 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=54015 --metrics-logging=true --relay=true --store=false --filter=true --discv5-bootstrap-node=enr:-L24QAcVZAFLI7zhf6ja9KZlbM10mTllaOwrCL-u3Vz8OVL8fuR0plwbwRDmxKzFm3aXUand8YCqH3MH0JNW7x7C2pACgmlkgnY0gmlwhKwSBcKKbXVsdGlhZGRyc5YACASsEgXCBnx3AAoErBIFwgZ8eN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDNase7gif_wv5-WuAxYiCEef1T9gvWzg7taOKmtXx4FWDdGNwgnx3g3VkcIJ8eYV3YWt1MgE
2026-02-25 07:22:48.365 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.19.225 waku 1a1a537bf0c4c4cbd37f754bca19e5ff00a38e26660bade24fa6468e0e68c36e
2026-02-25 07:22:48.395 DEBUG [src.node.docker_mananger] Container started with ID 1a1a537bf0c4. Setting up logs at ./log/docker/node3_2026-02-25_07-22-45__928a67ea-cb64-4b2b-8472-cf59ea135cab__wakuorg_nwaku:latest.log
2026-02-25 07:22:48.396 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 54011
2026-02-25 07:22:48.396 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 07:22:49.396 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54011/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:22:49.414 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 07:22:49.418 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 07:22:49.419 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54011/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:22:49.421 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.19.225/tcp/54012/p2p/16Uiu2HAkzvaoTfEwJqokotiEXCq8bFrnSb6RqkMNjcgjytVPKqhV","/ip4/172.18.19.225/tcp/54013/ws/p2p/16Uiu2HAkzvaoTfEwJqokotiEXCq8bFrnSb6RqkMNjcgjytVPKqhV"],"enrUri":"enr:-L24QP_7Wy4cdln8l_ZbQwqcZFb3ZYvUPqzCij7L1CeH6fYtCEVDjidUk-sbJiUfxeUaPStgz3EIdFXADiStc5bjYoYCgmlkgnY0gmlwhKwSE-GKbXVsdGlhZGRyc5YACASsEhPhBtL8AAoErBIT4QbS_d0DgnJzhQADAQAAiXNlY3AyNTZrMaECUbJsUpUCiiG3gYaQ01jWIb2IT8VLlH5nbCzdGjKsSlyDdGNwgtL8g3VkcILS_oV3YWt1MgU"}'
2026-02-25 07:22:49.421 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 07:22:49.421 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 07:22:49.421 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 07:22:49.423 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 07:22:49.423 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.54.157
2026-02-25 07:22:49.423 DEBUG [src.node.docker_mananger] Generated ports ['3042', '3043', '3044', '3045', '3046']
2026-02-25 07:22:49.423 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 07:22:49.423 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 07:22:49.423 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 07:22:49.424 DEBUG [src.node.docker_mananger] docker run -i -t -p 3042:3042 -p 3043:3043 -p 3044:3044 -p 3045:3045 -p 3046:3046 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3044 --rest-port=3042 --tcp-port=3043 --discv5-udp-port=3045 --rest-address=0.0.0.0 --nat=extip:172.18.54.157 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a0095b5b5b7b7564de7ed9d629e8e6e5f22fe40559b2c1f46c67b91158cfe7ee --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3046 --metrics-logging=true --relay=true --filter=true --store=false --discv5-bootstrap-node=enr:-L24QP_7Wy4cdln8l_ZbQwqcZFb3ZYvUPqzCij7L1CeH6fYtCEVDjidUk-sbJiUfxeUaPStgz3EIdFXADiStc5bjYoYCgmlkgnY0gmlwhKwSE-GKbXVsdGlhZGRyc5YACASsEhPhBtL8AAoErBIT4QbS_d0DgnJzhQADAQAAiXNlY3AyNTZrMaECUbJsUpUCiiG3gYaQ01jWIb2IT8VLlH5nbCzdGjKsSlyDdGNwgtL8g3VkcILS_oV3YWt1MgU
2026-02-25 07:22:49.619 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.54.157 waku d154797a5b0ed1c6b2ebe98b68b6a1fd974632be386e8d36aeea974d3cc98111
2026-02-25 07:22:49.652 DEBUG [src.node.docker_mananger] Container started with ID d154797a5b0e. Setting up logs at ./log/docker/node4_2026-02-25_07-22-45__928a67ea-cb64-4b2b-8472-cf59ea135cab__wakuorg_nwaku:latest.log
2026-02-25 07:22:49.652 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 3042
2026-02-25 07:22:49.652 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 07:22:50.653 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3042/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:22:50.668 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 07:22:50.671 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 07:22:50.671 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3042/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:22:50.675 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.54.157/tcp/3043/p2p/16Uiu2HAkvaoixu8vAWQHxjBRVkafHRzGshwkBf5QkkbdkNn4VyBm","/ip4/172.18.54.157/tcp/3044/ws/p2p/16Uiu2HAkvaoixu8vAWQHxjBRVkafHRzGshwkBf5QkkbdkNn4VyBm"],"enrUri":"enr:-L24QEzOBIbP9RFQElkzwZlmYtise5KWlaTnSg0QKx4P8dk2OD9buU7hWaW-n2zAv8GIiaWvlMxL44ku65IgPZiLZxICgmlkgnY0gmlwhKwSNp2KbXVsdGlhZGRyc5YACASsEjadBgvjAAoErBI2nQYL5N0DgnJzhQADAQAAiXNlY3AyNTZrMaECETKrti3RSb-cOwh9guaja_DxQBFTQN2uVvxvUskYBcCDdGNwggvjg3VkcIIL5YV3YWt1MgU"}'
2026-02-25 07:22:50.676 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 07:22:50.676 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 07:22:50.677 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 07:22:50.678 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 07:22:50.678 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.60.40
2026-02-25 07:22:50.678 DEBUG [src.node.docker_mananger] Generated ports ['57544', '57545', '57546', '57547', '57548']
2026-02-25 07:22:50.679 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 07:22:50.679 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 07:22:50.679 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 07:22:50.679 DEBUG [src.node.docker_mananger] docker run -i -t -p 57544:57544 -p 57545:57545 -p 57546:57546 -p 57547:57547 -p 57548:57548 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=57546 --rest-port=57544 --tcp-port=57545 --discv5-udp-port=57547 --rest-address=0.0.0.0 --nat=extip:172.18.60.40 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=d17155bce7c07d1ad8e0a6d9facbb0bf02b3a67ebccb1bcff340bbb6b6e71349 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=57548 --metrics-logging=true --relay=false --filternode=/ip4/172.18.54.157/tcp/3043/p2p/16Uiu2HAkvaoixu8vAWQHxjBRVkafHRzGshwkBf5QkkbdkNn4VyBm --store=false --discv5-bootstrap-node=enr:-L24QP_7Wy4cdln8l_ZbQwqcZFb3ZYvUPqzCij7L1CeH6fYtCEVDjidUk-sbJiUfxeUaPStgz3EIdFXADiStc5bjYoYCgmlkgnY0gmlwhKwSE-GKbXVsdGlhZGRyc5YACASsEhPhBtL8AAoErBIT4QbS_d0DgnJzhQADAQAAiXNlY3AyNTZrMaECUbJsUpUCiiG3gYaQ01jWIb2IT8VLlH5nbCzdGjKsSlyDdGNwgtL8g3VkcILS_oV3YWt1MgU
2026-02-25 07:22:50.869 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.60.40 waku c72db37ac0b92ad41e297e4d72bbbb44e19387d0496a519609606f3b78a035ce
2026-02-25 07:22:50.903 DEBUG [src.node.docker_mananger] Container started with ID c72db37ac0b9. Setting up logs at ./log/docker/node5_2026-02-25_07-22-45__928a67ea-cb64-4b2b-8472-cf59ea135cab__wakuorg_nwaku:latest.log
2026-02-25 07:22:50.903 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 57544
2026-02-25 07:22:50.904 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 07:22:51.905 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57544/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:22:51.908 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 07:22:51.908 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 07:22:51.908 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57544/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:22:51.910 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.60.40/tcp/57545/p2p/16Uiu2HAkzKAHJWbFxCKG38xFjRBsyT2gagKBcMStZC3rmfLLsjnc","/ip4/172.18.60.40/tcp/57546/ws/p2p/16Uiu2HAkzKAHJWbFxCKG38xFjRBsyT2gagKBcMStZC3rmfLLsjnc"],"enrUri":"enr:-L24QJyDYEVb4R6F3OVhyGwNMky5zO_QvZXU4ffysHdQL4DIEfHBvkwXC8yuOaW8yYqOTxLigHifAl1o0lWpLwWaCWkCgmlkgnY0gmlwhKwSPCiKbXVsdGlhZGRyc5YACASsEjwoBuDJAAoErBI8KAbgyt0DgnJzhQADAQAAiXNlY3AyNTZrMaECSJ9euOosbxh___NUwQTucY1Wgv2Fqgry_Sq06WRx_Z2DdGNwguDJg3VkcILgy4V3YWt1MgA"}'
2026-02-25 07:22:51.911 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 07:22:51.911 DEBUG [tests.e2e.test_e2e] Subscribe nodes to relay pubsub topic /waku/2/rs/3/1
2026-02-25 07:22:51.911 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:65492/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 07:22:51.915 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:22:51.915 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31862/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 07:22:51.923 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:22:51.924 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54011/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 07:22:51.932 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:22:51.932 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3042/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 07:22:51.939 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:22:51.940 DEBUG [tests.e2e.test_e2e] Node5 makes filter request pubsubtopic /waku/2/rs/3/1 and content topic /test/1/waku-filter/proto
2026-02-25 07:22:51.940 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57544/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-25 07:22:51.984 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-02-25 07:22:51.985 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:65492/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:22:51.992 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.5.194/tcp/41930/p2p/16Uiu2HAmGGVJHBQu36sqcfGPSDze5fEmwGd7Th68Ejxo8QuyEEKe","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"}]'
2026-02-25 07:22:51.993 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:31862/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:22:51.998 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.54.163/tcp/65493/p2p/16Uiu2HAmKirbw1yYxHYgcPW22R2ss8YRai4BZrZbbvMULnT31oGr","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"Discv5"},{"multiaddr":"/ip4/172.18.19.225/tcp/43620/p2p/16Uiu2HAkzvaoTfEwJqokotiEXCq8bFrnSb6RqkMNjcgjytVPKqhV","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"}]'
2026-02-25 07:22:51.999 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54011/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:22:52.002 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.5.194/tcp/31863/p2p/16Uiu2HAmGGVJHBQu36sqcfGPSDze5fEmwGd7Th68Ejxo8QuyEEKe","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"Discv5"},{"multiaddr":"/ip4/172.18.54.157/tcp/36862/p2p/16Uiu2HAkvaoixu8vAWQHxjBRVkafHRzGshwkBf5QkkbdkNn4VyBm","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"}]'
2026-02-25 07:22:52.002 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3042/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:22:52.004 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.60.40/tcp/33246/p2p/16Uiu2HAkzKAHJWbFxCKG38xFjRBsyT2gagKBcMStZC3rmfLLsjnc","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.19.225/tcp/54012/p2p/16Uiu2HAkzvaoTfEwJqokotiEXCq8bFrnSb6RqkMNjcgjytVPKqhV","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"Discv5"}]'
2026-02-25 07:22:52.005 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57544/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:22:52.007 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.19.225/tcp/54012/p2p/16Uiu2HAkzvaoTfEwJqokotiEXCq8bFrnSb6RqkMNjcgjytVPKqhV","protocols":["/vac/waku/relay/2.0.0","/vac/waku/filter-subscribe/2.0.0-beta1"],"shards":[0],"connected":"NotConnected","agent":"","origin":"Discv5"},{"multiaddr":"/ip4/172.18.54.157/tcp/3043/p2p/16Uiu2HAkvaoixu8vAWQHxjBRVkafHRzGshwkBf5QkkbdkNn4VyBm","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0,1],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"}]'
2026-02-25 07:22:52.007 DEBUG [src.libs.common] Sleeping for 60 seconds
2026-02-25 07:23:52.008 DEBUG [tests.e2e.test_e2e] 3 Nodes publish 12 message
2026-02-25 07:23:52.008 DEBUG [src.steps.store] Relaying message
2026-02-25 07:23:52.008 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:65492/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:23:52.015 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:23:52.018 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 07:23:52.218 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 07:23:54.219 DEBUG [src.steps.store] Relaying message
2026-02-25 07:23:54.219 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:65492/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:23:54.225 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:23:54.225 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 07:23:54.426 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 07:23:56.426 DEBUG [src.steps.store] Relaying message
2026-02-25 07:23:56.427 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:65492/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:23:56.436 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:23:56.437 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 07:23:56.638 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 07:23:58.639 DEBUG [src.steps.store] Relaying message
2026-02-25 07:23:58.639 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:65492/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:23:58.647 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:23:58.648 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 07:23:58.852 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 07:24:00.853 DEBUG [src.steps.store] Relaying message
2026-02-25 07:24:00.853 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31862/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:24:00.859 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:24:00.862 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 07:24:01.064 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 07:24:03.064 DEBUG [src.steps.store] Relaying message
2026-02-25 07:24:03.065 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31862/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:24:03.071 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:24:03.073 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 07:24:03.277 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 07:24:05.278 DEBUG [src.steps.store] Relaying message
2026-02-25 07:24:05.278 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31862/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:24:05.285 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:24:05.285 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 07:24:05.485 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 07:24:07.486 DEBUG [src.steps.store] Relaying message
2026-02-25 07:24:07.486 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:31862/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:24:07.493 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:24:07.495 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 07:24:07.697 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 07:24:09.697 DEBUG [src.steps.store] Relaying message
2026-02-25 07:24:09.697 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54011/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:24:09.707 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:24:09.707 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 07:24:09.907 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 07:24:11.908 DEBUG [src.steps.store] Relaying message
2026-02-25 07:24:11.908 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54011/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:24:11.919 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:24:11.922 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 07:24:12.123 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 07:24:14.124 DEBUG [src.steps.store] Relaying message
2026-02-25 07:24:14.124 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54011/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:24:14.132 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:24:14.133 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 07:24:14.333 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 07:24:16.334 DEBUG [src.steps.store] Relaying message
2026-02-25 07:24:16.334 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54011/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 07:24:16.345 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 07:24:16.347 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 07:24:16.548 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 07:24:18.548 DEBUG [tests.e2e.test_e2e] Node5 requests messages of subscribed filter topic /waku/2/rs/3/1
2026-02-25 07:24:18.549 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57544/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-25 07:24:18.551 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772004232008527963,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772004234219149696,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772004236426818930,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772004238638840704,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772004240852925853,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772004243064592970,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772004245278403659,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772004247486152435,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772004249697460739,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772004251908160036,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772004254123896733,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772004256333957300,"ephemeral":false}]'
2026-02-25 07:24:18.552 DEBUG [tests.e2e.test_e2e] Response for node 5 is [{'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772004232008527963, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772004234219149696, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772004236426818930, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772004238638840704, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772004240852925853, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772004243064592970, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772004245278403659, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772004247486152435, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772004249697460739, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772004251908160036, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772004254123896733, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772004256333957300, 'ephemeral': False}]
2026-02-25 07:24:18.554 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-25 07:24:18.555 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-25 07:24:18.555 DEBUG [src.node.waku_node] Stopping container with id 6b02d4cdf6d0
2026-02-25 07:24:19.093 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 07:24:19.093 DEBUG [src.node.waku_node] Stopping container with id 8a7ef03e37ef
2026-02-25 07:24:19.675 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 07:24:19.676 DEBUG [src.node.waku_node] Stopping container with id 1a1a537bf0c4
2026-02-25 07:24:19.912 ERROR [src.node.docker_mananger] Max retries reached for container 6b02d4cdf6d0. Exiting log stream.
2026-02-25 07:24:20.222 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 07:24:20.222 DEBUG [src.node.waku_node] Stopping container with id d154797a5b0e
2026-02-25 07:24:20.732 ERROR [src.node.docker_mananger] Max retries reached for container 8a7ef03e37ef. Exiting log stream.
2026-02-25 07:24:21.242 ERROR [src.node.docker_mananger] Max retries reached for container 1a1a537bf0c4. Exiting log stream.
2026-02-25 07:24:30.752 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 07:24:30.754 DEBUG [src.node.waku_node] Stopping container with id c72db37ac0b9
2026-02-25 07:24:31.263 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 07:24:31.265 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-25 07:24:31.341 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 07:24:31.482 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 07:24:31.625 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 07:24:31.804 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 07:24:31.826 DEBUG [src.node.docker_mananger] No errors found in the waku logs.