225 lines
44 KiB
Plaintext

2026-03-21 04:31:32.884 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-21 04:31:32.885 DEBUG [tests.conftest] Running test: test_filter_3_senders_multiple_msg_1_receiver with id: 2026-03-21_04-31-32__e85a2620-32b0-4ad7-8595-1922b343e4e6
2026-03-21 04:31:32.885 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-21 04:31:32.885 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-21 04:31:32.885 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-21 04:31:32.892 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-21 04:31:32.892 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-21_04-31-32__e85a2620-32b0-4ad7-8595-1922b343e4e6__wakuorg_nwaku:latest.log
2026-03-21 04:31:32.898 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-21 04:31:32.898 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-21_04-31-32__e85a2620-32b0-4ad7-8595-1922b343e4e6__wakuorg_nwaku:latest.log
2026-03-21 04:31:32.905 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-21 04:31:32.905 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-21_04-31-32__e85a2620-32b0-4ad7-8595-1922b343e4e6__wakuorg_nwaku:latest.log
2026-03-21 04:31:32.905 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-21 04:31:32.906 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-21 04:31:32.912 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-21 04:31:32.912 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-21_04-31-32__e85a2620-32b0-4ad7-8595-1922b343e4e6__wakuorg_nwaku:latest.log
2026-03-21 04:31:32.918 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-21 04:31:32.918 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-21_04-31-32__e85a2620-32b0-4ad7-8595-1922b343e4e6__wakuorg_nwaku:latest.log
2026-03-21 04:31:32.918 DEBUG [tests.e2e.test_e2e] Start 5 nodes
2026-03-21 04:31:32.918 DEBUG [src.node.waku_node] Starting Node...
2026-03-21 04:31:32.918 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-21 04:31:32.920 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-21 04:31:32.920 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.164.77
2026-03-21 04:31:32.920 DEBUG [src.node.docker_mananger] Generated ports ['64069', '64070', '64071', '64072', '64073']
2026-03-21 04:31:32.920 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-21 04:31:32.921 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-21 04:31:32.921 DEBUG [src.node.waku_node] Using volumes []
2026-03-21 04:31:32.921 DEBUG [src.node.docker_mananger] docker run -i -t -p 64069:64069 -p 64070:64070 -p 64071:64071 -p 64072:64072 -p 64073:64073 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=64071 --rest-port=64069 --tcp-port=64070 --discv5-udp-port=64072 --rest-address=0.0.0.0 --nat=extip:172.18.164.77 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=b0d4218afbf9f03dba1ac2dc2c1dc9c4e2e366baf8b81bd011c5d74c34276f3a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=64073 --metrics-logging=true --relay=true --store=false
2026-03-21 04:31:33.105 ERROR [src.node.docker_mananger] Max retries reached for container 8d5d4dbf05b5. Exiting log stream.
2026-03-21 04:31:33.106 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.164.77 waku 16acf8a264df9977390cdb243c707b2d5b0208dd06d158c4e4bbe626665d088a
2026-03-21 04:31:33.140 DEBUG [src.node.docker_mananger] Container started with ID 16acf8a264df. Setting up logs at ./log/docker/node1_2026-03-21_04-31-32__e85a2620-32b0-4ad7-8595-1922b343e4e6__wakuorg_nwaku:latest.log
2026-03-21 04:31:33.141 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 64069
2026-03-21 04:31:33.142 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-21 04:31:33.650 ERROR [src.node.docker_mananger] Max retries reached for container 365879d91927. Exiting log stream.
2026-03-21 04:31:34.143 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64069/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:31:34.146 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-21 04:31:34.146 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-21 04:31:34.146 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64069/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:31:34.149 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.164.77/tcp/64070/p2p/16Uiu2HAmRHwaEAzZwQ33F4SNiUGg4LvmevRiemLTDv9DtcP3hQqn","/ip4/172.18.164.77/tcp/64071/ws/p2p/16Uiu2HAmRHwaEAzZwQ33F4SNiUGg4LvmevRiemLTDv9DtcP3hQqn"],"enrUri":"enr:-L24QDkZRrXSgBc6Dvj4ZPKutRNcnN9Zjdhi-zkBdAi6bOWBdODX6msVBu0GMvjwN4GBo4vVQgFzix6um4XitNcb1-QCgmlkgnY0gmlwhKwSpE2KbXVsdGlhZGRyc5YACASsEqRNBvpGAAoErBKkTQb6R90DgnJzhQADAQAAiXNlY3AyNTZrMaEDu8OX2ctJukc21wW72vqZ3ZBArZcG4GwLaFY9S2Qep6mDdGNwgvpGg3VkcIL6SIV3YWt1MgE"}'
2026-03-21 04:31:34.149 INFO [src.node.waku_node] REST service is ready !!
2026-03-21 04:31:34.149 DEBUG [src.node.waku_node] Starting Node...
2026-03-21 04:31:34.149 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-21 04:31:34.151 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-21 04:31:34.151 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.101.184
2026-03-21 04:31:34.151 DEBUG [src.node.docker_mananger] Generated ports ['60397', '60398', '60399', '60400', '60401']
2026-03-21 04:31:34.151 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-21 04:31:34.151 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-21 04:31:34.151 DEBUG [src.node.waku_node] Using volumes []
2026-03-21 04:31:34.151 DEBUG [src.node.docker_mananger] docker run -i -t -p 60397:60397 -p 60398:60398 -p 60399:60399 -p 60400:60400 -p 60401:60401 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=60399 --rest-port=60397 --tcp-port=60398 --discv5-udp-port=60400 --rest-address=0.0.0.0 --nat=extip:172.18.101.184 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=552b8e5acb58dd9d5ff0c53deee545efe0e38c44eb3e5b9a7e6b0043ffaeb4d4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=60401 --metrics-logging=true --relay=true --store=false --discv5-bootstrap-node=enr:-L24QDkZRrXSgBc6Dvj4ZPKutRNcnN9Zjdhi-zkBdAi6bOWBdODX6msVBu0GMvjwN4GBo4vVQgFzix6um4XitNcb1-QCgmlkgnY0gmlwhKwSpE2KbXVsdGlhZGRyc5YACASsEqRNBvpGAAoErBKkTQb6R90DgnJzhQADAQAAiXNlY3AyNTZrMaEDu8OX2ctJukc21wW72vqZ3ZBArZcG4GwLaFY9S2Qep6mDdGNwgvpGg3VkcIL6SIV3YWt1MgE
2026-03-21 04:31:34.350 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.101.184 waku c2b3b1ea4293157fbedf2d44f8981d61e334fc5a452a219b42efc0e9e218797d
2026-03-21 04:31:34.383 DEBUG [src.node.docker_mananger] Container started with ID c2b3b1ea4293. Setting up logs at ./log/docker/node2_2026-03-21_04-31-32__e85a2620-32b0-4ad7-8595-1922b343e4e6__wakuorg_nwaku:latest.log
2026-03-21 04:31:34.383 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 60397
2026-03-21 04:31:34.384 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-21 04:31:35.386 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60397/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:31:35.412 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-21 04:31:35.412 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-21 04:31:35.412 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60397/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:31:35.420 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.101.184/tcp/60398/p2p/16Uiu2HAmNeFaHy8RSJDsQgMGFdnFumoH1rZohVELQKTWvha12qt5","/ip4/172.18.101.184/tcp/60399/ws/p2p/16Uiu2HAmNeFaHy8RSJDsQgMGFdnFumoH1rZohVELQKTWvha12qt5"],"enrUri":"enr:-L24QNOdKUPeqHmNsImB_HPW8nabxzAcrolrxmv3lXI9AxSzaZE50n1GD5tMqVhrxbsOuIKqvp8dTIItXWqC1mWlcgECgmlkgnY0gmlwhKwSZbiKbXVsdGlhZGRyc5YACASsEmW4BuvuAAoErBJluAbr790DgnJzhQADAQAAiXNlY3AyNTZrMaEDlGSApIABvVix-a3j886roiTDRrB9as0lzdcp1sMXvZqDdGNwguvug3VkcILr8IV3YWt1MgE"}'
2026-03-21 04:31:35.421 INFO [src.node.waku_node] REST service is ready !!
2026-03-21 04:31:35.421 DEBUG [src.node.waku_node] Starting Node...
2026-03-21 04:31:35.422 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-21 04:31:35.423 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-21 04:31:35.424 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.184.242
2026-03-21 04:31:35.424 DEBUG [src.node.docker_mananger] Generated ports ['3928', '3929', '3930', '3931', '3932']
2026-03-21 04:31:35.424 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-21 04:31:35.424 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-21 04:31:35.424 DEBUG [src.node.waku_node] Using volumes []
2026-03-21 04:31:35.424 DEBUG [src.node.docker_mananger] docker run -i -t -p 3928:3928 -p 3929:3929 -p 3930:3930 -p 3931:3931 -p 3932:3932 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3930 --rest-port=3928 --tcp-port=3929 --discv5-udp-port=3931 --rest-address=0.0.0.0 --nat=extip:172.18.184.242 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=f7828ccc3c4c2717ba9ae7eac1a25c7df33fe49d11bc4c5bfec8b23ee2eefadb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3932 --metrics-logging=true --relay=true --store=false --filter=true --discv5-bootstrap-node=enr:-L24QNOdKUPeqHmNsImB_HPW8nabxzAcrolrxmv3lXI9AxSzaZE50n1GD5tMqVhrxbsOuIKqvp8dTIItXWqC1mWlcgECgmlkgnY0gmlwhKwSZbiKbXVsdGlhZGRyc5YACASsEmW4BuvuAAoErBJluAbr790DgnJzhQADAQAAiXNlY3AyNTZrMaEDlGSApIABvVix-a3j886roiTDRrB9as0lzdcp1sMXvZqDdGNwguvug3VkcILr8IV3YWt1MgE
2026-03-21 04:31:35.621 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.184.242 waku ff10b0538171e0b41f7cb018141648b458615772a334159cf7f751af2f8fce3d
2026-03-21 04:31:35.653 DEBUG [src.node.docker_mananger] Container started with ID ff10b0538171. Setting up logs at ./log/docker/node3_2026-03-21_04-31-32__e85a2620-32b0-4ad7-8595-1922b343e4e6__wakuorg_nwaku:latest.log
2026-03-21 04:31:35.654 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 3928
2026-03-21 04:31:35.654 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-21 04:31:36.655 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3928/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:31:36.674 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-21 04:31:36.676 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-21 04:31:36.677 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3928/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:31:36.681 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.184.242/tcp/3929/p2p/16Uiu2HAmFW54TwdMW2adwyYD5Hjpeg4izxx48wvKiguBkttxewd5","/ip4/172.18.184.242/tcp/3930/ws/p2p/16Uiu2HAmFW54TwdMW2adwyYD5Hjpeg4izxx48wvKiguBkttxewd5"],"enrUri":"enr:-L24QAyXn2-0udfeMoBFu5nJRD1Ey1zbFDfeybDr_ptxgAxiIGQfz-Ph9A7ENMgNRjmAhqba1aklegz4jrYRLCrmAAwCgmlkgnY0gmlwhKwSuPKKbXVsdGlhZGRyc5YACASsErjyBg9ZAAoErBK48gYPWt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDKkootbcT3iI642WUwliQQw7vlWGLXvxiqR9ueBqHyxyDdGNwgg9Zg3VkcIIPW4V3YWt1MgU"}'
2026-03-21 04:31:36.683 INFO [src.node.waku_node] REST service is ready !!
2026-03-21 04:31:36.684 DEBUG [src.node.waku_node] Starting Node...
2026-03-21 04:31:36.685 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-21 04:31:36.687 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-21 04:31:36.688 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.45.157
2026-03-21 04:31:36.688 DEBUG [src.node.docker_mananger] Generated ports ['8998', '8999', '9000', '9001', '9002']
2026-03-21 04:31:36.688 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-21 04:31:36.688 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-21 04:31:36.689 DEBUG [src.node.waku_node] Using volumes []
2026-03-21 04:31:36.689 DEBUG [src.node.docker_mananger] docker run -i -t -p 8998:8998 -p 8999:8999 -p 9000:9000 -p 9001:9001 -p 9002:9002 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=9000 --rest-port=8998 --tcp-port=8999 --discv5-udp-port=9001 --rest-address=0.0.0.0 --nat=extip:172.18.45.157 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=6deddba61f1317c2fbf1bc0bcfabe1efd3d172dabd8c3cbade306d8ecea82b62 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=9002 --metrics-logging=true --relay=true --filter=true --store=false --discv5-bootstrap-node=enr:-L24QAyXn2-0udfeMoBFu5nJRD1Ey1zbFDfeybDr_ptxgAxiIGQfz-Ph9A7ENMgNRjmAhqba1aklegz4jrYRLCrmAAwCgmlkgnY0gmlwhKwSuPKKbXVsdGlhZGRyc5YACASsErjyBg9ZAAoErBK48gYPWt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDKkootbcT3iI642WUwliQQw7vlWGLXvxiqR9ueBqHyxyDdGNwgg9Zg3VkcIIPW4V3YWt1MgU
2026-03-21 04:31:36.887 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.45.157 waku bc2bf61322a224d5e2f24e659c2642860f3219a589f0640ce346acbb33cab98f
2026-03-21 04:31:36.921 DEBUG [src.node.docker_mananger] Container started with ID bc2bf61322a2. Setting up logs at ./log/docker/node4_2026-03-21_04-31-32__e85a2620-32b0-4ad7-8595-1922b343e4e6__wakuorg_nwaku:latest.log
2026-03-21 04:31:36.921 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 8998
2026-03-21 04:31:36.921 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-21 04:31:37.922 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8998/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:31:37.943 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-21 04:31:37.943 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-21 04:31:37.944 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8998/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:31:37.950 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.45.157/tcp/8999/p2p/16Uiu2HAm5dmFrftBkfymLXhHksCMZwLrKifvmXpqM7dY55zKU9Sg","/ip4/172.18.45.157/tcp/9000/ws/p2p/16Uiu2HAm5dmFrftBkfymLXhHksCMZwLrKifvmXpqM7dY55zKU9Sg"],"enrUri":"enr:-L24QJS3AN7xHr39wFdN_vBdbW3UT8kfYusyyYoRKlqICv9YNvFHP4pzaCD6vzulncRzqAzHYt-zFetaZJZ84hnURSkCgmlkgnY0gmlwhKwSLZ2KbXVsdGlhZGRyc5YACASsEi2dBiMnAAoErBItnQYjKN0DgnJzhQADAQAAiXNlY3AyNTZrMaECl63OPxfQJK--Rn-EsN3URHN3ZcVLtCW2ZIecWiDkrumDdGNwgiMng3VkcIIjKYV3YWt1MgU"}'
2026-03-21 04:31:37.951 INFO [src.node.waku_node] REST service is ready !!
2026-03-21 04:31:37.952 DEBUG [src.node.waku_node] Starting Node...
2026-03-21 04:31:37.953 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-21 04:31:37.955 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-21 04:31:37.955 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.121.92
2026-03-21 04:31:37.955 DEBUG [src.node.docker_mananger] Generated ports ['11720', '11721', '11722', '11723', '11724']
2026-03-21 04:31:37.955 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-21 04:31:37.955 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-21 04:31:37.956 DEBUG [src.node.waku_node] Using volumes []
2026-03-21 04:31:37.956 DEBUG [src.node.docker_mananger] docker run -i -t -p 11720:11720 -p 11721:11721 -p 11722:11722 -p 11723:11723 -p 11724:11724 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=11722 --rest-port=11720 --tcp-port=11721 --discv5-udp-port=11723 --rest-address=0.0.0.0 --nat=extip:172.18.121.92 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a6a3e7d7ce9ee153f65fa8ebce81b92cbae2bbdd1cad07af56e9857bc7bcde85 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=11724 --metrics-logging=true --relay=false --filternode=/ip4/172.18.45.157/tcp/8999/p2p/16Uiu2HAm5dmFrftBkfymLXhHksCMZwLrKifvmXpqM7dY55zKU9Sg --store=false --discv5-bootstrap-node=enr:-L24QAyXn2-0udfeMoBFu5nJRD1Ey1zbFDfeybDr_ptxgAxiIGQfz-Ph9A7ENMgNRjmAhqba1aklegz4jrYRLCrmAAwCgmlkgnY0gmlwhKwSuPKKbXVsdGlhZGRyc5YACASsErjyBg9ZAAoErBK48gYPWt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDKkootbcT3iI642WUwliQQw7vlWGLXvxiqR9ueBqHyxyDdGNwgg9Zg3VkcIIPW4V3YWt1MgU
2026-03-21 04:31:38.148 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.121.92 waku 11e5005130728053fd2e43fc6134a01dd069eb66a315036979ca5091744b584d
2026-03-21 04:31:38.183 DEBUG [src.node.docker_mananger] Container started with ID 11e500513072. Setting up logs at ./log/docker/node5_2026-03-21_04-31-32__e85a2620-32b0-4ad7-8595-1922b343e4e6__wakuorg_nwaku:latest.log
2026-03-21 04:31:38.183 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 11720
2026-03-21 04:31:38.184 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-21 04:31:39.184 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11720/health" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:31:39.187 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-21 04:31:39.187 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-21 04:31:39.187 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11720/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:31:39.190 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.121.92/tcp/11721/p2p/16Uiu2HAmQGtDPiMHREXdGZfxP148jGybNoQwowxf2ZTLDsC2xA1C","/ip4/172.18.121.92/tcp/11722/ws/p2p/16Uiu2HAmQGtDPiMHREXdGZfxP148jGybNoQwowxf2ZTLDsC2xA1C"],"enrUri":"enr:-L24QIAExsc4kQdvOkrGIW9HwN7ucCP3Y3lUuuOLYAOZqLiBcnbEYn6yOju38u1srZnBfr4ClBpNRQc-mGxs6TzG9mQCgmlkgnY0gmlwhKwSeVyKbXVsdGlhZGRyc5YACASsEnlcBi3JAAoErBJ5XAYtyt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDrKKG8k_ag2vJvBQhlGgDpigSQiM6W1WZYNQBSJ4z5VeDdGNwgi3Jg3VkcIIty4V3YWt1MgA"}'
2026-03-21 04:31:39.190 INFO [src.node.waku_node] REST service is ready !!
2026-03-21 04:31:39.190 DEBUG [tests.e2e.test_e2e] Subscribe nodes to relay pubsub topic /waku/2/rs/3/1
2026-03-21 04:31:39.191 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64069/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-21 04:31:39.194 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:31:39.196 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60397/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-21 04:31:39.203 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:31:39.204 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3928/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-21 04:31:39.212 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:31:39.213 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:8998/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-21 04:31:39.221 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:31:39.222 DEBUG [tests.e2e.test_e2e] Node5 makes filter request pubsubtopic /waku/2/rs/3/1 and content topic /test/1/waku-filter/proto
2026-03-21 04:31:39.222 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11720/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-21 04:31:39.271 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-03-21 04:31:39.273 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:64069/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:31:39.278 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.101.184/tcp/44612/p2p/16Uiu2HAmNeFaHy8RSJDsQgMGFdnFumoH1rZohVELQKTWvha12qt5","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-2-g85a7bf","origin":"Discv5"}]'
2026-03-21 04:31:39.279 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60397/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:31:39.284 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.184.242/tcp/55280/p2p/16Uiu2HAmFW54TwdMW2adwyYD5Hjpeg4izxx48wvKiguBkttxewd5","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-2-g85a7bf","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.164.77/tcp/64070/p2p/16Uiu2HAmRHwaEAzZwQ33F4SNiUGg4LvmevRiemLTDv9DtcP3hQqn","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-2-g85a7bf","origin":"Discv5"}]'
2026-03-21 04:31:39.285 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3928/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:31:39.290 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.101.184/tcp/60398/p2p/16Uiu2HAmNeFaHy8RSJDsQgMGFdnFumoH1rZohVELQKTWvha12qt5","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-2-g85a7bf","origin":"Discv5"},{"multiaddr":"/ip4/172.18.45.157/tcp/45734/p2p/16Uiu2HAm5dmFrftBkfymLXhHksCMZwLrKifvmXpqM7dY55zKU9Sg","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-2-g85a7bf","origin":"UnknownOrigin"}]'
2026-03-21 04:31:39.290 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8998/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:31:39.293 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.121.92/tcp/59678/p2p/16Uiu2HAmQGtDPiMHREXdGZfxP148jGybNoQwowxf2ZTLDsC2xA1C","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-2-g85a7bf","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.184.242/tcp/3929/p2p/16Uiu2HAmFW54TwdMW2adwyYD5Hjpeg4izxx48wvKiguBkttxewd5","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-2-g85a7bf","origin":"Discv5"}]'
2026-03-21 04:31:39.293 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11720/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:31:39.295 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.45.157/tcp/8999/p2p/16Uiu2HAm5dmFrftBkfymLXhHksCMZwLrKifvmXpqM7dY55zKU9Sg","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0,1],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-2-g85a7bf","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.184.242/tcp/3929/p2p/16Uiu2HAmFW54TwdMW2adwyYD5Hjpeg4izxx48wvKiguBkttxewd5","protocols":["/vac/waku/relay/2.0.0","/vac/waku/filter-subscribe/2.0.0-beta1"],"shards":[0],"connected":"NotConnected","agent":"","origin":"Discv5"}]'
2026-03-21 04:31:39.295 DEBUG [src.libs.common] Sleeping for 60 seconds
2026-03-21 04:32:39.296 DEBUG [tests.e2e.test_e2e] 3 Nodes publish 12 message
2026-03-21 04:32:39.296 DEBUG [src.steps.store] Relaying message
2026-03-21 04:32:39.296 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64069/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:39.306 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:39.307 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:32:39.509 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-21 04:32:41.510 DEBUG [src.steps.store] Relaying message
2026-03-21 04:32:41.510 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64069/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:41.523 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:41.525 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:32:41.725 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-21 04:32:43.726 DEBUG [src.steps.store] Relaying message
2026-03-21 04:32:43.726 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64069/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:43.734 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:43.735 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:32:43.937 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-21 04:32:45.938 DEBUG [src.steps.store] Relaying message
2026-03-21 04:32:45.938 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:64069/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:45.947 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:45.950 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:32:46.152 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-21 04:32:48.153 DEBUG [src.steps.store] Relaying message
2026-03-21 04:32:48.153 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60397/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:48.163 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:48.164 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:32:48.365 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-21 04:32:50.366 DEBUG [src.steps.store] Relaying message
2026-03-21 04:32:50.366 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60397/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:50.375 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:50.376 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:32:50.580 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-21 04:32:52.581 DEBUG [src.steps.store] Relaying message
2026-03-21 04:32:52.581 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60397/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:52.590 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:52.593 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:32:52.796 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-21 04:32:54.797 DEBUG [src.steps.store] Relaying message
2026-03-21 04:32:54.797 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60397/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:54.809 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:54.812 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:32:55.015 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-21 04:32:57.016 DEBUG [src.steps.store] Relaying message
2026-03-21 04:32:57.016 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3928/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:57.030 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:57.032 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:32:57.239 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-21 04:32:59.240 DEBUG [src.steps.store] Relaying message
2026-03-21 04:32:59.240 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3928/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:32:59.251 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:32:59.253 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:32:59.454 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-21 04:33:01.455 DEBUG [src.steps.store] Relaying message
2026-03-21 04:33:01.455 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3928/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:33:01.467 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:33:01.469 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:33:01.670 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-21 04:33:03.671 DEBUG [src.steps.store] Relaying message
2026-03-21 04:33:03.671 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3928/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-21 04:33:03.681 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-21 04:33:03.682 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-21 04:33:03.883 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-21 04:33:05.884 DEBUG [tests.e2e.test_e2e] Node5 requests messages of subscribed filter topic /waku/2/rs/3/1
2026-03-21 04:33:05.884 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11720/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-21 04:33:05.887 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774067559296623895,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774067561510043329,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774067563726108397,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774067565938332303,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774067568153191684,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774067570366195558,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774067572581168159,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774067574797382598,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774067577016444164,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774067579239837713,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774067581454849054,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774067583670968788,"ephemeral":false}]'
2026-03-21 04:33:05.887 DEBUG [tests.e2e.test_e2e] Response for node 5 is [{'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774067559296623895, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774067561510043329, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774067563726108397, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774067565938332303, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774067568153191684, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774067570366195558, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774067572581168159, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774067574797382598, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774067577016444164, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774067579239837713, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774067581454849054, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774067583670968788, 'ephemeral': False}]
2026-03-21 04:33:05.890 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-21 04:33:05.891 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-21 04:33:05.891 DEBUG [src.node.waku_node] Stopping container with id 16acf8a264df
2026-03-21 04:33:06.477 DEBUG [src.node.waku_node] Container stopped.
2026-03-21 04:33:06.479 DEBUG [src.node.waku_node] Stopping container with id c2b3b1ea4293
2026-03-21 04:33:07.077 DEBUG [src.node.waku_node] Container stopped.
2026-03-21 04:33:07.080 DEBUG [src.node.waku_node] Stopping container with id ff10b0538171
2026-03-21 04:33:07.291 ERROR [src.node.docker_mananger] Max retries reached for container 16acf8a264df. Exiting log stream.
2026-03-21 04:33:07.663 DEBUG [src.node.waku_node] Container stopped.
2026-03-21 04:33:07.664 DEBUG [src.node.waku_node] Stopping container with id bc2bf61322a2
2026-03-21 04:33:07.891 ERROR [src.node.docker_mananger] Max retries reached for container c2b3b1ea4293. Exiting log stream.
2026-03-21 04:33:08.478 ERROR [src.node.docker_mananger] Max retries reached for container ff10b0538171. Exiting log stream.
2026-03-21 04:33:18.239 DEBUG [src.node.waku_node] Container stopped.
2026-03-21 04:33:18.239 DEBUG [src.node.waku_node] Stopping container with id 11e500513072
2026-03-21 04:33:18.798 DEBUG [src.node.waku_node] Container stopped.
2026-03-21 04:33:18.802 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-21 04:33:18.874 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-21 04:33:18.951 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-21 04:33:19.027 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-21 04:33:19.114 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-21 04:33:19.136 DEBUG [src.node.docker_mananger] No errors found in the waku logs.