225 lines
44 KiB
Plaintext

2026-03-10 04:32:01.374 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-10 04:32:01.375 DEBUG [tests.conftest] Running test: test_filter_3_senders_multiple_msg_1_receiver with id: 2026-03-10_04-32-01__cfa6d092-f99f-4176-9a05-4e4cfe55d7fb
2026-03-10 04:32:01.375 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-10 04:32:01.375 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-10 04:32:01.376 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-10 04:32:01.381 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-10 04:32:01.382 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-10_04-32-01__cfa6d092-f99f-4176-9a05-4e4cfe55d7fb__wakuorg_nwaku:latest.log
2026-03-10 04:32:01.387 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-10 04:32:01.387 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-10_04-32-01__cfa6d092-f99f-4176-9a05-4e4cfe55d7fb__wakuorg_nwaku:latest.log
2026-03-10 04:32:01.392 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-10 04:32:01.392 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-10_04-32-01__cfa6d092-f99f-4176-9a05-4e4cfe55d7fb__wakuorg_nwaku:latest.log
2026-03-10 04:32:01.393 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-10 04:32:01.393 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-10 04:32:01.398 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-10 04:32:01.398 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-10_04-32-01__cfa6d092-f99f-4176-9a05-4e4cfe55d7fb__wakuorg_nwaku:latest.log
2026-03-10 04:32:01.403 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-10 04:32:01.403 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-10_04-32-01__cfa6d092-f99f-4176-9a05-4e4cfe55d7fb__wakuorg_nwaku:latest.log
2026-03-10 04:32:01.403 DEBUG [tests.e2e.test_e2e] Start 5 nodes
2026-03-10 04:32:01.404 DEBUG [src.node.waku_node] Starting Node...
2026-03-10 04:32:01.404 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-10 04:32:01.405 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-10 04:32:01.405 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.37.47
2026-03-10 04:32:01.405 DEBUG [src.node.docker_mananger] Generated ports ['16334', '16335', '16336', '16337', '16338']
2026-03-10 04:32:01.405 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-10 04:32:01.405 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-10 04:32:01.406 DEBUG [src.node.waku_node] Using volumes []
2026-03-10 04:32:01.406 DEBUG [src.node.docker_mananger] docker run -i -t -p 16334:16334 -p 16335:16335 -p 16336:16336 -p 16337:16337 -p 16338:16338 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=16336 --rest-port=16334 --tcp-port=16335 --discv5-udp-port=16337 --rest-address=0.0.0.0 --nat=extip:172.18.37.47 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=befb5cb17bef1f6335cdfbad535ca8afeff586eb9fefebbeeddbfe52009aeaae --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=16338 --metrics-logging=true --relay=true --store=false
2026-03-10 04:32:01.559 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.37.47 waku 4697ac2830e51802833ac49ae192cbcfe79bbcf36a8e0931bef5a20d5a96bb1a
2026-03-10 04:32:01.590 DEBUG [src.node.docker_mananger] Container started with ID 4697ac2830e5. Setting up logs at ./log/docker/node1_2026-03-10_04-32-01__cfa6d092-f99f-4176-9a05-4e4cfe55d7fb__wakuorg_nwaku:latest.log
2026-03-10 04:32:01.591 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 16334
2026-03-10 04:32:01.591 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-10 04:32:01.678 ERROR [src.node.docker_mananger] Max retries reached for container 33931439381f. Exiting log stream.
2026-03-10 04:32:02.142 ERROR [src.node.docker_mananger] Max retries reached for container 37794adfea38. Exiting log stream.
2026-03-10 04:32:02.592 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:16334/health" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:32:02.595 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-10 04:32:02.595 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-10 04:32:02.596 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:16334/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:32:02.598 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.37.47/tcp/16335/p2p/16Uiu2HAmNP55s6EimRRjMEqqrzMiqcycviJPHjPiqdUcTd8jcRk3","/ip4/172.18.37.47/tcp/16336/ws/p2p/16Uiu2HAmNP55s6EimRRjMEqqrzMiqcycviJPHjPiqdUcTd8jcRk3"],"enrUri":"enr:-L24QA-GzgIHKITDX_2jlGevmIg4fQEaxm-QS0RGDjmjYoolYUarPNPHERe3E-lfMmcyFqSSrXCR3V4WSywFfvOtxtsCgmlkgnY0gmlwhKwSJS-KbXVsdGlhZGRyc5YACASsEiUvBj_PAAoErBIlLwY_0N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDkIDt2sGyVyWrx0GVx9yuC_SgYmV7mGLog64CrxqmR5iDdGNwgj_Pg3VkcII_0YV3YWt1MgE"}'
2026-03-10 04:32:02.598 INFO [src.node.waku_node] REST service is ready !!
2026-03-10 04:32:02.598 DEBUG [src.node.waku_node] Starting Node...
2026-03-10 04:32:02.598 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-10 04:32:02.600 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-10 04:32:02.600 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.170.13
2026-03-10 04:32:02.600 DEBUG [src.node.docker_mananger] Generated ports ['54582', '54583', '54584', '54585', '54586']
2026-03-10 04:32:02.600 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-10 04:32:02.600 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-10 04:32:02.600 DEBUG [src.node.waku_node] Using volumes []
2026-03-10 04:32:02.600 DEBUG [src.node.docker_mananger] docker run -i -t -p 54582:54582 -p 54583:54583 -p 54584:54584 -p 54585:54585 -p 54586:54586 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=54584 --rest-port=54582 --tcp-port=54583 --discv5-udp-port=54585 --rest-address=0.0.0.0 --nat=extip:172.18.170.13 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=4abbfbf2dfa2ca872bb2f99ac4a48f785cbcbc8697e3703807a9cbf50ea9af3a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=54586 --metrics-logging=true --relay=true --store=false --discv5-bootstrap-node=enr:-L24QA-GzgIHKITDX_2jlGevmIg4fQEaxm-QS0RGDjmjYoolYUarPNPHERe3E-lfMmcyFqSSrXCR3V4WSywFfvOtxtsCgmlkgnY0gmlwhKwSJS-KbXVsdGlhZGRyc5YACASsEiUvBj_PAAoErBIlLwY_0N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDkIDt2sGyVyWrx0GVx9yuC_SgYmV7mGLog64CrxqmR5iDdGNwgj_Pg3VkcII_0YV3YWt1MgE
2026-03-10 04:32:02.748 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.170.13 waku a81e74118be3c60dc0209be915a6e6fa96018693560649e4df497b52ec967553
2026-03-10 04:32:02.775 DEBUG [src.node.docker_mananger] Container started with ID a81e74118be3. Setting up logs at ./log/docker/node2_2026-03-10_04-32-01__cfa6d092-f99f-4176-9a05-4e4cfe55d7fb__wakuorg_nwaku:latest.log
2026-03-10 04:32:02.775 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 54582
2026-03-10 04:32:02.776 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-10 04:32:03.776 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54582/health" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:32:03.802 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-10 04:32:03.805 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-10 04:32:03.805 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54582/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:32:03.812 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.170.13/tcp/54583/p2p/16Uiu2HAkvbuCnttYsFKHyQ6mS5w9dX6xw7WKKkQ8ukydCPGKBYyf","/ip4/172.18.170.13/tcp/54584/ws/p2p/16Uiu2HAkvbuCnttYsFKHyQ6mS5w9dX6xw7WKKkQ8ukydCPGKBYyf"],"enrUri":"enr:-L24QCCZK6lcUf31NQd7kJfkB3iGE1GMUzItX-rVC-hrnpvOWmRptw1qWG5CeYUp6kov9f1lrIH7V7Mcd9iVG9rAB2gCgmlkgnY0gmlwhKwSqg2KbXVsdGlhZGRyc5YACASsEqoNBtU3AAoErBKqDQbVON0DgnJzhQADAQAAiXNlY3AyNTZrMaECEXpyk_IJf8xApnu8mW2VlKOhf6uHuLEbb7eRmPsg5kKDdGNwgtU3g3VkcILVOYV3YWt1MgE"}'
2026-03-10 04:32:03.813 INFO [src.node.waku_node] REST service is ready !!
2026-03-10 04:32:03.813 DEBUG [src.node.waku_node] Starting Node...
2026-03-10 04:32:03.813 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-10 04:32:03.815 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-10 04:32:03.815 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.165.55
2026-03-10 04:32:03.815 DEBUG [src.node.docker_mananger] Generated ports ['65380', '65381', '65382', '65383', '65384']
2026-03-10 04:32:03.815 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-10 04:32:03.815 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-10 04:32:03.815 DEBUG [src.node.waku_node] Using volumes []
2026-03-10 04:32:03.815 DEBUG [src.node.docker_mananger] docker run -i -t -p 65380:65380 -p 65381:65381 -p 65382:65382 -p 65383:65383 -p 65384:65384 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=65382 --rest-port=65380 --tcp-port=65381 --discv5-udp-port=65383 --rest-address=0.0.0.0 --nat=extip:172.18.165.55 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=b26e070fc5eb8bce69fc60b27eaa7e8c4117578ec7738b48d8cfb2c99bc3f18b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=65384 --metrics-logging=true --relay=true --store=false --filter=true --discv5-bootstrap-node=enr:-L24QCCZK6lcUf31NQd7kJfkB3iGE1GMUzItX-rVC-hrnpvOWmRptw1qWG5CeYUp6kov9f1lrIH7V7Mcd9iVG9rAB2gCgmlkgnY0gmlwhKwSqg2KbXVsdGlhZGRyc5YACASsEqoNBtU3AAoErBKqDQbVON0DgnJzhQADAQAAiXNlY3AyNTZrMaECEXpyk_IJf8xApnu8mW2VlKOhf6uHuLEbb7eRmPsg5kKDdGNwgtU3g3VkcILVOYV3YWt1MgE
2026-03-10 04:32:03.962 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.165.55 waku 462be4a97b3f7d185db5147a8f988ef1213d5f131a1ac6690b83a41b4562bc3c
2026-03-10 04:32:03.988 DEBUG [src.node.docker_mananger] Container started with ID 462be4a97b3f. Setting up logs at ./log/docker/node3_2026-03-10_04-32-01__cfa6d092-f99f-4176-9a05-4e4cfe55d7fb__wakuorg_nwaku:latest.log
2026-03-10 04:32:03.988 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 65380
2026-03-10 04:32:03.988 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-10 04:32:04.988 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:65380/health" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:32:05.007 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-10 04:32:05.007 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-10 04:32:05.008 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:65380/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:32:05.012 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.165.55/tcp/65381/p2p/16Uiu2HAmT7FSRwLTgt1oVCCpZn44Kt3ehLR2n1iCoUHDSxguhFLQ","/ip4/172.18.165.55/tcp/65382/ws/p2p/16Uiu2HAmT7FSRwLTgt1oVCCpZn44Kt3ehLR2n1iCoUHDSxguhFLQ"],"enrUri":"enr:-L24QJCV8QrOBrnDwbxIazcqqrEwjM0dw5uBOUNc_FZ6W1GxBEulmTmsSnnuiIVU6ih1_HmvjgnuxPMPivR2MlqNnrQCgmlkgnY0gmlwhKwSpTeKbXVsdGlhZGRyc5YACASsEqU3Bv9lAAoErBKlNwb_Zt0DgnJzhQADAQAAiXNlY3AyNTZrMaED1r3HXh93xA7dcMkuKnLClocJr_-bAS6k-wZHm9-fe32DdGNwgv9lg3VkcIL_Z4V3YWt1MgU"}'
2026-03-10 04:32:05.013 INFO [src.node.waku_node] REST service is ready !!
2026-03-10 04:32:05.014 DEBUG [src.node.waku_node] Starting Node...
2026-03-10 04:32:05.014 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-10 04:32:05.016 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-10 04:32:05.016 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.100.94
2026-03-10 04:32:05.016 DEBUG [src.node.docker_mananger] Generated ports ['10177', '10178', '10179', '10180', '10181']
2026-03-10 04:32:05.017 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-10 04:32:05.017 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-10 04:32:05.017 DEBUG [src.node.waku_node] Using volumes []
2026-03-10 04:32:05.017 DEBUG [src.node.docker_mananger] docker run -i -t -p 10177:10177 -p 10178:10178 -p 10179:10179 -p 10180:10180 -p 10181:10181 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=10179 --rest-port=10177 --tcp-port=10178 --discv5-udp-port=10180 --rest-address=0.0.0.0 --nat=extip:172.18.100.94 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=aa69bcbf57133a70502741e98bbdfcbe90e548cb8ead016bbac7ac064b5deb2a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=10181 --metrics-logging=true --relay=true --filter=true --store=false --discv5-bootstrap-node=enr:-L24QJCV8QrOBrnDwbxIazcqqrEwjM0dw5uBOUNc_FZ6W1GxBEulmTmsSnnuiIVU6ih1_HmvjgnuxPMPivR2MlqNnrQCgmlkgnY0gmlwhKwSpTeKbXVsdGlhZGRyc5YACASsEqU3Bv9lAAoErBKlNwb_Zt0DgnJzhQADAQAAiXNlY3AyNTZrMaED1r3HXh93xA7dcMkuKnLClocJr_-bAS6k-wZHm9-fe32DdGNwgv9lg3VkcIL_Z4V3YWt1MgU
2026-03-10 04:32:05.168 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.100.94 waku 641aa45599fc2d8adea0fbbc3fe6cc5e69dd20d3d8102ebaec8d8b4bce5cf761
2026-03-10 04:32:05.191 DEBUG [src.node.docker_mananger] Container started with ID 641aa45599fc. Setting up logs at ./log/docker/node4_2026-03-10_04-32-01__cfa6d092-f99f-4176-9a05-4e4cfe55d7fb__wakuorg_nwaku:latest.log
2026-03-10 04:32:05.191 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 10177
2026-03-10 04:32:05.192 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-10 04:32:06.194 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10177/health" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:32:06.212 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-10 04:32:06.213 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-10 04:32:06.214 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10177/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:32:06.219 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.100.94/tcp/10178/p2p/16Uiu2HAmRszn37C1odJ2FrZjxVJJAcN5ToaJFEVZyWj78exqeTC8","/ip4/172.18.100.94/tcp/10179/ws/p2p/16Uiu2HAmRszn37C1odJ2FrZjxVJJAcN5ToaJFEVZyWj78exqeTC8"],"enrUri":"enr:-L24QLV-mldNb22WkG79lr-6HltSeYG-SvNpA4ztlIec2plmKvuCogF7fHtLCHl4JxAFwu0zFfI_JjMwlxrRLljwMV8CgmlkgnY0gmlwhKwSZF6KbXVsdGlhZGRyc5YACASsEmReBifCAAoErBJkXgYnw90DgnJzhQADAQAAiXNlY3AyNTZrMaEDxHz2h4sF9jYOmNNj2WVS4R7MCzxdwPlX8DiMbXUZhxWDdGNwgifCg3VkcIInxIV3YWt1MgU"}'
2026-03-10 04:32:06.220 INFO [src.node.waku_node] REST service is ready !!
2026-03-10 04:32:06.220 DEBUG [src.node.waku_node] Starting Node...
2026-03-10 04:32:06.220 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-10 04:32:06.223 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-10 04:32:06.223 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.129.232
2026-03-10 04:32:06.225 DEBUG [src.node.docker_mananger] Generated ports ['54368', '54369', '54370', '54371', '54372']
2026-03-10 04:32:06.225 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-10 04:32:06.225 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-10 04:32:06.225 DEBUG [src.node.waku_node] Using volumes []
2026-03-10 04:32:06.226 DEBUG [src.node.docker_mananger] docker run -i -t -p 54368:54368 -p 54369:54369 -p 54370:54370 -p 54371:54371 -p 54372:54372 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=54370 --rest-port=54368 --tcp-port=54369 --discv5-udp-port=54371 --rest-address=0.0.0.0 --nat=extip:172.18.129.232 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=15e5f1559c67cf2b4ef2fc19eafbb79c4e86cabed1aa04cccabbeb8c119b3cfe --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=54372 --metrics-logging=true --relay=false --filternode=/ip4/172.18.100.94/tcp/10178/p2p/16Uiu2HAmRszn37C1odJ2FrZjxVJJAcN5ToaJFEVZyWj78exqeTC8 --store=false --discv5-bootstrap-node=enr:-L24QJCV8QrOBrnDwbxIazcqqrEwjM0dw5uBOUNc_FZ6W1GxBEulmTmsSnnuiIVU6ih1_HmvjgnuxPMPivR2MlqNnrQCgmlkgnY0gmlwhKwSpTeKbXVsdGlhZGRyc5YACASsEqU3Bv9lAAoErBKlNwb_Zt0DgnJzhQADAQAAiXNlY3AyNTZrMaED1r3HXh93xA7dcMkuKnLClocJr_-bAS6k-wZHm9-fe32DdGNwgv9lg3VkcIL_Z4V3YWt1MgU
2026-03-10 04:32:06.375 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.129.232 waku a76ffde16d9f10098f5e039786a2d0ff9965c527a976c55c425eb5a7aac053d8
2026-03-10 04:32:06.403 DEBUG [src.node.docker_mananger] Container started with ID a76ffde16d9f. Setting up logs at ./log/docker/node5_2026-03-10_04-32-01__cfa6d092-f99f-4176-9a05-4e4cfe55d7fb__wakuorg_nwaku:latest.log
2026-03-10 04:32:06.404 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 54368
2026-03-10 04:32:06.404 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-10 04:32:07.404 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54368/health" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:32:07.407 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-10 04:32:07.407 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-10 04:32:07.407 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54368/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:32:07.409 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.129.232/tcp/54369/p2p/16Uiu2HAm6LLLnPjHRV6xPdfHBNs3RpaoPeJyoBS3xwsnFQswCgKJ","/ip4/172.18.129.232/tcp/54370/ws/p2p/16Uiu2HAm6LLLnPjHRV6xPdfHBNs3RpaoPeJyoBS3xwsnFQswCgKJ"],"enrUri":"enr:-L24QFGrY3IectG3wOtnsidLxFM06zphNWXWfbrs1NGimLcgbY4hFtu_3tt2LZpRNv_xFXKLkdPI8qmAKJdY_y_XjWMCgmlkgnY0gmlwhKwSgeiKbXVsdGlhZGRyc5YACASsEoHoBtRhAAoErBKB6AbUYt0DgnJzhQADAQAAiXNlY3AyNTZrMaECohJygDDz_hjT0x3XvKHkqhIcY0gOH8OFtbagEbYtErmDdGNwgtRhg3VkcILUY4V3YWt1MgA"}'
2026-03-10 04:32:07.410 INFO [src.node.waku_node] REST service is ready !!
2026-03-10 04:32:07.410 DEBUG [tests.e2e.test_e2e] Subscribe nodes to relay pubsub topic /waku/2/rs/3/1
2026-03-10 04:32:07.410 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16334/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-10 04:32:07.413 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:32:07.413 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54582/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-10 04:32:07.420 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:32:07.422 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:65380/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-10 04:32:07.429 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:32:07.430 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10177/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-10 04:32:07.436 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:32:07.437 DEBUG [tests.e2e.test_e2e] Node5 makes filter request pubsubtopic /waku/2/rs/3/1 and content topic /test/1/waku-filter/proto
2026-03-10 04:32:07.437 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54368/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-10 04:32:07.476 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-03-10 04:32:07.477 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:16334/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:32:07.484 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.170.13/tcp/40360/p2p/16Uiu2HAkvbuCnttYsFKHyQ6mS5w9dX6xw7WKKkQ8ukydCPGKBYyf","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"}]'
2026-03-10 04:32:07.484 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54582/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:32:07.489 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.165.55/tcp/46610/p2p/16Uiu2HAmT7FSRwLTgt1oVCCpZn44Kt3ehLR2n1iCoUHDSxguhFLQ","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.37.47/tcp/16335/p2p/16Uiu2HAmNP55s6EimRRjMEqqrzMiqcycviJPHjPiqdUcTd8jcRk3","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"}]'
2026-03-10 04:32:07.490 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:65380/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:32:07.492 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.170.13/tcp/54583/p2p/16Uiu2HAkvbuCnttYsFKHyQ6mS5w9dX6xw7WKKkQ8ukydCPGKBYyf","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"},{"multiaddr":"/ip4/172.18.100.94/tcp/47732/p2p/16Uiu2HAmRszn37C1odJ2FrZjxVJJAcN5ToaJFEVZyWj78exqeTC8","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"}]'
2026-03-10 04:32:07.492 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10177/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:32:07.495 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.165.55/tcp/65381/p2p/16Uiu2HAmT7FSRwLTgt1oVCCpZn44Kt3ehLR2n1iCoUHDSxguhFLQ","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"},{"multiaddr":"/ip4/172.18.129.232/tcp/50902/p2p/16Uiu2HAm6LLLnPjHRV6xPdfHBNs3RpaoPeJyoBS3xwsnFQswCgKJ","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"}]'
2026-03-10 04:32:07.495 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54368/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:32:07.497 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.100.94/tcp/10178/p2p/16Uiu2HAmRszn37C1odJ2FrZjxVJJAcN5ToaJFEVZyWj78exqeTC8","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0,1],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.165.55/tcp/65381/p2p/16Uiu2HAmT7FSRwLTgt1oVCCpZn44Kt3ehLR2n1iCoUHDSxguhFLQ","protocols":["/vac/waku/relay/2.0.0","/vac/waku/filter-subscribe/2.0.0-beta1"],"shards":[0],"connected":"NotConnected","agent":"","origin":"Discv5"}]'
2026-03-10 04:32:07.497 DEBUG [src.libs.common] Sleeping for 60 seconds
2026-03-10 04:33:07.497 DEBUG [tests.e2e.test_e2e] 3 Nodes publish 12 message
2026-03-10 04:33:07.498 DEBUG [src.steps.store] Relaying message
2026-03-10 04:33:07.498 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16334/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:33:07.511 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:33:07.511 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-10 04:33:07.711 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-10 04:33:09.712 DEBUG [src.steps.store] Relaying message
2026-03-10 04:33:09.712 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16334/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:33:09.723 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:33:09.723 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-10 04:33:09.923 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-10 04:33:11.924 DEBUG [src.steps.store] Relaying message
2026-03-10 04:33:11.924 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16334/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:33:11.934 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:33:11.935 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-10 04:33:12.138 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-10 04:33:14.138 DEBUG [src.steps.store] Relaying message
2026-03-10 04:33:14.139 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:16334/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:33:14.147 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:33:14.148 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-10 04:33:14.350 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-10 04:33:16.351 DEBUG [src.steps.store] Relaying message
2026-03-10 04:33:16.351 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54582/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:33:16.360 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:33:16.361 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-10 04:33:16.562 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-10 04:33:18.562 DEBUG [src.steps.store] Relaying message
2026-03-10 04:33:18.562 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54582/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:33:18.571 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:33:18.572 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-10 04:33:18.773 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-10 04:33:20.774 DEBUG [src.steps.store] Relaying message
2026-03-10 04:33:20.775 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54582/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:33:20.784 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:33:20.785 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-10 04:33:20.985 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-10 04:33:22.986 DEBUG [src.steps.store] Relaying message
2026-03-10 04:33:22.986 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:54582/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:33:22.994 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:33:22.997 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-10 04:33:23.198 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-10 04:33:25.199 DEBUG [src.steps.store] Relaying message
2026-03-10 04:33:25.199 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:65380/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:33:25.211 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:33:25.211 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-10 04:33:25.412 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-10 04:33:27.413 DEBUG [src.steps.store] Relaying message
2026-03-10 04:33:27.413 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:65380/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:33:27.424 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:33:27.425 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-10 04:33:27.626 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-10 04:33:29.627 DEBUG [src.steps.store] Relaying message
2026-03-10 04:33:29.627 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:65380/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:33:29.636 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:33:29.636 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-10 04:33:29.837 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-10 04:33:31.838 DEBUG [src.steps.store] Relaying message
2026-03-10 04:33:31.838 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:65380/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-10 04:33:31.846 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-10 04:33:31.847 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-10 04:33:32.047 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-10 04:33:34.048 DEBUG [tests.e2e.test_e2e] Node5 requests messages of subscribed filter topic /waku/2/rs/3/1
2026-03-10 04:33:34.049 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:54368/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-10 04:33:34.054 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773117187498222153,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773117189712386264,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773117191924158676,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773117194138692461,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773117196350880580,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773117198562583473,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773117200774784105,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773117202985867597,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773117205199317298,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773117207413159361,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773117209627072258,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1773117211837884448,"ephemeral":false}]'
2026-03-10 04:33:34.054 DEBUG [tests.e2e.test_e2e] Response for node 5 is [{'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1773117187498222153, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1773117189712386264, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1773117191924158676, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1773117194138692461, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1773117196350880580, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1773117198562583473, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1773117200774784105, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1773117202985867597, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1773117205199317298, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1773117207413159361, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1773117209627072258, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1773117211837884448, 'ephemeral': False}]
2026-03-10 04:33:34.055 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-10 04:33:34.056 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-10 04:33:34.056 DEBUG [src.node.waku_node] Stopping container with id 4697ac2830e5
2026-03-10 04:33:34.526 DEBUG [src.node.waku_node] Container stopped.
2026-03-10 04:33:34.527 DEBUG [src.node.waku_node] Stopping container with id a81e74118be3
2026-03-10 04:33:35.014 DEBUG [src.node.waku_node] Container stopped.
2026-03-10 04:33:35.015 DEBUG [src.node.waku_node] Stopping container with id 462be4a97b3f
2026-03-10 04:33:35.456 DEBUG [src.node.waku_node] Container stopped.
2026-03-10 04:33:35.456 DEBUG [src.node.waku_node] Stopping container with id 641aa45599fc
2026-03-10 04:33:35.534 ERROR [src.node.docker_mananger] Max retries reached for container 4697ac2830e5. Exiting log stream.
2026-03-10 04:33:35.826 ERROR [src.node.docker_mananger] Max retries reached for container a81e74118be3. Exiting log stream.
2026-03-10 04:33:36.268 ERROR [src.node.docker_mananger] Max retries reached for container 462be4a97b3f. Exiting log stream.
2026-03-10 04:33:45.911 DEBUG [src.node.waku_node] Container stopped.
2026-03-10 04:33:45.911 DEBUG [src.node.waku_node] Stopping container with id a76ffde16d9f
2026-03-10 04:33:46.355 DEBUG [src.node.waku_node] Container stopped.
2026-03-10 04:33:46.357 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-10 04:33:46.490 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-10 04:33:46.561 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-10 04:33:46.631 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-10 04:33:46.717 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-10 04:33:46.738 DEBUG [src.node.docker_mananger] No errors found in the waku logs.