226 lines
45 KiB
Plaintext

2026-03-23 04:44:38.277 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-23 04:44:38.278 DEBUG [tests.conftest] Running test: test_filter_3_senders_multiple_msg_1_receiver with id: 2026-03-23_04-44-38__20d56bb5-22fa-48b7-99b1-583d90e65087
2026-03-23 04:44:38.278 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-23 04:44:38.278 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-23 04:44:38.278 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-23 04:44:38.286 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-23 04:44:38.286 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-23_04-44-38__20d56bb5-22fa-48b7-99b1-583d90e65087__wakuorg_nwaku:latest.log
2026-03-23 04:44:38.292 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-23 04:44:38.293 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-23_04-44-38__20d56bb5-22fa-48b7-99b1-583d90e65087__wakuorg_nwaku:latest.log
2026-03-23 04:44:38.299 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-23 04:44:38.300 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-23_04-44-38__20d56bb5-22fa-48b7-99b1-583d90e65087__wakuorg_nwaku:latest.log
2026-03-23 04:44:38.300 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-23 04:44:38.300 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-23 04:44:38.308 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-23 04:44:38.309 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-23_04-44-38__20d56bb5-22fa-48b7-99b1-583d90e65087__wakuorg_nwaku:latest.log
2026-03-23 04:44:38.315 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-23 04:44:38.315 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-23_04-44-38__20d56bb5-22fa-48b7-99b1-583d90e65087__wakuorg_nwaku:latest.log
2026-03-23 04:44:38.315 DEBUG [tests.e2e.test_e2e] Start 5 nodes
2026-03-23 04:44:38.316 DEBUG [src.node.waku_node] Starting Node...
2026-03-23 04:44:38.316 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-23 04:44:38.317 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-23 04:44:38.317 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.84.198
2026-03-23 04:44:38.318 DEBUG [src.node.docker_mananger] Generated ports ['34704', '34705', '34706', '34707', '34708']
2026-03-23 04:44:38.318 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-23 04:44:38.318 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-23 04:44:38.318 DEBUG [src.node.waku_node] Using volumes []
2026-03-23 04:44:38.318 DEBUG [src.node.docker_mananger] docker run -i -t -p 34704:34704 -p 34705:34705 -p 34706:34706 -p 34707:34707 -p 34708:34708 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=34706 --rest-port=34704 --tcp-port=34705 --discv5-udp-port=34707 --rest-address=0.0.0.0 --nat=extip:172.18.84.198 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=2a6ebaebb3ff509e76f62c09f470ec2016cfc78448224d4d00fabe04bceab6e5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=34708 --metrics-logging=true --relay=true --store=false
2026-03-23 04:44:38.507 ERROR [src.node.docker_mananger] Max retries reached for container 2f39bf8d129a. Exiting log stream.
2026-03-23 04:44:38.523 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.84.198 waku 4b33d1e25e97cc3923c8d1fbd9aae574c3544046015af4d73f006e6ce62abef8
2026-03-23 04:44:38.559 DEBUG [src.node.docker_mananger] Container started with ID 4b33d1e25e97. Setting up logs at ./log/docker/node1_2026-03-23_04-44-38__20d56bb5-22fa-48b7-99b1-583d90e65087__wakuorg_nwaku:latest.log
2026-03-23 04:44:38.559 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 34704
2026-03-23 04:44:38.559 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-23 04:44:39.061 ERROR [src.node.docker_mananger] Max retries reached for container 663c03c50520. Exiting log stream.
2026-03-23 04:44:39.560 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34704/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:44:39.563 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-23 04:44:39.563 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-23 04:44:39.564 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34704/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:44:39.566 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.84.198/tcp/34705/p2p/16Uiu2HAkxFaj1mzFiWXKkvAFK1wbzU2QDbqYtbuL9vrTnJXMjJQZ","/ip4/172.18.84.198/tcp/34706/ws/p2p/16Uiu2HAkxFaj1mzFiWXKkvAFK1wbzU2QDbqYtbuL9vrTnJXMjJQZ"],"enrUri":"enr:-L24QKE6-yNxRNO_wERzncnl9FZZbG_YjnJmZGZ_ZDcprhuXWs9vyAaQ2wR_PfAsWkA70JSASZeVG8o_UCurK6FE0-wCgmlkgnY0gmlwhKwSVMaKbXVsdGlhZGRyc5YACASsElTGBoeRAAoErBJUxgaHkt0DgnJzhQADAQAAiXNlY3AyNTZrMaECKf1PoOb2E8Wuqf_ya0vZieFVQ6oMh4hp-pUg7PlF2AqDdGNwgoeRg3VkcIKHk4V3YWt1MgE"}'
2026-03-23 04:44:39.566 INFO [src.node.waku_node] REST service is ready !!
2026-03-23 04:44:39.566 DEBUG [src.node.waku_node] Starting Node...
2026-03-23 04:44:39.566 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-23 04:44:39.568 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-23 04:44:39.568 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.100.214
2026-03-23 04:44:39.568 DEBUG [src.node.docker_mananger] Generated ports ['32666', '32667', '32668', '32669', '32670']
2026-03-23 04:44:39.568 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-23 04:44:39.568 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-23 04:44:39.569 DEBUG [src.node.waku_node] Using volumes []
2026-03-23 04:44:39.569 DEBUG [src.node.docker_mananger] docker run -i -t -p 32666:32666 -p 32667:32667 -p 32668:32668 -p 32669:32669 -p 32670:32670 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=32668 --rest-port=32666 --tcp-port=32667 --discv5-udp-port=32669 --rest-address=0.0.0.0 --nat=extip:172.18.100.214 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cccbed0e7c1b40dcf9abdcb5aa77053a7bbd9fc4fd9004c4cfbfbdb1cb7ad692 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=32670 --metrics-logging=true --relay=true --store=false --discv5-bootstrap-node=enr:-L24QKE6-yNxRNO_wERzncnl9FZZbG_YjnJmZGZ_ZDcprhuXWs9vyAaQ2wR_PfAsWkA70JSASZeVG8o_UCurK6FE0-wCgmlkgnY0gmlwhKwSVMaKbXVsdGlhZGRyc5YACASsElTGBoeRAAoErBJUxgaHkt0DgnJzhQADAQAAiXNlY3AyNTZrMaECKf1PoOb2E8Wuqf_ya0vZieFVQ6oMh4hp-pUg7PlF2AqDdGNwgoeRg3VkcIKHk4V3YWt1MgE
2026-03-23 04:44:39.768 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.100.214 waku 545e446096d07cbe190cfa45efb58e338097ef16237f6db93787ba59444e8756
2026-03-23 04:44:39.803 DEBUG [src.node.docker_mananger] Container started with ID 545e446096d0. Setting up logs at ./log/docker/node2_2026-03-23_04-44-38__20d56bb5-22fa-48b7-99b1-583d90e65087__wakuorg_nwaku:latest.log
2026-03-23 04:44:39.803 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 32666
2026-03-23 04:44:39.803 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-23 04:44:40.804 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32666/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:44:40.831 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-23 04:44:40.832 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-23 04:44:40.834 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32666/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:44:40.840 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.100.214/tcp/32667/p2p/16Uiu2HAmPDTBDaoGsCoKNaPQdQfq98XAribA92TUtZfwdQB8fagv","/ip4/172.18.100.214/tcp/32668/ws/p2p/16Uiu2HAmPDTBDaoGsCoKNaPQdQfq98XAribA92TUtZfwdQB8fagv"],"enrUri":"enr:-L24QFP2odGpQEYXdq3DTbk0d_fGmkM--JxOE7JyWkf-fsv_TwFzVXSzEXeC1m0-u2D69_nQA_CHazZV8AIW-OiDQq0CgmlkgnY0gmlwhKwSZNaKbXVsdGlhZGRyc5YACASsEmTWBn-bAAoErBJk1gZ_nN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDnOXJrQdaqWVFcbA32hn12kE512JqGhcjKZwiA_eO1A-DdGNwgn-bg3VkcIJ_nYV3YWt1MgE"}'
2026-03-23 04:44:40.840 INFO [src.node.waku_node] REST service is ready !!
2026-03-23 04:44:40.840 DEBUG [src.node.waku_node] Starting Node...
2026-03-23 04:44:40.841 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-23 04:44:40.845 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-23 04:44:40.846 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.225.18
2026-03-23 04:44:40.846 DEBUG [src.node.docker_mananger] Generated ports ['30455', '30456', '30457', '30458', '30459']
2026-03-23 04:44:40.847 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-23 04:44:40.847 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-23 04:44:40.847 DEBUG [src.node.waku_node] Using volumes []
2026-03-23 04:44:40.847 DEBUG [src.node.docker_mananger] docker run -i -t -p 30455:30455 -p 30456:30456 -p 30457:30457 -p 30458:30458 -p 30459:30459 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=30457 --rest-port=30455 --tcp-port=30456 --discv5-udp-port=30458 --rest-address=0.0.0.0 --nat=extip:172.18.225.18 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=46d3d17fca15cf270b8b9df96e8e17ce62ebcb242f55228cedd8a9fccdadb8f2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=30459 --metrics-logging=true --relay=true --store=false --filter=true --discv5-bootstrap-node=enr:-L24QFP2odGpQEYXdq3DTbk0d_fGmkM--JxOE7JyWkf-fsv_TwFzVXSzEXeC1m0-u2D69_nQA_CHazZV8AIW-OiDQq0CgmlkgnY0gmlwhKwSZNaKbXVsdGlhZGRyc5YACASsEmTWBn-bAAoErBJk1gZ_nN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDnOXJrQdaqWVFcbA32hn12kE512JqGhcjKZwiA_eO1A-DdGNwgn-bg3VkcIJ_nYV3YWt1MgE
2026-03-23 04:44:41.037 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.225.18 waku f1e1cd2aebd052c031deb221da186d1a33c1f428447a188d06ced4b7590d1ce8
2026-03-23 04:44:41.075 DEBUG [src.node.docker_mananger] Container started with ID f1e1cd2aebd0. Setting up logs at ./log/docker/node3_2026-03-23_04-44-38__20d56bb5-22fa-48b7-99b1-583d90e65087__wakuorg_nwaku:latest.log
2026-03-23 04:44:41.076 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 30455
2026-03-23 04:44:41.077 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-23 04:44:42.077 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30455/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:44:42.096 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-23 04:44:42.097 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-23 04:44:42.097 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30455/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:44:42.101 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.225.18/tcp/30456/p2p/16Uiu2HAm9hNWDem2X9LYmzsvn7oNizbRdEU8gdHUsFp4KhPBEW4x","/ip4/172.18.225.18/tcp/30457/ws/p2p/16Uiu2HAm9hNWDem2X9LYmzsvn7oNizbRdEU8gdHUsFp4KhPBEW4x"],"enrUri":"enr:-L24QFdYA92nGUUftcsD0qaip_FzJSaSIOVrw8aqVCgRsfa0Cd60ONqK1mNhmeZCCFVrJr9NbsvOxlcf4e7STt4M3TECgmlkgnY0gmlwhKwS4RKKbXVsdGlhZGRyc5YACASsEuESBnb4AAoErBLhEgZ2-d0DgnJzhQADAQAAiXNlY3AyNTZrMaEC1Akmf-yF52_0x9vikmlDmuW-Dvlw7BUv1afXYUjeyGGDdGNwgnb4g3VkcIJ2-oV3YWt1MgU"}'
2026-03-23 04:44:42.102 INFO [src.node.waku_node] REST service is ready !!
2026-03-23 04:44:42.103 DEBUG [src.node.waku_node] Starting Node...
2026-03-23 04:44:42.103 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-23 04:44:42.105 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-23 04:44:42.106 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.177.68
2026-03-23 04:44:42.106 DEBUG [src.node.docker_mananger] Generated ports ['44498', '44499', '44500', '44501', '44502']
2026-03-23 04:44:42.107 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-23 04:44:42.107 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-23 04:44:42.107 DEBUG [src.node.waku_node] Using volumes []
2026-03-23 04:44:42.107 DEBUG [src.node.docker_mananger] docker run -i -t -p 44498:44498 -p 44499:44499 -p 44500:44500 -p 44501:44501 -p 44502:44502 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=44500 --rest-port=44498 --tcp-port=44499 --discv5-udp-port=44501 --rest-address=0.0.0.0 --nat=extip:172.18.177.68 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=171b8e45c0aae9ec27f79efda5fdecb853127843621a71262a0b3ba4822c1c12 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=44502 --metrics-logging=true --relay=true --filter=true --store=false --discv5-bootstrap-node=enr:-L24QFdYA92nGUUftcsD0qaip_FzJSaSIOVrw8aqVCgRsfa0Cd60ONqK1mNhmeZCCFVrJr9NbsvOxlcf4e7STt4M3TECgmlkgnY0gmlwhKwS4RKKbXVsdGlhZGRyc5YACASsEuESBnb4AAoErBLhEgZ2-d0DgnJzhQADAQAAiXNlY3AyNTZrMaEC1Akmf-yF52_0x9vikmlDmuW-Dvlw7BUv1afXYUjeyGGDdGNwgnb4g3VkcIJ2-oV3YWt1MgU
2026-03-23 04:44:42.322 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.177.68 waku 1a503d2e8ef86abd73d5fb4b9fc3aad496a110fe685d829b66b9a8ea326257b5
2026-03-23 04:44:42.359 DEBUG [src.node.docker_mananger] Container started with ID 1a503d2e8ef8. Setting up logs at ./log/docker/node4_2026-03-23_04-44-38__20d56bb5-22fa-48b7-99b1-583d90e65087__wakuorg_nwaku:latest.log
2026-03-23 04:44:42.359 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 44498
2026-03-23 04:44:42.359 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-23 04:44:43.361 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44498/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:44:43.376 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-23 04:44:43.376 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-23 04:44:43.376 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44498/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:44:43.384 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.177.68/tcp/44499/p2p/16Uiu2HAm3Hds8vPsNFEH4tfChdh829kTzzzp2gqFXV9yH29y2BYi","/ip4/172.18.177.68/tcp/44500/ws/p2p/16Uiu2HAm3Hds8vPsNFEH4tfChdh829kTzzzp2gqFXV9yH29y2BYi"],"enrUri":"enr:-L24QBaBYTfuW787XL5ZqVI0q6SF3iiImBR4V7ddKGt5oTx7VjWQJ56Gm3i4K4tpB3TARpa5vS5QRFJFJTzBhilRpx0CgmlkgnY0gmlwhKwSsUSKbXVsdGlhZGRyc5YACASsErFEBq3TAAoErBKxRAat1N0DgnJzhQADAQAAiXNlY3AyNTZrMaECdM51MG-E2ART4DNTemqC0yu6W1zPcCYyAKZ1CsS3o3-DdGNwgq3Tg3VkcIKt1YV3YWt1MgU"}'
2026-03-23 04:44:43.384 INFO [src.node.waku_node] REST service is ready !!
2026-03-23 04:44:43.385 DEBUG [src.node.waku_node] Starting Node...
2026-03-23 04:44:43.385 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-23 04:44:43.388 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-23 04:44:43.388 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.33.106
2026-03-23 04:44:43.389 DEBUG [src.node.docker_mananger] Generated ports ['6495', '6496', '6497', '6498', '6499']
2026-03-23 04:44:43.389 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-23 04:44:43.389 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-23 04:44:43.390 DEBUG [src.node.waku_node] Using volumes []
2026-03-23 04:44:43.390 DEBUG [src.node.docker_mananger] docker run -i -t -p 6495:6495 -p 6496:6496 -p 6497:6497 -p 6498:6498 -p 6499:6499 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=6497 --rest-port=6495 --tcp-port=6496 --discv5-udp-port=6498 --rest-address=0.0.0.0 --nat=extip:172.18.33.106 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bca03733add52ea96dcedcd7fcdc4de4716fde6f5218e68edc64b0afdceefdfc --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=6499 --metrics-logging=true --relay=false --filternode=/ip4/172.18.177.68/tcp/44499/p2p/16Uiu2HAm3Hds8vPsNFEH4tfChdh829kTzzzp2gqFXV9yH29y2BYi --store=false --discv5-bootstrap-node=enr:-L24QFdYA92nGUUftcsD0qaip_FzJSaSIOVrw8aqVCgRsfa0Cd60ONqK1mNhmeZCCFVrJr9NbsvOxlcf4e7STt4M3TECgmlkgnY0gmlwhKwS4RKKbXVsdGlhZGRyc5YACASsEuESBnb4AAoErBLhEgZ2-d0DgnJzhQADAQAAiXNlY3AyNTZrMaEC1Akmf-yF52_0x9vikmlDmuW-Dvlw7BUv1afXYUjeyGGDdGNwgnb4g3VkcIJ2-oV3YWt1MgU
2026-03-23 04:44:43.595 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.33.106 waku 26af075457ee8ebccc507c09e81a7746f9a1e2de1d5d33ce41b3c0dc2a0835f4
2026-03-23 04:44:43.632 DEBUG [src.node.docker_mananger] Container started with ID 26af075457ee. Setting up logs at ./log/docker/node5_2026-03-23_04-44-38__20d56bb5-22fa-48b7-99b1-583d90e65087__wakuorg_nwaku:latest.log
2026-03-23 04:44:43.632 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 6495
2026-03-23 04:44:43.633 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-23 04:44:44.633 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6495/health" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:44:44.636 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-23 04:44:44.637 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-23 04:44:44.637 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6495/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:44:44.639 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.33.106/tcp/6496/p2p/16Uiu2HAmKHhSkKv2vBGBv2aCnJpEuzVWJ5myPLiNr1hJ5XngAYnL","/ip4/172.18.33.106/tcp/6497/ws/p2p/16Uiu2HAmKHhSkKv2vBGBv2aCnJpEuzVWJ5myPLiNr1hJ5XngAYnL"],"enrUri":"enr:-L24QFgPD_t5VBCacKfta-9NIBtPpOqLLchON6kS_zB8hZt2Lpe7btIoQt-3hu9U1Ty3Gl7fmlxYQGDEm7r-cksXk60CgmlkgnY0gmlwhKwSIWqKbXVsdGlhZGRyc5YACASsEiFqBhlgAAoErBIhagYZYd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDYo1-9ZHHybMF2XUU06oKL0eBFYYeMId9PLUqJFAddhmDdGNwghlgg3VkcIIZYoV3YWt1MgA"}'
2026-03-23 04:44:44.639 INFO [src.node.waku_node] REST service is ready !!
2026-03-23 04:44:44.640 DEBUG [tests.e2e.test_e2e] Subscribe nodes to relay pubsub topic /waku/2/rs/3/1
2026-03-23 04:44:44.640 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34704/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-23 04:44:44.644 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:44:44.644 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32666/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-23 04:44:44.653 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:44:44.654 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30455/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-23 04:44:44.659 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:44:44.661 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44498/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-23 04:44:44.669 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:44:44.670 DEBUG [tests.e2e.test_e2e] Node5 makes filter request pubsubtopic /waku/2/rs/3/1 and content topic /test/1/waku-filter/proto
2026-03-23 04:44:44.670 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:6495/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-23 04:44:44.716 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-03-23 04:44:44.717 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34704/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:44:44.723 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.100.214/tcp/33764/p2p/16Uiu2HAmPDTBDaoGsCoKNaPQdQfq98XAribA92TUtZfwdQB8fagv","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-2-g85a7bf","origin":"UnknownOrigin"}]'
2026-03-23 04:44:44.723 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:32666/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:44:44.728 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.84.198/tcp/34705/p2p/16Uiu2HAkxFaj1mzFiWXKkvAFK1wbzU2QDbqYtbuL9vrTnJXMjJQZ","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-2-g85a7bf","origin":"Discv5"},{"multiaddr":"/ip4/172.18.225.18/tcp/45848/p2p/16Uiu2HAm9hNWDem2X9LYmzsvn7oNizbRdEU8gdHUsFp4KhPBEW4x","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-2-g85a7bf","origin":"UnknownOrigin"}]'
2026-03-23 04:44:44.730 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30455/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:44:44.734 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.177.68/tcp/37578/p2p/16Uiu2HAm3Hds8vPsNFEH4tfChdh829kTzzzp2gqFXV9yH29y2BYi","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-2-g85a7bf","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.100.214/tcp/32667/p2p/16Uiu2HAmPDTBDaoGsCoKNaPQdQfq98XAribA92TUtZfwdQB8fagv","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-2-g85a7bf","origin":"Discv5"}]'
2026-03-23 04:44:44.734 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44498/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:44:44.739 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.33.106/tcp/34188/p2p/16Uiu2HAmKHhSkKv2vBGBv2aCnJpEuzVWJ5myPLiNr1hJ5XngAYnL","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-2-g85a7bf","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.225.18/tcp/30456/p2p/16Uiu2HAm9hNWDem2X9LYmzsvn7oNizbRdEU8gdHUsFp4KhPBEW4x","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-2-g85a7bf","origin":"Discv5"}]'
2026-03-23 04:44:44.740 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6495/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:44:44.742 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.225.18/tcp/30456/p2p/16Uiu2HAm9hNWDem2X9LYmzsvn7oNizbRdEU8gdHUsFp4KhPBEW4x","protocols":["/vac/waku/relay/2.0.0","/vac/waku/filter-subscribe/2.0.0-beta1"],"shards":[0],"connected":"NotConnected","agent":"","origin":"Discv5"},{"multiaddr":"/ip4/172.18.177.68/tcp/44499/p2p/16Uiu2HAm3Hds8vPsNFEH4tfChdh829kTzzzp2gqFXV9yH29y2BYi","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0,1],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-2-g85a7bf","origin":"UnknownOrigin"}]'
2026-03-23 04:44:44.743 DEBUG [src.libs.common] Sleeping for 60 seconds
2026-03-23 04:45:44.743 DEBUG [tests.e2e.test_e2e] 3 Nodes publish 12 message
2026-03-23 04:45:44.744 DEBUG [src.steps.store] Relaying message
2026-03-23 04:45:44.744 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34704/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-23 04:45:44.753 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:45:44.756 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-23 04:45:44.958 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-23 04:45:46.959 DEBUG [src.steps.store] Relaying message
2026-03-23 04:45:46.959 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34704/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-23 04:45:46.973 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:45:46.975 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-23 04:45:47.176 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-23 04:45:49.177 DEBUG [src.steps.store] Relaying message
2026-03-23 04:45:49.177 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34704/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-23 04:45:49.186 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:45:49.187 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-23 04:45:49.388 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-23 04:45:51.388 DEBUG [src.steps.store] Relaying message
2026-03-23 04:45:51.389 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34704/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-23 04:45:51.400 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:45:51.405 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-23 04:45:51.605 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-23 04:45:53.606 DEBUG [src.steps.store] Relaying message
2026-03-23 04:45:53.606 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32666/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-23 04:45:53.617 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:45:53.620 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-23 04:45:53.822 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-23 04:45:55.823 DEBUG [src.steps.store] Relaying message
2026-03-23 04:45:55.823 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32666/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-23 04:45:55.833 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:45:55.837 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-23 04:45:56.038 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-23 04:45:58.039 DEBUG [src.steps.store] Relaying message
2026-03-23 04:45:58.039 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32666/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-23 04:45:58.050 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:45:58.052 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-23 04:45:58.254 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-23 04:46:00.255 DEBUG [src.steps.store] Relaying message
2026-03-23 04:46:00.255 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:32666/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-23 04:46:00.265 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:46:00.267 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-23 04:46:00.471 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-23 04:46:02.472 DEBUG [src.steps.store] Relaying message
2026-03-23 04:46:02.475 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30455/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-23 04:46:02.485 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:46:02.490 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-23 04:46:02.693 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-23 04:46:04.693 DEBUG [src.steps.store] Relaying message
2026-03-23 04:46:04.694 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30455/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-23 04:46:04.703 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:46:04.703 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-23 04:46:04.903 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-23 04:46:06.904 DEBUG [src.steps.store] Relaying message
2026-03-23 04:46:06.905 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30455/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-23 04:46:06.914 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:46:06.917 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-23 04:46:07.118 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-23 04:46:09.119 DEBUG [src.steps.store] Relaying message
2026-03-23 04:46:09.119 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30455/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-23 04:46:09.131 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-23 04:46:09.133 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-23 04:46:09.337 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-23 04:46:11.337 DEBUG [tests.e2e.test_e2e] Node5 requests messages of subscribed filter topic /waku/2/rs/3/1
2026-03-23 04:46:11.338 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:6495/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-23 04:46:11.341 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774241144743817248,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774241146959015801,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774241149176790532,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774241151388602761,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774241153606352237,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774241155822844395,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774241158039083866,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774241160254818778,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774241162472121000,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774241164693743764,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774241166904457111,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774241169119151874,"ephemeral":false}]'
2026-03-23 04:46:11.341 DEBUG [tests.e2e.test_e2e] Response for node 5 is [{'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774241144743817248, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774241146959015801, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774241149176790532, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774241151388602761, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774241153606352237, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774241155822844395, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774241158039083866, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774241160254818778, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774241162472121000, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774241164693743764, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774241166904457111, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774241169119151874, 'ephemeral': False}]
2026-03-23 04:46:11.343 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-23 04:46:11.344 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-23 04:46:11.344 DEBUG [src.node.waku_node] Stopping container with id 4b33d1e25e97
2026-03-23 04:46:11.939 DEBUG [src.node.waku_node] Container stopped.
2026-03-23 04:46:11.942 DEBUG [src.node.waku_node] Stopping container with id 545e446096d0
2026-03-23 04:46:12.565 DEBUG [src.node.waku_node] Container stopped.
2026-03-23 04:46:12.566 DEBUG [src.node.waku_node] Stopping container with id f1e1cd2aebd0
2026-03-23 04:46:12.759 ERROR [src.node.docker_mananger] Max retries reached for container 4b33d1e25e97. Exiting log stream.
2026-03-23 04:46:13.155 DEBUG [src.node.waku_node] Container stopped.
2026-03-23 04:46:13.155 DEBUG [src.node.waku_node] Stopping container with id 1a503d2e8ef8
2026-03-23 04:46:13.383 ERROR [src.node.docker_mananger] Max retries reached for container 545e446096d0. Exiting log stream.
2026-03-23 04:46:13.721 DEBUG [src.node.waku_node] Container stopped.
2026-03-23 04:46:13.722 DEBUG [src.node.waku_node] Stopping container with id 26af075457ee
2026-03-23 04:46:13.975 ERROR [src.node.docker_mananger] Max retries reached for container f1e1cd2aebd0. Exiting log stream.
2026-03-23 04:46:14.822 ERROR [src.node.docker_mananger] Max retries reached for container 1a503d2e8ef8. Exiting log stream.
2026-03-23 04:46:24.285 DEBUG [src.node.waku_node] Container stopped.
2026-03-23 04:46:24.287 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-23 04:46:24.360 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-23 04:46:24.432 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-23 04:46:24.505 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-23 04:46:24.684 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-23 04:46:24.708 DEBUG [src.node.docker_mananger] No errors found in the waku logs.