226 lines
45 KiB
Plaintext

2026-03-07 04:29:38.173 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-07 04:29:38.174 DEBUG [tests.conftest] Running test: test_filter_3_senders_multiple_msg_1_receiver with id: 2026-03-07_04-29-38__03f66680-4351-4b15-b5a8-46b7d275cb1f
2026-03-07 04:29:38.174 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-07 04:29:38.174 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-07 04:29:38.175 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-07 04:29:38.182 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:29:38.182 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-07_04-29-38__03f66680-4351-4b15-b5a8-46b7d275cb1f__wakuorg_nwaku:latest.log
2026-03-07 04:29:38.189 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:29:38.189 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-07_04-29-38__03f66680-4351-4b15-b5a8-46b7d275cb1f__wakuorg_nwaku:latest.log
2026-03-07 04:29:38.197 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:29:38.198 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-07_04-29-38__03f66680-4351-4b15-b5a8-46b7d275cb1f__wakuorg_nwaku:latest.log
2026-03-07 04:29:38.198 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-07 04:29:38.199 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-07 04:29:38.207 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:29:38.207 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-07_04-29-38__03f66680-4351-4b15-b5a8-46b7d275cb1f__wakuorg_nwaku:latest.log
2026-03-07 04:29:38.214 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:29:38.214 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-07_04-29-38__03f66680-4351-4b15-b5a8-46b7d275cb1f__wakuorg_nwaku:latest.log
2026-03-07 04:29:38.214 DEBUG [tests.e2e.test_e2e] Start 5 nodes
2026-03-07 04:29:38.215 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:29:38.215 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:29:38.216 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:29:38.216 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.109.48
2026-03-07 04:29:38.216 DEBUG [src.node.docker_mananger] Generated ports ['38379', '38380', '38381', '38382', '38383']
2026-03-07 04:29:38.217 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:29:38.217 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:29:38.217 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:29:38.217 DEBUG [src.node.docker_mananger] docker run -i -t -p 38379:38379 -p 38380:38380 -p 38381:38381 -p 38382:38382 -p 38383:38383 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=38381 --rest-port=38379 --tcp-port=38380 --discv5-udp-port=38382 --rest-address=0.0.0.0 --nat=extip:172.18.109.48 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=aab86bbc888bd6efbc3daa207b9a7e5c13db64bce2bacd81baa9db580f0ebb1c --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=38383 --metrics-logging=true --relay=true --store=false
2026-03-07 04:29:38.401 ERROR [src.node.docker_mananger] Max retries reached for container 7598cec881f0. Exiting log stream.
2026-03-07 04:29:38.426 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.109.48 waku fa5cb55d5e59640dd90a7ee3bf9b89cdadc07378e0fb7a26c23a310ff114fb14
2026-03-07 04:29:38.467 DEBUG [src.node.docker_mananger] Container started with ID fa5cb55d5e59. Setting up logs at ./log/docker/node1_2026-03-07_04-29-38__03f66680-4351-4b15-b5a8-46b7d275cb1f__wakuorg_nwaku:latest.log
2026-03-07 04:29:38.467 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 38379
2026-03-07 04:29:38.467 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:29:38.976 ERROR [src.node.docker_mananger] Max retries reached for container bc9ece04a608. Exiting log stream.
2026-03-07 04:29:39.468 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38379/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:39.471 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:29:39.471 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:29:39.472 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38379/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:39.474 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.109.48/tcp/38380/p2p/16Uiu2HAmDJXCErCM4aju4JAyALUS79cSSpRuDwxyXmykQxSpuRd3","/ip4/172.18.109.48/tcp/38381/ws/p2p/16Uiu2HAmDJXCErCM4aju4JAyALUS79cSSpRuDwxyXmykQxSpuRd3"],"enrUri":"enr:-L24QJKL7rrj55gr4taOnWmkLxSrjhgcVpfbSeASk12Oi9RTEA7CCtWJGEXhB6PGoVfl6lyVSQIzLZQyxKHfiTs9tvcCgmlkgnY0gmlwhKwSbTCKbXVsdGlhZGRyc5YACASsEm0wBpXsAAoErBJtMAaV7d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDCZ1dhSaciF_H63QVGqOLFEqaCKvYoPmM7sU_Mu_YmnqDdGNwgpXsg3VkcIKV7oV3YWt1MgE"}'
2026-03-07 04:29:39.474 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:29:39.474 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:29:39.475 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:29:39.476 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:29:39.476 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.55.57
2026-03-07 04:29:39.476 DEBUG [src.node.docker_mananger] Generated ports ['55583', '55584', '55585', '55586', '55587']
2026-03-07 04:29:39.477 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:29:39.477 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:29:39.477 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:29:39.477 DEBUG [src.node.docker_mananger] docker run -i -t -p 55583:55583 -p 55584:55584 -p 55585:55585 -p 55586:55586 -p 55587:55587 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=55585 --rest-port=55583 --tcp-port=55584 --discv5-udp-port=55586 --rest-address=0.0.0.0 --nat=extip:172.18.55.57 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=aec86ab44cf930e8f5e62b3618e5afc525eebbf9ecddcc1ff328fda6fdd6ff33 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=55587 --metrics-logging=true --relay=true --store=false --discv5-bootstrap-node=enr:-L24QJKL7rrj55gr4taOnWmkLxSrjhgcVpfbSeASk12Oi9RTEA7CCtWJGEXhB6PGoVfl6lyVSQIzLZQyxKHfiTs9tvcCgmlkgnY0gmlwhKwSbTCKbXVsdGlhZGRyc5YACASsEm0wBpXsAAoErBJtMAaV7d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDCZ1dhSaciF_H63QVGqOLFEqaCKvYoPmM7sU_Mu_YmnqDdGNwgpXsg3VkcIKV7oV3YWt1MgE
2026-03-07 04:29:39.674 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.55.57 waku 55c8c1779448e015fbb2e063e9f634108245fe70a01d16548e0310152dea768b
2026-03-07 04:29:39.712 DEBUG [src.node.docker_mananger] Container started with ID 55c8c1779448. Setting up logs at ./log/docker/node2_2026-03-07_04-29-38__03f66680-4351-4b15-b5a8-46b7d275cb1f__wakuorg_nwaku:latest.log
2026-03-07 04:29:39.713 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 55583
2026-03-07 04:29:39.713 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:29:40.714 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55583/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:40.731 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:29:40.732 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:29:40.732 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55583/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:40.740 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.55.57/tcp/55584/p2p/16Uiu2HAmSFnBfah7cyWE4YpRHHJxs8n3EKe36q9Wqv1kXDGJEpjy","/ip4/172.18.55.57/tcp/55585/ws/p2p/16Uiu2HAmSFnBfah7cyWE4YpRHHJxs8n3EKe36q9Wqv1kXDGJEpjy"],"enrUri":"enr:-L24QDZclBdR605rVa6-p9_KM5HpTHtYMPl0IK1XiRyO1CnOJ5wddpD0je5kul4uJKBMX506gTVKXPoTAjvpTx901pwCgmlkgnY0gmlwhKwSNzmKbXVsdGlhZGRyc5YACASsEjc5BtkgAAoErBI3OQbZId0DgnJzhQADAQAAiXNlY3AyNTZrMaEDyhGAlsYnVB4PCSdvxcU94c4l-TBZt3lhfCOjaczuXtCDdGNwgtkgg3VkcILZIoV3YWt1MgE"}'
2026-03-07 04:29:40.741 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:29:40.742 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:29:40.742 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:29:40.745 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:29:40.746 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.165.0
2026-03-07 04:29:40.746 DEBUG [src.node.docker_mananger] Generated ports ['55483', '55484', '55485', '55486', '55487']
2026-03-07 04:29:40.746 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:29:40.746 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:29:40.746 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:29:40.746 DEBUG [src.node.docker_mananger] docker run -i -t -p 55483:55483 -p 55484:55484 -p 55485:55485 -p 55486:55486 -p 55487:55487 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=55485 --rest-port=55483 --tcp-port=55484 --discv5-udp-port=55486 --rest-address=0.0.0.0 --nat=extip:172.18.165.0 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=3cc57ffd9d5b813b1dffc970adccc10be86dcecceea6ec0f3cde2efcddfcf3c6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=55487 --metrics-logging=true --relay=true --store=false --filter=true --discv5-bootstrap-node=enr:-L24QDZclBdR605rVa6-p9_KM5HpTHtYMPl0IK1XiRyO1CnOJ5wddpD0je5kul4uJKBMX506gTVKXPoTAjvpTx901pwCgmlkgnY0gmlwhKwSNzmKbXVsdGlhZGRyc5YACASsEjc5BtkgAAoErBI3OQbZId0DgnJzhQADAQAAiXNlY3AyNTZrMaEDyhGAlsYnVB4PCSdvxcU94c4l-TBZt3lhfCOjaczuXtCDdGNwgtkgg3VkcILZIoV3YWt1MgE
2026-03-07 04:29:40.959 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.165.0 waku e77c268fd6a2e8149c82b453531502397e3c051441884db4474f799667683d00
2026-03-07 04:29:40.997 DEBUG [src.node.docker_mananger] Container started with ID e77c268fd6a2. Setting up logs at ./log/docker/node3_2026-03-07_04-29-38__03f66680-4351-4b15-b5a8-46b7d275cb1f__wakuorg_nwaku:latest.log
2026-03-07 04:29:40.998 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 55483
2026-03-07 04:29:40.998 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:29:41.998 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55483/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:42.015 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:29:42.017 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:29:42.017 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55483/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:42.022 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.165.0/tcp/55484/p2p/16Uiu2HAmLNjbQSpLL4EBzKtcbb8unyzijfiR95bhFJztULGgL1oE","/ip4/172.18.165.0/tcp/55485/ws/p2p/16Uiu2HAmLNjbQSpLL4EBzKtcbb8unyzijfiR95bhFJztULGgL1oE"],"enrUri":"enr:-L24QJY0IHL-Qm-AhdXERzvlv2KKEXQH7SU502tFwTF1NXR7SrKiD8Y0JL_ZwNJmDT3sMdhVuGPEeTRRh0T3E1bbs9sCgmlkgnY0gmlwhKwSpQCKbXVsdGlhZGRyc5YACASsEqUABti8AAoErBKlAAbYvd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDcrOEX7Fi1KC5BcbOKdtv9gY309QAsm6fl_zJ6TJqAIGDdGNwgti8g3VkcILYvoV3YWt1MgU"}'
2026-03-07 04:29:42.022 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:29:42.022 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:29:42.022 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:29:42.024 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:29:42.024 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.68.138
2026-03-07 04:29:42.024 DEBUG [src.node.docker_mananger] Generated ports ['8399', '8400', '8401', '8402', '8403']
2026-03-07 04:29:42.024 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:29:42.024 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:29:42.025 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:29:42.025 DEBUG [src.node.docker_mananger] docker run -i -t -p 8399:8399 -p 8400:8400 -p 8401:8401 -p 8402:8402 -p 8403:8403 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=8401 --rest-port=8399 --tcp-port=8400 --discv5-udp-port=8402 --rest-address=0.0.0.0 --nat=extip:172.18.68.138 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=5af1aef738ecb56a10cb2fac1ad00f67027b61bf210ad6a461cc41dcfce81c62 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=8403 --metrics-logging=true --relay=true --filter=true --store=false --discv5-bootstrap-node=enr:-L24QJY0IHL-Qm-AhdXERzvlv2KKEXQH7SU502tFwTF1NXR7SrKiD8Y0JL_ZwNJmDT3sMdhVuGPEeTRRh0T3E1bbs9sCgmlkgnY0gmlwhKwSpQCKbXVsdGlhZGRyc5YACASsEqUABti8AAoErBKlAAbYvd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDcrOEX7Fi1KC5BcbOKdtv9gY309QAsm6fl_zJ6TJqAIGDdGNwgti8g3VkcILYvoV3YWt1MgU
2026-03-07 04:29:42.240 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.68.138 waku d7a72fac168bb27722e791cdad79dc7256e8a6bcc0e01b6728e07c7767e1ca85
2026-03-07 04:29:42.276 DEBUG [src.node.docker_mananger] Container started with ID d7a72fac168b. Setting up logs at ./log/docker/node4_2026-03-07_04-29-38__03f66680-4351-4b15-b5a8-46b7d275cb1f__wakuorg_nwaku:latest.log
2026-03-07 04:29:42.277 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 8399
2026-03-07 04:29:42.277 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:29:43.278 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8399/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:43.294 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:29:43.295 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:29:43.297 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8399/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:43.304 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.68.138/tcp/8400/p2p/16Uiu2HAkuwiRBBTsEjKCsTaxHcZmNDapdcLcRrwbhDamiyKUvsF3","/ip4/172.18.68.138/tcp/8401/ws/p2p/16Uiu2HAkuwiRBBTsEjKCsTaxHcZmNDapdcLcRrwbhDamiyKUvsF3"],"enrUri":"enr:-L24QGtTxJ3XqnSEsOS7nkdnFyf9DTtrU0-tg665bTx6_AEhTv1Or_A9lmC2YPEz_PB2ysKprsgNlFT30mEGeDBAh2YCgmlkgnY0gmlwhKwSRIqKbXVsdGlhZGRyc5YACASsEkSKBiDQAAoErBJEigYg0d0DgnJzhQADAQAAiXNlY3AyNTZrMaECB7IuNjfljkaL62I5hxTM390DmwguF-PDKNpbkl1ghu6DdGNwgiDQg3VkcIIg0oV3YWt1MgU"}'
2026-03-07 04:29:43.305 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:29:43.305 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:29:43.306 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:29:43.309 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:29:43.309 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.133.210
2026-03-07 04:29:43.309 DEBUG [src.node.docker_mananger] Generated ports ['3435', '3436', '3437', '3438', '3439']
2026-03-07 04:29:43.310 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:29:43.310 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:29:43.310 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:29:43.310 DEBUG [src.node.docker_mananger] docker run -i -t -p 3435:3435 -p 3436:3436 -p 3437:3437 -p 3438:3438 -p 3439:3439 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3437 --rest-port=3435 --tcp-port=3436 --discv5-udp-port=3438 --rest-address=0.0.0.0 --nat=extip:172.18.133.210 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e6a6dfbb44ba09bd8273cfa6aee6fb8a04d46efdebe73203ce0a6ee23edb2dba --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3439 --metrics-logging=true --relay=false --filternode=/ip4/172.18.68.138/tcp/8400/p2p/16Uiu2HAkuwiRBBTsEjKCsTaxHcZmNDapdcLcRrwbhDamiyKUvsF3 --store=false --discv5-bootstrap-node=enr:-L24QJY0IHL-Qm-AhdXERzvlv2KKEXQH7SU502tFwTF1NXR7SrKiD8Y0JL_ZwNJmDT3sMdhVuGPEeTRRh0T3E1bbs9sCgmlkgnY0gmlwhKwSpQCKbXVsdGlhZGRyc5YACASsEqUABti8AAoErBKlAAbYvd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDcrOEX7Fi1KC5BcbOKdtv9gY309QAsm6fl_zJ6TJqAIGDdGNwgti8g3VkcILYvoV3YWt1MgU
2026-03-07 04:29:43.530 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.133.210 waku 8fe1b66149b0b1dac8b3b264a4150733a535ff523d1d8d8537425b60c5101b7a
2026-03-07 04:29:43.566 DEBUG [src.node.docker_mananger] Container started with ID 8fe1b66149b0. Setting up logs at ./log/docker/node5_2026-03-07_04-29-38__03f66680-4351-4b15-b5a8-46b7d275cb1f__wakuorg_nwaku:latest.log
2026-03-07 04:29:43.566 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 3435
2026-03-07 04:29:43.567 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:29:44.567 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3435/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:44.570 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:29:44.570 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:29:44.571 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3435/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:44.573 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.133.210/tcp/3436/p2p/16Uiu2HAmQFdTJVRKJBznV4AfCxAcwaiAj4GTFuegTPYPZsieTo8e","/ip4/172.18.133.210/tcp/3437/ws/p2p/16Uiu2HAmQFdTJVRKJBznV4AfCxAcwaiAj4GTFuegTPYPZsieTo8e"],"enrUri":"enr:-L24QOnFk2CnZ-BwIW05-ANWkkcN6XQLEdUNYYvtbXTsDCiZeASU1Q5_FfMQaCy20oRXBtjGDNbrRkBVbvwd_PtwiicCgmlkgnY0gmlwhKwShdKKbXVsdGlhZGRyc5YACASsEoXSBg1sAAoErBKF0gYNbd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDrFBBxyA1FFcAnJ5e1nekTkDMQD3Nz6o4Q2HzRWATfLODdGNwgg1sg3VkcIINboV3YWt1MgA"}'
2026-03-07 04:29:44.573 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:29:44.573 DEBUG [tests.e2e.test_e2e] Subscribe nodes to relay pubsub topic /waku/2/rs/3/1
2026-03-07 04:29:44.574 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38379/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-07 04:29:44.577 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:29:44.578 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55583/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-07 04:29:44.587 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:29:44.589 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55483/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-07 04:29:44.600 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:29:44.601 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:8399/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-07 04:29:44.607 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:29:44.608 DEBUG [tests.e2e.test_e2e] Node5 makes filter request pubsubtopic /waku/2/rs/3/1 and content topic /test/1/waku-filter/proto
2026-03-07 04:29:44.609 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3435/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-07 04:29:44.662 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-03-07 04:29:44.665 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:38379/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:44.672 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.55.57/tcp/49046/p2p/16Uiu2HAmSFnBfah7cyWE4YpRHHJxs8n3EKe36q9Wqv1kXDGJEpjy","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"}]'
2026-03-07 04:29:44.673 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55583/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:44.677 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.109.48/tcp/38380/p2p/16Uiu2HAmDJXCErCM4aju4JAyALUS79cSSpRuDwxyXmykQxSpuRd3","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"},{"multiaddr":"/ip4/172.18.165.0/tcp/54036/p2p/16Uiu2HAmLNjbQSpLL4EBzKtcbb8unyzijfiR95bhFJztULGgL1oE","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"}]'
2026-03-07 04:29:44.677 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55483/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:44.679 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.68.138/tcp/57042/p2p/16Uiu2HAkuwiRBBTsEjKCsTaxHcZmNDapdcLcRrwbhDamiyKUvsF3","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.55.57/tcp/55584/p2p/16Uiu2HAmSFnBfah7cyWE4YpRHHJxs8n3EKe36q9Wqv1kXDGJEpjy","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"}]'
2026-03-07 04:29:44.680 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:8399/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:44.682 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.165.0/tcp/55484/p2p/16Uiu2HAmLNjbQSpLL4EBzKtcbb8unyzijfiR95bhFJztULGgL1oE","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"Discv5"},{"multiaddr":"/ip4/172.18.133.210/tcp/59914/p2p/16Uiu2HAmQFdTJVRKJBznV4AfCxAcwaiAj4GTFuegTPYPZsieTo8e","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"}]'
2026-03-07 04:29:44.683 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3435/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:29:44.685 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.165.0/tcp/55484/p2p/16Uiu2HAmLNjbQSpLL4EBzKtcbb8unyzijfiR95bhFJztULGgL1oE","protocols":["/vac/waku/relay/2.0.0","/vac/waku/filter-subscribe/2.0.0-beta1"],"shards":[0],"connected":"NotConnected","agent":"","origin":"Discv5"},{"multiaddr":"/ip4/172.18.68.138/tcp/8400/p2p/16Uiu2HAkuwiRBBTsEjKCsTaxHcZmNDapdcLcRrwbhDamiyKUvsF3","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0,1],"connected":"Connected","agent":"logos-delivery-v0.36.0-164-g0ad551","origin":"UnknownOrigin"}]'
2026-03-07 04:29:44.687 DEBUG [src.libs.common] Sleeping for 60 seconds
2026-03-07 04:30:44.687 DEBUG [tests.e2e.test_e2e] 3 Nodes publish 12 message
2026-03-07 04:30:44.688 DEBUG [src.steps.store] Relaying message
2026-03-07 04:30:44.688 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38379/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:30:44.696 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:30:44.699 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-07 04:30:44.900 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-07 04:30:46.901 DEBUG [src.steps.store] Relaying message
2026-03-07 04:30:46.901 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38379/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:30:46.912 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:30:46.917 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-07 04:30:47.118 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-07 04:30:49.119 DEBUG [src.steps.store] Relaying message
2026-03-07 04:30:49.119 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38379/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:30:49.129 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:30:49.135 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-07 04:30:49.335 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-07 04:30:51.336 DEBUG [src.steps.store] Relaying message
2026-03-07 04:30:51.336 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:38379/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:30:51.345 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:30:51.346 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-07 04:30:51.546 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-07 04:30:53.547 DEBUG [src.steps.store] Relaying message
2026-03-07 04:30:53.547 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55583/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:30:53.557 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:30:53.560 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-07 04:30:53.762 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-07 04:30:55.763 DEBUG [src.steps.store] Relaying message
2026-03-07 04:30:55.763 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55583/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:30:55.772 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:30:55.773 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-07 04:30:55.977 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-07 04:30:57.978 DEBUG [src.steps.store] Relaying message
2026-03-07 04:30:57.978 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55583/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:30:57.990 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:30:57.997 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-07 04:30:58.199 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-07 04:31:00.199 DEBUG [src.steps.store] Relaying message
2026-03-07 04:31:00.200 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55583/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:31:00.211 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:00.213 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-07 04:31:00.413 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-07 04:31:02.414 DEBUG [src.steps.store] Relaying message
2026-03-07 04:31:02.414 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55483/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:31:02.426 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:02.428 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-07 04:31:02.631 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-07 04:31:04.632 DEBUG [src.steps.store] Relaying message
2026-03-07 04:31:04.632 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55483/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:31:04.642 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:04.642 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-07 04:31:04.843 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-07 04:31:06.844 DEBUG [src.steps.store] Relaying message
2026-03-07 04:31:06.844 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55483/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:31:06.853 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:06.854 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-07 04:31:07.056 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-07 04:31:09.057 DEBUG [src.steps.store] Relaying message
2026-03-07 04:31:09.057 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55483/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:31:09.067 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:09.069 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-07 04:31:09.274 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-07 04:31:11.275 DEBUG [tests.e2e.test_e2e] Node5 requests messages of subscribed filter topic /waku/2/rs/3/1
2026-03-07 04:31:11.275 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3435/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:11.278 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772857844688301514,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772857846901403979,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772857849119224162,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772857851336354423,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772857853547356784,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772857855762927714,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772857857978297207,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772857860199616788,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772857862414371843,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772857864632284367,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772857866843839721,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772857869057408535,"ephemeral":false}]'
2026-03-07 04:31:11.279 DEBUG [tests.e2e.test_e2e] Response for node 5 is [{'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772857844688301514, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772857846901403979, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772857849119224162, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772857851336354423, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772857853547356784, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772857855762927714, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772857857978297207, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772857860199616788, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772857862414371843, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772857864632284367, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772857866843839721, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772857869057408535, 'ephemeral': False}]
2026-03-07 04:31:11.281 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-07 04:31:11.282 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-07 04:31:11.282 DEBUG [src.node.waku_node] Stopping container with id fa5cb55d5e59
2026-03-07 04:31:11.938 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:31:11.939 DEBUG [src.node.waku_node] Stopping container with id 55c8c1779448
2026-03-07 04:31:12.576 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:31:12.576 DEBUG [src.node.waku_node] Stopping container with id e77c268fd6a2
2026-03-07 04:31:13.011 ERROR [src.node.docker_mananger] Max retries reached for container fa5cb55d5e59. Exiting log stream.
2026-03-07 04:31:13.193 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:31:13.193 DEBUG [src.node.waku_node] Stopping container with id d7a72fac168b
2026-03-07 04:31:13.393 ERROR [src.node.docker_mananger] Max retries reached for container 55c8c1779448. Exiting log stream.
2026-03-07 04:31:13.783 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:31:13.783 DEBUG [src.node.waku_node] Stopping container with id 8fe1b66149b0
2026-03-07 04:31:14.008 ERROR [src.node.docker_mananger] Max retries reached for container e77c268fd6a2. Exiting log stream.
2026-03-07 04:31:14.399 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:31:14.400 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-07 04:31:14.545 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:31:14.617 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:31:14.692 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:31:14.694 ERROR [src.node.docker_mananger] Max retries reached for container d7a72fac168b. Exiting log stream.
2026-03-07 04:31:14.785 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:31:14.807 DEBUG [src.node.docker_mananger] No errors found in the waku logs.