225 lines
44 KiB
Plaintext

2026-02-02 04:40:01.854 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-02 04:40:01.854 DEBUG [tests.conftest] Running test: test_filter_3_senders_multiple_msg_1_receiver with id: 2026-02-02_04-40-01__7134bbb3-51e9-4ba6-bb06-623a0d4fb818
2026-02-02 04:40:01.854 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-02 04:40:01.854 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-02-02 04:40:01.855 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-02-02 04:40:01.861 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-02 04:40:01.861 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-02_04-40-01__7134bbb3-51e9-4ba6-bb06-623a0d4fb818__wakuorg_nwaku:latest.log
2026-02-02 04:40:01.867 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-02 04:40:01.867 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-02_04-40-01__7134bbb3-51e9-4ba6-bb06-623a0d4fb818__wakuorg_nwaku:latest.log
2026-02-02 04:40:01.873 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-02 04:40:01.873 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-02_04-40-01__7134bbb3-51e9-4ba6-bb06-623a0d4fb818__wakuorg_nwaku:latest.log
2026-02-02 04:40:01.873 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-02 04:40:01.874 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-02-02 04:40:01.880 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-02 04:40:01.880 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-02-02_04-40-01__7134bbb3-51e9-4ba6-bb06-623a0d4fb818__wakuorg_nwaku:latest.log
2026-02-02 04:40:01.886 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-02 04:40:01.886 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-02-02_04-40-01__7134bbb3-51e9-4ba6-bb06-623a0d4fb818__wakuorg_nwaku:latest.log
2026-02-02 04:40:01.886 DEBUG [tests.e2e.test_e2e] Start 5 nodes
2026-02-02 04:40:01.886 DEBUG [src.node.waku_node] Starting Node...
2026-02-02 04:40:01.886 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-02 04:40:01.887 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-02 04:40:01.888 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.121.175
2026-02-02 04:40:01.888 DEBUG [src.node.docker_mananger] Generated ports ['12275', '12276', '12277', '12278', '12279']
2026-02-02 04:40:01.888 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-02 04:40:01.888 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-02 04:40:01.888 DEBUG [src.node.waku_node] Using volumes []
2026-02-02 04:40:01.888 DEBUG [src.node.docker_mananger] docker run -i -t -p 12275:12275 -p 12276:12276 -p 12277:12277 -p 12278:12278 -p 12279:12279 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=12277 --rest-port=12275 --tcp-port=12276 --discv5-udp-port=12278 --rest-address=0.0.0.0 --nat=extip:172.18.121.175 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dada7a3a9cefe0cab3b79ac86c0dbebd552222a8686318382bc3d46dca208421 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=12279 --metrics-logging=true --relay=true --store=false
2026-02-02 04:40:02.072 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.121.175 waku c747b094ca5d26908307896977c02ff254fcab7ba37064d9002a1b2510ac52ad
2026-02-02 04:40:02.104 DEBUG [src.node.docker_mananger] Container started with ID c747b094ca5d. Setting up logs at ./log/docker/node1_2026-02-02_04-40-01__7134bbb3-51e9-4ba6-bb06-623a0d4fb818__wakuorg_nwaku:latest.log
2026-02-02 04:40:02.105 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 12275
2026-02-02 04:40:02.107 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-02 04:40:02.130 ERROR [src.node.docker_mananger] Max retries reached for container 5a017d614ce1. Exiting log stream.
2026-02-02 04:40:02.656 ERROR [src.node.docker_mananger] Max retries reached for container 2d070d51a4ef. Exiting log stream.
2026-02-02 04:40:03.107 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12275/health" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:40:03.110 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-02-02 04:40:03.111 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-02 04:40:03.111 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12275/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:40:03.113 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.121.175/tcp/12276/p2p/16Uiu2HAmQ7dabxnT1H7CNddpqh75Udcp6eMLFrWqBBs9dyFqrdcX","/ip4/172.18.121.175/tcp/12277/ws/p2p/16Uiu2HAmQ7dabxnT1H7CNddpqh75Udcp6eMLFrWqBBs9dyFqrdcX"],"enrUri":"enr:-L24QCdLqH9FqIpJ3ZYe8LPqhs5GCK1xmbZbx6WykH5vB_frPKEbyhidAK4I8aqjyv1tRhr1Pvt6aUG1-cjdBwIT_VUCgmlkgnY0gmlwhKwSea-KbXVsdGlhZGRyc5YACASsEnmvBi_0AAoErBJ5rwYv9d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDqkPAuBV29TRdkQVmLRznooifrmaq_Os_NFeXcJc4sISDdGNwgi_0g3VkcIIv9oV3YWt1MgE"}'
2026-02-02 04:40:03.113 INFO [src.node.waku_node] REST service is ready !!
2026-02-02 04:40:03.114 DEBUG [src.node.waku_node] Starting Node...
2026-02-02 04:40:03.114 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-02 04:40:03.115 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-02 04:40:03.115 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.54.252
2026-02-02 04:40:03.115 DEBUG [src.node.docker_mananger] Generated ports ['45704', '45705', '45706', '45707', '45708']
2026-02-02 04:40:03.116 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-02 04:40:03.116 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-02 04:40:03.116 DEBUG [src.node.waku_node] Using volumes []
2026-02-02 04:40:03.116 DEBUG [src.node.docker_mananger] docker run -i -t -p 45704:45704 -p 45705:45705 -p 45706:45706 -p 45707:45707 -p 45708:45708 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=45706 --rest-port=45704 --tcp-port=45705 --discv5-udp-port=45707 --rest-address=0.0.0.0 --nat=extip:172.18.54.252 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=7bc4afadc58c6df2ccefe3bc59b11ae7bca08c0f1eaa136ab8e10b939e7b9c1a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=45708 --metrics-logging=true --relay=true --store=false --discv5-bootstrap-node=enr:-L24QCdLqH9FqIpJ3ZYe8LPqhs5GCK1xmbZbx6WykH5vB_frPKEbyhidAK4I8aqjyv1tRhr1Pvt6aUG1-cjdBwIT_VUCgmlkgnY0gmlwhKwSea-KbXVsdGlhZGRyc5YACASsEnmvBi_0AAoErBJ5rwYv9d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDqkPAuBV29TRdkQVmLRznooifrmaq_Os_NFeXcJc4sISDdGNwgi_0g3VkcIIv9oV3YWt1MgE
2026-02-02 04:40:03.297 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.54.252 waku 39b9310d3bc3b91144c78475918432d3012cefc7a7bb8b89f6512b07eba452e2
2026-02-02 04:40:03.329 DEBUG [src.node.docker_mananger] Container started with ID 39b9310d3bc3. Setting up logs at ./log/docker/node2_2026-02-02_04-40-01__7134bbb3-51e9-4ba6-bb06-623a0d4fb818__wakuorg_nwaku:latest.log
2026-02-02 04:40:03.329 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 45704
2026-02-02 04:40:03.330 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-02 04:40:04.330 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45704/health" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:40:04.341 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-02-02 04:40:04.342 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-02 04:40:04.342 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45704/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:40:04.347 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.54.252/tcp/45705/p2p/16Uiu2HAkzfw287LcfH4ZThcRnc6tLj6kWbVYwdDbCft92bueL6qF","/ip4/172.18.54.252/tcp/45706/ws/p2p/16Uiu2HAkzfw287LcfH4ZThcRnc6tLj6kWbVYwdDbCft92bueL6qF"],"enrUri":"enr:-L24QMF5h_2vwf8GLcWuiRI0HxrR0DxEElYOuiFWvoNVlulvU0p6DbA2_on-53BwKl6rsp5apuIroybIb5PLKXnLrRUCgmlkgnY0gmlwhKwSNvyKbXVsdGlhZGRyc5YACASsEjb8BrKJAAoErBI2_Aayit0DgnJzhQADAQAAiXNlY3AyNTZrMaECTfGSajvuCM2-NVEoqZWBhGmMCGqFxfC-0lRp1G1XimqDdGNwgrKJg3VkcIKyi4V3YWt1MgE"}'
2026-02-02 04:40:04.348 INFO [src.node.waku_node] REST service is ready !!
2026-02-02 04:40:04.348 DEBUG [src.node.waku_node] Starting Node...
2026-02-02 04:40:04.349 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-02 04:40:04.351 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-02 04:40:04.351 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.135.148
2026-02-02 04:40:04.351 DEBUG [src.node.docker_mananger] Generated ports ['19780', '19781', '19782', '19783', '19784']
2026-02-02 04:40:04.352 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-02 04:40:04.352 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-02 04:40:04.352 DEBUG [src.node.waku_node] Using volumes []
2026-02-02 04:40:04.352 DEBUG [src.node.docker_mananger] docker run -i -t -p 19780:19780 -p 19781:19781 -p 19782:19782 -p 19783:19783 -p 19784:19784 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=19782 --rest-port=19780 --tcp-port=19781 --discv5-udp-port=19783 --rest-address=0.0.0.0 --nat=extip:172.18.135.148 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fb4ae9a4c1bea3c81db1bd73bba06a5f39a3fac54cbeb24ee09c0d07fd2daaad --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=19784 --metrics-logging=true --relay=true --store=false --filter=true --discv5-bootstrap-node=enr:-L24QMF5h_2vwf8GLcWuiRI0HxrR0DxEElYOuiFWvoNVlulvU0p6DbA2_on-53BwKl6rsp5apuIroybIb5PLKXnLrRUCgmlkgnY0gmlwhKwSNvyKbXVsdGlhZGRyc5YACASsEjb8BrKJAAoErBI2_Aayit0DgnJzhQADAQAAiXNlY3AyNTZrMaECTfGSajvuCM2-NVEoqZWBhGmMCGqFxfC-0lRp1G1XimqDdGNwgrKJg3VkcIKyi4V3YWt1MgE
2026-02-02 04:40:04.528 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.135.148 waku 3f1d83403b043f3b285aa626cd7c430c97fe4871db10afe9ca891d865057c9de
2026-02-02 04:40:04.558 DEBUG [src.node.docker_mananger] Container started with ID 3f1d83403b04. Setting up logs at ./log/docker/node3_2026-02-02_04-40-01__7134bbb3-51e9-4ba6-bb06-623a0d4fb818__wakuorg_nwaku:latest.log
2026-02-02 04:40:04.558 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 19780
2026-02-02 04:40:04.558 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-02 04:40:05.559 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19780/health" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:40:05.571 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-02-02 04:40:05.572 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-02 04:40:05.572 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19780/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:40:05.578 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.135.148/tcp/19781/p2p/16Uiu2HAm8sfHyDYUtbCH9wBVAHArZCtK1wHipB14xwnuzN9oRAvc","/ip4/172.18.135.148/tcp/19782/ws/p2p/16Uiu2HAm8sfHyDYUtbCH9wBVAHArZCtK1wHipB14xwnuzN9oRAvc"],"enrUri":"enr:-L24QESqdU9_pFtfjnE8vezzYdZFdHH8eahhaLei9B1rjMmvDjGtpaCA7hbSjz0fylvDFTddcRNoPhaNc2moPcNnUDECgmlkgnY0gmlwhKwSh5SKbXVsdGlhZGRyc5YACASsEoeUBk1FAAoErBKHlAZNRt0DgnJzhQADAQAAiXNlY3AyNTZrMaECx9BBNaLRm26MBZtb6YdOKbAtN54PgmUAzARwv7l6W8mDdGNwgk1Fg3VkcIJNR4V3YWt1MgU"}'
2026-02-02 04:40:05.578 INFO [src.node.waku_node] REST service is ready !!
2026-02-02 04:40:05.579 DEBUG [src.node.waku_node] Starting Node...
2026-02-02 04:40:05.579 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-02 04:40:05.580 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-02 04:40:05.581 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.135.161
2026-02-02 04:40:05.581 DEBUG [src.node.docker_mananger] Generated ports ['29457', '29458', '29459', '29460', '29461']
2026-02-02 04:40:05.581 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-02 04:40:05.581 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-02 04:40:05.581 DEBUG [src.node.waku_node] Using volumes []
2026-02-02 04:40:05.581 DEBUG [src.node.docker_mananger] docker run -i -t -p 29457:29457 -p 29458:29458 -p 29459:29459 -p 29460:29460 -p 29461:29461 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=29459 --rest-port=29457 --tcp-port=29458 --discv5-udp-port=29460 --rest-address=0.0.0.0 --nat=extip:172.18.135.161 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8f281ccd7b517bf1a5636a60ccc01b2512c7a9caa2cbacaa0f67c84e7de9157e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=29461 --metrics-logging=true --relay=true --filter=true --store=false --discv5-bootstrap-node=enr:-L24QESqdU9_pFtfjnE8vezzYdZFdHH8eahhaLei9B1rjMmvDjGtpaCA7hbSjz0fylvDFTddcRNoPhaNc2moPcNnUDECgmlkgnY0gmlwhKwSh5SKbXVsdGlhZGRyc5YACASsEoeUBk1FAAoErBKHlAZNRt0DgnJzhQADAQAAiXNlY3AyNTZrMaECx9BBNaLRm26MBZtb6YdOKbAtN54PgmUAzARwv7l6W8mDdGNwgk1Fg3VkcIJNR4V3YWt1MgU
2026-02-02 04:40:05.789 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.135.161 waku 2bfc4d08fc0306fc751d01be38349feba10f8450621852cf611680acfdff8e12
2026-02-02 04:40:05.822 DEBUG [src.node.docker_mananger] Container started with ID 2bfc4d08fc03. Setting up logs at ./log/docker/node4_2026-02-02_04-40-01__7134bbb3-51e9-4ba6-bb06-623a0d4fb818__wakuorg_nwaku:latest.log
2026-02-02 04:40:05.822 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 29457
2026-02-02 04:40:05.822 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-02 04:40:06.823 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29457/health" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:40:06.835 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"READY"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-02-02 04:40:06.835 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-02 04:40:06.835 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29457/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:40:06.839 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.135.161/tcp/29458/p2p/16Uiu2HAm7uLJcwn6RgpoZPzyiCaoNhiVL5imKENaPf4vKWi8zmcJ","/ip4/172.18.135.161/tcp/29459/ws/p2p/16Uiu2HAm7uLJcwn6RgpoZPzyiCaoNhiVL5imKENaPf4vKWi8zmcJ"],"enrUri":"enr:-L24QM_TWR5rovjRJSkuq3wHEcHrv6RMtyTTP7xMJcmF_Va3Q8e0pMmLWBkfWqPVtGnbsDnxynrZvXKQM0HXaHLcL4ECgmlkgnY0gmlwhKwSh6GKbXVsdGlhZGRyc5YACASsEoehBnMSAAoErBKHoQZzE90DgnJzhQADAQAAiXNlY3AyNTZrMaECuWJCPBJ_P23KgV9ebcETnshlv_t2I1OijHH7W0amnGeDdGNwgnMSg3VkcIJzFIV3YWt1MgU"}'
2026-02-02 04:40:06.839 INFO [src.node.waku_node] REST service is ready !!
2026-02-02 04:40:06.839 DEBUG [src.node.waku_node] Starting Node...
2026-02-02 04:40:06.839 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-02 04:40:06.841 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-02 04:40:06.841 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.5.206
2026-02-02 04:40:06.841 DEBUG [src.node.docker_mananger] Generated ports ['57156', '57157', '57158', '57159', '57160']
2026-02-02 04:40:06.841 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-02 04:40:06.841 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-02 04:40:06.841 DEBUG [src.node.waku_node] Using volumes []
2026-02-02 04:40:06.841 DEBUG [src.node.docker_mananger] docker run -i -t -p 57156:57156 -p 57157:57157 -p 57158:57158 -p 57159:57159 -p 57160:57160 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=57158 --rest-port=57156 --tcp-port=57157 --discv5-udp-port=57159 --rest-address=0.0.0.0 --nat=extip:172.18.5.206 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=1fe2c9f1fd3cca0bcecafe6dfc3eaa7cc60163b2afc3df545e01c3faa9c1add5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=57160 --metrics-logging=true --relay=false --filternode=/ip4/172.18.135.161/tcp/29458/p2p/16Uiu2HAm7uLJcwn6RgpoZPzyiCaoNhiVL5imKENaPf4vKWi8zmcJ --store=false --discv5-bootstrap-node=enr:-L24QESqdU9_pFtfjnE8vezzYdZFdHH8eahhaLei9B1rjMmvDjGtpaCA7hbSjz0fylvDFTddcRNoPhaNc2moPcNnUDECgmlkgnY0gmlwhKwSh5SKbXVsdGlhZGRyc5YACASsEoeUBk1FAAoErBKHlAZNRt0DgnJzhQADAQAAiXNlY3AyNTZrMaECx9BBNaLRm26MBZtb6YdOKbAtN54PgmUAzARwv7l6W8mDdGNwgk1Fg3VkcIJNR4V3YWt1MgU
2026-02-02 04:40:07.024 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.5.206 waku e8db599bd1007a4d74f0aadf93e6f51f2d5cff0a16b980e317c2ec44f6c20a05
2026-02-02 04:40:07.054 DEBUG [src.node.docker_mananger] Container started with ID e8db599bd100. Setting up logs at ./log/docker/node5_2026-02-02_04-40-01__7134bbb3-51e9-4ba6-bb06-623a0d4fb818__wakuorg_nwaku:latest.log
2026-02-02 04:40:07.054 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 57156
2026-02-02 04:40:07.054 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-02 04:40:08.055 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57156/health" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:40:08.059 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-02-02 04:40:08.060 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-02 04:40:08.060 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57156/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:40:08.062 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.5.206/tcp/57157/p2p/16Uiu2HAmKFHz9yrGetrVuekLA9sxFHaQGQntDuJ413Bm7s8UuiJU","/ip4/172.18.5.206/tcp/57158/ws/p2p/16Uiu2HAmKFHz9yrGetrVuekLA9sxFHaQGQntDuJ413Bm7s8UuiJU"],"enrUri":"enr:-L24QPGkIxFLeaMy9bQ_Xgv_kCuoV-Qo8mZsweoIPANnC8hpFuqs_wHNHn9n2ROVYrsoMIhvx2Ub316Ty2uOjU6DI5kCgmlkgnY0gmlwhKwSBc6KbXVsdGlhZGRyc5YACASsEgXOBt9FAAoErBIFzgbfRt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDYe_PSfJGkkFcyBKAMsvQXxZTbFQG7RBodX77fCSppmmDdGNwgt9Fg3VkcILfR4V3YWt1MgA"}'
2026-02-02 04:40:08.062 INFO [src.node.waku_node] REST service is ready !!
2026-02-02 04:40:08.062 DEBUG [tests.e2e.test_e2e] Subscribe nodes to relay pubsub topic /waku/2/rs/3/1
2026-02-02 04:40:08.063 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12275/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-02 04:40:08.066 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:40:08.067 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45704/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-02 04:40:08.072 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:40:08.072 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19780/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-02 04:40:08.080 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:40:08.081 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:29457/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-02 04:40:08.085 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:40:08.086 DEBUG [tests.e2e.test_e2e] Node5 makes filter request pubsubtopic /waku/2/rs/3/1 and content topic /test/1/waku-filter/proto
2026-02-02 04:40:08.086 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57156/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-02 04:40:08.129 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-02-02 04:40:08.130 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12275/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:40:08.136 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.54.252/tcp/46222/p2p/16Uiu2HAkzfw287LcfH4ZThcRnc6tLj6kWbVYwdDbCft92bueL6qF","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"Discv5"}]'
2026-02-02 04:40:08.136 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45704/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:40:08.141 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.135.148/tcp/37500/p2p/16Uiu2HAm8sfHyDYUtbCH9wBVAHArZCtK1wHipB14xwnuzN9oRAvc","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.121.175/tcp/12276/p2p/16Uiu2HAmQ7dabxnT1H7CNddpqh75Udcp6eMLFrWqBBs9dyFqrdcX","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"Discv5"}]'
2026-02-02 04:40:08.142 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:19780/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:40:08.144 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.54.252/tcp/45705/p2p/16Uiu2HAkzfw287LcfH4ZThcRnc6tLj6kWbVYwdDbCft92bueL6qF","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"Discv5"},{"multiaddr":"/ip4/172.18.135.161/tcp/43042/p2p/16Uiu2HAm7uLJcwn6RgpoZPzyiCaoNhiVL5imKENaPf4vKWi8zmcJ","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"UnknownOrigin"}]'
2026-02-02 04:40:08.144 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:29457/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:40:08.146 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.135.148/tcp/19781/p2p/16Uiu2HAm8sfHyDYUtbCH9wBVAHArZCtK1wHipB14xwnuzN9oRAvc","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"Discv5"},{"multiaddr":"/ip4/172.18.5.206/tcp/48022/p2p/16Uiu2HAmKFHz9yrGetrVuekLA9sxFHaQGQntDuJ413Bm7s8UuiJU","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"UnknownOrigin"}]'
2026-02-02 04:40:08.147 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57156/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:40:08.149 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.135.148/tcp/19781/p2p/16Uiu2HAm8sfHyDYUtbCH9wBVAHArZCtK1wHipB14xwnuzN9oRAvc","protocols":["/vac/waku/relay/2.0.0","/vac/waku/filter-subscribe/2.0.0-beta1"],"shards":[0],"connected":"NotConnected","agent":"","origin":"Discv5"},{"multiaddr":"/ip4/172.18.135.161/tcp/29458/p2p/16Uiu2HAm7uLJcwn6RgpoZPzyiCaoNhiVL5imKENaPf4vKWi8zmcJ","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0,1],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"UnknownOrigin"}]'
2026-02-02 04:40:08.149 DEBUG [src.libs.common] Sleeping for 60 seconds
2026-02-02 04:41:08.150 DEBUG [tests.e2e.test_e2e] 3 Nodes publish 12 message
2026-02-02 04:41:08.150 DEBUG [src.steps.store] Relaying message
2026-02-02 04:41:08.150 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12275/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-02 04:41:08.161 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:41:08.162 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-02 04:41:08.364 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-02 04:41:10.365 DEBUG [src.steps.store] Relaying message
2026-02-02 04:41:10.365 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12275/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-02 04:41:10.371 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:41:10.372 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-02 04:41:10.573 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-02 04:41:12.574 DEBUG [src.steps.store] Relaying message
2026-02-02 04:41:12.574 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12275/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-02 04:41:12.581 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:41:12.581 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-02 04:41:12.782 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-02 04:41:14.782 DEBUG [src.steps.store] Relaying message
2026-02-02 04:41:14.783 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12275/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-02 04:41:14.791 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:41:14.791 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-02 04:41:14.992 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-02 04:41:16.992 DEBUG [src.steps.store] Relaying message
2026-02-02 04:41:16.993 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45704/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-02 04:41:17.001 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:41:17.002 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-02 04:41:17.203 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-02 04:41:19.203 DEBUG [src.steps.store] Relaying message
2026-02-02 04:41:19.203 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45704/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-02 04:41:19.213 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:41:19.215 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-02 04:41:19.415 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-02 04:41:21.416 DEBUG [src.steps.store] Relaying message
2026-02-02 04:41:21.416 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45704/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-02 04:41:21.423 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:41:21.424 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-02 04:41:21.624 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-02 04:41:23.625 DEBUG [src.steps.store] Relaying message
2026-02-02 04:41:23.625 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45704/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-02 04:41:23.633 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:41:23.637 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-02 04:41:23.838 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-02 04:41:25.839 DEBUG [src.steps.store] Relaying message
2026-02-02 04:41:25.839 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19780/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-02 04:41:25.844 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:41:25.846 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-02 04:41:26.048 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-02 04:41:28.049 DEBUG [src.steps.store] Relaying message
2026-02-02 04:41:28.049 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19780/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-02 04:41:28.058 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:41:28.059 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-02 04:41:28.260 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-02 04:41:30.260 DEBUG [src.steps.store] Relaying message
2026-02-02 04:41:30.261 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19780/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-02 04:41:30.270 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:41:30.270 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-02 04:41:30.470 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-02 04:41:32.471 DEBUG [src.steps.store] Relaying message
2026-02-02 04:41:32.471 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:19780/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-02 04:41:32.482 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-02 04:41:32.483 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-02 04:41:32.684 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-02 04:41:34.684 DEBUG [tests.e2e.test_e2e] Node5 requests messages of subscribed filter topic /waku/2/rs/3/1
2026-02-02 04:41:34.685 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57156/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-02 04:41:34.692 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1770007268150470928,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1770007270365339769,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1770007272574327806,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1770007274782656616,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1770007276992694877,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1770007279203576260,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1770007281416486643,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1770007283624833793,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1770007285838951843,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1770007288049456507,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1770007290260566072,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1770007292471307930,"ephemeral":false}]'
2026-02-02 04:41:34.692 DEBUG [tests.e2e.test_e2e] Response for node 5 is [{'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1770007268150470928, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1770007270365339769, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1770007272574327806, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1770007274782656616, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1770007276992694877, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1770007279203576260, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1770007281416486643, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1770007283624833793, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1770007285838951843, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1770007288049456507, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1770007290260566072, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1770007292471307930, 'ephemeral': False}]
2026-02-02 04:41:34.698 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-02 04:41:34.699 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-02 04:41:34.699 DEBUG [src.node.waku_node] Stopping container with id c747b094ca5d
2026-02-02 04:41:35.270 DEBUG [src.node.waku_node] Container stopped.
2026-02-02 04:41:35.270 DEBUG [src.node.waku_node] Stopping container with id 39b9310d3bc3
2026-02-02 04:41:35.833 DEBUG [src.node.waku_node] Container stopped.
2026-02-02 04:41:35.838 DEBUG [src.node.waku_node] Stopping container with id 3f1d83403b04
2026-02-02 04:41:36.089 ERROR [src.node.docker_mananger] Max retries reached for container c747b094ca5d. Exiting log stream.
2026-02-02 04:41:36.367 DEBUG [src.node.waku_node] Container stopped.
2026-02-02 04:41:36.368 DEBUG [src.node.waku_node] Stopping container with id 2bfc4d08fc03
2026-02-02 04:41:36.893 DEBUG [src.node.waku_node] Container stopped.
2026-02-02 04:41:36.893 DEBUG [src.node.waku_node] Stopping container with id e8db599bd100
2026-02-02 04:41:36.911 ERROR [src.node.docker_mananger] Max retries reached for container 39b9310d3bc3. Exiting log stream.
2026-02-02 04:41:37.181 ERROR [src.node.docker_mananger] Max retries reached for container 3f1d83403b04. Exiting log stream.
2026-02-02 04:41:37.406 DEBUG [src.node.waku_node] Container stopped.
2026-02-02 04:41:37.407 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-02 04:41:37.478 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-02 04:41:37.616 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-02 04:41:37.688 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-02 04:41:37.774 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-02 04:41:37.796 DEBUG [src.node.docker_mananger] No errors found in the waku logs.