225 lines
44 KiB
Plaintext

2026-03-28 04:37:38.941 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-28 04:37:38.941 DEBUG [tests.conftest] Running test: test_filter_3_senders_multiple_msg_1_receiver with id: 2026-03-28_04-37-38__9029796f-4d10-4c1d-85c1-4b056085f8e8
2026-03-28 04:37:38.942 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-28 04:37:38.942 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-28 04:37:38.942 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-03-28 04:37:38.948 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-28 04:37:38.948 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-28_04-37-38__9029796f-4d10-4c1d-85c1-4b056085f8e8__wakuorg_nwaku:latest.log
2026-03-28 04:37:38.954 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-28 04:37:38.954 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-28_04-37-38__9029796f-4d10-4c1d-85c1-4b056085f8e8__wakuorg_nwaku:latest.log
2026-03-28 04:37:38.959 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-28 04:37:38.960 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-28_04-37-38__9029796f-4d10-4c1d-85c1-4b056085f8e8__wakuorg_nwaku:latest.log
2026-03-28 04:37:38.960 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-28 04:37:38.960 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-28 04:37:38.966 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-28 04:37:38.966 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-03-28_04-37-38__9029796f-4d10-4c1d-85c1-4b056085f8e8__wakuorg_nwaku:latest.log
2026-03-28 04:37:38.972 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-28 04:37:38.972 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-03-28_04-37-38__9029796f-4d10-4c1d-85c1-4b056085f8e8__wakuorg_nwaku:latest.log
2026-03-28 04:37:38.972 DEBUG [tests.e2e.test_e2e] Start 5 nodes
2026-03-28 04:37:38.972 DEBUG [src.node.waku_node] Starting Node...
2026-03-28 04:37:38.972 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-28 04:37:38.973 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-28 04:37:38.974 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.53.167
2026-03-28 04:37:38.974 DEBUG [src.node.docker_mananger] Generated ports ['59924', '59925', '59926', '59927', '59928']
2026-03-28 04:37:38.974 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-28 04:37:38.974 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-28 04:37:38.974 DEBUG [src.node.waku_node] Using volumes []
2026-03-28 04:37:38.974 DEBUG [src.node.docker_mananger] docker run -i -t -p 59924:59924 -p 59925:59925 -p 59926:59926 -p 59927:59927 -p 59928:59928 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=59926 --rest-port=59924 --tcp-port=59925 --discv5-udp-port=59927 --rest-address=0.0.0.0 --nat=extip:172.18.53.167 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ce8a0de7fa61bddcd999afc1f6fd2e252bcf9d6afbdb52d8dbbb3b936aa0ce47 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=59928 --metrics-logging=true --relay=true --store=false
2026-03-28 04:37:39.161 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.53.167 waku a75cb4545f71af034548813820bc39d1d74f53aed489122307a3af21074275da
2026-03-28 04:37:39.199 DEBUG [src.node.docker_mananger] Container started with ID a75cb4545f71. Setting up logs at ./log/docker/node1_2026-03-28_04-37-38__9029796f-4d10-4c1d-85c1-4b056085f8e8__wakuorg_nwaku:latest.log
2026-03-28 04:37:39.199 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 59924
2026-03-28 04:37:39.201 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-28 04:37:39.263 ERROR [src.node.docker_mananger] Max retries reached for container ea294479dd96. Exiting log stream.
2026-03-28 04:37:39.707 ERROR [src.node.docker_mananger] Max retries reached for container 0715e33e7ec4. Exiting log stream.
2026-03-28 04:37:40.201 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59924/health" -H "Content-Type: application/json" -d 'None'
2026-03-28 04:37:40.204 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-28 04:37:40.205 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-28 04:37:40.205 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59924/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-28 04:37:40.207 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.53.167/tcp/59925/p2p/16Uiu2HAm9syfNd54XvtFEYa5v6xgkqgBvb4n75YCE4FLxfmWpRdh","/ip4/172.18.53.167/tcp/59926/ws/p2p/16Uiu2HAm9syfNd54XvtFEYa5v6xgkqgBvb4n75YCE4FLxfmWpRdh"],"enrUri":"enr:-L24QEqsW_2RN-ltXVp4ZI8ygQkh1nNgZSKBaplu0hNb_z0AeNMA9q3coSRIOifO72e8p2srcMiYFieAuFZSUEH7FZwCgmlkgnY0gmlwhKwSNaeKbXVsdGlhZGRyc5YACASsEjWnBuoVAAoErBI1pwbqFt0DgnJzhQADAQAAiXNlY3AyNTZrMaEC1sC2KdKyXvPkeFhIIbnI38kXvI_RvgPlOTt-dI_X9ViDdGNwguoVg3VkcILqF4V3YWt1MgE"}'
2026-03-28 04:37:40.207 INFO [src.node.waku_node] REST service is ready !!
2026-03-28 04:37:40.207 DEBUG [src.node.waku_node] Starting Node...
2026-03-28 04:37:40.207 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-28 04:37:40.209 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-28 04:37:40.209 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.42.34
2026-03-28 04:37:40.209 DEBUG [src.node.docker_mananger] Generated ports ['41316', '41317', '41318', '41319', '41320']
2026-03-28 04:37:40.209 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-28 04:37:40.209 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-28 04:37:40.210 DEBUG [src.node.waku_node] Using volumes []
2026-03-28 04:37:40.210 DEBUG [src.node.docker_mananger] docker run -i -t -p 41316:41316 -p 41317:41317 -p 41318:41318 -p 41319:41319 -p 41320:41320 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=41318 --rest-port=41316 --tcp-port=41317 --discv5-udp-port=41319 --rest-address=0.0.0.0 --nat=extip:172.18.42.34 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=6ff2a1d2eeba947a63fc7f464569c9badaed6536cb5651a4f2aeedaecbf1ad9b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=41320 --metrics-logging=true --relay=true --store=false --discv5-bootstrap-node=enr:-L24QEqsW_2RN-ltXVp4ZI8ygQkh1nNgZSKBaplu0hNb_z0AeNMA9q3coSRIOifO72e8p2srcMiYFieAuFZSUEH7FZwCgmlkgnY0gmlwhKwSNaeKbXVsdGlhZGRyc5YACASsEjWnBuoVAAoErBI1pwbqFt0DgnJzhQADAQAAiXNlY3AyNTZrMaEC1sC2KdKyXvPkeFhIIbnI38kXvI_RvgPlOTt-dI_X9ViDdGNwguoVg3VkcILqF4V3YWt1MgE
2026-03-28 04:37:40.396 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.42.34 waku ca2e694fd1031699057949b516076e85f0040fb0209d23f04f3a4f732906b038
2026-03-28 04:37:40.430 DEBUG [src.node.docker_mananger] Container started with ID ca2e694fd103. Setting up logs at ./log/docker/node2_2026-03-28_04-37-38__9029796f-4d10-4c1d-85c1-4b056085f8e8__wakuorg_nwaku:latest.log
2026-03-28 04:37:40.430 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 41316
2026-03-28 04:37:40.431 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-28 04:37:41.431 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41316/health" -H "Content-Type: application/json" -d 'None'
2026-03-28 04:37:41.454 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-28 04:37:41.456 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-28 04:37:41.457 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41316/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-28 04:37:41.463 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.42.34/tcp/41317/p2p/16Uiu2HAm4ZdnufwJnMUMadqK3nRsEE7pEWcuVsb3hoTDZAiPccR9","/ip4/172.18.42.34/tcp/41318/ws/p2p/16Uiu2HAm4ZdnufwJnMUMadqK3nRsEE7pEWcuVsb3hoTDZAiPccR9"],"enrUri":"enr:-L24QICFyRrL82MwyhDRub7BfvuJv_RHOnPKz_h9MQXchEPPWXKyPkFD7qtXzCwTdpTgmhbuTwBh3c-oLwA_OI4W6zACgmlkgnY0gmlwhKwSKiKKbXVsdGlhZGRyc5YACASsEioiBqFlAAoErBIqIgahZt0DgnJzhQADAQAAiXNlY3AyNTZrMaECh8Na7vnT0mmvgVyfFYzoNKhPJO8U5JPnRy8G0xn8qxyDdGNwgqFlg3VkcIKhZ4V3YWt1MgE"}'
2026-03-28 04:37:41.464 INFO [src.node.waku_node] REST service is ready !!
2026-03-28 04:37:41.464 DEBUG [src.node.waku_node] Starting Node...
2026-03-28 04:37:41.464 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-28 04:37:41.465 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-28 04:37:41.466 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.14.45
2026-03-28 04:37:41.466 DEBUG [src.node.docker_mananger] Generated ports ['24383', '24384', '24385', '24386', '24387']
2026-03-28 04:37:41.466 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-28 04:37:41.466 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-28 04:37:41.466 DEBUG [src.node.waku_node] Using volumes []
2026-03-28 04:37:41.466 DEBUG [src.node.docker_mananger] docker run -i -t -p 24383:24383 -p 24384:24384 -p 24385:24385 -p 24386:24386 -p 24387:24387 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=24385 --rest-port=24383 --tcp-port=24384 --discv5-udp-port=24386 --rest-address=0.0.0.0 --nat=extip:172.18.14.45 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=fdfac13bbed6ef9048b4b9c4c4af2bb20528ae4bff57ccba67dd7c52a111a6aa --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=24387 --metrics-logging=true --relay=true --store=false --filter=true --discv5-bootstrap-node=enr:-L24QICFyRrL82MwyhDRub7BfvuJv_RHOnPKz_h9MQXchEPPWXKyPkFD7qtXzCwTdpTgmhbuTwBh3c-oLwA_OI4W6zACgmlkgnY0gmlwhKwSKiKKbXVsdGlhZGRyc5YACASsEioiBqFlAAoErBIqIgahZt0DgnJzhQADAQAAiXNlY3AyNTZrMaECh8Na7vnT0mmvgVyfFYzoNKhPJO8U5JPnRy8G0xn8qxyDdGNwgqFlg3VkcIKhZ4V3YWt1MgE
2026-03-28 04:37:41.663 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.14.45 waku f2e6fe234dba0448a690649f86eea5305b6270e0cc1905f5daaf4814d4dfc7c4
2026-03-28 04:37:41.698 DEBUG [src.node.docker_mananger] Container started with ID f2e6fe234dba. Setting up logs at ./log/docker/node3_2026-03-28_04-37-38__9029796f-4d10-4c1d-85c1-4b056085f8e8__wakuorg_nwaku:latest.log
2026-03-28 04:37:41.698 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 24383
2026-03-28 04:37:41.699 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-28 04:37:42.699 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24383/health" -H "Content-Type: application/json" -d 'None'
2026-03-28 04:37:42.714 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-28 04:37:42.719 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-28 04:37:42.720 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24383/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-28 04:37:42.723 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.14.45/tcp/24384/p2p/16Uiu2HAmD1cpV5GuxaJzGx1L3txZCV2y2f5PMcAcC86eqVib3xGK","/ip4/172.18.14.45/tcp/24385/ws/p2p/16Uiu2HAmD1cpV5GuxaJzGx1L3txZCV2y2f5PMcAcC86eqVib3xGK"],"enrUri":"enr:-L24QDvi4fx-Es6Evs3R4kY00je22m_NFhJCqrkprG4zRXs8PIVb_rdgi1SKhtqlu_A4gXAhS53qUtiTqq0hgbbw0m4CgmlkgnY0gmlwhKwSDi2KbXVsdGlhZGRyc5YACASsEg4tBl9AAAoErBIOLQZfQd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDBUjaB1IabPfbYDYMSEm99z1KgEHxgf1dPxrWUTgH70SDdGNwgl9Ag3VkcIJfQoV3YWt1MgU"}'
2026-03-28 04:37:42.724 INFO [src.node.waku_node] REST service is ready !!
2026-03-28 04:37:42.724 DEBUG [src.node.waku_node] Starting Node...
2026-03-28 04:37:42.725 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-28 04:37:42.726 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-28 04:37:42.726 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.20.13
2026-03-28 04:37:42.726 DEBUG [src.node.docker_mananger] Generated ports ['46210', '46211', '46212', '46213', '46214']
2026-03-28 04:37:42.727 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-28 04:37:42.727 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-28 04:37:42.727 DEBUG [src.node.waku_node] Using volumes []
2026-03-28 04:37:42.727 DEBUG [src.node.docker_mananger] docker run -i -t -p 46210:46210 -p 46211:46211 -p 46212:46212 -p 46213:46213 -p 46214:46214 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=46212 --rest-port=46210 --tcp-port=46211 --discv5-udp-port=46213 --rest-address=0.0.0.0 --nat=extip:172.18.20.13 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=d9dd46d6fbfbf99d7591b37cb3de0ecceb2ab47bd60090f29fdbccc57dbcf187 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=46214 --metrics-logging=true --relay=true --filter=true --store=false --discv5-bootstrap-node=enr:-L24QDvi4fx-Es6Evs3R4kY00je22m_NFhJCqrkprG4zRXs8PIVb_rdgi1SKhtqlu_A4gXAhS53qUtiTqq0hgbbw0m4CgmlkgnY0gmlwhKwSDi2KbXVsdGlhZGRyc5YACASsEg4tBl9AAAoErBIOLQZfQd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDBUjaB1IabPfbYDYMSEm99z1KgEHxgf1dPxrWUTgH70SDdGNwgl9Ag3VkcIJfQoV3YWt1MgU
2026-03-28 04:37:42.917 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.20.13 waku ad740b6f034cbc53399edc2f03cd52c8343c0def403a5baccc95c0a1da6381e6
2026-03-28 04:37:42.950 DEBUG [src.node.docker_mananger] Container started with ID ad740b6f034c. Setting up logs at ./log/docker/node4_2026-03-28_04-37-38__9029796f-4d10-4c1d-85c1-4b056085f8e8__wakuorg_nwaku:latest.log
2026-03-28 04:37:42.950 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 46210
2026-03-28 04:37:42.951 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-28 04:37:43.951 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46210/health" -H "Content-Type: application/json" -d 'None'
2026-03-28 04:37:43.972 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-28 04:37:43.974 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-28 04:37:43.975 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46210/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-28 04:37:43.979 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.20.13/tcp/46211/p2p/16Uiu2HAmTaQ8T6vsAahu4vudxYyoRDzx4kUSQ6MaUeExZcJFHU8n","/ip4/172.18.20.13/tcp/46212/ws/p2p/16Uiu2HAmTaQ8T6vsAahu4vudxYyoRDzx4kUSQ6MaUeExZcJFHU8n"],"enrUri":"enr:-L24QJCuwIJtFZtiFSTxinNSizT-n5FNN2cXZTixnfgUGHViZshQ7XW3EigHmcISJzlwZJbDzJa5D4V0bQZSeK1Unp8CgmlkgnY0gmlwhKwSFA2KbXVsdGlhZGRyc5YACASsEhQNBrSDAAoErBIUDQa0hN0DgnJzhQADAQAAiXNlY3AyNTZrMaED3bJJVDSCXawgFGxhGJ8az8OgWxpKSX_J6uX2SeBRnU-DdGNwgrSDg3VkcIK0hYV3YWt1MgU"}'
2026-03-28 04:37:43.980 INFO [src.node.waku_node] REST service is ready !!
2026-03-28 04:37:43.982 DEBUG [src.node.waku_node] Starting Node...
2026-03-28 04:37:43.982 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-28 04:37:43.984 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-28 04:37:43.984 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.250.159
2026-03-28 04:37:43.984 DEBUG [src.node.docker_mananger] Generated ports ['47879', '47880', '47881', '47882', '47883']
2026-03-28 04:37:43.985 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-28 04:37:43.985 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-28 04:37:43.985 DEBUG [src.node.waku_node] Using volumes []
2026-03-28 04:37:43.985 DEBUG [src.node.docker_mananger] docker run -i -t -p 47879:47879 -p 47880:47880 -p 47881:47881 -p 47882:47882 -p 47883:47883 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=47881 --rest-port=47879 --tcp-port=47880 --discv5-udp-port=47882 --rest-address=0.0.0.0 --nat=extip:172.18.250.159 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=b7ba0f8f3ad5fe2a8bbb6ca7dbf8aeffdc32c1129ef6799abcecccc3a4b1bebd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=47883 --metrics-logging=true --relay=false --filternode=/ip4/172.18.20.13/tcp/46211/p2p/16Uiu2HAmTaQ8T6vsAahu4vudxYyoRDzx4kUSQ6MaUeExZcJFHU8n --store=false --discv5-bootstrap-node=enr:-L24QDvi4fx-Es6Evs3R4kY00je22m_NFhJCqrkprG4zRXs8PIVb_rdgi1SKhtqlu_A4gXAhS53qUtiTqq0hgbbw0m4CgmlkgnY0gmlwhKwSDi2KbXVsdGlhZGRyc5YACASsEg4tBl9AAAoErBIOLQZfQd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDBUjaB1IabPfbYDYMSEm99z1KgEHxgf1dPxrWUTgH70SDdGNwgl9Ag3VkcIJfQoV3YWt1MgU
2026-03-28 04:37:44.187 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.250.159 waku 47d7b2f7ca53d9c28a0c0496cba90d5d6c95dfd6ce4d7a9c31aca6b420de842c
2026-03-28 04:37:44.222 DEBUG [src.node.docker_mananger] Container started with ID 47d7b2f7ca53. Setting up logs at ./log/docker/node5_2026-03-28_04-37-38__9029796f-4d10-4c1d-85c1-4b056085f8e8__wakuorg_nwaku:latest.log
2026-03-28 04:37:44.222 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 47879
2026-03-28 04:37:44.222 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-28 04:37:45.223 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47879/health" -H "Content-Type: application/json" -d 'None'
2026-03-28 04:37:45.226 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-28 04:37:45.226 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-28 04:37:45.226 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47879/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-28 04:37:45.228 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.250.159/tcp/47880/p2p/16Uiu2HAmSV5Xgnq88k2dZVTzPGUsibtpANDnJR4Xr9qp9CTGTYAX","/ip4/172.18.250.159/tcp/47881/ws/p2p/16Uiu2HAmSV5Xgnq88k2dZVTzPGUsibtpANDnJR4Xr9qp9CTGTYAX"],"enrUri":"enr:-L24QFp92xjMCjqUo813j7k2zrUft3YpdPDIH_ZrR623Hs3Pe8OoCdPIp83B4Q6_rzFNemCARlYxa426YOhv_JJihxcCgmlkgnY0gmlwhKwS-p-KbXVsdGlhZGRyc5YACASsEvqfBrsIAAoErBL6nwa7Cd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDzXmqQvRKckutJ8DmopdaBv7BA3oOkevPAhuohzp-B4SDdGNwgrsIg3VkcIK7CoV3YWt1MgA"}'
2026-03-28 04:37:45.229 INFO [src.node.waku_node] REST service is ready !!
2026-03-28 04:37:45.229 DEBUG [tests.e2e.test_e2e] Subscribe nodes to relay pubsub topic /waku/2/rs/3/1
2026-03-28 04:37:45.229 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59924/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-28 04:37:45.232 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-28 04:37:45.233 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41316/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-28 04:37:45.237 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-28 04:37:45.238 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24383/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-28 04:37:45.248 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-28 04:37:45.249 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:46210/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-28 04:37:45.256 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-28 04:37:45.256 DEBUG [tests.e2e.test_e2e] Node5 makes filter request pubsubtopic /waku/2/rs/3/1 and content topic /test/1/waku-filter/proto
2026-03-28 04:37:45.256 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:47879/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-28 04:37:45.302 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-03-28 04:37:45.305 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59924/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-28 04:37:45.317 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.42.34/tcp/40008/p2p/16Uiu2HAm4ZdnufwJnMUMadqK3nRsEE7pEWcuVsb3hoTDZAiPccR9","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"UnknownOrigin"}]'
2026-03-28 04:37:45.317 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:41316/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-28 04:37:45.319 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.14.45/tcp/42224/p2p/16Uiu2HAmD1cpV5GuxaJzGx1L3txZCV2y2f5PMcAcC86eqVib3xGK","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.53.167/tcp/59925/p2p/16Uiu2HAm9syfNd54XvtFEYa5v6xgkqgBvb4n75YCE4FLxfmWpRdh","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"Discv5"}]'
2026-03-28 04:37:45.320 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:24383/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-28 04:37:45.322 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.20.13/tcp/37732/p2p/16Uiu2HAmTaQ8T6vsAahu4vudxYyoRDzx4kUSQ6MaUeExZcJFHU8n","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.42.34/tcp/41317/p2p/16Uiu2HAm4ZdnufwJnMUMadqK3nRsEE7pEWcuVsb3hoTDZAiPccR9","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"Discv5"}]'
2026-03-28 04:37:45.322 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:46210/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-28 04:37:45.324 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.250.159/tcp/35840/p2p/16Uiu2HAmSV5Xgnq88k2dZVTzPGUsibtpANDnJR4Xr9qp9CTGTYAX","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.14.45/tcp/24384/p2p/16Uiu2HAmD1cpV5GuxaJzGx1L3txZCV2y2f5PMcAcC86eqVib3xGK","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"Discv5"}]'
2026-03-28 04:37:45.325 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47879/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-03-28 04:37:45.327 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.20.13/tcp/46211/p2p/16Uiu2HAmTaQ8T6vsAahu4vudxYyoRDzx4kUSQ6MaUeExZcJFHU8n","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0,1],"connected":"Connected","agent":"logos-delivery-v0.38.0-rc.0-14-g5c335c","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.14.45/tcp/24384/p2p/16Uiu2HAmD1cpV5GuxaJzGx1L3txZCV2y2f5PMcAcC86eqVib3xGK","protocols":["/vac/waku/relay/2.0.0","/vac/waku/filter-subscribe/2.0.0-beta1"],"shards":[0],"connected":"NotConnected","agent":"","origin":"Discv5"}]'
2026-03-28 04:37:45.327 DEBUG [src.libs.common] Sleeping for 60 seconds
2026-03-28 04:38:45.327 DEBUG [tests.e2e.test_e2e] 3 Nodes publish 12 message
2026-03-28 04:38:45.328 DEBUG [src.steps.store] Relaying message
2026-03-28 04:38:45.328 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59924/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-28 04:38:45.340 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-28 04:38:45.340 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-28 04:38:45.543 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-28 04:38:47.544 DEBUG [src.steps.store] Relaying message
2026-03-28 04:38:47.544 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59924/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-28 04:38:47.555 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-28 04:38:47.557 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-28 04:38:47.758 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-28 04:38:49.758 DEBUG [src.steps.store] Relaying message
2026-03-28 04:38:49.758 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59924/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-28 04:38:49.772 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-28 04:38:49.772 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-28 04:38:49.972 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-28 04:38:51.973 DEBUG [src.steps.store] Relaying message
2026-03-28 04:38:51.974 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59924/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-28 04:38:51.984 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-28 04:38:51.988 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-28 04:38:52.188 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-28 04:38:54.189 DEBUG [src.steps.store] Relaying message
2026-03-28 04:38:54.189 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41316/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-28 04:38:54.195 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-28 04:38:54.196 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-28 04:38:54.396 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-28 04:38:56.397 DEBUG [src.steps.store] Relaying message
2026-03-28 04:38:56.397 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41316/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-28 04:38:56.409 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-28 04:38:56.415 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-28 04:38:56.615 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-28 04:38:58.616 DEBUG [src.steps.store] Relaying message
2026-03-28 04:38:58.616 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41316/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-28 04:38:58.634 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-28 04:38:58.635 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-28 04:38:58.836 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-28 04:39:00.836 DEBUG [src.steps.store] Relaying message
2026-03-28 04:39:00.837 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:41316/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-28 04:39:00.845 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-28 04:39:00.849 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-28 04:39:01.049 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-28 04:39:03.050 DEBUG [src.steps.store] Relaying message
2026-03-28 04:39:03.051 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24383/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-28 04:39:03.063 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-28 04:39:03.067 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-28 04:39:03.268 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-28 04:39:05.269 DEBUG [src.steps.store] Relaying message
2026-03-28 04:39:05.270 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24383/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-28 04:39:05.284 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-28 04:39:05.291 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-28 04:39:05.492 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-28 04:39:07.492 DEBUG [src.steps.store] Relaying message
2026-03-28 04:39:07.493 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24383/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-28 04:39:07.502 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-28 04:39:07.503 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-28 04:39:07.704 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-28 04:39:09.704 DEBUG [src.steps.store] Relaying message
2026-03-28 04:39:09.705 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:24383/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-03-28 04:39:09.716 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-28 04:39:09.718 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-28 04:39:09.919 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-03-28 04:39:11.919 DEBUG [tests.e2e.test_e2e] Node5 requests messages of subscribed filter topic /waku/2/rs/3/1
2026-03-28 04:39:11.920 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:47879/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-03-28 04:39:11.923 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774672725328394441,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774672727544207416,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774672729758511255,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774672731973533356,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774672734189093828,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774672736397069928,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774672738616250201,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774672740836765265,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774672743050543966,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774672745269467245,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774672747492679925,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1774672749704627980,"ephemeral":false}]'
2026-03-28 04:39:11.923 DEBUG [tests.e2e.test_e2e] Response for node 5 is [{'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774672725328394441, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774672727544207416, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774672729758511255, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774672731973533356, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774672734189093828, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774672736397069928, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774672738616250201, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774672740836765265, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774672743050543966, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774672745269467245, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774672747492679925, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1774672749704627980, 'ephemeral': False}]
2026-03-28 04:39:11.925 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-28 04:39:11.926 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-28 04:39:11.926 DEBUG [src.node.waku_node] Stopping container with id a75cb4545f71
2026-03-28 04:39:12.455 DEBUG [src.node.waku_node] Container stopped.
2026-03-28 04:39:12.457 DEBUG [src.node.waku_node] Stopping container with id ca2e694fd103
2026-03-28 04:39:12.948 DEBUG [src.node.waku_node] Container stopped.
2026-03-28 04:39:12.949 DEBUG [src.node.waku_node] Stopping container with id f2e6fe234dba
2026-03-28 04:39:13.270 ERROR [src.node.docker_mananger] Max retries reached for container a75cb4545f71. Exiting log stream.
2026-03-28 04:39:13.437 DEBUG [src.node.waku_node] Container stopped.
2026-03-28 04:39:13.437 DEBUG [src.node.waku_node] Stopping container with id ad740b6f034c
2026-03-28 04:39:13.780 ERROR [src.node.docker_mananger] Max retries reached for container ca2e694fd103. Exiting log stream.
2026-03-28 04:39:14.252 ERROR [src.node.docker_mananger] Max retries reached for container f2e6fe234dba. Exiting log stream.
2026-03-28 04:39:23.927 DEBUG [src.node.waku_node] Container stopped.
2026-03-28 04:39:23.929 DEBUG [src.node.waku_node] Stopping container with id 47d7b2f7ca53
2026-03-28 04:39:24.387 DEBUG [src.node.waku_node] Container stopped.
2026-03-28 04:39:24.388 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-28 04:39:24.472 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-28 04:39:24.552 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-28 04:39:24.624 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-28 04:39:24.798 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-28 04:39:24.818 DEBUG [src.node.docker_mananger] No errors found in the waku logs.