116 lines
21 KiB
Plaintext

2026-02-28 04:25:08.339 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-28 04:25:08.339 DEBUG [tests.conftest] Running test: test_repeated_filter_requestID with id: 2026-02-28_04-25-08__059d381a-c95d-4c36-8ec9-bcc5b2c76128
2026-02-28 04:25:08.340 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-28 04:25:08.340 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-02-28 04:25:08.340 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-02-28 04:25:08.351 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:25:08.351 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-28_04-25-08__059d381a-c95d-4c36-8ec9-bcc5b2c76128__wakuorg_nwaku:latest.log
2026-02-28 04:25:08.358 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:25:08.358 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-28_04-25-08__059d381a-c95d-4c36-8ec9-bcc5b2c76128__wakuorg_nwaku:latest.log
2026-02-28 04:25:08.364 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-28 04:25:08.364 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-28_04-25-08__059d381a-c95d-4c36-8ec9-bcc5b2c76128__wakuorg_nwaku:latest.log
2026-02-28 04:25:08.365 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-28 04:25:08.365 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-02-28 04:25:08.366 DEBUG [tests.e2e.test_e2e] Create 3 nodes
2026-02-28 04:25:08.366 DEBUG [tests.e2e.test_e2e] Start 3 nodes with their corresponding config
2026-02-28 04:25:08.366 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:25:08.366 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:25:08.410 DEBUG [src.node.docker_mananger] Network waku created
2026-02-28 04:25:08.411 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.17.19
2026-02-28 04:25:08.411 DEBUG [src.node.docker_mananger] Generated ports ['63039', '63040', '63041', '63042', '63043']
2026-02-28 04:25:08.411 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:25:08.411 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:25:08.411 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:25:08.411 DEBUG [src.node.docker_mananger] docker run -i -t -p 63039:63039 -p 63040:63040 -p 63041:63041 -p 63042:63042 -p 63043:63043 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63041 --rest-port=63039 --tcp-port=63040 --discv5-udp-port=63042 --rest-address=0.0.0.0 --nat=extip:172.18.17.19 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=7ec7fde6db94aaccaaf8bede0cc5aa0f9f999d6c79b9edcaf1b75ae228fb801b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63043 --metrics-logging=true --relay=true --store=true
2026-02-28 04:25:11.297 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.17.19 waku 7d6b75bb08b887f4f7a4cb962b4db124ace8ceaa08624510e90b5c0607b5dafa
2026-02-28 04:25:11.334 DEBUG [src.node.docker_mananger] Container started with ID 7d6b75bb08b8. Setting up logs at ./log/docker/node1_2026-02-28_04-25-08__059d381a-c95d-4c36-8ec9-bcc5b2c76128__wakuorg_nwaku:latest.log
2026-02-28 04:25:11.335 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 63039
2026-02-28 04:25:11.337 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:25:12.338 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63039/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:12.341 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:25:12.342 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:25:12.342 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63039/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:12.344 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.17.19/tcp/63040/p2p/16Uiu2HAm4KX8AFc1tXwANrHL1zFWgTecyG5ekW3bwLXE23MH59fk","/ip4/172.18.17.19/tcp/63041/ws/p2p/16Uiu2HAm4KX8AFc1tXwANrHL1zFWgTecyG5ekW3bwLXE23MH59fk"],"enrUri":"enr:-L24QMVmjbsYvUjlZODoyaHax4AQzYKXEga2QDNYt4cHE60SNwejthNP-3sLAMpHeNWc3p7ZUUAn6jGZVwnNK5uYz30CgmlkgnY0gmlwhKwSEROKbXVsdGlhZGRyc5YACASsEhETBvZAAAoErBIREwb2Qd0DgnJzhQADAQAAiXNlY3AyNTZrMaEChCWvK7AayPzHPD_mWevYd84afI4y6KQsZVNC-GGpiAeDdGNwgvZAg3VkcIL2QoV3YWt1MgM"}'
2026-02-28 04:25:12.344 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:25:12.345 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:25:12.345 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:25:12.346 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:25:12.347 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.175.250
2026-02-28 04:25:12.347 DEBUG [src.node.docker_mananger] Generated ports ['42912', '42913', '42914', '42915', '42916']
2026-02-28 04:25:12.347 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:25:12.347 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:25:12.348 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:25:12.348 DEBUG [src.node.docker_mananger] docker run -i -t -p 42912:42912 -p 42913:42913 -p 42914:42914 -p 42915:42915 -p 42916:42916 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=42914 --rest-port=42912 --tcp-port=42913 --discv5-udp-port=42915 --rest-address=0.0.0.0 --nat=extip:172.18.175.250 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c9b261282b80dadad4ad8b3ea00fc3b6c6a805dd9c421b94ccd9370bf6a6dde1 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=42916 --metrics-logging=true --relay=true --store=true --filter=true --discv5-bootstrap-node=enr:-L24QMVmjbsYvUjlZODoyaHax4AQzYKXEga2QDNYt4cHE60SNwejthNP-3sLAMpHeNWc3p7ZUUAn6jGZVwnNK5uYz30CgmlkgnY0gmlwhKwSEROKbXVsdGlhZGRyc5YACASsEhETBvZAAAoErBIREwb2Qd0DgnJzhQADAQAAiXNlY3AyNTZrMaEChCWvK7AayPzHPD_mWevYd84afI4y6KQsZVNC-GGpiAeDdGNwgvZAg3VkcIL2QoV3YWt1MgM
2026-02-28 04:25:12.536 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.175.250 waku f850ff6ee605dc4b00d0f6f7837e3e913590b63b7711ffa3113b5c85fee9796c
2026-02-28 04:25:12.572 DEBUG [src.node.docker_mananger] Container started with ID f850ff6ee605. Setting up logs at ./log/docker/node2_2026-02-28_04-25-08__059d381a-c95d-4c36-8ec9-bcc5b2c76128__wakuorg_nwaku:latest.log
2026-02-28 04:25:12.573 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 42912
2026-02-28 04:25:12.573 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:25:13.574 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42912/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:13.576 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:25:13.577 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:25:13.577 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42912/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:13.579 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.175.250/tcp/42913/p2p/16Uiu2HAmHS7zq1L68WSyfaipHLSewDccoxm5amiLJPRG9VRNvAGP","/ip4/172.18.175.250/tcp/42914/ws/p2p/16Uiu2HAmHS7zq1L68WSyfaipHLSewDccoxm5amiLJPRG9VRNvAGP"],"enrUri":"enr:-L24QMcNcMBwMzBpV7tIpma1mq6q2Fvac9_AZKFQeC3K5blUDHD5r5_ujbOa1jIM4WuZanqlNGbNKxlLd5L3-a-rR3UCgmlkgnY0gmlwhKwSr_qKbXVsdGlhZGRyc5YACASsEq_6BqehAAoErBKv-ganot0DgnJzhQADAQAAiXNlY3AyNTZrMaEDRv6H5c80dMZbZ3hv9bGU_O9YwwCHom6Uuzs7brxp71iDdGNwgqehg3VkcIKno4V3YWt1Mgc"}'
2026-02-28 04:25:13.579 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:25:13.580 DEBUG [src.node.waku_node] Starting Node...
2026-02-28 04:25:13.580 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-28 04:25:13.581 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-28 04:25:13.581 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.15.96
2026-02-28 04:25:13.582 DEBUG [src.node.docker_mananger] Generated ports ['62306', '62307', '62308', '62309', '62310']
2026-02-28 04:25:13.582 DEBUG [src.node.waku_node] Cluster id was resolved to: 3
2026-02-28 04:25:13.582 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-02-28 04:25:13.582 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-28 04:25:13.582 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-28 04:25:13.582 DEBUG [src.node.waku_node] Using volumes []
2026-02-28 04:25:13.582 DEBUG [src.node.docker_mananger] docker run -i -t -p 62306:62306 -p 62307:62307 -p 62308:62308 -p 62309:62309 -p 62310:62310 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=62308 --rest-port=62306 --tcp-port=62307 --discv5-udp-port=62309 --rest-address=0.0.0.0 --nat=extip:172.18.15.96 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ed5be3bfa99ee44cee80e12bfcb68efae7a230fbffa18fcceae23415f9d1f90a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=62310 --metrics-logging=true --relay=true --filternode=/ip4/172.18.175.250/tcp/42913/p2p/16Uiu2HAmHS7zq1L68WSyfaipHLSewDccoxm5amiLJPRG9VRNvAGP --store=false --discv5-bootstrap-node=enr:-L24QMcNcMBwMzBpV7tIpma1mq6q2Fvac9_AZKFQeC3K5blUDHD5r5_ujbOa1jIM4WuZanqlNGbNKxlLd5L3-a-rR3UCgmlkgnY0gmlwhKwSr_qKbXVsdGlhZGRyc5YACASsEq_6BqehAAoErBKv-ganot0DgnJzhQADAQAAiXNlY3AyNTZrMaEDRv6H5c80dMZbZ3hv9bGU_O9YwwCHom6Uuzs7brxp71iDdGNwgqehg3VkcIKno4V3YWt1Mgc
2026-02-28 04:25:13.802 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.15.96 waku d488c45325ba830290c3ed21a2c7930bccbaf8719d109ec8299cf60f635c409a
2026-02-28 04:25:13.836 DEBUG [src.node.docker_mananger] Container started with ID d488c45325ba. Setting up logs at ./log/docker/node3_2026-02-28_04-25-08__059d381a-c95d-4c36-8ec9-bcc5b2c76128__wakuorg_nwaku:latest.log
2026-02-28 04:25:13.837 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 62306
2026-02-28 04:25:13.837 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-28 04:25:14.838 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62306/health" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:14.841 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-28 04:25:14.841 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-28 04:25:14.841 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62306/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:14.844 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.15.96/tcp/62307/p2p/16Uiu2HAm52k2YyYTQJBHjtAdZEpFfoikGkMuWnmYyV4UderVEQLh","/ip4/172.18.15.96/tcp/62308/ws/p2p/16Uiu2HAm52k2YyYTQJBHjtAdZEpFfoikGkMuWnmYyV4UderVEQLh"],"enrUri":"enr:-L24QFwk_wX3Q9PD9q3F9WkTZDmPFg7gvzfNmUkxW_mDz1WOPPdQymZBJymgQBNB3C9y-FWSxC4YFH95biVko2OZHRACgmlkgnY0gmlwhKwSD2CKbXVsdGlhZGRyc5YACASsEg9gBvNjAAoErBIPYAbzZN0DgnJzhQADAQAAiXNlY3AyNTZrMaECjrUWVdxPAWNhorDC7urK2ei3ndVJZ8VOkpHd2G3y4lqDdGNwgvNjg3VkcILzZYV3YWt1MgE"}'
2026-02-28 04:25:14.844 INFO [src.node.waku_node] REST service is ready !!
2026-02-28 04:25:14.844 DEBUG [tests.e2e.test_e2e] Subscribe nodes to relay pubsub topics
2026-02-28 04:25:14.844 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63039/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-28 04:25:14.849 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:25:14.849 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42912/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-28 04:25:14.854 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:25:14.855 DEBUG [tests.e2e.test_e2e] Wait for all nodes auto connection
2026-02-28 04:25:14.855 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63039/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:14.860 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.175.250/tcp/41786/p2p/16Uiu2HAmHS7zq1L68WSyfaipHLSewDccoxm5amiLJPRG9VRNvAGP","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"UnknownOrigin"}]'
2026-02-28 04:25:14.860 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42912/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:14.865 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.17.19/tcp/63040/p2p/16Uiu2HAm4KX8AFc1tXwANrHL1zFWgTecyG5ekW3bwLXE23MH59fk","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/store-query/3.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-157-gba8587","origin":"Discv5"}]'
2026-02-28 04:25:14.866 DEBUG [src.libs.common] Sleeping for 30 seconds
2026-02-28 04:25:44.866 DEBUG [tests.e2e.test_e2e] Node3 subscribe to filter for pubsubtopic /waku/2/rs/3/1 2 times with same request id
2026-02-28 04:25:44.867 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62306/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-28 04:25:44.876 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-02-28 04:25:44.877 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62306/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-28 04:25:44.886 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-02-28 04:25:44.886 DEBUG [tests.e2e.test_e2e] Node1 publish message for topic /waku/2/rs/3/1
2026-02-28 04:25:44.886 DEBUG [src.steps.store] Relaying message
2026-02-28 04:25:44.887 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63039/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-28 04:25:44.892 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-28 04:25:44.892 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-28 04:25:45.093 DEBUG [src.libs.common] Sleeping for 5 seconds
2026-02-28 04:25:50.093 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62306/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:50.096 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772252744886691026,"ephemeral":false}]'
2026-02-28 04:25:50.096 DEBUG [tests.e2e.test_e2e] Response for node 3 is [{'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772252744886691026, 'ephemeral': False}]
2026-02-28 04:25:50.096 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62306/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-28 04:25:50.099 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[]'
2026-02-28 04:25:50.099 DEBUG [tests.e2e.test_e2e] Response for node3 using same request ID is []
2026-02-28 04:25:50.101 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-28 04:25:50.102 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-28 04:25:50.102 DEBUG [src.node.waku_node] Stopping container with id 7d6b75bb08b8
2026-02-28 04:25:50.704 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:25:50.706 DEBUG [src.node.waku_node] Stopping container with id f850ff6ee605
2026-02-28 04:25:51.256 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:25:51.257 DEBUG [src.node.waku_node] Stopping container with id d488c45325ba
2026-02-28 04:25:51.517 ERROR [src.node.docker_mananger] Max retries reached for container 7d6b75bb08b8. Exiting log stream.
2026-02-28 04:25:51.794 DEBUG [src.node.waku_node] Container stopped.
2026-02-28 04:25:51.795 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-28 04:25:51.828 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-28 04:25:51.853 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-28 04:25:51.874 DEBUG [src.node.docker_mananger] No errors found in the waku logs.