2026-02-25 15:39:14 +00:00

225 lines
44 KiB
Plaintext

2026-02-25 15:20:32.545 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-25 15:20:32.545 DEBUG [tests.conftest] Running test: test_filter_3_senders_multiple_msg_1_receiver with id: 2026-02-25_15-20-32__553327b0-0270-45b7-a411-355041f9873b
2026-02-25 15:20:32.545 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-25 15:20:32.545 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-02-25 15:20:32.546 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-02-25 15:20:32.551 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 15:20:32.551 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-25_15-20-32__553327b0-0270-45b7-a411-355041f9873b__wakuorg_nwaku:latest.log
2026-02-25 15:20:32.556 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 15:20:32.556 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-25_15-20-32__553327b0-0270-45b7-a411-355041f9873b__wakuorg_nwaku:latest.log
2026-02-25 15:20:32.561 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 15:20:32.561 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-25_15-20-32__553327b0-0270-45b7-a411-355041f9873b__wakuorg_nwaku:latest.log
2026-02-25 15:20:32.562 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-02-25 15:20:32.562 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-02-25 15:20:32.567 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 15:20:32.567 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-02-25_15-20-32__553327b0-0270-45b7-a411-355041f9873b__wakuorg_nwaku:latest.log
2026-02-25 15:20:32.572 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-25 15:20:32.572 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-02-25_15-20-32__553327b0-0270-45b7-a411-355041f9873b__wakuorg_nwaku:latest.log
2026-02-25 15:20:32.572 DEBUG [tests.e2e.test_e2e] Start 5 nodes
2026-02-25 15:20:32.572 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 15:20:32.572 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 15:20:32.574 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 15:20:32.574 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.213.199
2026-02-25 15:20:32.574 DEBUG [src.node.docker_mananger] Generated ports ['55140', '55141', '55142', '55143', '55144']
2026-02-25 15:20:32.574 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 15:20:32.574 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 15:20:32.574 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 15:20:32.574 DEBUG [src.node.docker_mananger] docker run -i -t -p 55140:55140 -p 55141:55141 -p 55142:55142 -p 55143:55143 -p 55144:55144 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=55142 --rest-port=55140 --tcp-port=55141 --discv5-udp-port=55143 --rest-address=0.0.0.0 --nat=extip:172.18.213.199 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=1f32ec729efefafcba2fccdfc3dd1a8faa2a7e0daf490aa2dfab9b6e9ce91ba4 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=55144 --metrics-logging=true --relay=true --store=false
2026-02-25 15:20:32.714 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.213.199 waku fd14c44956c19719a20e911ec683d17e9fe80f58833bee7e073bcc9d8d111a96
2026-02-25 15:20:32.742 DEBUG [src.node.docker_mananger] Container started with ID fd14c44956c1. Setting up logs at ./log/docker/node1_2026-02-25_15-20-32__553327b0-0270-45b7-a411-355041f9873b__wakuorg_nwaku:latest.log
2026-02-25 15:20:32.743 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 55140
2026-02-25 15:20:32.743 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 15:20:32.851 ERROR [src.node.docker_mananger] Max retries reached for container 71a606784a00. Exiting log stream.
2026-02-25 15:20:33.330 ERROR [src.node.docker_mananger] Max retries reached for container 92880554c9d0. Exiting log stream.
2026-02-25 15:20:33.743 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55140/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:20:33.746 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 15:20:33.746 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 15:20:33.746 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55140/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:20:33.748 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.213.199/tcp/55141/p2p/16Uiu2HAmA9C3iPdGGnRjE5NaGxYcxWyqzfrjCpypsp8dkqomzQC1","/ip4/172.18.213.199/tcp/55142/ws/p2p/16Uiu2HAmA9C3iPdGGnRjE5NaGxYcxWyqzfrjCpypsp8dkqomzQC1"],"enrUri":"enr:-L24QJgUd2nhFPFv4ltHpKdoeiXhL6Cd5A8fF3a9MHT9EhSNSPpzWUvZVF65XyVpAvrkI_Fou_TW98cKFWSLM_RMLVgCgmlkgnY0gmlwhKwS1ceKbXVsdGlhZGRyc5YACASsEtXHBtdlAAoErBLVxwbXZt0DgnJzhQADAQAAiXNlY3AyNTZrMaEC2qZtfOaiq5B1-hVEH6yjZVUFyyQ3LAHFodS7mwC7KqKDdGNwgtdlg3VkcILXZ4V3YWt1MgE"}'
2026-02-25 15:20:33.749 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 15:20:33.749 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 15:20:33.749 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 15:20:33.750 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 15:20:33.750 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.68.192
2026-02-25 15:20:33.750 DEBUG [src.node.docker_mananger] Generated ports ['3164', '3165', '3166', '3167', '3168']
2026-02-25 15:20:33.750 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 15:20:33.751 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 15:20:33.751 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 15:20:33.751 DEBUG [src.node.docker_mananger] docker run -i -t -p 3164:3164 -p 3165:3165 -p 3166:3166 -p 3167:3167 -p 3168:3168 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=3166 --rest-port=3164 --tcp-port=3165 --discv5-udp-port=3167 --rest-address=0.0.0.0 --nat=extip:172.18.68.192 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=c74d7eb6fdc2f0e8abf624b3db1bbdad6ccdff80f265ac3fcdce40aabedce222 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=3168 --metrics-logging=true --relay=true --store=false --discv5-bootstrap-node=enr:-L24QJgUd2nhFPFv4ltHpKdoeiXhL6Cd5A8fF3a9MHT9EhSNSPpzWUvZVF65XyVpAvrkI_Fou_TW98cKFWSLM_RMLVgCgmlkgnY0gmlwhKwS1ceKbXVsdGlhZGRyc5YACASsEtXHBtdlAAoErBLVxwbXZt0DgnJzhQADAQAAiXNlY3AyNTZrMaEC2qZtfOaiq5B1-hVEH6yjZVUFyyQ3LAHFodS7mwC7KqKDdGNwgtdlg3VkcILXZ4V3YWt1MgE
2026-02-25 15:20:33.903 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.68.192 waku 57aa0ba893396cc5f66c21b80d48eb690e1c055271ea5fcbdf680df5868b44e2
2026-02-25 15:20:33.930 DEBUG [src.node.docker_mananger] Container started with ID 57aa0ba89339. Setting up logs at ./log/docker/node2_2026-02-25_15-20-32__553327b0-0270-45b7-a411-355041f9873b__wakuorg_nwaku:latest.log
2026-02-25 15:20:33.930 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 3164
2026-02-25 15:20:33.930 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 15:20:34.932 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3164/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:20:34.960 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 15:20:34.961 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 15:20:34.962 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3164/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:20:34.966 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.68.192/tcp/3165/p2p/16Uiu2HAm4j7ZBGJMWyxMZXRVpakp4eipa7FqzqMyGtriGoDuzpbp","/ip4/172.18.68.192/tcp/3166/ws/p2p/16Uiu2HAm4j7ZBGJMWyxMZXRVpakp4eipa7FqzqMyGtriGoDuzpbp"],"enrUri":"enr:-L24QOymRRg4VCLIMCQxl04umpazhMyyFMs6KsKymstNE17SFcqveVpy_E7qFLSctIWhbueraxjzpasggKBYM9e-kaMCgmlkgnY0gmlwhKwSRMCKbXVsdGlhZGRyc5YACASsEkTABgxdAAoErBJEwAYMXt0DgnJzhQADAQAAiXNlY3AyNTZrMaECijD5eRkDohNu6Nn84zMWd5Ok-EZdasvFzfb5FsJxUyeDdGNwggxdg3VkcIIMX4V3YWt1MgE"}'
2026-02-25 15:20:34.966 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 15:20:34.966 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 15:20:34.966 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 15:20:34.967 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 15:20:34.968 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.146.142
2026-02-25 15:20:34.968 DEBUG [src.node.docker_mananger] Generated ports ['2470', '2471', '2472', '2473', '2474']
2026-02-25 15:20:34.968 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 15:20:34.968 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 15:20:34.968 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 15:20:34.968 DEBUG [src.node.docker_mananger] docker run -i -t -p 2470:2470 -p 2471:2471 -p 2472:2472 -p 2473:2473 -p 2474:2474 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=2472 --rest-port=2470 --tcp-port=2471 --discv5-udp-port=2473 --rest-address=0.0.0.0 --nat=extip:172.18.146.142 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=5ae7df3bb0a15f25e16cda924dc3fc0e860d2007d7fdb5a0cc85e08ebca26eda --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=2474 --metrics-logging=true --relay=true --store=false --filter=true --discv5-bootstrap-node=enr:-L24QOymRRg4VCLIMCQxl04umpazhMyyFMs6KsKymstNE17SFcqveVpy_E7qFLSctIWhbueraxjzpasggKBYM9e-kaMCgmlkgnY0gmlwhKwSRMCKbXVsdGlhZGRyc5YACASsEkTABgxdAAoErBJEwAYMXt0DgnJzhQADAQAAiXNlY3AyNTZrMaECijD5eRkDohNu6Nn84zMWd5Ok-EZdasvFzfb5FsJxUyeDdGNwggxdg3VkcIIMX4V3YWt1MgE
2026-02-25 15:20:35.119 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.146.142 waku 6189d1b8b82e51ba6c8c26ed3bfad4c70e11de6493d0a87db89841bb1c6ad73a
2026-02-25 15:20:35.143 DEBUG [src.node.docker_mananger] Container started with ID 6189d1b8b82e. Setting up logs at ./log/docker/node3_2026-02-25_15-20-32__553327b0-0270-45b7-a411-355041f9873b__wakuorg_nwaku:latest.log
2026-02-25 15:20:35.144 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 2470
2026-02-25 15:20:35.144 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 15:20:36.145 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2470/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:20:36.163 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 15:20:36.164 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 15:20:36.164 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2470/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:20:36.170 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.146.142/tcp/2471/p2p/16Uiu2HAmMTCwe3FAZJ9JPkVXs8hwSZAj3zbNjnqwMPS18RuGK4X6","/ip4/172.18.146.142/tcp/2472/ws/p2p/16Uiu2HAmMTCwe3FAZJ9JPkVXs8hwSZAj3zbNjnqwMPS18RuGK4X6"],"enrUri":"enr:-L24QANZ9c7HXD4fklvg7FfHKI9alXhmw5eaFFH0mxvpeolmfO7PyfEDycRG_B9nQWy194PcFMdv5FeaQbByhX-tM60CgmlkgnY0gmlwhKwSko6KbXVsdGlhZGRyc5YACASsEpKOBgmnAAoErBKSjgYJqN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDgrRzYdx5PF7hLvJAsPruGMtS_-LoZkKSqNdu_RRkzv2DdGNwggmng3VkcIIJqYV3YWt1MgU"}'
2026-02-25 15:20:36.171 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 15:20:36.172 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 15:20:36.172 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 15:20:36.174 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 15:20:36.174 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.209.92
2026-02-25 15:20:36.174 DEBUG [src.node.docker_mananger] Generated ports ['56420', '56421', '56422', '56423', '56424']
2026-02-25 15:20:36.174 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 15:20:36.174 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 15:20:36.174 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 15:20:36.174 DEBUG [src.node.docker_mananger] docker run -i -t -p 56420:56420 -p 56421:56421 -p 56422:56422 -p 56423:56423 -p 56424:56424 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=56422 --rest-port=56420 --tcp-port=56421 --discv5-udp-port=56423 --rest-address=0.0.0.0 --nat=extip:172.18.209.92 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=25997eb1bbd99673fe3563b65827e42f9ed391dd9bd2dd4f8f3ace8230c097f5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=56424 --metrics-logging=true --relay=true --filter=true --store=false --discv5-bootstrap-node=enr:-L24QANZ9c7HXD4fklvg7FfHKI9alXhmw5eaFFH0mxvpeolmfO7PyfEDycRG_B9nQWy194PcFMdv5FeaQbByhX-tM60CgmlkgnY0gmlwhKwSko6KbXVsdGlhZGRyc5YACASsEpKOBgmnAAoErBKSjgYJqN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDgrRzYdx5PF7hLvJAsPruGMtS_-LoZkKSqNdu_RRkzv2DdGNwggmng3VkcIIJqYV3YWt1MgU
2026-02-25 15:20:36.332 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.209.92 waku 9f5a5b7d4d83ce6c5f2a0d69b9d1ddd0bf710b3ddb490bfbf3b29fa159360e13
2026-02-25 15:20:36.355 DEBUG [src.node.docker_mananger] Container started with ID 9f5a5b7d4d83. Setting up logs at ./log/docker/node4_2026-02-25_15-20-32__553327b0-0270-45b7-a411-355041f9873b__wakuorg_nwaku:latest.log
2026-02-25 15:20:36.356 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 56420
2026-02-25 15:20:36.357 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 15:20:37.357 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56420/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:20:37.374 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 15:20:37.375 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 15:20:37.375 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56420/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:20:37.379 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.209.92/tcp/56421/p2p/16Uiu2HAmCRPormxPF7nHj9rFV71PgrURcdMNfGT8NeEtbQjGr2fx","/ip4/172.18.209.92/tcp/56422/ws/p2p/16Uiu2HAmCRPormxPF7nHj9rFV71PgrURcdMNfGT8NeEtbQjGr2fx"],"enrUri":"enr:-L24QEscGizHP_udjhS897xEi7nC6Os--J3pPjLQuVvLOMZVd-kTW7t3OGYqnY28nQxPgGxZlnSLGXKrzlFY8IK6Q18CgmlkgnY0gmlwhKwS0VyKbXVsdGlhZGRyc5YACASsEtFcBtxlAAoErBLRXAbcZt0DgnJzhQADAQAAiXNlY3AyNTZrMaEC_IRkj7rl-aqmnJAz19n2vdMCTs_iROgg9X3HVmz1rY-DdGNwgtxlg3VkcILcZ4V3YWt1MgU"}'
2026-02-25 15:20:37.380 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 15:20:37.381 DEBUG [src.node.waku_node] Starting Node...
2026-02-25 15:20:37.381 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-25 15:20:37.383 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-25 15:20:37.383 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.71.63
2026-02-25 15:20:37.384 DEBUG [src.node.docker_mananger] Generated ports ['37702', '37703', '37704', '37705', '37706']
2026-02-25 15:20:37.384 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-25 15:20:37.384 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-25 15:20:37.384 DEBUG [src.node.waku_node] Using volumes []
2026-02-25 15:20:37.384 DEBUG [src.node.docker_mananger] docker run -i -t -p 37702:37702 -p 37703:37703 -p 37704:37704 -p 37705:37705 -p 37706:37706 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=37704 --rest-port=37702 --tcp-port=37703 --discv5-udp-port=37705 --rest-address=0.0.0.0 --nat=extip:172.18.71.63 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a80de4ffd133bd5f196bb1adaa5b3eda93f694cede46d7dc5d9a6d58ec0d7b8e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=37706 --metrics-logging=true --relay=false --filternode=/ip4/172.18.209.92/tcp/56421/p2p/16Uiu2HAmCRPormxPF7nHj9rFV71PgrURcdMNfGT8NeEtbQjGr2fx --store=false --discv5-bootstrap-node=enr:-L24QANZ9c7HXD4fklvg7FfHKI9alXhmw5eaFFH0mxvpeolmfO7PyfEDycRG_B9nQWy194PcFMdv5FeaQbByhX-tM60CgmlkgnY0gmlwhKwSko6KbXVsdGlhZGRyc5YACASsEpKOBgmnAAoErBKSjgYJqN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDgrRzYdx5PF7hLvJAsPruGMtS_-LoZkKSqNdu_RRkzv2DdGNwggmng3VkcIIJqYV3YWt1MgU
2026-02-25 15:20:37.533 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.71.63 waku 08cb338ac0bef26d573ba1b97a81cc8b380a870fe2f4c57cef411877fb7f1be5
2026-02-25 15:20:37.560 DEBUG [src.node.docker_mananger] Container started with ID 08cb338ac0be. Setting up logs at ./log/docker/node5_2026-02-25_15-20-32__553327b0-0270-45b7-a411-355041f9873b__wakuorg_nwaku:latest.log
2026-02-25 15:20:37.560 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 37702
2026-02-25 15:20:37.560 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-25 15:20:38.561 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37702/health" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:20:38.563 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-02-25 15:20:38.564 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-25 15:20:38.564 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37702/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:20:38.566 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.71.63/tcp/37703/p2p/16Uiu2HAmMKsP15534g25rng5rcgZQfFZdFd4ZV9z7avpCCy8b33s","/ip4/172.18.71.63/tcp/37704/ws/p2p/16Uiu2HAmMKsP15534g25rng5rcgZQfFZdFd4ZV9z7avpCCy8b33s"],"enrUri":"enr:-L24QM5uV6jAVFf9e3Qwe0wPXcoaEIWe7UsAeq2TC7MV7DvWTjWYia9QoCf2JN6pEJ9tYJ5psjAhMg7OcQ30ROZ25W8CgmlkgnY0gmlwhKwSRz-KbXVsdGlhZGRyc5YACASsEkc_BpNHAAoErBJHPwaTSN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDgNND8mnpyORmkGVkdDbYeZ0z66VZSpCYitWRgUryN-6DdGNwgpNHg3VkcIKTSYV3YWt1MgA"}'
2026-02-25 15:20:38.566 INFO [src.node.waku_node] REST service is ready !!
2026-02-25 15:20:38.566 DEBUG [tests.e2e.test_e2e] Subscribe nodes to relay pubsub topic /waku/2/rs/3/1
2026-02-25 15:20:38.566 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55140/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 15:20:38.569 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:20:38.570 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3164/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 15:20:38.575 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:20:38.575 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2470/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 15:20:38.583 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:20:38.584 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56420/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-25 15:20:38.591 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:20:38.592 DEBUG [tests.e2e.test_e2e] Node5 makes filter request pubsubtopic /waku/2/rs/3/1 and content topic /test/1/waku-filter/proto
2026-02-25 15:20:38.592 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:37702/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-25 15:20:38.630 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-02-25 15:20:38.631 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55140/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:20:38.635 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.68.192/tcp/49054/p2p/16Uiu2HAm4j7ZBGJMWyxMZXRVpakp4eipa7FqzqMyGtriGoDuzpbp","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"}]'
2026-02-25 15:20:38.636 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:3164/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:20:38.639 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.213.199/tcp/55141/p2p/16Uiu2HAmA9C3iPdGGnRjE5NaGxYcxWyqzfrjCpypsp8dkqomzQC1","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"Discv5"},{"multiaddr":"/ip4/172.18.146.142/tcp/42234/p2p/16Uiu2HAmMTCwe3FAZJ9JPkVXs8hwSZAj3zbNjnqwMPS18RuGK4X6","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"}]'
2026-02-25 15:20:38.639 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:2470/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:20:38.641 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.68.192/tcp/3165/p2p/16Uiu2HAm4j7ZBGJMWyxMZXRVpakp4eipa7FqzqMyGtriGoDuzpbp","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"Discv5"},{"multiaddr":"/ip4/172.18.209.92/tcp/39340/p2p/16Uiu2HAmCRPormxPF7nHj9rFV71PgrURcdMNfGT8NeEtbQjGr2fx","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"}]'
2026-02-25 15:20:38.642 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56420/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:20:38.644 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.71.63/tcp/57612/p2p/16Uiu2HAmMKsP15534g25rng5rcgZQfFZdFd4ZV9z7avpCCy8b33s","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.146.142/tcp/2471/p2p/16Uiu2HAmMTCwe3FAZJ9JPkVXs8hwSZAj3zbNjnqwMPS18RuGK4X6","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"Discv5"}]'
2026-02-25 15:20:38.644 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37702/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:20:38.646 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.146.142/tcp/2471/p2p/16Uiu2HAmMTCwe3FAZJ9JPkVXs8hwSZAj3zbNjnqwMPS18RuGK4X6","protocols":["/vac/waku/relay/2.0.0","/vac/waku/filter-subscribe/2.0.0-beta1"],"shards":[0],"connected":"NotConnected","agent":"","origin":"Discv5"},{"multiaddr":"/ip4/172.18.209.92/tcp/56421/p2p/16Uiu2HAmCRPormxPF7nHj9rFV71PgrURcdMNfGT8NeEtbQjGr2fx","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0,1],"connected":"Connected","agent":"nwaku-v0.36.0-156-gc7e0cc","origin":"UnknownOrigin"}]'
2026-02-25 15:20:38.646 DEBUG [src.libs.common] Sleeping for 60 seconds
2026-02-25 15:21:38.647 DEBUG [tests.e2e.test_e2e] 3 Nodes publish 12 message
2026-02-25 15:21:38.647 DEBUG [src.steps.store] Relaying message
2026-02-25 15:21:38.647 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55140/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:21:38.656 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:21:38.657 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:21:38.861 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 15:21:40.863 DEBUG [src.steps.store] Relaying message
2026-02-25 15:21:40.863 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55140/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:21:40.869 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:21:40.871 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:21:41.072 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 15:21:43.073 DEBUG [src.steps.store] Relaying message
2026-02-25 15:21:43.073 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55140/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:21:43.081 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:21:43.081 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:21:43.281 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 15:21:45.283 DEBUG [src.steps.store] Relaying message
2026-02-25 15:21:45.283 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55140/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:21:45.289 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:21:45.294 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:21:45.494 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 15:21:47.495 DEBUG [src.steps.store] Relaying message
2026-02-25 15:21:47.495 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3164/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:21:47.511 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:21:47.511 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:21:47.712 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 15:21:49.712 DEBUG [src.steps.store] Relaying message
2026-02-25 15:21:49.712 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3164/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:21:49.720 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:21:49.720 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:21:49.921 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 15:21:51.923 DEBUG [src.steps.store] Relaying message
2026-02-25 15:21:51.923 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3164/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:21:51.933 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:21:51.933 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:21:52.134 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 15:21:54.135 DEBUG [src.steps.store] Relaying message
2026-02-25 15:21:54.135 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:3164/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:21:54.145 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:21:54.146 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:21:54.347 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 15:21:56.347 DEBUG [src.steps.store] Relaying message
2026-02-25 15:21:56.347 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2470/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:21:56.357 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:21:56.359 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:21:56.560 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 15:21:58.560 DEBUG [src.steps.store] Relaying message
2026-02-25 15:21:58.560 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2470/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:21:58.570 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:21:58.573 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:21:58.774 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 15:22:00.774 DEBUG [src.steps.store] Relaying message
2026-02-25 15:22:00.774 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2470/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:22:00.781 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:22:00.781 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:22:00.983 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 15:22:02.983 DEBUG [src.steps.store] Relaying message
2026-02-25 15:22:02.983 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:2470/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-25 15:22:02.990 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-25 15:22:02.990 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-02-25 15:22:03.190 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-02-25 15:22:05.191 DEBUG [tests.e2e.test_e2e] Node5 requests messages of subscribed filter topic /waku/2/rs/3/1
2026-02-25 15:22:05.191 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:37702/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-25 15:22:05.193 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772032898647388586,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772032900862758094,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772032903073267823,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772032905282704912,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772032907495122645,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772032909712599673,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772032911922783431,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772032914135336235,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772032916347383643,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772032918560568077,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772032920774495584,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1772032922983588296,"ephemeral":false}]'
2026-02-25 15:22:05.194 DEBUG [tests.e2e.test_e2e] Response for node 5 is [{'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772032898647388586, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772032900862758094, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772032903073267823, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772032905282704912, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772032907495122645, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772032909712599673, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772032911922783431, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772032914135336235, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772032916347383643, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772032918560568077, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772032920774495584, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1772032922983588296, 'ephemeral': False}]
2026-02-25 15:22:05.195 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-25 15:22:05.196 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-25 15:22:05.196 DEBUG [src.node.waku_node] Stopping container with id fd14c44956c1
2026-02-25 15:22:05.720 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 15:22:05.720 DEBUG [src.node.waku_node] Stopping container with id 57aa0ba89339
2026-02-25 15:22:06.194 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 15:22:06.195 DEBUG [src.node.waku_node] Stopping container with id 6189d1b8b82e
2026-02-25 15:22:06.532 ERROR [src.node.docker_mananger] Max retries reached for container fd14c44956c1. Exiting log stream.
2026-02-25 15:22:06.615 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 15:22:06.616 DEBUG [src.node.waku_node] Stopping container with id 9f5a5b7d4d83
2026-02-25 15:22:07.010 ERROR [src.node.docker_mananger] Max retries reached for container 57aa0ba89339. Exiting log stream.
2026-02-25 15:22:07.053 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 15:22:07.053 DEBUG [src.node.waku_node] Stopping container with id 08cb338ac0be
2026-02-25 15:22:07.427 ERROR [src.node.docker_mananger] Max retries reached for container 6189d1b8b82e. Exiting log stream.
2026-02-25 15:22:07.506 DEBUG [src.node.waku_node] Container stopped.
2026-02-25 15:22:07.508 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-25 15:22:07.582 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 15:22:07.652 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 15:22:07.717 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 15:22:07.800 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-25 15:22:07.821 DEBUG [src.node.docker_mananger] No errors found in the waku logs.