225 lines
44 KiB
Plaintext

2026-01-29 04:31:45.831 DEBUG [tests.conftest] Running fixture setup: test_id
2026-01-29 04:31:45.831 DEBUG [tests.conftest] Running test: test_filter_3_senders_multiple_msg_1_receiver with id: 2026-01-29_04-31-45__a577cbf3-1ed0-4400-b63c-830d24e424cb
2026-01-29 04:31:45.832 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-01-29 04:31:45.832 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-01-29 04:31:45.832 DEBUG [src.steps.light_push] Running fixture setup: light_push_setup
2026-01-29 04:31:45.839 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-29 04:31:45.839 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-01-29_04-31-45__a577cbf3-1ed0-4400-b63c-830d24e424cb__wakuorg_nwaku:latest.log
2026-01-29 04:31:45.845 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-29 04:31:45.845 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-01-29_04-31-45__a577cbf3-1ed0-4400-b63c-830d24e424cb__wakuorg_nwaku:latest.log
2026-01-29 04:31:45.851 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-29 04:31:45.851 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-01-29_04-31-45__a577cbf3-1ed0-4400-b63c-830d24e424cb__wakuorg_nwaku:latest.log
2026-01-29 04:31:45.851 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-01-29 04:31:45.851 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-01-29 04:31:45.859 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-29 04:31:45.859 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-01-29_04-31-45__a577cbf3-1ed0-4400-b63c-830d24e424cb__wakuorg_nwaku:latest.log
2026-01-29 04:31:45.865 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-01-29 04:31:45.865 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-01-29_04-31-45__a577cbf3-1ed0-4400-b63c-830d24e424cb__wakuorg_nwaku:latest.log
2026-01-29 04:31:45.865 DEBUG [tests.e2e.test_e2e] Start 5 nodes
2026-01-29 04:31:45.865 DEBUG [src.node.waku_node] Starting Node...
2026-01-29 04:31:45.865 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-29 04:31:45.867 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-29 04:31:45.867 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.244.196
2026-01-29 04:31:45.867 DEBUG [src.node.docker_mananger] Generated ports ['12847', '12848', '12849', '12850', '12851']
2026-01-29 04:31:45.867 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-29 04:31:45.867 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-29 04:31:45.867 DEBUG [src.node.waku_node] Using volumes []
2026-01-29 04:31:45.868 DEBUG [src.node.docker_mananger] docker run -i -t -p 12847:12847 -p 12848:12848 -p 12849:12849 -p 12850:12850 -p 12851:12851 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=12849 --rest-port=12847 --tcp-port=12848 --discv5-udp-port=12850 --rest-address=0.0.0.0 --nat=extip:172.18.244.196 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=548dbdb743f2c6ebcd903a6ebcc2dcc9476b3def9911fa49da1a34bd60ea1ec8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=12851 --metrics-logging=true --relay=true --store=false
2026-01-29 04:31:46.058 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.244.196 waku ff15469828059d938d0b86b02e152401326f847f5fcd6dd4c7134a4b3fb08769
2026-01-29 04:31:46.059 ERROR [src.node.docker_mananger] Max retries reached for container ae33525d99df. Exiting log stream.
2026-01-29 04:31:46.090 DEBUG [src.node.docker_mananger] Container started with ID ff1546982805. Setting up logs at ./log/docker/node1_2026-01-29_04-31-45__a577cbf3-1ed0-4400-b63c-830d24e424cb__wakuorg_nwaku:latest.log
2026-01-29 04:31:46.091 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 12847
2026-01-29 04:31:46.092 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-29 04:31:46.635 ERROR [src.node.docker_mananger] Max retries reached for container b3a5ed2aa0e7. Exiting log stream.
2026-01-29 04:31:47.092 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12847/health" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:47.096 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-01-29 04:31:47.096 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-29 04:31:47.096 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12847/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:47.098 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.244.196/tcp/12848/p2p/16Uiu2HAmJqMFw4nRJFXKfAea39bkQ4EgsCBHy1YKd8RdmgCVhtqk","/ip4/172.18.244.196/tcp/12849/ws/p2p/16Uiu2HAmJqMFw4nRJFXKfAea39bkQ4EgsCBHy1YKd8RdmgCVhtqk"],"enrUri":"enr:-L24QD_4_KdVfFNyw5I6YxHhUbosQqdmAHiIsyCldGRhxxqkAU1llFqbDfGanawtGEho3hIO5JIoXUX5bMiol5H5p-MCgmlkgnY0gmlwhKwS9MSKbXVsdGlhZGRyc5YACASsEvTEBjIwAAoErBL0xAYyMd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDW82R6wU_AW5MkfO4K0eZM_oZDHwsIdQQW6aC5GL3zNeDdGNwgjIwg3VkcIIyMoV3YWt1MgE"}'
2026-01-29 04:31:47.098 INFO [src.node.waku_node] REST service is ready !!
2026-01-29 04:31:47.099 DEBUG [src.node.waku_node] Starting Node...
2026-01-29 04:31:47.099 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-29 04:31:47.100 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-29 04:31:47.100 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.128.102
2026-01-29 04:31:47.100 DEBUG [src.node.docker_mananger] Generated ports ['59707', '59708', '59709', '59710', '59711']
2026-01-29 04:31:47.101 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-29 04:31:47.101 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-29 04:31:47.101 DEBUG [src.node.waku_node] Using volumes []
2026-01-29 04:31:47.101 DEBUG [src.node.docker_mananger] docker run -i -t -p 59707:59707 -p 59708:59708 -p 59709:59709 -p 59710:59710 -p 59711:59711 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=59709 --rest-port=59707 --tcp-port=59708 --discv5-udp-port=59710 --rest-address=0.0.0.0 --nat=extip:172.18.128.102 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=edecba9d2b2fca8768acb2abc7d6e9bfdddd7fbc44eca002daccd375de4a8fbd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=59711 --metrics-logging=true --relay=true --store=false --discv5-bootstrap-node=enr:-L24QD_4_KdVfFNyw5I6YxHhUbosQqdmAHiIsyCldGRhxxqkAU1llFqbDfGanawtGEho3hIO5JIoXUX5bMiol5H5p-MCgmlkgnY0gmlwhKwS9MSKbXVsdGlhZGRyc5YACASsEvTEBjIwAAoErBL0xAYyMd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDW82R6wU_AW5MkfO4K0eZM_oZDHwsIdQQW6aC5GL3zNeDdGNwgjIwg3VkcIIyMoV3YWt1MgE
2026-01-29 04:31:47.288 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.128.102 waku 9329a8f13f5f4d5b4038573f6b215cec0de7fe86338d09194361b8809f31d6e9
2026-01-29 04:31:47.318 DEBUG [src.node.docker_mananger] Container started with ID 9329a8f13f5f. Setting up logs at ./log/docker/node2_2026-01-29_04-31-45__a577cbf3-1ed0-4400-b63c-830d24e424cb__wakuorg_nwaku:latest.log
2026-01-29 04:31:47.318 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 59707
2026-01-29 04:31:47.319 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-29 04:31:48.320 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59707/health" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:48.333 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-01-29 04:31:48.335 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-29 04:31:48.336 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59707/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:48.339 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.128.102/tcp/59708/p2p/16Uiu2HAmByzvaLbfmzoioXBXd8wVhcQe4Xpx4hfx7K3GSbH55rsY","/ip4/172.18.128.102/tcp/59709/ws/p2p/16Uiu2HAmByzvaLbfmzoioXBXd8wVhcQe4Xpx4hfx7K3GSbH55rsY"],"enrUri":"enr:-L24QPc6OAocQx1mWATnIb05awBiKuQtGEE6l1pHXdsxtF0HWyZd9jowgjKDVM9HMRTnd5AiHSUpcIqohJhvVw6HSzUCgmlkgnY0gmlwhKwSgGaKbXVsdGlhZGRyc5YACASsEoBmBuk8AAoErBKAZgbpPd0DgnJzhQADAQAAiXNlY3AyNTZrMaEC9gL_Ui55Oh3E7dYPu6PJdo9fbODkLlQRwY0TUegDzDeDdGNwguk8g3VkcILpPoV3YWt1MgE"}'
2026-01-29 04:31:48.339 INFO [src.node.waku_node] REST service is ready !!
2026-01-29 04:31:48.340 DEBUG [src.node.waku_node] Starting Node...
2026-01-29 04:31:48.340 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-29 04:31:48.341 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-29 04:31:48.341 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.226.89
2026-01-29 04:31:48.341 DEBUG [src.node.docker_mananger] Generated ports ['34626', '34627', '34628', '34629', '34630']
2026-01-29 04:31:48.342 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-29 04:31:48.342 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-29 04:31:48.342 DEBUG [src.node.waku_node] Using volumes []
2026-01-29 04:31:48.342 DEBUG [src.node.docker_mananger] docker run -i -t -p 34626:34626 -p 34627:34627 -p 34628:34628 -p 34629:34629 -p 34630:34630 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=34628 --rest-port=34626 --tcp-port=34627 --discv5-udp-port=34629 --rest-address=0.0.0.0 --nat=extip:172.18.226.89 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=cd427f094ebfba76fbbd7e3f60575ef01678fa6e5a8effacb60fbca1bedd6f2a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=34630 --metrics-logging=true --relay=true --store=false --filter=true --discv5-bootstrap-node=enr:-L24QPc6OAocQx1mWATnIb05awBiKuQtGEE6l1pHXdsxtF0HWyZd9jowgjKDVM9HMRTnd5AiHSUpcIqohJhvVw6HSzUCgmlkgnY0gmlwhKwSgGaKbXVsdGlhZGRyc5YACASsEoBmBuk8AAoErBKAZgbpPd0DgnJzhQADAQAAiXNlY3AyNTZrMaEC9gL_Ui55Oh3E7dYPu6PJdo9fbODkLlQRwY0TUegDzDeDdGNwguk8g3VkcILpPoV3YWt1MgE
2026-01-29 04:31:48.523 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.226.89 waku 68fab399e8e0a1128f315dddcb3aa101f854db85c4fbc91fc1e4399b3ae4f73c
2026-01-29 04:31:48.554 DEBUG [src.node.docker_mananger] Container started with ID 68fab399e8e0. Setting up logs at ./log/docker/node3_2026-01-29_04-31-45__a577cbf3-1ed0-4400-b63c-830d24e424cb__wakuorg_nwaku:latest.log
2026-01-29 04:31:48.554 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 34626
2026-01-29 04:31:48.555 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-29 04:31:49.556 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34626/health" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:49.564 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-01-29 04:31:49.564 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-29 04:31:49.564 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34626/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:49.569 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.226.89/tcp/34627/p2p/16Uiu2HAmFyKKhmvFm9wthUL9GUCTZGRu9ncU9XsZAQj7rLg72bj7","/ip4/172.18.226.89/tcp/34628/ws/p2p/16Uiu2HAmFyKKhmvFm9wthUL9GUCTZGRu9ncU9XsZAQj7rLg72bj7"],"enrUri":"enr:-L24QApMuiyVVfXBLVDeybJwe_kp4oV6uTFMalbES_lE4nheO-6MUmGAqPSO_3nqpyRZeKi2_0za8Mh0ofj3TUGJ9iYCgmlkgnY0gmlwhKwS4lmKbXVsdGlhZGRyc5YACASsEuJZBodDAAoErBLiWQaHRN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDMUT3wSaDaS0gzKtlcNwhiecI-Iq1hLBSTt--gL5LI3qDdGNwgodDg3VkcIKHRYV3YWt1MgU"}'
2026-01-29 04:31:49.571 INFO [src.node.waku_node] REST service is ready !!
2026-01-29 04:31:49.572 DEBUG [src.node.waku_node] Starting Node...
2026-01-29 04:31:49.572 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-29 04:31:49.574 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-29 04:31:49.574 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.154.83
2026-01-29 04:31:49.574 DEBUG [src.node.docker_mananger] Generated ports ['14827', '14828', '14829', '14830', '14831']
2026-01-29 04:31:49.574 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-29 04:31:49.574 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-29 04:31:49.574 DEBUG [src.node.waku_node] Using volumes []
2026-01-29 04:31:49.575 DEBUG [src.node.docker_mananger] docker run -i -t -p 14827:14827 -p 14828:14828 -p 14829:14829 -p 14830:14830 -p 14831:14831 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=14829 --rest-port=14827 --tcp-port=14828 --discv5-udp-port=14830 --rest-address=0.0.0.0 --nat=extip:172.18.154.83 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=df2c9296c04eced6468e52ecf7a5d8fdac4168cee5ca73b32fc059b7fa4ab326 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=14831 --metrics-logging=true --relay=true --filter=true --store=false --discv5-bootstrap-node=enr:-L24QApMuiyVVfXBLVDeybJwe_kp4oV6uTFMalbES_lE4nheO-6MUmGAqPSO_3nqpyRZeKi2_0za8Mh0ofj3TUGJ9iYCgmlkgnY0gmlwhKwS4lmKbXVsdGlhZGRyc5YACASsEuJZBodDAAoErBLiWQaHRN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDMUT3wSaDaS0gzKtlcNwhiecI-Iq1hLBSTt--gL5LI3qDdGNwgodDg3VkcIKHRYV3YWt1MgU
2026-01-29 04:31:49.771 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.154.83 waku 86df9d59f90fc685b9fe2351711717d48cbca53e41824061fc41f6946d8c8c90
2026-01-29 04:31:49.802 DEBUG [src.node.docker_mananger] Container started with ID 86df9d59f90f. Setting up logs at ./log/docker/node4_2026-01-29_04-31-45__a577cbf3-1ed0-4400-b63c-830d24e424cb__wakuorg_nwaku:latest.log
2026-01-29 04:31:49.802 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 14827
2026-01-29 04:31:49.803 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-29 04:31:50.804 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14827/health" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:50.811 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-01-29 04:31:50.812 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-29 04:31:50.812 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14827/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:50.820 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.154.83/tcp/14828/p2p/16Uiu2HAmUCorjZKXqFx1FZRoj51TVKvRkhsUxA71ACE5pyiGHJHA","/ip4/172.18.154.83/tcp/14829/ws/p2p/16Uiu2HAmUCorjZKXqFx1FZRoj51TVKvRkhsUxA71ACE5pyiGHJHA"],"enrUri":"enr:-L24QCXMUlZCz-5T8G3wgCoMuCFE-WTfzWLoutKOMLQeVOKwI0ovIszf3G9W2LDymMzQY-v_IxSq8ifhfY8X_4m-u2cCgmlkgnY0gmlwhKwSmlOKbXVsdGlhZGRyc5YACASsEppTBjnsAAoErBKaUwY57d0DgnJzhQADAQAAiXNlY3AyNTZrMaED5wYGrFKhfK7XI3hOwvAAO9E7QBcC1gGnf73n2nN5lZ2DdGNwgjnsg3VkcII57oV3YWt1MgU"}'
2026-01-29 04:31:50.820 INFO [src.node.waku_node] REST service is ready !!
2026-01-29 04:31:50.820 DEBUG [src.node.waku_node] Starting Node...
2026-01-29 04:31:50.821 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-01-29 04:31:50.823 DEBUG [src.node.docker_mananger] Network waku already exists
2026-01-29 04:31:50.823 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.26.211
2026-01-29 04:31:50.823 DEBUG [src.node.docker_mananger] Generated ports ['11415', '11416', '11417', '11418', '11419']
2026-01-29 04:31:50.824 DEBUG [src.node.waku_node] RLN credentials were not set
2026-01-29 04:31:50.824 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-01-29 04:31:50.824 DEBUG [src.node.waku_node] Using volumes []
2026-01-29 04:31:50.824 DEBUG [src.node.docker_mananger] docker run -i -t -p 11415:11415 -p 11416:11416 -p 11417:11417 -p 11418:11418 -p 11419:11419 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=11417 --rest-port=11415 --tcp-port=11416 --discv5-udp-port=11418 --rest-address=0.0.0.0 --nat=extip:172.18.26.211 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=7614fc79469e3dd879bf152ddf2ed0ab88009f751bfca7c1aafabbf8bf144161 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=11419 --metrics-logging=true --relay=false --filternode=/ip4/172.18.154.83/tcp/14828/p2p/16Uiu2HAmUCorjZKXqFx1FZRoj51TVKvRkhsUxA71ACE5pyiGHJHA --store=false --discv5-bootstrap-node=enr:-L24QApMuiyVVfXBLVDeybJwe_kp4oV6uTFMalbES_lE4nheO-6MUmGAqPSO_3nqpyRZeKi2_0za8Mh0ofj3TUGJ9iYCgmlkgnY0gmlwhKwS4lmKbXVsdGlhZGRyc5YACASsEuJZBodDAAoErBLiWQaHRN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDMUT3wSaDaS0gzKtlcNwhiecI-Iq1hLBSTt--gL5LI3qDdGNwgodDg3VkcIKHRYV3YWt1MgU
2026-01-29 04:31:51.017 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.26.211 waku bd1774c4fd8629955f92e608e730fccef3d55b80270a5d3d393300464ef9d53e
2026-01-29 04:31:51.046 DEBUG [src.node.docker_mananger] Container started with ID bd1774c4fd86. Setting up logs at ./log/docker/node5_2026-01-29_04-31-45__a577cbf3-1ed0-4400-b63c-830d24e424cb__wakuorg_nwaku:latest.log
2026-01-29 04:31:51.047 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 11415
2026-01-29 04:31:51.047 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-01-29 04:31:52.048 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11415/health" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:52.052 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-01-29 04:31:52.052 INFO [src.node.waku_node] Node protocols are initialized !!
2026-01-29 04:31:52.052 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11415/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:52.055 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.26.211/tcp/11416/p2p/16Uiu2HAkygARTrGQYpAZXfUcWGYsudwmjycr8c9UVne3cFFTESRs","/ip4/172.18.26.211/tcp/11417/ws/p2p/16Uiu2HAkygARTrGQYpAZXfUcWGYsudwmjycr8c9UVne3cFFTESRs"],"enrUri":"enr:-L24QOYbPQunW2iaG76bQ8Ikx7EBgTSwcOS2NDhYeTJDLD60ZQoipH_uE1erfvyVourQrJduS7QwM__5I7zAhzAtRpMCgmlkgnY0gmlwhKwSGtOKbXVsdGlhZGRyc5YACASsEhrTBiyYAAoErBIa0wYsmd0DgnJzhQADAQAAiXNlY3AyNTZrMaECPyUKByTMlwuUbPGKw2kQQ2O1-OfLv0xG0rqSlTpZ846DdGNwgiyYg3VkcIIsmoV3YWt1MgA"}'
2026-01-29 04:31:52.055 INFO [src.node.waku_node] REST service is ready !!
2026-01-29 04:31:52.055 DEBUG [tests.e2e.test_e2e] Subscribe nodes to relay pubsub topic /waku/2/rs/3/1
2026-01-29 04:31:52.055 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12847/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-01-29 04:31:52.058 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:31:52.058 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59707/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-01-29 04:31:52.064 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:31:52.066 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34626/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-01-29 04:31:52.074 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:31:52.075 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:14827/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-01-29 04:31:52.081 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:31:52.081 DEBUG [tests.e2e.test_e2e] Node5 makes filter request pubsubtopic /waku/2/rs/3/1 and content topic /test/1/waku-filter/proto
2026-01-29 04:31:52.082 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11415/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-01-29 04:31:52.124 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1","statusDesc":"OK"}'
2026-01-29 04:31:52.125 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12847/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:52.130 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.128.102/tcp/33240/p2p/16Uiu2HAmByzvaLbfmzoioXBXd8wVhcQe4Xpx4hfx7K3GSbH55rsY","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"UnknownOrigin"}]'
2026-01-29 04:31:52.130 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:59707/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:52.133 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.226.89/tcp/53940/p2p/16Uiu2HAmFyKKhmvFm9wthUL9GUCTZGRu9ncU9XsZAQj7rLg72bj7","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"UnknownOrigin"},{"multiaddr":"/ip4/172.18.244.196/tcp/12848/p2p/16Uiu2HAmJqMFw4nRJFXKfAea39bkQ4EgsCBHy1YKd8RdmgCVhtqk","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"Discv5"}]'
2026-01-29 04:31:52.133 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34626/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:52.135 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.128.102/tcp/59708/p2p/16Uiu2HAmByzvaLbfmzoioXBXd8wVhcQe4Xpx4hfx7K3GSbH55rsY","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"Discv5"},{"multiaddr":"/ip4/172.18.154.83/tcp/43840/p2p/16Uiu2HAmUCorjZKXqFx1FZRoj51TVKvRkhsUxA71ACE5pyiGHJHA","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"UnknownOrigin"}]'
2026-01-29 04:31:52.136 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:14827/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:52.138 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.226.89/tcp/34627/p2p/16Uiu2HAmFyKKhmvFm9wthUL9GUCTZGRu9ncU9XsZAQj7rLg72bj7","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"Discv5"},{"multiaddr":"/ip4/172.18.26.211/tcp/58504/p2p/16Uiu2HAkygARTrGQYpAZXfUcWGYsudwmjycr8c9UVne3cFFTESRs","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"UnknownOrigin"}]'
2026-01-29 04:31:52.138 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11415/admin/v1/peers" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:31:52.140 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"multiaddr":"/ip4/172.18.226.89/tcp/34627/p2p/16Uiu2HAmFyKKhmvFm9wthUL9GUCTZGRu9ncU9XsZAQj7rLg72bj7","protocols":["/vac/waku/relay/2.0.0","/vac/waku/filter-subscribe/2.0.0-beta1"],"shards":[0],"connected":"NotConnected","agent":"","origin":"Discv5"},{"multiaddr":"/ip4/172.18.154.83/tcp/14828/p2p/16Uiu2HAmUCorjZKXqFx1FZRoj51TVKvRkhsUxA71ACE5pyiGHJHA","protocols":["/ipfs/id/1.0.0","/libp2p/autonat/1.0.0","/libp2p/circuit/relay/0.2.0/hop","/vac/waku/metadata/1.0.0","/vac/waku/relay/2.0.0","/vac/waku/rendezvous/1.0.0","/ipfs/ping/1.0.0","/vac/waku/filter-subscribe/2.0.0-beta1","/vac/waku/filter-push/2.0.0-beta1","/vac/waku/peer-exchange/2.0.0-alpha1"],"shards":[0,1],"connected":"Connected","agent":"nwaku-v0.36.0-127-ga4e44d","origin":"UnknownOrigin"}]'
2026-01-29 04:31:52.141 DEBUG [src.libs.common] Sleeping for 60 seconds
2026-01-29 04:32:52.141 DEBUG [tests.e2e.test_e2e] 3 Nodes publish 12 message
2026-01-29 04:32:52.142 DEBUG [src.steps.store] Relaying message
2026-01-29 04:32:52.142 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12847/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-01-29 04:32:52.153 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:32:52.154 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-29 04:32:52.355 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-01-29 04:32:54.356 DEBUG [src.steps.store] Relaying message
2026-01-29 04:32:54.357 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12847/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-01-29 04:32:54.368 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:32:54.369 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-29 04:32:54.569 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-01-29 04:32:56.570 DEBUG [src.steps.store] Relaying message
2026-01-29 04:32:56.570 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12847/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-01-29 04:32:56.579 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:32:56.582 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-29 04:32:56.783 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-01-29 04:32:58.784 DEBUG [src.steps.store] Relaying message
2026-01-29 04:32:58.784 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12847/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-01-29 04:32:58.790 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:32:58.790 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-29 04:32:58.991 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-01-29 04:33:00.991 DEBUG [src.steps.store] Relaying message
2026-01-29 04:33:00.992 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59707/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-01-29 04:33:00.999 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:33:00.999 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-29 04:33:01.200 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-01-29 04:33:03.200 DEBUG [src.steps.store] Relaying message
2026-01-29 04:33:03.201 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59707/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-01-29 04:33:03.208 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:33:03.209 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-29 04:33:03.409 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-01-29 04:33:05.410 DEBUG [src.steps.store] Relaying message
2026-01-29 04:33:05.410 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59707/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-01-29 04:33:05.425 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:33:05.425 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-29 04:33:05.626 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-01-29 04:33:07.627 DEBUG [src.steps.store] Relaying message
2026-01-29 04:33:07.627 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:59707/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-01-29 04:33:07.633 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:33:07.634 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-29 04:33:07.835 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-01-29 04:33:09.835 DEBUG [src.steps.store] Relaying message
2026-01-29 04:33:09.835 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34626/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-01-29 04:33:09.844 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:33:09.844 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-29 04:33:10.046 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-01-29 04:33:12.046 DEBUG [src.steps.store] Relaying message
2026-01-29 04:33:12.047 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34626/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-01-29 04:33:12.055 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:33:12.055 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-29 04:33:12.258 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-01-29 04:33:14.259 DEBUG [src.steps.store] Relaying message
2026-01-29 04:33:14.259 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34626/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-01-29 04:33:14.268 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:33:14.271 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-29 04:33:14.473 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-01-29 04:33:16.473 DEBUG [src.steps.store] Relaying message
2026-01-29 04:33:16.474 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34626/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-01-29 04:33:16.483 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-01-29 04:33:16.483 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-01-29 04:33:16.684 DEBUG [src.libs.common] Sleeping for 2 seconds
2026-01-29 04:33:18.684 DEBUG [tests.e2e.test_e2e] Node5 requests messages of subscribed filter topic /waku/2/rs/3/1
2026-01-29 04:33:18.685 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11415/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-01-29 04:33:18.689 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1769661172141916319,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1769661174356470950,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1769661176570287164,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1769661178784317584,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1769661180991611392,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1769661183200807133,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1769661185409917072,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1769661187627355743,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1769661189835503773,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1769661192046595591,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1769661194259100098,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1769661196473598385,"ephemeral":false}]'
2026-01-29 04:33:18.690 DEBUG [tests.e2e.test_e2e] Response for node 5 is [{'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1769661172141916319, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1769661174356470950, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1769661176570287164, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1769661178784317584, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1769661180991611392, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1769661183200807133, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1769661185409917072, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1769661187627355743, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1769661189835503773, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1769661192046595591, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1769661194259100098, 'ephemeral': False}, {'payload': 'RmlsdGVyIHdvcmtzISE=', 'contentTopic': '/test/1/waku-filter/proto', 'version': 0, 'timestamp': 1769661196473598385, 'ephemeral': False}]
2026-01-29 04:33:18.692 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-01-29 04:33:18.693 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-01-29 04:33:18.693 DEBUG [src.node.waku_node] Stopping container with id ff1546982805
2026-01-29 04:33:19.274 DEBUG [src.node.waku_node] Container stopped.
2026-01-29 04:33:19.274 DEBUG [src.node.waku_node] Stopping container with id 9329a8f13f5f
2026-01-29 04:33:19.845 DEBUG [src.node.waku_node] Container stopped.
2026-01-29 04:33:19.845 DEBUG [src.node.waku_node] Stopping container with id 68fab399e8e0
2026-01-29 04:33:20.330 ERROR [src.node.docker_mananger] Max retries reached for container ff1546982805. Exiting log stream.
2026-01-29 04:33:20.426 DEBUG [src.node.waku_node] Container stopped.
2026-01-29 04:33:20.427 DEBUG [src.node.waku_node] Stopping container with id 86df9d59f90f
2026-01-29 04:33:20.659 ERROR [src.node.docker_mananger] Max retries reached for container 9329a8f13f5f. Exiting log stream.
2026-01-29 04:33:20.965 DEBUG [src.node.waku_node] Container stopped.
2026-01-29 04:33:20.965 DEBUG [src.node.waku_node] Stopping container with id bd1774c4fd86
2026-01-29 04:33:21.239 ERROR [src.node.docker_mananger] Max retries reached for container 68fab399e8e0. Exiting log stream.
2026-01-29 04:33:21.499 DEBUG [src.node.waku_node] Container stopped.
2026-01-29 04:33:21.500 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-01-29 04:33:21.646 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-29 04:33:21.715 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-29 04:33:21.787 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-29 04:33:21.871 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-01-29 04:33:21.895 DEBUG [src.node.docker_mananger] No errors found in the waku logs.