177 lines
34 KiB
Plaintext

2025-12-26 04:14:00.162 DEBUG [tests.conftest] Running fixture setup: test_id
2025-12-26 04:14:00.163 DEBUG [tests.conftest] Running test: test_filter_get_message_while_one_peer_is_paused with id: 2025-12-26_04-14-00__a215e2dc-a1b0-4f5d-83c3-313b24a9d3cf
2025-12-26 04:14:00.163 DEBUG [src.steps.common] Running fixture setup: common_setup
2025-12-26 04:14:00.163 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2025-12-26 04:14:00.164 DEBUG [src.steps.filter] Running fixture setup: setup_main_relay_node
2025-12-26 04:14:00.170 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-26 04:14:00.170 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2025-12-26_04-14-00__a215e2dc-a1b0-4f5d-83c3-313b24a9d3cf__wakuorg_nwaku:latest.log
2025-12-26 04:14:00.170 DEBUG [src.node.waku_node] Starting Node...
2025-12-26 04:14:00.170 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-26 04:14:00.172 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-26 04:14:00.172 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.67.110
2025-12-26 04:14:00.172 DEBUG [src.node.docker_mananger] Generated ports ['21702', '21703', '21704', '21705', '21706']
2025-12-26 04:14:00.172 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-26 04:14:00.172 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-26 04:14:00.172 DEBUG [src.node.waku_node] Using volumes []
2025-12-26 04:14:00.172 DEBUG [src.node.docker_mananger] docker run -i -t -p 21702:21702 -p 21703:21703 -p 21704:21704 -p 21705:21705 -p 21706:21706 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=21704 --rest-port=21702 --tcp-port=21703 --discv5-udp-port=21705 --rest-address=0.0.0.0 --nat=extip:172.18.67.110 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=dd1a83cbc03aa43f4a4dacff63c58aeaccfd0d9ef8f0ae5f3cfae0d5cea83e73 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=21706 --metrics-logging=true --relay=true --filter=true
2025-12-26 04:14:00.346 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.67.110 waku 7bbaac26753c8307c337e76382b055ea68f5bbd1e3febacd15119c564e0b39e0
2025-12-26 04:14:00.379 DEBUG [src.node.docker_mananger] Container started with ID 7bbaac26753c. Setting up logs at ./log/docker/node1_2025-12-26_04-14-00__a215e2dc-a1b0-4f5d-83c3-313b24a9d3cf__wakuorg_nwaku:latest.log
2025-12-26 04:14:00.379 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 21702
2025-12-26 04:14:00.379 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-26 04:14:00.423 ERROR [src.node.docker_mananger] Max retries reached for container c9bf0e81a760. Exiting log stream.
2025-12-26 04:14:00.946 ERROR [src.node.docker_mananger] Max retries reached for container ec7c65eb833d. Exiting log stream.
2025-12-26 04:14:01.380 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21702/health" -H "Content-Type: application/json" -d 'None'
2025-12-26 04:14:01.383 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-26 04:14:01.383 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-26 04:14:01.383 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:21702/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-26 04:14:01.386 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.67.110/tcp/21703/p2p/16Uiu2HAmCKTN66uhwkXZcdhiW7FoVkn8Zc7vvs4Ke12we6WpS8Fq","/ip4/172.18.67.110/tcp/21704/ws/p2p/16Uiu2HAmCKTN66uhwkXZcdhiW7FoVkn8Zc7vvs4Ke12we6WpS8Fq"],"enrUri":"enr:-L24QKHJKtMcXu1JIcfv2t56NAjRLrA-by4OzbhbNNQnQ5ZMJ9pszS_n2k9kMZH2KlN2Bf-AyrJn_YEX8t7OJjUJeiICgmlkgnY0gmlwhKwSQ26KbXVsdGlhZGRyc5YACASsEkNuBlTHAAoErBJDbgZUyN0DgnJzhQADAQAAiXNlY3AyNTZrMaEC-v7tqv24NDLorfpp0TWP-9ulSBkYugaFSQjLLkIgQhCDdGNwglTHg3VkcIJUyYV3YWt1MgU"}'
2025-12-26 04:14:01.386 INFO [src.node.waku_node] REST service is ready !!
2025-12-26 04:14:01.386 DEBUG [src.steps.filter] Running fixture setup: setup_main_filter_node
2025-12-26 04:14:01.393 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-26 04:14:01.393 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2025-12-26_04-14-00__a215e2dc-a1b0-4f5d-83c3-313b24a9d3cf__wakuorg_nwaku:latest.log
2025-12-26 04:14:01.393 DEBUG [src.node.waku_node] Starting Node...
2025-12-26 04:14:01.393 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-26 04:14:01.394 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-26 04:14:01.394 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.96.253
2025-12-26 04:14:01.395 DEBUG [src.node.docker_mananger] Generated ports ['9946', '9947', '9948', '9949', '9950']
2025-12-26 04:14:01.395 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-26 04:14:01.395 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-26 04:14:01.395 DEBUG [src.node.waku_node] Using volumes []
2025-12-26 04:14:01.395 DEBUG [src.node.docker_mananger] docker run -i -t -p 9946:9946 -p 9947:9947 -p 9948:9948 -p 9949:9949 -p 9950:9950 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=9948 --rest-port=9946 --tcp-port=9947 --discv5-udp-port=9949 --rest-address=0.0.0.0 --nat=extip:172.18.96.253 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=faff0df2feaaa417d0cfb45fa4c15a04d3c9fc55a67e5dc3b3b9f1f7ca51adde --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=9950 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QKHJKtMcXu1JIcfv2t56NAjRLrA-by4OzbhbNNQnQ5ZMJ9pszS_n2k9kMZH2KlN2Bf-AyrJn_YEX8t7OJjUJeiICgmlkgnY0gmlwhKwSQ26KbXVsdGlhZGRyc5YACASsEkNuBlTHAAoErBJDbgZUyN0DgnJzhQADAQAAiXNlY3AyNTZrMaEC-v7tqv24NDLorfpp0TWP-9ulSBkYugaFSQjLLkIgQhCDdGNwglTHg3VkcIJUyYV3YWt1MgU --filternode=/ip4/172.18.67.110/tcp/21703/p2p/16Uiu2HAmCKTN66uhwkXZcdhiW7FoVkn8Zc7vvs4Ke12we6WpS8Fq
2025-12-26 04:14:01.568 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.96.253 waku 6409156aa1caa1f50c0735cd84587053218a666e54b1837372be135b1976d577
2025-12-26 04:14:01.600 DEBUG [src.node.docker_mananger] Container started with ID 6409156aa1ca. Setting up logs at ./log/docker/node2_2025-12-26_04-14-00__a215e2dc-a1b0-4f5d-83c3-313b24a9d3cf__wakuorg_nwaku:latest.log
2025-12-26 04:14:01.600 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 9946
2025-12-26 04:14:01.601 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-26 04:14:02.601 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9946/health" -H "Content-Type: application/json" -d 'None'
2025-12-26 04:14:02.605 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2025-12-26 04:14:02.605 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-26 04:14:02.606 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9946/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-26 04:14:02.608 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.96.253/tcp/9947/p2p/16Uiu2HAmRDCyDwxSSJKFgtUBdP8PNjcirCMNj1G4SKZhGPJ7JZfk","/ip4/172.18.96.253/tcp/9948/ws/p2p/16Uiu2HAmRDCyDwxSSJKFgtUBdP8PNjcirCMNj1G4SKZhGPJ7JZfk"],"enrUri":"enr:-L24QIiUblL_jWDwz2baunXWBpUCOQV7lSlZFPse4-A_R_eoYv0EP7rHooOXO9is5AG4eTVEOO3Gl5Pj2HQKA8oRTCoCgmlkgnY0gmlwhKwSYP2KbXVsdGlhZGRyc5YACASsEmD9BibbAAoErBJg_QYm3N0DgnJzhQADAQAAiXNlY3AyNTZrMaEDuo0ZFWPR1SQecfwQNe7nPUzFKZpP-tJBBg_RlcjIlu-DdGNwgibbg3VkcIIm3YV3YWt1MgA"}'
2025-12-26 04:14:02.608 INFO [src.node.waku_node] REST service is ready !!
2025-12-26 04:14:02.608 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9946/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.67.110/tcp/21703/p2p/16Uiu2HAmCKTN66uhwkXZcdhiW7FoVkn8Zc7vvs4Ke12we6WpS8Fq"]'
2025-12-26 04:14:02.639 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-26 04:14:02.652 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-26 04:14:02.653 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2025-12-26_04-14-00__a215e2dc-a1b0-4f5d-83c3-313b24a9d3cf__wakuorg_nwaku:latest.log
2025-12-26 04:14:02.653 DEBUG [src.node.waku_node] Starting Node...
2025-12-26 04:14:02.653 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-26 04:14:02.656 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-26 04:14:02.657 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.125.179
2025-12-26 04:14:02.657 DEBUG [src.node.docker_mananger] Generated ports ['15909', '15910', '15911', '15912', '15913']
2025-12-26 04:14:02.658 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-26 04:14:02.659 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-26 04:14:02.659 DEBUG [src.node.waku_node] Using volumes []
2025-12-26 04:14:02.660 DEBUG [src.node.docker_mananger] docker run -i -t -p 15909:15909 -p 15910:15910 -p 15911:15911 -p 15912:15912 -p 15913:15913 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=15911 --rest-port=15909 --tcp-port=15910 --discv5-udp-port=15912 --rest-address=0.0.0.0 --nat=extip:172.18.125.179 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=a048a29ac2b9a8fc17fefc9f1e8d14afcc5f85c505df2653d2ce2d5489a888e8 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=15913 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QKHJKtMcXu1JIcfv2t56NAjRLrA-by4OzbhbNNQnQ5ZMJ9pszS_n2k9kMZH2KlN2Bf-AyrJn_YEX8t7OJjUJeiICgmlkgnY0gmlwhKwSQ26KbXVsdGlhZGRyc5YACASsEkNuBlTHAAoErBJDbgZUyN0DgnJzhQADAQAAiXNlY3AyNTZrMaEC-v7tqv24NDLorfpp0TWP-9ulSBkYugaFSQjLLkIgQhCDdGNwglTHg3VkcIJUyYV3YWt1MgU --filternode=/ip4/172.18.67.110/tcp/21703/p2p/16Uiu2HAmCKTN66uhwkXZcdhiW7FoVkn8Zc7vvs4Ke12we6WpS8Fq
2025-12-26 04:14:02.834 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.125.179 waku 97f9b7f2b1cb8337ab6b88a3ced95aa2dd1f590f0e9123e9a5ea6705100283fa
2025-12-26 04:14:02.861 DEBUG [src.node.docker_mananger] Container started with ID 97f9b7f2b1cb. Setting up logs at ./log/docker/node3_2025-12-26_04-14-00__a215e2dc-a1b0-4f5d-83c3-313b24a9d3cf__wakuorg_nwaku:latest.log
2025-12-26 04:14:02.861 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 15909
2025-12-26 04:14:02.862 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-26 04:14:03.862 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15909/health" -H "Content-Type: application/json" -d 'None'
2025-12-26 04:14:03.866 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2025-12-26 04:14:03.866 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-26 04:14:03.866 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15909/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-26 04:14:03.868 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.125.179/tcp/15910/p2p/16Uiu2HAkzXasA22zB6ZCUMh8ksJps4HzKuo9r7uEk9mAKPGYQZT3","/ip4/172.18.125.179/tcp/15911/ws/p2p/16Uiu2HAkzXasA22zB6ZCUMh8ksJps4HzKuo9r7uEk9mAKPGYQZT3"],"enrUri":"enr:-L24QA47dlSoIBPJjxS3yAb4CTLZUaAWpVKomYwQNePDc8tOSrA44zaT4w_TxZdgKD6LSee7ljk77v-cimxoTTGdfr0CgmlkgnY0gmlwhKwSfbOKbXVsdGlhZGRyc5YACASsEn2zBj4mAAoErBJ9swY-J90DgnJzhQADAQAAiXNlY3AyNTZrMaECS84i9qoblSDI6Z1pVfuPaOz4YJ_IeuE4ha6kQ68wTM6DdGNwgj4mg3VkcII-KIV3YWt1MgA"}'
2025-12-26 04:14:03.869 INFO [src.node.waku_node] REST service is ready !!
2025-12-26 04:14:03.869 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:15909/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.67.110/tcp/21703/p2p/16Uiu2HAmCKTN66uhwkXZcdhiW7FoVkn8Zc7vvs4Ke12we6WpS8Fq"]'
2025-12-26 04:14:03.896 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-26 04:14:03.906 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-26 04:14:03.906 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2025-12-26_04-14-00__a215e2dc-a1b0-4f5d-83c3-313b24a9d3cf__wakuorg_nwaku:latest.log
2025-12-26 04:14:03.907 DEBUG [src.node.waku_node] Starting Node...
2025-12-26 04:14:03.908 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-26 04:14:03.911 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-26 04:14:03.912 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.204.161
2025-12-26 04:14:03.912 DEBUG [src.node.docker_mananger] Generated ports ['49119', '49120', '49121', '49122', '49123']
2025-12-26 04:14:03.912 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-26 04:14:03.912 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-26 04:14:03.912 DEBUG [src.node.waku_node] Using volumes []
2025-12-26 04:14:03.913 DEBUG [src.node.docker_mananger] docker run -i -t -p 49119:49119 -p 49120:49120 -p 49121:49121 -p 49122:49122 -p 49123:49123 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=49121 --rest-port=49119 --tcp-port=49120 --discv5-udp-port=49122 --rest-address=0.0.0.0 --nat=extip:172.18.204.161 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=7080cf1567facab8cbcd21084dbd5aaa8b9b88cb8cdfb22adccffed91dc78d4e --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=49123 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QKHJKtMcXu1JIcfv2t56NAjRLrA-by4OzbhbNNQnQ5ZMJ9pszS_n2k9kMZH2KlN2Bf-AyrJn_YEX8t7OJjUJeiICgmlkgnY0gmlwhKwSQ26KbXVsdGlhZGRyc5YACASsEkNuBlTHAAoErBJDbgZUyN0DgnJzhQADAQAAiXNlY3AyNTZrMaEC-v7tqv24NDLorfpp0TWP-9ulSBkYugaFSQjLLkIgQhCDdGNwglTHg3VkcIJUyYV3YWt1MgU --filternode=/ip4/172.18.67.110/tcp/21703/p2p/16Uiu2HAmCKTN66uhwkXZcdhiW7FoVkn8Zc7vvs4Ke12we6WpS8Fq
2025-12-26 04:14:04.092 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.204.161 waku eb24f14bd4ae39eb2a7903cb45a3b2dd16cfc0b9871380da8a4d19ab2b684304
2025-12-26 04:14:04.123 DEBUG [src.node.docker_mananger] Container started with ID eb24f14bd4ae. Setting up logs at ./log/docker/node4_2025-12-26_04-14-00__a215e2dc-a1b0-4f5d-83c3-313b24a9d3cf__wakuorg_nwaku:latest.log
2025-12-26 04:14:04.124 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 49119
2025-12-26 04:14:04.125 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-26 04:14:05.125 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49119/health" -H "Content-Type: application/json" -d 'None'
2025-12-26 04:14:05.129 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2025-12-26 04:14:05.129 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-26 04:14:05.130 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49119/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-26 04:14:05.132 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.204.161/tcp/49120/p2p/16Uiu2HAmKHF3FbVMAQjJtsAQXSuPSi7yM6mhH1YtttMkXKkzof8q","/ip4/172.18.204.161/tcp/49121/ws/p2p/16Uiu2HAmKHF3FbVMAQjJtsAQXSuPSi7yM6mhH1YtttMkXKkzof8q"],"enrUri":"enr:-L24QKuIAgSc3PgqofFHAEjlOrHcNAkQQMYLz0Kej6uC94zMU9ui4VeOeri87nbCLIysgoIfWffBsRBs11HnMNIK4_ICgmlkgnY0gmlwhKwSzKGKbXVsdGlhZGRyc5YACASsEsyhBr_gAAoErBLMoQa_4d0DgnJzhQADAQAAiXNlY3AyNTZrMaEDYm-jvOfCrdsy-uaz7E0qK-vmn_NgnCJh14AkHHt95T6DdGNwgr_gg3VkcIK_4oV3YWt1MgA"}'
2025-12-26 04:14:05.132 INFO [src.node.waku_node] REST service is ready !!
2025-12-26 04:14:05.132 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:49119/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.67.110/tcp/21703/p2p/16Uiu2HAmCKTN66uhwkXZcdhiW7FoVkn8Zc7vvs4Ke12we6WpS8Fq"]'
2025-12-26 04:14:05.164 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-26 04:14:05.175 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-26 04:14:05.176 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2025-12-26_04-14-00__a215e2dc-a1b0-4f5d-83c3-313b24a9d3cf__wakuorg_nwaku:latest.log
2025-12-26 04:14:05.176 DEBUG [src.node.waku_node] Starting Node...
2025-12-26 04:14:05.176 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-26 04:14:05.179 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-26 04:14:05.179 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.85.132
2025-12-26 04:14:05.179 DEBUG [src.node.docker_mananger] Generated ports ['22319', '22320', '22321', '22322', '22323']
2025-12-26 04:14:05.179 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-26 04:14:05.179 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-26 04:14:05.179 DEBUG [src.node.waku_node] Using volumes []
2025-12-26 04:14:05.180 DEBUG [src.node.docker_mananger] docker run -i -t -p 22319:22319 -p 22320:22320 -p 22321:22321 -p 22322:22322 -p 22323:22323 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=22321 --rest-port=22319 --tcp-port=22320 --discv5-udp-port=22322 --rest-address=0.0.0.0 --nat=extip:172.18.85.132 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=ffa6dc25b4be6f7bd8e7dac5f2ee2f5becdacb6d7afbafca2e4e0caaea56b6e6 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=22323 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QKHJKtMcXu1JIcfv2t56NAjRLrA-by4OzbhbNNQnQ5ZMJ9pszS_n2k9kMZH2KlN2Bf-AyrJn_YEX8t7OJjUJeiICgmlkgnY0gmlwhKwSQ26KbXVsdGlhZGRyc5YACASsEkNuBlTHAAoErBJDbgZUyN0DgnJzhQADAQAAiXNlY3AyNTZrMaEC-v7tqv24NDLorfpp0TWP-9ulSBkYugaFSQjLLkIgQhCDdGNwglTHg3VkcIJUyYV3YWt1MgU --filternode=/ip4/172.18.67.110/tcp/21703/p2p/16Uiu2HAmCKTN66uhwkXZcdhiW7FoVkn8Zc7vvs4Ke12we6WpS8Fq
2025-12-26 04:14:05.374 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.85.132 waku 567cad3884e245d9e71d35e3508a2bb5c0f253bb218cc14248aa6dfb40992194
2025-12-26 04:14:05.405 DEBUG [src.node.docker_mananger] Container started with ID 567cad3884e2. Setting up logs at ./log/docker/node5_2025-12-26_04-14-00__a215e2dc-a1b0-4f5d-83c3-313b24a9d3cf__wakuorg_nwaku:latest.log
2025-12-26 04:14:05.406 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 22319
2025-12-26 04:14:05.406 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-26 04:14:06.406 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22319/health" -H "Content-Type: application/json" -d 'None'
2025-12-26 04:14:06.410 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2025-12-26 04:14:06.410 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-26 04:14:06.410 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22319/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-26 04:14:06.413 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.85.132/tcp/22320/p2p/16Uiu2HAkwHqSuYgnYtHop4WUgtjcBF67RV4H7FK3ky6ybhkZuwZQ","/ip4/172.18.85.132/tcp/22321/ws/p2p/16Uiu2HAkwHqSuYgnYtHop4WUgtjcBF67RV4H7FK3ky6ybhkZuwZQ"],"enrUri":"enr:-L24QBk2hF-jLNN8YDwlrMK33lDPsE0_XgcCuwYISwS1ksNpRCecnRyXHOPssA205cScskZO_lJZYP5bAi777Zm6pzoCgmlkgnY0gmlwhKwSVYSKbXVsdGlhZGRyc5YACASsElWEBlcwAAoErBJVhAZXMd0DgnJzhQADAQAAiXNlY3AyNTZrMaECG7VuqhU_UPmcZaRnnap5ferrERniWHqz0Jy8HCXe8e-DdGNwglcwg3VkcIJXMoV3YWt1MgA"}'
2025-12-26 04:14:06.413 INFO [src.node.waku_node] REST service is ready !!
2025-12-26 04:14:06.413 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22319/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.67.110/tcp/21703/p2p/16Uiu2HAmCKTN66uhwkXZcdhiW7FoVkn8Zc7vvs4Ke12we6WpS8Fq"]'
2025-12-26 04:14:06.441 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-26 04:14:06.442 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21702/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2025-12-26 04:14:06.454 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-26 04:14:06.455 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:9946/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "a6010b94-4c55-4205-8dba-401ade459ad9", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2025-12-26 04:14:06.464 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"a6010b94-4c55-4205-8dba-401ade459ad9","statusDesc":"OK"}'
2025-12-26 04:14:06.465 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:15909/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "29331ec3-5d23-43a1-8875-5dd656ca6765", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2025-12-26 04:14:06.473 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"29331ec3-5d23-43a1-8875-5dd656ca6765","statusDesc":"OK"}'
2025-12-26 04:14:06.473 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:49119/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1dbb9068-ebbe-488a-81d2-207d9293d6bb", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2025-12-26 04:14:06.483 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1dbb9068-ebbe-488a-81d2-207d9293d6bb","statusDesc":"OK"}'
2025-12-26 04:14:06.484 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:22319/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "0b63864b-6b41-4ea0-950d-f6156133ded2", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2025-12-26 04:14:06.492 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"0b63864b-6b41-4ea0-950d-f6156133ded2","statusDesc":"OK"}'
2025-12-26 04:14:06.493 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21702/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2025-12-26 04:14:06.510 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-26 04:14:06.510 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2025-12-26 04:14:06.611 DEBUG [src.steps.filter] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2025-12-26 04:14:06.611 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9946/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2025-12-26 04:14:06.613 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1766722446493360700,"ephemeral":false}]'
2025-12-26 04:14:06.615 DEBUG [src.steps.filter] Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
2025-12-26 04:14:06.615 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15909/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2025-12-26 04:14:06.617 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1766722446493360700,"ephemeral":false}]'
2025-12-26 04:14:06.619 DEBUG [src.steps.filter] Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message
2025-12-26 04:14:06.619 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49119/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2025-12-26 04:14:06.622 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1766722446493360700,"ephemeral":false}]'
2025-12-26 04:14:06.623 DEBUG [src.steps.filter] Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message
2025-12-26 04:14:06.623 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:22319/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2025-12-26 04:14:06.625 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1766722446493360700,"ephemeral":false}]'
2025-12-26 04:14:06.627 DEBUG [src.node.waku_node] Pausing container with id 6409156aa1ca
2025-12-26 04:14:06.636 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21702/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2025-12-26 04:14:06.642 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-26 04:14:06.642 DEBUG [src.node.waku_node] Unpause container with id 6409156aa1ca
2025-12-26 04:14:06.652 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:21702/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2025-12-26 04:14:06.657 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-26 04:14:06.658 DEBUG [src.libs.common] Sleeping for 0.5 seconds
2025-12-26 04:14:07.159 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:9946/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2025-12-26 04:14:07.162 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1766722446627407679,"ephemeral":false},{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1766722446627496635,"ephemeral":false}]'
2025-12-26 04:14:07.163 DEBUG [tests.conftest] Running fixture teardown: test_setup
2025-12-26 04:14:07.164 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2025-12-26 04:14:07.164 DEBUG [src.node.waku_node] Stopping container with id 7bbaac26753c
2025-12-26 04:14:07.701 DEBUG [src.node.waku_node] Container stopped.
2025-12-26 04:14:07.701 DEBUG [src.node.waku_node] Stopping container with id 6409156aa1ca
2025-12-26 04:14:08.232 DEBUG [src.node.waku_node] Container stopped.
2025-12-26 04:14:08.232 DEBUG [src.node.waku_node] Stopping container with id 97f9b7f2b1cb
2025-12-26 04:14:08.514 ERROR [src.node.docker_mananger] Max retries reached for container 7bbaac26753c. Exiting log stream.
2025-12-26 04:14:08.775 DEBUG [src.node.waku_node] Container stopped.
2025-12-26 04:14:08.777 DEBUG [src.node.waku_node] Stopping container with id eb24f14bd4ae
2025-12-26 04:14:09.066 ERROR [src.node.docker_mananger] Max retries reached for container 6409156aa1ca. Exiting log stream.
2025-12-26 04:14:09.291 DEBUG [src.node.waku_node] Container stopped.
2025-12-26 04:14:09.293 DEBUG [src.node.waku_node] Stopping container with id 567cad3884e2
2025-12-26 04:14:09.607 ERROR [src.node.docker_mananger] Max retries reached for container 97f9b7f2b1cb. Exiting log stream.
2025-12-26 04:14:09.803 DEBUG [src.node.waku_node] Container stopped.
2025-12-26 04:14:09.805 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2025-12-26 04:14:09.819 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-26 04:14:09.829 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-26 04:14:09.839 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-26 04:14:09.848 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-26 04:14:09.854 DEBUG [src.node.docker_mananger] No errors found in the waku logs.