168 lines
32 KiB
Plaintext

2026-02-01 04:44:11.017 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-01 04:44:11.017 DEBUG [tests.conftest] Running test: test_all_nodes_subscribed_to_the_topic with id: 2026-02-01_04-44-11__c8a7aa06-66d9-45af-b130-3cce43ca3930
2026-02-01 04:44:11.017 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-01 04:44:11.018 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-02-01 04:44:11.018 DEBUG [src.steps.filter] Running fixture setup: setup_main_relay_node
2026-02-01 04:44:11.024 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-01 04:44:11.025 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-01_04-44-11__c8a7aa06-66d9-45af-b130-3cce43ca3930__wakuorg_nwaku:latest.log
2026-02-01 04:44:11.025 DEBUG [src.node.waku_node] Starting Node...
2026-02-01 04:44:11.025 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-01 04:44:11.026 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-01 04:44:11.026 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.69.118
2026-02-01 04:44:11.027 DEBUG [src.node.docker_mananger] Generated ports ['39475', '39476', '39477', '39478', '39479']
2026-02-01 04:44:11.027 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-01 04:44:11.027 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-01 04:44:11.027 DEBUG [src.node.waku_node] Using volumes []
2026-02-01 04:44:11.027 DEBUG [src.node.docker_mananger] docker run -i -t -p 39475:39475 -p 39476:39476 -p 39477:39477 -p 39478:39478 -p 39479:39479 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=39477 --rest-port=39475 --tcp-port=39476 --discv5-udp-port=39478 --rest-address=0.0.0.0 --nat=extip:172.18.69.118 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=80040e7dbab6b2a3ed1fac8bfe67efe9eaf1ec73bdde4a8e9caa8d7b6b2ddda5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=39479 --metrics-logging=true --relay=true --filter=true
2026-02-01 04:44:11.225 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.69.118 waku 29a51a9c123944dcce1e30db88f50c41a7c0563a4666de214163741ac0852371
2026-02-01 04:44:11.260 DEBUG [src.node.docker_mananger] Container started with ID 29a51a9c1239. Setting up logs at ./log/docker/node1_2026-02-01_04-44-11__c8a7aa06-66d9-45af-b130-3cce43ca3930__wakuorg_nwaku:latest.log
2026-02-01 04:44:11.260 ERROR [src.node.docker_mananger] Max retries reached for container 3c60425b7979. Exiting log stream.
2026-02-01 04:44:11.262 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 39475
2026-02-01 04:44:11.262 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-01 04:44:11.808 ERROR [src.node.docker_mananger] Max retries reached for container 3d6dd9b731a6. Exiting log stream.
2026-02-01 04:44:12.262 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39475/health" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:44:12.266 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-02-01 04:44:12.266 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-01 04:44:12.266 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:39475/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:44:12.268 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.69.118/tcp/39476/p2p/16Uiu2HAm1mNZRQYF99WUM7pS8mBorgP4rjiPixfYD141XYQvL5pT","/ip4/172.18.69.118/tcp/39477/ws/p2p/16Uiu2HAm1mNZRQYF99WUM7pS8mBorgP4rjiPixfYD141XYQvL5pT"],"enrUri":"enr:-L24QCpxd7qZsntS99mC0f3X77kc-iBboDq2Hsx2bg8Uf_loIoqnYy-x2M_MpcS85qIBuR32ZIk6J8BzL_45j4_RuOQCgmlkgnY0gmlwhKwSRXaKbXVsdGlhZGRyc5YACASsEkV2Bpo0AAoErBJFdgaaNd0DgnJzhQADAQAAiXNlY3AyNTZrMaECXjIKaBRpFFUKNhq984mLnLVipVfofMfMS967Zm3TULiDdGNwgpo0g3VkcIKaNoV3YWt1MgU"}'
2026-02-01 04:44:12.268 INFO [src.node.waku_node] REST service is ready !!
2026-02-01 04:44:12.269 DEBUG [src.steps.filter] Running fixture setup: setup_main_filter_node
2026-02-01 04:44:12.275 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-01 04:44:12.275 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-01_04-44-11__c8a7aa06-66d9-45af-b130-3cce43ca3930__wakuorg_nwaku:latest.log
2026-02-01 04:44:12.275 DEBUG [src.node.waku_node] Starting Node...
2026-02-01 04:44:12.276 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-01 04:44:12.277 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-01 04:44:12.277 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.195.143
2026-02-01 04:44:12.277 DEBUG [src.node.docker_mananger] Generated ports ['55252', '55253', '55254', '55255', '55256']
2026-02-01 04:44:12.277 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-01 04:44:12.277 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-01 04:44:12.277 DEBUG [src.node.waku_node] Using volumes []
2026-02-01 04:44:12.278 DEBUG [src.node.docker_mananger] docker run -i -t -p 55252:55252 -p 55253:55253 -p 55254:55254 -p 55255:55255 -p 55256:55256 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=55254 --rest-port=55252 --tcp-port=55253 --discv5-udp-port=55255 --rest-address=0.0.0.0 --nat=extip:172.18.195.143 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=00dd7fcc4aca44ebc68aa86adb579bd3543c8a846caecbc8aee86fc735f839f2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=55256 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QCpxd7qZsntS99mC0f3X77kc-iBboDq2Hsx2bg8Uf_loIoqnYy-x2M_MpcS85qIBuR32ZIk6J8BzL_45j4_RuOQCgmlkgnY0gmlwhKwSRXaKbXVsdGlhZGRyc5YACASsEkV2Bpo0AAoErBJFdgaaNd0DgnJzhQADAQAAiXNlY3AyNTZrMaECXjIKaBRpFFUKNhq984mLnLVipVfofMfMS967Zm3TULiDdGNwgpo0g3VkcIKaNoV3YWt1MgU --filternode=/ip4/172.18.69.118/tcp/39476/p2p/16Uiu2HAm1mNZRQYF99WUM7pS8mBorgP4rjiPixfYD141XYQvL5pT
2026-02-01 04:44:12.462 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.195.143 waku c6f70ca379b4010303c68490abee283b92794537439ac46a7f497c3f8487e91e
2026-02-01 04:44:12.495 DEBUG [src.node.docker_mananger] Container started with ID c6f70ca379b4. Setting up logs at ./log/docker/node2_2026-02-01_04-44-11__c8a7aa06-66d9-45af-b130-3cce43ca3930__wakuorg_nwaku:latest.log
2026-02-01 04:44:12.496 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 55252
2026-02-01 04:44:12.496 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-01 04:44:13.496 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55252/health" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:44:13.500 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-02-01 04:44:13.501 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-01 04:44:13.501 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55252/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:44:13.503 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.195.143/tcp/55253/p2p/16Uiu2HAkvZNvWmPMLUm6oWfSsrDYYk3sk5KRGEpz76JjSDJDMuSx","/ip4/172.18.195.143/tcp/55254/ws/p2p/16Uiu2HAkvZNvWmPMLUm6oWfSsrDYYk3sk5KRGEpz76JjSDJDMuSx"],"enrUri":"enr:-L24QFHEwmtzes8arvQi2EepgnUX8ZU6V2kXSMqyZbC-nS4KQDvsg7nBf0aoDNzWqXx43bPnSzZauBM3Z-L8v4KXUnACgmlkgnY0gmlwhKwSw4-KbXVsdGlhZGRyc5YACASsEsOPBtfVAAoErBLDjwbX1t0DgnJzhQADAQAAiXNlY3AyNTZrMaECENUMKTnQIWD2XJ-hAesSKV2fRvJPN0pztv-ghLtcsjGDdGNwgtfVg3VkcILX14V3YWt1MgA"}'
2026-02-01 04:44:13.504 INFO [src.node.waku_node] REST service is ready !!
2026-02-01 04:44:13.504 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55252/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.69.118/tcp/39476/p2p/16Uiu2HAm1mNZRQYF99WUM7pS8mBorgP4rjiPixfYD141XYQvL5pT"]'
2026-02-01 04:44:13.537 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:44:13.548 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-01 04:44:13.548 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-01_04-44-11__c8a7aa06-66d9-45af-b130-3cce43ca3930__wakuorg_nwaku:latest.log
2026-02-01 04:44:13.548 DEBUG [src.node.waku_node] Starting Node...
2026-02-01 04:44:13.549 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-01 04:44:13.554 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-01 04:44:13.555 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.199.63
2026-02-01 04:44:13.555 DEBUG [src.node.docker_mananger] Generated ports ['57611', '57612', '57613', '57614', '57615']
2026-02-01 04:44:13.556 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-01 04:44:13.556 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-01 04:44:13.556 DEBUG [src.node.waku_node] Using volumes []
2026-02-01 04:44:13.557 DEBUG [src.node.docker_mananger] docker run -i -t -p 57611:57611 -p 57612:57612 -p 57613:57613 -p 57614:57614 -p 57615:57615 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=57613 --rest-port=57611 --tcp-port=57612 --discv5-udp-port=57614 --rest-address=0.0.0.0 --nat=extip:172.18.199.63 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=6cba25c216e8da680aeca82bf204b443f1a0daa3ffee28cba8eedea54ddee78b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=57615 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QCpxd7qZsntS99mC0f3X77kc-iBboDq2Hsx2bg8Uf_loIoqnYy-x2M_MpcS85qIBuR32ZIk6J8BzL_45j4_RuOQCgmlkgnY0gmlwhKwSRXaKbXVsdGlhZGRyc5YACASsEkV2Bpo0AAoErBJFdgaaNd0DgnJzhQADAQAAiXNlY3AyNTZrMaECXjIKaBRpFFUKNhq984mLnLVipVfofMfMS967Zm3TULiDdGNwgpo0g3VkcIKaNoV3YWt1MgU --filternode=/ip4/172.18.69.118/tcp/39476/p2p/16Uiu2HAm1mNZRQYF99WUM7pS8mBorgP4rjiPixfYD141XYQvL5pT
2026-02-01 04:44:13.744 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.199.63 waku 5b6c20019b3d73b846d7ac40803dd2ec64606af04092f76a640d2497afb3fc1e
2026-02-01 04:44:13.775 DEBUG [src.node.docker_mananger] Container started with ID 5b6c20019b3d. Setting up logs at ./log/docker/node3_2026-02-01_04-44-11__c8a7aa06-66d9-45af-b130-3cce43ca3930__wakuorg_nwaku:latest.log
2026-02-01 04:44:13.776 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 57611
2026-02-01 04:44:13.777 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-01 04:44:14.777 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57611/health" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:44:14.781 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-02-01 04:44:14.781 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-01 04:44:14.782 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57611/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:44:14.784 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.199.63/tcp/57612/p2p/16Uiu2HAm2weZL2zGHMAsCNcqEx6dZJEstLHmzZZpKpmHed4kF8Bz","/ip4/172.18.199.63/tcp/57613/ws/p2p/16Uiu2HAm2weZL2zGHMAsCNcqEx6dZJEstLHmzZZpKpmHed4kF8Bz"],"enrUri":"enr:-L24QHzUmHV9z5m3m_qb9CCZUMb8yw3fC41Mp2sZkshBJJMjLde-uSATRCFucYnJfU2w0Q8mGwE-LujIqyDcyik9hv8CgmlkgnY0gmlwhKwSxz-KbXVsdGlhZGRyc5YACASsEsc_BuEMAAoErBLHPwbhDd0DgnJzhQADAQAAiXNlY3AyNTZrMaECb6-gB9v0MZ7hdD6Q2jA_f8wB4J4W5G0w4MB6hlx0KLmDdGNwguEMg3VkcILhDoV3YWt1MgA"}'
2026-02-01 04:44:14.784 INFO [src.node.waku_node] REST service is ready !!
2026-02-01 04:44:14.784 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57611/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.69.118/tcp/39476/p2p/16Uiu2HAm1mNZRQYF99WUM7pS8mBorgP4rjiPixfYD141XYQvL5pT"]'
2026-02-01 04:44:14.818 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:44:14.828 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-01 04:44:14.828 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node4_2026-02-01_04-44-11__c8a7aa06-66d9-45af-b130-3cce43ca3930__wakuorg_nwaku:latest.log
2026-02-01 04:44:14.828 DEBUG [src.node.waku_node] Starting Node...
2026-02-01 04:44:14.829 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-01 04:44:14.832 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-01 04:44:14.832 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.83.38
2026-02-01 04:44:14.833 DEBUG [src.node.docker_mananger] Generated ports ['44331', '44332', '44333', '44334', '44335']
2026-02-01 04:44:14.833 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-01 04:44:14.833 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-01 04:44:14.833 DEBUG [src.node.waku_node] Using volumes []
2026-02-01 04:44:14.833 DEBUG [src.node.docker_mananger] docker run -i -t -p 44331:44331 -p 44332:44332 -p 44333:44333 -p 44334:44334 -p 44335:44335 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=44333 --rest-port=44331 --tcp-port=44332 --discv5-udp-port=44334 --rest-address=0.0.0.0 --nat=extip:172.18.83.38 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=5fda85dd89ac2cf4edbf9764dd9dbb9acc69cfecdaa14f7c30cdf4eb3eb7cb6a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=44335 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QCpxd7qZsntS99mC0f3X77kc-iBboDq2Hsx2bg8Uf_loIoqnYy-x2M_MpcS85qIBuR32ZIk6J8BzL_45j4_RuOQCgmlkgnY0gmlwhKwSRXaKbXVsdGlhZGRyc5YACASsEkV2Bpo0AAoErBJFdgaaNd0DgnJzhQADAQAAiXNlY3AyNTZrMaECXjIKaBRpFFUKNhq984mLnLVipVfofMfMS967Zm3TULiDdGNwgpo0g3VkcIKaNoV3YWt1MgU --filternode=/ip4/172.18.69.118/tcp/39476/p2p/16Uiu2HAm1mNZRQYF99WUM7pS8mBorgP4rjiPixfYD141XYQvL5pT
2026-02-01 04:44:15.037 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.83.38 waku 2dfdfab7c5a410d6b91b050ed63fff2e3bec77ecca62f332cd85d709ed86884b
2026-02-01 04:44:15.069 DEBUG [src.node.docker_mananger] Container started with ID 2dfdfab7c5a4. Setting up logs at ./log/docker/node4_2026-02-01_04-44-11__c8a7aa06-66d9-45af-b130-3cce43ca3930__wakuorg_nwaku:latest.log
2026-02-01 04:44:15.069 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 44331
2026-02-01 04:44:15.069 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-01 04:44:16.070 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44331/health" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:44:16.074 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-02-01 04:44:16.074 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-01 04:44:16.074 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44331/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:44:16.076 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.83.38/tcp/44332/p2p/16Uiu2HAmEi2s33rxhmibTiTFCpX2vgyJec1RpSEkxYrmF5WZ9QBV","/ip4/172.18.83.38/tcp/44333/ws/p2p/16Uiu2HAmEi2s33rxhmibTiTFCpX2vgyJec1RpSEkxYrmF5WZ9QBV"],"enrUri":"enr:-L24QI2sd08AYf_Jj_HaityblP-yBnnJXsWpIkYj5lwJvkQDZ784A3cptFo0vVQcce4qZmkIKybtyzU9YIjfmvSjWnACgmlkgnY0gmlwhKwSUyaKbXVsdGlhZGRyc5YACASsElMmBq0sAAoErBJTJgatLd0DgnJzhQADAQAAiXNlY3AyNTZrMaEDHn71JHO-1eUknm1OyX5DshOzj7DHMGqOcXcaZFNtrPyDdGNwgq0sg3VkcIKtLoV3YWt1MgA"}'
2026-02-01 04:44:16.077 INFO [src.node.waku_node] REST service is ready !!
2026-02-01 04:44:16.077 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44331/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.69.118/tcp/39476/p2p/16Uiu2HAm1mNZRQYF99WUM7pS8mBorgP4rjiPixfYD141XYQvL5pT"]'
2026-02-01 04:44:16.108 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:44:16.119 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-01 04:44:16.120 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node5_2026-02-01_04-44-11__c8a7aa06-66d9-45af-b130-3cce43ca3930__wakuorg_nwaku:latest.log
2026-02-01 04:44:16.120 DEBUG [src.node.waku_node] Starting Node...
2026-02-01 04:44:16.120 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-01 04:44:16.121 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-01 04:44:16.121 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.25.16
2026-02-01 04:44:16.122 DEBUG [src.node.docker_mananger] Generated ports ['61188', '61189', '61190', '61191', '61192']
2026-02-01 04:44:16.122 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-01 04:44:16.122 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-01 04:44:16.122 DEBUG [src.node.waku_node] Using volumes []
2026-02-01 04:44:16.122 DEBUG [src.node.docker_mananger] docker run -i -t -p 61188:61188 -p 61189:61189 -p 61190:61190 -p 61191:61191 -p 61192:61192 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=61190 --rest-port=61188 --tcp-port=61189 --discv5-udp-port=61191 --rest-address=0.0.0.0 --nat=extip:172.18.25.16 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8dfedef02f0ab9da6a6be33c677bf6b6bbad7e4b9aa8ba4bfccf2dbaac0a165a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=61192 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QCpxd7qZsntS99mC0f3X77kc-iBboDq2Hsx2bg8Uf_loIoqnYy-x2M_MpcS85qIBuR32ZIk6J8BzL_45j4_RuOQCgmlkgnY0gmlwhKwSRXaKbXVsdGlhZGRyc5YACASsEkV2Bpo0AAoErBJFdgaaNd0DgnJzhQADAQAAiXNlY3AyNTZrMaECXjIKaBRpFFUKNhq984mLnLVipVfofMfMS967Zm3TULiDdGNwgpo0g3VkcIKaNoV3YWt1MgU --filternode=/ip4/172.18.69.118/tcp/39476/p2p/16Uiu2HAm1mNZRQYF99WUM7pS8mBorgP4rjiPixfYD141XYQvL5pT
2026-02-01 04:44:16.324 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.25.16 waku 2cbfd51ae7c1f7b9c4a6bbff1b6dae28db973d5d3bcd2039c1882072b01f231f
2026-02-01 04:44:16.360 DEBUG [src.node.docker_mananger] Container started with ID 2cbfd51ae7c1. Setting up logs at ./log/docker/node5_2026-02-01_04-44-11__c8a7aa06-66d9-45af-b130-3cce43ca3930__wakuorg_nwaku:latest.log
2026-02-01 04:44:16.361 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 61188
2026-02-01 04:44:16.361 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-01 04:44:17.361 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61188/health" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:44:17.365 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"}]}'
2026-02-01 04:44:17.365 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-01 04:44:17.366 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61188/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:44:17.368 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.25.16/tcp/61189/p2p/16Uiu2HAmBa6fFFHiyyRnMUwuH6rb2tEbCvyaNgv6oiMtYBdD7qzU","/ip4/172.18.25.16/tcp/61190/ws/p2p/16Uiu2HAmBa6fFFHiyyRnMUwuH6rb2tEbCvyaNgv6oiMtYBdD7qzU"],"enrUri":"enr:-L24QOYFRXlYRgAwsY0UEu6L8Q7RZaXEI-6eAEFwTBdmwV9nJNdsYIVMgUEVK8B0BcrC2bCEs-zQRYVjY8r7IYaf0AsCgmlkgnY0gmlwhKwSGRCKbXVsdGlhZGRyc5YACASsEhkQBu8FAAoErBIZEAbvBt0DgnJzhQADAQAAiXNlY3AyNTZrMaEC7-OLFnFMSNYwgLJhYzTpJfQysEYDfoDHxk1FSfKW6vWDdGNwgu8Fg3VkcILvB4V3YWt1MgA"}'
2026-02-01 04:44:17.368 INFO [src.node.waku_node] REST service is ready !!
2026-02-01 04:44:17.368 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61188/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.69.118/tcp/39476/p2p/16Uiu2HAm1mNZRQYF99WUM7pS8mBorgP4rjiPixfYD141XYQvL5pT"]'
2026-02-01 04:44:17.397 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:44:17.398 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39475/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-02-01 04:44:17.405 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:44:17.406 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:55252/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "23d52fb5-3a0b-4b02-85ed-025d19e633d3", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-01 04:44:17.417 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"23d52fb5-3a0b-4b02-85ed-025d19e633d3","statusDesc":"OK"}'
2026-02-01 04:44:17.419 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:57611/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "ec35d83d-cac5-4ea6-8a50-abddf8328b0f", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-01 04:44:17.432 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"ec35d83d-cac5-4ea6-8a50-abddf8328b0f","statusDesc":"OK"}'
2026-02-01 04:44:17.433 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:44331/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "09aa5950-4e4a-43a2-9f70-181433199e88", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-01 04:44:17.442 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"09aa5950-4e4a-43a2-9f70-181433199e88","statusDesc":"OK"}'
2026-02-01 04:44:17.442 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:61188/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "fe4c52b0-eaff-4bd2-a1d1-81079fe731fb", "contentFilters": ["/test/1/waku-filter/proto"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-02-01 04:44:17.451 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"fe4c52b0-eaff-4bd2-a1d1-81079fe731fb","statusDesc":"OK"}'
2026-02-01 04:44:17.451 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:39475/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/test/1/waku-filter/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:44:17.469 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:44:17.470 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-02-01 04:44:17.570 DEBUG [src.steps.filter] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-02-01 04:44:17.571 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:55252/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:44:17.573 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1769921057451852546,"ephemeral":false}]'
2026-02-01 04:44:17.575 DEBUG [src.steps.filter] Checking that peer NODE_3:wakuorg/nwaku:latest can find the published message
2026-02-01 04:44:17.575 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:57611/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:44:17.577 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1769921057451852546,"ephemeral":false}]'
2026-02-01 04:44:17.579 DEBUG [src.steps.filter] Checking that peer NODE_4:wakuorg/nwaku:latest can find the published message
2026-02-01 04:44:17.579 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:44331/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:44:17.581 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1769921057451852546,"ephemeral":false}]'
2026-02-01 04:44:17.583 DEBUG [src.steps.filter] Checking that peer NODE_5:wakuorg/nwaku:latest can find the published message
2026-02-01 04:44:17.583 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:61188/filter/v2/messages/%2Ftest%2F1%2Fwaku-filter%2Fproto" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:44:17.585 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/test/1/waku-filter/proto","version":0,"timestamp":1769921057451852546,"ephemeral":false}]'
2026-02-01 04:44:17.588 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-01 04:44:17.589 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-01 04:44:17.589 DEBUG [src.node.waku_node] Stopping container with id 29a51a9c1239
2026-02-01 04:44:18.160 DEBUG [src.node.waku_node] Container stopped.
2026-02-01 04:44:18.160 DEBUG [src.node.waku_node] Stopping container with id c6f70ca379b4
2026-02-01 04:44:18.707 DEBUG [src.node.waku_node] Container stopped.
2026-02-01 04:44:18.709 DEBUG [src.node.waku_node] Stopping container with id 5b6c20019b3d
2026-02-01 04:44:18.974 ERROR [src.node.docker_mananger] Max retries reached for container 29a51a9c1239. Exiting log stream.
2026-02-01 04:44:19.262 DEBUG [src.node.waku_node] Container stopped.
2026-02-01 04:44:19.262 DEBUG [src.node.waku_node] Stopping container with id 2dfdfab7c5a4
2026-02-01 04:44:19.541 ERROR [src.node.docker_mananger] Max retries reached for container c6f70ca379b4. Exiting log stream.
2026-02-01 04:44:19.793 DEBUG [src.node.waku_node] Container stopped.
2026-02-01 04:44:19.794 DEBUG [src.node.waku_node] Stopping container with id 2cbfd51ae7c1
2026-02-01 04:44:20.074 ERROR [src.node.docker_mananger] Max retries reached for container 5b6c20019b3d. Exiting log stream.
2026-02-01 04:44:20.345 DEBUG [src.node.waku_node] Container stopped.
2026-02-01 04:44:20.347 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-01 04:44:20.361 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-01 04:44:20.369 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-01 04:44:20.374 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-01 04:44:20.378 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-01 04:44:20.382 DEBUG [src.node.docker_mananger] No errors found in the waku logs.