324 lines
52 KiB
Plaintext

2026-03-09 04:39:18.769 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-09 04:39:18.770 DEBUG [tests.conftest] Running test: test_cursor_pointing_to_deleted_message with id: 2026-03-09_04-39-18__cb80afa0-b05c-44a9-9ce7-f827fc324c01
2026-03-09 04:39:18.770 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-09 04:39:18.770 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-09 04:39:18.771 DEBUG [src.steps.store] Running fixture setup: node_setup
2026-03-09 04:39:18.778 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-09 04:39:18.778 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/publishing_node1_2026-03-09_04-39-18__cb80afa0-b05c-44a9-9ce7-f827fc324c01__wakuorg_nwaku:latest.log
2026-03-09 04:39:18.778 DEBUG [src.node.waku_node] Starting Node...
2026-03-09 04:39:18.779 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-09 04:39:18.780 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-09 04:39:18.780 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.121.188
2026-03-09 04:39:18.780 DEBUG [src.node.docker_mananger] Generated ports ['12356', '12357', '12358', '12359', '12360']
2026-03-09 04:39:18.780 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-09 04:39:18.781 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-09 04:39:18.781 DEBUG [src.node.waku_node] Using volumes []
2026-03-09 04:39:18.781 DEBUG [src.node.docker_mananger] docker run -i -t -p 12356:12356 -p 12357:12357 -p 12358:12358 -p 12359:12359 -p 12360:12360 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=12358 --rest-port=12356 --tcp-port=12357 --discv5-udp-port=12359 --rest-address=0.0.0.0 --nat=extip:172.18.121.188 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8f04157f472338f8a25bdebeabde82deda3aef7cad6820d6cbf6aa180bcf80bd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=12360 --metrics-logging=true --store=true --relay=true
2026-03-09 04:39:18.981 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.121.188 waku 8eb96fb7dbda1957f14a7ecfe5a1e5bd98de7a2298124fdb391442382b14ea93
2026-03-09 04:39:19.008 ERROR [src.node.docker_mananger] Max retries reached for container 2eb16717920d. Exiting log stream.
2026-03-09 04:39:19.021 DEBUG [src.node.docker_mananger] Container started with ID 8eb96fb7dbda. Setting up logs at ./log/docker/publishing_node1_2026-03-09_04-39-18__cb80afa0-b05c-44a9-9ce7-f827fc324c01__wakuorg_nwaku:latest.log
2026-03-09 04:39:19.022 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 12356
2026-03-09 04:39:19.022 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-09 04:39:19.571 ERROR [src.node.docker_mananger] Max retries reached for container 20e16391437e. Exiting log stream.
2026-03-09 04:39:20.022 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12356/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:20.025 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-09 04:39:20.026 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-09 04:39:20.026 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12356/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:20.028 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.121.188/tcp/12357/p2p/16Uiu2HAmMz8taUnQkEFJu1g153DsNSYvrumWUt8nQjifnC1Az6Rv","/ip4/172.18.121.188/tcp/12358/ws/p2p/16Uiu2HAmMz8taUnQkEFJu1g153DsNSYvrumWUt8nQjifnC1Az6Rv"],"enrUri":"enr:-L24QCqeBM4pOOFrgA97717z-3Q10PrjbRSkjmBYkuOXMCAuVR-7fSMlp6YwcvnwzvWjzJgUqL8AN5wbdiOFWLonXmUCgmlkgnY0gmlwhKwSebyKbXVsdGlhZGRyc5YACASsEnm8BjBFAAoErBJ5vAYwRt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDiqDfkHEbjHdYo7FD6auaLw_ZaNyX-5-HD4gTQbHvDRGDdGNwgjBFg3VkcIIwR4V3YWt1MgM"}'
2026-03-09 04:39:20.028 INFO [src.node.waku_node] REST service is ready !!
2026-03-09 04:39:20.036 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-09 04:39:20.036 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/store_node1_2026-03-09_04-39-18__cb80afa0-b05c-44a9-9ce7-f827fc324c01__wakuorg_nwaku:latest.log
2026-03-09 04:39:20.036 DEBUG [src.node.waku_node] Starting Node...
2026-03-09 04:39:20.036 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-09 04:39:20.038 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-09 04:39:20.038 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.150.121
2026-03-09 04:39:20.038 DEBUG [src.node.docker_mananger] Generated ports ['34354', '34355', '34356', '34357', '34358']
2026-03-09 04:39:20.038 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-09 04:39:20.038 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-09 04:39:20.038 DEBUG [src.node.waku_node] Using volumes []
2026-03-09 04:39:20.038 DEBUG [src.node.docker_mananger] docker run -i -t -p 34354:34354 -p 34355:34355 -p 34356:34356 -p 34357:34357 -p 34358:34358 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=34356 --rest-port=34354 --tcp-port=34355 --discv5-udp-port=34357 --rest-address=0.0.0.0 --nat=extip:172.18.150.121 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=44fc876f658c06f49c9e6d2e3bb68feaf84fe4be2e706e386ac7be49d3ebe3db --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=34358 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QCqeBM4pOOFrgA97717z-3Q10PrjbRSkjmBYkuOXMCAuVR-7fSMlp6YwcvnwzvWjzJgUqL8AN5wbdiOFWLonXmUCgmlkgnY0gmlwhKwSebyKbXVsdGlhZGRyc5YACASsEnm8BjBFAAoErBJ5vAYwRt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDiqDfkHEbjHdYo7FD6auaLw_ZaNyX-5-HD4gTQbHvDRGDdGNwgjBFg3VkcIIwR4V3YWt1MgM --storenode=/ip4/172.18.121.188/tcp/12357/p2p/16Uiu2HAmMz8taUnQkEFJu1g153DsNSYvrumWUt8nQjifnC1Az6Rv --store=true --relay=true
2026-03-09 04:39:20.227 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.150.121 waku cf7a821d3a5941500ccd86f6461d3217741753e390cd3e844b1147ea36fe5234
2026-03-09 04:39:20.259 DEBUG [src.node.docker_mananger] Container started with ID cf7a821d3a59. Setting up logs at ./log/docker/store_node1_2026-03-09_04-39-18__cb80afa0-b05c-44a9-9ce7-f827fc324c01__wakuorg_nwaku:latest.log
2026-03-09 04:39:20.260 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 34354
2026-03-09 04:39:20.260 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-09 04:39:21.262 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:21.363 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:21.465 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:21.566 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:21.668 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:21.685 ERROR [src.node.docker_mananger] Max retries reached for container cf7a821d3a59. Exiting log stream.
2026-03-09 04:39:21.769 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:21.870 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:21.972 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:22.073 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:22.174 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:22.275 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:22.376 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:22.478 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:22.579 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:22.680 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:22.782 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:22.883 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:22.985 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:23.086 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:23.187 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:23.288 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:23.390 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:23.491 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:23.593 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:23.694 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:23.795 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:23.896 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:23.997 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:24.099 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:24.200 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:24.302 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:24.403 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:24.504 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:24.605 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:24.707 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:24.809 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:24.910 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:25.011 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:25.113 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:25.215 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:25.316 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:25.417 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:25.519 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:25.620 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:25.721 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:25.822 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:25.924 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:26.025 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:26.127 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:26.229 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:26.330 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:26.431 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:26.532 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:26.634 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:26.735 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:26.836 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:26.938 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:27.039 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:27.140 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:27.241 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:27.343 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:27.444 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:27.545 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:27.646 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:27.747 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:27.849 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:27.950 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:28.051 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:28.152 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:28.254 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:28.355 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:28.456 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:28.558 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:28.659 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:28.760 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:28.861 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:28.963 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:29.064 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:29.165 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:29.267 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:29.368 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:29.469 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:29.570 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:29.672 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:29.773 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:29.874 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:29.975 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:30.077 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:30.178 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:30.280 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:30.381 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:30.482 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:30.583 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:30.685 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:30.786 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:30.887 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:30.989 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:31.090 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:31.192 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:31.293 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:31.394 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:31.496 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:31.597 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:31.698 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:31.800 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:31.901 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:32.002 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:32.104 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:32.205 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:32.306 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:32.408 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:32.509 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:32.610 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:32.712 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:32.813 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:32.914 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:33.015 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:33.116 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:33.217 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:33.319 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:33.420 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:33.522 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:33.623 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:33.724 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:33.825 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:33.927 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:34.028 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:34.130 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:34.231 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:34.332 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:34.434 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:34.535 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:34.636 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:34.737 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:34.838 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:34.940 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:35.041 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:35.142 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:35.244 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:35.345 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:35.446 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:35.547 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:35.649 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:35.750 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:35.851 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:35.953 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:36.054 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:36.155 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:36.257 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:36.358 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:36.460 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:36.561 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:36.662 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:36.763 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:36.864 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:36.966 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:37.067 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:37.168 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:37.269 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:37.371 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:37.472 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:37.574 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:37.675 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:37.776 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:37.877 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:37.979 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:38.080 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:38.182 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:38.283 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:38.385 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:38.486 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:38.587 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:38.688 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:38.790 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:38.891 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:38.992 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:39.094 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:39.195 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:39.297 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:39.398 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:39.499 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:39.600 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:39.702 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:39.803 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:39.904 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:40.006 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:40.107 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:40.209 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:40.310 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:40.411 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:40.512 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:40.614 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:40.715 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:40.816 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:40.917 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:41.019 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:41.120 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:41.222 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:41.324 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34354/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:41.325 ERROR [src.node.waku_node] REST service did not become ready in time: HTTPConnectionPool(host='127.0.0.1', port=34354): Max retries exceeded with url: /health (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fa043074530>: Failed to establish a new connection: [Errno 111] Connection refused'))
2026-03-09 04:39:41.425 DEBUG [src.node.waku_node] Starting Node...
2026-03-09 04:39:41.425 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-09 04:39:41.427 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-09 04:39:41.427 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.78.190
2026-03-09 04:39:41.427 DEBUG [src.node.docker_mananger] Generated ports ['34049', '34050', '34051', '34052', '34053']
2026-03-09 04:39:41.428 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-09 04:39:41.428 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-09 04:39:41.428 DEBUG [src.node.waku_node] Using volumes []
2026-03-09 04:39:41.428 DEBUG [src.node.docker_mananger] docker run -i -t -p 34049:34049 -p 34050:34050 -p 34051:34051 -p 34052:34052 -p 34053:34053 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=34051 --rest-port=34049 --tcp-port=34050 --discv5-udp-port=34052 --rest-address=0.0.0.0 --nat=extip:172.18.78.190 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=5bebfcaa53d73f50a7ec9fafc2659b5cf2ff3c3daff92dff1de37cc3cecee7da --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=34053 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QCqeBM4pOOFrgA97717z-3Q10PrjbRSkjmBYkuOXMCAuVR-7fSMlp6YwcvnwzvWjzJgUqL8AN5wbdiOFWLonXmUCgmlkgnY0gmlwhKwSebyKbXVsdGlhZGRyc5YACASsEnm8BjBFAAoErBJ5vAYwRt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDiqDfkHEbjHdYo7FD6auaLw_ZaNyX-5-HD4gTQbHvDRGDdGNwgjBFg3VkcIIwR4V3YWt1MgM --storenode=/ip4/172.18.121.188/tcp/12357/p2p/16Uiu2HAmMz8taUnQkEFJu1g153DsNSYvrumWUt8nQjifnC1Az6Rv --store=true --relay=true
2026-03-09 04:39:41.624 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.78.190 waku fb4ab01c57a6ae4c6d5274048deba1255895d1532de70c83a31af04a8cb0f5de
2026-03-09 04:39:41.658 DEBUG [src.node.docker_mananger] Container started with ID fb4ab01c57a6. Setting up logs at ./log/docker/store_node1_2026-03-09_04-39-18__cb80afa0-b05c-44a9-9ce7-f827fc324c01__wakuorg_nwaku:latest.log
2026-03-09 04:39:41.658 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 34049
2026-03-09 04:39:41.658 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-09 04:39:42.659 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34049/health" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:42.661 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-09 04:39:42.662 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-09 04:39:42.662 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34049/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:42.664 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.78.190/tcp/34050/p2p/16Uiu2HAmR57BYS1MTGenem57mWHdRdwo3FxogjXR9T1GhF5briyr","/ip4/172.18.78.190/tcp/34051/ws/p2p/16Uiu2HAmR57BYS1MTGenem57mWHdRdwo3FxogjXR9T1GhF5briyr"],"enrUri":"enr:-L24QLZuagc4XbEaqNDm9NvhDDtqodrMOPzlPCXUAl3MQ4pGX0_ln5ODlXzTACJl2IfcuQ7dRUl8Ky8DDTtFqQaXtkMCgmlkgnY0gmlwhKwSTr6KbXVsdGlhZGRyc5YACASsEk6-BoUCAAoErBJOvgaFA90DgnJzhQADAQAAiXNlY3AyNTZrMaEDuHnoTfkgy5uoh15pa-8f88mfc2TwIFU5XBneLzfCLm2DdGNwgoUCg3VkcIKFBIV3YWt1MgM"}'
2026-03-09 04:39:42.665 INFO [src.node.waku_node] REST service is ready !!
2026-03-09 04:39:42.665 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34049/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.121.188/tcp/12357/p2p/16Uiu2HAmMz8taUnQkEFJu1g153DsNSYvrumWUt8nQjifnC1Az6Rv"]'
2026-03-09 04:39:42.668 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:39:42.668 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12356/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-09 04:39:42.671 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:39:42.671 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34049/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-09 04:39:42.673 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:39:42.674 DEBUG [src.steps.store] Relaying message
2026-03-09 04:39:42.674 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV8w", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-09 04:39:42.680 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:39:42.681 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-09 04:39:42.881 DEBUG [src.steps.store] Relaying message
2026-03-09 04:39:42.882 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV8x", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-09 04:39:42.888 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:39:42.889 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-09 04:39:43.090 DEBUG [src.steps.store] Relaying message
2026-03-09 04:39:43.090 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV8y", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-09 04:39:43.097 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:39:43.097 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-09 04:39:43.298 DEBUG [src.steps.store] Relaying message
2026-03-09 04:39:43.298 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV8z", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-09 04:39:43.304 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:39:43.305 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-09 04:39:43.506 DEBUG [src.steps.store] Relaying message
2026-03-09 04:39:43.506 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV80", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-09 04:39:43.512 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:39:43.513 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-09 04:39:43.713 DEBUG [src.steps.store] Relaying message
2026-03-09 04:39:43.714 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV81", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-09 04:39:43.721 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:39:43.721 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-09 04:39:43.922 DEBUG [src.steps.store] Relaying message
2026-03-09 04:39:43.922 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV82", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-09 04:39:43.928 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:39:43.928 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-09 04:39:44.129 DEBUG [src.steps.store] Relaying message
2026-03-09 04:39:44.129 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV83", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-09 04:39:44.135 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:39:44.135 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-09 04:39:44.336 DEBUG [src.steps.store] Relaying message
2026-03-09 04:39:44.336 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV84", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-09 04:39:44.342 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:39:44.343 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-09 04:39:44.543 DEBUG [src.steps.store] Relaying message
2026-03-09 04:39:44.544 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12356/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "TWVzc2FnZV85", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-09 04:39:44.549 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-09 04:39:44.549 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2026-03-09 04:39:44.750 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12356/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&contentTopics=%2Fmyapp%2F1%2Flatest%2Fproto&cursor=0x36bf04f9649f3340298acd9e6dffa4f531f5769b423e68aa755a7487d35c6805&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:44.753 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:12356/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&contentTopics=%2Fmyapp%2F1%2Flatest%2Fproto&cursor=0x36bf04f9649f3340298acd9e6dffa4f531f5769b423e68aa755a7487d35c6805&pageSize=100&ascending=true. Response content: b'error in handleSelfStoreRequest: BAD_RESPONSE: archive error: DRIVER_ERROR: cursor not found'
2026-03-09 04:39:44.754 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34049/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&contentTopics=%2Fmyapp%2F1%2Flatest%2Fproto&cursor=0x36bf04f9649f3340298acd9e6dffa4f531f5769b423e68aa755a7487d35c6805&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-09 04:39:44.757 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:34049/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&contentTopics=%2Fmyapp%2F1%2Flatest%2Fproto&cursor=0x36bf04f9649f3340298acd9e6dffa4f531f5769b423e68aa755a7487d35c6805&pageSize=100&ascending=true. Response content: b'error in handleSelfStoreRequest: BAD_RESPONSE: archive error: DRIVER_ERROR: cursor not found'
2026-03-09 04:39:44.758 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-09 04:39:44.759 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-09 04:39:44.760 DEBUG [src.node.waku_node] Stopping container with id 8eb96fb7dbda
2026-03-09 04:39:45.380 DEBUG [src.node.waku_node] Container stopped.
2026-03-09 04:39:45.382 DEBUG [src.node.waku_node] Stopping container with id fb4ab01c57a6
2026-03-09 04:39:45.938 DEBUG [src.node.waku_node] Container stopped.
2026-03-09 04:39:45.942 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-09 04:39:45.953 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-09 04:39:45.960 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-09 04:39:45.967 DEBUG [src.node.docker_mananger] No errors found in the waku logs.