Commit Graph

922 Commits

Author SHA1 Message Date
Jakub Sokołowski 948b5885fe
nimbus.prater: move disabling discovery to Hetzner group
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-29 21:20:03 +02:00
Jakub Sokołowski e9a05d73ab
nimbus.prater: add DNS discovery for Erigon
Necessary because we disable normal discovery.

Source:
https://github.com/ethereum/discv4-dns-lists

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-29 21:03:53 +02:00
Jakub Sokołowski a8741b7019
nimbus.prater: , disable discovery for Erigon
It appears peer discovery can be detected by hetzner as an attempt at
network scanning:
https://github.com/ledgerwatch/erigon/issues/7234

Which can lead to the server being shut down.
For this reason I'm lowering max peers and disabling discovery.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-29 20:06:58 +02:00
Jakub Sokołowski 3f3d763990
nimbus.prater: double nofile limit to 32768
Which needs to be more than 4 x 7899 validators.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-29 18:36:09 +02:00
Jakub Sokołowski e5324beaaa
nimbus-geth-goerli: remove one of three Geth nodes
Not nough storage space to run 3 nodes on the hosts.

Also made AWS, Windows and MacOS nodes discover available
Geth nodes using Consul catalog.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-24 18:34:03 +02:00
Jakub Sokołowski 001baf0367
requirements: bump beacon node roles, use prune
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-23 19:20:24 +02:00
Jakub Sokołowski 597b85a0c8
nimbus.sepolia: open EL WebSocket to wakuv2.test
https://github.com/waku-org/nwaku/issues/1624
https://github.com/status-im/infra-nim-waku/pull/69

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-17 18:15:47 +02:00
Jakub Sokołowski 2e14ecc79e
nimbus.sepolia: enable SMART metrics service
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-17 18:11:27 +02:00
Jakub Sokołowski c15e1ea358
nimbus.mainnet: 10k max peers for stable-02@linux-03
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-16 12:38:24 +02:00
Jakub Sokołowski a270f4044c
all: get Consul certificates from BitWarden
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-16 12:14:38 +02:00
Jakub Sokołowski 0cd6de1ea6
nimbus.mainnet: use ncli_db from stable node
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-16 12:14:27 +02:00
Jakub Sokołowski 5e790e8585
nimbus-era-files: fix trailing newline in launchd
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-16 12:14:09 +02:00
Jakub Sokołowski d04a98ea11
remove metal-01.he-eu-hel1.nimbus.mainnet
https://github.com/status-im/infra-nimbus/issues/132

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-16 11:05:30 +02:00
Jakub Sokołowski 05f98abd53
nimbus.prater: use more CL endpoints on MacOS
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-16 11:05:23 +02:00
Jakub Sokołowski 4dbb3c165c
nimbus.mainnet: fix config of ERA files hosting
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-16 10:53:21 +02:00
Jakub Sokołowski a145963a2a
ih-eu-mda1: disable Consul check for SMART metrics
The service fails on InnovaHosting servers due to HBA controller:
https://github.com/prometheus-community/smartctl_exporter/issues/26

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-15 19:51:41 +02:00
Jakub Sokołowski 9102e1954a
nimbus.sepolia: fix exposed REST API endpoint
Missing redirect config.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-15 16:19:19 +02:00
Jakub Sokołowski 9a3f1f8b4c
nimbus.mainnet: fix filenames for host_vars
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-15 13:24:52 +02:00
Jakub Sokołowski 0256a21dd0
nimbus.mainnet: add two more hosts from Innova
The `linux-06` is a new host, while `linux-07` is re-purposed `linux-01`
from the prater fleet. This is done because the Innova company is out of
Xeon E5-2690 CPUs, and we want consistent performance across the fleet.

This way all seven hosts in `nimbus.mainnet` will use the E5-2690 CPU.

https://github.com/status-im/infra-nimbus/issues/132

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-09 15:07:22 +02:00
Jakub Sokołowski 406ac58f16
nimbus.mainnet: use --no-el for even number nodes
Attempted fix issues with syncing where latency on the Geth endpoint is
too high for beacon nodes to finish syncing properly.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-05 20:58:53 +02:00
Jakub Sokołowski 01cf22c9f8
get-geth-api-urls: rename variables for clarity
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-05-05 19:21:49 +02:00
Jakub Sokołowski 5635b39e50
mainnet: decommission 6 Hetzner hosts
Being replaced by InnovaHosting servers
https://github.com/status-im/infra-nimbus/issues/132

I'm leaving old `metal-07` as `metal-01` since we don't have a server
with `libp2p` nodes on mainnet yet.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-04-28 12:22:46 +02:00
Jakub Sokołowski cd0841eba2
ih-eu-mda1: fix destintion DC for sending logs
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-04-25 18:06:00 +02:00
Jakub Sokołowski e43ede93a5
nimbus.mainnet: fix exec layer URL logic
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-04-20 22:28:26 +02:00
Jakub Sokołowski 940b2577da
nimbus.mainnet: add node layout for new Innova hosts
Once they are synced and working we'll remove the Hetzner ones.

https://github.com/status-im/infra-nimbus/issues/132

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-04-18 18:14:53 +02:00
Jakub Sokołowski 3c0348cb81
add linux-05.ih-eu-mda1.nimbus.mainnet host
https://github.com/status-im/infra-nimbus/issues/132

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-04-18 18:13:00 +02:00
Jakub Sokołowski 1c177eb944
add linux-04.ih-eu-mda1.nimbus.mainnet host
https://github.com/status-im/infra-nimbus/issues/132

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-04-18 17:58:48 +02:00
Jakub Sokołowski 8ddbd86139
nimbus.mainnet: revert removing of stable-02 node
This reverts commit ab266d132d.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-04-17 20:06:57 +02:00
Jakub Sokołowski 53ccd34927
nimbus.prater: bootstrap new Innova servers
https://github.com/status-im/infra-nimbus/issues/132

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-04-17 17:11:27 +02:00
Jakub Sokołowski 1f5ad05893
nimbus.fluffy: 24h to make healthcheck critical
This is not a critical service and there's a LOT of sevices that cause a
lot of alerts when developers are stopping and starting them.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-04-12 19:28:37 +02:00
Jakub Sokołowski 9ec35f149b
nimbus.fluff: deploy smart-metrics exporter
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-04-12 13:24:29 +02:00
Jakub Sokołowski 39ceeaf5ec
requirements: bump rocketpool, geth, erigon
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-04-07 18:16:50 +02:00
Jakub Sokołowski ab266d132d
nimbus.mainnet: remove stable-02 node to save space
We can always re-add it when we deploy to our new hosts.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-04-07 12:00:20 +02:00
Jakub Sokołowski 171acedac7
nimbus.prater: un-comment roles
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-04-06 16:39:31 +02:00
Jakub Sokołowski debe4bd960
nimbus.mainnet: fix data volume mount on metal-05
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-04-06 16:38:19 +02:00
Jakub Sokołowski d41b3c89f8
dash.nimbus: increase logs retention to 30 days
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-04-05 11:04:09 +02:00
Jakub Sokołowski d6de0faf1a
nimbus.prater: open Erigon metrics port on VPN
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-03-23 15:14:38 +01:00
Jakub Sokołowski 0956c88d9a
nimbus.prater: enable metrics for Erigon nodes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-03-22 13:47:15 +01:00
Jakub Sokołowski 9aa83f8d47
nimbus.prater: use Erigon EL node if available
Beginning of work on testing multi-EL node setup:
https://github.com/status-im/infra-nimbus/issues/144

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-03-22 12:10:34 +01:00
Jakub Sokołowski 0943ae2f76
nimbus-era-files: fix script template for verify timer
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-03-22 10:58:39 +01:00
Jakub Sokołowski cdf362f2a9
nimbus.prater: provide private key for mining
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-03-21 13:07:23 +01:00
Jakub Sokołowski f92bcb2802
nimbus.prater: fix erigon metrics port conflict
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-03-21 13:07:13 +01:00
Jakub Sokołowski 4a5b7d7107
nimbus.prater: deploy two Erigon nodes
Part of work to support multiple EL nodes driven by one CL node:
https://github.com/status-im/infra-nimbus/issues/144

Disabled Geth websocket as unused and conflicting with Erigon.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-03-20 22:27:50 +01:00
Jakub Sokołowski 5926a3da4d
nimbus.prater: add extra data volumes for CL nodes
https://github.com/status-im/infra-nimbus/issues/144

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-03-20 21:30:38 +01:00
Jakub Sokołowski e677decb38
requirements: bump ElasticSearch to 7.17.9
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-03-20 21:30:23 +01:00
Jakub Sokołowski 4ea58aeda7
deploy SMART metrics to all metal hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-03-18 18:02:58 +01:00
Jakub Sokołowski e1e21119da
use new exec layer variables for beacon nodes
Role changes:
- https://github.com/status-im/infra-role-beacon-node-linux/commit/99a445d1
- https://github.com/status-im/infra-role-beacon-node-macos/commit/eecf9fea
- https://github.com/status-im/infra-role-beacon-node-windows/commit/dba21b36

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-03-16 00:59:48 +01:00
Jakub Sokołowski 03ef7c54bb
nimbus.sepolia: use nimbus-eth1 Engine API WS port
Related to:
https://github.com/status-im/nimbus-eth1/issues/1486

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-03-06 11:29:51 +01:00
Jakub Sokołowski c854752503
ansible/resize.yml: fix unmounting /mnt volumes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-03-02 14:37:27 +01:00
Jakub Sokołowski 5783656224
nimbus.mainnet: make AWS nodes have archive history
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-03-02 12:22:51 +01:00
Jakub Sokołowski 768ecef371
nimbus.prater: use AWS hosts to sync first node
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-03-02 12:22:45 +01:00
Jakub Sokołowski 090c4661a9
nimbus.mainnet: use AWS hosts to sync first node
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-03-02 12:22:44 +01:00
Jakub Sokołowski 10f3132bcd
logs.nimbus: use G1 garbage collector
https://github.com/status-im/infra-nimbus/issues/138

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-03-01 18:44:02 +01:00
Jakub Sokołowski 4e20fd2c14
nimbus.prater: use a new set of MEV boost URLs
The one from `flashbots.net` seems to have connectivity issues:
```
REST request was interrupted
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-24 13:16:06 +01:00
Jakub Sokołowski 15d96ca3be
nimbus.mainnet/prater: use more threads than 1
This setting is quite old and it's time to use more than one thread.
The `libp2p` branch is the exception that will keep using 1 thread.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-24 11:37:17 +01:00
Jakub Sokołowski 3e3cff6840
nimbus.mainnet/prater: enable pruned history
For most nodes this is fine, except for nodes with publicly exposed API,
which we should keep as synced from genesis and in archive mode.

Every other node is fine being prunned. I'm keeping AWS nodes not pruned
as fallback since increasing their storage is quick and easy.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-21 22:52:41 +01:00
Jakub Sokołowski 6e05ef6eec
nimbus.prater: add linux-01.cs-eu-nld1.nimbus.prater
Part of research into alternative hosting for Nimbus:
https://github.com/status-im/infra-nimbus/issues/132

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-21 21:25:42 +01:00
Jakub Sokołowski e3cbc05ab9
requirements: bump roles, drop versions for bootstrap
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-21 12:55:22 +01:00
Jakub Sokołowski d6da1ce336
nimbus.mainnet: drop db_purge and db_sync vars
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-21 12:38:17 +01:00
Jakub Sokołowski 297f347934
drop linux-01.cs-eu-nld1.nimbus.prater host
Decided against using it due to maintenance costs:
https://github.com/status-im/infra-nimbus/issues/132

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-21 12:37:15 +01:00
Jakub Sokołowski 77278c2b65
logs.nimbus: lower ES JVM heap size to 40 GB
Never ending issues with `Data too big` errors:
https://github.com/status-im/infra-nimbus/issues/138

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-21 00:11:55 +01:00
Jakub Sokołowski fc236d0132
remove SSH access from mamy, miran, s1fr0
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-02-17 16:35:09 +01:00
Jakub Sokołowski c05fad0e01
add linux-01.cs-eu-nld1.nimbus.prater host
Test for replacement of Hetzner hosts:
https://github.com/status-im/infra-nimbus/issues/132

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-01-30 21:34:21 +01:00
Jakub Sokołowski 61d586fa8c
logs.nimbus: set static max heap size to 48 GB
Trying to fix the `Data too large` circuit breaker errors:
https://github.com/status-im/infra-nimbus/issues/138

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-01-28 14:17:04 +01:00
Jakub Sokołowski ee1ed5203b
logs/dash.nimbus: drop manual JVM heap size setting
Lets try how well the automatic sizing works:
https://www.elastic.co/guide/en/elasticsearch/reference/7.17/important-settings.html#heap-size-settings

https://github.com/status-im/infra-nimbus/issues/138

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-01-19 15:00:14 +01:00
Jakub Sokołowski e73125a215
replace logs.nimbus hosts with new AX101 servers
Constant memory issues due to volume of logs:
https://github.com/status-im/infra-nimbus/issues/138

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-01-19 14:08:34 +01:00
Jakub Sokołowski 9f0ab35e5d
requirements: bump elasticsearch and kiban to 7.17.8
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-01-19 14:08:33 +01:00
Nikola K 2c3a01e1fe
add crypt1d as new nimbus devops
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-01-13 10:46:17 +01:00
Jakub Sokołowski 5930389580
nimbus.prater: bump AWS host data volumes to 300 GB
Also add a `resize.yml` playbook for easier resizing.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-01-12 12:31:57 +01:00
Jakub Sokołowski 3089a52ff0
requirements: bump bootstrap roles, upgrade rocketpool
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-01-12 12:31:36 +01:00
Jakub Sokołowski c18ead4714
nimbus.prater: add resync timer configuration
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-01-04 17:24:02 +01:00
Jakub Sokołowski cd982c44f3
drop unused nimbus-db-purge role in favor of resync
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-01-03 15:00:39 +01:00
Jakub Sokołowski d0bb5fa009
nimbus.ropsten: decomission, network shutdown
https://blog.ethereum.org/2022/11/30/ropsten-shutdown-announcement

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-12-09 08:51:13 +01:00
Jakub Sokołowski ffa5032735
requirements: bump macos bootstrap, fix consul meta
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-12-09 08:47:23 +01:00
Jakub Sokołowski 7f5463fe14
nimbus.prater: use common ERA files folder
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-12-08 13:37:28 +01:00
Jakub Sokołowski 2caba20c3f
nimbus.prater: configure resync for macos host
We're running out of disk space, this is a quick fix for now.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-12-07 17:38:43 +01:00
Jakub Sokołowski 0187369fa6
nimbus.prater: generate ERA files on MacOS host
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-12-07 17:37:57 +01:00
Jakub Sokołowski 0eff309f15
nimbus-era-files: add support for Darwin platforms
Necessary for Prater MacOS host.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-12-07 16:27:41 +01:00
Jakub Sokołowski 6cb88c3388
nimbus.ropsten: ropsten will be removed from unstable
https://github.com/status-im/nimbus-eth2/pull/4280

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-12-01 08:46:47 +01:00
Zahary Karadjov 01b6f0b6c7
Enable payload builder on 06-prater-unstable 2022-11-30 13:44:27 +02:00
Zahary Karadjov 3f94bbfc0f
Configure the --suggested-fee-recipient option for BNs and VCs across the fleet
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-11-30 10:49:23 +01:00
Jakub Sokołowski 91f4c79cbe
nimbus-era-files: comment about length of timeout
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-11-30 10:46:57 +01:00
Jakub Sokołowski 86a5a83c99
nimbus.mainnet: use unstable ncli_db for ERA files
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-11-30 10:46:37 +01:00
Zahary Karadjov 2fba850aca
Enable the VC payload builder on linux-06's testing intance
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-11-24 14:16:22 +01:00
Jakub Sokołowski 8d25970d54
nimbus.prater: use unstable ncli_db to include fixes
Specifically fixes for ERA file validating and naming.
https://github.com/status-im/nimbus-eth2/pull/4351

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-11-24 13:53:20 +01:00
Jakub Sokołowski 4ab71fc6a8
nimbus-era-files: update readme with example
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-11-23 19:57:55 +01:00
Jakub Sokołowski d72cd696aa
nimbus-era-files: add timer for validating files
For now it seems unstable so I'm making it just create warnings.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-11-23 19:11:51 +01:00
Jakub Sokołowski ddfd5e7d9c
requirements: bump bootstrap to add new SSH keys
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-11-23 19:11:35 +01:00
Jakub Sokołowski 38fa2dbea9
era: open ports 80 and 443 for Nginx
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-11-17 11:32:08 +01:00
Jakub Sokołowski 427b736fb2
host ERA files under prater.era.nimbus.team domain
https://github.com/status-im/infra-nimbus/issues/126

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-11-17 11:27:01 +01:00
Jakub Sokołowski 1cea695b37
requirements: bump bootstrap and rocketpool
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-11-17 11:23:52 +01:00
Jakub Sokołowski fff4ae5c0a
nimbus.prater: enable nimbus-era-files role
Necessary to generate ERA files for hosting.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-11-08 17:56:03 +01:00
Jakub Sokołowski f75c94e6f5
host ERA files under mainnet.era.nimbus.team domain
https://github.com/status-im/infra-nimbus/issues/126

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-11-08 17:53:09 +01:00
Jakub Sokołowski 1a49e60147
nimbus-era-files: extend folder mode to 755
Not unsafe, and necessary for hosting using Nginx.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-11-08 17:53:08 +01:00
Jakub Sokołowski 7f7e234f36
nimbus.prater: bump header body and header limits
Necessary to accomodate large number of validators handled by the
validator client node.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-28 17:00:35 +02:00
Jakub Sokołowski 063a3b7c05
nimbus.prater: bump VC log level to DEBUG
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-28 17:00:22 +02:00
Jakub Sokołowski 26f0db1807
nimbus.prater: enable VC for linux-06 libp2p node
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-28 10:20:39 +02:00
Jakub Sokołowski b5aea537fb
requirements: add --purge to validator distribution
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-28 10:13:07 +02:00
Jakub Sokołowski 8f326fdf2a
logs.nimbus: open ES API port for Logstash hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-27 16:33:37 +02:00
Jakub Sokołowski 7e4f19b453
nimbus.prater: adjust validators count on last host
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-26 11:15:50 +02:00
Jakub Sokołowski 2320bfd74a
nimbus.prater: open geth exporter ports
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-25 21:11:47 +02:00
Jakub Sokołowski 4d43415e61
nimbus.ropsten: open geth exporter ports
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-25 21:11:46 +02:00
Jakub Sokołowski c696c70cfc
nimbus.prater: fix beacon node validator distribution
Missing part that already exists for Sepolia and Ropstne.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-25 18:19:23 +02:00
Jakub Sokołowski dd65e33a7e
requirements: bump all ansible roles
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-25 12:24:06 +02:00
Jakub Sokołowski baf158e399
nimbus.prater: drop index from validator client name
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-24 18:23:55 +02:00
Jakub Sokołowski cf8bab14ab
nimbus.prater: use VC for unstable node on linux-03
https://github.com/status-im/infra-nimbus/issues/122

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-24 16:09:42 +02:00
Jakub Sokołowski 439d07db86
nimbus.ropsten: reduce REST headers and body size
This was a fix for very large URL arguments caused by large number of
validators applied to the connected validator client.
Unfortunately the values used were in bytes and not kilobytes.
In result we got unnecessarily high memory usage.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-22 12:33:23 +02:00
Jakub Sokołowski 83073a7567
nimbus.mainnet: deploy libp2p nodes to metal-07
Because `libp2p` nodes take up space on 05 and 06.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-19 12:16:50 +02:00
Jakub Sokołowski c26130ab69
add metal-07.he-eu-hel1.nimbus.mainnet host
Will be used for libp2p nodes.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-19 12:16:34 +02:00
Jakub Sokołowski c610692511
set explicit but wider values for websocket origins
Possible fix for `nim-waku` and `geth` connectivity issues:
https://github.com/status-im/nwaku/issues/1269

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-17 19:17:03 +02:00
Jakub Sokołowski d63bd18938
give SSH access to p1ge0nh8er and s1fr0
For debugging issues with Geth Websocket port for Nim-Waku.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-14 15:54:55 +02:00
Jakub Sokołowski 4017674931
add systemd-journal groups to all users by default
https://github.com/status-im/infra-role-bootstrap-linux/commit/d85963fa

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-14 15:01:31 +02:00
Jakub Sokołowski c8e3232dff
nimbus-era-files: use --network flag to fix errors
Changes to default runtime config have caused errors like this:
```
FAT Could not load head state, database corrupt? tid=3639597 file=blockchain_dag.nim:920 head=e7d4f3b7:4636671 tail=4d611d5b:0 genesis=4d611d5b:0
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-12 09:30:46 +02:00
Jakub Sokołowski 5de206719e
nimbus.prater: temporary fix for buggy doppelganger
https://github.com/status-im/infra-nimbus/issues/122

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-11 14:23:29 +02:00
Jakub Sokołowski 269a76a23e
nimbus.prater: deploy validator client to linux-04
https://github.com/status-im/infra-nimbus/issues/122

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-11 13:39:59 +02:00
Jakub Sokołowski 30c7f36bf4
requirements: bump linux bootstrap role
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-11 11:43:33 +02:00
Jakub Sokołowski 8df9680e8c
nimbus.mainnet: move swap file to root on AWS hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-11 11:32:40 +02:00
Jakub Sokołowski fe161dacbc
requirements: bump all ansible roles
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-05 15:18:54 +02:00
Jakub Sokołowski b5a6665de3
nimbus.ropsten: drop TTD config from extra flags
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-05 15:18:29 +02:00
Jakub Sokołowski 1773ffb439
nimbus.prater: payload builder on unstable-large-01
https://github.com/status-im/infra-nimbus/issues/128

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-29 15:03:34 +02:00
Jakub Sokołowski 759b3c8bf3
nimbus.prater: enable full light client data
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-28 15:24:36 +02:00
Jakub Sokołowski 7da6edf144
nimbus.sepolia: add validator client service
For now only for the first node.
https://github.com/status-im/infra-nimbus/issues/122

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-28 02:23:12 +02:00
Jakub Sokołowski e966bb1a59
nimbus.mainnet: fix web3 url conditional
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-27 19:27:52 +02:00
Jakub Sokołowski 2ff11c1b7a
nimbus.logs: drop unused oauth-proxy setup
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-27 19:27:40 +02:00
Zahary Karadjov 4e477b0c2f
nimbus.mainnet: enable full light client data
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-27 11:41:01 +02:00
Jakub Sokołowski 89f04d8aa4
nimbus.ropsten: use less validators on VC nodes
We want to test with lower numbers of validators first.

https://github.com/status-im/infra-nimbus/issues/122

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-23 17:01:48 +02:00
Jakub Sokołowski 23c07e3dbf
nimbus.ropsten: lower geth memory limits
It seems to be hogging far too much memory.

https://github.com/status-im/infra-nimbus/issues/122

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-23 17:01:13 +02:00
Jakub Sokołowski 7b7c61e5ee
nimbus.ropsten: uncomment geth setup
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-23 15:39:06 +02:00
Jakub Sokołowski 7d05abad43
nimbus.ropsten: initial setup of validator clients
https://github.com/status-im/infra-nimbus/issues/122

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-23 14:02:08 +02:00
Jakub Sokołowski 781c6650b7
nimbus.eth1: update rocketpool configuration
Add missing fee recipient address.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-22 14:57:58 +02:00
Jakub Sokołowski 1f54ea1fd4
nimbus.prater: open websocket port to other hosts
https://github.com/status-im/infra-nim-waku/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-21 12:39:19 +02:00
Jakub Sokołowski fa3bb88648
nimbus.prater: open websocket port for wakuv2.test
https://github.com/status-im/infra-nim-waku/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-21 12:24:55 +02:00
Jakub Sokołowski 414923bfbe
nimbus.prater: open Geth RPC ports for wakuv2 fleets
https://github.com/status-im/infra-nim-waku/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-19 19:52:31 +02:00
Jakub Sokołowski c1c261a083
nimbus.ropsten: use authrpc port with beacon nodes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-19 15:27:50 +02:00
Jakub Sokołowski fc23654e8a
nimbus.mainnet: use local Geth nodes for metal hosts
https://github.com/status-im/infra-nimbus/issues/127

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-15 14:31:04 +02:00
Jakub Sokołowski 513fb2bb88
get-geth-api-urls: drop Infura URLs entirely
Mainnet merge has happened, so no need for the exception.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-15 14:30:30 +02:00
Jakub Sokołowski 0dd5174870
nimbus.prater: fix missing port redirection config
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-15 14:07:43 +02:00
Jakub Sokołowski a0d1d97e0e
nimbus.kiln: drop Kiln testnet network entirely
Has been discontinued effective on 2022/09/12:
https://blog.ethereum.org/2022/09/09/kiln-shutdown

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-14 17:33:38 +02:00
Jakub Sokołowski 23a91206c1
nimbus.mainnet: open ports for Geth exporter
https://github.com/status-im/infra-nimbus/issues/127

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-14 15:34:23 +02:00
Jakub Sokołowski b4066e7386
nimbus.mainnet: deploy one Geth node on metal hosts
https://github.com/status-im/infra-nimbus/issues/127

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-14 15:24:15 +02:00
Jakub Sokołowski 21926f4cf7
mainnet: drop purging of DBs, resync does that
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-14 15:18:37 +02:00
Jakub Sokołowski 98b38cbf96
nimbus.mainnet: mount new NVMe volumes at /docker
https://github.com/status-im/infra-nimbus/issues/127

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-14 15:16:37 +02:00
Jakub Sokołowski 90895a638e
requirements: include fix for creating secrets dir
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-14 15:16:29 +02:00
Jakub Sokołowski b1933c0946
nimbus.prater: add suggested fee recipient
Account details will be available in Nimbus private docs:
https://github.com/status-im/nimbus-private/blob/master/testnets-maintenance.md#goerli-account

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-14 13:35:15 +02:00
Jakub Sokołowski 928d5a12ef
requirements: specify validator paths explicitly
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-12 16:58:02 +02:00
Jakub Sokołowski d26521d9ab
nimbus.prater: lower Geth memory limit to 15%
Geth loves memory, and eats up as much as it can.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-08 14:11:38 +02:00
Jakub Sokołowski 9481622372
drop goerli-01.aws-eu-central-1a.nimbus.geth host
No longer necessary after dedicated metal hosts were deployed:
https://github.com/status-im/infra-nimbus/issues/125

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-08 13:32:28 +02:00
Jakub Sokołowski f00a2a2009
requirements: bump bootstrap role
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-08 13:29:37 +02:00
Jakub Sokołowski e80d5943d1
nimbus.prater: use EL clients from new Geth hosts
https://github.com/status-im/infra-nimbus/issues/125

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-07 13:48:20 +02:00
Jakub Sokołowski 96a9843b21
nimbus-geth-goerli: one group_vars file to all hosts
https://github.com/status-im/infra-nimbus/issues/125

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-07 13:27:18 +02:00
Jakub Sokołowski 08a744da2f
rename Goerli geth nodes to be part of one fleet
This makes it simpler to provision and configure them.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-07 11:59:49 +02:00
Jakub Sokołowski 2dd9350f86
add macos-goerli-01.he-eu-hel1.nimbus.geth host
Repurposed old `metal-04.he-eu-hel1.nimbus.prater` host:
https://github.com/status-im/infra-nimbus/commit/b3ba3211

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-07 11:02:57 +02:00
Jakub Sokołowski d848640257
requirements: upgrade bootstrap roles
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-07 11:02:48 +02:00
Jakub Sokołowski cb448d64f3
nimbus-prater-windows: deploy dedicated Geth nodes
https://github.com/status-im/infra-nimbus/issues/125

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-06 19:26:25 +02:00
Jakub Sokołowski 0d7e29b8c3
add geth-windows-01.he-eu-hel1.nimbus.prater host
Sourced from old `nimbus.prater` fleet host: `metal-03`
https://github.com/status-im/infra-nimbus/commit/b3ba3211

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-09-05 12:13:40 +02:00
Jakub Sokołowski b3ba3211d5
nimbus.prater: drop old metal linux hosts
https://github.com/status-im/infra-nimbus/issues/125

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-31 20:00:06 +02:00
Jakub Sokołowski 8766336641
nimbus.prater: deploy Geth nodes on new hosts
https://github.com/status-im/infra-nimbus/issues/125

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-31 19:57:27 +02:00
Jakub Sokołowski 1bdcf1cab9
nimbus.prater: provision new bigger linux hosts
Part of deploying dedicated Geth nodes.
https://github.com/status-im/infra-nimbus/issues/125

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-30 20:19:47 +02:00
Jakub Sokołowski 4d5197c728
nimbus-openeth: OpenEth has been discontinued
The repo has been archived and receives no updates:
https://github.com/openethereum/openethereum

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-30 10:48:54 +02:00
Jakub Sokołowski 207064c5d6
nimbus.mainnet: fix syncing using ERA files
https://github.com/status-im/infra-nimbus/issues/98

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-29 13:08:06 +02:00
Jakub Sokołowski ddc8de5fa4
requirements: upgrade Geth to 1.10.23
https://github.com/status-im/infra-role-geth/commit/773c384d

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-24 14:03:58 +02:00
Jakub Sokołowski cca16d27c5
nimbus.prater: enable payload builder for two nodes
https://github.com/status-im/infra-nimbus/issues/124

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-23 15:29:40 +02:00
Jakub Sokołowski 620958880d
requirements: upgrade Geth from 1.10.21 to 1.10.22
https://github.com/ethereum/go-ethereum/releases/tag/v1.10.22

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-22 14:19:30 +02:00
Jakub Sokołowski 33f376cc3d
nimbus.mainnet: resync monthly and add 7 days delay
To avoid resyncing multiple nodes at the same time.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-22 10:54:10 +02:00
Jakub Sokołowski 6336f4514e
requirements: fix resync timers stop/starting service
https://github.com/status-im/infra-nimbus/issues/98

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-18 10:28:10 +02:00
Jakub Sokołowski 49a4c358b1
nimbus-sepolia-metal: add missing Web3 JWT secret
We set it for Geth, but not for Beacon nodes.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-18 09:56:15 +02:00
Jakub Sokołowski f8c262dfb4
nimbus.mainnet: enable creating resync timer jobs
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-18 09:04:38 +02:00
Jakub Sokołowski 7ec7641eed
nimbus.prater: open REST API ports to the fleet
Allows for trusted node syncing through the VPN.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-16 18:02:19 +02:00
Jakub Sokołowski 79843f4c25
requirements: bump most roles, add scope to geth
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-16 17:59:57 +02:00
Jakub Sokołowski b0a9b11d50
requirements: bump bootstrap roles
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-16 12:45:02 +02:00
Jakub Sokołowski 4fe3a607fe
nimbus.mainnet: open REST port to access via VPN
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-13 11:42:41 +02:00
Jakub Sokołowski 7d0029b9e2
drop unused ropsten-01.aws-eu-central-1a.nimbus.geth
https://github.com/status-im/infra-nimbus/issues/117

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-12 10:53:47 +02:00
Jakub Sokołowski 823196a0d9
use Geth Auth RPC endpoints for Engine API
Needs JWT secrets configured and changes to Consul queries.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-11 19:23:41 +02:00
Jakub Sokołowski f0aa49e60a
nimbus-sepolia-metal: drop mev-register-validators
Changes are already inn `unstable`.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-11 19:13:40 +02:00
Jakub Sokołowski 9d8e55dd55
nimbus-geth: configure Auth RPC ports for Engine API
This is required for communication with consensus layer nodes:
https://geth.ethereum.org/docs/interface/consensus-clients

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-11 13:06:37 +02:00
Jakub Sokołowski 30ed658621
grant SSH access to etan@status.im
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-11 13:06:36 +02:00
Jakub Sokołowski e3c203c815
nimbus.mainnet: enable purging DB for even nodes
https://github.com/status-im/infra-nimbus/issues/98

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-10 22:34:21 +02:00
Jakub Sokołowski b207184ede
get-geth-api-urls: specify fleet to avoid other nodes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-10 22:31:13 +02:00
Jakub Sokołowski 1ffc159f70
use idx instead of port_offset loop_var name
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-10 16:55:01 +02:00
Jakub Sokołowski b4b97d9338
nimbus.ropsten: spread validators between all nodes
https://github.com/status-im/infra-nimbus/issues/117

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-08 13:03:31 +02:00
Jakub Sokołowski 470f24cf5c
nimbus.mainnet: fix location of node DB folder
We've gotten rid of the `shared_{network}_0` subfolder:
https://github.com/status-im/infra-role-beacon-node-linux/commit/f4259bdf

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-08 11:37:46 +02:00
Jakub Sokołowski 974ab511a7
requirements: re-enable beacon-node API healthcheck
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-08 10:33:39 +02:00
Jakub Sokołowski e8eded758c
nimbus.mainnet: enable ERA folder symlinking
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-08-08 10:32:48 +02:00
Artur Marud b3e6e3f972
ropsten: create multi-geth config (#120)
* ropsten: create multi-geth config

Related: https://github.com/status-im/infra-nimbus/issues/117

Signed-off-by: Artur Marud <artur@status.im>
2022-07-22 14:24:00 +02:00
Jakub Sokołowski da363b1a23
nimbus-era-files: make timer optional
AWS hosts have just one node, so there's no need for ERA files generation.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-07-20 15:17:18 +02:00
Artur Marud fb67e2fe16
ropsten: added new disk configuration for ropsten hetzner host (#119)
Signed-off-by: Artur Marud <artur@status.im>
2022-07-19 21:34:20 +02:00
Artur Marud 65d8f36123
sepolia: implement and configure "payload_builder" feature for `node-02` (#118)
Refers: https://github.com/status-im/nimbus-eth2/pull/3883

Signed-off-by: Artur Marud <artur@status.im>
2022-07-18 18:47:06 +02:00
Jakub Sokołowski 57ec2fd903
requirements: bump beacon node to use new data path
We dropped the `shared_*` folders from data paths.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-07-18 09:53:35 +02:00
Jakub Sokołowski a6bc25ebd3
logs.nimbus: drop ElasticHQ in favor of ES Comrade
https://github.com/status-im/infra-hq/issues/82

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-07-14 20:31:24 +02:00
Jakub Sokołowski 472a379a9a
dash.nimbus: fix LB variable typos
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-07-14 16:51:20 +02:00
Jakub Sokołowski 3cc72b68e9
nimbus.mainnet: deploy nimbus-era-files to metal hosts
https://github.com/status-im/infra-nimbus/issues/98

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-07-14 01:00:29 +02:00
Jakub Sokołowski 00cfcf569f
nimbus-era-files: role for ERA generating timer
https://github.com/status-im/infra-nimbus/issues/98

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-07-14 00:59:59 +02:00
Jakub Sokołowski ce48768972
requirements: disable windows user password expiry
https://github.com/status-im/infra-nimbus/issues/116

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-07-12 16:04:19 +02:00
Jakub Sokołowski 07d561b62a
logs.nimbus: fix firewall rules for logs.hq fleet
https://github.com/status-im/infra-hq/issues/80

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-07-11 17:42:50 +02:00
Jakub Sokołowski cf57579f9d
nimbus-sepolia-trial: set JWT shared secret token
Otherwise beacon node fails at startup with:
```
Failed to setup web3 connection: WebSocket connection error: 403 Forbidden
```
https://github.com/status-im/infra-nimbus/issues/111

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-07-07 20:24:47 +02:00
Jakub Sokołowski 0b58b2f8b5
deploy nimbus-eth1 and beacon nodes for Sepolia
https://github.com/status-im/infra-nimbus/issues/111

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-07-07 16:24:06 +02:00
Jakub Sokołowski ddeb32e432
nimbus-sepolia-metal: drop unused branch variable
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-07-07 10:34:03 +02:00
Jakub Sokołowski 4e0db40fb4
requirements: upgrade Geth to 1.10.20
https://github.com/ethereum/go-ethereum/releases/tag/v1.10.20

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-07-05 18:50:55 +02:00
Miran 2b079f1774
fix various typos in comments and roles 2022-07-04 15:07:55 +02:00
Jakub Sokołowski 6702c50f38
bootstrap: give miran sudo permissions
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-07-04 09:32:53 +02:00
Jakub Sokołowski 2d2c55b38e
requirements: drop unused beacon node build flag
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-07-04 09:10:47 +02:00
zah 4147d511ba
Enable websock on some servers; Use the typical branches for Sepolia (#113) 2022-07-01 14:15:11 +02:00
Artur Marud f129dc6a3b
prater: continued nim-1.6 rollout
Signed-off-by: Artur Marud <artur@status.im>
2022-06-28 19:12:24 +02:00
Jakub Sokołowski 558e226afb
nimbus-geth-mainnet: open API for eth2.prod fleet
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-28 19:04:24 +02:00
Jakub Sokołowski f804a857f8
requirements: upgarde bootstrap roles and geth
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-27 18:30:48 +02:00
Jakub Sokołowski 0e3c1dc47a
requirements: bump geth to include new defaults
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-22 15:11:12 +02:00
zah 6ae39ddd3d
Use Nim 1.6 on metal-05's libp2p instance (#112) 2022-06-22 11:39:15 +02:00
Jakub Sokołowski 5aa3b64aca
requirements: bump beacon node roles
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-20 09:59:47 +02:00
Artur Marud defee3c490
infra-nimbus: sepolia validators configuration
Signed-off-by: Artur Marud <artur@status.im>
2022-06-20 09:51:38 +02:00
Artur Marud 61c0be82e1
infra-nimbus: sepolia beacon nodes setup
Signed-off-by: Artur Marud <artur@status.im>
2022-06-17 11:55:18 +02:00
Artur Marud e43c8af2b7
infra-nimbus: go-eth upgrade to 1.10.19 for ropsten, kiln and sepolia
* major changes - correct TTD for reopsten by default

Signed-off-by: Artur Marud <artur@status.im>
2022-06-15 17:02:34 +02:00
Artur Marud 9ebf3cba2d
Sepolia (#110)
* infra-nimbus: new testnet - sepolia

Signed-off-by: Artur Marud <artur@status.im>
2022-06-15 15:03:58 +02:00
zah 34f9a4b03b
Test our most recent branches with Nim 1.6 (#109)
The branch_override is no longer necessary, because our unstable and testing branches should be building fine with Nim 1.6
2022-06-14 15:23:52 +02:00
Jakub Sokołowski 2b57a4096e
add serial variable to playbooks
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-14 11:40:18 +02:00
Jakub Sokołowski 2dd96fdc36
drop giovanni from active users
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-14 10:12:01 +02:00
Etan Kissling f165e2ff52 disable light client data overrides
On `kiln`, `ropsten`, `prater`, `sepolia`, the BN code applies network
specific defaults `true` / `only-new`. `mainnet`: `false` / `none`.
This means that the overrides here are no longer needed, also avoiding
issues with planned renames of the parameters in the BN implementation.

Signed-off-by: Etan Kissling <etan@status.im>
2022-06-14 10:09:02 +02:00
narimiran bf1cc4a5a0 users: add miran 2022-06-10 15:33:19 +02:00
Jakub Sokołowski 427ef2a3c0
nimbus-geth-ropsten: add required engine API module
Without it the merge fails with:
```
{
  "lvl": "DBG",
  "ts": "2022-06-08 16:08:59.069+00:00",
  "msg": "{\"code\":-32601,\"message\":\"the method engine_newPayloadV1 does not exist/is not available\"}"
}
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-08 19:02:41 +02:00
Jakub Sokołowski fbc939aef1
nimbus.ropsten: move all validators to first node
We can't have multiple nodes controling a single Geth instance.
This will lead to unpredictable behavior on the execution layer.

https://github.com/status-im/infra-nimbus/issues/97

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-08 11:08:11 +02:00
Jakub Sokołowski c8fa895f98
get-geth-api-urls: query for OpenEthereum nodes too
https://github.com/status-im/infra-nimbus/issues/80

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-03 12:01:44 +02:00
Jakub Sokołowski f82df25498
nimbus.openeth: upgrade to 3.3.5, add metrics
https://github.com/status-im/infra-role-openethereum/commit/83996de8

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-03 10:53:36 +02:00
Jakub Sokołowski f615273cdc
nimbus.ropsten: lower TTD to 50000000000000000
"Here’s an update on the Ropsten TTD: we’ve chosen to use a value of
50000000000000000. At the current hash rate, it would hit in several
weeks. That said,  the EF will rent hash rate itself and work with
partners to accelerate things. With a modest increase in hash rate, we
should be able to make the Ropsten Merge happen on June 8/9.

If your
team is running any validators, please perform a TTD override to
50000000000000000 on them ASAP."

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-02 18:13:12 +02:00
Jakub Sokołowski 77695bd0ea
nimbus-geth-ropsten: set custom TTD for geth
https://hackmd.io/ngKLqVvvTTGZLj1bGPuCoA#Geth

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-02 10:51:27 +02:00
Jakub Sokołowski c474a3311d
logs.nimbus: leave memory for Lucene, use 32 GB heap
https://github.com/status-im/infra-nimbus/issues/96

"The moral of the story is this: even when you have memory to spare, try
to avoid crossing the 32 GB heap boundary. It wastes memory, reduces CPU
performance, and makes the GC struggle with large heaps."

https://www.elastic.co/guide/en/elasticsearch/guide/current/heap-sizing.html#compressed_oops
https://www.elastic.co/guide/en/elasticsearch/guide/current/heap-sizing.html#_give_less_than_half_your_memory_to_lucene

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-01 12:28:48 +02:00
Jakub Sokołowski 3366cd40ef
enable validator monitoring regardless of branch
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-01 11:51:14 +02:00
Jakub Sokołowski a670e46895
dash.nimbus: move nimbus-logs to our own SSL proxy
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-01 11:43:48 +02:00
Jakub Sokołowski 5e1af52f2d
logs.nimubs: move nimbus-es to our own SSL proxy
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-01 11:43:45 +02:00
Jakub Sokołowski f8b09ccd3c
dash.nimbus: upgrade kibana and ES to 7.17.4
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-01 11:40:19 +02:00
Artur Marud b1545a6662
nimbus.ropsten: Validators layout setup
Signed-off-by: Artur Marud <artur@status.im>
2022-05-26 19:11:55 +02:00
Jakub Sokołowski 11aa98adf1
requirements: fix dist-validators bug
Not fetching new changes from `nimbus-private` repo on Windows.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-05-26 13:13:07 +02:00
Jakub Sokołowski b10890920a
requirements: upgrade Geth to 1.10.18
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-05-26 00:58:01 +02:00
Artur Marud 7e19b3d93e
nimbus.ropsten: Initial beacon node setup
https://github.com/status-im/infra-nimbus/issues/97

- no validators have been deployed yet.

Signed-off-by: Artur Marud <artur@status.im>
2022-05-25 13:35:12 +02:00
Artur Marud fe9aed90a2
nimbus.geth: Opened firewall rpc port for ropsten
Signed-off-by: Artur Marud <artur@status.im>
2022-05-25 12:28:49 +02:00
Jakub Sokołowski 05214dc254
nimbus.ropsten: add metal-01.he-eu-hel1.nimbus.ropsten
Host for Nimbus nodes for new merge testnet called Ropsten:
https://github.com/status-im/infra-nimbus/issues/97

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-05-25 11:19:10 +02:00
Jakub Sokołowski 8c27671a95
nimbus.geth: bump Ropsten data volume to 250 GB
https://github.com/status-im/infra-nimbus/issues/97

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-05-24 18:23:47 +02:00
Jakub Sokołowski 6a2a801190
nimbus-geth-ropsten: switch Geth to snap sync
Full sync is just too slow and will not finish in time.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-05-24 11:16:23 +02:00
Jakub Sokołowski e163284f9b
nimbus.prater: fix port number for public API
Fixes:
http://unstable.prater.beacon-api.nimbus.team/eth/v1/node/version

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-05-23 14:00:55 +02:00
Jakub Sokołowski dcc11e0c87
nimbus-geth-ropsten: configure Geth instance
https://github.com/status-im/infra-nimbus/issues/97

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-05-20 20:16:42 +02:00
Jakub Sokołowski 94ffee2813
add ropsten-01.aws-eu-central-1a.nimbus.geth host
https://github.com/status-im/infra-nimbus/issues/97

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-05-20 20:16:10 +02:00
Jakub Sokołowski dcbc5f03c3
ansible/upgrade.yml: update to version from template
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-05-20 20:15:34 +02:00
Jakub Sokołowski f6c1529bea
nimbus.kiln: upgrade images and init JSON SHA256
The host was also reinstalled as it had weird networking issues.
It also had very flaky Geth nodes, which caused a lot of alerts.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-05-16 20:50:46 +02:00
Jakub Sokołowski bd87eacbc9
ansible.cfg: drop remote_user=admin from config
It made sense when there was only one admin.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-05-12 09:53:52 +02:00
Zahary Karadjov e6f2f3e010 Add another 10K prater validators
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-05-05 16:37:49 +02:00
Jakub Sokołowski 389e6dd432
nimbus.mainnet: fix number variable for metal-02
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-04-26 10:16:44 +04:00
Jakub Sokołowski ea49b47011
drop redundant --proposer-boosting-debug flag
https://github.com/status-im/infra-role-beacon-node-linux/commit/907ee4b6
https://github.com/status-im/infra-role-beacon-node-macos/commit/290984b3
https://github.com/status-im/infra-role-beacon-node-windows/commit/c2f22db0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-04-12 20:12:01 +02:00
Jakub Sokołowski f58a8506a9
nimbus.kiln: use new container built from master
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-04-12 19:25:55 +02:00
Jakub Sokołowski d231accd45
logs.nimbus: refactor OAuth container setup
This is to take into account changes made in:
https://github.com/status-im/infra-role-oauth-proxy/commit/4dd42c56

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-04-11 11:26:38 +02:00
Jakub Sokołowski 32835c38b4
ci-slave-metal: remove SSH access from Stefan
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-03-31 20:02:18 +02:00
Jakub Sokołowski 5bbc1458cf
expose API at unstable.kiln.beacon-api.nimbus.team
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-03-30 18:27:11 +02:00
Etan Kissling 79c5899f62 nimbus.prater: enable --*-light-client-data
Signed-off-by: Etan Kissling <etan@status.im>
2022-03-30 16:28:36 +02:00