status-im
/
infra-nimbus
mirror of https://github.com/status-im/infra-nimbus.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
972 Commits 10 Branches 0 Tags 31 MiB
Commit Graph

130 Commits

Author SHA1 Message Date
Jakub Sokołowski c48ac78797
nimbus.prater: use stable instead of unstable branch 
Avoid an RPC bug found in `unstable` for Dencun upgrade:
https://github.com/status-im/nimbus-eth2/issues/5753

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2024-01-16 09:27:44 +03:00
Alexis Pentori c7f77f5e32
nimbus.prater: switching MEV boots url. 
Removing invalid url. List of valid URL available at https://ethstaker.cc/mev-relay-list#mev-relay-list-for-goerli-testnet

Signed-off-by: Alexis Pentori <alexis@status.im>
 2024-01-03 16:28:08 +01:00
Jakub Sokołowski 7a239812ec
nimbus.prater: remove Erigon node to save disk space 
It was using 1.1 TB on `linux-05`, which is unreasonable.
And the network is deprecated anyway.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2024-01-02 13:22:54 +01:00
Jakub Sokołowski 9d99b031ac
nimbus.prater: reduce Consul alerts sensitivity 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-12-06 11:13:54 +01:00
Jakub Sokołowski 58cbfee30f
nimbus.prater: disable resyncing on all hosts 
It just causes unnecessary alerts for an obsolete network.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-11-27 11:45:16 +01:00
Jakub Sokołowski 2cac3081a0
layouts: add script and generate TSVs of validators 
Helps developers identify which host holds which validator.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-11-17 15:01:57 +01:00
Jakub Sokołowski 7272d55105
nimbus.prater: drop chronos and erigon from linux-06 
The host was overloaded and ran out of disk space on `/docker` volume.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-11-02 10:25:40 +01:00
Jakub Sokołowski a86a65c4bc
nimbus.prater: disable log aggregation for the fleet 
Zahary agreed that we need to start phasing out use of Prater.
This also helps us avoid paying extra for 10 Gbps link for aggr host.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-10-23 13:02:39 +02:00
Jakub Sokołowski 874771e109
nimbus.prater: fix port clash between Erigon and Geth 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-10-09 11:15:32 +02:00
Alexis Pentori 73184446d6
nimbus.parter: removing ephemeral debug option 
Signed-off-by: Alexis Pentori <alexis@status.im>
 2023-09-15 14:37:39 +02:00
Jakub Sokołowski a658d312a8
nimbus.prater: add stable node to macm1-01 host 
https://github.com/status-im/infra-nimbus/issues/132

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-09-06 10:19:21 +02:00
Jakub Sokołowski 227206c82d
nimbus.prater: move validators to macm1-01 
https://github.com/status-im/infra-nimbus/issues/132

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-09-06 10:18:44 +02:00
Jakub Sokołowski a823709dfe
add macm1-01.ih-eu-mda1.nimbus.prater host 
Replacement for `macos-01.ms-eu-dublin.nimbus.prater`.

https://github.com/status-im/infra-nimbus/issues/132

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-08-18 21:46:25 +02:00
Jakub Sokołowski 2a99b6ab43
nimbus.prater: add Nethermind node on linux-04 
https://github.com/status-im/infra-eth2/issues/11

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-08-17 13:26:08 +02:00
Jakub Sokołowski c662e92d51
nimbus.prater: configure Nethermind metrics endpoint 
https://github.com/status-im/infra-eth2/issues/11

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-08-17 13:05:28 +02:00
Jakub Sokołowski 8b6a22110a
nimbus.prater: open ports for Nethermind EL node 
https://github.com/status-im/infra-eth2/issues/11

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-08-11 14:21:19 +02:00
Jakub Sokołowski 1e24f891fe
nimbus.prater: add DNS discovery entry for nethermind 
https://github.com/status-im/infra-eth2/issues/11

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-08-11 14:20:34 +02:00
Jakub Sokołowski 600c6b02df
nimbus.prater: add chronos node on linux-06 host 
For Eugene for tracking regressions in chronos library.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-08-08 15:54:11 +02:00
Jakub Sokołowski 8d5d8a3935
refactor handling of long libp2p branch name 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-08-08 15:22:03 +02:00
Jakub Sokołowski 5344827479
nimbus.prater: deploy Nethermind node on linux-02 
Part of work to use Nethermind for eth2.prod fleet:
https://github.com/status-im/infra-eth2/issues/11

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-08-07 23:05:33 +02:00
Jakub Sokołowski 5586db729d
nimbus.prater: reduce max_headers_size to 128 KB 
Probably the reason for elevated memory usage when using Validator
Client with large number of validators attached.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-08-07 14:54:07 +02:00
Jakub Sokołowski f304db1cc0
nimbus.prater: bump Eirgon memory limit to 15% 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-07-16 10:18:40 +02:00
Jakub Sokołowski 7dff81fb2f
add windows-01.ih-eu-mda1.nimbus.prater host 
https://github.com/status-im/infra-nimbus/issues/132

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-07-07 12:17:33 +02:00
Jakub Sokołowski cec778f4f1
nimbus.prater: debug flag for old attestation stability 
As requested by Dustin.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-07-06 08:32:54 +02:00
Jakub Sokołowski 9455a6a5ae
nimbus.prater: drop nim_commit=version-1-6 flag 
It no longer has any effect.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-07-06 08:29:09 +02:00
Jakub Sokołowski 44d77c54f4
nimbus.prater: move validators from Hetzner hosts 
The InnovaHosting servers are almost fully synced, time to move.
https://github.com/status-im/infra-nimbus/issues/132

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-07-06 08:29:08 +02:00
Jakub Sokołowski 052a8485aa
nimubs.prater: add 4 new hosts from InnovaHosting 
https://github.com/status-im/infra-nimbus/issues/132

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-06-22 20:44:31 +02:00
Jakub Sokołowski 766092f537
nimbus.prater: fix validator monitor details condition 
It was causing very high cardinality due to lots of validators.
Crashed our Hetzner metrics server.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-06-22 12:07:16 +02:00
Jakub Sokołowski 7d9ebb1744
nimbus.prater: double beacon node open files limit 
Causes issues with metrics responses due to inability to open more files.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-06-22 09:31:22 +02:00
Jakub Sokołowski 6f0ff4ad19
nimbus.prater: run only two nodes on MacOS host 
Not enough disk space for 3 nodes.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-06-20 19:47:20 +02:00
Jakub Sokołowski 1aa507c359
prater: move validators to new linux-01 and linux-02 
https://github.com/status-im/infra-nimbus/issues/132

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-06-16 12:57:24 +02:00
Jakub Sokołowski 43b238c87e
nimbus.all: use new --validator-monitor-details flag 
Replaced `--validator-monitor-totals` in:
https://github.com/status-im/nimbus-eth2/pull/4468

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-06-07 19:04:37 +02:00
Jakub Sokołowski 6ae7dc00f0
nimbus.prater: add Innova host config 
https://github.com/status-im/infra-nimbus/issues/132

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-06-02 10:35:18 +02:00
Jakub Sokołowski 948b5885fe
nimbus.prater: move disabling discovery to Hetzner group 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-05-29 21:20:03 +02:00
Jakub Sokołowski e9a05d73ab
nimbus.prater: add DNS discovery for Erigon 
Necessary because we disable normal discovery.

Source:
https://github.com/ethereum/discv4-dns-lists

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-05-29 21:03:53 +02:00
Jakub Sokołowski a8741b7019
nimbus.prater: , disable discovery for Erigon 
It appears peer discovery can be detected by hetzner as an attempt at
network scanning:
https://github.com/ledgerwatch/erigon/issues/7234

Which can lead to the server being shut down.
For this reason I'm lowering max peers and disabling discovery.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-05-29 20:06:58 +02:00
Jakub Sokołowski 3f3d763990
nimbus.prater: double nofile limit to 32768 
Which needs to be more than 4 x 7899 validators.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-05-29 18:36:09 +02:00
Jakub Sokołowski 0256a21dd0
nimbus.mainnet: add two more hosts from Innova 
The `linux-06` is a new host, while `linux-07` is re-purposed `linux-01`
from the prater fleet. This is done because the Innova company is out of
Xeon E5-2690 CPUs, and we want consistent performance across the fleet.

This way all seven hosts in `nimbus.mainnet` will use the E5-2690 CPU.

https://github.com/status-im/infra-nimbus/issues/132

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-05-09 15:07:22 +02:00
Jakub Sokołowski d6de0faf1a
nimbus.prater: open Erigon metrics port on VPN 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-03-23 15:14:38 +01:00
Jakub Sokołowski 0956c88d9a
nimbus.prater: enable metrics for Erigon nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-03-22 13:47:15 +01:00
Jakub Sokołowski 9aa83f8d47
nimbus.prater: use Erigon EL node if available 
Beginning of work on testing multi-EL node setup:
https://github.com/status-im/infra-nimbus/issues/144

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-03-22 12:10:34 +01:00
Jakub Sokołowski cdf362f2a9
nimbus.prater: provide private key for mining 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-03-21 13:07:23 +01:00
Jakub Sokołowski f92bcb2802
nimbus.prater: fix erigon metrics port conflict 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-03-21 13:07:13 +01:00
Jakub Sokołowski 4a5b7d7107
nimbus.prater: deploy two Erigon nodes 
Part of work to support multiple EL nodes driven by one CL node:
https://github.com/status-im/infra-nimbus/issues/144

Disabled Geth websocket as unused and conflicting with Erigon.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-03-20 22:27:50 +01:00
Jakub Sokołowski 4ea58aeda7
deploy SMART metrics to all metal hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-03-18 18:02:58 +01:00
Jakub Sokołowski e1e21119da
use new exec layer variables for beacon nodes 
Role changes:
- https://github.com/status-im/infra-role-beacon-node-linux/commit/99a445d1
- https://github.com/status-im/infra-role-beacon-node-macos/commit/eecf9fea
- https://github.com/status-im/infra-role-beacon-node-windows/commit/dba21b36

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-03-16 00:59:48 +01:00
Jakub Sokołowski 768ecef371
nimbus.prater: use AWS hosts to sync first node 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-03-02 12:22:45 +01:00
Jakub Sokołowski 4e20fd2c14
nimbus.prater: use a new set of MEV boost URLs 
The one from `flashbots.net` seems to have connectivity issues:
```
REST request was interrupted
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-02-24 13:16:06 +01:00
Jakub Sokołowski 15d96ca3be
nimbus.mainnet/prater: use more threads than 1 
This setting is quite old and it's time to use more than one thread.
The `libp2p` branch is the exception that will keep using 1 thread.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-02-24 11:37:17 +01:00
Jakub Sokołowski 3e3cff6840
nimbus.mainnet/prater: enable pruned history 
For most nodes this is fine, except for nodes with publicly exposed API,
which we should keep as synced from genesis and in archive mode.

Every other node is fine being prunned. I'm keeping AWS nodes not pruned
as fallback since increasing their storage is quick and easy.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-02-21 22:52:41 +01:00