status-im
/
infra-nimbus
mirror of https://github.com/status-im/infra-nimbus.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
917 Commits 10 Branches 0 Tags 31 MiB
Commit Graph

438 Commits

Author SHA1 Message Date
Zahary Karadjov 01b6f0b6c7
Enable payload builder on 06-prater-unstable 2022-11-30 13:44:27 +02:00
Zahary Karadjov 3f94bbfc0f
Configure the --suggested-fee-recipient option for BNs and VCs across the fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-11-30 10:49:23 +01:00
Jakub Sokołowski 86a5a83c99
nimbus.mainnet: use unstable ncli_db for ERA files 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-11-30 10:46:37 +01:00
Zahary Karadjov 2fba850aca
Enable the VC payload builder on linux-06's testing intance 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-11-24 14:16:22 +01:00
Jakub Sokołowski 8d25970d54
nimbus.prater: use unstable ncli_db to include fixes 
Specifically fixes for ERA file validating and naming.
https://github.com/status-im/nimbus-eth2/pull/4351

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-11-24 13:53:20 +01:00
Jakub Sokołowski fff4ae5c0a
nimbus.prater: enable nimbus-era-files role 
Necessary to generate ERA files for hosting.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-11-08 17:56:03 +01:00
Jakub Sokołowski 7f7e234f36
nimbus.prater: bump header body and header limits 
Necessary to accomodate large number of validators handled by the
validator client node.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-28 17:00:35 +02:00
Jakub Sokołowski 063a3b7c05
nimbus.prater: bump VC log level to DEBUG 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-28 17:00:22 +02:00
Jakub Sokołowski 26f0db1807
nimbus.prater: enable VC for linux-06 libp2p node 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-28 10:20:39 +02:00
Jakub Sokołowski 8f326fdf2a
logs.nimbus: open ES API port for Logstash hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-27 16:33:37 +02:00
Jakub Sokołowski 7e4f19b453
nimbus.prater: adjust validators count on last host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-26 11:15:50 +02:00
Jakub Sokołowski 2320bfd74a
nimbus.prater: open geth exporter ports 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-25 21:11:47 +02:00
Jakub Sokołowski 4d43415e61
nimbus.ropsten: open geth exporter ports 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-25 21:11:46 +02:00
Jakub Sokołowski c696c70cfc
nimbus.prater: fix beacon node validator distribution 
Missing part that already exists for Sepolia and Ropstne.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-25 18:19:23 +02:00
Jakub Sokołowski baf158e399
nimbus.prater: drop index from validator client name 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-24 18:23:55 +02:00
Jakub Sokołowski cf8bab14ab
nimbus.prater: use VC for unstable node on linux-03 
https://github.com/status-im/infra-nimbus/issues/122

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-24 16:09:42 +02:00
Jakub Sokołowski 439d07db86
nimbus.ropsten: reduce REST headers and body size 
This was a fix for very large URL arguments caused by large number of
validators applied to the connected validator client.
Unfortunately the values used were in bytes and not kilobytes.
In result we got unnecessarily high memory usage.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-22 12:33:23 +02:00
Jakub Sokołowski 83073a7567
nimbus.mainnet: deploy libp2p nodes to metal-07 
Because `libp2p` nodes take up space on 05 and 06.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-19 12:16:50 +02:00
Jakub Sokołowski c610692511
set explicit but wider values for websocket origins 
Possible fix for `nim-waku` and `geth` connectivity issues:
https://github.com/status-im/nwaku/issues/1269

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-17 19:17:03 +02:00
Jakub Sokołowski d63bd18938
give SSH access to p1ge0nh8er and s1fr0 
For debugging issues with Geth Websocket port for Nim-Waku.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-14 15:54:55 +02:00
Jakub Sokołowski 4017674931
add systemd-journal groups to all users by default 
https://github.com/status-im/infra-role-bootstrap-linux/commit/d85963fa

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-14 15:01:31 +02:00
Jakub Sokołowski c8e3232dff
nimbus-era-files: use --network flag to fix errors 
Changes to default runtime config have caused errors like this:
```
FAT Could not load head state, database corrupt? tid=3639597 file=blockchain_dag.nim:920 head=e7d4f3b7:4636671 tail=4d611d5b:0 genesis=4d611d5b:0
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-12 09:30:46 +02:00
Jakub Sokołowski 5de206719e
nimbus.prater: temporary fix for buggy doppelganger 
https://github.com/status-im/infra-nimbus/issues/122

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-11 14:23:29 +02:00
Jakub Sokołowski 269a76a23e
nimbus.prater: deploy validator client to linux-04 
https://github.com/status-im/infra-nimbus/issues/122

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-11 13:39:59 +02:00
Jakub Sokołowski b5a6665de3
nimbus.ropsten: drop TTD config from extra flags 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-05 15:18:29 +02:00
Jakub Sokołowski 1773ffb439
nimbus.prater: payload builder on unstable-large-01 
https://github.com/status-im/infra-nimbus/issues/128

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-29 15:03:34 +02:00
Jakub Sokołowski 759b3c8bf3
nimbus.prater: enable full light client data 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-28 15:24:36 +02:00
Jakub Sokołowski 7da6edf144
nimbus.sepolia: add validator client service 
For now only for the first node.
https://github.com/status-im/infra-nimbus/issues/122

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-28 02:23:12 +02:00
Jakub Sokołowski e966bb1a59
nimbus.mainnet: fix web3 url conditional 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-27 19:27:52 +02:00
Zahary Karadjov 4e477b0c2f
nimbus.mainnet: enable full light client data 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-27 11:41:01 +02:00
Jakub Sokołowski 89f04d8aa4
nimbus.ropsten: use less validators on VC nodes 
We want to test with lower numbers of validators first.

https://github.com/status-im/infra-nimbus/issues/122

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-23 17:01:48 +02:00
Jakub Sokołowski 23c07e3dbf
nimbus.ropsten: lower geth memory limits 
It seems to be hogging far too much memory.

https://github.com/status-im/infra-nimbus/issues/122

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-23 17:01:13 +02:00
Jakub Sokołowski 7d05abad43
nimbus.ropsten: initial setup of validator clients 
https://github.com/status-im/infra-nimbus/issues/122

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-23 14:02:08 +02:00
Jakub Sokołowski 781c6650b7
nimbus.eth1: update rocketpool configuration 
Add missing fee recipient address.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-22 14:57:58 +02:00
Jakub Sokołowski 1f54ea1fd4
nimbus.prater: open websocket port to other hosts 
https://github.com/status-im/infra-nim-waku/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-21 12:39:19 +02:00
Jakub Sokołowski fa3bb88648
nimbus.prater: open websocket port for wakuv2.test 
https://github.com/status-im/infra-nim-waku/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-21 12:24:55 +02:00
Jakub Sokołowski 414923bfbe
nimbus.prater: open Geth RPC ports for wakuv2 fleets 
https://github.com/status-im/infra-nim-waku/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-19 19:52:31 +02:00
Jakub Sokołowski c1c261a083
nimbus.ropsten: use authrpc port with beacon nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-19 15:27:50 +02:00
Jakub Sokołowski fc23654e8a
nimbus.mainnet: use local Geth nodes for metal hosts 
https://github.com/status-im/infra-nimbus/issues/127

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-15 14:31:04 +02:00
Jakub Sokołowski a0d1d97e0e
nimbus.kiln: drop Kiln testnet network entirely 
Has been discontinued effective on 2022/09/12:
https://blog.ethereum.org/2022/09/09/kiln-shutdown

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-14 17:33:38 +02:00
Jakub Sokołowski 23a91206c1
nimbus.mainnet: open ports for Geth exporter 
https://github.com/status-im/infra-nimbus/issues/127

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-14 15:34:23 +02:00
Jakub Sokołowski b4066e7386
nimbus.mainnet: deploy one Geth node on metal hosts 
https://github.com/status-im/infra-nimbus/issues/127

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-14 15:24:15 +02:00
Jakub Sokołowski 98b38cbf96
nimbus.mainnet: mount new NVMe volumes at /docker 
https://github.com/status-im/infra-nimbus/issues/127

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-14 15:16:37 +02:00
Jakub Sokołowski b1933c0946
nimbus.prater: add suggested fee recipient 
Account details will be available in Nimbus private docs:
https://github.com/status-im/nimbus-private/blob/master/testnets-maintenance.md#goerli-account

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-14 13:35:15 +02:00
Jakub Sokołowski d26521d9ab
nimbus.prater: lower Geth memory limit to 15% 
Geth loves memory, and eats up as much as it can.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-08 14:11:38 +02:00
Jakub Sokołowski 9481622372
drop goerli-01.aws-eu-central-1a.nimbus.geth host 
No longer necessary after dedicated metal hosts were deployed:
https://github.com/status-im/infra-nimbus/issues/125

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-08 13:32:28 +02:00
Jakub Sokołowski e80d5943d1
nimbus.prater: use EL clients from new Geth hosts 
https://github.com/status-im/infra-nimbus/issues/125

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-07 13:48:20 +02:00
Jakub Sokołowski 96a9843b21
nimbus-geth-goerli: one group_vars file to all hosts 
https://github.com/status-im/infra-nimbus/issues/125

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-07 13:27:18 +02:00
Jakub Sokołowski cb448d64f3
nimbus-prater-windows: deploy dedicated Geth nodes 
https://github.com/status-im/infra-nimbus/issues/125

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-09-06 19:26:25 +02:00
Jakub Sokołowski 8766336641
nimbus.prater: deploy Geth nodes on new hosts 
https://github.com/status-im/infra-nimbus/issues/125

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-31 19:57:27 +02:00
Jakub Sokołowski 4d5197c728
nimbus-openeth: OpenEth has been discontinued 
The repo has been archived and receives no updates:
https://github.com/openethereum/openethereum

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-30 10:48:54 +02:00
Jakub Sokołowski 207064c5d6
nimbus.mainnet: fix syncing using ERA files 
https://github.com/status-im/infra-nimbus/issues/98

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-29 13:08:06 +02:00
Jakub Sokołowski cca16d27c5
nimbus.prater: enable payload builder for two nodes 
https://github.com/status-im/infra-nimbus/issues/124

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-23 15:29:40 +02:00
Jakub Sokołowski 33f376cc3d
nimbus.mainnet: resync monthly and add 7 days delay 
To avoid resyncing multiple nodes at the same time.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-22 10:54:10 +02:00
Jakub Sokołowski f8c262dfb4
nimbus.mainnet: enable creating resync timer jobs 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-18 09:04:38 +02:00
Jakub Sokołowski 7ec7641eed
nimbus.prater: open REST API ports to the fleet 
Allows for trusted node syncing through the VPN.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-16 18:02:19 +02:00
Jakub Sokołowski 4fe3a607fe
nimbus.mainnet: open REST port to access via VPN 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-13 11:42:41 +02:00
Jakub Sokołowski 7d0029b9e2
drop unused ropsten-01.aws-eu-central-1a.nimbus.geth 
https://github.com/status-im/infra-nimbus/issues/117

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-12 10:53:47 +02:00
Jakub Sokołowski 823196a0d9
use Geth Auth RPC endpoints for Engine API 
Needs JWT secrets configured and changes to Consul queries.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-11 19:23:41 +02:00
Jakub Sokołowski 9d8e55dd55
nimbus-geth: configure Auth RPC ports for Engine API 
This is required for communication with consensus layer nodes:
https://geth.ethereum.org/docs/interface/consensus-clients

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-11 13:06:37 +02:00
Jakub Sokołowski 30ed658621
grant SSH access to etan@status.im 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-11 13:06:36 +02:00
Jakub Sokołowski e3c203c815
nimbus.mainnet: enable purging DB for even nodes 
https://github.com/status-im/infra-nimbus/issues/98

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-10 22:34:21 +02:00
Jakub Sokołowski 1ffc159f70
use idx instead of port_offset loop_var name 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-10 16:55:01 +02:00
Jakub Sokołowski b4b97d9338
nimbus.ropsten: spread validators between all nodes 
https://github.com/status-im/infra-nimbus/issues/117

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-08 13:03:31 +02:00
Jakub Sokołowski 470f24cf5c
nimbus.mainnet: fix location of node DB folder 
We've gotten rid of the `shared_{network}_0` subfolder:
https://github.com/status-im/infra-role-beacon-node-linux/commit/f4259bdf

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-08 11:37:46 +02:00
Jakub Sokołowski e8eded758c
nimbus.mainnet: enable ERA folder symlinking 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-08 10:32:48 +02:00
Artur Marud b3e6e3f972
ropsten: create multi-geth config (#120) 
* ropsten: create multi-geth config

Related: https://github.com/status-im/infra-nimbus/issues/117

Signed-off-by: Artur Marud <artur@status.im>
 2022-07-22 14:24:00 +02:00
Jakub Sokołowski da363b1a23
nimbus-era-files: make timer optional 
AWS hosts have just one node, so there's no need for ERA files generation.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-20 15:17:18 +02:00
Artur Marud fb67e2fe16
ropsten: added new disk configuration for ropsten hetzner host (#119) 
Signed-off-by: Artur Marud <artur@status.im>
 2022-07-19 21:34:20 +02:00
Jakub Sokołowski a6bc25ebd3
logs.nimbus: drop ElasticHQ in favor of ES Comrade 
https://github.com/status-im/infra-hq/issues/82

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-14 20:31:24 +02:00
Jakub Sokołowski 472a379a9a
dash.nimbus: fix LB variable typos 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-14 16:51:20 +02:00
Jakub Sokołowski 3cc72b68e9
nimbus.mainnet: deploy nimbus-era-files to metal hosts 
https://github.com/status-im/infra-nimbus/issues/98

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-14 01:00:29 +02:00
Jakub Sokołowski 07d561b62a
logs.nimbus: fix firewall rules for logs.hq fleet 
https://github.com/status-im/infra-hq/issues/80

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-11 17:42:50 +02:00
Jakub Sokołowski 4e0db40fb4
requirements: upgrade Geth to 1.10.20 
https://github.com/ethereum/go-ethereum/releases/tag/v1.10.20

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-05 18:50:55 +02:00
Miran 2b079f1774
fix various typos in comments and roles 2022-07-04 15:07:55 +02:00
Jakub Sokołowski 6702c50f38
bootstrap: give miran sudo permissions 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-04 09:32:53 +02:00
zah 4147d511ba
Enable websock on some servers; Use the typical branches for Sepolia (#113) 2022-07-01 14:15:11 +02:00
Artur Marud f129dc6a3b
prater: continued nim-1.6 rollout 
Signed-off-by: Artur Marud <artur@status.im>
 2022-06-28 19:12:24 +02:00
Jakub Sokołowski 558e226afb
nimbus-geth-mainnet: open API for eth2.prod fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-28 19:04:24 +02:00
zah 6ae39ddd3d
Use Nim 1.6 on metal-05's libp2p instance (#112) 2022-06-22 11:39:15 +02:00
Artur Marud e43c8af2b7
infra-nimbus: go-eth upgrade to 1.10.19 for ropsten, kiln and sepolia 
* major changes - correct TTD for reopsten by default

Signed-off-by: Artur Marud <artur@status.im>
 2022-06-15 17:02:34 +02:00
Artur Marud 9ebf3cba2d
Sepolia (#110) 
* infra-nimbus: new testnet - sepolia

Signed-off-by: Artur Marud <artur@status.im>
 2022-06-15 15:03:58 +02:00
zah 34f9a4b03b
Test our most recent branches with Nim 1.6 (#109) 
The branch_override is no longer necessary, because our unstable and testing branches should be building fine with Nim 1.6
 2022-06-14 15:23:52 +02:00
Jakub Sokołowski 2dd96fdc36
drop giovanni from active users 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-14 10:12:01 +02:00
Etan Kissling f165e2ff52 disable light client data overrides 
On `kiln`, `ropsten`, `prater`, `sepolia`, the BN code applies network
specific defaults `true` / `only-new`. `mainnet`: `false` / `none`.
This means that the overrides here are no longer needed, also avoiding
issues with planned renames of the parameters in the BN implementation.

Signed-off-by: Etan Kissling <etan@status.im>
 2022-06-14 10:09:02 +02:00
narimiran bf1cc4a5a0 users: add miran 2022-06-10 15:33:19 +02:00
Jakub Sokołowski 427ef2a3c0
nimbus-geth-ropsten: add required engine API module 
Without it the merge fails with:
```
{
  "lvl": "DBG",
  "ts": "2022-06-08 16:08:59.069+00:00",
  "msg": "{\"code\":-32601,\"message\":\"the method engine_newPayloadV1 does not exist/is not available\"}"
}
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-08 19:02:41 +02:00
Jakub Sokołowski fbc939aef1
nimbus.ropsten: move all validators to first node 
We can't have multiple nodes controling a single Geth instance.
This will lead to unpredictable behavior on the execution layer.

https://github.com/status-im/infra-nimbus/issues/97

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-08 11:08:11 +02:00
Jakub Sokołowski f615273cdc
nimbus.ropsten: lower TTD to 50000000000000000 
"Here’s an update on the Ropsten TTD: we’ve chosen to use a value of
50000000000000000. At the current hash rate, it would hit in several
weeks. That said,  the EF will rent hash rate itself and work with
partners to accelerate things. With a modest increase in hash rate, we
should be able to make the Ropsten Merge happen on June 8/9.

If your
team is running any validators, please perform a TTD override to
50000000000000000 on them ASAP."

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-02 18:13:12 +02:00
Jakub Sokołowski 77695bd0ea
nimbus-geth-ropsten: set custom TTD for geth 
https://hackmd.io/ngKLqVvvTTGZLj1bGPuCoA#Geth

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-02 10:51:27 +02:00
Jakub Sokołowski c474a3311d
logs.nimbus: leave memory for Lucene, use 32 GB heap 
https://github.com/status-im/infra-nimbus/issues/96

"The moral of the story is this: even when you have memory to spare, try
to avoid crossing the 32 GB heap boundary. It wastes memory, reduces CPU
performance, and makes the GC struggle with large heaps."

https://www.elastic.co/guide/en/elasticsearch/guide/current/heap-sizing.html#compressed_oops
https://www.elastic.co/guide/en/elasticsearch/guide/current/heap-sizing.html#_give_less_than_half_your_memory_to_lucene

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 12:28:48 +02:00
Jakub Sokołowski 3366cd40ef
enable validator monitoring regardless of branch 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 11:51:14 +02:00
Jakub Sokołowski a670e46895
dash.nimbus: move nimbus-logs to our own SSL proxy 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 11:43:48 +02:00
Jakub Sokołowski 5e1af52f2d
logs.nimubs: move nimbus-es to our own SSL proxy 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 11:43:45 +02:00
Jakub Sokołowski f8b09ccd3c
dash.nimbus: upgrade kibana and ES to 7.17.4 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 11:40:19 +02:00
Artur Marud b1545a6662
nimbus.ropsten: Validators layout setup 
Signed-off-by: Artur Marud <artur@status.im>
 2022-05-26 19:11:55 +02:00
Artur Marud 7e19b3d93e
nimbus.ropsten: Initial beacon node setup 
https://github.com/status-im/infra-nimbus/issues/97

- no validators have been deployed yet.

Signed-off-by: Artur Marud <artur@status.im>
 2022-05-25 13:35:12 +02:00
Artur Marud fe9aed90a2
nimbus.geth: Opened firewall rpc port for ropsten 
Signed-off-by: Artur Marud <artur@status.im>
 2022-05-25 12:28:49 +02:00
Jakub Sokołowski 6a2a801190
nimbus-geth-ropsten: switch Geth to snap sync 
Full sync is just too slow and will not finish in time.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-24 11:16:23 +02:00
Jakub Sokołowski dcc11e0c87
nimbus-geth-ropsten: configure Geth instance 
https://github.com/status-im/infra-nimbus/issues/97

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-20 20:16:42 +02:00
Jakub Sokołowski f6c1529bea
nimbus.kiln: upgrade images and init JSON SHA256 
The host was also reinstalled as it had weird networking issues.
It also had very flaky Geth nodes, which caused a lot of alerts.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-16 20:50:46 +02:00
Zahary Karadjov e6f2f3e010 Add another 10K prater validators 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-05 16:37:49 +02:00
Jakub Sokołowski 389e6dd432
nimbus.mainnet: fix number variable for metal-02 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-04-26 10:16:44 +04:00
Jakub Sokołowski ea49b47011
drop redundant --proposer-boosting-debug flag 
https://github.com/status-im/infra-role-beacon-node-linux/commit/907ee4b6
https://github.com/status-im/infra-role-beacon-node-macos/commit/290984b3
https://github.com/status-im/infra-role-beacon-node-windows/commit/c2f22db0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-04-12 20:12:01 +02:00
Jakub Sokołowski f58a8506a9
nimbus.kiln: use new container built from master 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-04-12 19:25:55 +02:00
Jakub Sokołowski d231accd45
logs.nimbus: refactor OAuth container setup 
This is to take into account changes made in:
https://github.com/status-im/infra-role-oauth-proxy/commit/4dd42c56

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-04-11 11:26:38 +02:00
Jakub Sokołowski 32835c38b4
ci-slave-metal: remove SSH access from Stefan 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-31 20:02:18 +02:00
Jakub Sokołowski 5bbc1458cf
expose API at unstable.kiln.beacon-api.nimbus.team 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-30 18:27:11 +02:00
Etan Kissling 79c5899f62 nimbus.prater: enable --*-light-client-data 
Signed-off-by: Etan Kissling <etan@status.im>
 2022-03-30 16:28:36 +02:00
Jakub Sokołowski 50fa1be86f
enable proposer boosting for all nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-30 13:07:23 +02:00
Jakub Sokołowski 6e79a6df06
dash.nimbus: lower ES indice clean up to 14 days 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-29 21:39:42 +02:00
Etan Kissling 91cc24b228 nimbus.kiln: enable --*-light-client-data 
Signed-off-by: Etan Kissling <etan@status.im>
 2022-03-28 18:17:44 +02:00
Jakub Sokołowski c85d852e9c
drop config for nimbus.pyrmont fleet 
The testnet has been discontinued.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-26 10:36:56 +01:00
Etan Kissling c0630aeb00 nimbus: mark branches supporting BN light client data 
Signed-off-by: Etan Kissling <etan@status.im>
 2022-03-25 17:31:22 +01:00
Jakub Sokołowski 70bf75d1de
drop deprecated JSON-RPC API port from all nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-22 18:58:19 +01:00
Jakub Sokołowski 45d7608040
nimbus.mainnet: enable proposer boosting for unstable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-22 11:40:44 +01:00
Jakub Sokołowski 3266a65a83
nimbus.fluffy: use first two nodes as bootstrap nodes 
https://github.com/status-im/infra-nimbus/issues/87

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-16 11:50:17 +01:00
Jakub Sokołowski 71a0430e1c
nimbus.fluffy: add loop_var, include consul fixes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-16 00:59:01 +01:00
Jakub Sokołowski d33ec7037e
nimbus.kiln: enable --proposer-boosting-debug 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 19:10:38 +01:00
Jakub Sokołowski 38b16053cf
nimbus.kiln: add validators layout for testnet 
https://github.com/status-im/nimbus-private/commit/e963d195
https://github.com/status-im/nimbus-private/tree/master/kiln_deposits

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 16:54:32 +01:00
Jakub Sokołowski 0d5ef90cd2
nimbus.kiln: configure beacon nodes without validators 
https://github.com/status-im/infra-nimbus/issues/88

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 15:40:21 +01:00
Jakub Sokołowski a4e54f2c5e
nimbus.kiln: update Geth bootstrap nodes list 
Based on this recent PR:
https://github.com/eth-clients/merge-testnets/pull/6

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 15:38:42 +01:00
Jakub Sokołowski 69469913fb
nimbus.kiln: configure four Geth containers 
- https://github.com/status-im/infra-nimbus/issues/88
- https://config.kiln.themerge.dev/el/bootnodes
- https://config.kiln.themerge.dev/el/genesis/geth.json
- https://kiln.themerge.dev/

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 12:29:27 +01:00
Jakub Sokołowski 968c174ba0
bootstrap: add extra IP to SSHGuard whitelist 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 11:45:07 +01:00
Jakub Sokołowski dd43e135a5
move metal-07.he-eu-hel1.nimbus.prater to nimbus.kiln 
Also move validators from it to `metal-06`.
https://github.com/status-im/infra-nimbus/issues/88

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-10 18:19:25 +01:00
Jakub Sokołowski f2777f6496
nimbus.fluffy: configure 32 nodes on each host 
https://github.com/status-im/infra-nimbus/issues/87

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-08 15:50:03 +01:00
Jakub Sokołowski 1b9d64e72f
enable --proposer-boosting-debug on testnet unstable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-07 12:53:23 +01:00
Jakub Sokołowski 89093c894a
logs.nimbus: firewall for ElasticSearch exporter port 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-03 18:23:13 +01:00
Jakub Sokołowski 6488efd4e9
nimbus-db-purge: deploy to two mainnet hosts 
https://github.com/status-im/infra-nimbus/issues/86

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-28 17:32:01 +01:00
Jakub Sokołowski c4436f71f4
drop windows-01.gc-us-central1-a.nimbus.prater 
Replaced by `windows-01.he-eu-hel1.nimbus.prater` due to disk space
constraints and high cost of Google Cloud host.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-28 13:14:04 +01:00
Jakub Sokołowski c0ab15c34f
mainnet.openeth: deploy OpenEthereum node to the host 
We need some variety and redundancy in how we sync Eth1:
https://github.com/status-im/infra-nimbus/issues/80

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-21 17:26:33 +01:00
Jakub Sokołowski 6940d0219c
drop libp2p node from macos host to save space 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 19:53:50 +01:00
Jakub Sokołowski 65304b6aaa new validator layout for prater fleet 
The `0/1/10/30/60/899/4000` layout will require 3 more hosts.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 19:41:07 +01:00
Jakub Sokołowski 3d4679f0d3
nimbus.prater: add nim_compiler overrides 
For some reason `nim-1.6` branch doesn't actually use Nim 1.6 compiler.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 14:24:37 +01:00
Jakub Sokołowski 01c6a06117
nimbus.prater: override some branches to nim-1.6 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 13:46:56 +01:00
Jakub Sokołowski d6414fd956
deploy nodes without validators to 3 new prater hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-16 17:19:23 +01:00
Jakub Sokołowski 84d2773a98
deploy nodes without validators to new prater hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-15 21:09:51 +01:00
Jakub Sokołowski ec65bac02a
nimbus.pyrmont: drop two nodes and move validators 
Two nodes will be reused in the Prater fleet.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-15 21:08:44 +01:00
Jakub Sokołowski 18eb46836e
logs.nimbus: use docker compose setup for elasticsearch 
https://github.com/status-im/infra-role-elasticsearch/commit/567f32ac

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-11 02:08:47 +01:00
Jakub Sokołowski 392d4124c5
dash.nimbus: bump limit of log indices back to 20 
Currently daily indices take up 10 GB per host, so it' fine.

https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-10 12:31:03 +01:00
Jakub Sokołowski 0398c31ad9
logs.nimbus: drop ES replicas down to 0 to save space 
https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-09 18:43:23 +01:00
Jakub Sokołowski fbb1ee69d9
consul: update token paths in BitWarden 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-09 00:24:07 +01:00
Jakub Sokołowski d74ff169ef
wireguard: bump role and add Consul ACL token 
Part of effort to lock down Consul ACLs:
https://github.com/status-im/infra-hq/issues/70

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-08 20:51:45 +01:00
Jakub Sokołowski cdf63cba43
consul: add mandatory agent ACL token 
https://github.com/status-im/infra-hq/issues/70

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-08 11:58:55 +01:00
Jakub Sokołowski fb7bde2377
dash.nimbus: lower indices kept to 10 
We have bigger log volume now that we fixed the logging setup in:
https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-07 15:07:55 +01:00
Jakub Sokołowski f665fcd8ce
rename logs-dash groups_vars to dash.nimbus 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-07 15:03:12 +01:00
Jakub Sokołowski ba2caedb64
logs.nimbus: bump JVM memory limits to 80% 
We started getting errors like:
```
Caused by: org.elasticsearch.common.breaker.CircuitBreakingException: [parent] Data too large, data for [internal:cluster/nodes/indices/shard/store[n]] would be [36997638608/34.4gb], which is larger than the limit of [36795685273/34.2gb], real usage: [36997638456/34.4gb], new bytes reserved: [152/152b], usages [request=0/0b, fielddata=0/0b, in_flight_requests=152/152b, model_inference=0/0b, eql_sequence=0/0b, accounting=3913236/3.7mb]
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-07 11:49:44 +01:00
Jakub Sokołowski ade0a50a53
logs.nimbus: migrate to Hetzner metal hosts 
For better performance, lower prices, and better network utilization.

https://github.com/status-im/infra-nimbus/issues/84

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-03 21:48:24 +01:00
Jakub Sokołowski a6d673366a
all: lowe logrotate count to 48, bump bootstrap 
Also remove `delaycompress` from logrotate config.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-31 17:09:28 +01:00
Jakub Sokołowski 2962ebbee0
disable use of HTTP Eth1 node endpoints 
Should fix issues with leaking file descriptors causing peer issues and
metrics endpoint timeouts.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-26 01:22:16 +01:00