status-im
/
infra-nimbus
mirror of https://github.com/status-im/infra-nimbus.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
538 Commits 10 Branches 0 Tags 31 MiB
Commit Graph

218 Commits

Author SHA1 Message Date
Jakub Sokołowski 0d5ef90cd2
nimbus.kiln: configure beacon nodes without validators 
https://github.com/status-im/infra-nimbus/issues/88

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 15:40:21 +01:00
Jakub Sokołowski a4e54f2c5e
nimbus.kiln: update Geth bootstrap nodes list 
Based on this recent PR:
https://github.com/eth-clients/merge-testnets/pull/6

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 15:38:42 +01:00
Jakub Sokołowski 69469913fb
nimbus.kiln: configure four Geth containers 
- https://github.com/status-im/infra-nimbus/issues/88
- https://config.kiln.themerge.dev/el/bootnodes
- https://config.kiln.themerge.dev/el/genesis/geth.json
- https://kiln.themerge.dev/

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 12:29:27 +01:00
Jakub Sokołowski 968c174ba0
bootstrap: add extra IP to SSHGuard whitelist 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 11:45:07 +01:00
Jakub Sokołowski dd43e135a5
move metal-07.he-eu-hel1.nimbus.prater to nimbus.kiln 
Also move validators from it to `metal-06`.
https://github.com/status-im/infra-nimbus/issues/88

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-10 18:19:25 +01:00
Jakub Sokołowski f2777f6496
nimbus.fluffy: configure 32 nodes on each host 
https://github.com/status-im/infra-nimbus/issues/87

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-08 15:50:03 +01:00
Jakub Sokołowski 1b9d64e72f
enable --proposer-boosting-debug on testnet unstable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-07 12:53:23 +01:00
Jakub Sokołowski 89093c894a
logs.nimbus: firewall for ElasticSearch exporter port 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-03 18:23:13 +01:00
Jakub Sokołowski 6488efd4e9
nimbus-db-purge: deploy to two mainnet hosts 
https://github.com/status-im/infra-nimbus/issues/86

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-28 17:32:01 +01:00
Jakub Sokołowski c4436f71f4
drop windows-01.gc-us-central1-a.nimbus.prater 
Replaced by `windows-01.he-eu-hel1.nimbus.prater` due to disk space
constraints and high cost of Google Cloud host.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-28 13:14:04 +01:00
Jakub Sokołowski c0ab15c34f
mainnet.openeth: deploy OpenEthereum node to the host 
We need some variety and redundancy in how we sync Eth1:
https://github.com/status-im/infra-nimbus/issues/80

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-21 17:26:33 +01:00
Jakub Sokołowski 6940d0219c
drop libp2p node from macos host to save space 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 19:53:50 +01:00
Jakub Sokołowski 65304b6aaa new validator layout for prater fleet 
The `0/1/10/30/60/899/4000` layout will require 3 more hosts.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 19:41:07 +01:00
Jakub Sokołowski 3d4679f0d3
nimbus.prater: add nim_compiler overrides 
For some reason `nim-1.6` branch doesn't actually use Nim 1.6 compiler.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 14:24:37 +01:00
Jakub Sokołowski 01c6a06117
nimbus.prater: override some branches to nim-1.6 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 13:46:56 +01:00
Jakub Sokołowski d6414fd956
deploy nodes without validators to 3 new prater hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-16 17:19:23 +01:00
Jakub Sokołowski 84d2773a98
deploy nodes without validators to new prater hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-15 21:09:51 +01:00
Jakub Sokołowski ec65bac02a
nimbus.pyrmont: drop two nodes and move validators 
Two nodes will be reused in the Prater fleet.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-15 21:08:44 +01:00
Jakub Sokołowski 18eb46836e
logs.nimbus: use docker compose setup for elasticsearch 
https://github.com/status-im/infra-role-elasticsearch/commit/567f32ac

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-11 02:08:47 +01:00
Jakub Sokołowski 392d4124c5
dash.nimbus: bump limit of log indices back to 20 
Currently daily indices take up 10 GB per host, so it' fine.

https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-10 12:31:03 +01:00
Jakub Sokołowski 0398c31ad9
logs.nimbus: drop ES replicas down to 0 to save space 
https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-09 18:43:23 +01:00
Jakub Sokołowski fbb1ee69d9
consul: update token paths in BitWarden 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-09 00:24:07 +01:00
Jakub Sokołowski d74ff169ef
wireguard: bump role and add Consul ACL token 
Part of effort to lock down Consul ACLs:
https://github.com/status-im/infra-hq/issues/70

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-08 20:51:45 +01:00
Jakub Sokołowski cdf63cba43
consul: add mandatory agent ACL token 
https://github.com/status-im/infra-hq/issues/70

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-08 11:58:55 +01:00
Jakub Sokołowski fb7bde2377
dash.nimbus: lower indices kept to 10 
We have bigger log volume now that we fixed the logging setup in:
https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-07 15:07:55 +01:00
Jakub Sokołowski f665fcd8ce
rename logs-dash groups_vars to dash.nimbus 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-07 15:03:12 +01:00
Jakub Sokołowski ba2caedb64
logs.nimbus: bump JVM memory limits to 80% 
We started getting errors like:
```
Caused by: org.elasticsearch.common.breaker.CircuitBreakingException: [parent] Data too large, data for [internal:cluster/nodes/indices/shard/store[n]] would be [36997638608/34.4gb], which is larger than the limit of [36795685273/34.2gb], real usage: [36997638456/34.4gb], new bytes reserved: [152/152b], usages [request=0/0b, fielddata=0/0b, in_flight_requests=152/152b, model_inference=0/0b, eql_sequence=0/0b, accounting=3913236/3.7mb]
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-07 11:49:44 +01:00
Jakub Sokołowski ade0a50a53
logs.nimbus: migrate to Hetzner metal hosts 
For better performance, lower prices, and better network utilization.

https://github.com/status-im/infra-nimbus/issues/84

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-03 21:48:24 +01:00
Jakub Sokołowski a6d673366a
all: lowe logrotate count to 48, bump bootstrap 
Also remove `delaycompress` from logrotate config.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-31 17:09:28 +01:00
Jakub Sokołowski 2962ebbee0
disable use of HTTP Eth1 node endpoints 
Should fix issues with leaking file descriptors causing peer issues and
metrics endpoint timeouts.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-26 01:22:16 +01:00
Jakub Sokołowski 9b54c84d96
enable validator monitoring flags for unstable nodes 
Once the next release is out we can drop the `unstable` conditionals.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-21 15:36:53 +01:00
Jakub Sokołowski e00443d6e2
nimbus.mainnet: drop libp2p-02 nodes to save space 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-13 14:16:41 +01:00
Jakub Sokołowski 667fd3184e
builds: add libp2p metrics flags 
This is done instead of this PR:
https://github.com/status-im/infra-role-beacon-node-linux/pull/3/files

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-05 19:38:23 +01:00
Jakub Sokołowski 237da365e7
bootstrap: add missing admin pass for macos hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-04 20:55:08 +01:00
Jakub Sokołowski 9c8b0f6185
users: give tanguy sudo permissions 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-04 15:35:30 +01:00
Jakub Sokołowski 462f373827
mainnet.geth: use snap sync method 
We had issues with mainnet node not fully syncing.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-18 18:06:59 +01:00
Jakub Sokołowski 5dae92080a
get-geth-api-urls: use HTTP RPC API for unstable only 
Current support for HTTP RPC API is not stable enough.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-03 19:40:52 +01:00
Jakub Sokołowski ce70b55014
prater-windows: disable windows defender 
Negatively impacts I/O performance, and we don't need it.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-25 20:00:52 +01:00
Jakub Sokołowski 5d5857928d
pyrmont: expose REST API at insecura.nimbus.team 
Inteded for tests of public insecure API access for Jacek.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-22 15:36:56 +01:00
Jakub Sokołowski 6c3384b8ba
ugprade Rocketpool to 1.0.0 
https://github.com/status-im/infra-rocketpool/issues/2

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-08 13:35:37 +01:00
Jakub Sokołowski f334b8917f
rocketpool: upgrade to v1.0.0-pre4 
https://github.com/status-im/infra-role-rocketpool/issues/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-03 14:02:57 +01:00
Jakub Sokołowski a4877e9b28
upgrade ELK stack to 7.14.2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-28 19:29:15 +02:00
Jakub Sokołowski edfcf0b621
nimbus.eth1: update rocketpool setup to new layout 
https://github.com/status-im/infra-rocketpool/issues/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-27 20:38:59 +02:00
Jakub Sokołowski 9fddf38791
geth: open mainnet ports for rocket.prod fleet 
https://github.com/status-im/infra-rocketpool/issues/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-26 15:37:00 +02:00
Jakub Sokołowski 6be2fc03e9
mainnet: add two libp2p nodes on 05 and 06 hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-25 14:30:22 +02:00
Jakub Sokołowski bcc297b796
prater: move libp2p nodes from AWS to Hetzner 
It will lower costs of Prater fleet. I've discussed this with Tanguy and
he's fine with it. I'm also addin two nodes without validators.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-25 12:58:59 +02:00
Jakub Sokołowski b5684f018e
drop prater 02 AWS nodes, rename stable one 
The renaming of:
`stable-large-01.aws-eu-central-1a.nimbus.prater`
to
`testing-large-01.aws-eu-central-1a.nimbus.prater`
Was done because the host was a Prater bootstrap node and it could not
be lost. The node key and the ports remained unchanged.

https://github.com/status-im/infra-nimbus/issues/60

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-22 18:23:22 +02:00
Jakub Sokołowski 961756674c
nimbus.prater: move validators to new MacOS host 
https://github.com/status-im/infra-nimbus/issues/60
https://github.com/status-im/infra-role-dist-validators/commit/f5e6c306

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-22 17:56:20 +02:00
Jakub Sokołowski 1dfba96dec
nimbus.eth1: sync goerli instad of mainnet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-14 13:05:29 +02:00
Jakub Sokołowski 7aa5d2d420
add all users to admin group on MacOS hosts 
This fixes SSH access issue, since only admin group members can have
remote access to the host:
https://www.vinnie.work/blog/2020-12-26-why-so-hard-osx-ssh-access/

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-13 13:34:56 +02:00