status-im
/
infra-nimbus
mirror of https://github.com/status-im/infra-nimbus.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
742 Commits 10 Branches 0 Tags 31 MiB
Commit Graph

742 Commits

Author SHA1 Message Date
Jakub Sokołowski 3266a65a83
nimbus.fluffy: use first two nodes as bootstrap nodes 
https://github.com/status-im/infra-nimbus/issues/87

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-16 11:50:17 +01:00
Jakub Sokołowski 71a0430e1c
nimbus.fluffy: add loop_var, include consul fixes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-16 00:59:01 +01:00
Jakub Sokołowski d33ec7037e
nimbus.kiln: enable --proposer-boosting-debug 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 19:10:38 +01:00
Jakub Sokołowski 38b16053cf
nimbus.kiln: add validators layout for testnet 
https://github.com/status-im/nimbus-private/commit/e963d195
https://github.com/status-im/nimbus-private/tree/master/kiln_deposits

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 16:54:32 +01:00
Jakub Sokołowski 0d5ef90cd2
nimbus.kiln: configure beacon nodes without validators 
https://github.com/status-im/infra-nimbus/issues/88

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 15:40:21 +01:00
Jakub Sokołowski a4e54f2c5e
nimbus.kiln: update Geth bootstrap nodes list 
Based on this recent PR:
https://github.com/eth-clients/merge-testnets/pull/6

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 15:38:42 +01:00
Jakub Sokołowski 69469913fb
nimbus.kiln: configure four Geth containers 
- https://github.com/status-im/infra-nimbus/issues/88
- https://config.kiln.themerge.dev/el/bootnodes
- https://config.kiln.themerge.dev/el/genesis/geth.json
- https://kiln.themerge.dev/

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 12:29:27 +01:00
Jakub Sokołowski 3a277cebd6
cleanup: clean also service logs 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 12:11:39 +01:00
Jakub Sokołowski 968c174ba0
bootstrap: add extra IP to SSHGuard whitelist 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 11:45:07 +01:00
Jakub Sokołowski dd43e135a5
move metal-07.he-eu-hel1.nimbus.prater to nimbus.kiln 
Also move validators from it to `metal-06`.
https://github.com/status-im/infra-nimbus/issues/88

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-10 18:19:25 +01:00
Jakub Sokołowski f2777f6496
nimbus.fluffy: configure 32 nodes on each host 
https://github.com/status-im/infra-nimbus/issues/87

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-08 15:50:03 +01:00
Jakub Sokołowski 2a98be3ade
add two new hosts for nimubs.fluffy fleet 
https://github.com/status-im/infra-nimbus/issues/87

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-08 12:23:11 +01:00
Jakub Sokołowski 1b9d64e72f
enable --proposer-boosting-debug on testnet unstable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-07 12:53:23 +01:00
Jakub Sokołowski 8017d10bbc
requirements: bump Geth to 1.10.16 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-07 11:09:01 +01:00
Jakub Sokołowski ee14e22ce7
dummy-module: add become_user variable, fix windows 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-03 21:02:59 +01:00
Jakub Sokołowski 89093c894a
logs.nimbus: firewall for ElasticSearch exporter port 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-03 18:23:13 +01:00
Jakub Sokołowski 6488efd4e9
nimbus-db-purge: deploy to two mainnet hosts 
https://github.com/status-im/infra-nimbus/issues/86

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-28 17:32:01 +01:00
Jakub Sokołowski a8b48242b0
nimbus-db-purge: add role to periodicall purge DB 
https://github.com/status-im/infra-nimbus/issues/86

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-28 17:31:31 +01:00
Jakub Sokołowski 01e129694b
dummy-module: don't set become_user for inventory 
Causes `become_user` specified in tasks to be ignored.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-28 16:51:16 +01:00
Jakub Sokołowski c4436f71f4
drop windows-01.gc-us-central1-a.nimbus.prater 
Replaced by `windows-01.he-eu-hel1.nimbus.prater` due to disk space
constraints and high cost of Google Cloud host.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-28 13:14:04 +01:00
Jakub Sokołowski 9b365b02a7
add new windows-01.he-eu-hel1.nimbus.prater host 
To replace `windows-01.gc-us-central1-a.nimbus.prater` which is running
out of disk space, and is also far too expensive.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-25 15:02:27 +01:00
Jakub Sokołowski 489878038e
requirements: bump bootstrap roles 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-24 01:40:03 +01:00
Jakub Sokołowski c0ab15c34f
mainnet.openeth: deploy OpenEthereum node to the host 
We need some variety and redundancy in how we sync Eth1:
https://github.com/status-im/infra-nimbus/issues/80

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-21 17:26:33 +01:00
Jakub Sokołowski 3acbf34f70
add new mainnet-01.he-eu-hel1.nimbus.openeth host 
https://github.com/status-im/infra-nimbus/issues/80

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-21 13:54:20 +01:00
Jakub Sokołowski 54c847b9db
nimbus.geth: bump Goerli data volume to 150 GB 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-18 19:37:25 +01:00
Jakub Sokołowski aebe67a9d8
nimbus.prater: add 100 GB data volume for AWS hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 21:19:04 +01:00
Jakub Sokołowski 9f52f8701f
nimbus.mainnet: bump size of AWS data volumes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 20:47:57 +01:00
Jakub Sokołowski 6940d0219c
drop libp2p node from macos host to save space 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 19:53:50 +01:00
Jakub Sokołowski 65304b6aaa new validator layout for prater fleet 
The `0/1/10/30/60/899/4000` layout will require 3 more hosts.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 19:41:07 +01:00
Jakub Sokołowski 3d4679f0d3
nimbus.prater: add nim_compiler overrides 
For some reason `nim-1.6` branch doesn't actually use Nim 1.6 compiler.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 14:24:37 +01:00
Jakub Sokołowski 01c6a06117
nimbus.prater: override some branches to nim-1.6 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 13:46:56 +01:00
Jakub Sokołowski d6414fd956
deploy nodes without validators to 3 new prater hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-16 17:19:23 +01:00
Jakub Sokołowski 612eb284c6
add 3 new nimbus.prater hosts 
Necessary for new layout from:
https://github.com/status-im/infra-nimbus/pull/85

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-16 17:09:51 +01:00
Jakub Sokołowski 84d2773a98
deploy nodes without validators to new prater hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-15 21:09:51 +01:00
Jakub Sokołowski ec65bac02a
nimbus.pyrmont: drop two nodes and move validators 
Two nodes will be reused in the Prater fleet.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-15 21:08:44 +01:00
Jakub Sokołowski 18eb46836e
logs.nimbus: use docker compose setup for elasticsearch 
https://github.com/status-im/infra-role-elasticsearch/commit/567f32ac

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-11 02:08:47 +01:00
Jakub Sokołowski b12a350cb9
bitwarden: include fixes for session invalidation 
For more details see:
- https://github.com/status-im/infra-misc/issues/90
- https://github.com/c0sco/ansible-modules-bitwarden/issues/23

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-10 15:34:18 +01:00
Jakub Sokołowski 4e7625beee
requirements: bump wireguard role 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-10 14:50:05 +01:00
Jakub Sokołowski 392d4124c5
dash.nimbus: bump limit of log indices back to 20 
Currently daily indices take up 10 GB per host, so it' fine.

https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-10 12:31:03 +01:00
Jakub Sokołowski 0398c31ad9
logs.nimbus: drop ES replicas down to 0 to save space 
https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-09 18:43:23 +01:00
Jakub Sokołowski fbb1ee69d9
consul: update token paths in BitWarden 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-09 00:24:07 +01:00
Jakub Sokołowski d74ff169ef
wireguard: bump role and add Consul ACL token 
Part of effort to lock down Consul ACLs:
https://github.com/status-im/infra-hq/issues/70

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-08 20:51:45 +01:00
Jakub Sokołowski cdf63cba43
consul: add mandatory agent ACL token 
https://github.com/status-im/infra-hq/issues/70

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-08 11:58:55 +01:00
Jakub Sokołowski fb7bde2377
dash.nimbus: lower indices kept to 10 
We have bigger log volume now that we fixed the logging setup in:
https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-07 15:07:55 +01:00
Jakub Sokołowski f665fcd8ce
rename logs-dash groups_vars to dash.nimbus 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-07 15:03:12 +01:00
Jakub Sokołowski ba2caedb64
logs.nimbus: bump JVM memory limits to 80% 
We started getting errors like:
```
Caused by: org.elasticsearch.common.breaker.CircuitBreakingException: [parent] Data too large, data for [internal:cluster/nodes/indices/shard/store[n]] would be [36997638608/34.4gb], which is larger than the limit of [36795685273/34.2gb], real usage: [36997638456/34.4gb], new bytes reserved: [152/152b], usages [request=0/0b, fielddata=0/0b, in_flight_requests=152/152b, model_inference=0/0b, eql_sequence=0/0b, accounting=3913236/3.7mb]
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-07 11:49:44 +01:00
Jakub Sokołowski ade0a50a53
logs.nimbus: migrate to Hetzner metal hosts 
For better performance, lower prices, and better network utilization.

https://github.com/status-im/infra-nimbus/issues/84

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-03 21:48:24 +01:00
Jakub Sokołowski 761b0d7e2b
terraform: inherit aws provider version from module 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-03 20:32:29 +01:00
Jakub Sokołowski 36a838e6ae
logs: rename tf resources before adding new hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-03 20:32:28 +01:00
Jakub Sokołowski aed600506d
requirements: deploy consul listen address fix 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-03 19:06:52 +01:00