status-im
/
infra-nimbus
mirror of https://github.com/status-im/infra-nimbus.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
766 Commits 10 Branches 0 Tags 31 MiB
Commit Graph

356 Commits

Author SHA1 Message Date
Jakub Sokołowski 65304b6aaa new validator layout for prater fleet 
The `0/1/10/30/60/899/4000` layout will require 3 more hosts.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 19:41:07 +01:00
Jakub Sokołowski 3d4679f0d3
nimbus.prater: add nim_compiler overrides 
For some reason `nim-1.6` branch doesn't actually use Nim 1.6 compiler.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 14:24:37 +01:00
Jakub Sokołowski 01c6a06117
nimbus.prater: override some branches to nim-1.6 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 13:46:56 +01:00
Jakub Sokołowski d6414fd956
deploy nodes without validators to 3 new prater hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-16 17:19:23 +01:00
Jakub Sokołowski 84d2773a98
deploy nodes without validators to new prater hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-15 21:09:51 +01:00
Jakub Sokołowski ec65bac02a
nimbus.pyrmont: drop two nodes and move validators 
Two nodes will be reused in the Prater fleet.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-15 21:08:44 +01:00
Jakub Sokołowski 18eb46836e
logs.nimbus: use docker compose setup for elasticsearch 
https://github.com/status-im/infra-role-elasticsearch/commit/567f32ac

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-11 02:08:47 +01:00
Jakub Sokołowski 392d4124c5
dash.nimbus: bump limit of log indices back to 20 
Currently daily indices take up 10 GB per host, so it' fine.

https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-10 12:31:03 +01:00
Jakub Sokołowski 0398c31ad9
logs.nimbus: drop ES replicas down to 0 to save space 
https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-09 18:43:23 +01:00
Jakub Sokołowski fbb1ee69d9
consul: update token paths in BitWarden 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-09 00:24:07 +01:00
Jakub Sokołowski d74ff169ef
wireguard: bump role and add Consul ACL token 
Part of effort to lock down Consul ACLs:
https://github.com/status-im/infra-hq/issues/70

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-08 20:51:45 +01:00
Jakub Sokołowski cdf63cba43
consul: add mandatory agent ACL token 
https://github.com/status-im/infra-hq/issues/70

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-08 11:58:55 +01:00
Jakub Sokołowski fb7bde2377
dash.nimbus: lower indices kept to 10 
We have bigger log volume now that we fixed the logging setup in:
https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-07 15:07:55 +01:00
Jakub Sokołowski f665fcd8ce
rename logs-dash groups_vars to dash.nimbus 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-07 15:03:12 +01:00
Jakub Sokołowski ba2caedb64
logs.nimbus: bump JVM memory limits to 80% 
We started getting errors like:
```
Caused by: org.elasticsearch.common.breaker.CircuitBreakingException: [parent] Data too large, data for [internal:cluster/nodes/indices/shard/store[n]] would be [36997638608/34.4gb], which is larger than the limit of [36795685273/34.2gb], real usage: [36997638456/34.4gb], new bytes reserved: [152/152b], usages [request=0/0b, fielddata=0/0b, in_flight_requests=152/152b, model_inference=0/0b, eql_sequence=0/0b, accounting=3913236/3.7mb]
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-07 11:49:44 +01:00
Jakub Sokołowski ade0a50a53
logs.nimbus: migrate to Hetzner metal hosts 
For better performance, lower prices, and better network utilization.

https://github.com/status-im/infra-nimbus/issues/84

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-03 21:48:24 +01:00
Jakub Sokołowski a6d673366a
all: lowe logrotate count to 48, bump bootstrap 
Also remove `delaycompress` from logrotate config.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-31 17:09:28 +01:00
Jakub Sokołowski 2962ebbee0
disable use of HTTP Eth1 node endpoints 
Should fix issues with leaking file descriptors causing peer issues and
metrics endpoint timeouts.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-26 01:22:16 +01:00
Jakub Sokołowski 9b54c84d96
enable validator monitoring flags for unstable nodes 
Once the next release is out we can drop the `unstable` conditionals.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-21 15:36:53 +01:00
Jakub Sokołowski e00443d6e2
nimbus.mainnet: drop libp2p-02 nodes to save space 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-13 14:16:41 +01:00
Jakub Sokołowski 667fd3184e
builds: add libp2p metrics flags 
This is done instead of this PR:
https://github.com/status-im/infra-role-beacon-node-linux/pull/3/files

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-05 19:38:23 +01:00
Jakub Sokołowski 237da365e7
bootstrap: add missing admin pass for macos hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-04 20:55:08 +01:00
Jakub Sokołowski 9c8b0f6185
users: give tanguy sudo permissions 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-04 15:35:30 +01:00
Jakub Sokołowski 462f373827
mainnet.geth: use snap sync method 
We had issues with mainnet node not fully syncing.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-18 18:06:59 +01:00
Jakub Sokołowski 5dae92080a
get-geth-api-urls: use HTTP RPC API for unstable only 
Current support for HTTP RPC API is not stable enough.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-03 19:40:52 +01:00
Jakub Sokołowski ce70b55014
prater-windows: disable windows defender 
Negatively impacts I/O performance, and we don't need it.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-25 20:00:52 +01:00
Jakub Sokołowski 5d5857928d
pyrmont: expose REST API at insecura.nimbus.team 
Inteded for tests of public insecure API access for Jacek.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-22 15:36:56 +01:00
Jakub Sokołowski 6c3384b8ba
ugprade Rocketpool to 1.0.0 
https://github.com/status-im/infra-rocketpool/issues/2

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-08 13:35:37 +01:00
Jakub Sokołowski f334b8917f
rocketpool: upgrade to v1.0.0-pre4 
https://github.com/status-im/infra-role-rocketpool/issues/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-03 14:02:57 +01:00
Jakub Sokołowski a4877e9b28
upgrade ELK stack to 7.14.2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-28 19:29:15 +02:00
Jakub Sokołowski edfcf0b621
nimbus.eth1: update rocketpool setup to new layout 
https://github.com/status-im/infra-rocketpool/issues/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-27 20:38:59 +02:00
Jakub Sokołowski 9fddf38791
geth: open mainnet ports for rocket.prod fleet 
https://github.com/status-im/infra-rocketpool/issues/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-26 15:37:00 +02:00
Jakub Sokołowski 6be2fc03e9
mainnet: add two libp2p nodes on 05 and 06 hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-25 14:30:22 +02:00
Jakub Sokołowski bcc297b796
prater: move libp2p nodes from AWS to Hetzner 
It will lower costs of Prater fleet. I've discussed this with Tanguy and
he's fine with it. I'm also addin two nodes without validators.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-25 12:58:59 +02:00
Jakub Sokołowski b5684f018e
drop prater 02 AWS nodes, rename stable one 
The renaming of:
`stable-large-01.aws-eu-central-1a.nimbus.prater`
to
`testing-large-01.aws-eu-central-1a.nimbus.prater`
Was done because the host was a Prater bootstrap node and it could not
be lost. The node key and the ports remained unchanged.

https://github.com/status-im/infra-nimbus/issues/60

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-22 18:23:22 +02:00
Jakub Sokołowski 961756674c
nimbus.prater: move validators to new MacOS host 
https://github.com/status-im/infra-nimbus/issues/60
https://github.com/status-im/infra-role-dist-validators/commit/f5e6c306

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-22 17:56:20 +02:00
Jakub Sokołowski 1dfba96dec
nimbus.eth1: sync goerli instad of mainnet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-14 13:05:29 +02:00
Jakub Sokołowski 7aa5d2d420
add all users to admin group on MacOS hosts 
This fixes SSH access issue, since only admin group members can have
remote access to the host:
https://www.vinnie.work/blog/2020-12-26-why-so-hard-osx-ssh-access/

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-13 13:34:56 +02:00
Jakub Sokołowski 67c7eff430
nimbus.prater: deploy Consul agent on MacOS host 
https://github.com/status-im/infra-role-bootstrap-macos/pull/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-06 13:57:33 +02:00
Jakub Sokołowski 3585f5615a
mainnet/prater: block libp2p ports for select nodes 
As part of experiment in how nodes behave in restrictive networks.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 18:28:08 +02:00
Jakub Sokołowski 6ed5081087
nimbus.prater: move validators from 03 nodes to metal-02 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 15:46:13 +02:00
Jakub Sokołowski 6df0c868df
nimbus.prater: fix naming of libp2p services 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 14:51:49 +02:00
Jakub Sokołowski 89cbff6b52
switch back to original 3 branch layout of nodes 
Since with release of `1.5.0` the `stable` branch has all the necessary changes:
https://github.com/status-im/nimbus-eth2/releases/tag/v1.5.0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 12:43:51 +02:00
Jakub Sokołowski 61e573d40a
nimbus.mainnet: add 2GB swap file for all hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 12:08:14 +02:00
Jakub Sokołowski 8a91646bfe
nimbus.prater: deploy nodes to metal-02 
Without validators for now.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 23:45:19 +02:00
Jakub Sokołowski 9a8fbd88f8
nimbus.pyrmont: refactor node layout configuration 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 22:36:29 +02:00
Jakub Sokołowski 7eb4c4749c
nimbus.prater: refactor node layout configuration 
This is necessary to support multiple hosts with multiple nodes.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 21:59:25 +02:00
Jakub Sokołowski 018e1f3b78
enable beacon_node_rpc_enabled for all hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 17:53:07 +02:00
Jakub Sokołowski 6c7e3384e5
nimbus.mainnet: deploy 6 nodes on new Hetzner hosts 
https://github.com/status-im/infra-nimbus/issues/66

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 12:08:58 +02:00
Jakub Sokołowski e7e457395a
nimbus.eth1: deploy eth1 node with infra-role-nimbus-eth1 
https://github.com/status-im/infra-nimbus/issues/72

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-01 14:32:09 +02:00
Jakub Sokołowski c56a7cee04
nimbus.prater: switch to using systemd services 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-29 19:38:30 +02:00
Zahary Karadjov 597dbb2b79
Increase the number of peers on Pyrmont and Prater 2021-09-21 21:29:16 +03:00
Jakub Sokołowski 7f5fd21829
nimbus.mainnet: set branch to use to stable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-21 18:37:59 +02:00
Jakub Sokołowski 3673ff3577
bootstrap: add zahary to extra users 
Instead of adding him via default users:
https://github.com/status-im/infra-role-bootstrap-linux/commit/d6a6c129

This fixes addition to Windows host as well.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-20 16:21:09 +02:00
Zahary Karadjov e58d1f7abc
Reduce the number of peers on Prater and Pyrmont nodes 
This is a test of the recently developed subnet walking functionality
 2021-09-14 19:55:21 +03:00
Jakub Sokołowski e8317de1a4
beacon-node-builds: add nim-libp2p-auto-bump builds 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-08 18:51:02 +02:00
Jakub Sokołowski d7e0530d97
log-dash: fix ES LB access to log-store nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-02 13:15:08 +02:00
Jakub Sokołowski 437d9e034f
temproarily switch nodes to run unstable for Altair 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-02 08:14:34 +02:00
Zahary Karadjov 4be33a288d
Specify the correct web3_url for the Rocket Pool node on nimbus.eth1 2021-08-26 21:27:41 +03:00
Jakub Sokołowski 7064ed2f2d
drop nimbus.rayonism host, replaced by nimbus.eth1 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-26 20:21:00 +02:00
Jakub Sokołowski 28b69ccc69
fix bootstrap root password secret, bump roles 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-26 20:19:00 +02:00
Zahary Karadjov 15f7c9ea9b Deploy RocketPool on the new nimbus.eth1 hetzner host 2021-08-26 19:49:38 +02:00
Jakub Sokołowski abe15b05db
geth: explicitly open RPC and WebSocket ports to VPN 
Since geth role now defaults to using `localhost` for both.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-25 15:26:42 +02:00
Jakub Sokołowski 0a143764f0
geth-goerli: adjust VPN firewall comments 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-25 15:08:30 +02:00
Zahary Karadjov 8f01241bc8 Experimental deployment of RocketPool on the Rayonism host 2021-08-25 15:05:29 +02:00
Jakub Sokołowski 2a781d70e8
firewall: remove obsolete settings for open-ports 
We now call `open-ports` role inside of `beacon-node` roles.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-23 16:51:26 +02:00
Jakub Sokołowski e0d70f46f3
prater/pyrmont: add config for REST API port 
https://github.com/status-im/infra-role-beacon-node-linux/pull/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-23 16:46:05 +02:00
Jakub Sokołowski ecdaa70356
geth: open WebSocket port for Nimbus fleets 
This worked before due to connections being already established.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-19 15:32:59 +02:00
Jakub Sokołowski b785e3e862
firewall: open ElasticSearch port to log-aggr.hq 
Fixes logs redirection from Logstash hosts to Nimbus ES cluster.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-13 22:31:39 +02:00
Jakub Sokołowski a21ac2fe8c
port rest of fleet secrets to BitWarden 
https://github.com/status-im/infra-docs/issues/9

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-13 22:25:19 +02:00
Jakub Sokołowski 5d36d3ad3e
firewall: use new IP sets and iptables chains 
https://github.com/status-im/infra-hq/issues/69
https://github.com/status-im/infra-role-bootstrap-linux/commit/92d8923b
https://github.com/status-im/infra-role-wireguard/commit/8394639e

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-11 19:54:36 +02:00
Jakub Sokołowski 3e32ec1ba9
migrate bootstrap secrets to BitWarden 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-28 12:02:03 +02:00
Jakub Sokołowski 4a7ab275a5
move validators from 04 Pyrmont hosts to one windows host 
https://github.com/status-im/infra-nimbus/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-19 16:48:08 +02:00
Jakub Sokołowski c8c1b4faa8
pyrmont: fix duplicate dist-validators variable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-19 16:44:04 +02:00
Jakub Sokołowski 32baf5e4b7
migrate Pyrmont fleet to Hetzner metal hosts 
https://github.com/status-im/infra-nimbus/issues/65

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-19 12:33:23 +02:00
Jakub Sokołowski 8f05a0191c
prater: add service user pass and facts path for windows 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-14 14:59:40 +02:00
Jakub Sokołowski b5f75078f3
move validators from prater 05 hosts to Hetzner host 
https://github.com/status-im/infra-nimbus/issues/52

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-30 22:48:36 +02:00
Jakub Sokołowski a9dfaa12a3
give extra users admin rights on the windows hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-28 18:02:45 +02:00
Jakub Sokołowski f0f5f32e8a
drop group_vars files in favor of generating container tags 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-28 17:32:00 +02:00
Jakub Sokołowski a99a6d0fc6
refactor to distribute validators via beacon-node role 
This way we can deploy multiple nodes on the same host.
https://github.com/status-im/infra-nimbus/issues/52

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-28 16:43:27 +02:00
Jakub Sokołowski 432623b74d
rename Hetzner host to just metal-01 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-28 16:39:45 +02:00
cheatfate 3a3d52a156 Add cheatfate's SSH account. 2021-06-22 13:02:33 +02:00
Arthur Koziel 0a75a69a09 Deploy mainnet beacon nodes on hetzner server 
This will run multiple mainnet beacon nodes on the hetzner server. It
will use the `infra-role-beacon-node-linux` to build and run `stable`,
`unstable` and `testing` on the machine.

Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-22 12:29:01 +02:00
Jakub Sokołowski 13b27db54d
windows: configure running multiple beacon nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-16 15:41:50 +02:00
Jakub Sokołowski fcb8db90fd
add missing password for nimbus windows user 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-11 16:52:26 +02:00
Jakub Sokołowski f4a20bc128
fix password format used for root 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-11 11:18:10 +02:00
Tanguy Cizain cae0195d03 add tanguy's key 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-11 11:15:35 +02:00
Jakub Sokołowski 8468615f7d
deploy one Nimbus Prater node on Windows host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-10 18:09:05 +02:00
Jakub Sokołowski e3171c98a9
use WireGuard instead of Tinc VPN for metrics 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-19 14:12:47 +02:00
Arthur Koziel fb2ab82f6d
Add hetzner dedicated server (#56) 
add stable-metal-01.he-eu-hel1.nimbus.mainnet

Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-05-19 18:04:12 +08:00
Jakub Sokołowski 0a38a4642d
rayonism: increase Geth node verbosity to detail 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-12 14:35:16 +02:00
Jakub Sokołowski 9bf2e03137
move secrets from service to services 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 15:37:45 +02:00
Jakub Sokołowski 87695af8bc
rayonism: disable discovery and add --networkid=5 
No idea why.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 12:23:41 +02:00
Jakub Sokołowski 6c0b62a6a8
rayonism: adjust location of rpc.sh wrapper 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 12:23:28 +02:00
Jakub Sokołowski f933dd0df8
rayonism: put Geth config in the same folder as Beacon node 
This way we create both as part of the same Docker network.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 11:59:34 +02:00
Jakub Sokołowski 23dc761b41
rayonism: use WebSocket instead of HTTp for RPC 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 11:33:31 +02:00
Jakub Sokołowski e20bbb1c48
rayonism: replace steklo testnet with nocturne 
Changes done according to:
https://github.com/status-im/infra-nimbus/issues/54

For more details see:
https://github.com/protolambda/nocturne

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 10:42:11 +02:00
Jakub Sokołowski e50e7f7764
drop legacy beacon_node_web3_url variable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-06 15:40:38 +02:00
Jakub Sokołowski 02b70ee6f0
rayonism: un-comment validators layout 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-30 14:16:49 +02:00
Jakub Sokołowski 6d832ae5c3
rayonism: set debug log level for geth node 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-30 11:33:53 +02:00
Jakub Sokołowski 518726e5f6
rayonism: use http:// instead of ws:// for web3 url 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-30 11:29:31 +02:00
Jakub Sokołowski 1b54f4e1ca
rayonism: update image, enable consensus API module 
https://github.com/status-im/infra-nimbus/issues/53

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-29 19:29:14 +02:00
Jakub Sokołowski 97db7ea804
rayonism: deploy beacon node for steklo testnet 
https://github.com/status-im/infra-nimbus/issues/53

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-29 15:14:25 +02:00
Jakub Sokołowski 1ce2b2c7fb
rayonism: deploy Geth node for steklo testnet 
https://github.com/status-im/infra-nimbus/issues/53

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-29 14:35:06 +02:00
Jakub Sokołowski 65d8302527
implement Eth1 Web3 URL fallbacks 
Related:
https://github.com/status-im/infra-role-beacon-node/commit/92f740e0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-19 20:27:52 +02:00
Zahary Karadjov 8e26b95157 Use the default slashing DB kind 2021-04-14 15:37:05 +02:00
Arthur Koziel 65dca92c13
update ansible for libp2p-stable/unstable 
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-04-13 16:17:13 +08:00
Arthur Koziel 6d9fcf4a20
rename prater-libp2p to prater-unstable-libp2p-stable 
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-04-02 11:42:10 +08:00
Jakub Sokołowski dd6bcc515d
geth-goerli: increase container memory limit to 80% 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-03-30 18:52:39 +02:00
Jakub Sokołowski dbce2ffc5d
deploiy new Docker Compose setup for Geth nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-03-29 13:42:06 +02:00
Zahary Karadjov b03dbdb5c6
Increase the --max-peers count on all fleet nodes 
This setting is recommended due to the high-number of validators
attached to each node which requires maintaining healthy peer
counts on a larger number of gossip topics. For now, we don't
bother specifying a lower value on the servers running a lower
number of validators in order to simplify the implementation.
 2021-03-23 17:53:58 +08:00
Jakub Sokołowski db5ec2f497
bootstrap: provide Consul encryption key from infra-pass 
Related: https://github.com/status-im/infra-role-bootstrap/commit/0d40f81d

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-03-22 11:12:49 +01:00
Arthur Koziel 662e456d06
add config for prater testnet 
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-03-19 16:18:16 +08:00
Jakub Sokołowski a0b0fa87d3
enable --subscribe-all-subnets for Mainnet bootnodes 
https://github.com/status-im/infra-nimbus/issues/38

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-03-08 15:10:16 +01:00
Zahary Karadjov 4668266eb6
Specify the double-checking slashing DB mode on all large servers 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-22 15:16:47 +01:00
Zahary Karadjov f887391f04 More varied validator assignments 2021-02-22 15:14:16 +01:00
Jakub Sokołowski a40c0ab49c
geth-goerli: increase cache size from default 1GB to 2GB 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-12 23:06:04 +01:00
Jakub Sokołowski bb1e3ff3ba
bump size of Goerli Geth node to t3a.large 
It keeps hitting memory limits and failing to sync.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-12 22:58:42 +01:00
Jakub Sokołowski 4cdd5f01ce
increase Goerli container memory limit to 80% 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-09 18:32:11 +01:00
Jakub Sokołowski d8b643fd74
add SSH users to systemd-journal group 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-08 12:36:14 +01:00
Jakub Sokołowski b7226818d3
disable kibana-logtrail, it's not been updated to 7.10.2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-01 16:05:50 +01:00
Jakub Sokołowski dbac764185
upgrade ElasticSearch to 7.10.2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-01 15:57:10 +01:00
Jakub Sokołowski 157d215230
specify beacon_node_netkey for nimbus-mainnet-small bootnodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-29 13:26:55 +01:00
Jakub Sokołowski 26a31c5d63
use 8000+ UIDs for extra SSH users to not clash with core 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-26 12:11:33 +01:00
Jakub Sokołowski 8f76c6810a
log-store: fix mounting of data volumes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-25 15:08:34 +01:00
Jakub Sokołowski 62f44b8a05
drop old fleet from group and host vars and pyrmont playbook 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 15:59:47 +01:00
Jakub Sokołowski 84be761116
fix hostname in nimbus-pyrmont-unstable-libp2p validators layout 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 15:19:58 +01:00
Jakub Sokołowski 37c1c62a5d add validators distributio for the new fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 14:27:39 +01:00
Jakub Sokołowski 8ad0027936
log-store: add 2GB swap files to hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 20:35:33 +01:00
Jakub Sokołowski 6e138997e2
re-enable sending logs to logstash 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 19:27:04 +01:00
Jakub Sokołowski 45a0315bb0
deploy elasticsearch and a kibana dashboard 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 16:00:29 +01:00
Jakub Sokołowski 2b44636cd6
create new pyrmont fleet using new branch naming 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 19:04:10 +01:00
Jakub Sokołowski 05684f23b1
drop unused toledor and maste references 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 16:52:40 +01:00
Jakub Sokołowski 2132851b16
use bootstrap__active_extra_users variable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-14 14:01:57 +01:00
Jakub Sokołowski 9c5abd392a
allow VPN connections to Goerli/Mainnet WebSocket API 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-04 18:20:05 +01:00
Jakub Sokołowski 989aeacb51
use Geth Goerli WebSocket endpoint for Pyrmont fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-04 13:09:48 +01:00
Jakub Sokołowski 65f0d944d8
bump max logs for logrotate to 72 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-26 21:30:32 +01:00
Jakub Sokołowski 996e2df2e8
make docker log files contain only container messages 
See: https://github.com/status-im/infra-nimbus/issues/26

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-26 19:06:08 +01:00
Jakub Sokołowski 796c7ce292
bump count of logrotate files to keep to 24 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-26 18:30:05 +01:00
Jakub Sokołowski eb44131dc6
add configuration for nimbus.mainnet bootstrap nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-25 15:58:44 +01:00
Jakub Sokołowski 57dce5d830
fix sync types for networks 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 17:18:21 +01:00
Jakub Sokołowski 8441dafbbf
configure Geth Mainnet fast sync node 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 16:30:03 +01:00
Jakub Sokołowski 3b8ca79a44
enable WebSocket API for Geth Goerli node 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 15:43:10 +01:00
Jakub Sokołowski d0a7c82d24
configure Goerli full sync on nimbus.geth node 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 14:44:50 +01:00
Jakub Sokołowski 7901c37c58
switch toledo to using devel-small branch 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 22:59:12 +01:00
Jakub Sokołowski f089923acd
switch to using containers based on host type 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 17:33:03 +01:00
Jakub Sokołowski 9fa06b2590
move build mater hosts to host_vars 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:54:24 +01:00
Jakub Sokołowski 21a41cb1ed
drop unused variables, don't re-create containers every time 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:45:51 +01:00
Jakub Sokołowski 9ce7995256
move variables to individual group_vars files 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:05:10 +01:00
Jakub Sokołowski 1f39b846ad
move builds to existing master pyrmont hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:05:10 +01:00
Jakub Sokołowski 754f796871
drop the master host as well 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:05:10 +01:00
Jakub Sokołowski 3c2089ec82
update validators distribution for new layout of hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 14:52:07 +01:00
Jakub Sokołowski 1caaddb924
remove to old medalla fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 14:51:31 +01:00
Jakub Sokołowski 521706c31c
update hostnames for validators distribution 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 13:55:13 +01:00
Jakub Sokołowski 3888da1e6e
set beacon node infura web3 url from infra-pass 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-19 23:00:44 +01:00
Jakub Sokołowski b06078cf7d
drop setting beacon_node_network from nimbus.test.yml 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 16:11:43 +01:00
Jakub Sokołowski e43f66f965
make sure toledo uses correct entrypoint 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 13:53:21 +01:00
Jakub Sokołowski c858cdb577
configure pyrmont distribution of validators and branch layout 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 13:40:13 +01:00
Jakub Sokołowski d3116a8f0b
move toledo host config to separate group_vars and playbook 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 13:25:38 +01:00
Jakub Sokołowski aad84c1554
drop beacon_node_repo_branch, use beacon_node_cont_tag 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 13:00:02 +01:00
Jakub Sokołowski 20bb18553a
add ssh access for giovanni 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 12:26:45 +01:00
Jakub Sokołowski 5bfaa61b73
distribute-validators: role to copy over validators and secrets 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 12:24:52 +01:00
Jakub Sokołowski faae2a99ef
drop beacon_node_shared_testnet, use beacon_node_network 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 11:13:34 +01:00
Jakub Sokołowski 7888b4379e
beacon-node-builds: automate building multiple branches 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-08 22:40:28 +01:00
Jakub Sokołowski f30a3c1314
adjust branch names and memory for master 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-07 11:47:37 +01:00
Jakub Sokołowski 652c7129fa
deploy new layout with Madella nodes on each host 
See: https://github.com/status-im/infra-nimbus/issues/23

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-05 13:51:42 +01:00
Jakub Sokołowski 4cd82e895b
drop bootstrap__extra_volume_path, it clashes with new default 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-02 18:47:12 +01:00
Ștefan Talpalaru dcef20dc7b
log level: TRACE -> DEBUG (#20) 2020-08-04 16:15:30 +02:00
Jakub Sokołowski 118b780312
destory the Nimbus ElasticSearch cluster and dashboard 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-08-03 16:29:33 +02:00
Jakub Sokołowski b3773f51b4
disable sending Nimbus fleet logs to Logstash 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-08-03 15:46:07 +02:00
Jakub Sokołowski ac5ff01a1b
drop libp2p.test fleet since it's unused 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-08-03 15:28:44 +02:00
Ștefan Talpalaru d291695db5
increase mem limits, remove CPU ones (#16) 
* increase CPU/mem limits

* get rid of CPU limits altogether

the kernel scheduler is good enough at ensuring fairness
 2020-07-01 00:07:33 +02:00
Ștefan Talpalaru d88720874d
halve the number of containers (#15) 
* halve the number of containers

and cleanup some vars

* dedicate some slaves to testnet2

* use list slices for hosts
 2020-06-26 22:37:59 +02:00
Jakub Sokołowski 08b6fe9050
deploy 5 libp2p.test hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-06-10 14:55:55 +02:00
Jakub Sokołowski e0ddfa98fd
all: stop disabling watchtower cleanup 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-06-10 13:01:28 +02:00
Jakub Sokołowski 2440e23a1e
adopt to new open-ports role updates 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-05-28 23:11:32 +02:00
Jakub Sokołowski 01088fd433
drop Adam and Igor from users 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-04-14 10:43:03 +02:00
Jakub Sokołowski b3e320e064
deploy 2GB swap files on Nimbus hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-03-26 19:04:59 +01:00
Jakub Sokołowski 0e184b9e96
set cpu and memory limits for beacon nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-03-26 14:15:22 +01:00
Jakub Sokołowski 4c10d02983
move docker logs for Nimbus to /docker/log 
For more details see:
https://github.com/status-im/infra-nimbus/issues/10

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-03-12 13:49:32 +01:00
kdeme 1dd328307b Add my public ssh key 2020-03-09 23:17:16 +01:00
Jakub Sokołowski 03b6fbe91b
update bootstrap extra volume var name 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-26 16:30:45 +01:00
Jakub Sokołowski e8bef4c9b5
fix domain for nimbus-test-stats.status.im 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-20 11:47:17 +01:00
Jakub Sokołowski fcd17845b8
nimbus-stats: port to use systemd timer, fix consul query 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-19 11:51:09 +01:00
Dmitriy Ryajov 9091772f37
add ssh key for dryajov 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-18 16:07:56 +01:00
Jakub Sokołowski 5cc7ee12b1
add lograotate config to slaves too 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-16 01:18:09 +01:00
Jakub Sokołowski b709917224
lower local log retention to avoid filling root 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-13 18:48:53 +01:00
Jakub Sokołowski 7ed2ec39dc
beacon-nodes: match new cont_recreate and cont_state settings 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-10 14:12:57 +01:00
Jakub Sokołowski a56f818416
beacon-node: change log level to TRACE 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-07 14:18:47 +01:00
Jakub Sokołowski 84f80b9aa0
logclean-job: keep only 9 newest logstash daily indices 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-07 14:15:31 +01:00
Jakub Sokołowski 24a87596b4
log-dash: configure Kibana dashboard 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-05 13:39:43 +01:00
Jakub Sokołowski 1ba18ae134
log-store: deploy an ElasticSearch cluster 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-03 13:10:28 +01:00
Jakub Sokołowski e91fb002bf
we now have Consul so we can re enable tinc 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-29 23:17:10 +01:00
Jakub Sokołowski 52321e8ca3
mount extra volume at /docker 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-28 22:19:01 +01:00
Jakub Sokołowski c825c4595b
add zahary user 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-28 21:13:15 +01:00
Jakub Sokołowski 14b623c4b4
port fleet to AWS EC2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-27 16:46:53 +01:00
Jakub Sokołowski aeb4345600
disable watchtower cleanup flag 
Otherwise watchtower throws image removal errors like:
Error: No such image: sha256:abdc

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-23 13:29:47 +01:00
Jakub Sokołowski 0f426e1b51
make yglukhov user inactive 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-22 21:23:37 +01:00
Jakub Sokołowski f519666812
update origin-certs role arguments 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-11-12 23:45:58 +01:00
Jakub Sokołowski f7a3f15982
fix uid for stefan 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-11-01 15:33:06 +01:00