Commit Graph

218 Commits

Author SHA1 Message Date
Jakub Sokołowski 67c7eff430
nimbus.prater: deploy Consul agent on MacOS host
https://github.com/status-im/infra-role-bootstrap-macos/pull/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-10-06 13:57:33 +02:00
Jakub Sokołowski 3585f5615a
mainnet/prater: block libp2p ports for select nodes
As part of experiment in how nodes behave in restrictive networks.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-10-05 18:28:08 +02:00
Jakub Sokołowski 6ed5081087
nimbus.prater: move validators from 03 nodes to metal-02
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-10-05 15:46:13 +02:00
Jakub Sokołowski 6df0c868df
nimbus.prater: fix naming of libp2p services
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-10-05 14:51:49 +02:00
Jakub Sokołowski 89cbff6b52
switch back to original 3 branch layout of nodes
Since with release of `1.5.0` the `stable` branch has all the necessary changes:
https://github.com/status-im/nimbus-eth2/releases/tag/v1.5.0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-10-05 12:43:51 +02:00
Jakub Sokołowski 61e573d40a
nimbus.mainnet: add 2GB swap file for all hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-10-05 12:08:14 +02:00
Jakub Sokołowski 8a91646bfe
nimbus.prater: deploy nodes to metal-02
Without validators for now.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-10-04 23:45:19 +02:00
Jakub Sokołowski 9a8fbd88f8
nimbus.pyrmont: refactor node layout configuration
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-10-04 22:36:29 +02:00
Jakub Sokołowski 7eb4c4749c
nimbus.prater: refactor node layout configuration
This is necessary to support multiple hosts with multiple nodes.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-10-04 21:59:25 +02:00
Jakub Sokołowski 018e1f3b78
enable beacon_node_rpc_enabled for all hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-10-04 17:53:07 +02:00
Jakub Sokołowski 6c7e3384e5
nimbus.mainnet: deploy 6 nodes on new Hetzner hosts
https://github.com/status-im/infra-nimbus/issues/66

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-10-04 12:08:58 +02:00
Jakub Sokołowski e7e457395a
nimbus.eth1: deploy eth1 node with infra-role-nimbus-eth1
https://github.com/status-im/infra-nimbus/issues/72

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-10-01 14:32:09 +02:00
Jakub Sokołowski c56a7cee04
nimbus.prater: switch to using systemd services
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-09-29 19:38:30 +02:00
Zahary Karadjov 597dbb2b79
Increase the number of peers on Pyrmont and Prater 2021-09-21 21:29:16 +03:00
Jakub Sokołowski 7f5fd21829
nimbus.mainnet: set branch to use to stable
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-09-21 18:37:59 +02:00
Jakub Sokołowski 3673ff3577
bootstrap: add zahary to extra users
Instead of adding him via default users:
https://github.com/status-im/infra-role-bootstrap-linux/commit/d6a6c129

This fixes addition to Windows host as well.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-09-20 16:21:09 +02:00
Zahary Karadjov e58d1f7abc
Reduce the number of peers on Prater and Pyrmont nodes
This is a test of the recently developed subnet walking functionality
2021-09-14 19:55:21 +03:00
Jakub Sokołowski e8317de1a4
beacon-node-builds: add nim-libp2p-auto-bump builds
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-09-08 18:51:02 +02:00
Jakub Sokołowski d7e0530d97
log-dash: fix ES LB access to log-store nodes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-09-02 13:15:08 +02:00
Jakub Sokołowski 437d9e034f
temproarily switch nodes to run unstable for Altair
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-09-02 08:14:34 +02:00
Zahary Karadjov 4be33a288d
Specify the correct web3_url for the Rocket Pool node on nimbus.eth1 2021-08-26 21:27:41 +03:00
Jakub Sokołowski 7064ed2f2d
drop nimbus.rayonism host, replaced by nimbus.eth1
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-26 20:21:00 +02:00
Jakub Sokołowski 28b69ccc69
fix bootstrap root password secret, bump roles
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-26 20:19:00 +02:00
Zahary Karadjov 15f7c9ea9b Deploy RocketPool on the new nimbus.eth1 hetzner host 2021-08-26 19:49:38 +02:00
Jakub Sokołowski abe15b05db
geth: explicitly open RPC and WebSocket ports to VPN
Since geth role now defaults to using `localhost` for both.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-25 15:26:42 +02:00
Jakub Sokołowski 0a143764f0
geth-goerli: adjust VPN firewall comments
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-25 15:08:30 +02:00
Zahary Karadjov 8f01241bc8 Experimental deployment of RocketPool on the Rayonism host 2021-08-25 15:05:29 +02:00
Jakub Sokołowski 2a781d70e8
firewall: remove obsolete settings for open-ports
We now call `open-ports` role inside of `beacon-node` roles.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-23 16:51:26 +02:00
Jakub Sokołowski e0d70f46f3
prater/pyrmont: add config for REST API port
https://github.com/status-im/infra-role-beacon-node-linux/pull/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-23 16:46:05 +02:00
Jakub Sokołowski ecdaa70356
geth: open WebSocket port for Nimbus fleets
This worked before due to connections being already established.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-19 15:32:59 +02:00
Jakub Sokołowski b785e3e862
firewall: open ElasticSearch port to log-aggr.hq
Fixes logs redirection from Logstash hosts to Nimbus ES cluster.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-13 22:31:39 +02:00
Jakub Sokołowski a21ac2fe8c
port rest of fleet secrets to BitWarden
https://github.com/status-im/infra-docs/issues/9

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-13 22:25:19 +02:00
Jakub Sokołowski 5d36d3ad3e
firewall: use new IP sets and iptables chains
https://github.com/status-im/infra-hq/issues/69
https://github.com/status-im/infra-role-bootstrap-linux/commit/92d8923b
https://github.com/status-im/infra-role-wireguard/commit/8394639e

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-11 19:54:36 +02:00
Jakub Sokołowski 3e32ec1ba9
migrate bootstrap secrets to BitWarden
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-28 12:02:03 +02:00
Jakub Sokołowski 4a7ab275a5
move validators from 04 Pyrmont hosts to one windows host
https://github.com/status-im/infra-nimbus/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-19 16:48:08 +02:00
Jakub Sokołowski c8c1b4faa8
pyrmont: fix duplicate dist-validators variable
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-19 16:44:04 +02:00
Jakub Sokołowski 32baf5e4b7
migrate Pyrmont fleet to Hetzner metal hosts
https://github.com/status-im/infra-nimbus/issues/65

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-19 12:33:23 +02:00
Jakub Sokołowski 8f05a0191c
prater: add service user pass and facts path for windows
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-14 14:59:40 +02:00
Jakub Sokołowski b5f75078f3
move validators from prater 05 hosts to Hetzner host
https://github.com/status-im/infra-nimbus/issues/52

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-30 22:48:36 +02:00
Jakub Sokołowski a9dfaa12a3
give extra users admin rights on the windows hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 18:02:45 +02:00
Jakub Sokołowski f0f5f32e8a
drop group_vars files in favor of generating container tags
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 17:32:00 +02:00
Jakub Sokołowski a99a6d0fc6
refactor to distribute validators via beacon-node role
This way we can deploy multiple nodes on the same host.
https://github.com/status-im/infra-nimbus/issues/52

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 16:43:27 +02:00
Jakub Sokołowski 432623b74d
rename Hetzner host to just metal-01
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 16:39:45 +02:00
cheatfate 3a3d52a156 Add cheatfate's SSH account. 2021-06-22 13:02:33 +02:00
Arthur Koziel 0a75a69a09 Deploy mainnet beacon nodes on hetzner server
This will run multiple mainnet beacon nodes on the hetzner server. It
will use the `infra-role-beacon-node-linux` to build and run `stable`,
`unstable` and `testing` on the machine.

Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-22 12:29:01 +02:00
Jakub Sokołowski 13b27db54d
windows: configure running multiple beacon nodes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-16 15:41:50 +02:00
Jakub Sokołowski fcb8db90fd
add missing password for nimbus windows user
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-11 16:52:26 +02:00
Jakub Sokołowski f4a20bc128
fix password format used for root
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-11 11:18:10 +02:00
Tanguy Cizain cae0195d03 add tanguy's key
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-11 11:15:35 +02:00
Jakub Sokołowski 8468615f7d
deploy one Nimbus Prater node on Windows host
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-10 18:09:05 +02:00
Jakub Sokołowski e3171c98a9
use WireGuard instead of Tinc VPN for metrics
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-19 14:12:47 +02:00
Arthur Koziel fb2ab82f6d
Add hetzner dedicated server (#56)
add stable-metal-01.he-eu-hel1.nimbus.mainnet

Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-05-19 18:04:12 +08:00
Jakub Sokołowski 0a38a4642d
rayonism: increase Geth node verbosity to detail
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-12 14:35:16 +02:00
Jakub Sokołowski 9bf2e03137
move secrets from service to services
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 15:37:45 +02:00
Jakub Sokołowski 87695af8bc
rayonism: disable discovery and add --networkid=5
No idea why.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 12:23:41 +02:00
Jakub Sokołowski 6c0b62a6a8
rayonism: adjust location of rpc.sh wrapper
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 12:23:28 +02:00
Jakub Sokołowski f933dd0df8
rayonism: put Geth config in the same folder as Beacon node
This way we create both as part of the same Docker network.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 11:59:34 +02:00
Jakub Sokołowski 23dc761b41
rayonism: use WebSocket instead of HTTp for RPC
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 11:33:31 +02:00
Jakub Sokołowski e20bbb1c48
rayonism: replace steklo testnet with nocturne
Changes done according to:
https://github.com/status-im/infra-nimbus/issues/54

For more details see:
https://github.com/protolambda/nocturne

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 10:42:11 +02:00
Jakub Sokołowski e50e7f7764
drop legacy beacon_node_web3_url variable
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-06 15:40:38 +02:00
Jakub Sokołowski 02b70ee6f0
rayonism: un-comment validators layout
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-30 14:16:49 +02:00
Jakub Sokołowski 6d832ae5c3
rayonism: set debug log level for geth node
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-30 11:33:53 +02:00
Jakub Sokołowski 518726e5f6
rayonism: use http:// instead of ws:// for web3 url
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-30 11:29:31 +02:00
Jakub Sokołowski 1b54f4e1ca
rayonism: update image, enable consensus API module
https://github.com/status-im/infra-nimbus/issues/53

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-29 19:29:14 +02:00
Jakub Sokołowski 97db7ea804
rayonism: deploy beacon node for steklo testnet
https://github.com/status-im/infra-nimbus/issues/53

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-29 15:14:25 +02:00
Jakub Sokołowski 1ce2b2c7fb
rayonism: deploy Geth node for steklo testnet
https://github.com/status-im/infra-nimbus/issues/53

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-29 14:35:06 +02:00
Jakub Sokołowski 65d8302527
implement Eth1 Web3 URL fallbacks
Related:
https://github.com/status-im/infra-role-beacon-node/commit/92f740e0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-19 20:27:52 +02:00
Zahary Karadjov 8e26b95157 Use the default slashing DB kind 2021-04-14 15:37:05 +02:00
Arthur Koziel 65dca92c13
update ansible for libp2p-stable/unstable
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-04-13 16:17:13 +08:00
Arthur Koziel 6d9fcf4a20
rename prater-libp2p to prater-unstable-libp2p-stable
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-04-02 11:42:10 +08:00
Jakub Sokołowski dd6bcc515d
geth-goerli: increase container memory limit to 80%
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-30 18:52:39 +02:00
Jakub Sokołowski dbce2ffc5d
deploiy new Docker Compose setup for Geth nodes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-29 13:42:06 +02:00
Zahary Karadjov b03dbdb5c6
Increase the --max-peers count on all fleet nodes
This setting is recommended due to the high-number of validators
attached to each node which requires maintaining healthy peer
counts on a larger number of gossip topics. For now, we don't
bother specifying a lower value on the servers running a lower
number of validators in order to simplify the implementation.
2021-03-23 17:53:58 +08:00
Jakub Sokołowski db5ec2f497
bootstrap: provide Consul encryption key from infra-pass
Related: https://github.com/status-im/infra-role-bootstrap/commit/0d40f81d

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-22 11:12:49 +01:00
Arthur Koziel 662e456d06
add config for prater testnet
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-03-19 16:18:16 +08:00
Jakub Sokołowski a0b0fa87d3
enable --subscribe-all-subnets for Mainnet bootnodes
https://github.com/status-im/infra-nimbus/issues/38

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-08 15:10:16 +01:00
Zahary Karadjov 4668266eb6
Specify the double-checking slashing DB mode on all large servers
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-22 15:16:47 +01:00
Zahary Karadjov f887391f04 More varied validator assignments 2021-02-22 15:14:16 +01:00
Jakub Sokołowski a40c0ab49c
geth-goerli: increase cache size from default 1GB to 2GB
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-12 23:06:04 +01:00
Jakub Sokołowski bb1e3ff3ba
bump size of Goerli Geth node to t3a.large
It keeps hitting memory limits and failing to sync.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-12 22:58:42 +01:00
Jakub Sokołowski 4cdd5f01ce
increase Goerli container memory limit to 80%
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-09 18:32:11 +01:00
Jakub Sokołowski d8b643fd74
add SSH users to systemd-journal group
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-08 12:36:14 +01:00
Jakub Sokołowski b7226818d3
disable kibana-logtrail, it's not been updated to 7.10.2
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-01 16:05:50 +01:00
Jakub Sokołowski dbac764185
upgrade ElasticSearch to 7.10.2
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-01 15:57:10 +01:00
Jakub Sokołowski 157d215230
specify beacon_node_netkey for nimbus-mainnet-small bootnodes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-29 13:26:55 +01:00
Jakub Sokołowski 26a31c5d63
use 8000+ UIDs for extra SSH users to not clash with core
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-26 12:11:33 +01:00
Jakub Sokołowski 8f76c6810a
log-store: fix mounting of data volumes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-25 15:08:34 +01:00
Jakub Sokołowski 62f44b8a05
drop old fleet from group and host vars and pyrmont playbook
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-22 15:59:47 +01:00
Jakub Sokołowski 84be761116
fix hostname in nimbus-pyrmont-unstable-libp2p validators layout
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-22 15:19:58 +01:00
Jakub Sokołowski 37c1c62a5d add validators distributio for the new fleet
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-22 14:27:39 +01:00
Jakub Sokołowski 8ad0027936
log-store: add 2GB swap files to hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-20 20:35:33 +01:00
Jakub Sokołowski 6e138997e2
re-enable sending logs to logstash
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-20 19:27:04 +01:00
Jakub Sokołowski 45a0315bb0
deploy elasticsearch and a kibana dashboard
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-20 16:00:29 +01:00
Jakub Sokołowski 2b44636cd6
create new pyrmont fleet using new branch naming
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-18 19:04:10 +01:00
Jakub Sokołowski 05684f23b1
drop unused toledor and maste references
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-18 16:52:40 +01:00
Jakub Sokołowski 2132851b16
use bootstrap__active_extra_users variable
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-14 14:01:57 +01:00
Jakub Sokołowski 9c5abd392a
allow VPN connections to Goerli/Mainnet WebSocket API
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-12-04 18:20:05 +01:00
Jakub Sokołowski 989aeacb51
use Geth Goerli WebSocket endpoint for Pyrmont fleet
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-12-04 13:09:48 +01:00
Jakub Sokołowski 65f0d944d8
bump max logs for logrotate to 72
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-26 21:30:32 +01:00
Jakub Sokołowski 996e2df2e8
make docker log files contain only container messages
See: https://github.com/status-im/infra-nimbus/issues/26

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-26 19:06:08 +01:00