Commit Graph

675 Commits

Author SHA1 Message Date
Jakub Sokołowski abe15b05db
geth: explicitly open RPC and WebSocket ports to VPN
Since geth role now defaults to using `localhost` for both.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-25 15:26:42 +02:00
Jakub Sokołowski 0a143764f0
geth-goerli: adjust VPN firewall comments
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-25 15:08:30 +02:00
Zahary Karadjov 7a2120c8cb Explicitly enable the RPC service on Pyrmont and Prater hosts 2021-08-25 15:05:29 +02:00
Zahary Karadjov 8f01241bc8 Experimental deployment of RocketPool on the Rayonism host 2021-08-25 15:05:29 +02:00
Jakub Sokołowski 9f5bc6be6a
upgrade Geth to 1.10.8 to fix CVE-2021-39137
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-25 13:11:43 +02:00
Jakub Sokołowski 2a781d70e8
firewall: remove obsolete settings for open-ports
We now call `open-ports` role inside of `beacon-node` roles.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-23 16:51:26 +02:00
Jakub Sokołowski e0d70f46f3
prater/pyrmont: add config for REST API port
https://github.com/status-im/infra-role-beacon-node-linux/pull/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-23 16:46:05 +02:00
Jakub Sokołowski ecdaa70356
geth: open WebSocket port for Nimbus fleets
This worked before due to connections being already established.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-19 15:32:59 +02:00
Jakub Sokołowski 4f05e2f40d
beacon-node-builds: drop targets, move to prater host
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-18 12:43:51 +02:00
Jakub Sokołowski e08baf3861
pyrmont: temporarily switch to running altair branch
Necessary for Eth2 2 hard-fork that is going to happen on Pyrmont.
Will revert back to the other branches once changes reach them.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-18 11:49:17 +02:00
Jakub Sokołowski b785e3e862
firewall: open ElasticSearch port to log-aggr.hq
Fixes logs redirection from Logstash hosts to Nimbus ES cluster.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-13 22:31:39 +02:00
Jakub Sokołowski a21ac2fe8c
port rest of fleet secrets to BitWarden
https://github.com/status-im/infra-docs/issues/9

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-13 22:25:19 +02:00
Jakub Sokołowski 5d36d3ad3e
firewall: use new IP sets and iptables chains
https://github.com/status-im/infra-hq/issues/69
https://github.com/status-im/infra-role-bootstrap-linux/commit/92d8923b
https://github.com/status-im/infra-role-wireguard/commit/8394639e

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-11 19:54:36 +02:00
Jakub Sokołowski 1ff378d392
update WireGuard config files layout
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-29 18:57:45 +02:00
Jakub Sokołowski 95261d2d10
ansible/cleanup: drop removing backups, remove nginx logs
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-29 18:57:42 +02:00
Jakub Sokołowski 6375725d87
deploy rpc.sh wrapper for windows beacon nodes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-29 09:32:12 +02:00
Jakub Sokołowski 4384f62e5f
rename infra-role-bootstrap-linux, upgrde consul
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-28 12:29:01 +02:00
Jakub Sokołowski 3e32ec1ba9
migrate bootstrap secrets to BitWarden
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-28 12:02:03 +02:00
Jakub Sokołowski c3a8883662
upgrade Geth to 1.10.6 for the London hard-fork
https://github.com/ethereum/go-ethereum/releases/tag/v1.10.6

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-22 19:44:24 +02:00
Jakub Sokołowski 8943576ddf
remove 3 Prater hosts that donated validators to windows
https://github.com/status-im/infra-nimbus/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-19 17:11:20 +02:00
Jakub Sokołowski 4a7ab275a5
move validators from 04 Pyrmont hosts to one windows host
https://github.com/status-im/infra-nimbus/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-19 16:48:08 +02:00
Jakub Sokołowski a3ae9a36ee
remove unused Pyrmont fleet host_vars files
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-19 16:44:31 +02:00
Jakub Sokołowski c8c1b4faa8
pyrmont: fix duplicate dist-validators variable
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-19 16:44:04 +02:00
Jakub Sokołowski 7c1199f4c0
decomission old AWS Pyrmont hosts
https://github.com/status-im/infra-nimbus/issues/65

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-19 13:04:05 +02:00
Jakub Sokołowski 32baf5e4b7
migrate Pyrmont fleet to Hetzner metal hosts
https://github.com/status-im/infra-nimbus/issues/65

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-19 12:33:23 +02:00
Jakub Sokołowski 87d23f8fa1
deploy 3 beacon nodes on all Pyrmont metal hosts
https://github.com/status-im/infra-nimbus/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-15 20:15:58 +02:00
Jakub Sokołowski df96f214cd
add 4 metal Hetzner hosts for Pyrmont migration
https://github.com/status-im/infra-nimbus/issues/65

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-15 13:51:41 +02:00
Jakub Sokołowski 4fc3ac2689
beacon-node-builds: fix nightly tag clobbering issue
Using single_branch:true avoids cloning other tags/branches.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-14 16:19:52 +02:00
Jakub Sokołowski eb1fea5716
upgrade deploy-eth2-prod image to v1.4.1
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-14 15:37:45 +02:00
Jakub Sokołowski 8f05a0191c
prater: add service user pass and facts path for windows
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-14 14:59:40 +02:00
Jakub Sokołowski 7d76f4b39e
drop all 05 prater nodes in favor of Hetzner host
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-30 22:50:29 +02:00
Jakub Sokołowski b5f75078f3
move validators from prater 05 hosts to Hetzner host
https://github.com/status-im/infra-nimbus/issues/52

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-30 22:48:36 +02:00
Jakub Sokołowski bdab0a2f8b
deploy prater nodes on hetzner node
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 21:30:00 +02:00
Jakub Sokołowski a9dfaa12a3
give extra users admin rights on the windows hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 18:02:45 +02:00
Jakub Sokołowski f0f5f32e8a
drop group_vars files in favor of generating container tags
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 17:32:00 +02:00
Jakub Sokołowski a99a6d0fc6
refactor to distribute validators via beacon-node role
This way we can deploy multiple nodes on the same host.
https://github.com/status-im/infra-nimbus/issues/52

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 16:43:27 +02:00
Jakub Sokołowski 5122d41a99
move distribute-validators role to a separate repo
https://github.com/status-im/infra-role-dist-validators

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 16:40:48 +02:00
Jakub Sokołowski 432623b74d
rename Hetzner host to just metal-01
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 16:39:45 +02:00
Jakub Sokołowski 054c5c2d26
ansible/requirements: update bootstrap and winsw
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 09:52:38 +02:00
Jakub Sokołowski db456f7f5c
upgrade Terraform to 1.0, upgrade all providers
https://www.terraform.io/upgrade-guides/0-15.html
https://www.terraform.io/upgrade-guides/1-0.html

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-23 11:48:43 +02:00
cheatfate 3a3d52a156 Add cheatfate's SSH account. 2021-06-22 13:02:33 +02:00
Arthur Koziel 0a75a69a09 Deploy mainnet beacon nodes on hetzner server
This will run multiple mainnet beacon nodes on the hetzner server. It
will use the `infra-role-beacon-node-linux` to build and run `stable`,
`unstable` and `testing` on the machine.

Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-22 12:29:01 +02:00
Jakub Sokołowski 31232a0b2c
beacon-node-builds: upgrade eth2 fleet to 1.4.0
https://github.com/status-im/nimbus-eth2/releases/tag/v1.4.0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-22 11:53:20 +02:00
Jakub Sokołowski 3d522beb2f
windows: use non-core image with full GUI for debugging
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-21 19:36:11 +02:00
Jakub Sokołowski 13b27db54d
windows: configure running multiple beacon nodes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-16 15:41:50 +02:00
Jakub Sokołowski ddc91ed233
beacon-node-builds: make build failures just a warning
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-16 10:50:52 +02:00
Jakub Sokołowski 23af824b2b
ansible/requirements.yml: add fix for consul handler errors
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-14 17:20:50 +02:00
Jakub Sokołowski f24c714b49
beacon-node-builds: fix apt-get stdout redirection
The & character breaks the command in /bin/sh shell.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-14 16:09:46 +02:00
Jakub Sokołowski 133a30c1b6
deploy 4GB SWAP files to build hosts
We've been seeing build failures due to OOM killer.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-14 10:17:33 +02:00
Jakub Sokołowski fcb8db90fd
add missing password for nimbus windows user
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-11 16:52:26 +02:00
Jakub Sokołowski f4a20bc128
fix password format used for root
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-11 11:18:10 +02:00
Tanguy Cizain cae0195d03 add tanguy's key
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-11 11:15:35 +02:00
Jakub Sokołowski 8468615f7d
deploy one Nimbus Prater node on Windows host
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-10 18:09:05 +02:00
Jakub Sokołowski 809c4ce355
ansible/inventory/test: add windows-01 host
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-09 23:04:13 +02:00
Jakub Sokołowski b5cbe7fa4d
provision windows-01.gc-us-central1-a.nimbus.prater
https://github.com/status-im/infra-nimbus/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-02 14:37:32 +02:00
Jakub Sokołowski 39f9b71dff
beacon-node-builds: add vim: ft=sh for buils.sh
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-01 21:26:42 +02:00
Jakub Sokołowski 38745d0495
ansible/requirements: bump bootstrap so watchtower fixes containers
We've added flags so that containers are fixed even when stuck in `Restarting...`:
https://github.com/status-im/infra-role-bootstrap/commit/c9bdc2ba

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-26 11:50:02 +02:00
Jakub Sokołowski 47f500e1ad
beacon-node-builds: refactor to rebuild after failures
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-21 00:38:03 +02:00
Jakub Sokołowski ee9f8a74b7
bump beacon-node role and others to use WireGuard
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-19 23:03:14 +02:00
Jakub Sokołowski fd9c93a5f7
deploy-eth2-prod: bump to v1.3.0
https://github.com/status-im/nimbus-eth2/releases/tag/v1.3.0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-19 18:33:19 +02:00
Jakub Sokołowski e3171c98a9
use WireGuard instead of Tinc VPN for metrics
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-19 14:12:47 +02:00
Arthur Koziel fb2ab82f6d
Add hetzner dedicated server (#56)
add stable-metal-01.he-eu-hel1.nimbus.mainnet

Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-05-19 18:04:12 +08:00
Arthur Koziel 04648b6465
Scan all DC's for Geth nodes (#57)
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-05-19 17:54:46 +08:00
Jakub Sokołowski 2047fe1702
ansible/requirements: bump origin-certs role
https://github.com/status-im/infra-role-origin-certs/commit/586d81d6

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-13 10:53:51 +02:00
Jakub Sokołowski 0a38a4642d
rayonism: increase Geth node verbosity to detail
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-12 14:35:16 +02:00
Jakub Sokołowski 9bf2e03137
move secrets from service to services
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 15:37:45 +02:00
Jakub Sokołowski 87695af8bc
rayonism: disable discovery and add --networkid=5
No idea why.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 12:23:41 +02:00
Jakub Sokołowski 6c0b62a6a8
rayonism: adjust location of rpc.sh wrapper
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 12:23:28 +02:00
Jakub Sokołowski f933dd0df8
rayonism: put Geth config in the same folder as Beacon node
This way we create both as part of the same Docker network.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 11:59:34 +02:00
Jakub Sokołowski 23dc761b41
rayonism: use WebSocket instead of HTTp for RPC
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 11:33:31 +02:00
Jakub Sokołowski e20bbb1c48
rayonism: replace steklo testnet with nocturne
Changes done according to:
https://github.com/status-im/infra-nimbus/issues/54

For more details see:
https://github.com/protolambda/nocturne

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 10:42:11 +02:00
Jakub Sokołowski c6c7159e94
distribute-validators: create container folder if missing
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 10:41:52 +02:00
Jakub Sokołowski d7930a8437
ansible/requirements: bump bootstrap and elasticsearch roles
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 10:31:33 +02:00
Jakub Sokołowski 657e8a098f
ansible: add meta requirements target, add check to bootstrap
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-10 15:29:38 +02:00
Jakub Sokołowski e50e7f7764
drop legacy beacon_node_web3_url variable
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-06 15:40:38 +02:00
Jakub Sokołowski 1283cec6ee
ansible/requirements: update oauth-proxy rol
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-06 11:17:56 +02:00
Jakub Sokołowski 02b70ee6f0
rayonism: un-comment validators layout
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-30 14:16:49 +02:00
Jakub Sokołowski 6d832ae5c3
rayonism: set debug log level for geth node
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-30 11:33:53 +02:00
Jakub Sokołowski 518726e5f6
rayonism: use http:// instead of ws:// for web3 url
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-30 11:29:31 +02:00
Jakub Sokołowski 1b54f4e1ca
rayonism: update image, enable consensus API module
https://github.com/status-im/infra-nimbus/issues/53

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-29 19:29:14 +02:00
Jakub Sokołowski 97db7ea804
rayonism: deploy beacon node for steklo testnet
https://github.com/status-im/infra-nimbus/issues/53

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-29 15:14:25 +02:00
Jakub Sokołowski 6b8245ad63
rayonism: add build configuration for quick-merge-v1 branch
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-29 14:42:54 +02:00
Jakub Sokołowski 1ce2b2c7fb
rayonism: deploy Geth node for steklo testnet
https://github.com/status-im/infra-nimbus/issues/53

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-29 14:35:06 +02:00
Jakub Sokołowski ba8644873b
deploy qmerge-large-01.aws-eu-central-1a.nimbus.rayonism
For more details see:
https://github.com/status-im/infra-nimbus/issues/53

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-29 13:53:43 +02:00
Jakub Sokołowski 04f9fe30ca
add stable-hetzner-01.he-hel1.nimbus.prater to inventory
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-29 12:14:38 +02:00
Jakub Sokołowski 3147311722
bump deploy-eth2-prod build to 1.2.1
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-20 20:13:41 +02:00
Jakub Sokołowski 65d8302527
implement Eth1 Web3 URL fallbacks
Related:
https://github.com/status-im/infra-role-beacon-node/commit/92f740e0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-19 20:27:52 +02:00
Jakub Sokołowski 762f4e3457
requirements: bump bootstrap role version
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-14 16:18:03 +02:00
Zahary Karadjov 8e26b95157 Use the default slashing DB kind 2021-04-14 15:37:05 +02:00
Arthur Koziel 65dca92c13
update ansible for libp2p-stable/unstable
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-04-13 16:17:13 +08:00
Jakub Sokołowski 45241a5a15
beacon-node-builds: drop use of -d:insecure
No longer necessary due to new secure HTTP backend:
https://github.com/status-im/nimbus-eth2/releases/tag/v1.1.0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-13 08:07:49 +02:00
Jakub Sokołowski 757b097c81 add versioncheck.py script to verify Ansible role versions
Since Ansible or Ansible Galaxy doesn't actually check role versions
itself, we have to do it ourselves. This script goes through contents of
`ansible/requirements.txt` and verifies each role is installed and has
correct version.

It also checks the version of Ansible itself.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-13 08:07:26 +02:00
Jakub Sokołowski 3c0fe9e8fb
beacon-node-builds: fix systemd timer service group not existing
Fixes:
Failed to determine group credentials: No such process
Failed at step GROUP spawning /data/beacon-node-builds/unstable-small/build.sh: No such process

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-07 09:23:50 +02:00
Arthur Koziel d9c21f7d5b
add terraform module for libp2p-unstable
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-04-02 15:00:02 +08:00
Arthur Koziel 6d9fcf4a20
rename prater-libp2p to prater-unstable-libp2p-stable
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-04-02 11:42:10 +08:00
Arthur Koziel 91c03ecb80
rename build for libp2p-stable, add libp2p-unstable build
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-04-01 18:48:48 +08:00
Arthur Koziel 0e7fd54d09
rename host libp2p-large to u-libp2p-s-large
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-04-01 18:46:32 +08:00
Arthur Koziel fe3ed92b98
fix ws url for goerli
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-04-01 18:28:53 +08:00
Jakub Sokołowski dd6bcc515d
geth-goerli: increase container memory limit to 80%
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-30 18:52:39 +02:00
Jakub Sokołowski dbce2ffc5d
deploiy new Docker Compose setup for Geth nodes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-29 13:42:06 +02:00
Jakub Sokołowski 6afc2bfa97
ansible/cleanup.yml: add cleanup of docker images
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-25 21:45:06 +01:00
Zahary Karadjov b03dbdb5c6
Increase the --max-peers count on all fleet nodes
This setting is recommended due to the high-number of validators
attached to each node which requires maintaining healthy peer
counts on a larger number of gossip topics. For now, we don't
bother specifying a lower value on the servers running a lower
number of validators in order to simplify the implementation.
2021-03-23 17:53:58 +08:00
Arthur Koziel 2088c0c92b
set beacon_node_subscribe_all and beacon_node_netkey for prater bootnodes
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-03-23 17:44:55 +08:00
Arthur Koziel 48e2766741
build libp2p-large docker image on pyrmont testing-large-01
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-03-23 13:50:24 +08:00
Jakub Sokołowski ff48a961b5
update inventory with prater hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-22 15:38:54 +01:00
Jakub Sokołowski db5ec2f497
bootstrap: provide Consul encryption key from infra-pass
Related: https://github.com/status-im/infra-role-bootstrap/commit/0d40f81d

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-22 11:12:49 +01:00
Arthur Koziel 662e456d06
add config for prater testnet
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-03-19 16:18:16 +08:00
Jakub Sokołowski c07aca5aa3
beacon-node-builds: upgrade eth2 to v1.0.10
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-11 17:28:17 +01:00
Jakub Sokołowski a0b0fa87d3
enable --subscribe-all-subnets for Mainnet bootnodes
https://github.com/status-im/infra-nimbus/issues/38

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-08 15:10:16 +01:00
Jakub Sokołowski d88c8b44fc
beacon-node-builds: relax the sudoers regex for systemctl
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-03 08:46:37 +01:00
Jakub Sokołowski 9153bb02f1
logclean-job: fix bug in script that deletes newer first
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-27 15:37:49 +01:00
Jakub Sokołowski b1ad100a50
logclean-job: increase timer timeout to 5 minutes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-27 15:26:53 +01:00
Jakub Sokołowski d31094d85c
logclean-job: reduce kept ES indices to 20
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-27 15:24:34 +01:00
Jakub Sokołowski aee3b5eff5
beacon-node-builds: allow for repo updates for select builds
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-22 21:37:38 +01:00
Jakub Sokołowski f931c3cde1
upgrade eth2 image to 1.0.8
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-22 17:55:20 +01:00
Jakub Sokołowski dd70e0652d
beacon-node-builds: add commit to labels
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-22 16:05:56 +01:00
Jakub Sokołowski a269c3e490
distribute-validators: add --delete for rsyncing secrets
Also drop some debug messages, comment out ignore_errors.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-22 15:49:05 +01:00
Jakub Sokołowski 73bde9a51a
add any_errors_fatal:true to avoid duplicate validators
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-22 15:48:51 +01:00
Zahary Karadjov 4668266eb6
Specify the double-checking slashing DB mode on all large servers
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-22 15:16:47 +01:00
Zahary Karadjov f887391f04 More varied validator assignments 2021-02-22 15:14:16 +01:00
Jakub Sokołowski 8dfe06a9bd
change testing branch build to 6am
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-22 15:09:28 +01:00
Jakub Sokołowski a40c0ab49c
geth-goerli: increase cache size from default 1GB to 2GB
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-12 23:06:04 +01:00
Jakub Sokołowski bb1e3ff3ba
bump size of Goerli Geth node to t3a.large
It keeps hitting memory limits and failing to sync.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-12 22:58:42 +01:00
Jakub Sokołowski a5a950bb91
set become=false in ansible.cfg, set it to true in playbooks
See: https://github.com/status-im/nimbus-private/pull/9

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-09 20:27:13 +01:00
Jakub Sokołowski 0e82fa7c03
beacon-node-builds: don't update git branch when deploying
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-09 18:35:32 +01:00
Jakub Sokołowski 4cdd5f01ce
increase Goerli container memory limit to 80%
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-09 18:32:11 +01:00
Jakub Sokołowski d8b643fd74
add SSH users to systemd-journal group
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-08 12:36:14 +01:00
Jakub Sokołowski f96fe517e7
beacon-node-builds: allow staff group membets to start builds
I was thinking of defining the jobs as nimbus user systemd units, but
that would not work unless nimbus user logged in at least once.

And Systemd services have no functionality for allowing non-root users
to start/stop/restart system services, so sudo is the simplest way.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-08 12:36:02 +01:00
Jakub Sokołowski 8e0966fb0e
beacon-node-builds: don't fetch if we're on a detached head
Causes failures when a tag is checked out, nothing to fetch.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-04 23:48:26 +01:00
zah 33ba3b1e8b Upgrade the production fleet to 1.0.7 2021-02-04 21:41:22 +01:00
Jakub Sokołowski b7226818d3
disable kibana-logtrail, it's not been updated to 7.10.2
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-01 16:05:50 +01:00
Jakub Sokołowski dbac764185
upgrade ElasticSearch to 7.10.2
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-01 15:57:10 +01:00
Jakub Sokołowski 157d215230
specify beacon_node_netkey for nimbus-mainnet-small bootnodes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-29 13:26:55 +01:00
Jakub Sokołowski 26a31c5d63
use 8000+ UIDs for extra SSH users to not clash with core
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-26 12:11:33 +01:00
Jakub Sokołowski 8f76c6810a
log-store: fix mounting of data volumes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-25 15:08:34 +01:00
Jakub Sokołowski 62f44b8a05
drop old fleet from group and host vars and pyrmont playbook
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-22 15:59:47 +01:00
Jakub Sokołowski 49bd1fa267
remove old pyrmont fleet, move new one back to pyrmont.tf
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-22 15:56:26 +01:00
Jakub Sokołowski 8aa381ca2e
update names in inventory for nimbus.mainnet hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-22 15:46:04 +01:00
Jakub Sokołowski 84be761116
fix hostname in nimbus-pyrmont-unstable-libp2p validators layout
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-22 15:19:58 +01:00
Jakub Sokołowski 37c1c62a5d add validators distributio for the new fleet
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-22 14:27:39 +01:00
Jakub Sokołowski 8ad0027936
log-store: add 2GB swap files to hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-20 20:35:33 +01:00
Jakub Sokołowski 6e138997e2
re-enable sending logs to logstash
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-20 19:27:04 +01:00
Jakub Sokołowski 45a0315bb0
deploy elasticsearch and a kibana dashboard
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-20 16:00:29 +01:00
Jakub Sokołowski ef8e77a1ac
re-add the ELK stack hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-20 15:59:11 +01:00
Jakub Sokołowski 67ebb93be3
fix wrong build nodes listed in playbook
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-18 19:53:52 +01:00
Jakub Sokołowski 0bc722ca21
dist-validators: don't run any tasks if no layout is defined
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-18 19:47:51 +01:00
Jakub Sokołowski 89dfe7ca5c
add new fleet hosts to inventory
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-18 19:35:03 +01:00
Jakub Sokołowski 2b44636cd6
create new pyrmont fleet using new branch naming
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-18 19:04:10 +01:00
Jakub Sokołowski 05684f23b1
drop unused toledor and maste references
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-18 16:52:40 +01:00
Jakub Sokołowski 2132851b16
use bootstrap__active_extra_users variable
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-14 14:01:57 +01:00
Jakub Sokołowski ab017c29bb
update inventory
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-13 17:07:31 +01:00
Ștefan Talpalaru e71d1643b8 beacon-node-builds: support core dumps
- build with "-d:noSignalHandler" in NIMFLAGS
- keep binary copies for a week, so we can use them with core dumps on
  target hosts
- finish replacing "item.branch" with "item.version"
- manually add a [nimbus-master] section to "ansible/inventory/test"
2020-12-18 21:56:32 +02:00
Jakub Sokołowski 8dc1db8f0b
nimbus-builds: add release build for eth2.prod fleet
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-12-11 18:44:34 +01:00
Jakub Sokołowski 6ecba424d1
drop useless debug task
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-12-04 18:27:17 +01:00
Jakub Sokołowski 48529cb841
use Infura for Web3 on master-large-01 on Pyrmont for comparison
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-12-04 18:26:05 +01:00
Jakub Sokołowski 9c5abd392a
allow VPN connections to Goerli/Mainnet WebSocket API
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-12-04 18:20:05 +01:00
Jakub Sokołowski 989aeacb51
use Geth Goerli WebSocket endpoint for Pyrmont fleet
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-12-04 13:09:48 +01:00
Jakub Sokołowski 65f0d944d8
bump max logs for logrotate to 72
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-26 21:30:32 +01:00
Jakub Sokołowski 996e2df2e8
make docker log files contain only container messages
See: https://github.com/status-im/infra-nimbus/issues/26

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-26 19:06:08 +01:00
Jakub Sokołowski 796c7ce292
bump count of logrotate files to keep to 24
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-26 18:30:05 +01:00
Jakub Sokołowski 176d843a40
drop toledo hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-26 17:06:35 +01:00
Jakub Sokołowski eb44131dc6
add configuration for nimbus.mainnet bootstrap nodes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-25 15:58:44 +01:00
Jakub Sokołowski 43e8379ad6
deploy 2 small hosts for mainnet bootnodes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-25 15:50:22 +01:00
Jakub Sokołowski 57dce5d830
fix sync types for networks
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-24 17:18:21 +01:00
Jakub Sokołowski 8441dafbbf
configure Geth Mainnet fast sync node
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-24 16:30:03 +01:00
Jakub Sokołowski dfa0f20bdc
deplo a nimbus.geth host for mainnet sync
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-24 16:07:21 +01:00
Jakub Sokołowski 3b8ca79a44
enable WebSocket API for Geth Goerli node
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-24 15:43:10 +01:00
Jakub Sokołowski d0a7c82d24
configure Goerli full sync on nimbus.geth node
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-24 14:44:50 +01:00
Jakub Sokołowski 41cb7720c5
deploy a nimbus.geth node for goerli network
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-24 14:44:49 +01:00
Jakub Sokołowski 7901c37c58
switch toledo to using devel-small branch
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 22:59:12 +01:00
Jakub Sokołowski cef9441279
beacon-node-builds: drop pushing each commit
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 17:33:03 +01:00
Jakub Sokołowski f089923acd
switch to using containers based on host type
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 17:33:03 +01:00
Jakub Sokołowski afd230007f
beacon-node-builds: use the git_config resource
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 17:16:15 +01:00
Jakub Sokołowski 3eacfc36c7
beacon-node-builds: use docker_login resource
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 17:13:01 +01:00
Jakub Sokołowski 9fa06b2590
move build mater hosts to host_vars
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:54:24 +01:00
Jakub Sokołowski 318e56bd04
beacon-node-builds: run with -j1 to not disturb containers
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:45:51 +01:00
Jakub Sokołowski 21a41cb1ed
drop unused variables, don't re-create containers every time
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:45:51 +01:00
Jakub Sokołowski 6b88b720d9
fix typo in group names, drop master
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:45:51 +01:00
Jakub Sokołowski 5455ec8f7c
distribute-validators: remove before copying validators
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:37:49 +01:00
Jakub Sokołowski cf19d74410
add README missing from ansible/inventory folder
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:05:11 +01:00
Jakub Sokołowski 9ce7995256
move variables to individual group_vars files
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:05:10 +01:00
Jakub Sokołowski 1f39b846ad
move builds to existing master pyrmont hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:05:10 +01:00
Jakub Sokołowski 754f796871
drop the master host as well
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:05:10 +01:00
Jakub Sokołowski 68f357521d
change pyrmont host groups for cleaner playbook
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:05:09 +01:00
Jakub Sokołowski 8f4f4d69bd
remove old medalla hosts from inventory
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 15:10:55 +01:00
Jakub Sokołowski 1a5ca8ab59
beacon-node-builds: drop building nimbus_beacon_node_spec_0_12_3
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 14:54:36 +01:00
Jakub Sokołowski 3c2089ec82
update validators distribution for new layout of hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 14:52:07 +01:00
Jakub Sokołowski 1caaddb924
remove to old medalla fleet
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 14:51:31 +01:00
Jakub Sokołowski 521706c31c
update hostnames for validators distribution
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 13:55:13 +01:00
Jakub Sokołowski d0f852adce
implement new layout and naming of pyrmont hosts
This is done in advance of resizing andlayout changes.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 13:51:38 +01:00
Zahary Karadjov ee0a8a55d4
Use dedicated Infura accounts for the Pyrmont fleet 2020-11-20 09:30:41 +02:00
Jakub Sokołowski 3888da1e6e
set beacon node infura web3 url from infra-pass
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-19 23:00:44 +01:00
Jakub Sokołowski b57c46cf0a
distribute-validators: adjust ownership before chmod
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 16:26:16 +01:00
Jakub Sokołowski b06078cf7d
drop setting beacon_node_network from nimbus.test.yml
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 16:11:43 +01:00
Jakub Sokołowski bce497758b
distribute-validators: wildcards don't work in single quotes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 15:47:18 +01:00
Jakub Sokołowski f79d65f7c9
beacon-node-builds: bump timeout to 60 minutes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 15:07:15 +01:00
Jakub Sokołowski a11e60cc93
distribute-validators: make sure dist_validators_range has a value
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 14:01:21 +01:00
Jakub Sokołowski e43f66f965
make sure toledo uses correct entrypoint
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 13:53:21 +01:00
Jakub Sokołowski c858cdb577
configure pyrmont distribution of validators and branch layout
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 13:40:13 +01:00
Jakub Sokołowski 6d1915adfd
set medalla entrypoint to be nimbus_beacon_node_spec_0_12_3
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 13:39:32 +01:00
Jakub Sokołowski 8c68e3b56c
build nimbus_beacon_node also for master,devel,libp2p
This is necessary for the new pyrmont network.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 13:36:21 +01:00
Jakub Sokołowski 32f6f9e408
deploy 10 hosts for pyrmont testnet
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 13:25:39 +01:00
Jakub Sokołowski d3116a8f0b
move toledo host config to separate group_vars and playbook
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 13:25:38 +01:00
Jakub Sokołowski 81857071de
distibute-validators: adjust permissions setting for secrets
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-12 13:29:34 +01:00
Jakub Sokołowski 2930e4456d
distribute-validators: add assert to check overlap of secrets
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-12 12:32:37 +01:00
Jakub Sokołowski 890784ae1d
distribute-validators: fix adjusting permissions
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-12 12:09:20 +01:00
Jakub Sokołowski 64b7736d85
distribute-validators: fix order of copied validators and secrets
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-12 11:52:09 +01:00
Ștefan Talpalaru ffa65e00e0 build.sh: deal with Git history being changed upstream
and some drive-by improvements
2020-11-12 11:13:19 +01:00
Jakub Sokołowski b452c6cddc
beacon-node-builds: update readme, add start example
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-10 17:02:50 +01:00
Jakub Sokołowski 055c74aa52
beacon-node-builds: set entrypoint based on targets
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-10 15:39:24 +01:00
Jakub Sokołowski dba111b404
beacon-node-build: fix make targets for networks
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-10 14:01:52 +01:00
Jakub Sokołowski ab42ec87cc
beacon-node-builds: build toledo at 20:00 UTC
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-10 13:24:56 +01:00
Jakub Sokołowski c0766cfb72
use dedicated docker image for toledo
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-10 13:00:25 +01:00
Jakub Sokołowski aad84c1554
drop beacon_node_repo_branch, use beacon_node_cont_tag
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-10 13:00:02 +01:00
Jakub Sokołowski 39431c0bd8
beacon-node-builds: specify medalla and toledo make targets
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-10 12:56:52 +01:00
Jakub Sokołowski f081c31012
don't set folder mode to 0750, breaks permissions
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-10 12:55:43 +01:00
Jakub Sokołowski 20bb18553a
add ssh access for giovanni
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-10 12:26:45 +01:00
Jakub Sokołowski 5bfaa61b73
distribute-validators: role to copy over validators and secrets
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-10 12:24:52 +01:00
Jakub Sokołowski b25bd39c1a
deploy 2 hosts for toledo network running develop
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-10 11:38:45 +01:00
Jakub Sokołowski faae2a99ef
drop beacon_node_shared_testnet, use beacon_node_network
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-10 11:13:34 +01:00
Jakub Sokołowski fafcfee4f6
beacon-node-builds: Use debian image for docker, add --force
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-09 01:20:22 +01:00
Jakub Sokołowski f484a8617f
beacon-node-builds: add README, remove unused batches
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-08 22:50:32 +01:00
Jakub Sokołowski 7888b4379e
beacon-node-builds: automate building multiple branches
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-08 22:40:28 +01:00
Jakub Sokołowski f30a3c1314
adjust branch names and memory for master
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-07 11:47:37 +01:00
Jakub Sokołowski 652c7129fa
deploy new layout with Madella nodes on each host
See: https://github.com/status-im/infra-nimbus/issues/23

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-05 13:51:42 +01:00
Jakub Sokołowski 73dfac49da
simplify playbook by dropping include_role
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-02 18:47:13 +01:00
Jakub Sokołowski 4cd82e895b
drop bootstrap__extra_volume_path, it clashes with new default
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-02 18:47:12 +01:00
Jakub Sokołowski c7d1db5ced
terraform.py: drop deprecated encoding argument from json.loads
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-02 15:32:57 +01:00
Jakub Sokołowski 9d56aa3e84
use our own fork of Nginx role to fix permissions
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-10-07 19:50:55 +02:00
Jakub Sokołowski 1b23e1a4e7
network-debug-script: add networkctl list
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-09-16 14:38:05 +02:00
Jakub Sokołowski 56e3f1d5cb
add network-debug-script to figure out host issues
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-09-16 12:50:46 +02:00
Jakub Sokołowski 728caf06ab
another update because of tainted terraform resource
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-08-19 20:53:19 +02:00
Ștefan Talpalaru a27d6826d8
new IPs 2020-08-19 19:47:59 +02:00
Ștefan Talpalaru 49af390fb6
new dynamic IPs 2020-08-19 18:09:20 +02:00
Ștefan Talpalaru c084b2044c
new dynamic IPs for nimbus.test[0:5] 2020-08-19 15:16:57 +02:00
Jakub Sokołowski c6ce372cd1
moar ip updates
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-08-13 11:57:13 +02:00
Jakub Sokołowski 04bb3f4082
update IPs
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-08-13 00:48:42 +02:00
Ștefan Talpalaru dcef20dc7b
log level: TRACE -> DEBUG (#20) 2020-08-04 16:15:30 +02:00
Ștefan Talpalaru 917d2d6adf
Medalla nodes (#19) 2020-08-04 12:45:57 +02:00
Jakub Sokołowski 118b780312
destory the Nimbus ElasticSearch cluster and dashboard
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-08-03 16:29:33 +02:00
Jakub Sokołowski b3773f51b4
disable sending Nimbus fleet logs to Logstash
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-08-03 15:46:07 +02:00
Jakub Sokołowski ac5ff01a1b
drop libp2p.test fleet since it's unused
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-08-03 15:28:44 +02:00
Ștefan Talpalaru 7be336fc3c
disable swap (#18) 2020-07-14 14:27:18 +02:00
Ștefan Talpalaru 22f4aeba8b
enable container restarts for Altona nodes (#17) 2020-07-06 23:22:23 +02:00
Ștefan Talpalaru d291695db5
increase mem limits, remove CPU ones (#16)
* increase CPU/mem limits

* get rid of CPU limits altogether

the kernel scheduler is good enough at ensuring fairness
2020-07-01 00:07:33 +02:00
Ștefan Talpalaru d88720874d
halve the number of containers (#15)
* halve the number of containers

and cleanup some vars

* dedicate some slaves to testnet2

* use list slices for hosts
2020-06-26 22:37:59 +02:00
Jakub Sokołowski 08b6fe9050
deploy 5 libp2p.test hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-06-10 14:55:55 +02:00
Jakub Sokołowski e0ddfa98fd
all: stop disabling watchtower cleanup
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-06-10 13:01:28 +02:00
Jakub Sokołowski 70fea6e4d7
rename main.yml to nimbus.yml playbook
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-06-10 12:35:30 +02:00
Jakub Sokołowski 2440e23a1e
adopt to new open-ports role updates
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-05-28 23:11:32 +02:00
Jakub Sokołowski 04e86a2802
re-create master-01 due to AWS retirement
"Retiring: This instance is scheduled for retirement after June 5, 2020 at 6:00:00 PM UTC+2."

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-05-25 19:46:05 +02:00
Jakub Sokołowski 01088fd433
drop Adam and Igor from users
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-04-14 10:43:03 +02:00
Jakub Sokołowski b3e320e064
deploy 2GB swap files on Nimbus hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-03-26 19:04:59 +01:00
Jakub Sokołowski 0e184b9e96
set cpu and memory limits for beacon nodes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-03-26 14:15:22 +01:00
Jakub Sokołowski d3513549f3
add RPC port configuration for Nimbus
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-03-23 19:49:13 +01:00
Jakub Sokołowski 4c10d02983
move docker logs for Nimbus to /docker/log
For more details see:
https://github.com/status-im/infra-nimbus/issues/10

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-03-12 13:49:32 +01:00
kdeme 1dd328307b Add my public ssh key 2020-03-09 23:17:16 +01:00
Jakub Sokołowski 03b6fbe91b
update bootstrap extra volume var name
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-02-26 16:30:45 +01:00
Jakub Sokołowski e8bef4c9b5
fix domain for nimbus-test-stats.status.im
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-02-20 11:47:17 +01:00
Jakub Sokołowski fcd17845b8
nimbus-stats: port to use systemd timer, fix consul query
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-02-19 11:51:09 +01:00
Dmitriy Ryajov 9091772f37
add ssh key for dryajov
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-02-18 16:07:56 +01:00
Jakub Sokołowski 5cc7ee12b1
add lograotate config to slaves too
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-02-16 01:18:09 +01:00
Jakub Sokołowski 460dad55ed
inventory: update master IP
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-02-15 21:38:22 +01:00
Jakub Sokołowski b709917224
lower local log retention to avoid filling root
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-02-13 18:48:53 +01:00
Jakub Sokołowski 93d0a6f2fd
inventory: update master-01 ip
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-02-13 18:23:32 +01:00
Jakub Sokołowski 7ed2ec39dc
beacon-nodes: match new cont_recreate and cont_state settings
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-02-10 14:12:57 +01:00
Jakub Sokołowski cf400925ad
update IP of node-01
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-02-10 01:37:44 +01:00
Jakub Sokołowski a02aa10704
inventory: update IP for node-07.aws-eu-central-1a.nimbus.test
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-02-07 18:09:19 +01:00
Jakub Sokołowski 4686a5d08d
inventory: update ip for node-05.aws-eu-central-1a.nimbus.test
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-02-07 16:51:57 +01:00
Jakub Sokołowski a56f818416
beacon-node: change log level to TRACE
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-02-07 14:18:47 +01:00
Jakub Sokołowski 84f80b9aa0
logclean-job: keep only 9 newest logstash daily indices
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-02-07 14:15:31 +01:00
Jakub Sokołowski 24a87596b4
log-dash: configure Kibana dashboard
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-02-05 13:39:43 +01:00
Jakub Sokołowski 283215e5bb
inventory: add node-01.aws-eu-central-1a.dash.nimbus
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-02-05 13:39:28 +01:00
Jakub Sokołowski e7e20b2943
inventory: add log-store.test cluster for Nimbus
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-02-03 13:10:29 +01:00
Jakub Sokołowski 1ba18ae134
log-store: deploy an ElasticSearch cluster
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-02-03 13:10:28 +01:00
Jakub Sokołowski e91fb002bf
we now have Consul so we can re enable tinc
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-01-29 23:17:10 +01:00
Jakub Sokołowski 4cbfa61270
update emergency inventory with new IPs after CIDR change
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-01-29 23:16:46 +01:00
Jakub Sokołowski 52321e8ca3
mount extra volume at /docker
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-01-28 22:19:01 +01:00
Jakub Sokołowski a250807322
fix data_center value in emergency inventory
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-01-28 22:18:43 +01:00
Jakub Sokołowski c825c4595b
add zahary user
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-01-28 21:13:15 +01:00
Jakub Sokołowski d06b8d8c70
update emergency inventory with new fleet
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-01-28 21:04:32 +01:00
Jakub Sokołowski 14b623c4b4
port fleet to AWS EC2
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-01-27 16:46:53 +01:00
Jakub Sokołowski aeb4345600
disable watchtower cleanup flag
Otherwise watchtower throws image removal errors like:
Error: No such image: sha256:abdc

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-01-23 13:29:47 +01:00
Jakub Sokołowski 0f426e1b51
make yglukhov user inactive
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-01-22 21:23:37 +01:00
Jakub Sokołowski f519666812
update origin-certs role arguments
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-11-12 23:45:58 +01:00
Jakub Sokołowski 08be7f7351
add minimal Ansible version check
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-11-04 15:55:29 +01:00
Jakub Sokołowski 7fb6661674
add missing tags for whole playbook for beacon nodes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-11-04 13:55:38 +01:00
Jakub Sokołowski ef4f18bc5f
make playbook more selective
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-11-04 01:04:03 +01:00
Jakub Sokołowski b417df663e
add upgrade and cleanup playbooks
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-11-02 14:44:22 +01:00
Jakub Sokołowski a5ace15000
simpliy playbook, run master beacon nodes together with slaves
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-11-01 16:37:10 +01:00
Jakub Sokołowski 6a4726dbbd
fix mapping of ports to match service ports
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-11-01 16:07:36 +01:00
Jakub Sokołowski f7a3f15982
fix uid for stefan
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-11-01 15:33:06 +01:00
Jakub Sokołowski 3cfa129770
remove bruno user
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-11-01 15:22:49 +01:00
Ștefan Talpalaru 2109d84fa0 added my own public SSH key 2019-11-01 15:21:25 +01:00
Jakub Sokołowski 3c2384092e
change ports for other testnets
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-10-29 17:31:27 +01:00
Jakub Sokołowski 9c9b69c623
update to expose new metrics port
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-10-29 17:28:32 +01:00
Jakub Sokołowski e790ff5c65
fix order in emergency inventory
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-08-02 19:02:05 -04:00
Jakub Sokołowski d14d91efff
upgrade ansible inventory script
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-08-02 19:01:10 -04:00
Jakub Sokołowski 817eb9b075
drop flavour(protocol) name from container names
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-06-21 10:46:45 -04:00
Jakub Sokołowski 15efd6b84d
add ssh access explicitly for Nimbus team members
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-06-12 15:38:30 -04:00
Jakub Sokołowski cd3e4e61cc
start ports from 9000 and 9100, not 9001 and 9101
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-05-15 14:17:23 +02:00
Jakub Sokołowski 3adc241e4d
use new refactored beacon-node role in a loop
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-05-09 18:18:46 +02:00
Jakub Sokołowski 36ce9bf87d
enable debug logs temporarily
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-05-09 16:54:18 +02:00
Zahary Karadjov 44ba6baa1f Run 2 nodes per network type on each server 2019-05-09 17:49:50 +03:00
Jakub Sokołowski 3035b457b1
use one query for all types of messages
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-04-19 12:50:55 +02:00
Jakub Sokołowski f8d90dd829
update
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-04-18 09:42:56 +02:00
Jakub Sokołowski f3b1cbbfbd
update readme
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-04-18 09:41:55 +02:00
Jakub Sokołowski b140075d12
add logger, make -m option use append action
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-04-18 09:35:33 +02:00
Jakub Sokołowski d0f32c610e
remove needlessly commited file
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-04-18 09:14:40 +02:00
Jakub Sokołowski 9fcbc6014f
add new nimbus-stats role for publishing nimbus fleet status
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-04-17 19:25:11 +02:00
Zahary Karadjov 9ec6d1b4a9 Fix a typo 2019-03-28 22:22:10 +02:00
Zahary Karadjov 7f7fb91d51 Added an extra rlpx/testnet0 node 2019-03-26 20:47:34 +02:00
Jakub Sokołowski 1b03b4c7fb
add config for beacon nodes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-03-25 13:02:20 +01:00
Jakub Sokołowski 52b8ae8acf
add missing secrets
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-03-23 10:27:22 +01:00
Jakub Sokołowski 35dd23be1d
fix name of testnet-site role
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-03-22 18:20:55 +01:00
Jakub Sokołowski 9bd1cf8dcd
commit new hosts to emergency inventory
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-03-22 18:20:44 +01:00
Jakub Sokołowski 87765ef6d9
use new roles
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-03-22 16:50:30 +01:00
Jakub Sokołowski dca0efdd5b
fix name of nimbus role
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-03-21 16:31:23 +01:00
Jakub Sokołowski ad1cc2168d
add emergency inventory
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-03-21 13:44:01 +01:00
Jakub Sokołowski 280729edf6
add master and regular nodes(1 for now) for nimbus
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-03-21 13:27:16 +01:00
Jakub Sokołowski 5f8a3cd4e4
add basic main.yml playbook
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-03-21 13:14:11 +01:00
Jakub Sokołowski 5333f49a7f
add bootstrap playbook
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-03-21 12:00:53 +01:00
Jakub Sokołowski beb8fb4ac6
add requirements.yml with new nimbus role
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-03-20 13:38:44 +01:00
Jakub Sokołowski c07f554c2a
add ansible/files folder
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-03-20 13:36:44 +01:00
Jakub Sokołowski 405c032fd7
add ansible terraform.py inventory script
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2019-03-20 13:36:05 +01:00