status-im
/
infra-nimbus
mirror of https://github.com/status-im/infra-nimbus.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
476 Commits 10 Branches 0 Tags 31 MiB
Commit Graph

402 Commits

Author SHA1 Message Date
Jakub Sokołowski 81bd269610
nimbus.mainnet: add new 6 hetzner hosts 
https://github.com/status-im/infra-nimbus/issues/66

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 12:08:49 +02:00
Jakub Sokołowski e7e457395a
nimbus.eth1: deploy eth1 node with infra-role-nimbus-eth1 
https://github.com/status-im/infra-nimbus/issues/72

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-01 14:32:09 +02:00
Jakub Sokołowski f59c8d8f43
macos: add bootstrap role, add hostname fix 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-30 17:21:23 +02:00
Jakub Sokołowski c56a7cee04
nimbus.prater: switch to using systemd services 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-29 19:38:30 +02:00
Jakub Sokołowski c8f539dd89
beacon-node-builds: drop building docker containers 
All Linux hosts will be migrated to using systemd services.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-29 19:34:24 +02:00
Jakub Sokołowski 0c60f0ad09
beacon-node-builds: move some builds to testing-large-02 
This should spread out disk space usage a bit more.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-29 11:26:47 +02:00
Jakub Sokołowski c4e0f20fa1
beacon-node-builds: keep only 3 days worth of builds 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-29 11:21:15 +02:00
Jakub Sokołowski 879a15b91f
update requirements, change order of prater tasks 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-24 21:35:05 +02:00
Arthur Koziel 7f80f68804 add macos beacon nodes 
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-09-24 12:29:28 +02:00
Jakub Sokołowski e2eb049cbb
move deployment of beacon-node-builds to the bottom 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-22 16:40:51 +02:00
Zahary Karadjov 813c40adec
Switch back to the unstable branch on all nodes 2021-09-22 16:52:41 +03:00
Zahary Karadjov 597dbb2b79
Increase the number of peers on Pyrmont and Prater 2021-09-21 21:29:16 +03:00
Jakub Sokołowski 7f5fd21829
nimbus.mainnet: set branch to use to stable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-21 18:37:59 +02:00
Jakub Sokołowski 0bfc961817
update requirements to include logging fixes 
They make linux systemd service not send logs to Journald store.

Issue:
https://github.com/status-im/infra-role-bootstrap-linux/issues/24

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-21 17:59:47 +02:00
Zahary Karadjov 3a02974e3a
A/B testing for the taskpool implementation 
The `stable` hosts will run with the taskpool code reverted, the
testing hosts will employ multiple cores.
 2021-09-21 16:45:10 +03:00
Jakub Sokołowski 3673ff3577
bootstrap: add zahary to extra users 
Instead of adding him via default users:
https://github.com/status-im/infra-role-bootstrap-linux/commit/d6a6c129

This fixes addition to Windows host as well.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-20 16:21:09 +02:00
Zahary Karadjov e58d1f7abc
Reduce the number of peers on Prater and Pyrmont nodes 
This is a test of the recently developed subnet walking functionality
 2021-09-14 19:55:21 +03:00
Jakub Sokołowski e8317de1a4
beacon-node-builds: add nim-libp2p-auto-bump builds 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-08 18:51:02 +02:00
Jakub Sokołowski ca46d0fc54
fix restarting of systemd services 
Only one `sudoers` file was being modified by multiple roles:
https://github.com/status-im/infra-role-beacon-node-linux/commit/ff400bfb

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-07 15:47:25 +02:00
Jakub Sokołowski d7e0530d97
log-dash: fix ES LB access to log-store nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-02 13:15:08 +02:00
Jakub Sokołowski 437d9e034f
temproarily switch nodes to run unstable for Altair 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-02 08:14:34 +02:00
Zahary Karadjov 4be33a288d
Specify the correct web3_url for the Rocket Pool node on nimbus.eth1 2021-08-26 21:27:41 +03:00
Jakub Sokołowski 7064ed2f2d
drop nimbus.rayonism host, replaced by nimbus.eth1 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-26 20:21:00 +02:00
Jakub Sokołowski 28b69ccc69
fix bootstrap root password secret, bump roles 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-26 20:19:00 +02:00
Zahary Karadjov 15f7c9ea9b Deploy RocketPool on the new nimbus.eth1 hetzner host 2021-08-26 19:49:38 +02:00
Zahary Karadjov 3e69657de8
Bump RocketPool to v1.0.0-RC7 2021-08-26 20:38:42 +03:00
Jakub Sokołowski 345ceb8050
add metal-01.he-eu-hel1.nimbus.eth1 host 
https://github.com/status-im/infra-nimbus/issues/70

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-26 15:52:16 +02:00
Jakub Sokołowski abe15b05db
geth: explicitly open RPC and WebSocket ports to VPN 
Since geth role now defaults to using `localhost` for both.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-25 15:26:42 +02:00
Jakub Sokołowski 0a143764f0
geth-goerli: adjust VPN firewall comments 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-25 15:08:30 +02:00
Zahary Karadjov 7a2120c8cb Explicitly enable the RPC service on Pyrmont and Prater hosts 2021-08-25 15:05:29 +02:00
Zahary Karadjov 8f01241bc8 Experimental deployment of RocketPool on the Rayonism host 2021-08-25 15:05:29 +02:00
Jakub Sokołowski 9f5bc6be6a
upgrade Geth to 1.10.8 to fix CVE-2021-39137 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-25 13:11:43 +02:00
Jakub Sokołowski 2a781d70e8
firewall: remove obsolete settings for open-ports 
We now call `open-ports` role inside of `beacon-node` roles.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-23 16:51:26 +02:00
Jakub Sokołowski e0d70f46f3
prater/pyrmont: add config for REST API port 
https://github.com/status-im/infra-role-beacon-node-linux/pull/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-23 16:46:05 +02:00
Jakub Sokołowski ecdaa70356
geth: open WebSocket port for Nimbus fleets 
This worked before due to connections being already established.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-19 15:32:59 +02:00
Jakub Sokołowski 4f05e2f40d
beacon-node-builds: drop targets, move to prater host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-18 12:43:51 +02:00
Jakub Sokołowski e08baf3861
pyrmont: temporarily switch to running altair branch 
Necessary for Eth2 2 hard-fork that is going to happen on Pyrmont.
Will revert back to the other branches once changes reach them.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-18 11:49:17 +02:00
Jakub Sokołowski b785e3e862
firewall: open ElasticSearch port to log-aggr.hq 
Fixes logs redirection from Logstash hosts to Nimbus ES cluster.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-13 22:31:39 +02:00
Jakub Sokołowski a21ac2fe8c
port rest of fleet secrets to BitWarden 
https://github.com/status-im/infra-docs/issues/9

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-13 22:25:19 +02:00
Jakub Sokołowski 5d36d3ad3e
firewall: use new IP sets and iptables chains 
https://github.com/status-im/infra-hq/issues/69
https://github.com/status-im/infra-role-bootstrap-linux/commit/92d8923b
https://github.com/status-im/infra-role-wireguard/commit/8394639e

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-11 19:54:36 +02:00
Jakub Sokołowski 1ff378d392
update WireGuard config files layout 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-29 18:57:45 +02:00
Jakub Sokołowski 95261d2d10
ansible/cleanup: drop removing backups, remove nginx logs 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-29 18:57:42 +02:00
Jakub Sokołowski 6375725d87
deploy rpc.sh wrapper for windows beacon nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-29 09:32:12 +02:00
Jakub Sokołowski 4384f62e5f
rename infra-role-bootstrap-linux, upgrde consul 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-28 12:29:01 +02:00
Jakub Sokołowski 3e32ec1ba9
migrate bootstrap secrets to BitWarden 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-28 12:02:03 +02:00
Jakub Sokołowski c3a8883662
upgrade Geth to 1.10.6 for the London hard-fork 
https://github.com/ethereum/go-ethereum/releases/tag/v1.10.6

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-22 19:44:24 +02:00
Jakub Sokołowski 8943576ddf
remove 3 Prater hosts that donated validators to windows 
https://github.com/status-im/infra-nimbus/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-19 17:11:20 +02:00
Jakub Sokołowski 4a7ab275a5
move validators from 04 Pyrmont hosts to one windows host 
https://github.com/status-im/infra-nimbus/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-19 16:48:08 +02:00
Jakub Sokołowski a3ae9a36ee
remove unused Pyrmont fleet host_vars files 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-19 16:44:31 +02:00
Jakub Sokołowski c8c1b4faa8
pyrmont: fix duplicate dist-validators variable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-19 16:44:04 +02:00
Jakub Sokołowski 7c1199f4c0
decomission old AWS Pyrmont hosts 
https://github.com/status-im/infra-nimbus/issues/65

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-19 13:04:05 +02:00
Jakub Sokołowski 32baf5e4b7
migrate Pyrmont fleet to Hetzner metal hosts 
https://github.com/status-im/infra-nimbus/issues/65

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-19 12:33:23 +02:00
Jakub Sokołowski 87d23f8fa1
deploy 3 beacon nodes on all Pyrmont metal hosts 
https://github.com/status-im/infra-nimbus/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-15 20:15:58 +02:00
Jakub Sokołowski df96f214cd
add 4 metal Hetzner hosts for Pyrmont migration 
https://github.com/status-im/infra-nimbus/issues/65

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-15 13:51:41 +02:00
Jakub Sokołowski 4fc3ac2689
beacon-node-builds: fix nightly tag clobbering issue 
Using single_branch:true avoids cloning other tags/branches.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-14 16:19:52 +02:00
Jakub Sokołowski eb1fea5716
upgrade deploy-eth2-prod image to v1.4.1 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-14 15:37:45 +02:00
Jakub Sokołowski 8f05a0191c
prater: add service user pass and facts path for windows 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-14 14:59:40 +02:00
Jakub Sokołowski 7d76f4b39e
drop all 05 prater nodes in favor of Hetzner host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-30 22:50:29 +02:00
Jakub Sokołowski b5f75078f3
move validators from prater 05 hosts to Hetzner host 
https://github.com/status-im/infra-nimbus/issues/52

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-30 22:48:36 +02:00
Jakub Sokołowski bdab0a2f8b
deploy prater nodes on hetzner node 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-28 21:30:00 +02:00
Jakub Sokołowski a9dfaa12a3
give extra users admin rights on the windows hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-28 18:02:45 +02:00
Jakub Sokołowski f0f5f32e8a
drop group_vars files in favor of generating container tags 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-28 17:32:00 +02:00
Jakub Sokołowski a99a6d0fc6
refactor to distribute validators via beacon-node role 
This way we can deploy multiple nodes on the same host.
https://github.com/status-im/infra-nimbus/issues/52

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-28 16:43:27 +02:00
Jakub Sokołowski 5122d41a99
move distribute-validators role to a separate repo 
https://github.com/status-im/infra-role-dist-validators

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-28 16:40:48 +02:00
Jakub Sokołowski 432623b74d
rename Hetzner host to just metal-01 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-28 16:39:45 +02:00
Jakub Sokołowski 054c5c2d26
ansible/requirements: update bootstrap and winsw 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-28 09:52:38 +02:00
Jakub Sokołowski db456f7f5c
upgrade Terraform to 1.0, upgrade all providers 
https://www.terraform.io/upgrade-guides/0-15.html
https://www.terraform.io/upgrade-guides/1-0.html

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-23 11:48:43 +02:00
cheatfate 3a3d52a156 Add cheatfate's SSH account. 2021-06-22 13:02:33 +02:00
Arthur Koziel 0a75a69a09 Deploy mainnet beacon nodes on hetzner server 
This will run multiple mainnet beacon nodes on the hetzner server. It
will use the `infra-role-beacon-node-linux` to build and run `stable`,
`unstable` and `testing` on the machine.

Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-22 12:29:01 +02:00
Jakub Sokołowski 31232a0b2c
beacon-node-builds: upgrade eth2 fleet to 1.4.0 
https://github.com/status-im/nimbus-eth2/releases/tag/v1.4.0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-22 11:53:20 +02:00
Jakub Sokołowski 3d522beb2f
windows: use non-core image with full GUI for debugging 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-21 19:36:11 +02:00
Jakub Sokołowski 13b27db54d
windows: configure running multiple beacon nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-16 15:41:50 +02:00
Jakub Sokołowski ddc91ed233
beacon-node-builds: make build failures just a warning 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-16 10:50:52 +02:00
Jakub Sokołowski 23af824b2b
ansible/requirements.yml: add fix for consul handler errors 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-14 17:20:50 +02:00
Jakub Sokołowski f24c714b49
beacon-node-builds: fix apt-get stdout redirection 
The & character breaks the command in /bin/sh shell.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-14 16:09:46 +02:00
Jakub Sokołowski 133a30c1b6
deploy 4GB SWAP files to build hosts 
We've been seeing build failures due to OOM killer.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-14 10:17:33 +02:00
Jakub Sokołowski fcb8db90fd
add missing password for nimbus windows user 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-11 16:52:26 +02:00
Jakub Sokołowski f4a20bc128
fix password format used for root 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-11 11:18:10 +02:00
Tanguy Cizain cae0195d03 add tanguy's key 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-11 11:15:35 +02:00
Jakub Sokołowski 8468615f7d
deploy one Nimbus Prater node on Windows host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-10 18:09:05 +02:00
Jakub Sokołowski 809c4ce355
ansible/inventory/test: add windows-01 host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-09 23:04:13 +02:00
Jakub Sokołowski b5cbe7fa4d
provision windows-01.gc-us-central1-a.nimbus.prater 
https://github.com/status-im/infra-nimbus/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-02 14:37:32 +02:00
Jakub Sokołowski 39f9b71dff
beacon-node-builds: add vim: ft=sh for buils.sh 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-01 21:26:42 +02:00
Jakub Sokołowski 38745d0495
ansible/requirements: bump bootstrap so watchtower fixes containers 
We've added flags so that containers are fixed even when stuck in `Restarting...`:
https://github.com/status-im/infra-role-bootstrap/commit/c9bdc2ba

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-26 11:50:02 +02:00
Jakub Sokołowski 47f500e1ad
beacon-node-builds: refactor to rebuild after failures 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-21 00:38:03 +02:00
Jakub Sokołowski ee9f8a74b7
bump beacon-node role and others to use WireGuard 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-19 23:03:14 +02:00
Jakub Sokołowski fd9c93a5f7
deploy-eth2-prod: bump to v1.3.0 
https://github.com/status-im/nimbus-eth2/releases/tag/v1.3.0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-19 18:33:19 +02:00
Jakub Sokołowski e3171c98a9
use WireGuard instead of Tinc VPN for metrics 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-19 14:12:47 +02:00
Arthur Koziel fb2ab82f6d
Add hetzner dedicated server (#56) 
add stable-metal-01.he-eu-hel1.nimbus.mainnet

Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-05-19 18:04:12 +08:00
Arthur Koziel 04648b6465
Scan all DC's for Geth nodes (#57) 
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-05-19 17:54:46 +08:00
Jakub Sokołowski 2047fe1702
ansible/requirements: bump origin-certs role 
https://github.com/status-im/infra-role-origin-certs/commit/586d81d6

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-13 10:53:51 +02:00
Jakub Sokołowski 0a38a4642d
rayonism: increase Geth node verbosity to detail 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-12 14:35:16 +02:00
Jakub Sokołowski 9bf2e03137
move secrets from service to services 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 15:37:45 +02:00
Jakub Sokołowski 87695af8bc
rayonism: disable discovery and add --networkid=5 
No idea why.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 12:23:41 +02:00
Jakub Sokołowski 6c0b62a6a8
rayonism: adjust location of rpc.sh wrapper 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 12:23:28 +02:00
Jakub Sokołowski f933dd0df8
rayonism: put Geth config in the same folder as Beacon node 
This way we create both as part of the same Docker network.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 11:59:34 +02:00
Jakub Sokołowski 23dc761b41
rayonism: use WebSocket instead of HTTp for RPC 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 11:33:31 +02:00
Jakub Sokołowski e20bbb1c48
rayonism: replace steklo testnet with nocturne 
Changes done according to:
https://github.com/status-im/infra-nimbus/issues/54

For more details see:
https://github.com/protolambda/nocturne

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 10:42:11 +02:00
Jakub Sokołowski c6c7159e94
distribute-validators: create container folder if missing 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 10:41:52 +02:00
Jakub Sokołowski d7930a8437
ansible/requirements: bump bootstrap and elasticsearch roles 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 10:31:33 +02:00