Jakub Sokołowski
4f05e2f40d
beacon-node-builds: drop targets, move to prater host
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-18 12:43:51 +02:00
Jakub Sokołowski
e08baf3861
pyrmont: temporarily switch to running altair branch
...
Necessary for Eth2 2 hard-fork that is going to happen on Pyrmont.
Will revert back to the other branches once changes reach them.
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-18 11:49:17 +02:00
Jakub Sokołowski
b785e3e862
firewall: open ElasticSearch port to log-aggr.hq
...
Fixes logs redirection from Logstash hosts to Nimbus ES cluster.
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-13 22:31:39 +02:00
Jakub Sokołowski
a21ac2fe8c
port rest of fleet secrets to BitWarden
...
https://github.com/status-im/infra-docs/issues/9
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-13 22:25:19 +02:00
Jakub Sokołowski
5d36d3ad3e
firewall: use new IP sets and iptables chains
...
https://github.com/status-im/infra-hq/issues/69
https://github.com/status-im/infra-role-bootstrap-linux/commit/92d8923b
https://github.com/status-im/infra-role-wireguard/commit/8394639e
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-11 19:54:36 +02:00
Jakub Sokołowski
1ff378d392
update WireGuard config files layout
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-29 18:57:45 +02:00
Jakub Sokołowski
95261d2d10
ansible/cleanup: drop removing backups, remove nginx logs
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-29 18:57:42 +02:00
Jakub Sokołowski
6375725d87
deploy rpc.sh wrapper for windows beacon nodes
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-29 09:32:12 +02:00
Jakub Sokołowski
4384f62e5f
rename infra-role-bootstrap-linux, upgrde consul
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-28 12:29:01 +02:00
Jakub Sokołowski
3e32ec1ba9
migrate bootstrap secrets to BitWarden
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-28 12:02:03 +02:00
Jakub Sokołowski
c3a8883662
upgrade Geth to 1.10.6 for the London hard-fork
...
https://github.com/ethereum/go-ethereum/releases/tag/v1.10.6
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-22 19:44:24 +02:00
Jakub Sokołowski
8943576ddf
remove 3 Prater hosts that donated validators to windows
...
https://github.com/status-im/infra-nimbus/issues/59
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-19 17:11:20 +02:00
Jakub Sokołowski
4a7ab275a5
move validators from 04 Pyrmont hosts to one windows host
...
https://github.com/status-im/infra-nimbus/issues/59
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-19 16:48:08 +02:00
Jakub Sokołowski
a3ae9a36ee
remove unused Pyrmont fleet host_vars files
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-19 16:44:31 +02:00
Jakub Sokołowski
c8c1b4faa8
pyrmont: fix duplicate dist-validators variable
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-19 16:44:04 +02:00
Jakub Sokołowski
7c1199f4c0
decomission old AWS Pyrmont hosts
...
https://github.com/status-im/infra-nimbus/issues/65
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-19 13:04:05 +02:00
Jakub Sokołowski
32baf5e4b7
migrate Pyrmont fleet to Hetzner metal hosts
...
https://github.com/status-im/infra-nimbus/issues/65
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-19 12:33:23 +02:00
Jakub Sokołowski
87d23f8fa1
deploy 3 beacon nodes on all Pyrmont metal hosts
...
https://github.com/status-im/infra-nimbus/issues/59
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-15 20:15:58 +02:00
Jakub Sokołowski
df96f214cd
add 4 metal Hetzner hosts for Pyrmont migration
...
https://github.com/status-im/infra-nimbus/issues/65
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-15 13:51:41 +02:00
Jakub Sokołowski
4fc3ac2689
beacon-node-builds: fix nightly tag clobbering issue
...
Using single_branch:true avoids cloning other tags/branches.
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-14 16:19:52 +02:00
Jakub Sokołowski
eb1fea5716
upgrade deploy-eth2-prod image to v1.4.1
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-14 15:37:45 +02:00
Jakub Sokołowski
8f05a0191c
prater: add service user pass and facts path for windows
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-14 14:59:40 +02:00
Jakub Sokołowski
7d76f4b39e
drop all 05 prater nodes in favor of Hetzner host
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-30 22:50:29 +02:00
Jakub Sokołowski
b5f75078f3
move validators from prater 05 hosts to Hetzner host
...
https://github.com/status-im/infra-nimbus/issues/52
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-30 22:48:36 +02:00
Jakub Sokołowski
bdab0a2f8b
deploy prater nodes on hetzner node
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 21:30:00 +02:00
Jakub Sokołowski
a9dfaa12a3
give extra users admin rights on the windows hosts
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 18:02:45 +02:00
Jakub Sokołowski
f0f5f32e8a
drop group_vars files in favor of generating container tags
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 17:32:00 +02:00
Jakub Sokołowski
a99a6d0fc6
refactor to distribute validators via beacon-node role
...
This way we can deploy multiple nodes on the same host.
https://github.com/status-im/infra-nimbus/issues/52
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 16:43:27 +02:00
Jakub Sokołowski
5122d41a99
move distribute-validators role to a separate repo
...
https://github.com/status-im/infra-role-dist-validators
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 16:40:48 +02:00
Jakub Sokołowski
432623b74d
rename Hetzner host to just metal-01
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 16:39:45 +02:00
Jakub Sokołowski
054c5c2d26
ansible/requirements: update bootstrap and winsw
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 09:52:38 +02:00
Jakub Sokołowski
db456f7f5c
upgrade Terraform to 1.0, upgrade all providers
...
https://www.terraform.io/upgrade-guides/0-15.html
https://www.terraform.io/upgrade-guides/1-0.html
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-23 11:48:43 +02:00
cheatfate
3a3d52a156
Add cheatfate's SSH account.
2021-06-22 13:02:33 +02:00
Arthur Koziel
0a75a69a09
Deploy mainnet beacon nodes on hetzner server
...
This will run multiple mainnet beacon nodes on the hetzner server. It
will use the `infra-role-beacon-node-linux` to build and run `stable`,
`unstable` and `testing` on the machine.
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-22 12:29:01 +02:00
Jakub Sokołowski
31232a0b2c
beacon-node-builds: upgrade eth2 fleet to 1.4.0
...
https://github.com/status-im/nimbus-eth2/releases/tag/v1.4.0
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-22 11:53:20 +02:00
Jakub Sokołowski
3d522beb2f
windows: use non-core image with full GUI for debugging
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-21 19:36:11 +02:00
Jakub Sokołowski
13b27db54d
windows: configure running multiple beacon nodes
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-16 15:41:50 +02:00
Jakub Sokołowski
ddc91ed233
beacon-node-builds: make build failures just a warning
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-16 10:50:52 +02:00
Jakub Sokołowski
23af824b2b
ansible/requirements.yml: add fix for consul handler errors
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-14 17:20:50 +02:00
Jakub Sokołowski
f24c714b49
beacon-node-builds: fix apt-get stdout redirection
...
The & character breaks the command in /bin/sh shell.
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-14 16:09:46 +02:00
Jakub Sokołowski
133a30c1b6
deploy 4GB SWAP files to build hosts
...
We've been seeing build failures due to OOM killer.
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-14 10:17:33 +02:00
Jakub Sokołowski
fcb8db90fd
add missing password for nimbus windows user
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-11 16:52:26 +02:00
Jakub Sokołowski
f4a20bc128
fix password format used for root
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-11 11:18:10 +02:00
Tanguy Cizain
cae0195d03
add tanguy's key
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-11 11:15:35 +02:00
Jakub Sokołowski
8468615f7d
deploy one Nimbus Prater node on Windows host
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-10 18:09:05 +02:00
Jakub Sokołowski
809c4ce355
ansible/inventory/test: add windows-01 host
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-09 23:04:13 +02:00
Jakub Sokołowski
b5cbe7fa4d
provision windows-01.gc-us-central1-a.nimbus.prater
...
https://github.com/status-im/infra-nimbus/issues/59
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-02 14:37:32 +02:00
Jakub Sokołowski
39f9b71dff
beacon-node-builds: add vim: ft=sh for buils.sh
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-01 21:26:42 +02:00
Jakub Sokołowski
38745d0495
ansible/requirements: bump bootstrap so watchtower fixes containers
...
We've added flags so that containers are fixed even when stuck in `Restarting...`:
https://github.com/status-im/infra-role-bootstrap/commit/c9bdc2ba
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-26 11:50:02 +02:00
Jakub Sokołowski
47f500e1ad
beacon-node-builds: refactor to rebuild after failures
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-21 00:38:03 +02:00
Jakub Sokołowski
ee9f8a74b7
bump beacon-node role and others to use WireGuard
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-19 23:03:14 +02:00
Jakub Sokołowski
fd9c93a5f7
deploy-eth2-prod: bump to v1.3.0
...
https://github.com/status-im/nimbus-eth2/releases/tag/v1.3.0
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-19 18:33:19 +02:00
Jakub Sokołowski
e3171c98a9
use WireGuard instead of Tinc VPN for metrics
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-19 14:12:47 +02:00
Arthur Koziel
fb2ab82f6d
Add hetzner dedicated server ( #56 )
...
add stable-metal-01.he-eu-hel1.nimbus.mainnet
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-05-19 18:04:12 +08:00
Arthur Koziel
04648b6465
Scan all DC's for Geth nodes ( #57 )
...
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-05-19 17:54:46 +08:00
Jakub Sokołowski
2047fe1702
ansible/requirements: bump origin-certs role
...
https://github.com/status-im/infra-role-origin-certs/commit/586d81d6
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-13 10:53:51 +02:00
Jakub Sokołowski
0a38a4642d
rayonism: increase Geth node verbosity to detail
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-12 14:35:16 +02:00
Jakub Sokołowski
9bf2e03137
move secrets from service to services
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 15:37:45 +02:00
Jakub Sokołowski
87695af8bc
rayonism: disable discovery and add --networkid=5
...
No idea why.
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 12:23:41 +02:00
Jakub Sokołowski
6c0b62a6a8
rayonism: adjust location of rpc.sh wrapper
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 12:23:28 +02:00
Jakub Sokołowski
f933dd0df8
rayonism: put Geth config in the same folder as Beacon node
...
This way we create both as part of the same Docker network.
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 11:59:34 +02:00
Jakub Sokołowski
23dc761b41
rayonism: use WebSocket instead of HTTp for RPC
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 11:33:31 +02:00
Jakub Sokołowski
e20bbb1c48
rayonism: replace steklo testnet with nocturne
...
Changes done according to:
https://github.com/status-im/infra-nimbus/issues/54
For more details see:
https://github.com/protolambda/nocturne
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 10:42:11 +02:00
Jakub Sokołowski
c6c7159e94
distribute-validators: create container folder if missing
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 10:41:52 +02:00
Jakub Sokołowski
d7930a8437
ansible/requirements: bump bootstrap and elasticsearch roles
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 10:31:33 +02:00
Jakub Sokołowski
657e8a098f
ansible: add meta requirements target, add check to bootstrap
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-10 15:29:38 +02:00
Jakub Sokołowski
e50e7f7764
drop legacy beacon_node_web3_url variable
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-06 15:40:38 +02:00
Jakub Sokołowski
1283cec6ee
ansible/requirements: update oauth-proxy rol
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-06 11:17:56 +02:00
Jakub Sokołowski
02b70ee6f0
rayonism: un-comment validators layout
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-30 14:16:49 +02:00
Jakub Sokołowski
6d832ae5c3
rayonism: set debug log level for geth node
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-30 11:33:53 +02:00
Jakub Sokołowski
518726e5f6
rayonism: use http:// instead of ws:// for web3 url
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-30 11:29:31 +02:00
Jakub Sokołowski
1b54f4e1ca
rayonism: update image, enable consensus API module
...
https://github.com/status-im/infra-nimbus/issues/53
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-29 19:29:14 +02:00
Jakub Sokołowski
97db7ea804
rayonism: deploy beacon node for steklo testnet
...
https://github.com/status-im/infra-nimbus/issues/53
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-29 15:14:25 +02:00
Jakub Sokołowski
6b8245ad63
rayonism: add build configuration for quick-merge-v1 branch
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-29 14:42:54 +02:00
Jakub Sokołowski
1ce2b2c7fb
rayonism: deploy Geth node for steklo testnet
...
https://github.com/status-im/infra-nimbus/issues/53
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-29 14:35:06 +02:00
Jakub Sokołowski
ba8644873b
deploy qmerge-large-01.aws-eu-central-1a.nimbus.rayonism
...
For more details see:
https://github.com/status-im/infra-nimbus/issues/53
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-29 13:53:43 +02:00
Jakub Sokołowski
04f9fe30ca
add stable-hetzner-01.he-hel1.nimbus.prater to inventory
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-29 12:14:38 +02:00
Jakub Sokołowski
3147311722
bump deploy-eth2-prod build to 1.2.1
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-20 20:13:41 +02:00
Jakub Sokołowski
65d8302527
implement Eth1 Web3 URL fallbacks
...
Related:
https://github.com/status-im/infra-role-beacon-node/commit/92f740e0
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-19 20:27:52 +02:00
Jakub Sokołowski
762f4e3457
requirements: bump bootstrap role version
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-14 16:18:03 +02:00
Zahary Karadjov
8e26b95157
Use the default slashing DB kind
2021-04-14 15:37:05 +02:00
Arthur Koziel
65dca92c13
update ansible for libp2p-stable/unstable
...
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-04-13 16:17:13 +08:00
Jakub Sokołowski
45241a5a15
beacon-node-builds: drop use of -d:insecure
...
No longer necessary due to new secure HTTP backend:
https://github.com/status-im/nimbus-eth2/releases/tag/v1.1.0
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-13 08:07:49 +02:00
Jakub Sokołowski
757b097c81
add versioncheck.py script to verify Ansible role versions
...
Since Ansible or Ansible Galaxy doesn't actually check role versions
itself, we have to do it ourselves. This script goes through contents of
`ansible/requirements.txt` and verifies each role is installed and has
correct version.
It also checks the version of Ansible itself.
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-13 08:07:26 +02:00
Jakub Sokołowski
3c0fe9e8fb
beacon-node-builds: fix systemd timer service group not existing
...
Fixes:
Failed to determine group credentials: No such process
Failed at step GROUP spawning /data/beacon-node-builds/unstable-small/build.sh: No such process
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-07 09:23:50 +02:00
Arthur Koziel
d9c21f7d5b
add terraform module for libp2p-unstable
...
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-04-02 15:00:02 +08:00
Arthur Koziel
6d9fcf4a20
rename prater-libp2p to prater-unstable-libp2p-stable
...
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-04-02 11:42:10 +08:00
Arthur Koziel
91c03ecb80
rename build for libp2p-stable, add libp2p-unstable build
...
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-04-01 18:48:48 +08:00
Arthur Koziel
0e7fd54d09
rename host libp2p-large to u-libp2p-s-large
...
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-04-01 18:46:32 +08:00
Arthur Koziel
fe3ed92b98
fix ws url for goerli
...
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-04-01 18:28:53 +08:00
Jakub Sokołowski
dd6bcc515d
geth-goerli: increase container memory limit to 80%
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-30 18:52:39 +02:00
Jakub Sokołowski
dbce2ffc5d
deploiy new Docker Compose setup for Geth nodes
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-29 13:42:06 +02:00
Jakub Sokołowski
6afc2bfa97
ansible/cleanup.yml: add cleanup of docker images
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-25 21:45:06 +01:00
Zahary Karadjov
b03dbdb5c6
Increase the --max-peers count on all fleet nodes
...
This setting is recommended due to the high-number of validators
attached to each node which requires maintaining healthy peer
counts on a larger number of gossip topics. For now, we don't
bother specifying a lower value on the servers running a lower
number of validators in order to simplify the implementation.
2021-03-23 17:53:58 +08:00
Arthur Koziel
2088c0c92b
set beacon_node_subscribe_all and beacon_node_netkey for prater bootnodes
...
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-03-23 17:44:55 +08:00
Arthur Koziel
48e2766741
build libp2p-large docker image on pyrmont testing-large-01
...
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-03-23 13:50:24 +08:00
Jakub Sokołowski
ff48a961b5
update inventory with prater hosts
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-22 15:38:54 +01:00
Jakub Sokołowski
db5ec2f497
bootstrap: provide Consul encryption key from infra-pass
...
Related: https://github.com/status-im/infra-role-bootstrap/commit/0d40f81d
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-22 11:12:49 +01:00
Arthur Koziel
662e456d06
add config for prater testnet
...
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-03-19 16:18:16 +08:00
Jakub Sokołowski
c07aca5aa3
beacon-node-builds: upgrade eth2 to v1.0.10
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-11 17:28:17 +01:00
Jakub Sokołowski
a0b0fa87d3
enable --subscribe-all-subnets for Mainnet bootnodes
...
https://github.com/status-im/infra-nimbus/issues/38
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-08 15:10:16 +01:00
Jakub Sokołowski
d88c8b44fc
beacon-node-builds: relax the sudoers regex for systemctl
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-03 08:46:37 +01:00
Jakub Sokołowski
9153bb02f1
logclean-job: fix bug in script that deletes newer first
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-27 15:37:49 +01:00
Jakub Sokołowski
b1ad100a50
logclean-job: increase timer timeout to 5 minutes
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-27 15:26:53 +01:00
Jakub Sokołowski
d31094d85c
logclean-job: reduce kept ES indices to 20
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-27 15:24:34 +01:00
Jakub Sokołowski
aee3b5eff5
beacon-node-builds: allow for repo updates for select builds
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-22 21:37:38 +01:00
Jakub Sokołowski
f931c3cde1
upgrade eth2 image to 1.0.8
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-22 17:55:20 +01:00
Jakub Sokołowski
dd70e0652d
beacon-node-builds: add commit to labels
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-22 16:05:56 +01:00
Jakub Sokołowski
a269c3e490
distribute-validators: add --delete for rsyncing secrets
...
Also drop some debug messages, comment out ignore_errors.
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-22 15:49:05 +01:00
Jakub Sokołowski
73bde9a51a
add any_errors_fatal:true to avoid duplicate validators
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-22 15:48:51 +01:00
Zahary Karadjov
4668266eb6
Specify the double-checking slashing DB mode on all large servers
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-22 15:16:47 +01:00
Zahary Karadjov
f887391f04
More varied validator assignments
2021-02-22 15:14:16 +01:00
Jakub Sokołowski
8dfe06a9bd
change testing branch build to 6am
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-22 15:09:28 +01:00
Jakub Sokołowski
a40c0ab49c
geth-goerli: increase cache size from default 1GB to 2GB
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-12 23:06:04 +01:00
Jakub Sokołowski
bb1e3ff3ba
bump size of Goerli Geth node to t3a.large
...
It keeps hitting memory limits and failing to sync.
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-12 22:58:42 +01:00
Jakub Sokołowski
a5a950bb91
set become=false in ansible.cfg, set it to true in playbooks
...
See: https://github.com/status-im/nimbus-private/pull/9
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-09 20:27:13 +01:00
Jakub Sokołowski
0e82fa7c03
beacon-node-builds: don't update git branch when deploying
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-09 18:35:32 +01:00
Jakub Sokołowski
4cdd5f01ce
increase Goerli container memory limit to 80%
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-09 18:32:11 +01:00
Jakub Sokołowski
d8b643fd74
add SSH users to systemd-journal group
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-08 12:36:14 +01:00
Jakub Sokołowski
f96fe517e7
beacon-node-builds: allow staff group membets to start builds
...
I was thinking of defining the jobs as nimbus user systemd units, but
that would not work unless nimbus user logged in at least once.
And Systemd services have no functionality for allowing non-root users
to start/stop/restart system services, so sudo is the simplest way.
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-08 12:36:02 +01:00
Jakub Sokołowski
8e0966fb0e
beacon-node-builds: don't fetch if we're on a detached head
...
Causes failures when a tag is checked out, nothing to fetch.
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-04 23:48:26 +01:00
zah
33ba3b1e8b
Upgrade the production fleet to 1.0.7
2021-02-04 21:41:22 +01:00
Jakub Sokołowski
b7226818d3
disable kibana-logtrail, it's not been updated to 7.10.2
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-01 16:05:50 +01:00
Jakub Sokołowski
dbac764185
upgrade ElasticSearch to 7.10.2
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-01 15:57:10 +01:00
Jakub Sokołowski
157d215230
specify beacon_node_netkey for nimbus-mainnet-small bootnodes
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-29 13:26:55 +01:00
Jakub Sokołowski
26a31c5d63
use 8000+ UIDs for extra SSH users to not clash with core
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-26 12:11:33 +01:00
Jakub Sokołowski
8f76c6810a
log-store: fix mounting of data volumes
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-25 15:08:34 +01:00
Jakub Sokołowski
62f44b8a05
drop old fleet from group and host vars and pyrmont playbook
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-22 15:59:47 +01:00
Jakub Sokołowski
49bd1fa267
remove old pyrmont fleet, move new one back to pyrmont.tf
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-22 15:56:26 +01:00
Jakub Sokołowski
8aa381ca2e
update names in inventory for nimbus.mainnet hosts
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-22 15:46:04 +01:00
Jakub Sokołowski
84be761116
fix hostname in nimbus-pyrmont-unstable-libp2p validators layout
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-22 15:19:58 +01:00
Jakub Sokołowski
37c1c62a5d
add validators distributio for the new fleet
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-22 14:27:39 +01:00
Jakub Sokołowski
8ad0027936
log-store: add 2GB swap files to hosts
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-20 20:35:33 +01:00
Jakub Sokołowski
6e138997e2
re-enable sending logs to logstash
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-20 19:27:04 +01:00
Jakub Sokołowski
45a0315bb0
deploy elasticsearch and a kibana dashboard
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-20 16:00:29 +01:00
Jakub Sokołowski
ef8e77a1ac
re-add the ELK stack hosts
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-20 15:59:11 +01:00
Jakub Sokołowski
67ebb93be3
fix wrong build nodes listed in playbook
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-18 19:53:52 +01:00
Jakub Sokołowski
0bc722ca21
dist-validators: don't run any tasks if no layout is defined
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-18 19:47:51 +01:00
Jakub Sokołowski
89dfe7ca5c
add new fleet hosts to inventory
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-18 19:35:03 +01:00
Jakub Sokołowski
2b44636cd6
create new pyrmont fleet using new branch naming
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-18 19:04:10 +01:00
Jakub Sokołowski
05684f23b1
drop unused toledor and maste references
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-18 16:52:40 +01:00
Jakub Sokołowski
2132851b16
use bootstrap__active_extra_users variable
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-14 14:01:57 +01:00
Jakub Sokołowski
ab017c29bb
update inventory
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-13 17:07:31 +01:00
Ștefan Talpalaru
e71d1643b8
beacon-node-builds: support core dumps
...
- build with "-d:noSignalHandler" in NIMFLAGS
- keep binary copies for a week, so we can use them with core dumps on
target hosts
- finish replacing "item.branch" with "item.version"
- manually add a [nimbus-master] section to "ansible/inventory/test"
2020-12-18 21:56:32 +02:00
Jakub Sokołowski
8dc1db8f0b
nimbus-builds: add release build for eth2.prod fleet
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-12-11 18:44:34 +01:00
Jakub Sokołowski
6ecba424d1
drop useless debug task
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-12-04 18:27:17 +01:00
Jakub Sokołowski
48529cb841
use Infura for Web3 on master-large-01 on Pyrmont for comparison
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-12-04 18:26:05 +01:00
Jakub Sokołowski
9c5abd392a
allow VPN connections to Goerli/Mainnet WebSocket API
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-12-04 18:20:05 +01:00
Jakub Sokołowski
989aeacb51
use Geth Goerli WebSocket endpoint for Pyrmont fleet
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-12-04 13:09:48 +01:00
Jakub Sokołowski
65f0d944d8
bump max logs for logrotate to 72
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-26 21:30:32 +01:00
Jakub Sokołowski
996e2df2e8
make docker log files contain only container messages
...
See: https://github.com/status-im/infra-nimbus/issues/26
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-26 19:06:08 +01:00
Jakub Sokołowski
796c7ce292
bump count of logrotate files to keep to 24
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-26 18:30:05 +01:00
Jakub Sokołowski
176d843a40
drop toledo hosts
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-26 17:06:35 +01:00
Jakub Sokołowski
eb44131dc6
add configuration for nimbus.mainnet bootstrap nodes
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-25 15:58:44 +01:00
Jakub Sokołowski
43e8379ad6
deploy 2 small hosts for mainnet bootnodes
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-25 15:50:22 +01:00
Jakub Sokołowski
57dce5d830
fix sync types for networks
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-24 17:18:21 +01:00
Jakub Sokołowski
8441dafbbf
configure Geth Mainnet fast sync node
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-24 16:30:03 +01:00
Jakub Sokołowski
dfa0f20bdc
deplo a nimbus.geth host for mainnet sync
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-24 16:07:21 +01:00
Jakub Sokołowski
3b8ca79a44
enable WebSocket API for Geth Goerli node
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-24 15:43:10 +01:00
Jakub Sokołowski
d0a7c82d24
configure Goerli full sync on nimbus.geth node
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-24 14:44:50 +01:00
Jakub Sokołowski
41cb7720c5
deploy a nimbus.geth node for goerli network
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-24 14:44:49 +01:00
Jakub Sokołowski
7901c37c58
switch toledo to using devel-small branch
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 22:59:12 +01:00
Jakub Sokołowski
cef9441279
beacon-node-builds: drop pushing each commit
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 17:33:03 +01:00
Jakub Sokołowski
f089923acd
switch to using containers based on host type
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 17:33:03 +01:00
Jakub Sokołowski
afd230007f
beacon-node-builds: use the git_config resource
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 17:16:15 +01:00
Jakub Sokołowski
3eacfc36c7
beacon-node-builds: use docker_login resource
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 17:13:01 +01:00
Jakub Sokołowski
9fa06b2590
move build mater hosts to host_vars
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:54:24 +01:00
Jakub Sokołowski
318e56bd04
beacon-node-builds: run with -j1 to not disturb containers
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:45:51 +01:00
Jakub Sokołowski
21a41cb1ed
drop unused variables, don't re-create containers every time
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:45:51 +01:00
Jakub Sokołowski
6b88b720d9
fix typo in group names, drop master
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:45:51 +01:00
Jakub Sokołowski
5455ec8f7c
distribute-validators: remove before copying validators
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:37:49 +01:00
Jakub Sokołowski
cf19d74410
add README missing from ansible/inventory folder
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:05:11 +01:00
Jakub Sokołowski
9ce7995256
move variables to individual group_vars files
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:05:10 +01:00
Jakub Sokołowski
1f39b846ad
move builds to existing master pyrmont hosts
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:05:10 +01:00
Jakub Sokołowski
754f796871
drop the master host as well
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:05:10 +01:00
Jakub Sokołowski
68f357521d
change pyrmont host groups for cleaner playbook
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:05:09 +01:00
Jakub Sokołowski
8f4f4d69bd
remove old medalla hosts from inventory
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 15:10:55 +01:00
Jakub Sokołowski
1a5ca8ab59
beacon-node-builds: drop building nimbus_beacon_node_spec_0_12_3
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 14:54:36 +01:00
Jakub Sokołowski
3c2089ec82
update validators distribution for new layout of hosts
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 14:52:07 +01:00
Jakub Sokołowski
1caaddb924
remove to old medalla fleet
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 14:51:31 +01:00
Jakub Sokołowski
521706c31c
update hostnames for validators distribution
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 13:55:13 +01:00
Jakub Sokołowski
d0f852adce
implement new layout and naming of pyrmont hosts
...
This is done in advance of resizing andlayout changes.
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 13:51:38 +01:00
Zahary Karadjov
ee0a8a55d4
Use dedicated Infura accounts for the Pyrmont fleet
2020-11-20 09:30:41 +02:00
Jakub Sokołowski
3888da1e6e
set beacon node infura web3 url from infra-pass
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-19 23:00:44 +01:00
Jakub Sokołowski
b57c46cf0a
distribute-validators: adjust ownership before chmod
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 16:26:16 +01:00
Jakub Sokołowski
b06078cf7d
drop setting beacon_node_network from nimbus.test.yml
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 16:11:43 +01:00
Jakub Sokołowski
bce497758b
distribute-validators: wildcards don't work in single quotes
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 15:47:18 +01:00
Jakub Sokołowski
f79d65f7c9
beacon-node-builds: bump timeout to 60 minutes
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 15:07:15 +01:00
Jakub Sokołowski
a11e60cc93
distribute-validators: make sure dist_validators_range has a value
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 14:01:21 +01:00
Jakub Sokołowski
e43f66f965
make sure toledo uses correct entrypoint
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 13:53:21 +01:00
Jakub Sokołowski
c858cdb577
configure pyrmont distribution of validators and branch layout
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 13:40:13 +01:00
Jakub Sokołowski
6d1915adfd
set medalla entrypoint to be nimbus_beacon_node_spec_0_12_3
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 13:39:32 +01:00
Jakub Sokołowski
8c68e3b56c
build nimbus_beacon_node also for master,devel,libp2p
...
This is necessary for the new pyrmont network.
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 13:36:21 +01:00
Jakub Sokołowski
32f6f9e408
deploy 10 hosts for pyrmont testnet
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 13:25:39 +01:00
Jakub Sokołowski
d3116a8f0b
move toledo host config to separate group_vars and playbook
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 13:25:38 +01:00
Jakub Sokołowski
81857071de
distibute-validators: adjust permissions setting for secrets
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-12 13:29:34 +01:00
Jakub Sokołowski
2930e4456d
distribute-validators: add assert to check overlap of secrets
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-12 12:32:37 +01:00
Jakub Sokołowski
890784ae1d
distribute-validators: fix adjusting permissions
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-12 12:09:20 +01:00
Jakub Sokołowski
64b7736d85
distribute-validators: fix order of copied validators and secrets
...
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-12 11:52:09 +01:00
Ștefan Talpalaru
ffa65e00e0
build.sh: deal with Git history being changed upstream
...
and some drive-by improvements
2020-11-12 11:13:19 +01:00