status-im
/
infra-nimbus
mirror of https://github.com/status-im/infra-nimbus.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
336 Commits 11 Branches 0 Tags 30 MiB
Commit Graph

271 Commits

Author SHA1 Message Date
Jakub Sokołowski ff48a961b5
update inventory with prater hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-03-22 15:38:54 +01:00
Jakub Sokołowski db5ec2f497
bootstrap: provide Consul encryption key from infra-pass 
Related: https://github.com/status-im/infra-role-bootstrap/commit/0d40f81d

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-03-22 11:12:49 +01:00
Arthur Koziel 662e456d06
add config for prater testnet 
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-03-19 16:18:16 +08:00
Jakub Sokołowski c07aca5aa3
beacon-node-builds: upgrade eth2 to v1.0.10 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-03-11 17:28:17 +01:00
Jakub Sokołowski a0b0fa87d3
enable --subscribe-all-subnets for Mainnet bootnodes 
https://github.com/status-im/infra-nimbus/issues/38

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-03-08 15:10:16 +01:00
Jakub Sokołowski d88c8b44fc
beacon-node-builds: relax the sudoers regex for systemctl 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-03-03 08:46:37 +01:00
Jakub Sokołowski 9153bb02f1
logclean-job: fix bug in script that deletes newer first 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-27 15:37:49 +01:00
Jakub Sokołowski b1ad100a50
logclean-job: increase timer timeout to 5 minutes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-27 15:26:53 +01:00
Jakub Sokołowski d31094d85c
logclean-job: reduce kept ES indices to 20 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-27 15:24:34 +01:00
Jakub Sokołowski aee3b5eff5
beacon-node-builds: allow for repo updates for select builds 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-22 21:37:38 +01:00
Jakub Sokołowski f931c3cde1
upgrade eth2 image to 1.0.8 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-22 17:55:20 +01:00
Jakub Sokołowski dd70e0652d
beacon-node-builds: add commit to labels 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-22 16:05:56 +01:00
Jakub Sokołowski a269c3e490
distribute-validators: add --delete for rsyncing secrets 
Also drop some debug messages, comment out ignore_errors.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-22 15:49:05 +01:00
Jakub Sokołowski 73bde9a51a
add any_errors_fatal:true to avoid duplicate validators 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-22 15:48:51 +01:00
Zahary Karadjov 4668266eb6
Specify the double-checking slashing DB mode on all large servers 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-22 15:16:47 +01:00
Zahary Karadjov f887391f04 More varied validator assignments 2021-02-22 15:14:16 +01:00
Jakub Sokołowski 8dfe06a9bd
change testing branch build to 6am 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-22 15:09:28 +01:00
Jakub Sokołowski a40c0ab49c
geth-goerli: increase cache size from default 1GB to 2GB 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-12 23:06:04 +01:00
Jakub Sokołowski bb1e3ff3ba
bump size of Goerli Geth node to t3a.large 
It keeps hitting memory limits and failing to sync.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-12 22:58:42 +01:00
Jakub Sokołowski a5a950bb91
set become=false in ansible.cfg, set it to true in playbooks 
See: https://github.com/status-im/nimbus-private/pull/9

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-09 20:27:13 +01:00
Jakub Sokołowski 0e82fa7c03
beacon-node-builds: don't update git branch when deploying 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-09 18:35:32 +01:00
Jakub Sokołowski 4cdd5f01ce
increase Goerli container memory limit to 80% 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-09 18:32:11 +01:00
Jakub Sokołowski d8b643fd74
add SSH users to systemd-journal group 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-08 12:36:14 +01:00
Jakub Sokołowski f96fe517e7
beacon-node-builds: allow staff group membets to start builds 
I was thinking of defining the jobs as nimbus user systemd units, but
that would not work unless nimbus user logged in at least once.

And Systemd services have no functionality for allowing non-root users
to start/stop/restart system services, so sudo is the simplest way.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-08 12:36:02 +01:00
Jakub Sokołowski 8e0966fb0e
beacon-node-builds: don't fetch if we're on a detached head 
Causes failures when a tag is checked out, nothing to fetch.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-04 23:48:26 +01:00
zah 33ba3b1e8b Upgrade the production fleet to 1.0.7 2021-02-04 21:41:22 +01:00
Jakub Sokołowski b7226818d3
disable kibana-logtrail, it's not been updated to 7.10.2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-01 16:05:50 +01:00
Jakub Sokołowski dbac764185
upgrade ElasticSearch to 7.10.2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-01 15:57:10 +01:00
Jakub Sokołowski 157d215230
specify beacon_node_netkey for nimbus-mainnet-small bootnodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-29 13:26:55 +01:00
Jakub Sokołowski 26a31c5d63
use 8000+ UIDs for extra SSH users to not clash with core 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-26 12:11:33 +01:00
Jakub Sokołowski 8f76c6810a
log-store: fix mounting of data volumes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-25 15:08:34 +01:00
Jakub Sokołowski 62f44b8a05
drop old fleet from group and host vars and pyrmont playbook 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 15:59:47 +01:00
Jakub Sokołowski 49bd1fa267
remove old pyrmont fleet, move new one back to pyrmont.tf 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 15:56:26 +01:00
Jakub Sokołowski 8aa381ca2e
update names in inventory for nimbus.mainnet hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 15:46:04 +01:00
Jakub Sokołowski 84be761116
fix hostname in nimbus-pyrmont-unstable-libp2p validators layout 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 15:19:58 +01:00
Jakub Sokołowski 37c1c62a5d add validators distributio for the new fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 14:27:39 +01:00
Jakub Sokołowski 8ad0027936
log-store: add 2GB swap files to hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 20:35:33 +01:00
Jakub Sokołowski 6e138997e2
re-enable sending logs to logstash 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 19:27:04 +01:00
Jakub Sokołowski 45a0315bb0
deploy elasticsearch and a kibana dashboard 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 16:00:29 +01:00
Jakub Sokołowski ef8e77a1ac
re-add the ELK stack hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 15:59:11 +01:00
Jakub Sokołowski 67ebb93be3
fix wrong build nodes listed in playbook 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 19:53:52 +01:00
Jakub Sokołowski 0bc722ca21
dist-validators: don't run any tasks if no layout is defined 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 19:47:51 +01:00
Jakub Sokołowski 89dfe7ca5c
add new fleet hosts to inventory 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 19:35:03 +01:00
Jakub Sokołowski 2b44636cd6
create new pyrmont fleet using new branch naming 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 19:04:10 +01:00
Jakub Sokołowski 05684f23b1
drop unused toledor and maste references 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 16:52:40 +01:00
Jakub Sokołowski 2132851b16
use bootstrap__active_extra_users variable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-14 14:01:57 +01:00
Jakub Sokołowski ab017c29bb
update inventory 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-13 17:07:31 +01:00
Ștefan Talpalaru e71d1643b8 beacon-node-builds: support core dumps 
- build with "-d:noSignalHandler" in NIMFLAGS
- keep binary copies for a week, so we can use them with core dumps on
  target hosts
- finish replacing "item.branch" with "item.version"
- manually add a [nimbus-master] section to "ansible/inventory/test"
 2020-12-18 21:56:32 +02:00
Jakub Sokołowski 8dc1db8f0b
nimbus-builds: add release build for eth2.prod fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-11 18:44:34 +01:00
Jakub Sokołowski 6ecba424d1
drop useless debug task 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-04 18:27:17 +01:00
Jakub Sokołowski 48529cb841
use Infura for Web3 on master-large-01 on Pyrmont for comparison 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-04 18:26:05 +01:00
Jakub Sokołowski 9c5abd392a
allow VPN connections to Goerli/Mainnet WebSocket API 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-04 18:20:05 +01:00
Jakub Sokołowski 989aeacb51
use Geth Goerli WebSocket endpoint for Pyrmont fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-04 13:09:48 +01:00
Jakub Sokołowski 65f0d944d8
bump max logs for logrotate to 72 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-26 21:30:32 +01:00
Jakub Sokołowski 996e2df2e8
make docker log files contain only container messages 
See: https://github.com/status-im/infra-nimbus/issues/26

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-26 19:06:08 +01:00
Jakub Sokołowski 796c7ce292
bump count of logrotate files to keep to 24 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-26 18:30:05 +01:00
Jakub Sokołowski 176d843a40
drop toledo hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-26 17:06:35 +01:00
Jakub Sokołowski eb44131dc6
add configuration for nimbus.mainnet bootstrap nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-25 15:58:44 +01:00
Jakub Sokołowski 43e8379ad6
deploy 2 small hosts for mainnet bootnodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-25 15:50:22 +01:00
Jakub Sokołowski 57dce5d830
fix sync types for networks 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 17:18:21 +01:00
Jakub Sokołowski 8441dafbbf
configure Geth Mainnet fast sync node 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 16:30:03 +01:00
Jakub Sokołowski dfa0f20bdc
deplo a nimbus.geth host for mainnet sync 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 16:07:21 +01:00
Jakub Sokołowski 3b8ca79a44
enable WebSocket API for Geth Goerli node 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 15:43:10 +01:00
Jakub Sokołowski d0a7c82d24
configure Goerli full sync on nimbus.geth node 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 14:44:50 +01:00
Jakub Sokołowski 41cb7720c5
deploy a nimbus.geth node for goerli network 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 14:44:49 +01:00
Jakub Sokołowski 7901c37c58
switch toledo to using devel-small branch 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 22:59:12 +01:00
Jakub Sokołowski cef9441279
beacon-node-builds: drop pushing each commit 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 17:33:03 +01:00
Jakub Sokołowski f089923acd
switch to using containers based on host type 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 17:33:03 +01:00
Jakub Sokołowski afd230007f
beacon-node-builds: use the git_config resource 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 17:16:15 +01:00
Jakub Sokołowski 3eacfc36c7
beacon-node-builds: use docker_login resource 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 17:13:01 +01:00
Jakub Sokołowski 9fa06b2590
move build mater hosts to host_vars 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:54:24 +01:00
Jakub Sokołowski 318e56bd04
beacon-node-builds: run with -j1 to not disturb containers 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:45:51 +01:00
Jakub Sokołowski 21a41cb1ed
drop unused variables, don't re-create containers every time 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:45:51 +01:00
Jakub Sokołowski 6b88b720d9
fix typo in group names, drop master 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:45:51 +01:00
Jakub Sokołowski 5455ec8f7c
distribute-validators: remove before copying validators 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:37:49 +01:00
Jakub Sokołowski cf19d74410
add README missing from ansible/inventory folder 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:05:11 +01:00
Jakub Sokołowski 9ce7995256
move variables to individual group_vars files 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:05:10 +01:00
Jakub Sokołowski 1f39b846ad
move builds to existing master pyrmont hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:05:10 +01:00
Jakub Sokołowski 754f796871
drop the master host as well 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:05:10 +01:00
Jakub Sokołowski 68f357521d
change pyrmont host groups for cleaner playbook 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:05:09 +01:00
Jakub Sokołowski 8f4f4d69bd
remove old medalla hosts from inventory 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 15:10:55 +01:00
Jakub Sokołowski 1a5ca8ab59
beacon-node-builds: drop building nimbus_beacon_node_spec_0_12_3 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 14:54:36 +01:00
Jakub Sokołowski 3c2089ec82
update validators distribution for new layout of hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 14:52:07 +01:00
Jakub Sokołowski 1caaddb924
remove to old medalla fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 14:51:31 +01:00
Jakub Sokołowski 521706c31c
update hostnames for validators distribution 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 13:55:13 +01:00
Jakub Sokołowski d0f852adce
implement new layout and naming of pyrmont hosts 
This is done in advance of resizing andlayout changes.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 13:51:38 +01:00
Zahary Karadjov ee0a8a55d4
Use dedicated Infura accounts for the Pyrmont fleet 2020-11-20 09:30:41 +02:00
Jakub Sokołowski 3888da1e6e
set beacon node infura web3 url from infra-pass 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-19 23:00:44 +01:00
Jakub Sokołowski b57c46cf0a
distribute-validators: adjust ownership before chmod 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 16:26:16 +01:00
Jakub Sokołowski b06078cf7d
drop setting beacon_node_network from nimbus.test.yml 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 16:11:43 +01:00
Jakub Sokołowski bce497758b
distribute-validators: wildcards don't work in single quotes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 15:47:18 +01:00
Jakub Sokołowski f79d65f7c9
beacon-node-builds: bump timeout to 60 minutes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 15:07:15 +01:00
Jakub Sokołowski a11e60cc93
distribute-validators: make sure dist_validators_range has a value 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 14:01:21 +01:00
Jakub Sokołowski e43f66f965
make sure toledo uses correct entrypoint 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 13:53:21 +01:00
Jakub Sokołowski c858cdb577
configure pyrmont distribution of validators and branch layout 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 13:40:13 +01:00
Jakub Sokołowski 6d1915adfd
set medalla entrypoint to be nimbus_beacon_node_spec_0_12_3 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 13:39:32 +01:00
Jakub Sokołowski 8c68e3b56c
build nimbus_beacon_node also for master,devel,libp2p 
This is necessary for the new pyrmont network.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 13:36:21 +01:00
Jakub Sokołowski 32f6f9e408
deploy 10 hosts for pyrmont testnet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 13:25:39 +01:00
Jakub Sokołowski d3116a8f0b
move toledo host config to separate group_vars and playbook 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 13:25:38 +01:00
Jakub Sokołowski 81857071de
distibute-validators: adjust permissions setting for secrets 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-12 13:29:34 +01:00