status-im
/
infra-nimbus
mirror of https://github.com/status-im/infra-nimbus.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
308 Commits 10 Branches 0 Tags 31 MiB
Commit Graph

244 Commits

Author SHA1 Message Date
Jakub Sokołowski dbac764185
upgrade ElasticSearch to 7.10.2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-01 15:57:10 +01:00
Jakub Sokołowski 157d215230
specify beacon_node_netkey for nimbus-mainnet-small bootnodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-29 13:26:55 +01:00
Jakub Sokołowski 26a31c5d63
use 8000+ UIDs for extra SSH users to not clash with core 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-26 12:11:33 +01:00
Jakub Sokołowski 8f76c6810a
log-store: fix mounting of data volumes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-25 15:08:34 +01:00
Jakub Sokołowski 62f44b8a05
drop old fleet from group and host vars and pyrmont playbook 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 15:59:47 +01:00
Jakub Sokołowski 49bd1fa267
remove old pyrmont fleet, move new one back to pyrmont.tf 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 15:56:26 +01:00
Jakub Sokołowski 8aa381ca2e
update names in inventory for nimbus.mainnet hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 15:46:04 +01:00
Jakub Sokołowski 84be761116
fix hostname in nimbus-pyrmont-unstable-libp2p validators layout 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 15:19:58 +01:00
Jakub Sokołowski 37c1c62a5d add validators distributio for the new fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 14:27:39 +01:00
Jakub Sokołowski 8ad0027936
log-store: add 2GB swap files to hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 20:35:33 +01:00
Jakub Sokołowski 6e138997e2
re-enable sending logs to logstash 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 19:27:04 +01:00
Jakub Sokołowski 45a0315bb0
deploy elasticsearch and a kibana dashboard 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 16:00:29 +01:00
Jakub Sokołowski ef8e77a1ac
re-add the ELK stack hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 15:59:11 +01:00
Jakub Sokołowski 67ebb93be3
fix wrong build nodes listed in playbook 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 19:53:52 +01:00
Jakub Sokołowski 0bc722ca21
dist-validators: don't run any tasks if no layout is defined 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 19:47:51 +01:00
Jakub Sokołowski 89dfe7ca5c
add new fleet hosts to inventory 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 19:35:03 +01:00
Jakub Sokołowski 2b44636cd6
create new pyrmont fleet using new branch naming 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 19:04:10 +01:00
Jakub Sokołowski 05684f23b1
drop unused toledor and maste references 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 16:52:40 +01:00
Jakub Sokołowski 2132851b16
use bootstrap__active_extra_users variable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-14 14:01:57 +01:00
Jakub Sokołowski ab017c29bb
update inventory 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-13 17:07:31 +01:00
Ștefan Talpalaru e71d1643b8 beacon-node-builds: support core dumps 
- build with "-d:noSignalHandler" in NIMFLAGS
- keep binary copies for a week, so we can use them with core dumps on
  target hosts
- finish replacing "item.branch" with "item.version"
- manually add a [nimbus-master] section to "ansible/inventory/test"
 2020-12-18 21:56:32 +02:00
Jakub Sokołowski 8dc1db8f0b
nimbus-builds: add release build for eth2.prod fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-11 18:44:34 +01:00
Jakub Sokołowski 6ecba424d1
drop useless debug task 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-04 18:27:17 +01:00
Jakub Sokołowski 48529cb841
use Infura for Web3 on master-large-01 on Pyrmont for comparison 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-04 18:26:05 +01:00
Jakub Sokołowski 9c5abd392a
allow VPN connections to Goerli/Mainnet WebSocket API 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-04 18:20:05 +01:00
Jakub Sokołowski 989aeacb51
use Geth Goerli WebSocket endpoint for Pyrmont fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-04 13:09:48 +01:00
Jakub Sokołowski 65f0d944d8
bump max logs for logrotate to 72 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-26 21:30:32 +01:00
Jakub Sokołowski 996e2df2e8
make docker log files contain only container messages 
See: https://github.com/status-im/infra-nimbus/issues/26

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-26 19:06:08 +01:00
Jakub Sokołowski 796c7ce292
bump count of logrotate files to keep to 24 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-26 18:30:05 +01:00
Jakub Sokołowski 176d843a40
drop toledo hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-26 17:06:35 +01:00
Jakub Sokołowski eb44131dc6
add configuration for nimbus.mainnet bootstrap nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-25 15:58:44 +01:00
Jakub Sokołowski 43e8379ad6
deploy 2 small hosts for mainnet bootnodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-25 15:50:22 +01:00
Jakub Sokołowski 57dce5d830
fix sync types for networks 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 17:18:21 +01:00
Jakub Sokołowski 8441dafbbf
configure Geth Mainnet fast sync node 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 16:30:03 +01:00
Jakub Sokołowski dfa0f20bdc
deplo a nimbus.geth host for mainnet sync 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 16:07:21 +01:00
Jakub Sokołowski 3b8ca79a44
enable WebSocket API for Geth Goerli node 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 15:43:10 +01:00
Jakub Sokołowski d0a7c82d24
configure Goerli full sync on nimbus.geth node 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 14:44:50 +01:00
Jakub Sokołowski 41cb7720c5
deploy a nimbus.geth node for goerli network 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 14:44:49 +01:00
Jakub Sokołowski 7901c37c58
switch toledo to using devel-small branch 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 22:59:12 +01:00
Jakub Sokołowski cef9441279
beacon-node-builds: drop pushing each commit 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 17:33:03 +01:00
Jakub Sokołowski f089923acd
switch to using containers based on host type 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 17:33:03 +01:00
Jakub Sokołowski afd230007f
beacon-node-builds: use the git_config resource 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 17:16:15 +01:00
Jakub Sokołowski 3eacfc36c7
beacon-node-builds: use docker_login resource 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 17:13:01 +01:00
Jakub Sokołowski 9fa06b2590
move build mater hosts to host_vars 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:54:24 +01:00
Jakub Sokołowski 318e56bd04
beacon-node-builds: run with -j1 to not disturb containers 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:45:51 +01:00
Jakub Sokołowski 21a41cb1ed
drop unused variables, don't re-create containers every time 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:45:51 +01:00
Jakub Sokołowski 6b88b720d9
fix typo in group names, drop master 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:45:51 +01:00
Jakub Sokołowski 5455ec8f7c
distribute-validators: remove before copying validators 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:37:49 +01:00
Jakub Sokołowski cf19d74410
add README missing from ansible/inventory folder 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:05:11 +01:00
Jakub Sokołowski 9ce7995256
move variables to individual group_vars files 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:05:10 +01:00
Jakub Sokołowski 1f39b846ad
move builds to existing master pyrmont hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:05:10 +01:00
Jakub Sokołowski 754f796871
drop the master host as well 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:05:10 +01:00
Jakub Sokołowski 68f357521d
change pyrmont host groups for cleaner playbook 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:05:09 +01:00
Jakub Sokołowski 8f4f4d69bd
remove old medalla hosts from inventory 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 15:10:55 +01:00
Jakub Sokołowski 1a5ca8ab59
beacon-node-builds: drop building nimbus_beacon_node_spec_0_12_3 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 14:54:36 +01:00
Jakub Sokołowski 3c2089ec82
update validators distribution for new layout of hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 14:52:07 +01:00
Jakub Sokołowski 1caaddb924
remove to old medalla fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 14:51:31 +01:00
Jakub Sokołowski 521706c31c
update hostnames for validators distribution 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 13:55:13 +01:00
Jakub Sokołowski d0f852adce
implement new layout and naming of pyrmont hosts 
This is done in advance of resizing andlayout changes.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 13:51:38 +01:00
Zahary Karadjov ee0a8a55d4
Use dedicated Infura accounts for the Pyrmont fleet 2020-11-20 09:30:41 +02:00
Jakub Sokołowski 3888da1e6e
set beacon node infura web3 url from infra-pass 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-19 23:00:44 +01:00
Jakub Sokołowski b57c46cf0a
distribute-validators: adjust ownership before chmod 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 16:26:16 +01:00
Jakub Sokołowski b06078cf7d
drop setting beacon_node_network from nimbus.test.yml 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 16:11:43 +01:00
Jakub Sokołowski bce497758b
distribute-validators: wildcards don't work in single quotes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 15:47:18 +01:00
Jakub Sokołowski f79d65f7c9
beacon-node-builds: bump timeout to 60 minutes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 15:07:15 +01:00
Jakub Sokołowski a11e60cc93
distribute-validators: make sure dist_validators_range has a value 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 14:01:21 +01:00
Jakub Sokołowski e43f66f965
make sure toledo uses correct entrypoint 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 13:53:21 +01:00
Jakub Sokołowski c858cdb577
configure pyrmont distribution of validators and branch layout 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 13:40:13 +01:00
Jakub Sokołowski 6d1915adfd
set medalla entrypoint to be nimbus_beacon_node_spec_0_12_3 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 13:39:32 +01:00
Jakub Sokołowski 8c68e3b56c
build nimbus_beacon_node also for master,devel,libp2p 
This is necessary for the new pyrmont network.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 13:36:21 +01:00
Jakub Sokołowski 32f6f9e408
deploy 10 hosts for pyrmont testnet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 13:25:39 +01:00
Jakub Sokołowski d3116a8f0b
move toledo host config to separate group_vars and playbook 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 13:25:38 +01:00
Jakub Sokołowski 81857071de
distibute-validators: adjust permissions setting for secrets 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-12 13:29:34 +01:00
Jakub Sokołowski 2930e4456d
distribute-validators: add assert to check overlap of secrets 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-12 12:32:37 +01:00
Jakub Sokołowski 890784ae1d
distribute-validators: fix adjusting permissions 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-12 12:09:20 +01:00
Jakub Sokołowski 64b7736d85
distribute-validators: fix order of copied validators and secrets 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-12 11:52:09 +01:00
Ștefan Talpalaru ffa65e00e0 build.sh: deal with Git history being changed upstream 
and some drive-by improvements
 2020-11-12 11:13:19 +01:00
Jakub Sokołowski b452c6cddc
beacon-node-builds: update readme, add start example 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 17:02:50 +01:00
Jakub Sokołowski 055c74aa52
beacon-node-builds: set entrypoint based on targets 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 15:39:24 +01:00
Jakub Sokołowski dba111b404
beacon-node-build: fix make targets for networks 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 14:01:52 +01:00
Jakub Sokołowski ab42ec87cc
beacon-node-builds: build toledo at 20:00 UTC 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 13:24:56 +01:00
Jakub Sokołowski c0766cfb72
use dedicated docker image for toledo 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 13:00:25 +01:00
Jakub Sokołowski aad84c1554
drop beacon_node_repo_branch, use beacon_node_cont_tag 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 13:00:02 +01:00
Jakub Sokołowski 39431c0bd8
beacon-node-builds: specify medalla and toledo make targets 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 12:56:52 +01:00
Jakub Sokołowski f081c31012
don't set folder mode to 0750, breaks permissions 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 12:55:43 +01:00
Jakub Sokołowski 20bb18553a
add ssh access for giovanni 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 12:26:45 +01:00
Jakub Sokołowski 5bfaa61b73
distribute-validators: role to copy over validators and secrets 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 12:24:52 +01:00
Jakub Sokołowski b25bd39c1a
deploy 2 hosts for toledo network running develop 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 11:38:45 +01:00
Jakub Sokołowski faae2a99ef
drop beacon_node_shared_testnet, use beacon_node_network 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 11:13:34 +01:00
Jakub Sokołowski fafcfee4f6
beacon-node-builds: Use debian image for docker, add --force 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-09 01:20:22 +01:00
Jakub Sokołowski f484a8617f
beacon-node-builds: add README, remove unused batches 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-08 22:50:32 +01:00
Jakub Sokołowski 7888b4379e
beacon-node-builds: automate building multiple branches 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-08 22:40:28 +01:00
Jakub Sokołowski f30a3c1314
adjust branch names and memory for master 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-07 11:47:37 +01:00
Jakub Sokołowski 652c7129fa
deploy new layout with Madella nodes on each host 
See: https://github.com/status-im/infra-nimbus/issues/23

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-05 13:51:42 +01:00
Jakub Sokołowski 73dfac49da
simplify playbook by dropping include_role 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-02 18:47:13 +01:00
Jakub Sokołowski 4cd82e895b
drop bootstrap__extra_volume_path, it clashes with new default 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-02 18:47:12 +01:00
Jakub Sokołowski c7d1db5ced
terraform.py: drop deprecated encoding argument from json.loads 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-02 15:32:57 +01:00
Jakub Sokołowski 9d56aa3e84
use our own fork of Nginx role to fix permissions 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-10-07 19:50:55 +02:00
Jakub Sokołowski 1b23e1a4e7
network-debug-script: add networkctl list 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-09-16 14:38:05 +02:00
Jakub Sokołowski 56e3f1d5cb
add network-debug-script to figure out host issues 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-09-16 12:50:46 +02:00