status-im
/
infra-nimbus
mirror of https://github.com/status-im/infra-nimbus.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
738 Commits 10 Branches 0 Tags 31 MiB
Commit Graph

339 Commits

Author SHA1 Message Date
Jakub Sokołowski bb1e3ff3ba
bump size of Goerli Geth node to t3a.large 
It keeps hitting memory limits and failing to sync.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-12 22:58:42 +01:00
Jakub Sokołowski 4cdd5f01ce
increase Goerli container memory limit to 80% 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-09 18:32:11 +01:00
Jakub Sokołowski d8b643fd74
add SSH users to systemd-journal group 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-08 12:36:14 +01:00
Jakub Sokołowski b7226818d3
disable kibana-logtrail, it's not been updated to 7.10.2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-01 16:05:50 +01:00
Jakub Sokołowski dbac764185
upgrade ElasticSearch to 7.10.2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-01 15:57:10 +01:00
Jakub Sokołowski 157d215230
specify beacon_node_netkey for nimbus-mainnet-small bootnodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-29 13:26:55 +01:00
Jakub Sokołowski 26a31c5d63
use 8000+ UIDs for extra SSH users to not clash with core 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-26 12:11:33 +01:00
Jakub Sokołowski 8f76c6810a
log-store: fix mounting of data volumes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-25 15:08:34 +01:00
Jakub Sokołowski 62f44b8a05
drop old fleet from group and host vars and pyrmont playbook 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 15:59:47 +01:00
Jakub Sokołowski 84be761116
fix hostname in nimbus-pyrmont-unstable-libp2p validators layout 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 15:19:58 +01:00
Jakub Sokołowski 37c1c62a5d add validators distributio for the new fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 14:27:39 +01:00
Jakub Sokołowski 8ad0027936
log-store: add 2GB swap files to hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 20:35:33 +01:00
Jakub Sokołowski 6e138997e2
re-enable sending logs to logstash 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 19:27:04 +01:00
Jakub Sokołowski 45a0315bb0
deploy elasticsearch and a kibana dashboard 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 16:00:29 +01:00
Jakub Sokołowski 2b44636cd6
create new pyrmont fleet using new branch naming 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 19:04:10 +01:00
Jakub Sokołowski 05684f23b1
drop unused toledor and maste references 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 16:52:40 +01:00
Jakub Sokołowski 2132851b16
use bootstrap__active_extra_users variable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-14 14:01:57 +01:00
Jakub Sokołowski 9c5abd392a
allow VPN connections to Goerli/Mainnet WebSocket API 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-04 18:20:05 +01:00
Jakub Sokołowski 989aeacb51
use Geth Goerli WebSocket endpoint for Pyrmont fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-04 13:09:48 +01:00
Jakub Sokołowski 65f0d944d8
bump max logs for logrotate to 72 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-26 21:30:32 +01:00
Jakub Sokołowski 996e2df2e8
make docker log files contain only container messages 
See: https://github.com/status-im/infra-nimbus/issues/26

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-26 19:06:08 +01:00
Jakub Sokołowski 796c7ce292
bump count of logrotate files to keep to 24 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-26 18:30:05 +01:00
Jakub Sokołowski eb44131dc6
add configuration for nimbus.mainnet bootstrap nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-25 15:58:44 +01:00
Jakub Sokołowski 57dce5d830
fix sync types for networks 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 17:18:21 +01:00
Jakub Sokołowski 8441dafbbf
configure Geth Mainnet fast sync node 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 16:30:03 +01:00
Jakub Sokołowski 3b8ca79a44
enable WebSocket API for Geth Goerli node 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 15:43:10 +01:00
Jakub Sokołowski d0a7c82d24
configure Goerli full sync on nimbus.geth node 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-24 14:44:50 +01:00
Jakub Sokołowski 7901c37c58
switch toledo to using devel-small branch 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 22:59:12 +01:00
Jakub Sokołowski f089923acd
switch to using containers based on host type 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 17:33:03 +01:00
Jakub Sokołowski 9fa06b2590
move build mater hosts to host_vars 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:54:24 +01:00
Jakub Sokołowski 21a41cb1ed
drop unused variables, don't re-create containers every time 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:45:51 +01:00
Jakub Sokołowski 9ce7995256
move variables to individual group_vars files 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:05:10 +01:00
Jakub Sokołowski 1f39b846ad
move builds to existing master pyrmont hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:05:10 +01:00
Jakub Sokołowski 754f796871
drop the master host as well 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 16:05:10 +01:00
Jakub Sokołowski 3c2089ec82
update validators distribution for new layout of hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 14:52:07 +01:00
Jakub Sokołowski 1caaddb924
remove to old medalla fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 14:51:31 +01:00
Jakub Sokołowski 521706c31c
update hostnames for validators distribution 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-20 13:55:13 +01:00
Jakub Sokołowski 3888da1e6e
set beacon node infura web3 url from infra-pass 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-19 23:00:44 +01:00
Jakub Sokołowski b06078cf7d
drop setting beacon_node_network from nimbus.test.yml 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 16:11:43 +01:00
Jakub Sokołowski e43f66f965
make sure toledo uses correct entrypoint 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 13:53:21 +01:00
Jakub Sokołowski c858cdb577
configure pyrmont distribution of validators and branch layout 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 13:40:13 +01:00
Jakub Sokołowski d3116a8f0b
move toledo host config to separate group_vars and playbook 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-17 13:25:38 +01:00
Jakub Sokołowski aad84c1554
drop beacon_node_repo_branch, use beacon_node_cont_tag 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 13:00:02 +01:00
Jakub Sokołowski 20bb18553a
add ssh access for giovanni 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 12:26:45 +01:00
Jakub Sokołowski 5bfaa61b73
distribute-validators: role to copy over validators and secrets 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 12:24:52 +01:00
Jakub Sokołowski faae2a99ef
drop beacon_node_shared_testnet, use beacon_node_network 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 11:13:34 +01:00
Jakub Sokołowski 7888b4379e
beacon-node-builds: automate building multiple branches 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-08 22:40:28 +01:00
Jakub Sokołowski f30a3c1314
adjust branch names and memory for master 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-07 11:47:37 +01:00
Jakub Sokołowski 652c7129fa
deploy new layout with Madella nodes on each host 
See: https://github.com/status-im/infra-nimbus/issues/23

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-05 13:51:42 +01:00
Jakub Sokołowski 4cd82e895b
drop bootstrap__extra_volume_path, it clashes with new default 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-02 18:47:12 +01:00
Ștefan Talpalaru dcef20dc7b
log level: TRACE -> DEBUG (#20) 2020-08-04 16:15:30 +02:00
Jakub Sokołowski 118b780312
destory the Nimbus ElasticSearch cluster and dashboard 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-08-03 16:29:33 +02:00
Jakub Sokołowski b3773f51b4
disable sending Nimbus fleet logs to Logstash 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-08-03 15:46:07 +02:00
Jakub Sokołowski ac5ff01a1b
drop libp2p.test fleet since it's unused 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-08-03 15:28:44 +02:00
Ștefan Talpalaru d291695db5
increase mem limits, remove CPU ones (#16) 
* increase CPU/mem limits

* get rid of CPU limits altogether

the kernel scheduler is good enough at ensuring fairness
 2020-07-01 00:07:33 +02:00
Ștefan Talpalaru d88720874d
halve the number of containers (#15) 
* halve the number of containers

and cleanup some vars

* dedicate some slaves to testnet2

* use list slices for hosts
 2020-06-26 22:37:59 +02:00
Jakub Sokołowski 08b6fe9050
deploy 5 libp2p.test hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-06-10 14:55:55 +02:00
Jakub Sokołowski e0ddfa98fd
all: stop disabling watchtower cleanup 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-06-10 13:01:28 +02:00
Jakub Sokołowski 2440e23a1e
adopt to new open-ports role updates 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-05-28 23:11:32 +02:00
Jakub Sokołowski 01088fd433
drop Adam and Igor from users 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-04-14 10:43:03 +02:00
Jakub Sokołowski b3e320e064
deploy 2GB swap files on Nimbus hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-03-26 19:04:59 +01:00
Jakub Sokołowski 0e184b9e96
set cpu and memory limits for beacon nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-03-26 14:15:22 +01:00
Jakub Sokołowski 4c10d02983
move docker logs for Nimbus to /docker/log 
For more details see:
https://github.com/status-im/infra-nimbus/issues/10

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-03-12 13:49:32 +01:00
kdeme 1dd328307b Add my public ssh key 2020-03-09 23:17:16 +01:00
Jakub Sokołowski 03b6fbe91b
update bootstrap extra volume var name 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-26 16:30:45 +01:00
Jakub Sokołowski e8bef4c9b5
fix domain for nimbus-test-stats.status.im 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-20 11:47:17 +01:00
Jakub Sokołowski fcd17845b8
nimbus-stats: port to use systemd timer, fix consul query 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-19 11:51:09 +01:00
Dmitriy Ryajov 9091772f37
add ssh key for dryajov 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-18 16:07:56 +01:00
Jakub Sokołowski 5cc7ee12b1
add lograotate config to slaves too 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-16 01:18:09 +01:00
Jakub Sokołowski b709917224
lower local log retention to avoid filling root 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-13 18:48:53 +01:00
Jakub Sokołowski 7ed2ec39dc
beacon-nodes: match new cont_recreate and cont_state settings 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-10 14:12:57 +01:00
Jakub Sokołowski a56f818416
beacon-node: change log level to TRACE 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-07 14:18:47 +01:00
Jakub Sokołowski 84f80b9aa0
logclean-job: keep only 9 newest logstash daily indices 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-07 14:15:31 +01:00
Jakub Sokołowski 24a87596b4
log-dash: configure Kibana dashboard 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-05 13:39:43 +01:00
Jakub Sokołowski 1ba18ae134
log-store: deploy an ElasticSearch cluster 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-03 13:10:28 +01:00
Jakub Sokołowski e91fb002bf
we now have Consul so we can re enable tinc 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-29 23:17:10 +01:00
Jakub Sokołowski 52321e8ca3
mount extra volume at /docker 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-28 22:19:01 +01:00
Jakub Sokołowski c825c4595b
add zahary user 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-28 21:13:15 +01:00
Jakub Sokołowski 14b623c4b4
port fleet to AWS EC2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-27 16:46:53 +01:00
Jakub Sokołowski aeb4345600
disable watchtower cleanup flag 
Otherwise watchtower throws image removal errors like:
Error: No such image: sha256:abdc

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-23 13:29:47 +01:00
Jakub Sokołowski 0f426e1b51
make yglukhov user inactive 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-22 21:23:37 +01:00
Jakub Sokołowski f519666812
update origin-certs role arguments 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-11-12 23:45:58 +01:00
Jakub Sokołowski f7a3f15982
fix uid for stefan 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-11-01 15:33:06 +01:00
Jakub Sokołowski 3cfa129770
remove bruno user 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-11-01 15:22:49 +01:00
Ștefan Talpalaru 2109d84fa0 added my own public SSH key 2019-11-01 15:21:25 +01:00
Jakub Sokołowski 15efd6b84d
add ssh access explicitly for Nimbus team members 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-06-12 15:38:30 -04:00
Jakub Sokołowski 36ce9bf87d
enable debug logs temporarily 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-05-09 16:54:18 +02:00
Jakub Sokołowski 9fcbc6014f
add new nimbus-stats role for publishing nimbus fleet status 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-04-17 19:25:11 +02:00
Jakub Sokołowski 52b8ae8acf
add missing secrets 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-03-23 10:27:22 +01:00