status-im
/
infra-nimbus
mirror of https://github.com/status-im/infra-nimbus.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
334 Commits 10 Branches 0 Tags 31 MiB
Commit Graph

269 Commits

Author SHA1 Message Date
Jakub Sokołowski 64b7736d85
distribute-validators: fix order of copied validators and secrets 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-12 11:52:09 +01:00
Ștefan Talpalaru ffa65e00e0 build.sh: deal with Git history being changed upstream 
and some drive-by improvements
 2020-11-12 11:13:19 +01:00
Jakub Sokołowski b452c6cddc
beacon-node-builds: update readme, add start example 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 17:02:50 +01:00
Jakub Sokołowski 055c74aa52
beacon-node-builds: set entrypoint based on targets 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 15:39:24 +01:00
Jakub Sokołowski dba111b404
beacon-node-build: fix make targets for networks 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 14:01:52 +01:00
Jakub Sokołowski ab42ec87cc
beacon-node-builds: build toledo at 20:00 UTC 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 13:24:56 +01:00
Jakub Sokołowski c0766cfb72
use dedicated docker image for toledo 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 13:00:25 +01:00
Jakub Sokołowski aad84c1554
drop beacon_node_repo_branch, use beacon_node_cont_tag 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 13:00:02 +01:00
Jakub Sokołowski 39431c0bd8
beacon-node-builds: specify medalla and toledo make targets 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 12:56:52 +01:00
Jakub Sokołowski f081c31012
don't set folder mode to 0750, breaks permissions 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 12:55:43 +01:00
Jakub Sokołowski 20bb18553a
add ssh access for giovanni 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 12:26:45 +01:00
Jakub Sokołowski 5bfaa61b73
distribute-validators: role to copy over validators and secrets 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 12:24:52 +01:00
Jakub Sokołowski b25bd39c1a
deploy 2 hosts for toledo network running develop 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 11:38:45 +01:00
Jakub Sokołowski faae2a99ef
drop beacon_node_shared_testnet, use beacon_node_network 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-10 11:13:34 +01:00
Jakub Sokołowski fafcfee4f6
beacon-node-builds: Use debian image for docker, add --force 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-09 01:20:22 +01:00
Jakub Sokołowski f484a8617f
beacon-node-builds: add README, remove unused batches 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-08 22:50:32 +01:00
Jakub Sokołowski 7888b4379e
beacon-node-builds: automate building multiple branches 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-08 22:40:28 +01:00
Jakub Sokołowski f30a3c1314
adjust branch names and memory for master 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-07 11:47:37 +01:00
Jakub Sokołowski 652c7129fa
deploy new layout with Madella nodes on each host 
See: https://github.com/status-im/infra-nimbus/issues/23

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-05 13:51:42 +01:00
Jakub Sokołowski 73dfac49da
simplify playbook by dropping include_role 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-02 18:47:13 +01:00
Jakub Sokołowski 4cd82e895b
drop bootstrap__extra_volume_path, it clashes with new default 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-02 18:47:12 +01:00
Jakub Sokołowski c7d1db5ced
terraform.py: drop deprecated encoding argument from json.loads 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-02 15:32:57 +01:00
Jakub Sokołowski 9d56aa3e84
use our own fork of Nginx role to fix permissions 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-10-07 19:50:55 +02:00
Jakub Sokołowski 1b23e1a4e7
network-debug-script: add networkctl list 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-09-16 14:38:05 +02:00
Jakub Sokołowski 56e3f1d5cb
add network-debug-script to figure out host issues 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-09-16 12:50:46 +02:00
Jakub Sokołowski 728caf06ab
another update because of tainted terraform resource 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-08-19 20:53:19 +02:00
Ștefan Talpalaru a27d6826d8
new IPs 2020-08-19 19:47:59 +02:00
Ștefan Talpalaru 49af390fb6
new dynamic IPs 2020-08-19 18:09:20 +02:00
Ștefan Talpalaru c084b2044c
new dynamic IPs for nimbus.test[0:5] 2020-08-19 15:16:57 +02:00
Jakub Sokołowski c6ce372cd1
moar ip updates 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-08-13 11:57:13 +02:00
Jakub Sokołowski 04bb3f4082
update IPs 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-08-13 00:48:42 +02:00
Ștefan Talpalaru dcef20dc7b
log level: TRACE -> DEBUG (#20) 2020-08-04 16:15:30 +02:00
Ștefan Talpalaru 917d2d6adf
Medalla nodes (#19) 2020-08-04 12:45:57 +02:00
Jakub Sokołowski 118b780312
destory the Nimbus ElasticSearch cluster and dashboard 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-08-03 16:29:33 +02:00
Jakub Sokołowski b3773f51b4
disable sending Nimbus fleet logs to Logstash 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-08-03 15:46:07 +02:00
Jakub Sokołowski ac5ff01a1b
drop libp2p.test fleet since it's unused 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-08-03 15:28:44 +02:00
Ștefan Talpalaru 7be336fc3c
disable swap (#18) 2020-07-14 14:27:18 +02:00
Ștefan Talpalaru 22f4aeba8b
enable container restarts for Altona nodes (#17) 2020-07-06 23:22:23 +02:00
Ștefan Talpalaru d291695db5
increase mem limits, remove CPU ones (#16) 
* increase CPU/mem limits

* get rid of CPU limits altogether

the kernel scheduler is good enough at ensuring fairness
 2020-07-01 00:07:33 +02:00
Ștefan Talpalaru d88720874d
halve the number of containers (#15) 
* halve the number of containers

and cleanup some vars

* dedicate some slaves to testnet2

* use list slices for hosts
 2020-06-26 22:37:59 +02:00
Jakub Sokołowski 08b6fe9050
deploy 5 libp2p.test hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-06-10 14:55:55 +02:00
Jakub Sokołowski e0ddfa98fd
all: stop disabling watchtower cleanup 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-06-10 13:01:28 +02:00
Jakub Sokołowski 70fea6e4d7
rename main.yml to nimbus.yml playbook 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-06-10 12:35:30 +02:00
Jakub Sokołowski 2440e23a1e
adopt to new open-ports role updates 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-05-28 23:11:32 +02:00
Jakub Sokołowski 04e86a2802
re-create master-01 due to AWS retirement 
"Retiring: This instance is scheduled for retirement after June 5, 2020 at 6:00:00 PM UTC+2."

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-05-25 19:46:05 +02:00
Jakub Sokołowski 01088fd433
drop Adam and Igor from users 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-04-14 10:43:03 +02:00
Jakub Sokołowski b3e320e064
deploy 2GB swap files on Nimbus hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-03-26 19:04:59 +01:00
Jakub Sokołowski 0e184b9e96
set cpu and memory limits for beacon nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-03-26 14:15:22 +01:00
Jakub Sokołowski d3513549f3
add RPC port configuration for Nimbus 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-03-23 19:49:13 +01:00
Jakub Sokołowski 4c10d02983
move docker logs for Nimbus to /docker/log 
For more details see:
https://github.com/status-im/infra-nimbus/issues/10

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-03-12 13:49:32 +01:00
kdeme 1dd328307b Add my public ssh key 2020-03-09 23:17:16 +01:00
Jakub Sokołowski 03b6fbe91b
update bootstrap extra volume var name 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-26 16:30:45 +01:00
Jakub Sokołowski e8bef4c9b5
fix domain for nimbus-test-stats.status.im 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-20 11:47:17 +01:00
Jakub Sokołowski fcd17845b8
nimbus-stats: port to use systemd timer, fix consul query 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-19 11:51:09 +01:00
Dmitriy Ryajov 9091772f37
add ssh key for dryajov 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-18 16:07:56 +01:00
Jakub Sokołowski 5cc7ee12b1
add lograotate config to slaves too 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-16 01:18:09 +01:00
Jakub Sokołowski 460dad55ed
inventory: update master IP 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-15 21:38:22 +01:00
Jakub Sokołowski b709917224
lower local log retention to avoid filling root 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-13 18:48:53 +01:00
Jakub Sokołowski 93d0a6f2fd
inventory: update master-01 ip 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-13 18:23:32 +01:00
Jakub Sokołowski 7ed2ec39dc
beacon-nodes: match new cont_recreate and cont_state settings 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-10 14:12:57 +01:00
Jakub Sokołowski cf400925ad
update IP of node-01 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-10 01:37:44 +01:00
Jakub Sokołowski a02aa10704
inventory: update IP for node-07.aws-eu-central-1a.nimbus.test 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-07 18:09:19 +01:00
Jakub Sokołowski 4686a5d08d
inventory: update ip for node-05.aws-eu-central-1a.nimbus.test 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-07 16:51:57 +01:00
Jakub Sokołowski a56f818416
beacon-node: change log level to TRACE 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-07 14:18:47 +01:00
Jakub Sokołowski 84f80b9aa0
logclean-job: keep only 9 newest logstash daily indices 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-07 14:15:31 +01:00
Jakub Sokołowski 24a87596b4
log-dash: configure Kibana dashboard 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-05 13:39:43 +01:00
Jakub Sokołowski 283215e5bb
inventory: add node-01.aws-eu-central-1a.dash.nimbus 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-05 13:39:28 +01:00
Jakub Sokołowski e7e20b2943
inventory: add log-store.test cluster for Nimbus 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-03 13:10:29 +01:00
Jakub Sokołowski 1ba18ae134
log-store: deploy an ElasticSearch cluster 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-03 13:10:28 +01:00
Jakub Sokołowski e91fb002bf
we now have Consul so we can re enable tinc 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-29 23:17:10 +01:00
Jakub Sokołowski 4cbfa61270
update emergency inventory with new IPs after CIDR change 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-29 23:16:46 +01:00
Jakub Sokołowski 52321e8ca3
mount extra volume at /docker 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-28 22:19:01 +01:00
Jakub Sokołowski a250807322
fix data_center value in emergency inventory 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-28 22:18:43 +01:00
Jakub Sokołowski c825c4595b
add zahary user 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-28 21:13:15 +01:00
Jakub Sokołowski d06b8d8c70
update emergency inventory with new fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-28 21:04:32 +01:00
Jakub Sokołowski 14b623c4b4
port fleet to AWS EC2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-27 16:46:53 +01:00
Jakub Sokołowski aeb4345600
disable watchtower cleanup flag 
Otherwise watchtower throws image removal errors like:
Error: No such image: sha256:abdc

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-23 13:29:47 +01:00
Jakub Sokołowski 0f426e1b51
make yglukhov user inactive 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-22 21:23:37 +01:00
Jakub Sokołowski f519666812
update origin-certs role arguments 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-11-12 23:45:58 +01:00
Jakub Sokołowski 08be7f7351
add minimal Ansible version check 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-11-04 15:55:29 +01:00
Jakub Sokołowski 7fb6661674
add missing tags for whole playbook for beacon nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-11-04 13:55:38 +01:00
Jakub Sokołowski ef4f18bc5f
make playbook more selective 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-11-04 01:04:03 +01:00
Jakub Sokołowski b417df663e
add upgrade and cleanup playbooks 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-11-02 14:44:22 +01:00
Jakub Sokołowski a5ace15000
simpliy playbook, run master beacon nodes together with slaves 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-11-01 16:37:10 +01:00
Jakub Sokołowski 6a4726dbbd
fix mapping of ports to match service ports 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-11-01 16:07:36 +01:00
Jakub Sokołowski f7a3f15982
fix uid for stefan 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-11-01 15:33:06 +01:00
Jakub Sokołowski 3cfa129770
remove bruno user 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-11-01 15:22:49 +01:00
Ștefan Talpalaru 2109d84fa0 added my own public SSH key 2019-11-01 15:21:25 +01:00
Jakub Sokołowski 3c2384092e
change ports for other testnets 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-10-29 17:31:27 +01:00
Jakub Sokołowski 9c9b69c623
update to expose new metrics port 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-10-29 17:28:32 +01:00
Jakub Sokołowski e790ff5c65
fix order in emergency inventory 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-08-02 19:02:05 -04:00
Jakub Sokołowski d14d91efff
upgrade ansible inventory script 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-08-02 19:01:10 -04:00
Jakub Sokołowski 817eb9b075
drop flavour(protocol) name from container names 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-06-21 10:46:45 -04:00
Jakub Sokołowski 15efd6b84d
add ssh access explicitly for Nimbus team members 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-06-12 15:38:30 -04:00
Jakub Sokołowski cd3e4e61cc
start ports from 9000 and 9100, not 9001 and 9101 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-05-15 14:17:23 +02:00
Jakub Sokołowski 3adc241e4d
use new refactored beacon-node role in a loop 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-05-09 18:18:46 +02:00
Jakub Sokołowski 36ce9bf87d
enable debug logs temporarily 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-05-09 16:54:18 +02:00
Zahary Karadjov 44ba6baa1f Run 2 nodes per network type on each server 2019-05-09 17:49:50 +03:00
Jakub Sokołowski 3035b457b1
use one query for all types of messages 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-04-19 12:50:55 +02:00
Jakub Sokołowski f8d90dd829
update 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-04-18 09:42:56 +02:00
Jakub Sokołowski f3b1cbbfbd
update readme 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-04-18 09:41:55 +02:00
Jakub Sokołowski b140075d12
add logger, make -m option use append action 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-04-18 09:35:33 +02:00
Jakub Sokołowski d0f32c610e
remove needlessly commited file 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-04-18 09:14:40 +02:00
Jakub Sokołowski 9fcbc6014f
add new nimbus-stats role for publishing nimbus fleet status 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-04-17 19:25:11 +02:00
Zahary Karadjov 9ec6d1b4a9 Fix a typo 2019-03-28 22:22:10 +02:00
Zahary Karadjov 7f7fb91d51 Added an extra rlpx/testnet0 node 2019-03-26 20:47:34 +02:00
Jakub Sokołowski 1b03b4c7fb
add config for beacon nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-03-25 13:02:20 +01:00
Jakub Sokołowski 52b8ae8acf
add missing secrets 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-03-23 10:27:22 +01:00
Jakub Sokołowski 35dd23be1d
fix name of testnet-site role 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-03-22 18:20:55 +01:00
Jakub Sokołowski 9bd1cf8dcd
commit new hosts to emergency inventory 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-03-22 18:20:44 +01:00
Jakub Sokołowski 87765ef6d9
use new roles 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-03-22 16:50:30 +01:00
Jakub Sokołowski dca0efdd5b
fix name of nimbus role 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-03-21 16:31:23 +01:00
Jakub Sokołowski ad1cc2168d
add emergency inventory 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-03-21 13:44:01 +01:00
Jakub Sokołowski 280729edf6
add master and regular nodes(1 for now) for nimbus 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-03-21 13:27:16 +01:00
Jakub Sokołowski 5f8a3cd4e4
add basic main.yml playbook 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-03-21 13:14:11 +01:00
Jakub Sokołowski 5333f49a7f
add bootstrap playbook 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-03-21 12:00:53 +01:00
Jakub Sokołowski beb8fb4ac6
add requirements.yml with new nimbus role 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-03-20 13:38:44 +01:00
Jakub Sokołowski c07f554c2a
add ansible/files folder 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-03-20 13:36:44 +01:00
Jakub Sokołowski 405c032fd7
add ansible terraform.py inventory script 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2019-03-20 13:36:05 +01:00