status-im
/
infra-nimbus
mirror of https://github.com/status-im/infra-nimbus.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
694 Commits 10 Branches 0 Tags 31 MiB
Commit Graph

601 Commits

Author SHA1 Message Date
Jakub Sokołowski f615273cdc
nimbus.ropsten: lower TTD to 50000000000000000 
"Here’s an update on the Ropsten TTD: we’ve chosen to use a value of
50000000000000000. At the current hash rate, it would hit in several
weeks. That said,  the EF will rent hash rate itself and work with
partners to accelerate things. With a modest increase in hash rate, we
should be able to make the Ropsten Merge happen on June 8/9.

If your
team is running any validators, please perform a TTD override to
50000000000000000 on them ASAP."

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-02 18:13:12 +02:00
Jakub Sokołowski 77695bd0ea
nimbus-geth-ropsten: set custom TTD for geth 
https://hackmd.io/ngKLqVvvTTGZLj1bGPuCoA#Geth

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-02 10:51:27 +02:00
Jakub Sokołowski c474a3311d
logs.nimbus: leave memory for Lucene, use 32 GB heap 
https://github.com/status-im/infra-nimbus/issues/96

"The moral of the story is this: even when you have memory to spare, try
to avoid crossing the 32 GB heap boundary. It wastes memory, reduces CPU
performance, and makes the GC struggle with large heaps."

https://www.elastic.co/guide/en/elasticsearch/guide/current/heap-sizing.html#compressed_oops
https://www.elastic.co/guide/en/elasticsearch/guide/current/heap-sizing.html#_give_less_than_half_your_memory_to_lucene

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 12:28:48 +02:00
Jakub Sokołowski 3366cd40ef
enable validator monitoring regardless of branch 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 11:51:14 +02:00
Jakub Sokołowski a670e46895
dash.nimbus: move nimbus-logs to our own SSL proxy 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 11:43:48 +02:00
Jakub Sokołowski 5e1af52f2d
logs.nimubs: move nimbus-es to our own SSL proxy 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 11:43:45 +02:00
Jakub Sokołowski f8b09ccd3c
dash.nimbus: upgrade kibana and ES to 7.17.4 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 11:40:19 +02:00
Artur Marud b1545a6662
nimbus.ropsten: Validators layout setup 
Signed-off-by: Artur Marud <artur@status.im>
 2022-05-26 19:11:55 +02:00
Jakub Sokołowski 11aa98adf1
requirements: fix dist-validators bug 
Not fetching new changes from `nimbus-private` repo on Windows.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-26 13:13:07 +02:00
Jakub Sokołowski b10890920a
requirements: upgrade Geth to 1.10.18 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-26 00:58:01 +02:00
Artur Marud 7e19b3d93e
nimbus.ropsten: Initial beacon node setup 
https://github.com/status-im/infra-nimbus/issues/97

- no validators have been deployed yet.

Signed-off-by: Artur Marud <artur@status.im>
 2022-05-25 13:35:12 +02:00
Artur Marud fe9aed90a2
nimbus.geth: Opened firewall rpc port for ropsten 
Signed-off-by: Artur Marud <artur@status.im>
 2022-05-25 12:28:49 +02:00
Jakub Sokołowski 05214dc254
nimbus.ropsten: add metal-01.he-eu-hel1.nimbus.ropsten 
Host for Nimbus nodes for new merge testnet called Ropsten:
https://github.com/status-im/infra-nimbus/issues/97

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-25 11:19:10 +02:00
Jakub Sokołowski 8c27671a95
nimbus.geth: bump Ropsten data volume to 250 GB 
https://github.com/status-im/infra-nimbus/issues/97

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-24 18:23:47 +02:00
Jakub Sokołowski 6a2a801190
nimbus-geth-ropsten: switch Geth to snap sync 
Full sync is just too slow and will not finish in time.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-24 11:16:23 +02:00
Jakub Sokołowski e163284f9b
nimbus.prater: fix port number for public API 
Fixes:
http://unstable.prater.beacon-api.nimbus.team/eth/v1/node/version

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-23 14:00:55 +02:00
Jakub Sokołowski dcc11e0c87
nimbus-geth-ropsten: configure Geth instance 
https://github.com/status-im/infra-nimbus/issues/97

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-20 20:16:42 +02:00
Jakub Sokołowski 94ffee2813
add ropsten-01.aws-eu-central-1a.nimbus.geth host 
https://github.com/status-im/infra-nimbus/issues/97

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-20 20:16:10 +02:00
Jakub Sokołowski dcbc5f03c3
ansible/upgrade.yml: update to version from template 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-20 20:15:34 +02:00
Jakub Sokołowski f6c1529bea
nimbus.kiln: upgrade images and init JSON SHA256 
The host was also reinstalled as it had weird networking issues.
It also had very flaky Geth nodes, which caused a lot of alerts.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-16 20:50:46 +02:00
Jakub Sokołowski bd87eacbc9
ansible.cfg: drop remote_user=admin from config 
It made sense when there was only one admin.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-12 09:53:52 +02:00
Zahary Karadjov e6f2f3e010 Add another 10K prater validators 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-05 16:37:49 +02:00
Jakub Sokołowski 389e6dd432
nimbus.mainnet: fix number variable for metal-02 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-04-26 10:16:44 +04:00
Jakub Sokołowski ea49b47011
drop redundant --proposer-boosting-debug flag 
https://github.com/status-im/infra-role-beacon-node-linux/commit/907ee4b6
https://github.com/status-im/infra-role-beacon-node-macos/commit/290984b3
https://github.com/status-im/infra-role-beacon-node-windows/commit/c2f22db0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-04-12 20:12:01 +02:00
Jakub Sokołowski f58a8506a9
nimbus.kiln: use new container built from master 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-04-12 19:25:55 +02:00
Jakub Sokołowski d231accd45
logs.nimbus: refactor OAuth container setup 
This is to take into account changes made in:
https://github.com/status-im/infra-role-oauth-proxy/commit/4dd42c56

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-04-11 11:26:38 +02:00
Jakub Sokołowski 32835c38b4
ci-slave-metal: remove SSH access from Stefan 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-31 20:02:18 +02:00
Jakub Sokołowski 5bbc1458cf
expose API at unstable.kiln.beacon-api.nimbus.team 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-30 18:27:11 +02:00
Etan Kissling 79c5899f62 nimbus.prater: enable --*-light-client-data 
Signed-off-by: Etan Kissling <etan@status.im>
 2022-03-30 16:28:36 +02:00
Jakub Sokołowski 50fa1be86f
enable proposer boosting for all nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-30 13:07:23 +02:00
Jakub Sokołowski 6e79a6df06
dash.nimbus: lower ES indice clean up to 14 days 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-29 21:39:42 +02:00
Etan Kissling 91cc24b228 nimbus.kiln: enable --*-light-client-data 
Signed-off-by: Etan Kissling <etan@status.im>
 2022-03-28 18:17:44 +02:00
Jakub Sokołowski c85d852e9c
drop config for nimbus.pyrmont fleet 
The testnet has been discontinued.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-26 10:36:56 +01:00
Etan Kissling c0630aeb00 nimbus: mark branches supporting BN light client data 
Signed-off-by: Etan Kissling <etan@status.im>
 2022-03-25 17:31:22 +01:00
Jakub Sokołowski 70bf75d1de
drop deprecated JSON-RPC API port from all nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-22 18:58:19 +01:00
Jakub Sokołowski 45d7608040
nimbus.mainnet: enable proposer boosting for unstable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-22 11:40:44 +01:00
Jakub Sokołowski 9661063ebd
logclean-job: add missing Install section for timer 
Without it it doesn't get enabled at boot time.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-17 19:51:56 +01:00
Jakub Sokołowski 3266a65a83
nimbus.fluffy: use first two nodes as bootstrap nodes 
https://github.com/status-im/infra-nimbus/issues/87

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-16 11:50:17 +01:00
Jakub Sokołowski 71a0430e1c
nimbus.fluffy: add loop_var, include consul fixes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-16 00:59:01 +01:00
Jakub Sokołowski d33ec7037e
nimbus.kiln: enable --proposer-boosting-debug 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 19:10:38 +01:00
Jakub Sokołowski 38b16053cf
nimbus.kiln: add validators layout for testnet 
https://github.com/status-im/nimbus-private/commit/e963d195
https://github.com/status-im/nimbus-private/tree/master/kiln_deposits

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 16:54:32 +01:00
Jakub Sokołowski 0d5ef90cd2
nimbus.kiln: configure beacon nodes without validators 
https://github.com/status-im/infra-nimbus/issues/88

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 15:40:21 +01:00
Jakub Sokołowski a4e54f2c5e
nimbus.kiln: update Geth bootstrap nodes list 
Based on this recent PR:
https://github.com/eth-clients/merge-testnets/pull/6

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 15:38:42 +01:00
Jakub Sokołowski 69469913fb
nimbus.kiln: configure four Geth containers 
- https://github.com/status-im/infra-nimbus/issues/88
- https://config.kiln.themerge.dev/el/bootnodes
- https://config.kiln.themerge.dev/el/genesis/geth.json
- https://kiln.themerge.dev/

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 12:29:27 +01:00
Jakub Sokołowski 3a277cebd6
cleanup: clean also service logs 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 12:11:39 +01:00
Jakub Sokołowski 968c174ba0
bootstrap: add extra IP to SSHGuard whitelist 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 11:45:07 +01:00
Jakub Sokołowski dd43e135a5
move metal-07.he-eu-hel1.nimbus.prater to nimbus.kiln 
Also move validators from it to `metal-06`.
https://github.com/status-im/infra-nimbus/issues/88

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-10 18:19:25 +01:00
Jakub Sokołowski f2777f6496
nimbus.fluffy: configure 32 nodes on each host 
https://github.com/status-im/infra-nimbus/issues/87

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-08 15:50:03 +01:00
Jakub Sokołowski 2a98be3ade
add two new hosts for nimubs.fluffy fleet 
https://github.com/status-im/infra-nimbus/issues/87

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-08 12:23:11 +01:00
Jakub Sokołowski 1b9d64e72f
enable --proposer-boosting-debug on testnet unstable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-07 12:53:23 +01:00
Jakub Sokołowski 8017d10bbc
requirements: bump Geth to 1.10.16 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-07 11:09:01 +01:00
Jakub Sokołowski 89093c894a
logs.nimbus: firewall for ElasticSearch exporter port 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-03 18:23:13 +01:00
Jakub Sokołowski 6488efd4e9
nimbus-db-purge: deploy to two mainnet hosts 
https://github.com/status-im/infra-nimbus/issues/86

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-28 17:32:01 +01:00
Jakub Sokołowski a8b48242b0
nimbus-db-purge: add role to periodicall purge DB 
https://github.com/status-im/infra-nimbus/issues/86

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-28 17:31:31 +01:00
Jakub Sokołowski 01e129694b
dummy-module: don't set become_user for inventory 
Causes `become_user` specified in tasks to be ignored.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-28 16:51:16 +01:00
Jakub Sokołowski c4436f71f4
drop windows-01.gc-us-central1-a.nimbus.prater 
Replaced by `windows-01.he-eu-hel1.nimbus.prater` due to disk space
constraints and high cost of Google Cloud host.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-28 13:14:04 +01:00
Jakub Sokołowski 9b365b02a7
add new windows-01.he-eu-hel1.nimbus.prater host 
To replace `windows-01.gc-us-central1-a.nimbus.prater` which is running
out of disk space, and is also far too expensive.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-25 15:02:27 +01:00
Jakub Sokołowski 489878038e
requirements: bump bootstrap roles 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-24 01:40:03 +01:00
Jakub Sokołowski c0ab15c34f
mainnet.openeth: deploy OpenEthereum node to the host 
We need some variety and redundancy in how we sync Eth1:
https://github.com/status-im/infra-nimbus/issues/80

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-21 17:26:33 +01:00
Jakub Sokołowski 3acbf34f70
add new mainnet-01.he-eu-hel1.nimbus.openeth host 
https://github.com/status-im/infra-nimbus/issues/80

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-21 13:54:20 +01:00
Jakub Sokołowski 54c847b9db
nimbus.geth: bump Goerli data volume to 150 GB 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-18 19:37:25 +01:00
Jakub Sokołowski 9f52f8701f
nimbus.mainnet: bump size of AWS data volumes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 20:47:57 +01:00
Jakub Sokołowski 6940d0219c
drop libp2p node from macos host to save space 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 19:53:50 +01:00
Jakub Sokołowski 65304b6aaa new validator layout for prater fleet 
The `0/1/10/30/60/899/4000` layout will require 3 more hosts.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 19:41:07 +01:00
Jakub Sokołowski 3d4679f0d3
nimbus.prater: add nim_compiler overrides 
For some reason `nim-1.6` branch doesn't actually use Nim 1.6 compiler.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 14:24:37 +01:00
Jakub Sokołowski 01c6a06117
nimbus.prater: override some branches to nim-1.6 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 13:46:56 +01:00
Jakub Sokołowski d6414fd956
deploy nodes without validators to 3 new prater hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-16 17:19:23 +01:00
Jakub Sokołowski 612eb284c6
add 3 new nimbus.prater hosts 
Necessary for new layout from:
https://github.com/status-im/infra-nimbus/pull/85

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-16 17:09:51 +01:00
Jakub Sokołowski 84d2773a98
deploy nodes without validators to new prater hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-15 21:09:51 +01:00
Jakub Sokołowski ec65bac02a
nimbus.pyrmont: drop two nodes and move validators 
Two nodes will be reused in the Prater fleet.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-15 21:08:44 +01:00
Jakub Sokołowski 18eb46836e
logs.nimbus: use docker compose setup for elasticsearch 
https://github.com/status-im/infra-role-elasticsearch/commit/567f32ac

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-11 02:08:47 +01:00
Jakub Sokołowski b12a350cb9
bitwarden: include fixes for session invalidation 
For more details see:
- https://github.com/status-im/infra-misc/issues/90
- https://github.com/c0sco/ansible-modules-bitwarden/issues/23

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-10 15:34:18 +01:00
Jakub Sokołowski 4e7625beee
requirements: bump wireguard role 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-10 14:50:05 +01:00
Jakub Sokołowski 392d4124c5
dash.nimbus: bump limit of log indices back to 20 
Currently daily indices take up 10 GB per host, so it' fine.

https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-10 12:31:03 +01:00
Jakub Sokołowski 0398c31ad9
logs.nimbus: drop ES replicas down to 0 to save space 
https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-09 18:43:23 +01:00
Jakub Sokołowski fbb1ee69d9
consul: update token paths in BitWarden 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-09 00:24:07 +01:00
Jakub Sokołowski d74ff169ef
wireguard: bump role and add Consul ACL token 
Part of effort to lock down Consul ACLs:
https://github.com/status-im/infra-hq/issues/70

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-08 20:51:45 +01:00
Jakub Sokołowski cdf63cba43
consul: add mandatory agent ACL token 
https://github.com/status-im/infra-hq/issues/70

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-08 11:58:55 +01:00
Jakub Sokołowski fb7bde2377
dash.nimbus: lower indices kept to 10 
We have bigger log volume now that we fixed the logging setup in:
https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-07 15:07:55 +01:00
Jakub Sokołowski f665fcd8ce
rename logs-dash groups_vars to dash.nimbus 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-07 15:03:12 +01:00
Jakub Sokołowski ba2caedb64
logs.nimbus: bump JVM memory limits to 80% 
We started getting errors like:
```
Caused by: org.elasticsearch.common.breaker.CircuitBreakingException: [parent] Data too large, data for [internal:cluster/nodes/indices/shard/store[n]] would be [36997638608/34.4gb], which is larger than the limit of [36795685273/34.2gb], real usage: [36997638456/34.4gb], new bytes reserved: [152/152b], usages [request=0/0b, fielddata=0/0b, in_flight_requests=152/152b, model_inference=0/0b, eql_sequence=0/0b, accounting=3913236/3.7mb]
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-07 11:49:44 +01:00
Jakub Sokołowski ade0a50a53
logs.nimbus: migrate to Hetzner metal hosts 
For better performance, lower prices, and better network utilization.

https://github.com/status-im/infra-nimbus/issues/84

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-03 21:48:24 +01:00
Jakub Sokołowski aed600506d
requirements: deploy consul listen address fix 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-03 19:06:52 +01:00
Jakub Sokołowski b3da28aeb8
requirements: bump bootstrap to fix journald config 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-01 12:58:13 +01:00
Jakub Sokołowski a6d673366a
all: lowe logrotate count to 48, bump bootstrap 
Also remove `delaycompress` from logrotate config.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-31 17:09:28 +01:00
Jakub Sokołowski 4983b11282
requirements: bump bootstrap and beacon node roles 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-28 13:41:02 +01:00
Jakub Sokołowski 0dc470aae2
requirements: add support for ansible toggle script 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-26 11:00:20 +01:00
Jakub Sokołowski 2962ebbee0
disable use of HTTP Eth1 node endpoints 
Should fix issues with leaking file descriptors causing peer issues and
metrics endpoint timeouts.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-26 01:22:16 +01:00
Jakub Sokołowski 0369818fa0
replace macos-01.ms-eu-dublin.nimbus.prater host 
The old one had only 256 GB of SSD storage which is not enough for
three nodes syncing Prater testnet.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-24 15:44:38 +01:00
Jakub Sokołowski 9b54c84d96
enable validator monitoring flags for unstable nodes 
Once the next release is out we can drop the `unstable` conditionals.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-21 15:36:53 +01:00
Jakub Sokołowski 4ff2422fe2
nimbnus.prater: use the AWS NVMe drive for data 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-19 11:26:16 +01:00
Jakub Sokołowski e00443d6e2
nimbus.mainnet: drop libp2p-02 nodes to save space 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-13 14:16:41 +01:00
Jakub Sokołowski 79f55366f2
requirements: upgrade Geth to 1.10.15 
https://github.com/ethereum/go-ethereum/releases/tag/v1.10.15

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-07 13:05:58 +01:00
Jakub Sokołowski 667fd3184e
builds: add libp2p metrics flags 
This is done instead of this PR:
https://github.com/status-im/infra-role-beacon-node-linux/pull/3/files

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-05 19:38:23 +01:00
Jakub Sokołowski f106c9e5b8
requirements: parametrize nim build flags 
https://github.com/status-im/infra-role-beacon-node-linux/commit/d993d06d
https://github.com/status-im/infra-role-beacon-node-macos/commit/ed0453ef
https://github.com/status-im/infra-role-beacon-node-windows/commit/f6dd9dd6

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-05 19:38:23 +01:00
Jakub Sokołowski 237da365e7
bootstrap: add missing admin pass for macos hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-04 20:55:08 +01:00
Jakub Sokołowski 9c8b0f6185
users: give tanguy sudo permissions 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-04 15:35:30 +01:00
Jakub Sokołowski d99b195bc1
consul: upgrade from 1.10.1 to 1.11.1 
https://github.com/hashicorp/consul/releases/tag/v1.11.1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-03 17:53:34 +01:00
Jakub Sokołowski 462f373827
mainnet.geth: use snap sync method 
We had issues with mainnet node not fully syncing.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-18 18:06:59 +01:00
Jakub Sokołowski 2724d8f8b2
requirements: upgrade Netdata to 1.32.0 
https://github.com/netdata/netdata/releases/tag/v1.32.0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-09 17:37:31 +01:00
Jakub Sokołowski f745dfd2f8
add missing get-geth-api-urls role for macos host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-07 18:31:46 +01:00
Jakub Sokołowski 5dae92080a
get-geth-api-urls: use HTTP RPC API for unstable only 
Current support for HTTP RPC API is not stable enough.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-03 19:40:52 +01:00
Jakub Sokołowski 0c1169cee3
get-geth-api-urls: query for HTTP RPC API endpoints 
We want to test the support for normal HTTP API endpoints.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-02 13:14:41 +01:00
Jakub Sokołowski 62835a2079
requirements: bump bootstrap roles and geth version 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-02 13:09:48 +01:00
Jakub Sokołowski ce70b55014
prater-windows: disable windows defender 
Negatively impacts I/O performance, and we don't need it.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-25 20:00:52 +01:00
Jakub Sokołowski 1ffbb8d351
requirements: bump windows, increase check timeouts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-24 20:46:31 +01:00
Jakub Sokołowski 85d4b054be
requirements: update --log-format flag, bootstrap 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-24 19:54:46 +01:00
Jakub Sokołowski 5d5857928d
pyrmont: expose REST API at insecura.nimbus.team 
Inteded for tests of public insecure API access for Jacek.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-22 15:36:56 +01:00
Jakub Sokołowski 968f56f7ed
update SSH credentials 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-18 17:44:08 +01:00
Jakub Sokołowski 871ece2a3f
fix for renamed --log-stdout flag to --log-format 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-10 18:47:55 +01:00
Jakub Sokołowski 6c3384b8ba
ugprade Rocketpool to 1.0.0 
https://github.com/status-im/infra-rocketpool/issues/2

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-08 13:35:37 +01:00
Jakub Sokołowski f334b8917f
rocketpool: upgrade to v1.0.0-pre4 
https://github.com/status-im/infra-role-rocketpool/issues/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-03 14:02:57 +01:00
Jakub Sokołowski 2fd016d36d
requirements: add support for --log-stdout flag 
Necessary to keep logs in JSON format.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-03 10:14:16 +01:00
Jakub Sokołowski a4877e9b28
upgrade ELK stack to 7.14.2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-28 19:29:15 +02:00
Jakub Sokołowski edfcf0b621
nimbus.eth1: update rocketpool setup to new layout 
https://github.com/status-im/infra-rocketpool/issues/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-27 20:38:59 +02:00
Jakub Sokołowski 9fddf38791
geth: open mainnet ports for rocket.prod fleet 
https://github.com/status-im/infra-rocketpool/issues/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-26 15:37:00 +02:00
Jakub Sokołowski 8e19a929d3
restart.yml: add playbook to restart all nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-26 13:21:18 +02:00
Jakub Sokołowski db178fc217
rebuild.yml: add playbook to rebuild all nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-26 13:21:14 +02:00
Jakub Sokołowski 9887cdbfc9
requirements: udpate to use new rocketpool role name 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-26 13:08:29 +02:00
Jakub Sokołowski 6be2fc03e9
mainnet: add two libp2p nodes on 05 and 06 hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-25 14:30:22 +02:00
Jakub Sokołowski bcc297b796
prater: move libp2p nodes from AWS to Hetzner 
It will lower costs of Prater fleet. I've discussed this with Tanguy and
he's fine with it. I'm also addin two nodes without validators.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-25 12:58:59 +02:00
Jakub Sokołowski b5684f018e
drop prater 02 AWS nodes, rename stable one 
The renaming of:
`stable-large-01.aws-eu-central-1a.nimbus.prater`
to
`testing-large-01.aws-eu-central-1a.nimbus.prater`
Was done because the host was a Prater bootstrap node and it could not
be lost. The node key and the ports remained unchanged.

https://github.com/status-im/infra-nimbus/issues/60

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-22 18:23:22 +02:00
Jakub Sokołowski 961756674c
nimbus.prater: move validators to new MacOS host 
https://github.com/status-im/infra-nimbus/issues/60
https://github.com/status-im/infra-role-dist-validators/commit/f5e6c306

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-22 17:56:20 +02:00
Jakub Sokołowski 5f04e4b15a
nimbus.prater: lower max peers on macos to fix file limit 
It's a temporary fix until we apply a proper solution which involves
calling `setrlimit()` at startup to raise the soft limit:
https://github.com/status-im/nimbus-eth2/issues/2984

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-22 14:07:38 +02:00
Jakub Sokołowski c5a3c9fd91
terrafomr: change instance_type variable to just type 
https://github.com/status-im/infra-tf-amazon-web-services/commit/36571309

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-20 12:45:32 +02:00
Jakub Sokołowski 556a495c68
prater: fix bootstrap node ports to be 9100 
Since we published their addresses with ports being 9100:
https://github.com/eth2-clients/eth2-networks/commit/463d414c

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-19 15:48:34 +02:00
Jakub Sokołowski 1dfba96dec
nimbus.eth1: sync goerli instad of mainnet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-14 13:05:29 +02:00
Jakub Sokołowski f10eab7ed7
requirements: update to fix Hetzner data volumes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-13 20:27:57 +02:00
Jakub Sokołowski 7aa5d2d420
add all users to admin group on MacOS hosts 
This fixes SSH access issue, since only admin group members can have
remote access to the host:
https://www.vinnie.work/blog/2020-12-26-why-so-hard-osx-ssh-access/

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-13 13:34:56 +02:00
Jakub Sokołowski 8c69a70ccd
requirements: deploy Netdata to MacOS host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-12 17:33:23 +02:00
Jakub Sokołowski 5d828108b0
combine three bootstrap playbooks into one 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-12 17:16:22 +02:00
Jakub Sokołowski 6c67bcabdc
get-geth-web3-urls: support windows and deploy 
Fixes sync issues described in:
https://github.com/status-im/infra-nimbus/issues/75

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-12 13:52:13 +02:00
Jakub Sokołowski bd6ed56d74
deploy Consul and WireGuard to MacOS host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-06 22:24:06 +02:00
Jakub Sokołowski 67c7eff430
nimbus.prater: deploy Consul agent on MacOS host 
https://github.com/status-im/infra-role-bootstrap-macos/pull/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-06 13:57:33 +02:00
Jakub Sokołowski 454796a885
pin ports for mainnet bootstrap nodes 
We have published their addresses with these ports
therefore they cannot be changed.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 21:37:04 +02:00
Jakub Sokołowski 3585f5615a
mainnet/prater: block libp2p ports for select nodes 
As part of experiment in how nodes behave in restrictive networks.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 18:28:08 +02:00
Jakub Sokołowski 6ed5081087
nimbus.prater: move validators from 03 nodes to metal-02 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 15:46:13 +02:00
Jakub Sokołowski 6df0c868df
nimbus.prater: fix naming of libp2p services 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 14:51:49 +02:00
Jakub Sokołowski 89cbff6b52
switch back to original 3 branch layout of nodes 
Since with release of `1.5.0` the `stable` branch has all the necessary changes:
https://github.com/status-im/nimbus-eth2/releases/tag/v1.5.0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 12:43:51 +02:00
Jakub Sokołowski 61e573d40a
nimbus.mainnet: add 2GB swap file for all hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 12:08:14 +02:00
Jakub Sokołowski b78c5421b5
nimbus.prater: create testing.prater.beacon-api endpoint 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 10:38:12 +02:00
Jakub Sokołowski 8a91646bfe
nimbus.prater: deploy nodes to metal-02 
Without validators for now.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 23:45:19 +02:00
Jakub Sokołowski 49a964ed29
add metal-02.he-eu-hel1.nimbus.prater 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 22:47:26 +02:00
Jakub Sokołowski 9a8fbd88f8
nimbus.pyrmont: refactor node layout configuration 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 22:36:29 +02:00
Jakub Sokołowski 7eb4c4749c
nimbus.prater: refactor node layout configuration 
This is necessary to support multiple hosts with multiple nodes.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 21:59:25 +02:00
Jakub Sokołowski 018e1f3b78
enable beacon_node_rpc_enabled for all hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 17:53:07 +02:00
Jakub Sokołowski 4a911d1ccc
add unstable.prater.beacon-api.nimbus.team endpoint 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 16:54:43 +02:00
Jakub Sokołowski 5f06c39644
nimbus.mainnet: add two public Beacon API endpoints 
These nodes are intended for testing by Community.
https://ethereum.github.io/beacon-APIs/

https://github.com/status-im/infra-nimbus/issues/66

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 13:42:33 +02:00
Jakub Sokołowski 6c7e3384e5
nimbus.mainnet: deploy 6 nodes on new Hetzner hosts 
https://github.com/status-im/infra-nimbus/issues/66

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 12:08:58 +02:00
Jakub Sokołowski 81bd269610
nimbus.mainnet: add new 6 hetzner hosts 
https://github.com/status-im/infra-nimbus/issues/66

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 12:08:49 +02:00