status-im
/
infra-nimbus
mirror of https://github.com/status-im/infra-nimbus.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
1,032 Commits 10 Branches 0 Tags 31 MiB
Commit Graph

914 Commits

Author SHA1 Message Date
Jakub Sokołowski 4d5197c728
nimbus-openeth: OpenEth has been discontinued 
The repo has been archived and receives no updates:
https://github.com/openethereum/openethereum

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-30 10:48:54 +02:00
Jakub Sokołowski 207064c5d6
nimbus.mainnet: fix syncing using ERA files 
https://github.com/status-im/infra-nimbus/issues/98

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-29 13:08:06 +02:00
Jakub Sokołowski ddc8de5fa4
requirements: upgrade Geth to 1.10.23 
https://github.com/status-im/infra-role-geth/commit/773c384d

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-24 14:03:58 +02:00
Jakub Sokołowski cca16d27c5
nimbus.prater: enable payload builder for two nodes 
https://github.com/status-im/infra-nimbus/issues/124

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-23 15:29:40 +02:00
Jakub Sokołowski 620958880d
requirements: upgrade Geth from 1.10.21 to 1.10.22 
https://github.com/ethereum/go-ethereum/releases/tag/v1.10.22

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-22 14:19:30 +02:00
Jakub Sokołowski 33f376cc3d
nimbus.mainnet: resync monthly and add 7 days delay 
To avoid resyncing multiple nodes at the same time.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-22 10:54:10 +02:00
Jakub Sokołowski 6336f4514e
requirements: fix resync timers stop/starting service 
https://github.com/status-im/infra-nimbus/issues/98

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-18 10:28:10 +02:00
Jakub Sokołowski 49a4c358b1
nimbus-sepolia-metal: add missing Web3 JWT secret 
We set it for Geth, but not for Beacon nodes.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-18 09:56:15 +02:00
Jakub Sokołowski f8c262dfb4
nimbus.mainnet: enable creating resync timer jobs 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-18 09:04:38 +02:00
Jakub Sokołowski 7ec7641eed
nimbus.prater: open REST API ports to the fleet 
Allows for trusted node syncing through the VPN.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-16 18:02:19 +02:00
Jakub Sokołowski 79843f4c25
requirements: bump most roles, add scope to geth 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-16 17:59:57 +02:00
Jakub Sokołowski b0a9b11d50
requirements: bump bootstrap roles 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-16 12:45:02 +02:00
Jakub Sokołowski 4fe3a607fe
nimbus.mainnet: open REST port to access via VPN 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-13 11:42:41 +02:00
Jakub Sokołowski 7d0029b9e2
drop unused ropsten-01.aws-eu-central-1a.nimbus.geth 
https://github.com/status-im/infra-nimbus/issues/117

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-12 10:53:47 +02:00
Jakub Sokołowski 823196a0d9
use Geth Auth RPC endpoints for Engine API 
Needs JWT secrets configured and changes to Consul queries.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-11 19:23:41 +02:00
Jakub Sokołowski f0aa49e60a
nimbus-sepolia-metal: drop mev-register-validators 
Changes are already inn `unstable`.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-11 19:13:40 +02:00
Jakub Sokołowski 9d8e55dd55
nimbus-geth: configure Auth RPC ports for Engine API 
This is required for communication with consensus layer nodes:
https://geth.ethereum.org/docs/interface/consensus-clients

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-11 13:06:37 +02:00
Jakub Sokołowski 30ed658621
grant SSH access to etan@status.im 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-11 13:06:36 +02:00
Jakub Sokołowski e3c203c815
nimbus.mainnet: enable purging DB for even nodes 
https://github.com/status-im/infra-nimbus/issues/98

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-10 22:34:21 +02:00
Jakub Sokołowski b207184ede
get-geth-api-urls: specify fleet to avoid other nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-10 22:31:13 +02:00
Jakub Sokołowski 1ffc159f70
use idx instead of port_offset loop_var name 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-10 16:55:01 +02:00
Jakub Sokołowski b4b97d9338
nimbus.ropsten: spread validators between all nodes 
https://github.com/status-im/infra-nimbus/issues/117

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-08 13:03:31 +02:00
Jakub Sokołowski 470f24cf5c
nimbus.mainnet: fix location of node DB folder 
We've gotten rid of the `shared_{network}_0` subfolder:
https://github.com/status-im/infra-role-beacon-node-linux/commit/f4259bdf

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-08 11:37:46 +02:00
Jakub Sokołowski 974ab511a7
requirements: re-enable beacon-node API healthcheck 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-08 10:33:39 +02:00
Jakub Sokołowski e8eded758c
nimbus.mainnet: enable ERA folder symlinking 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-08 10:32:48 +02:00
Artur Marud b3e6e3f972
ropsten: create multi-geth config (#120) 
* ropsten: create multi-geth config

Related: https://github.com/status-im/infra-nimbus/issues/117

Signed-off-by: Artur Marud <artur@status.im>
 2022-07-22 14:24:00 +02:00
Jakub Sokołowski da363b1a23
nimbus-era-files: make timer optional 
AWS hosts have just one node, so there's no need for ERA files generation.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-20 15:17:18 +02:00
Artur Marud fb67e2fe16
ropsten: added new disk configuration for ropsten hetzner host (#119) 
Signed-off-by: Artur Marud <artur@status.im>
 2022-07-19 21:34:20 +02:00
Artur Marud 65d8f36123
sepolia: implement and configure "payload_builder" feature for `node-02` (#118) 
Refers: https://github.com/status-im/nimbus-eth2/pull/3883

Signed-off-by: Artur Marud <artur@status.im>
 2022-07-18 18:47:06 +02:00
Jakub Sokołowski 57ec2fd903
requirements: bump beacon node to use new data path 
We dropped the `shared_*` folders from data paths.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-18 09:53:35 +02:00
Jakub Sokołowski a6bc25ebd3
logs.nimbus: drop ElasticHQ in favor of ES Comrade 
https://github.com/status-im/infra-hq/issues/82

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-14 20:31:24 +02:00
Jakub Sokołowski 472a379a9a
dash.nimbus: fix LB variable typos 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-14 16:51:20 +02:00
Jakub Sokołowski 3cc72b68e9
nimbus.mainnet: deploy nimbus-era-files to metal hosts 
https://github.com/status-im/infra-nimbus/issues/98

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-14 01:00:29 +02:00
Jakub Sokołowski 00cfcf569f
nimbus-era-files: role for ERA generating timer 
https://github.com/status-im/infra-nimbus/issues/98

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-14 00:59:59 +02:00
Jakub Sokołowski ce48768972
requirements: disable windows user password expiry 
https://github.com/status-im/infra-nimbus/issues/116

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-12 16:04:19 +02:00
Jakub Sokołowski 07d561b62a
logs.nimbus: fix firewall rules for logs.hq fleet 
https://github.com/status-im/infra-hq/issues/80

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-11 17:42:50 +02:00
Jakub Sokołowski cf57579f9d
nimbus-sepolia-trial: set JWT shared secret token 
Otherwise beacon node fails at startup with:
```
Failed to setup web3 connection: WebSocket connection error: 403 Forbidden
```
https://github.com/status-im/infra-nimbus/issues/111

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-07 20:24:47 +02:00
Jakub Sokołowski 0b58b2f8b5
deploy nimbus-eth1 and beacon nodes for Sepolia 
https://github.com/status-im/infra-nimbus/issues/111

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-07 16:24:06 +02:00
Jakub Sokołowski ddeb32e432
nimbus-sepolia-metal: drop unused branch variable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-07 10:34:03 +02:00
Jakub Sokołowski 4e0db40fb4
requirements: upgrade Geth to 1.10.20 
https://github.com/ethereum/go-ethereum/releases/tag/v1.10.20

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-05 18:50:55 +02:00
Miran 2b079f1774
fix various typos in comments and roles 2022-07-04 15:07:55 +02:00
Jakub Sokołowski 6702c50f38
bootstrap: give miran sudo permissions 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-04 09:32:53 +02:00
Jakub Sokołowski 2d2c55b38e
requirements: drop unused beacon node build flag 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-04 09:10:47 +02:00
zah 4147d511ba
Enable websock on some servers; Use the typical branches for Sepolia (#113) 2022-07-01 14:15:11 +02:00
Artur Marud f129dc6a3b
prater: continued nim-1.6 rollout 
Signed-off-by: Artur Marud <artur@status.im>
 2022-06-28 19:12:24 +02:00
Jakub Sokołowski 558e226afb
nimbus-geth-mainnet: open API for eth2.prod fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-28 19:04:24 +02:00
Jakub Sokołowski f804a857f8
requirements: upgarde bootstrap roles and geth 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-27 18:30:48 +02:00
Jakub Sokołowski 0e3c1dc47a
requirements: bump geth to include new defaults 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-22 15:11:12 +02:00
zah 6ae39ddd3d
Use Nim 1.6 on metal-05's libp2p instance (#112) 2022-06-22 11:39:15 +02:00
Jakub Sokołowski 5aa3b64aca
requirements: bump beacon node roles 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-20 09:59:47 +02:00
Artur Marud defee3c490
infra-nimbus: sepolia validators configuration 
Signed-off-by: Artur Marud <artur@status.im>
 2022-06-20 09:51:38 +02:00
Artur Marud 61c0be82e1
infra-nimbus: sepolia beacon nodes setup 
Signed-off-by: Artur Marud <artur@status.im>
 2022-06-17 11:55:18 +02:00
Artur Marud e43c8af2b7
infra-nimbus: go-eth upgrade to 1.10.19 for ropsten, kiln and sepolia 
* major changes - correct TTD for reopsten by default

Signed-off-by: Artur Marud <artur@status.im>
 2022-06-15 17:02:34 +02:00
Artur Marud 9ebf3cba2d
Sepolia (#110) 
* infra-nimbus: new testnet - sepolia

Signed-off-by: Artur Marud <artur@status.im>
 2022-06-15 15:03:58 +02:00
zah 34f9a4b03b
Test our most recent branches with Nim 1.6 (#109) 
The branch_override is no longer necessary, because our unstable and testing branches should be building fine with Nim 1.6
 2022-06-14 15:23:52 +02:00
Jakub Sokołowski 2b57a4096e
add serial variable to playbooks 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-14 11:40:18 +02:00
Jakub Sokołowski 2dd96fdc36
drop giovanni from active users 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-14 10:12:01 +02:00
Etan Kissling f165e2ff52 disable light client data overrides 
On `kiln`, `ropsten`, `prater`, `sepolia`, the BN code applies network
specific defaults `true` / `only-new`. `mainnet`: `false` / `none`.
This means that the overrides here are no longer needed, also avoiding
issues with planned renames of the parameters in the BN implementation.

Signed-off-by: Etan Kissling <etan@status.im>
 2022-06-14 10:09:02 +02:00
narimiran bf1cc4a5a0 users: add miran 2022-06-10 15:33:19 +02:00
Jakub Sokołowski 427ef2a3c0
nimbus-geth-ropsten: add required engine API module 
Without it the merge fails with:
```
{
  "lvl": "DBG",
  "ts": "2022-06-08 16:08:59.069+00:00",
  "msg": "{\"code\":-32601,\"message\":\"the method engine_newPayloadV1 does not exist/is not available\"}"
}
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-08 19:02:41 +02:00
Jakub Sokołowski fbc939aef1
nimbus.ropsten: move all validators to first node 
We can't have multiple nodes controling a single Geth instance.
This will lead to unpredictable behavior on the execution layer.

https://github.com/status-im/infra-nimbus/issues/97

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-08 11:08:11 +02:00
Jakub Sokołowski c8fa895f98
get-geth-api-urls: query for OpenEthereum nodes too 
https://github.com/status-im/infra-nimbus/issues/80

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-03 12:01:44 +02:00
Jakub Sokołowski f82df25498
nimbus.openeth: upgrade to 3.3.5, add metrics 
https://github.com/status-im/infra-role-openethereum/commit/83996de8

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-03 10:53:36 +02:00
Jakub Sokołowski f615273cdc
nimbus.ropsten: lower TTD to 50000000000000000 
"Here’s an update on the Ropsten TTD: we’ve chosen to use a value of
50000000000000000. At the current hash rate, it would hit in several
weeks. That said,  the EF will rent hash rate itself and work with
partners to accelerate things. With a modest increase in hash rate, we
should be able to make the Ropsten Merge happen on June 8/9.

If your
team is running any validators, please perform a TTD override to
50000000000000000 on them ASAP."

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-02 18:13:12 +02:00
Jakub Sokołowski 77695bd0ea
nimbus-geth-ropsten: set custom TTD for geth 
https://hackmd.io/ngKLqVvvTTGZLj1bGPuCoA#Geth

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-02 10:51:27 +02:00
Jakub Sokołowski c474a3311d
logs.nimbus: leave memory for Lucene, use 32 GB heap 
https://github.com/status-im/infra-nimbus/issues/96

"The moral of the story is this: even when you have memory to spare, try
to avoid crossing the 32 GB heap boundary. It wastes memory, reduces CPU
performance, and makes the GC struggle with large heaps."

https://www.elastic.co/guide/en/elasticsearch/guide/current/heap-sizing.html#compressed_oops
https://www.elastic.co/guide/en/elasticsearch/guide/current/heap-sizing.html#_give_less_than_half_your_memory_to_lucene

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 12:28:48 +02:00
Jakub Sokołowski 3366cd40ef
enable validator monitoring regardless of branch 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 11:51:14 +02:00
Jakub Sokołowski a670e46895
dash.nimbus: move nimbus-logs to our own SSL proxy 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 11:43:48 +02:00
Jakub Sokołowski 5e1af52f2d
logs.nimubs: move nimbus-es to our own SSL proxy 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 11:43:45 +02:00
Jakub Sokołowski f8b09ccd3c
dash.nimbus: upgrade kibana and ES to 7.17.4 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 11:40:19 +02:00
Artur Marud b1545a6662
nimbus.ropsten: Validators layout setup 
Signed-off-by: Artur Marud <artur@status.im>
 2022-05-26 19:11:55 +02:00
Jakub Sokołowski 11aa98adf1
requirements: fix dist-validators bug 
Not fetching new changes from `nimbus-private` repo on Windows.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-26 13:13:07 +02:00
Jakub Sokołowski b10890920a
requirements: upgrade Geth to 1.10.18 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-26 00:58:01 +02:00
Artur Marud 7e19b3d93e
nimbus.ropsten: Initial beacon node setup 
https://github.com/status-im/infra-nimbus/issues/97

- no validators have been deployed yet.

Signed-off-by: Artur Marud <artur@status.im>
 2022-05-25 13:35:12 +02:00
Artur Marud fe9aed90a2
nimbus.geth: Opened firewall rpc port for ropsten 
Signed-off-by: Artur Marud <artur@status.im>
 2022-05-25 12:28:49 +02:00
Jakub Sokołowski 05214dc254
nimbus.ropsten: add metal-01.he-eu-hel1.nimbus.ropsten 
Host for Nimbus nodes for new merge testnet called Ropsten:
https://github.com/status-im/infra-nimbus/issues/97

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-25 11:19:10 +02:00
Jakub Sokołowski 8c27671a95
nimbus.geth: bump Ropsten data volume to 250 GB 
https://github.com/status-im/infra-nimbus/issues/97

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-24 18:23:47 +02:00
Jakub Sokołowski 6a2a801190
nimbus-geth-ropsten: switch Geth to snap sync 
Full sync is just too slow and will not finish in time.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-24 11:16:23 +02:00
Jakub Sokołowski e163284f9b
nimbus.prater: fix port number for public API 
Fixes:
http://unstable.prater.beacon-api.nimbus.team/eth/v1/node/version

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-23 14:00:55 +02:00
Jakub Sokołowski dcc11e0c87
nimbus-geth-ropsten: configure Geth instance 
https://github.com/status-im/infra-nimbus/issues/97

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-20 20:16:42 +02:00
Jakub Sokołowski 94ffee2813
add ropsten-01.aws-eu-central-1a.nimbus.geth host 
https://github.com/status-im/infra-nimbus/issues/97

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-20 20:16:10 +02:00
Jakub Sokołowski dcbc5f03c3
ansible/upgrade.yml: update to version from template 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-20 20:15:34 +02:00
Jakub Sokołowski f6c1529bea
nimbus.kiln: upgrade images and init JSON SHA256 
The host was also reinstalled as it had weird networking issues.
It also had very flaky Geth nodes, which caused a lot of alerts.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-16 20:50:46 +02:00
Jakub Sokołowski bd87eacbc9
ansible.cfg: drop remote_user=admin from config 
It made sense when there was only one admin.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-12 09:53:52 +02:00
Zahary Karadjov e6f2f3e010 Add another 10K prater validators 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-05 16:37:49 +02:00
Jakub Sokołowski 389e6dd432
nimbus.mainnet: fix number variable for metal-02 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-04-26 10:16:44 +04:00
Jakub Sokołowski ea49b47011
drop redundant --proposer-boosting-debug flag 
https://github.com/status-im/infra-role-beacon-node-linux/commit/907ee4b6
https://github.com/status-im/infra-role-beacon-node-macos/commit/290984b3
https://github.com/status-im/infra-role-beacon-node-windows/commit/c2f22db0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-04-12 20:12:01 +02:00
Jakub Sokołowski f58a8506a9
nimbus.kiln: use new container built from master 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-04-12 19:25:55 +02:00
Jakub Sokołowski d231accd45
logs.nimbus: refactor OAuth container setup 
This is to take into account changes made in:
https://github.com/status-im/infra-role-oauth-proxy/commit/4dd42c56

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-04-11 11:26:38 +02:00
Jakub Sokołowski 32835c38b4
ci-slave-metal: remove SSH access from Stefan 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-31 20:02:18 +02:00
Jakub Sokołowski 5bbc1458cf
expose API at unstable.kiln.beacon-api.nimbus.team 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-30 18:27:11 +02:00
Etan Kissling 79c5899f62 nimbus.prater: enable --*-light-client-data 
Signed-off-by: Etan Kissling <etan@status.im>
 2022-03-30 16:28:36 +02:00
Jakub Sokołowski 50fa1be86f
enable proposer boosting for all nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-30 13:07:23 +02:00
Jakub Sokołowski 6e79a6df06
dash.nimbus: lower ES indice clean up to 14 days 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-29 21:39:42 +02:00
Etan Kissling 91cc24b228 nimbus.kiln: enable --*-light-client-data 
Signed-off-by: Etan Kissling <etan@status.im>
 2022-03-28 18:17:44 +02:00
Jakub Sokołowski c85d852e9c
drop config for nimbus.pyrmont fleet 
The testnet has been discontinued.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-26 10:36:56 +01:00
Etan Kissling c0630aeb00 nimbus: mark branches supporting BN light client data 
Signed-off-by: Etan Kissling <etan@status.im>
 2022-03-25 17:31:22 +01:00
Jakub Sokołowski 70bf75d1de
drop deprecated JSON-RPC API port from all nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-22 18:58:19 +01:00
Jakub Sokołowski 45d7608040
nimbus.mainnet: enable proposer boosting for unstable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-22 11:40:44 +01:00
Jakub Sokołowski 9661063ebd
logclean-job: add missing Install section for timer 
Without it it doesn't get enabled at boot time.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-17 19:51:56 +01:00
Jakub Sokołowski 3266a65a83
nimbus.fluffy: use first two nodes as bootstrap nodes 
https://github.com/status-im/infra-nimbus/issues/87

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-16 11:50:17 +01:00
Jakub Sokołowski 71a0430e1c
nimbus.fluffy: add loop_var, include consul fixes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-16 00:59:01 +01:00
Jakub Sokołowski d33ec7037e
nimbus.kiln: enable --proposer-boosting-debug 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 19:10:38 +01:00
Jakub Sokołowski 38b16053cf
nimbus.kiln: add validators layout for testnet 
https://github.com/status-im/nimbus-private/commit/e963d195
https://github.com/status-im/nimbus-private/tree/master/kiln_deposits

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 16:54:32 +01:00
Jakub Sokołowski 0d5ef90cd2
nimbus.kiln: configure beacon nodes without validators 
https://github.com/status-im/infra-nimbus/issues/88

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 15:40:21 +01:00
Jakub Sokołowski a4e54f2c5e
nimbus.kiln: update Geth bootstrap nodes list 
Based on this recent PR:
https://github.com/eth-clients/merge-testnets/pull/6

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 15:38:42 +01:00
Jakub Sokołowski 69469913fb
nimbus.kiln: configure four Geth containers 
- https://github.com/status-im/infra-nimbus/issues/88
- https://config.kiln.themerge.dev/el/bootnodes
- https://config.kiln.themerge.dev/el/genesis/geth.json
- https://kiln.themerge.dev/

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 12:29:27 +01:00
Jakub Sokołowski 3a277cebd6
cleanup: clean also service logs 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 12:11:39 +01:00
Jakub Sokołowski 968c174ba0
bootstrap: add extra IP to SSHGuard whitelist 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-11 11:45:07 +01:00
Jakub Sokołowski dd43e135a5
move metal-07.he-eu-hel1.nimbus.prater to nimbus.kiln 
Also move validators from it to `metal-06`.
https://github.com/status-im/infra-nimbus/issues/88

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-10 18:19:25 +01:00
Jakub Sokołowski f2777f6496
nimbus.fluffy: configure 32 nodes on each host 
https://github.com/status-im/infra-nimbus/issues/87

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-08 15:50:03 +01:00
Jakub Sokołowski 2a98be3ade
add two new hosts for nimubs.fluffy fleet 
https://github.com/status-im/infra-nimbus/issues/87

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-08 12:23:11 +01:00
Jakub Sokołowski 1b9d64e72f
enable --proposer-boosting-debug on testnet unstable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-07 12:53:23 +01:00
Jakub Sokołowski 8017d10bbc
requirements: bump Geth to 1.10.16 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-07 11:09:01 +01:00
Jakub Sokołowski 89093c894a
logs.nimbus: firewall for ElasticSearch exporter port 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-03 18:23:13 +01:00
Jakub Sokołowski 6488efd4e9
nimbus-db-purge: deploy to two mainnet hosts 
https://github.com/status-im/infra-nimbus/issues/86

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-28 17:32:01 +01:00
Jakub Sokołowski a8b48242b0
nimbus-db-purge: add role to periodicall purge DB 
https://github.com/status-im/infra-nimbus/issues/86

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-28 17:31:31 +01:00
Jakub Sokołowski 01e129694b
dummy-module: don't set become_user for inventory 
Causes `become_user` specified in tasks to be ignored.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-28 16:51:16 +01:00
Jakub Sokołowski c4436f71f4
drop windows-01.gc-us-central1-a.nimbus.prater 
Replaced by `windows-01.he-eu-hel1.nimbus.prater` due to disk space
constraints and high cost of Google Cloud host.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-28 13:14:04 +01:00
Jakub Sokołowski 9b365b02a7
add new windows-01.he-eu-hel1.nimbus.prater host 
To replace `windows-01.gc-us-central1-a.nimbus.prater` which is running
out of disk space, and is also far too expensive.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-25 15:02:27 +01:00
Jakub Sokołowski 489878038e
requirements: bump bootstrap roles 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-24 01:40:03 +01:00
Jakub Sokołowski c0ab15c34f
mainnet.openeth: deploy OpenEthereum node to the host 
We need some variety and redundancy in how we sync Eth1:
https://github.com/status-im/infra-nimbus/issues/80

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-21 17:26:33 +01:00
Jakub Sokołowski 3acbf34f70
add new mainnet-01.he-eu-hel1.nimbus.openeth host 
https://github.com/status-im/infra-nimbus/issues/80

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-21 13:54:20 +01:00
Jakub Sokołowski 54c847b9db
nimbus.geth: bump Goerli data volume to 150 GB 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-18 19:37:25 +01:00
Jakub Sokołowski 9f52f8701f
nimbus.mainnet: bump size of AWS data volumes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 20:47:57 +01:00
Jakub Sokołowski 6940d0219c
drop libp2p node from macos host to save space 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 19:53:50 +01:00
Jakub Sokołowski 65304b6aaa new validator layout for prater fleet 
The `0/1/10/30/60/899/4000` layout will require 3 more hosts.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 19:41:07 +01:00
Jakub Sokołowski 3d4679f0d3
nimbus.prater: add nim_compiler overrides 
For some reason `nim-1.6` branch doesn't actually use Nim 1.6 compiler.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 14:24:37 +01:00
Jakub Sokołowski 01c6a06117
nimbus.prater: override some branches to nim-1.6 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-17 13:46:56 +01:00
Jakub Sokołowski d6414fd956
deploy nodes without validators to 3 new prater hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-16 17:19:23 +01:00
Jakub Sokołowski 612eb284c6
add 3 new nimbus.prater hosts 
Necessary for new layout from:
https://github.com/status-im/infra-nimbus/pull/85

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-16 17:09:51 +01:00
Jakub Sokołowski 84d2773a98
deploy nodes without validators to new prater hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-15 21:09:51 +01:00
Jakub Sokołowski ec65bac02a
nimbus.pyrmont: drop two nodes and move validators 
Two nodes will be reused in the Prater fleet.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-15 21:08:44 +01:00
Jakub Sokołowski 18eb46836e
logs.nimbus: use docker compose setup for elasticsearch 
https://github.com/status-im/infra-role-elasticsearch/commit/567f32ac

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-11 02:08:47 +01:00
Jakub Sokołowski b12a350cb9
bitwarden: include fixes for session invalidation 
For more details see:
- https://github.com/status-im/infra-misc/issues/90
- https://github.com/c0sco/ansible-modules-bitwarden/issues/23

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-10 15:34:18 +01:00
Jakub Sokołowski 4e7625beee
requirements: bump wireguard role 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-10 14:50:05 +01:00
Jakub Sokołowski 392d4124c5
dash.nimbus: bump limit of log indices back to 20 
Currently daily indices take up 10 GB per host, so it' fine.

https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-10 12:31:03 +01:00
Jakub Sokołowski 0398c31ad9
logs.nimbus: drop ES replicas down to 0 to save space 
https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-09 18:43:23 +01:00
Jakub Sokołowski fbb1ee69d9
consul: update token paths in BitWarden 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-09 00:24:07 +01:00
Jakub Sokołowski d74ff169ef
wireguard: bump role and add Consul ACL token 
Part of effort to lock down Consul ACLs:
https://github.com/status-im/infra-hq/issues/70

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-08 20:51:45 +01:00
Jakub Sokołowski cdf63cba43
consul: add mandatory agent ACL token 
https://github.com/status-im/infra-hq/issues/70

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-08 11:58:55 +01:00
Jakub Sokołowski fb7bde2377
dash.nimbus: lower indices kept to 10 
We have bigger log volume now that we fixed the logging setup in:
https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-07 15:07:55 +01:00
Jakub Sokołowski f665fcd8ce
rename logs-dash groups_vars to dash.nimbus 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-07 15:03:12 +01:00
Jakub Sokołowski ba2caedb64
logs.nimbus: bump JVM memory limits to 80% 
We started getting errors like:
```
Caused by: org.elasticsearch.common.breaker.CircuitBreakingException: [parent] Data too large, data for [internal:cluster/nodes/indices/shard/store[n]] would be [36997638608/34.4gb], which is larger than the limit of [36795685273/34.2gb], real usage: [36997638456/34.4gb], new bytes reserved: [152/152b], usages [request=0/0b, fielddata=0/0b, in_flight_requests=152/152b, model_inference=0/0b, eql_sequence=0/0b, accounting=3913236/3.7mb]
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-07 11:49:44 +01:00
Jakub Sokołowski ade0a50a53
logs.nimbus: migrate to Hetzner metal hosts 
For better performance, lower prices, and better network utilization.

https://github.com/status-im/infra-nimbus/issues/84

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-03 21:48:24 +01:00
Jakub Sokołowski aed600506d
requirements: deploy consul listen address fix 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-03 19:06:52 +01:00
Jakub Sokołowski b3da28aeb8
requirements: bump bootstrap to fix journald config 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-01 12:58:13 +01:00
Jakub Sokołowski a6d673366a
all: lowe logrotate count to 48, bump bootstrap 
Also remove `delaycompress` from logrotate config.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-31 17:09:28 +01:00
Jakub Sokołowski 4983b11282
requirements: bump bootstrap and beacon node roles 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-28 13:41:02 +01:00
Jakub Sokołowski 0dc470aae2
requirements: add support for ansible toggle script 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-26 11:00:20 +01:00
Jakub Sokołowski 2962ebbee0
disable use of HTTP Eth1 node endpoints 
Should fix issues with leaking file descriptors causing peer issues and
metrics endpoint timeouts.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-26 01:22:16 +01:00
Jakub Sokołowski 0369818fa0
replace macos-01.ms-eu-dublin.nimbus.prater host 
The old one had only 256 GB of SSD storage which is not enough for
three nodes syncing Prater testnet.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-24 15:44:38 +01:00
Jakub Sokołowski 9b54c84d96
enable validator monitoring flags for unstable nodes 
Once the next release is out we can drop the `unstable` conditionals.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-21 15:36:53 +01:00
Jakub Sokołowski 4ff2422fe2
nimbnus.prater: use the AWS NVMe drive for data 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-19 11:26:16 +01:00
Jakub Sokołowski e00443d6e2
nimbus.mainnet: drop libp2p-02 nodes to save space 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-13 14:16:41 +01:00
Jakub Sokołowski 79f55366f2
requirements: upgrade Geth to 1.10.15 
https://github.com/ethereum/go-ethereum/releases/tag/v1.10.15

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-07 13:05:58 +01:00
Jakub Sokołowski 667fd3184e
builds: add libp2p metrics flags 
This is done instead of this PR:
https://github.com/status-im/infra-role-beacon-node-linux/pull/3/files

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-05 19:38:23 +01:00
Jakub Sokołowski f106c9e5b8
requirements: parametrize nim build flags 
https://github.com/status-im/infra-role-beacon-node-linux/commit/d993d06d
https://github.com/status-im/infra-role-beacon-node-macos/commit/ed0453ef
https://github.com/status-im/infra-role-beacon-node-windows/commit/f6dd9dd6

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-05 19:38:23 +01:00
Jakub Sokołowski 237da365e7
bootstrap: add missing admin pass for macos hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-04 20:55:08 +01:00
Jakub Sokołowski 9c8b0f6185
users: give tanguy sudo permissions 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-04 15:35:30 +01:00
Jakub Sokołowski d99b195bc1
consul: upgrade from 1.10.1 to 1.11.1 
https://github.com/hashicorp/consul/releases/tag/v1.11.1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-03 17:53:34 +01:00
Jakub Sokołowski 462f373827
mainnet.geth: use snap sync method 
We had issues with mainnet node not fully syncing.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-18 18:06:59 +01:00
Jakub Sokołowski 2724d8f8b2
requirements: upgrade Netdata to 1.32.0 
https://github.com/netdata/netdata/releases/tag/v1.32.0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-09 17:37:31 +01:00
Jakub Sokołowski f745dfd2f8
add missing get-geth-api-urls role for macos host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-07 18:31:46 +01:00
Jakub Sokołowski 5dae92080a
get-geth-api-urls: use HTTP RPC API for unstable only 
Current support for HTTP RPC API is not stable enough.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-03 19:40:52 +01:00
Jakub Sokołowski 0c1169cee3
get-geth-api-urls: query for HTTP RPC API endpoints 
We want to test the support for normal HTTP API endpoints.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-02 13:14:41 +01:00
Jakub Sokołowski 62835a2079
requirements: bump bootstrap roles and geth version 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-02 13:09:48 +01:00
Jakub Sokołowski ce70b55014
prater-windows: disable windows defender 
Negatively impacts I/O performance, and we don't need it.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-25 20:00:52 +01:00
Jakub Sokołowski 1ffbb8d351
requirements: bump windows, increase check timeouts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-24 20:46:31 +01:00
Jakub Sokołowski 85d4b054be
requirements: update --log-format flag, bootstrap 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-24 19:54:46 +01:00
Jakub Sokołowski 5d5857928d
pyrmont: expose REST API at insecura.nimbus.team 
Inteded for tests of public insecure API access for Jacek.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-22 15:36:56 +01:00
Jakub Sokołowski 968f56f7ed
update SSH credentials 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-18 17:44:08 +01:00
Jakub Sokołowski 871ece2a3f
fix for renamed --log-stdout flag to --log-format 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-10 18:47:55 +01:00
Jakub Sokołowski 6c3384b8ba
ugprade Rocketpool to 1.0.0 
https://github.com/status-im/infra-rocketpool/issues/2

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-08 13:35:37 +01:00
Jakub Sokołowski f334b8917f
rocketpool: upgrade to v1.0.0-pre4 
https://github.com/status-im/infra-role-rocketpool/issues/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-03 14:02:57 +01:00
Jakub Sokołowski 2fd016d36d
requirements: add support for --log-stdout flag 
Necessary to keep logs in JSON format.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-03 10:14:16 +01:00
Jakub Sokołowski a4877e9b28
upgrade ELK stack to 7.14.2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-28 19:29:15 +02:00
Jakub Sokołowski edfcf0b621
nimbus.eth1: update rocketpool setup to new layout 
https://github.com/status-im/infra-rocketpool/issues/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-27 20:38:59 +02:00
Jakub Sokołowski 9fddf38791
geth: open mainnet ports for rocket.prod fleet 
https://github.com/status-im/infra-rocketpool/issues/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-26 15:37:00 +02:00
Jakub Sokołowski 8e19a929d3
restart.yml: add playbook to restart all nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-26 13:21:18 +02:00
Jakub Sokołowski db178fc217
rebuild.yml: add playbook to rebuild all nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-26 13:21:14 +02:00
Jakub Sokołowski 9887cdbfc9
requirements: udpate to use new rocketpool role name 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-26 13:08:29 +02:00
Jakub Sokołowski 6be2fc03e9
mainnet: add two libp2p nodes on 05 and 06 hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-25 14:30:22 +02:00
Jakub Sokołowski bcc297b796
prater: move libp2p nodes from AWS to Hetzner 
It will lower costs of Prater fleet. I've discussed this with Tanguy and
he's fine with it. I'm also addin two nodes without validators.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-25 12:58:59 +02:00
Jakub Sokołowski b5684f018e
drop prater 02 AWS nodes, rename stable one 
The renaming of:
`stable-large-01.aws-eu-central-1a.nimbus.prater`
to
`testing-large-01.aws-eu-central-1a.nimbus.prater`
Was done because the host was a Prater bootstrap node and it could not
be lost. The node key and the ports remained unchanged.

https://github.com/status-im/infra-nimbus/issues/60

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-22 18:23:22 +02:00
Jakub Sokołowski 961756674c
nimbus.prater: move validators to new MacOS host 
https://github.com/status-im/infra-nimbus/issues/60
https://github.com/status-im/infra-role-dist-validators/commit/f5e6c306

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-22 17:56:20 +02:00
Jakub Sokołowski 5f04e4b15a
nimbus.prater: lower max peers on macos to fix file limit 
It's a temporary fix until we apply a proper solution which involves
calling `setrlimit()` at startup to raise the soft limit:
https://github.com/status-im/nimbus-eth2/issues/2984

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-22 14:07:38 +02:00
Jakub Sokołowski c5a3c9fd91
terrafomr: change instance_type variable to just type 
https://github.com/status-im/infra-tf-amazon-web-services/commit/36571309

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-20 12:45:32 +02:00
Jakub Sokołowski 556a495c68
prater: fix bootstrap node ports to be 9100 
Since we published their addresses with ports being 9100:
https://github.com/eth2-clients/eth2-networks/commit/463d414c

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-19 15:48:34 +02:00
Jakub Sokołowski 1dfba96dec
nimbus.eth1: sync goerli instad of mainnet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-14 13:05:29 +02:00
Jakub Sokołowski f10eab7ed7
requirements: update to fix Hetzner data volumes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-13 20:27:57 +02:00
Jakub Sokołowski 7aa5d2d420
add all users to admin group on MacOS hosts 
This fixes SSH access issue, since only admin group members can have
remote access to the host:
https://www.vinnie.work/blog/2020-12-26-why-so-hard-osx-ssh-access/

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-13 13:34:56 +02:00
Jakub Sokołowski 8c69a70ccd
requirements: deploy Netdata to MacOS host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-12 17:33:23 +02:00
Jakub Sokołowski 5d828108b0
combine three bootstrap playbooks into one 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-12 17:16:22 +02:00
Jakub Sokołowski 6c67bcabdc
get-geth-web3-urls: support windows and deploy 
Fixes sync issues described in:
https://github.com/status-im/infra-nimbus/issues/75

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-12 13:52:13 +02:00
Jakub Sokołowski bd6ed56d74
deploy Consul and WireGuard to MacOS host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-06 22:24:06 +02:00
Jakub Sokołowski 67c7eff430
nimbus.prater: deploy Consul agent on MacOS host 
https://github.com/status-im/infra-role-bootstrap-macos/pull/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-06 13:57:33 +02:00
Jakub Sokołowski 454796a885
pin ports for mainnet bootstrap nodes 
We have published their addresses with these ports
therefore they cannot be changed.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 21:37:04 +02:00
Jakub Sokołowski 3585f5615a
mainnet/prater: block libp2p ports for select nodes 
As part of experiment in how nodes behave in restrictive networks.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 18:28:08 +02:00
Jakub Sokołowski 6ed5081087
nimbus.prater: move validators from 03 nodes to metal-02 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 15:46:13 +02:00
Jakub Sokołowski 6df0c868df
nimbus.prater: fix naming of libp2p services 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 14:51:49 +02:00
Jakub Sokołowski 89cbff6b52
switch back to original 3 branch layout of nodes 
Since with release of `1.5.0` the `stable` branch has all the necessary changes:
https://github.com/status-im/nimbus-eth2/releases/tag/v1.5.0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 12:43:51 +02:00
Jakub Sokołowski 61e573d40a
nimbus.mainnet: add 2GB swap file for all hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 12:08:14 +02:00
Jakub Sokołowski b78c5421b5
nimbus.prater: create testing.prater.beacon-api endpoint 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 10:38:12 +02:00
Jakub Sokołowski 8a91646bfe
nimbus.prater: deploy nodes to metal-02 
Without validators for now.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 23:45:19 +02:00
Jakub Sokołowski 49a964ed29
add metal-02.he-eu-hel1.nimbus.prater 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 22:47:26 +02:00
Jakub Sokołowski 9a8fbd88f8
nimbus.pyrmont: refactor node layout configuration 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 22:36:29 +02:00
Jakub Sokołowski 7eb4c4749c
nimbus.prater: refactor node layout configuration 
This is necessary to support multiple hosts with multiple nodes.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 21:59:25 +02:00
Jakub Sokołowski 018e1f3b78
enable beacon_node_rpc_enabled for all hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 17:53:07 +02:00
Jakub Sokołowski 4a911d1ccc
add unstable.prater.beacon-api.nimbus.team endpoint 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 16:54:43 +02:00
Jakub Sokołowski 5f06c39644
nimbus.mainnet: add two public Beacon API endpoints 
These nodes are intended for testing by Community.
https://ethereum.github.io/beacon-APIs/

https://github.com/status-im/infra-nimbus/issues/66

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 13:42:33 +02:00
Jakub Sokołowski 6c7e3384e5
nimbus.mainnet: deploy 6 nodes on new Hetzner hosts 
https://github.com/status-im/infra-nimbus/issues/66

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 12:08:58 +02:00
Jakub Sokołowski 81bd269610
nimbus.mainnet: add new 6 hetzner hosts 
https://github.com/status-im/infra-nimbus/issues/66

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 12:08:49 +02:00
Jakub Sokołowski e7e457395a
nimbus.eth1: deploy eth1 node with infra-role-nimbus-eth1 
https://github.com/status-im/infra-nimbus/issues/72

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-01 14:32:09 +02:00
Jakub Sokołowski f59c8d8f43
macos: add bootstrap role, add hostname fix 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-30 17:21:23 +02:00
Jakub Sokołowski c56a7cee04
nimbus.prater: switch to using systemd services 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-29 19:38:30 +02:00
Jakub Sokołowski c8f539dd89
beacon-node-builds: drop building docker containers 
All Linux hosts will be migrated to using systemd services.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-29 19:34:24 +02:00
Jakub Sokołowski 0c60f0ad09
beacon-node-builds: move some builds to testing-large-02 
This should spread out disk space usage a bit more.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-29 11:26:47 +02:00
Jakub Sokołowski c4e0f20fa1
beacon-node-builds: keep only 3 days worth of builds 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-29 11:21:15 +02:00
Jakub Sokołowski 879a15b91f
update requirements, change order of prater tasks 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-24 21:35:05 +02:00
Arthur Koziel 7f80f68804 add macos beacon nodes 
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-09-24 12:29:28 +02:00
Jakub Sokołowski e2eb049cbb
move deployment of beacon-node-builds to the bottom 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-22 16:40:51 +02:00
Zahary Karadjov 813c40adec
Switch back to the unstable branch on all nodes 2021-09-22 16:52:41 +03:00
Zahary Karadjov 597dbb2b79
Increase the number of peers on Pyrmont and Prater 2021-09-21 21:29:16 +03:00
Jakub Sokołowski 7f5fd21829
nimbus.mainnet: set branch to use to stable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-21 18:37:59 +02:00
Jakub Sokołowski 0bfc961817
update requirements to include logging fixes 
They make linux systemd service not send logs to Journald store.

Issue:
https://github.com/status-im/infra-role-bootstrap-linux/issues/24

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-21 17:59:47 +02:00
Zahary Karadjov 3a02974e3a
A/B testing for the taskpool implementation 
The `stable` hosts will run with the taskpool code reverted, the
testing hosts will employ multiple cores.
 2021-09-21 16:45:10 +03:00
Jakub Sokołowski 3673ff3577
bootstrap: add zahary to extra users 
Instead of adding him via default users:
https://github.com/status-im/infra-role-bootstrap-linux/commit/d6a6c129

This fixes addition to Windows host as well.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-20 16:21:09 +02:00
Zahary Karadjov e58d1f7abc
Reduce the number of peers on Prater and Pyrmont nodes 
This is a test of the recently developed subnet walking functionality
 2021-09-14 19:55:21 +03:00
Jakub Sokołowski e8317de1a4
beacon-node-builds: add nim-libp2p-auto-bump builds 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-08 18:51:02 +02:00
Jakub Sokołowski ca46d0fc54
fix restarting of systemd services 
Only one `sudoers` file was being modified by multiple roles:
https://github.com/status-im/infra-role-beacon-node-linux/commit/ff400bfb

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-07 15:47:25 +02:00
Jakub Sokołowski d7e0530d97
log-dash: fix ES LB access to log-store nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-02 13:15:08 +02:00
Jakub Sokołowski 437d9e034f
temproarily switch nodes to run unstable for Altair 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-02 08:14:34 +02:00
Zahary Karadjov 4be33a288d
Specify the correct web3_url for the Rocket Pool node on nimbus.eth1 2021-08-26 21:27:41 +03:00
Jakub Sokołowski 7064ed2f2d
drop nimbus.rayonism host, replaced by nimbus.eth1 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-26 20:21:00 +02:00
Jakub Sokołowski 28b69ccc69
fix bootstrap root password secret, bump roles 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-26 20:19:00 +02:00
Zahary Karadjov 15f7c9ea9b Deploy RocketPool on the new nimbus.eth1 hetzner host 2021-08-26 19:49:38 +02:00
Zahary Karadjov 3e69657de8
Bump RocketPool to v1.0.0-RC7 2021-08-26 20:38:42 +03:00
Jakub Sokołowski 345ceb8050
add metal-01.he-eu-hel1.nimbus.eth1 host 
https://github.com/status-im/infra-nimbus/issues/70

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-26 15:52:16 +02:00
Jakub Sokołowski abe15b05db
geth: explicitly open RPC and WebSocket ports to VPN 
Since geth role now defaults to using `localhost` for both.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-25 15:26:42 +02:00
Jakub Sokołowski 0a143764f0
geth-goerli: adjust VPN firewall comments 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-25 15:08:30 +02:00
Zahary Karadjov 7a2120c8cb Explicitly enable the RPC service on Pyrmont and Prater hosts 2021-08-25 15:05:29 +02:00
Zahary Karadjov 8f01241bc8 Experimental deployment of RocketPool on the Rayonism host 2021-08-25 15:05:29 +02:00
Jakub Sokołowski 9f5bc6be6a
upgrade Geth to 1.10.8 to fix CVE-2021-39137 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-25 13:11:43 +02:00
Jakub Sokołowski 2a781d70e8
firewall: remove obsolete settings for open-ports 
We now call `open-ports` role inside of `beacon-node` roles.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-23 16:51:26 +02:00
Jakub Sokołowski e0d70f46f3
prater/pyrmont: add config for REST API port 
https://github.com/status-im/infra-role-beacon-node-linux/pull/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-23 16:46:05 +02:00
Jakub Sokołowski ecdaa70356
geth: open WebSocket port for Nimbus fleets 
This worked before due to connections being already established.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-19 15:32:59 +02:00
Jakub Sokołowski 4f05e2f40d
beacon-node-builds: drop targets, move to prater host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-18 12:43:51 +02:00
Jakub Sokołowski e08baf3861
pyrmont: temporarily switch to running altair branch 
Necessary for Eth2 2 hard-fork that is going to happen on Pyrmont.
Will revert back to the other branches once changes reach them.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-18 11:49:17 +02:00
Jakub Sokołowski b785e3e862
firewall: open ElasticSearch port to log-aggr.hq 
Fixes logs redirection from Logstash hosts to Nimbus ES cluster.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-13 22:31:39 +02:00
Jakub Sokołowski a21ac2fe8c
port rest of fleet secrets to BitWarden 
https://github.com/status-im/infra-docs/issues/9

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-13 22:25:19 +02:00
Jakub Sokołowski 5d36d3ad3e
firewall: use new IP sets and iptables chains 
https://github.com/status-im/infra-hq/issues/69
https://github.com/status-im/infra-role-bootstrap-linux/commit/92d8923b
https://github.com/status-im/infra-role-wireguard/commit/8394639e

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-11 19:54:36 +02:00
Jakub Sokołowski 1ff378d392
update WireGuard config files layout 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-29 18:57:45 +02:00
Jakub Sokołowski 95261d2d10
ansible/cleanup: drop removing backups, remove nginx logs 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-29 18:57:42 +02:00
Jakub Sokołowski 6375725d87
deploy rpc.sh wrapper for windows beacon nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-29 09:32:12 +02:00
Jakub Sokołowski 4384f62e5f
rename infra-role-bootstrap-linux, upgrde consul 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-28 12:29:01 +02:00
Jakub Sokołowski 3e32ec1ba9
migrate bootstrap secrets to BitWarden 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-28 12:02:03 +02:00
Jakub Sokołowski c3a8883662
upgrade Geth to 1.10.6 for the London hard-fork 
https://github.com/ethereum/go-ethereum/releases/tag/v1.10.6

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-22 19:44:24 +02:00
Jakub Sokołowski 8943576ddf
remove 3 Prater hosts that donated validators to windows 
https://github.com/status-im/infra-nimbus/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-19 17:11:20 +02:00
Jakub Sokołowski 4a7ab275a5
move validators from 04 Pyrmont hosts to one windows host 
https://github.com/status-im/infra-nimbus/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-19 16:48:08 +02:00
Jakub Sokołowski a3ae9a36ee
remove unused Pyrmont fleet host_vars files 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-19 16:44:31 +02:00
Jakub Sokołowski c8c1b4faa8
pyrmont: fix duplicate dist-validators variable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-19 16:44:04 +02:00
Jakub Sokołowski 7c1199f4c0
decomission old AWS Pyrmont hosts 
https://github.com/status-im/infra-nimbus/issues/65

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-19 13:04:05 +02:00
Jakub Sokołowski 32baf5e4b7
migrate Pyrmont fleet to Hetzner metal hosts 
https://github.com/status-im/infra-nimbus/issues/65

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-19 12:33:23 +02:00
Jakub Sokołowski 87d23f8fa1
deploy 3 beacon nodes on all Pyrmont metal hosts 
https://github.com/status-im/infra-nimbus/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-15 20:15:58 +02:00
Jakub Sokołowski df96f214cd
add 4 metal Hetzner hosts for Pyrmont migration 
https://github.com/status-im/infra-nimbus/issues/65

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-15 13:51:41 +02:00
Jakub Sokołowski 4fc3ac2689
beacon-node-builds: fix nightly tag clobbering issue 
Using single_branch:true avoids cloning other tags/branches.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-14 16:19:52 +02:00
Jakub Sokołowski eb1fea5716
upgrade deploy-eth2-prod image to v1.4.1 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-14 15:37:45 +02:00
Jakub Sokołowski 8f05a0191c
prater: add service user pass and facts path for windows 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-07-14 14:59:40 +02:00
Jakub Sokołowski 7d76f4b39e
drop all 05 prater nodes in favor of Hetzner host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-30 22:50:29 +02:00
Jakub Sokołowski b5f75078f3
move validators from prater 05 hosts to Hetzner host 
https://github.com/status-im/infra-nimbus/issues/52

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-30 22:48:36 +02:00
Jakub Sokołowski bdab0a2f8b
deploy prater nodes on hetzner node 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-28 21:30:00 +02:00
Jakub Sokołowski a9dfaa12a3
give extra users admin rights on the windows hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-28 18:02:45 +02:00
Jakub Sokołowski f0f5f32e8a
drop group_vars files in favor of generating container tags 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-28 17:32:00 +02:00
Jakub Sokołowski a99a6d0fc6
refactor to distribute validators via beacon-node role 
This way we can deploy multiple nodes on the same host.
https://github.com/status-im/infra-nimbus/issues/52

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-28 16:43:27 +02:00
Jakub Sokołowski 5122d41a99
move distribute-validators role to a separate repo 
https://github.com/status-im/infra-role-dist-validators

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-28 16:40:48 +02:00
Jakub Sokołowski 432623b74d
rename Hetzner host to just metal-01 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-28 16:39:45 +02:00
Jakub Sokołowski 054c5c2d26
ansible/requirements: update bootstrap and winsw 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-28 09:52:38 +02:00
Jakub Sokołowski db456f7f5c
upgrade Terraform to 1.0, upgrade all providers 
https://www.terraform.io/upgrade-guides/0-15.html
https://www.terraform.io/upgrade-guides/1-0.html

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-23 11:48:43 +02:00
cheatfate 3a3d52a156 Add cheatfate's SSH account. 2021-06-22 13:02:33 +02:00
Arthur Koziel 0a75a69a09 Deploy mainnet beacon nodes on hetzner server 
This will run multiple mainnet beacon nodes on the hetzner server. It
will use the `infra-role-beacon-node-linux` to build and run `stable`,
`unstable` and `testing` on the machine.

Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-22 12:29:01 +02:00
Jakub Sokołowski 31232a0b2c
beacon-node-builds: upgrade eth2 fleet to 1.4.0 
https://github.com/status-im/nimbus-eth2/releases/tag/v1.4.0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-22 11:53:20 +02:00
Jakub Sokołowski 3d522beb2f
windows: use non-core image with full GUI for debugging 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-21 19:36:11 +02:00
Jakub Sokołowski 13b27db54d
windows: configure running multiple beacon nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-16 15:41:50 +02:00
Jakub Sokołowski ddc91ed233
beacon-node-builds: make build failures just a warning 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-16 10:50:52 +02:00
Jakub Sokołowski 23af824b2b
ansible/requirements.yml: add fix for consul handler errors 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-14 17:20:50 +02:00
Jakub Sokołowski f24c714b49
beacon-node-builds: fix apt-get stdout redirection 
The & character breaks the command in /bin/sh shell.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-14 16:09:46 +02:00
Jakub Sokołowski 133a30c1b6
deploy 4GB SWAP files to build hosts 
We've been seeing build failures due to OOM killer.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-14 10:17:33 +02:00
Jakub Sokołowski fcb8db90fd
add missing password for nimbus windows user 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-11 16:52:26 +02:00
Jakub Sokołowski f4a20bc128
fix password format used for root 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-11 11:18:10 +02:00
Tanguy Cizain cae0195d03 add tanguy's key 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-11 11:15:35 +02:00
Jakub Sokołowski 8468615f7d
deploy one Nimbus Prater node on Windows host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-10 18:09:05 +02:00
Jakub Sokołowski 809c4ce355
ansible/inventory/test: add windows-01 host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-09 23:04:13 +02:00
Jakub Sokołowski b5cbe7fa4d
provision windows-01.gc-us-central1-a.nimbus.prater 
https://github.com/status-im/infra-nimbus/issues/59

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-02 14:37:32 +02:00
Jakub Sokołowski 39f9b71dff
beacon-node-builds: add vim: ft=sh for buils.sh 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-06-01 21:26:42 +02:00
Jakub Sokołowski 38745d0495
ansible/requirements: bump bootstrap so watchtower fixes containers 
We've added flags so that containers are fixed even when stuck in `Restarting...`:
https://github.com/status-im/infra-role-bootstrap/commit/c9bdc2ba

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-26 11:50:02 +02:00
Jakub Sokołowski 47f500e1ad
beacon-node-builds: refactor to rebuild after failures 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-21 00:38:03 +02:00
Jakub Sokołowski ee9f8a74b7
bump beacon-node role and others to use WireGuard 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-19 23:03:14 +02:00
Jakub Sokołowski fd9c93a5f7
deploy-eth2-prod: bump to v1.3.0 
https://github.com/status-im/nimbus-eth2/releases/tag/v1.3.0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-19 18:33:19 +02:00
Jakub Sokołowski e3171c98a9
use WireGuard instead of Tinc VPN for metrics 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-19 14:12:47 +02:00
Arthur Koziel fb2ab82f6d
Add hetzner dedicated server (#56) 
add stable-metal-01.he-eu-hel1.nimbus.mainnet

Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-05-19 18:04:12 +08:00
Arthur Koziel 04648b6465
Scan all DC's for Geth nodes (#57) 
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-05-19 17:54:46 +08:00
Jakub Sokołowski 2047fe1702
ansible/requirements: bump origin-certs role 
https://github.com/status-im/infra-role-origin-certs/commit/586d81d6

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-13 10:53:51 +02:00
Jakub Sokołowski 0a38a4642d
rayonism: increase Geth node verbosity to detail 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-12 14:35:16 +02:00
Jakub Sokołowski 9bf2e03137
move secrets from service to services 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 15:37:45 +02:00
Jakub Sokołowski 87695af8bc
rayonism: disable discovery and add --networkid=5 
No idea why.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 12:23:41 +02:00
Jakub Sokołowski 6c0b62a6a8
rayonism: adjust location of rpc.sh wrapper 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 12:23:28 +02:00
Jakub Sokołowski f933dd0df8
rayonism: put Geth config in the same folder as Beacon node 
This way we create both as part of the same Docker network.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 11:59:34 +02:00
Jakub Sokołowski 23dc761b41
rayonism: use WebSocket instead of HTTp for RPC 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 11:33:31 +02:00
Jakub Sokołowski e20bbb1c48
rayonism: replace steklo testnet with nocturne 
Changes done according to:
https://github.com/status-im/infra-nimbus/issues/54

For more details see:
https://github.com/protolambda/nocturne

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 10:42:11 +02:00
Jakub Sokołowski c6c7159e94
distribute-validators: create container folder if missing 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 10:41:52 +02:00
Jakub Sokołowski d7930a8437
ansible/requirements: bump bootstrap and elasticsearch roles 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-11 10:31:33 +02:00
Jakub Sokołowski 657e8a098f
ansible: add meta requirements target, add check to bootstrap 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-10 15:29:38 +02:00
Jakub Sokołowski e50e7f7764
drop legacy beacon_node_web3_url variable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-06 15:40:38 +02:00
Jakub Sokołowski 1283cec6ee
ansible/requirements: update oauth-proxy rol 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-06 11:17:56 +02:00
Jakub Sokołowski 02b70ee6f0
rayonism: un-comment validators layout 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-30 14:16:49 +02:00
Jakub Sokołowski 6d832ae5c3
rayonism: set debug log level for geth node 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-30 11:33:53 +02:00
Jakub Sokołowski 518726e5f6
rayonism: use http:// instead of ws:// for web3 url 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-30 11:29:31 +02:00
Jakub Sokołowski 1b54f4e1ca
rayonism: update image, enable consensus API module 
https://github.com/status-im/infra-nimbus/issues/53

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-29 19:29:14 +02:00
Jakub Sokołowski 97db7ea804
rayonism: deploy beacon node for steklo testnet 
https://github.com/status-im/infra-nimbus/issues/53

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-29 15:14:25 +02:00
Jakub Sokołowski 6b8245ad63
rayonism: add build configuration for quick-merge-v1 branch 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-29 14:42:54 +02:00
Jakub Sokołowski 1ce2b2c7fb
rayonism: deploy Geth node for steklo testnet 
https://github.com/status-im/infra-nimbus/issues/53

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-29 14:35:06 +02:00
Jakub Sokołowski ba8644873b
deploy qmerge-large-01.aws-eu-central-1a.nimbus.rayonism 
For more details see:
https://github.com/status-im/infra-nimbus/issues/53

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-29 13:53:43 +02:00
Jakub Sokołowski 04f9fe30ca
add stable-hetzner-01.he-hel1.nimbus.prater to inventory 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-29 12:14:38 +02:00
Jakub Sokołowski 3147311722
bump deploy-eth2-prod build to 1.2.1 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-20 20:13:41 +02:00
Jakub Sokołowski 65d8302527
implement Eth1 Web3 URL fallbacks 
Related:
https://github.com/status-im/infra-role-beacon-node/commit/92f740e0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-19 20:27:52 +02:00
Jakub Sokołowski 762f4e3457
requirements: bump bootstrap role version 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-14 16:18:03 +02:00
Zahary Karadjov 8e26b95157 Use the default slashing DB kind 2021-04-14 15:37:05 +02:00
Arthur Koziel 65dca92c13
update ansible for libp2p-stable/unstable 
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-04-13 16:17:13 +08:00
Jakub Sokołowski 45241a5a15
beacon-node-builds: drop use of -d:insecure 
No longer necessary due to new secure HTTP backend:
https://github.com/status-im/nimbus-eth2/releases/tag/v1.1.0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-13 08:07:49 +02:00
Jakub Sokołowski 757b097c81 add versioncheck.py script to verify Ansible role versions 
Since Ansible or Ansible Galaxy doesn't actually check role versions
itself, we have to do it ourselves. This script goes through contents of
`ansible/requirements.txt` and verifies each role is installed and has
correct version.

It also checks the version of Ansible itself.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-13 08:07:26 +02:00
Jakub Sokołowski 3c0fe9e8fb
beacon-node-builds: fix systemd timer service group not existing 
Fixes:
Failed to determine group credentials: No such process
Failed at step GROUP spawning /data/beacon-node-builds/unstable-small/build.sh: No such process

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-07 09:23:50 +02:00
Arthur Koziel d9c21f7d5b
add terraform module for libp2p-unstable 
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-04-02 15:00:02 +08:00
Arthur Koziel 6d9fcf4a20
rename prater-libp2p to prater-unstable-libp2p-stable 
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-04-02 11:42:10 +08:00
Arthur Koziel 91c03ecb80
rename build for libp2p-stable, add libp2p-unstable build 
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-04-01 18:48:48 +08:00
Arthur Koziel 0e7fd54d09
rename host libp2p-large to u-libp2p-s-large 
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-04-01 18:46:32 +08:00
Arthur Koziel fe3ed92b98
fix ws url for goerli 
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-04-01 18:28:53 +08:00
Jakub Sokołowski dd6bcc515d
geth-goerli: increase container memory limit to 80% 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-03-30 18:52:39 +02:00
Jakub Sokołowski dbce2ffc5d
deploiy new Docker Compose setup for Geth nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-03-29 13:42:06 +02:00
Jakub Sokołowski 6afc2bfa97
ansible/cleanup.yml: add cleanup of docker images 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-03-25 21:45:06 +01:00
Zahary Karadjov b03dbdb5c6
Increase the --max-peers count on all fleet nodes 
This setting is recommended due to the high-number of validators
attached to each node which requires maintaining healthy peer
counts on a larger number of gossip topics. For now, we don't
bother specifying a lower value on the servers running a lower
number of validators in order to simplify the implementation.
 2021-03-23 17:53:58 +08:00
Arthur Koziel 2088c0c92b
set beacon_node_subscribe_all and beacon_node_netkey for prater bootnodes 
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-03-23 17:44:55 +08:00
Arthur Koziel 48e2766741
build libp2p-large docker image on pyrmont testing-large-01 
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-03-23 13:50:24 +08:00
Jakub Sokołowski ff48a961b5
update inventory with prater hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-03-22 15:38:54 +01:00
Jakub Sokołowski db5ec2f497
bootstrap: provide Consul encryption key from infra-pass 
Related: https://github.com/status-im/infra-role-bootstrap/commit/0d40f81d

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-03-22 11:12:49 +01:00
Arthur Koziel 662e456d06
add config for prater testnet 
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-03-19 16:18:16 +08:00
Jakub Sokołowski c07aca5aa3
beacon-node-builds: upgrade eth2 to v1.0.10 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-03-11 17:28:17 +01:00
Jakub Sokołowski a0b0fa87d3
enable --subscribe-all-subnets for Mainnet bootnodes 
https://github.com/status-im/infra-nimbus/issues/38

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-03-08 15:10:16 +01:00
Jakub Sokołowski d88c8b44fc
beacon-node-builds: relax the sudoers regex for systemctl 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-03-03 08:46:37 +01:00
Jakub Sokołowski 9153bb02f1
logclean-job: fix bug in script that deletes newer first 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-27 15:37:49 +01:00
Jakub Sokołowski b1ad100a50
logclean-job: increase timer timeout to 5 minutes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-27 15:26:53 +01:00
Jakub Sokołowski d31094d85c
logclean-job: reduce kept ES indices to 20 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-27 15:24:34 +01:00
Jakub Sokołowski aee3b5eff5
beacon-node-builds: allow for repo updates for select builds 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-22 21:37:38 +01:00
Jakub Sokołowski f931c3cde1
upgrade eth2 image to 1.0.8 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-22 17:55:20 +01:00
Jakub Sokołowski dd70e0652d
beacon-node-builds: add commit to labels 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-22 16:05:56 +01:00
Jakub Sokołowski a269c3e490
distribute-validators: add --delete for rsyncing secrets 
Also drop some debug messages, comment out ignore_errors.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-22 15:49:05 +01:00
Jakub Sokołowski 73bde9a51a
add any_errors_fatal:true to avoid duplicate validators 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-22 15:48:51 +01:00
Zahary Karadjov 4668266eb6
Specify the double-checking slashing DB mode on all large servers 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-22 15:16:47 +01:00
Zahary Karadjov f887391f04 More varied validator assignments 2021-02-22 15:14:16 +01:00
Jakub Sokołowski 8dfe06a9bd
change testing branch build to 6am 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-22 15:09:28 +01:00
Jakub Sokołowski a40c0ab49c
geth-goerli: increase cache size from default 1GB to 2GB 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-12 23:06:04 +01:00
Jakub Sokołowski bb1e3ff3ba
bump size of Goerli Geth node to t3a.large 
It keeps hitting memory limits and failing to sync.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-12 22:58:42 +01:00
Jakub Sokołowski a5a950bb91
set become=false in ansible.cfg, set it to true in playbooks 
See: https://github.com/status-im/nimbus-private/pull/9

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-09 20:27:13 +01:00
Jakub Sokołowski 0e82fa7c03
beacon-node-builds: don't update git branch when deploying 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-09 18:35:32 +01:00
Jakub Sokołowski 4cdd5f01ce
increase Goerli container memory limit to 80% 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-09 18:32:11 +01:00
Jakub Sokołowski d8b643fd74
add SSH users to systemd-journal group 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-08 12:36:14 +01:00
Jakub Sokołowski f96fe517e7
beacon-node-builds: allow staff group membets to start builds 
I was thinking of defining the jobs as nimbus user systemd units, but
that would not work unless nimbus user logged in at least once.

And Systemd services have no functionality for allowing non-root users
to start/stop/restart system services, so sudo is the simplest way.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-08 12:36:02 +01:00
Jakub Sokołowski 8e0966fb0e
beacon-node-builds: don't fetch if we're on a detached head 
Causes failures when a tag is checked out, nothing to fetch.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-04 23:48:26 +01:00
zah 33ba3b1e8b Upgrade the production fleet to 1.0.7 2021-02-04 21:41:22 +01:00
Jakub Sokołowski b7226818d3
disable kibana-logtrail, it's not been updated to 7.10.2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-01 16:05:50 +01:00
Jakub Sokołowski dbac764185
upgrade ElasticSearch to 7.10.2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-01 15:57:10 +01:00
Jakub Sokołowski 157d215230
specify beacon_node_netkey for nimbus-mainnet-small bootnodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-29 13:26:55 +01:00
Jakub Sokołowski 26a31c5d63
use 8000+ UIDs for extra SSH users to not clash with core 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-26 12:11:33 +01:00
Jakub Sokołowski 8f76c6810a
log-store: fix mounting of data volumes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-25 15:08:34 +01:00
Jakub Sokołowski 62f44b8a05
drop old fleet from group and host vars and pyrmont playbook 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 15:59:47 +01:00
Jakub Sokołowski 49bd1fa267
remove old pyrmont fleet, move new one back to pyrmont.tf 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 15:56:26 +01:00
Jakub Sokołowski 8aa381ca2e
update names in inventory for nimbus.mainnet hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 15:46:04 +01:00
Jakub Sokołowski 84be761116
fix hostname in nimbus-pyrmont-unstable-libp2p validators layout 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 15:19:58 +01:00
Jakub Sokołowski 37c1c62a5d add validators distributio for the new fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-22 14:27:39 +01:00
Jakub Sokołowski 8ad0027936
log-store: add 2GB swap files to hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 20:35:33 +01:00
Jakub Sokołowski 6e138997e2
re-enable sending logs to logstash 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 19:27:04 +01:00
Jakub Sokołowski 45a0315bb0
deploy elasticsearch and a kibana dashboard 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 16:00:29 +01:00
Jakub Sokołowski ef8e77a1ac
re-add the ELK stack hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 15:59:11 +01:00
Jakub Sokołowski 67ebb93be3
fix wrong build nodes listed in playbook 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 19:53:52 +01:00
Jakub Sokołowski 0bc722ca21
dist-validators: don't run any tasks if no layout is defined 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 19:47:51 +01:00
Jakub Sokołowski 89dfe7ca5c
add new fleet hosts to inventory 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 19:35:03 +01:00
Jakub Sokołowski 2b44636cd6
create new pyrmont fleet using new branch naming 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 19:04:10 +01:00
Jakub Sokołowski 05684f23b1
drop unused toledor and maste references 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-18 16:52:40 +01:00
Jakub Sokołowski 2132851b16
use bootstrap__active_extra_users variable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-14 14:01:57 +01:00
Jakub Sokołowski ab017c29bb
update inventory 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-13 17:07:31 +01:00
Ștefan Talpalaru e71d1643b8 beacon-node-builds: support core dumps 
- build with "-d:noSignalHandler" in NIMFLAGS
- keep binary copies for a week, so we can use them with core dumps on
  target hosts
- finish replacing "item.branch" with "item.version"
- manually add a [nimbus-master] section to "ansible/inventory/test"
 2020-12-18 21:56:32 +02:00
Jakub Sokołowski 8dc1db8f0b
nimbus-builds: add release build for eth2.prod fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-11 18:44:34 +01:00
Jakub Sokołowski 6ecba424d1
drop useless debug task 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-04 18:27:17 +01:00
Jakub Sokołowski 48529cb841
use Infura for Web3 on master-large-01 on Pyrmont for comparison 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-04 18:26:05 +01:00
Jakub Sokołowski 9c5abd392a
allow VPN connections to Goerli/Mainnet WebSocket API 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-04 18:20:05 +01:00
Jakub Sokołowski 989aeacb51
use Geth Goerli WebSocket endpoint for Pyrmont fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-12-04 13:09:48 +01:00
Jakub Sokołowski 65f0d944d8
bump max logs for logrotate to 72 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-26 21:30:32 +01:00
Jakub Sokołowski 996e2df2e8
make docker log files contain only container messages 
See: https://github.com/status-im/infra-nimbus/issues/26

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-26 19:06:08 +01:00
Jakub Sokołowski 796c7ce292
bump count of logrotate files to keep to 24 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-26 18:30:05 +01:00
Jakub Sokołowski 176d843a40
drop toledo hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-11-26 17:06:35 +01:00