status-im
/
infra-nimbus
mirror of https://github.com/status-im/infra-nimbus.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
545 Commits 10 Branches 0 Tags 31 MiB
Commit Graph

467 Commits

Author SHA1 Message Date
Jakub Sokołowski a6d673366a
all: lowe logrotate count to 48, bump bootstrap 
Also remove `delaycompress` from logrotate config.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-31 17:09:28 +01:00
Jakub Sokołowski 4983b11282
requirements: bump bootstrap and beacon node roles 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-28 13:41:02 +01:00
Jakub Sokołowski 0dc470aae2
requirements: add support for ansible toggle script 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-26 11:00:20 +01:00
Jakub Sokołowski 2962ebbee0
disable use of HTTP Eth1 node endpoints 
Should fix issues with leaking file descriptors causing peer issues and
metrics endpoint timeouts.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-26 01:22:16 +01:00
Jakub Sokołowski 0369818fa0
replace macos-01.ms-eu-dublin.nimbus.prater host 
The old one had only 256 GB of SSD storage which is not enough for
three nodes syncing Prater testnet.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-24 15:44:38 +01:00
Jakub Sokołowski 9b54c84d96
enable validator monitoring flags for unstable nodes 
Once the next release is out we can drop the `unstable` conditionals.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-21 15:36:53 +01:00
Jakub Sokołowski 4ff2422fe2
nimbnus.prater: use the AWS NVMe drive for data 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-19 11:26:16 +01:00
Jakub Sokołowski e00443d6e2
nimbus.mainnet: drop libp2p-02 nodes to save space 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-13 14:16:41 +01:00
Jakub Sokołowski 79f55366f2
requirements: upgrade Geth to 1.10.15 
https://github.com/ethereum/go-ethereum/releases/tag/v1.10.15

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-07 13:05:58 +01:00
Jakub Sokołowski 667fd3184e
builds: add libp2p metrics flags 
This is done instead of this PR:
https://github.com/status-im/infra-role-beacon-node-linux/pull/3/files

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-05 19:38:23 +01:00
Jakub Sokołowski f106c9e5b8
requirements: parametrize nim build flags 
https://github.com/status-im/infra-role-beacon-node-linux/commit/d993d06d
https://github.com/status-im/infra-role-beacon-node-macos/commit/ed0453ef
https://github.com/status-im/infra-role-beacon-node-windows/commit/f6dd9dd6

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-05 19:38:23 +01:00
Jakub Sokołowski 237da365e7
bootstrap: add missing admin pass for macos hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-04 20:55:08 +01:00
Jakub Sokołowski 9c8b0f6185
users: give tanguy sudo permissions 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-04 15:35:30 +01:00
Jakub Sokołowski d99b195bc1
consul: upgrade from 1.10.1 to 1.11.1 
https://github.com/hashicorp/consul/releases/tag/v1.11.1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-01-03 17:53:34 +01:00
Jakub Sokołowski 462f373827
mainnet.geth: use snap sync method 
We had issues with mainnet node not fully syncing.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-18 18:06:59 +01:00
Jakub Sokołowski 2724d8f8b2
requirements: upgrade Netdata to 1.32.0 
https://github.com/netdata/netdata/releases/tag/v1.32.0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-09 17:37:31 +01:00
Jakub Sokołowski f745dfd2f8
add missing get-geth-api-urls role for macos host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-07 18:31:46 +01:00
Jakub Sokołowski 5dae92080a
get-geth-api-urls: use HTTP RPC API for unstable only 
Current support for HTTP RPC API is not stable enough.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-03 19:40:52 +01:00
Jakub Sokołowski 0c1169cee3
get-geth-api-urls: query for HTTP RPC API endpoints 
We want to test the support for normal HTTP API endpoints.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-02 13:14:41 +01:00
Jakub Sokołowski 62835a2079
requirements: bump bootstrap roles and geth version 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-02 13:09:48 +01:00
Jakub Sokołowski ce70b55014
prater-windows: disable windows defender 
Negatively impacts I/O performance, and we don't need it.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-25 20:00:52 +01:00
Jakub Sokołowski 1ffbb8d351
requirements: bump windows, increase check timeouts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-24 20:46:31 +01:00
Jakub Sokołowski 85d4b054be
requirements: update --log-format flag, bootstrap 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-24 19:54:46 +01:00
Jakub Sokołowski 5d5857928d
pyrmont: expose REST API at insecura.nimbus.team 
Inteded for tests of public insecure API access for Jacek.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-22 15:36:56 +01:00
Jakub Sokołowski 968f56f7ed
update SSH credentials 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-18 17:44:08 +01:00
Jakub Sokołowski 871ece2a3f
fix for renamed --log-stdout flag to --log-format 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-10 18:47:55 +01:00
Jakub Sokołowski 6c3384b8ba
ugprade Rocketpool to 1.0.0 
https://github.com/status-im/infra-rocketpool/issues/2

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-08 13:35:37 +01:00
Jakub Sokołowski f334b8917f
rocketpool: upgrade to v1.0.0-pre4 
https://github.com/status-im/infra-role-rocketpool/issues/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-03 14:02:57 +01:00
Jakub Sokołowski 2fd016d36d
requirements: add support for --log-stdout flag 
Necessary to keep logs in JSON format.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-11-03 10:14:16 +01:00
Jakub Sokołowski a4877e9b28
upgrade ELK stack to 7.14.2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-28 19:29:15 +02:00
Jakub Sokołowski edfcf0b621
nimbus.eth1: update rocketpool setup to new layout 
https://github.com/status-im/infra-rocketpool/issues/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-27 20:38:59 +02:00
Jakub Sokołowski 9fddf38791
geth: open mainnet ports for rocket.prod fleet 
https://github.com/status-im/infra-rocketpool/issues/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-26 15:37:00 +02:00
Jakub Sokołowski 8e19a929d3
restart.yml: add playbook to restart all nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-26 13:21:18 +02:00
Jakub Sokołowski db178fc217
rebuild.yml: add playbook to rebuild all nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-26 13:21:14 +02:00
Jakub Sokołowski 9887cdbfc9
requirements: udpate to use new rocketpool role name 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-26 13:08:29 +02:00
Jakub Sokołowski 6be2fc03e9
mainnet: add two libp2p nodes on 05 and 06 hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-25 14:30:22 +02:00
Jakub Sokołowski bcc297b796
prater: move libp2p nodes from AWS to Hetzner 
It will lower costs of Prater fleet. I've discussed this with Tanguy and
he's fine with it. I'm also addin two nodes without validators.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-25 12:58:59 +02:00
Jakub Sokołowski b5684f018e
drop prater 02 AWS nodes, rename stable one 
The renaming of:
`stable-large-01.aws-eu-central-1a.nimbus.prater`
to
`testing-large-01.aws-eu-central-1a.nimbus.prater`
Was done because the host was a Prater bootstrap node and it could not
be lost. The node key and the ports remained unchanged.

https://github.com/status-im/infra-nimbus/issues/60

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-22 18:23:22 +02:00
Jakub Sokołowski 961756674c
nimbus.prater: move validators to new MacOS host 
https://github.com/status-im/infra-nimbus/issues/60
https://github.com/status-im/infra-role-dist-validators/commit/f5e6c306

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-22 17:56:20 +02:00
Jakub Sokołowski 5f04e4b15a
nimbus.prater: lower max peers on macos to fix file limit 
It's a temporary fix until we apply a proper solution which involves
calling `setrlimit()` at startup to raise the soft limit:
https://github.com/status-im/nimbus-eth2/issues/2984

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-22 14:07:38 +02:00
Jakub Sokołowski c5a3c9fd91
terrafomr: change instance_type variable to just type 
https://github.com/status-im/infra-tf-amazon-web-services/commit/36571309

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-20 12:45:32 +02:00
Jakub Sokołowski 556a495c68
prater: fix bootstrap node ports to be 9100 
Since we published their addresses with ports being 9100:
https://github.com/eth2-clients/eth2-networks/commit/463d414c

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-19 15:48:34 +02:00
Jakub Sokołowski 1dfba96dec
nimbus.eth1: sync goerli instad of mainnet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-14 13:05:29 +02:00
Jakub Sokołowski f10eab7ed7
requirements: update to fix Hetzner data volumes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-13 20:27:57 +02:00
Jakub Sokołowski 7aa5d2d420
add all users to admin group on MacOS hosts 
This fixes SSH access issue, since only admin group members can have
remote access to the host:
https://www.vinnie.work/blog/2020-12-26-why-so-hard-osx-ssh-access/

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-13 13:34:56 +02:00
Jakub Sokołowski 8c69a70ccd
requirements: deploy Netdata to MacOS host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-12 17:33:23 +02:00
Jakub Sokołowski 5d828108b0
combine three bootstrap playbooks into one 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-12 17:16:22 +02:00
Jakub Sokołowski 6c67bcabdc
get-geth-web3-urls: support windows and deploy 
Fixes sync issues described in:
https://github.com/status-im/infra-nimbus/issues/75

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-12 13:52:13 +02:00
Jakub Sokołowski bd6ed56d74
deploy Consul and WireGuard to MacOS host 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-06 22:24:06 +02:00
Jakub Sokołowski 67c7eff430
nimbus.prater: deploy Consul agent on MacOS host 
https://github.com/status-im/infra-role-bootstrap-macos/pull/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-06 13:57:33 +02:00
Jakub Sokołowski 454796a885
pin ports for mainnet bootstrap nodes 
We have published their addresses with these ports
therefore they cannot be changed.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 21:37:04 +02:00
Jakub Sokołowski 3585f5615a
mainnet/prater: block libp2p ports for select nodes 
As part of experiment in how nodes behave in restrictive networks.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 18:28:08 +02:00
Jakub Sokołowski 6ed5081087
nimbus.prater: move validators from 03 nodes to metal-02 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 15:46:13 +02:00
Jakub Sokołowski 6df0c868df
nimbus.prater: fix naming of libp2p services 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 14:51:49 +02:00
Jakub Sokołowski 89cbff6b52
switch back to original 3 branch layout of nodes 
Since with release of `1.5.0` the `stable` branch has all the necessary changes:
https://github.com/status-im/nimbus-eth2/releases/tag/v1.5.0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 12:43:51 +02:00
Jakub Sokołowski 61e573d40a
nimbus.mainnet: add 2GB swap file for all hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 12:08:14 +02:00
Jakub Sokołowski b78c5421b5
nimbus.prater: create testing.prater.beacon-api endpoint 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-05 10:38:12 +02:00
Jakub Sokołowski 8a91646bfe
nimbus.prater: deploy nodes to metal-02 
Without validators for now.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 23:45:19 +02:00
Jakub Sokołowski 49a964ed29
add metal-02.he-eu-hel1.nimbus.prater 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 22:47:26 +02:00
Jakub Sokołowski 9a8fbd88f8
nimbus.pyrmont: refactor node layout configuration 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 22:36:29 +02:00
Jakub Sokołowski 7eb4c4749c
nimbus.prater: refactor node layout configuration 
This is necessary to support multiple hosts with multiple nodes.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 21:59:25 +02:00
Jakub Sokołowski 018e1f3b78
enable beacon_node_rpc_enabled for all hosts 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 17:53:07 +02:00
Jakub Sokołowski 4a911d1ccc
add unstable.prater.beacon-api.nimbus.team endpoint 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 16:54:43 +02:00
Jakub Sokołowski 5f06c39644
nimbus.mainnet: add two public Beacon API endpoints 
These nodes are intended for testing by Community.
https://ethereum.github.io/beacon-APIs/

https://github.com/status-im/infra-nimbus/issues/66

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 13:42:33 +02:00
Jakub Sokołowski 6c7e3384e5
nimbus.mainnet: deploy 6 nodes on new Hetzner hosts 
https://github.com/status-im/infra-nimbus/issues/66

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 12:08:58 +02:00
Jakub Sokołowski 81bd269610
nimbus.mainnet: add new 6 hetzner hosts 
https://github.com/status-im/infra-nimbus/issues/66

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-04 12:08:49 +02:00
Jakub Sokołowski e7e457395a
nimbus.eth1: deploy eth1 node with infra-role-nimbus-eth1 
https://github.com/status-im/infra-nimbus/issues/72

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-01 14:32:09 +02:00
Jakub Sokołowski f59c8d8f43
macos: add bootstrap role, add hostname fix 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-30 17:21:23 +02:00
Jakub Sokołowski c56a7cee04
nimbus.prater: switch to using systemd services 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-29 19:38:30 +02:00
Jakub Sokołowski c8f539dd89
beacon-node-builds: drop building docker containers 
All Linux hosts will be migrated to using systemd services.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-29 19:34:24 +02:00
Jakub Sokołowski 0c60f0ad09
beacon-node-builds: move some builds to testing-large-02 
This should spread out disk space usage a bit more.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-29 11:26:47 +02:00
Jakub Sokołowski c4e0f20fa1
beacon-node-builds: keep only 3 days worth of builds 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-29 11:21:15 +02:00
Jakub Sokołowski 879a15b91f
update requirements, change order of prater tasks 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-24 21:35:05 +02:00
Arthur Koziel 7f80f68804 add macos beacon nodes 
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
 2021-09-24 12:29:28 +02:00
Jakub Sokołowski e2eb049cbb
move deployment of beacon-node-builds to the bottom 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-22 16:40:51 +02:00
Zahary Karadjov 813c40adec
Switch back to the unstable branch on all nodes 2021-09-22 16:52:41 +03:00
Zahary Karadjov 597dbb2b79
Increase the number of peers on Pyrmont and Prater 2021-09-21 21:29:16 +03:00
Jakub Sokołowski 7f5fd21829
nimbus.mainnet: set branch to use to stable 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-21 18:37:59 +02:00
Jakub Sokołowski 0bfc961817
update requirements to include logging fixes 
They make linux systemd service not send logs to Journald store.

Issue:
https://github.com/status-im/infra-role-bootstrap-linux/issues/24

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-21 17:59:47 +02:00
Zahary Karadjov 3a02974e3a
A/B testing for the taskpool implementation 
The `stable` hosts will run with the taskpool code reverted, the
testing hosts will employ multiple cores.
 2021-09-21 16:45:10 +03:00
Jakub Sokołowski 3673ff3577
bootstrap: add zahary to extra users 
Instead of adding him via default users:
https://github.com/status-im/infra-role-bootstrap-linux/commit/d6a6c129

This fixes addition to Windows host as well.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-20 16:21:09 +02:00
Zahary Karadjov e58d1f7abc
Reduce the number of peers on Prater and Pyrmont nodes 
This is a test of the recently developed subnet walking functionality
 2021-09-14 19:55:21 +03:00
Jakub Sokołowski e8317de1a4
beacon-node-builds: add nim-libp2p-auto-bump builds 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-08 18:51:02 +02:00
Jakub Sokołowski ca46d0fc54
fix restarting of systemd services 
Only one `sudoers` file was being modified by multiple roles:
https://github.com/status-im/infra-role-beacon-node-linux/commit/ff400bfb

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-07 15:47:25 +02:00
Jakub Sokołowski d7e0530d97
log-dash: fix ES LB access to log-store nodes 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-02 13:15:08 +02:00
Jakub Sokołowski 437d9e034f
temproarily switch nodes to run unstable for Altair 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-09-02 08:14:34 +02:00
Zahary Karadjov 4be33a288d
Specify the correct web3_url for the Rocket Pool node on nimbus.eth1 2021-08-26 21:27:41 +03:00
Jakub Sokołowski 7064ed2f2d
drop nimbus.rayonism host, replaced by nimbus.eth1 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-26 20:21:00 +02:00
Jakub Sokołowski 28b69ccc69
fix bootstrap root password secret, bump roles 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-26 20:19:00 +02:00
Zahary Karadjov 15f7c9ea9b Deploy RocketPool on the new nimbus.eth1 hetzner host 2021-08-26 19:49:38 +02:00
Zahary Karadjov 3e69657de8
Bump RocketPool to v1.0.0-RC7 2021-08-26 20:38:42 +03:00
Jakub Sokołowski 345ceb8050
add metal-01.he-eu-hel1.nimbus.eth1 host 
https://github.com/status-im/infra-nimbus/issues/70

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-26 15:52:16 +02:00
Jakub Sokołowski abe15b05db
geth: explicitly open RPC and WebSocket ports to VPN 
Since geth role now defaults to using `localhost` for both.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-25 15:26:42 +02:00
Jakub Sokołowski 0a143764f0
geth-goerli: adjust VPN firewall comments 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-25 15:08:30 +02:00
Zahary Karadjov 7a2120c8cb Explicitly enable the RPC service on Pyrmont and Prater hosts 2021-08-25 15:05:29 +02:00
Zahary Karadjov 8f01241bc8 Experimental deployment of RocketPool on the Rayonism host 2021-08-25 15:05:29 +02:00
Jakub Sokołowski 9f5bc6be6a
upgrade Geth to 1.10.8 to fix CVE-2021-39137 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-25 13:11:43 +02:00
Jakub Sokołowski 2a781d70e8
firewall: remove obsolete settings for open-ports 
We now call `open-ports` role inside of `beacon-node` roles.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-23 16:51:26 +02:00
Jakub Sokołowski e0d70f46f3
prater/pyrmont: add config for REST API port 
https://github.com/status-im/infra-role-beacon-node-linux/pull/1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-23 16:46:05 +02:00
Jakub Sokołowski ecdaa70356
geth: open WebSocket port for Nimbus fleets 
This worked before due to connections being already established.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-08-19 15:32:59 +02:00