Commit Graph

72 Commits

Author SHA1 Message Date
Jakub Sokołowski a8b48242b0
nimbus-db-purge: add role to periodicall purge DB
https://github.com/status-im/infra-nimbus/issues/86

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-02-28 17:31:31 +01:00
Jakub Sokołowski fb7bde2377
dash.nimbus: lower indices kept to 10
We have bigger log volume now that we fixed the logging setup in:
https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-02-07 15:07:55 +01:00
Jakub Sokołowski 5dae92080a
get-geth-api-urls: use HTTP RPC API for unstable only
Current support for HTTP RPC API is not stable enough.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-12-03 19:40:52 +01:00
Jakub Sokołowski 0c1169cee3
get-geth-api-urls: query for HTTP RPC API endpoints
We want to test the support for normal HTTP API endpoints.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-12-02 13:14:41 +01:00
Jakub Sokołowski 6c67bcabdc
get-geth-web3-urls: support windows and deploy
Fixes sync issues described in:
https://github.com/status-im/infra-nimbus/issues/75

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-10-12 13:52:13 +02:00
Jakub Sokołowski 5f06c39644
nimbus.mainnet: add two public Beacon API endpoints
These nodes are intended for testing by Community.
https://ethereum.github.io/beacon-APIs/

https://github.com/status-im/infra-nimbus/issues/66

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-10-04 13:42:33 +02:00
Jakub Sokołowski c8f539dd89
beacon-node-builds: drop building docker containers
All Linux hosts will be migrated to using systemd services.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-09-29 19:34:24 +02:00
Jakub Sokołowski c4e0f20fa1
beacon-node-builds: keep only 3 days worth of builds
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-09-29 11:21:15 +02:00
Jakub Sokołowski 4f05e2f40d
beacon-node-builds: drop targets, move to prater host
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-08-18 12:43:51 +02:00
Jakub Sokołowski 4fc3ac2689
beacon-node-builds: fix nightly tag clobbering issue
Using single_branch:true avoids cloning other tags/branches.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-07-14 16:19:52 +02:00
Jakub Sokołowski 5122d41a99
move distribute-validators role to a separate repo
https://github.com/status-im/infra-role-dist-validators

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-28 16:40:48 +02:00
Jakub Sokołowski ddc91ed233
beacon-node-builds: make build failures just a warning
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-16 10:50:52 +02:00
Jakub Sokołowski f24c714b49
beacon-node-builds: fix apt-get stdout redirection
The & character breaks the command in /bin/sh shell.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-14 16:09:46 +02:00
Jakub Sokołowski 39f9b71dff
beacon-node-builds: add vim: ft=sh for buils.sh
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-06-01 21:26:42 +02:00
Jakub Sokołowski 47f500e1ad
beacon-node-builds: refactor to rebuild after failures
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-21 00:38:03 +02:00
Jakub Sokołowski ee9f8a74b7
bump beacon-node role and others to use WireGuard
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-19 23:03:14 +02:00
Arthur Koziel 04648b6465
Scan all DC's for Geth nodes (#57)
Signed-off-by: Arthur Koziel <arthur@arthurkoziel.com>
2021-05-19 17:54:46 +08:00
Jakub Sokołowski c6c7159e94
distribute-validators: create container folder if missing
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-05-11 10:41:52 +02:00
Jakub Sokołowski 65d8302527
implement Eth1 Web3 URL fallbacks
Related:
https://github.com/status-im/infra-role-beacon-node/commit/92f740e0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-19 20:27:52 +02:00
Jakub Sokołowski 45241a5a15
beacon-node-builds: drop use of -d:insecure
No longer necessary due to new secure HTTP backend:
https://github.com/status-im/nimbus-eth2/releases/tag/v1.1.0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-13 08:07:49 +02:00
Jakub Sokołowski 3c0fe9e8fb
beacon-node-builds: fix systemd timer service group not existing
Fixes:
Failed to determine group credentials: No such process
Failed at step GROUP spawning /data/beacon-node-builds/unstable-small/build.sh: No such process

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-04-07 09:23:50 +02:00
Jakub Sokołowski d88c8b44fc
beacon-node-builds: relax the sudoers regex for systemctl
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-03-03 08:46:37 +01:00
Jakub Sokołowski 9153bb02f1
logclean-job: fix bug in script that deletes newer first
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-27 15:37:49 +01:00
Jakub Sokołowski b1ad100a50
logclean-job: increase timer timeout to 5 minutes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-27 15:26:53 +01:00
Jakub Sokołowski d31094d85c
logclean-job: reduce kept ES indices to 20
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-27 15:24:34 +01:00
Jakub Sokołowski aee3b5eff5
beacon-node-builds: allow for repo updates for select builds
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-22 21:37:38 +01:00
Jakub Sokołowski dd70e0652d
beacon-node-builds: add commit to labels
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-22 16:05:56 +01:00
Jakub Sokołowski a269c3e490
distribute-validators: add --delete for rsyncing secrets
Also drop some debug messages, comment out ignore_errors.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-22 15:49:05 +01:00
Jakub Sokołowski 0e82fa7c03
beacon-node-builds: don't update git branch when deploying
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-09 18:35:32 +01:00
Jakub Sokołowski f96fe517e7
beacon-node-builds: allow staff group membets to start builds
I was thinking of defining the jobs as nimbus user systemd units, but
that would not work unless nimbus user logged in at least once.

And Systemd services have no functionality for allowing non-root users
to start/stop/restart system services, so sudo is the simplest way.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-08 12:36:02 +01:00
Jakub Sokołowski 8e0966fb0e
beacon-node-builds: don't fetch if we're on a detached head
Causes failures when a tag is checked out, nothing to fetch.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-02-04 23:48:26 +01:00
Jakub Sokołowski 37c1c62a5d add validators distributio for the new fleet
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-22 14:27:39 +01:00
Jakub Sokołowski 0bc722ca21
dist-validators: don't run any tasks if no layout is defined
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2021-01-18 19:47:51 +01:00
Ștefan Talpalaru e71d1643b8 beacon-node-builds: support core dumps
- build with "-d:noSignalHandler" in NIMFLAGS
- keep binary copies for a week, so we can use them with core dumps on
  target hosts
- finish replacing "item.branch" with "item.version"
- manually add a [nimbus-master] section to "ansible/inventory/test"
2020-12-18 21:56:32 +02:00
Jakub Sokołowski 8dc1db8f0b
nimbus-builds: add release build for eth2.prod fleet
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-12-11 18:44:34 +01:00
Jakub Sokołowski cef9441279
beacon-node-builds: drop pushing each commit
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 17:33:03 +01:00
Jakub Sokołowski afd230007f
beacon-node-builds: use the git_config resource
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 17:16:15 +01:00
Jakub Sokołowski 3eacfc36c7
beacon-node-builds: use docker_login resource
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 17:13:01 +01:00
Jakub Sokołowski 318e56bd04
beacon-node-builds: run with -j1 to not disturb containers
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:45:51 +01:00
Jakub Sokołowski 5455ec8f7c
distribute-validators: remove before copying validators
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:37:49 +01:00
Jakub Sokołowski 1f39b846ad
move builds to existing master pyrmont hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 16:05:10 +01:00
Jakub Sokołowski 1a5ca8ab59
beacon-node-builds: drop building nimbus_beacon_node_spec_0_12_3
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-20 14:54:36 +01:00
Jakub Sokołowski b57c46cf0a
distribute-validators: adjust ownership before chmod
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 16:26:16 +01:00
Jakub Sokołowski bce497758b
distribute-validators: wildcards don't work in single quotes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 15:47:18 +01:00
Jakub Sokołowski f79d65f7c9
beacon-node-builds: bump timeout to 60 minutes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 15:07:15 +01:00
Jakub Sokołowski a11e60cc93
distribute-validators: make sure dist_validators_range has a value
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 14:01:21 +01:00
Jakub Sokołowski 8c68e3b56c
build nimbus_beacon_node also for master,devel,libp2p
This is necessary for the new pyrmont network.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-17 13:36:21 +01:00
Jakub Sokołowski 81857071de
distibute-validators: adjust permissions setting for secrets
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-12 13:29:34 +01:00
Jakub Sokołowski 2930e4456d
distribute-validators: add assert to check overlap of secrets
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-12 12:32:37 +01:00
Jakub Sokołowski 890784ae1d
distribute-validators: fix adjusting permissions
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2020-11-12 12:09:20 +01:00