Commit Graph

1028 Commits

Author SHA1 Message Date
Jakub Sokołowski d2d277a0f1
fluffy: make all nodes use the same port 9100
Will make it easier to debug them:
https://github.com/status-im/infra-nimbus/issues/186

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-07-04 16:50:06 +02:00
Jakub Sokołowski 567e95314b
fluffy: use separate IPv4 addresses for each node
https://github.com/status-im/infra-nimbus/issues/186

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-07-04 16:49:30 +02:00
Jakub Sokołowski 032dc7ddf4
fluffy: fix using tags with nimbus-fluffy role
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-07-04 16:49:03 +02:00
Jakub Sokołowski a303fc92bd
fluffy: add extra 32 addreses to each host
Which will then be attached to individual fluffy nodes:
https://github.com/status-im/infra-nimbus/issues/186

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-07-04 16:49:02 +02:00
Jakub Sokołowski ae6ee82a18
fluffy: add netplan role to manage network config
https://github.com/status-im/infra-nimbus/issues/186

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-07-04 08:48:45 +02:00
Jakub Sokołowski d5ad598a3a
portal: fix portal RPC address to fluffy node
https://github.com/status-im/infra-nimbus/issues/182

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-07-02 16:39:04 +02:00
Jakub Sokołowski bedcd886b2
portal: use new portal-rpc-url flag
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-07-02 11:51:43 +02:00
Jakub Sokołowski 99163a8158
portal: open listening port for fluffy node
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-07-02 11:43:53 +02:00
Jakub Sokołowski 95def75354
portal: add open-ports to expose metrics
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-07-02 11:22:55 +02:00
Jakub Sokołowski 7ae2a5f547
portal: add fluffy node for the portal-bridge
https://github.com/status-im/infra-nimbus/issues/182

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-07-02 11:21:01 +02:00
Jakub Sokołowski 4be597d182
portal: extrac portal-bridge setup to new playbook
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-07-02 11:20:31 +02:00
Jakub Sokołowski e2c8ce0175
portal-bridge: fix web3 URL to not use HTTPS
Was causing errors like this:
```
Failed to send POST Request with JSON-RPC: Could not connect to remote host, reason: (UnsupportedVersion) Incoming protocol or record version is unsupported (code: 3)"
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-07-02 10:40:01 +02:00
Jakub Sokołowski a991898990
portal-bridge: move config to separate vars file
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-07-02 10:39:57 +02:00
Jakub Sokołowski 17d767c59d
fluffy: deploy portal-bridge instance
And use `linux-02` from `nimbus.mainnet` for EL.

https://github.com/status-im/infra-nimbus/issues/182

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-28 13:56:39 +02:00
Jakub Sokołowski 5fc1d1f422
requirements: include porta-bridge service fixes
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-28 13:56:37 +02:00
Jakub Sokołowski a8b050a41a
requirements: bump erigon version
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-28 11:21:18 +02:00
Jakub Sokołowski becc1905e5
holesky: update admin user pass for windows and macos
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-24 11:20:14 +02:00
Jakub Sokołowski b9940a9908
ansible/roles.py: fix pull call to handle up-to-date repo
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-24 08:48:25 +02:00
Jakub Sokołowski d3ac5a8766
sepolia: drop trial eth1 node, creates noise
Can always be re-added later when `nimbus-eth1` is stable.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-21 14:25:46 +02:00
Jakub Sokołowski 112a7662db
requirements: bump rocketpool, geth, erigon roles
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-21 14:24:15 +02:00
Jakub Sokołowski 8f62939e54
mainnet,sepolia,holesky: open Nginx ports for ERA files
It appears the rules were lost at some point:
https://github.com/status-im/infra-nimbus/issues/187

And yes, not all hosts need this port open, but will in the future and
there's currently no harm in it, it's just dev fleets.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-20 16:17:43 +02:00
Jakub Sokołowski 8395f200b4
mainnet,sepolia,holesky: add tags for include_role tasks
By using `apply` argument we can make the `tags` work for `include_role`
calls used together with `with_items`.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-20 16:01:14 +02:00
Jakub Sokołowski ee4db9e740
mainnet: build ncli_db for ERA files generation
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-18 12:26:39 +02:00
Jakub Sokołowski 44d0271816
holesky: use public_api flag to determin remapped port
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-18 12:03:08 +02:00
Jakub Sokołowski 30c13db7c8
mainnet: use public_api flag to determin remapped port
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-18 11:43:08 +02:00
Jakub Sokołowski 9fa3af9a37
mainnet,sepolia,holesky: disable checks on public API nodes
Flakiness of REST API when abused by exposure to the internet makes
these healthchecks useless. They essentially produce noise.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-14 19:46:54 +02:00
Jakub Sokołowski eca6fc2e76
ansible: add roles.py script to manage roles
https://github.com/status-im/infra-template/pull/5
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-13 17:19:32 +02:00
Jakub Sokołowski f8c12213f8
holesky: lower sensitivity for public API endpoints
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-13 10:49:50 +02:00
Jakub Sokołowski 06a2d56d5f
nimbus.holesy: recover healthchecks after one hour
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-13 08:52:48 +02:00
Jakub Sokołowski 7f65b48324
requirements: bump breacon node and nimbus-fluffy
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-12 10:43:06 +02:00
Jakub Sokołowski 0ac7766cb1
mainnet,sepolia,holesky: fix format of extra_flags
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-12 01:17:43 +02:00
Jakub Sokołowski 3d961e404d
all: drop obsolete nim build flags
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-11 17:42:13 +02:00
Jakub Sokołowski b551423ea1
sepolia: drop firewall rules for wakuv2.test fleet
It no longer exists.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-11 08:57:52 +02:00
Jakub Sokołowski 82b65e6918
miannet,sepolia,holesky: run update jobs every 2 hours
Otherwise we get a massive CPU load spike that makes nodes unavailable.

Also fix nim flags variable names.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-11 08:37:36 +02:00
Jakub Sokołowski 68c347973f
mainnet,sepolia,holesky: fix IPv6 addresses
Hosts were in a different subnets and needed different IPv6 addresses.

Ranges allocated to us:

START:   2a0a:d580:804:40::100/64
END      2a0a:d580:804:40::120/64
GATEWAY: 2a0a:d580:804:40::1

START:   2a0a:d580:801:60::100/64
END:     2a0a:d580:801:60::120/64
GATEWAY: 2a0a:d580:801:60::1

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-06-06 21:11:19 +02:00
Jakub Sokołowski 04399f4e60
sepolia: fix ERA file generation by building ncli_db
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-28 10:28:29 +02:00
Jakub Sokołowski 6ee7485753
requirements: bump oauth-proxyh, bn, vc, smart-metrics
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-28 10:27:59 +02:00
Jakub Sokołowski fc21ebbc29
fluffy: mount second volume under /era
https://github.com/status-im/infra-nimbus/issues/182

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-24 17:08:21 +02:00
Jakub Sokołowski 0f9ca492ee
holesky: add hosting of holesky.era.nimbus.team
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-22 20:34:46 +02:00
kdeme 85fad5e860
fluffy: change network to mainnet, renamed from testnet0
Can also get rid of nimbus_fluffy_network_nice_name now in the process.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-22 17:28:02 +02:00
Jakub Sokołowski e1b9f8d867
mainnet: remove unnecessary commented line
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-22 17:27:19 +02:00
Alexis Pentori 29c93910b3
nimbus-eth1: switching tesnet to holesky
Signed-off-by: Alexis Pentori <alexis@status.im>
2024-05-22 16:47:46 +02:00
Anton Iakimov ee741f17e4
nimbus.mainnet: simplify success_before_passing logic 2024-05-22 16:10:38 +02:00
Anton Iakimov e4b080274b
mainnet: set public testing endpoint check to recover faster 2024-05-20 16:39:22 +02:00
Anton Iakimov c2c610df7c
requirements: update to fix config path 2024-05-20 16:38:39 +02:00
Anton Iakimov 6055da9327
requirements: update roles 2024-05-20 15:49:11 +02:00
Jakub Sokołowski 9aa1a6cb2e
holesky: fix number of Geth nodes for windows-01
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-13 11:57:09 +02:00
Jakub Sokołowski 0664dca702
nimbus.holesky: fix Geth ports for windows-01
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-13 11:46:53 +02:00
Jakub Sokołowski 7d132a413c
requirements: switch BNs to using TOML config file
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-13 11:46:52 +02:00
Jakub Sokołowski 3ebbe395c1
requirements: bump consul, BNs, geth, erigon
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-12 11:56:48 +02:00
Jakub Sokołowski be2528f250
nimbus.sepolia: dynamic public API port
Also fix distribution of validators.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-09 16:50:28 +02:00
Jakub Sokołowski cf5eb1366f
requirements: upgrade BN, geth, nethermind
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-09 14:20:47 +02:00
Jakub Sokołowski 931c9f38b7
nimbus.mainnet: dynamically derive public API node ports
Fixes:
https://github.com/status-im/nimbus-eth2/issues/6271

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-08 10:20:33 +02:00
Jakub Sokołowski a844250fe8
nimbus.mainnet: fix port for public API endpoint
Was wrong due to removal of a node.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-08 09:11:41 +02:00
Jakub Sokołowski 1b4c2becf4
lookup_plugins/bitwarden: ignore stderr
Otherwise we get weird JSON parsing errors:
```
An unhandled exception occurred while running the lookup plugin 'bitwarden'.
Error was a <class 'json.decoder.JSONDecodeError'>, original message:
Extra data: line 1 column 843 (char 842). Extra data: line 1 column 843 (char 842)
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-07 14:48:35 +02:00
Jakub Sokołowski 290335c75b
all: remove SSH access from Zahary
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-06 11:00:28 +02:00
Jakub Sokołowski fa9c9a4769
requirements: bump BN and EL roles
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-06 10:50:08 +02:00
Jakub Sokołowski 56933830f9
all: remove SSH access for ujscale
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-05-06 10:40:01 +02:00
Jakub Sokołowski d787da3cb2
nimbus.holesky: update tsv with state after cleanup
Old folders with validator clients that should not exist were present on
hosts, mostly erigon ones, and posing a threat for further slashings.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-04-28 09:43:13 +02:00
Jakub Sokołowski 0970c10b89
nimbus.holesky: re-add missing playbook steps
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-04-24 09:33:52 +02:00
Jakub Sokołowski 1f4483748b
ansible/upgrade: add missing become=true
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-04-24 08:59:55 +02:00
Jakub Sokołowski 1c472b5d29
nimbus.sepolia: fix validator client enabling
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-04-24 08:48:45 +02:00
Jakub Sokołowski 60dd11a88e
holesky,mainnet,sepolia: lower consul sensitivity
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-04-24 08:25:36 +02:00
Jakub Sokołowski d1d762a686
nimbus.fluffy: lower sensitivity for consul checks
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-04-23 12:49:37 +02:00
Jakub Sokołowski 9ceadfe93c
requirements: bump BN, Fluffy, Geth, Erigon, Rocketpool
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-04-23 12:14:01 +02:00
Jakub Sokołowski 29e7870a8b
nimbus.prater: decomission last two remaining hosts
The testnet is dead, and keeping it around is not necessary.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-04-19 10:13:23 +02:00
Jakub Sokołowski a50b372f01
requirements: bump nimbus-fluffy, add container
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-04-03 13:14:29 +02:00
Jakub Sokołowski 4ecdc1425e
nimbus.fluffy: increase number of nodes back to 32
We now have effective storage size limits:
https://github.com/status-im/infra-role-nimbus-fluffy/pull/4

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-04-02 10:56:49 +02:00
Jakub Sokołowski ce13aac5ce
nimbus.mainnet: download BN when branch is stable
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-04-01 13:50:34 +02:00
Jakub Sokołowski f26dfe57c4
nimbus.holesky: reduce critical alerts sensitivity
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-30 09:59:34 +01:00
Jakub Sokołowski f1e772f162
requirements: bump beacon-node for windows
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-30 09:58:23 +01:00
Jakub Sokołowski 86ebefcd78
requirements: bump windows beacon-node role
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-26 21:12:16 +01:00
Jakub Sokołowski d62f1960c4
nimbus.holesky: set missing fact_path for windows-01
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-26 20:57:37 +01:00
Jakub Sokołowski 19e3ede1e4
nimbus.holesky: add libp2p node on windows-01 host
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-26 20:57:36 +01:00
Jakub Sokołowski 467eee3dff
nimbus.holesky: use ReFS volume mounted as D drive
It is supposed to provide superior performance to NTFS:
https://github.com/status-im/infra-nimbus/issues/180

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-26 20:57:35 +01:00
Alexis Pentori 29bce4b7da
sepolia: update port open for waku network monitor
Signed-off-by: Alexis Pentori <alexis@status.im>
2024-03-26 15:33:11 +01:00
Jakub Sokołowski 6aeb204614
nimbus.holesky: deploy windows-01 host with nodes
Currently we have issues building and running Beacon node:
https://github.com/status-im/nimbus-eth2/issues/6139

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-26 12:42:26 +01:00
Jakub Sokołowski 6757e2f6ab
nimbus.fluffy: reduce number of nodes from 32 to 16
There's not enough disk space.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-26 00:46:40 +01:00
Etan Kissling eccb234f17
nimbus.prater: use custom research branch
As prater is approaching end of life, it is suitable for testing edge
cases with partitioned network. To avoid interfering with other networks
a separate branch should be tracked instead.

Signed-off-by: Etan Kissling <etan@status.im>
2024-03-25 16:26:18 +01:00
Jakub Sokołowski 10ff179299
nimbus.holesky: add Geth hosts for MacOS and Windows
No Windows host with beacon nodes currently.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-21 16:53:36 +01:00
Jakub Sokołowski 5792c09f1d
requirements: update beacon-node and systemd-timer
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-20 13:50:21 +01:00
Jakub Sokołowski 9ef7a7a8bf
nimbus.sepolia: add IPv6 addresses and netplan role
https://github.com/status-im/infra-nimbus/issues/176

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-20 13:50:20 +01:00
Jakub Sokołowski 90edd3c50e
nimbus.mainnet: add IPv6 addresses and netplan role
https://github.com/status-im/infra-nimbus/issues/176

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-20 13:50:19 +01:00
Jakub Sokołowski 581336eff8
nimbus.holesky: add IPv6 addresses and netplan role
https://github.com/status-im/infra-nimbus/issues/176

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-20 13:36:20 +01:00
Jakub Sokołowski 2ad97c7be4
nimbus.prater: lower alert sensitivity even further
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-18 19:59:55 +01:00
Etan Kissling 140e1835ce
Revert "nimbus.prater: use stable instead of unstable branch"
This reverts commit c48ac78797.

The underlying issue that prompted switching to `stable` has been fixed.

- https://github.com/status-im/nimbus-eth2/issues/5753

Signed-off-by: Etan Kissling <etan@status.im>
2024-03-16 17:21:20 +01:00
Jakub Sokołowski 92e180f775
ansible/inventory: update to use status.im domain
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-15 12:07:45 +01:00
Jakub Sokołowski dd53f463ec
requirements: bump systemd-timer role
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-14 15:49:17 +01:00
Jakub Sokołowski 848a148844
requirements: use full names for all roles
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-10 13:43:30 +01:00
Jakub Sokołowski 2aed8560e6
nimbus.prater: bump consul alerts thresholds
We really don't care about this fleet.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-10 13:08:53 +01:00
Jakub Sokołowski 4a7355d91d
nimbus.mainnet: disable subscribe-all for bootstrap
Generates high CPU load and deteriorates bootstrap node performance.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-08 15:19:17 +01:00
Jakub Sokołowski 084e5ceeb2
requirements: bump systemd-timer and launchd-timer
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-08 15:08:48 +01:00
Jakub Sokołowski e1a4d68df8
mainnet: fix name of yamux debug flag
https://github.com/status-im/nimbus-eth2/pull/6010

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-07 19:52:17 +01:00
kdeme bcbc19ec16
all: remove SSH access for daniil@status.im
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-05 12:45:15 +01:00
Jakub Sokołowski 2fdb97f25f
nimbus.prater: update validators layout TSV file
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-05 11:24:46 +01:00
Jakub Sokołowski de1ae7b873
nimbus.mainnet: rename nodes to include bootstrap word
This is additional precaution to avoid accidental destruction of these hosts
as they are used by Ethereum clients to connect to the network.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-05 10:41:52 +01:00
Jakub Sokołowski 5f903426a5
nimbus.prater: reduce layout to just 2 hosts
This testnet will be dead within ~3 weeks.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-03-04 17:49:56 +01:00
Jakub Sokołowski aaa3c437a9
nimbus.holesky: lower limit for detailed val metrics
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2024-02-29 02:31:01 +01:00
Anton Iakimov 23ba0d0d18
nimbus.sepolia: open ports for waku.sandbox 2024-02-27 16:47:23 +01:00
Anton Iakimov 0395e9a253
nimbus.mainnet: remove beacon-node-mainnet-testing-02 2024-02-27 16:06:23 +01:00