status-im
/
infra-nimbus
mirror of https://github.com/status-im/infra-nimbus.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
650 Commits 10 Branches 0 Tags 31 MiB
Commit Graph

285 Commits

Author SHA1 Message Date
Jakub Sokołowski 33f376cc3d
nimbus.mainnet: resync monthly and add 7 days delay 
To avoid resyncing multiple nodes at the same time.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-22 10:54:10 +02:00
Jakub Sokołowski f8c262dfb4
nimbus.mainnet: enable creating resync timer jobs 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-18 09:04:38 +02:00
Jakub Sokołowski 7ec7641eed
nimbus.prater: open REST API ports to the fleet 
Allows for trusted node syncing through the VPN.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-16 18:02:19 +02:00
Jakub Sokołowski 4fe3a607fe
nimbus.mainnet: open REST port to access via VPN 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-13 11:42:41 +02:00
Jakub Sokołowski 7d0029b9e2
drop unused ropsten-01.aws-eu-central-1a.nimbus.geth 
https://github.com/status-im/infra-nimbus/issues/117

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-12 10:53:47 +02:00
Jakub Sokołowski 823196a0d9
use Geth Auth RPC endpoints for Engine API 
Needs JWT secrets configured and changes to Consul queries.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-11 19:23:41 +02:00
Jakub Sokołowski 9d8e55dd55
nimbus-geth: configure Auth RPC ports for Engine API 
This is required for communication with consensus layer nodes:
https://geth.ethereum.org/docs/interface/consensus-clients

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-11 13:06:37 +02:00
Jakub Sokołowski 30ed658621
grant SSH access to etan@status.im 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-11 13:06:36 +02:00
Jakub Sokołowski e3c203c815
nimbus.mainnet: enable purging DB for even nodes 
https://github.com/status-im/infra-nimbus/issues/98

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-10 22:34:21 +02:00
Jakub Sokołowski 1ffc159f70
use idx instead of port_offset loop_var name 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-10 16:55:01 +02:00
Jakub Sokołowski b4b97d9338
nimbus.ropsten: spread validators between all nodes 
https://github.com/status-im/infra-nimbus/issues/117

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-08 13:03:31 +02:00
Jakub Sokołowski 470f24cf5c
nimbus.mainnet: fix location of node DB folder 
We've gotten rid of the `shared_{network}_0` subfolder:
https://github.com/status-im/infra-role-beacon-node-linux/commit/f4259bdf

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-08 11:37:46 +02:00
Jakub Sokołowski e8eded758c
nimbus.mainnet: enable ERA folder symlinking 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-08-08 10:32:48 +02:00
Artur Marud b3e6e3f972
ropsten: create multi-geth config (#120) 
* ropsten: create multi-geth config

Related: https://github.com/status-im/infra-nimbus/issues/117

Signed-off-by: Artur Marud <artur@status.im>
 2022-07-22 14:24:00 +02:00
Jakub Sokołowski da363b1a23
nimbus-era-files: make timer optional 
AWS hosts have just one node, so there's no need for ERA files generation.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-20 15:17:18 +02:00
Artur Marud fb67e2fe16
ropsten: added new disk configuration for ropsten hetzner host (#119) 
Signed-off-by: Artur Marud <artur@status.im>
 2022-07-19 21:34:20 +02:00
Jakub Sokołowski a6bc25ebd3
logs.nimbus: drop ElasticHQ in favor of ES Comrade 
https://github.com/status-im/infra-hq/issues/82

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-14 20:31:24 +02:00
Jakub Sokołowski 472a379a9a
dash.nimbus: fix LB variable typos 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-14 16:51:20 +02:00
Jakub Sokołowski 3cc72b68e9
nimbus.mainnet: deploy nimbus-era-files to metal hosts 
https://github.com/status-im/infra-nimbus/issues/98

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-14 01:00:29 +02:00
Jakub Sokołowski 07d561b62a
logs.nimbus: fix firewall rules for logs.hq fleet 
https://github.com/status-im/infra-hq/issues/80

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-11 17:42:50 +02:00
Jakub Sokołowski 4e0db40fb4
requirements: upgrade Geth to 1.10.20 
https://github.com/ethereum/go-ethereum/releases/tag/v1.10.20

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-05 18:50:55 +02:00
Miran 2b079f1774
fix various typos in comments and roles 2022-07-04 15:07:55 +02:00
Jakub Sokołowski 6702c50f38
bootstrap: give miran sudo permissions 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-04 09:32:53 +02:00
zah 4147d511ba
Enable websock on some servers; Use the typical branches for Sepolia (#113) 2022-07-01 14:15:11 +02:00
Artur Marud f129dc6a3b
prater: continued nim-1.6 rollout 
Signed-off-by: Artur Marud <artur@status.im>
 2022-06-28 19:12:24 +02:00
Jakub Sokołowski 558e226afb
nimbus-geth-mainnet: open API for eth2.prod fleet 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-28 19:04:24 +02:00
zah 6ae39ddd3d
Use Nim 1.6 on metal-05's libp2p instance (#112) 2022-06-22 11:39:15 +02:00
Artur Marud e43c8af2b7
infra-nimbus: go-eth upgrade to 1.10.19 for ropsten, kiln and sepolia 
* major changes - correct TTD for reopsten by default

Signed-off-by: Artur Marud <artur@status.im>
 2022-06-15 17:02:34 +02:00
Artur Marud 9ebf3cba2d
Sepolia (#110) 
* infra-nimbus: new testnet - sepolia

Signed-off-by: Artur Marud <artur@status.im>
 2022-06-15 15:03:58 +02:00
zah 34f9a4b03b
Test our most recent branches with Nim 1.6 (#109) 
The branch_override is no longer necessary, because our unstable and testing branches should be building fine with Nim 1.6
 2022-06-14 15:23:52 +02:00
Jakub Sokołowski 2dd96fdc36
drop giovanni from active users 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-14 10:12:01 +02:00
Etan Kissling f165e2ff52 disable light client data overrides 
On `kiln`, `ropsten`, `prater`, `sepolia`, the BN code applies network
specific defaults `true` / `only-new`. `mainnet`: `false` / `none`.
This means that the overrides here are no longer needed, also avoiding
issues with planned renames of the parameters in the BN implementation.

Signed-off-by: Etan Kissling <etan@status.im>
 2022-06-14 10:09:02 +02:00
narimiran bf1cc4a5a0 users: add miran 2022-06-10 15:33:19 +02:00
Jakub Sokołowski 427ef2a3c0
nimbus-geth-ropsten: add required engine API module 
Without it the merge fails with:
```
{
  "lvl": "DBG",
  "ts": "2022-06-08 16:08:59.069+00:00",
  "msg": "{\"code\":-32601,\"message\":\"the method engine_newPayloadV1 does not exist/is not available\"}"
}
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-08 19:02:41 +02:00
Jakub Sokołowski fbc939aef1
nimbus.ropsten: move all validators to first node 
We can't have multiple nodes controling a single Geth instance.
This will lead to unpredictable behavior on the execution layer.

https://github.com/status-im/infra-nimbus/issues/97

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-08 11:08:11 +02:00
Jakub Sokołowski f615273cdc
nimbus.ropsten: lower TTD to 50000000000000000 
"Here’s an update on the Ropsten TTD: we’ve chosen to use a value of
50000000000000000. At the current hash rate, it would hit in several
weeks. That said,  the EF will rent hash rate itself and work with
partners to accelerate things. With a modest increase in hash rate, we
should be able to make the Ropsten Merge happen on June 8/9.

If your
team is running any validators, please perform a TTD override to
50000000000000000 on them ASAP."

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-02 18:13:12 +02:00
Jakub Sokołowski 77695bd0ea
nimbus-geth-ropsten: set custom TTD for geth 
https://hackmd.io/ngKLqVvvTTGZLj1bGPuCoA#Geth

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-02 10:51:27 +02:00
Jakub Sokołowski c474a3311d
logs.nimbus: leave memory for Lucene, use 32 GB heap 
https://github.com/status-im/infra-nimbus/issues/96

"The moral of the story is this: even when you have memory to spare, try
to avoid crossing the 32 GB heap boundary. It wastes memory, reduces CPU
performance, and makes the GC struggle with large heaps."

https://www.elastic.co/guide/en/elasticsearch/guide/current/heap-sizing.html#compressed_oops
https://www.elastic.co/guide/en/elasticsearch/guide/current/heap-sizing.html#_give_less_than_half_your_memory_to_lucene

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 12:28:48 +02:00
Jakub Sokołowski 3366cd40ef
enable validator monitoring regardless of branch 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 11:51:14 +02:00
Jakub Sokołowski a670e46895
dash.nimbus: move nimbus-logs to our own SSL proxy 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 11:43:48 +02:00
Jakub Sokołowski 5e1af52f2d
logs.nimubs: move nimbus-es to our own SSL proxy 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 11:43:45 +02:00
Jakub Sokołowski f8b09ccd3c
dash.nimbus: upgrade kibana and ES to 7.17.4 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-06-01 11:40:19 +02:00
Artur Marud b1545a6662
nimbus.ropsten: Validators layout setup 
Signed-off-by: Artur Marud <artur@status.im>
 2022-05-26 19:11:55 +02:00
Artur Marud 7e19b3d93e
nimbus.ropsten: Initial beacon node setup 
https://github.com/status-im/infra-nimbus/issues/97

- no validators have been deployed yet.

Signed-off-by: Artur Marud <artur@status.im>
 2022-05-25 13:35:12 +02:00
Artur Marud fe9aed90a2
nimbus.geth: Opened firewall rpc port for ropsten 
Signed-off-by: Artur Marud <artur@status.im>
 2022-05-25 12:28:49 +02:00
Jakub Sokołowski 6a2a801190
nimbus-geth-ropsten: switch Geth to snap sync 
Full sync is just too slow and will not finish in time.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-24 11:16:23 +02:00
Jakub Sokołowski dcc11e0c87
nimbus-geth-ropsten: configure Geth instance 
https://github.com/status-im/infra-nimbus/issues/97

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-20 20:16:42 +02:00
Jakub Sokołowski f6c1529bea
nimbus.kiln: upgrade images and init JSON SHA256 
The host was also reinstalled as it had weird networking issues.
It also had very flaky Geth nodes, which caused a lot of alerts.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-16 20:50:46 +02:00
Zahary Karadjov e6f2f3e010 Add another 10K prater validators 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-05 16:37:49 +02:00
Jakub Sokołowski 389e6dd432
nimbus.mainnet: fix number variable for metal-02 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-04-26 10:16:44 +04:00