Commit Graph

16 Commits

Author SHA1 Message Date
Jakub Sokołowski ee1ed5203b
logs/dash.nimbus: drop manual JVM heap size setting
Lets try how well the automatic sizing works:
https://www.elastic.co/guide/en/elasticsearch/reference/7.17/important-settings.html#heap-size-settings

https://github.com/status-im/infra-nimbus/issues/138

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-01-19 15:00:14 +01:00
Jakub Sokołowski 9f0ab35e5d
requirements: bump elasticsearch and kiban to 7.17.8
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2023-01-19 14:08:33 +01:00
Jakub Sokołowski 8f326fdf2a
logs.nimbus: open ES API port for Logstash hosts
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-10-27 16:33:37 +02:00
Jakub Sokołowski a6bc25ebd3
logs.nimbus: drop ElasticHQ in favor of ES Comrade
https://github.com/status-im/infra-hq/issues/82

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-07-14 20:31:24 +02:00
Jakub Sokołowski 472a379a9a
dash.nimbus: fix LB variable typos
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-07-14 16:51:20 +02:00
Jakub Sokołowski 07d561b62a
logs.nimbus: fix firewall rules for logs.hq fleet
https://github.com/status-im/infra-hq/issues/80

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-07-11 17:42:50 +02:00
Miran 2b079f1774
fix various typos in comments and roles 2022-07-04 15:07:55 +02:00
Jakub Sokołowski c474a3311d
logs.nimbus: leave memory for Lucene, use 32 GB heap
https://github.com/status-im/infra-nimbus/issues/96

"The moral of the story is this: even when you have memory to spare, try
to avoid crossing the 32 GB heap boundary. It wastes memory, reduces CPU
performance, and makes the GC struggle with large heaps."

https://www.elastic.co/guide/en/elasticsearch/guide/current/heap-sizing.html#compressed_oops
https://www.elastic.co/guide/en/elasticsearch/guide/current/heap-sizing.html#_give_less_than_half_your_memory_to_lucene

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-01 12:28:48 +02:00
Jakub Sokołowski 5e1af52f2d
logs.nimubs: move nimbus-es to our own SSL proxy
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-01 11:43:45 +02:00
Jakub Sokołowski f8b09ccd3c
dash.nimbus: upgrade kibana and ES to 7.17.4
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-06-01 11:40:19 +02:00
Jakub Sokołowski d231accd45
logs.nimbus: refactor OAuth container setup
This is to take into account changes made in:
https://github.com/status-im/infra-role-oauth-proxy/commit/4dd42c56

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-04-11 11:26:38 +02:00
Jakub Sokołowski 89093c894a
logs.nimbus: firewall for ElasticSearch exporter port
Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-03-03 18:23:13 +01:00
Jakub Sokołowski 18eb46836e
logs.nimbus: use docker compose setup for elasticsearch
https://github.com/status-im/infra-role-elasticsearch/commit/567f32ac

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-02-11 02:08:47 +01:00
Jakub Sokołowski 0398c31ad9
logs.nimbus: drop ES replicas down to 0 to save space
https://github.com/status-im/infra-nimbus/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-02-09 18:43:23 +01:00
Jakub Sokołowski ba2caedb64
logs.nimbus: bump JVM memory limits to 80%
We started getting errors like:
```
Caused by: org.elasticsearch.common.breaker.CircuitBreakingException: [parent] Data too large, data for [internal:cluster/nodes/indices/shard/store[n]] would be [36997638608/34.4gb], which is larger than the limit of [36795685273/34.2gb], real usage: [36997638456/34.4gb], new bytes reserved: [152/152b], usages [request=0/0b, fielddata=0/0b, in_flight_requests=152/152b, model_inference=0/0b, eql_sequence=0/0b, accounting=3913236/3.7mb]
```

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-02-07 11:49:44 +01:00
Jakub Sokołowski ade0a50a53
logs.nimbus: migrate to Hetzner metal hosts
For better performance, lower prices, and better network utilization.

https://github.com/status-im/infra-nimbus/issues/84

Signed-off-by: Jakub Sokołowski <jakub@status.im>
2022-02-03 21:48:24 +01:00