status-im
/
infra-role-elasticsearch
mirror of https://github.com/status-im/infra-role-elasticsearch.git
2
0
Fork 0
Code Issues Projects Releases Wiki Activity
85 Commits 1 Branch 0 Tags 166 KiB
Commit Graph

85 Commits

Author SHA1 Message Date
Jakub Sokołowski d9dc779dcc
config: allow modifying settings.query.default_field 
The wildcard means we query all available fields by default.

https://www.elastic.co/guide/en/elasticsearch/reference/7.17/index-modules.html#dynamic-index-settings
https://www.elastic.co/guide/en/kibana/7.17/upgrade-assistant-api-default-field.html

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2024-09-25 14:24:23 +02:00
markoburcul aedab4dae9
config: Increase url max length for http queries 
Resolves issue with Elastic Comrade which was getting 400 too_long_frame_exception
error when querying ES nodes.

Signed-off-by: markoburcul <marko@status.im>
 2024-09-18 20:29:50 +02:00
markoburcul 91fd37d3c5
ansible: Change hostname to inventory_hostname 
Due to the change caused by updated terraform script, we need to change
usage of variable `hostname` to `inventory_hostname`.

Signed-off-by: markoburcul <marko@status.im>
 2024-09-16 18:03:11 +02:00
Jakub Sokołowski 30efbecb13
docker: upgrade to Docker Compose V2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2024-08-08 12:46:29 +02:00
Jakub Sokołowski 1e86928b78
meta: use full names of Ansible roles 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2024-03-10 13:34:12 +01:00
Jakub Sokołowski 7ec1d25604
config: add index.mapping.total_fields.limit setting 
Nimbus builds are generating a LOT of fields.

https://discuss.elastic.co/t/approaches-to-deal-with-limit-of-total-fields-1000-in-index-has-been-exceeded/241039
https://www.elastic.co/guide/en/elasticsearch/reference/current/mapping.html#mapping-limit-settings

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-10-12 18:55:04 +02:00
Jakub Sokołowski a989381d59
config: allow tuning node_concurrent_recoveries 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-06-28 12:13:50 +02:00
Jakub Sokołowski c94433b9f6
upgrade from 7.17.8 to 7.17.9 
https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.9.html

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-03-20 20:06:52 +01:00
Jakub Sokołowski ada672a3f5
add es_jvm_g1gc_enabled to change garbage collector 
https://github.com/status-im/infra-nimbus/issues/138

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-03-01 18:42:29 +01:00
Jakub Sokołowski 5d239ac67f
update jvm config with defaults from container 
First step before trying out different GC options.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-03-01 18:11:36 +01:00
Jakub Sokołowski 26a74907e1
config: use automatic JVM heap size by default 
https://www.elastic.co/guide/en/elasticsearch/reference/7.17/important-settings.html#heap-size-settings

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-01-19 13:50:55 +01:00
Jakub Sokołowski bf5eeadb38
upgrade from 7.17.7 to 7.17.8 
https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.8.html

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2023-01-19 12:32:08 +01:00
Jakub Sokołowski 6fdb0999ca
upgrade image from 7.17.5 to 7.17.7 
https://github.com/elastic/elasticsearch/releases/tag/v7.17.7

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-10-26 11:20:57 +02:00
Jakub Sokołowski bf20428098
config: fix typo in config template 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-15 12:31:17 +02:00
Jakub Sokołowski b74ce144da
upgrade from 7.17.4 to 7.17.5 
https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.5.html

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-14 16:16:41 +02:00
Jakub Sokołowski 7dc554e11a
default to empty list for nodes 
Avoids `NoneType` errors from Ansible in a single-node setup.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-14 16:15:07 +02:00
Jakub Sokołowski d198fc1cd2
drop ElasticHQ in favor of ES Comrade 
https://elastic.infra.status.im/
https://github.com/moshe/elasticsearch-comrade
https://github.com/status-im/infra-role-elasticsearch-comrade

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-14 12:03:59 +02:00
Jakub Sokołowski 607291b5da
set initial_master_nodes only at bootstrap 
Also improve format of `cluster.seed_hosts`.
Possible fix for leader election issues:
https://github.com/status-im/infra-hq/issues/81

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-07-13 10:40:40 +02:00
Jakub Sokołowski 0677d8a987
upgrade ES from 7.17.0 to 7.17.4 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-05-30 11:51:32 +02:00
Jakub Sokołowski 0731b84f94
exporter: upgrade 1.1.0 to 1.3.0 
https://github.com/prometheus-community/elasticsearch_exporter/releases/tag/v1.2.0
https://github.com/prometheus-community/elasticsearch_exporter/releases/tag/v1.2.1
https://github.com/prometheus-community/elasticsearch_exporter/releases/tag/v1.3.0

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-28 10:15:11 +02:00
Jakub Sokołowski d759410f17
fix HQ_DEFAULT_URL to use node as hostname 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-23 22:32:04 +01:00
Jakub Sokołowski 18503666d0
drop duplicate variable definition 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-03-17 14:57:18 +01:00
Jakub Sokołowski 47d5b38ddb
add /var/backup to container for snapshots 
Also added documentation for snapshots.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-14 14:42:36 +01:00
Jakub Sokołowski f7391551f8
add HQ container to compose setup 
Using a separate Ansible role is just a pain.

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-10 20:21:19 +01:00
Jakub Sokołowski 11da113c02
ugprade node 7.14.2 to 7.17.0 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-10 20:21:19 +01:00
Jakub Sokołowski 567f32acdc
refactor to use Docker Compose file 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2022-02-10 20:21:18 +01:00
Jakub Sokołowski f38d712b12
jvm: add -Dlog4j2.formatMsgNoLookups=true flag 
Fix for CVE-2021-44228 remote execution vulnerability in Log4j library:
https://cve.mitre.org/cgi-bin/cvename.cgi?name=2021-44228
https://community.zammad.org/t/cve-2021-44228-elasticsearch-users-be-aware/8256

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-12-12 18:02:50 +01:00
Jakub Sokołowski 0d60d773b6
upgrade to 7.14.2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-10-28 19:24:00 +02:00
Jakub Sokołowski 21a90e1849
allow configuration as a single-node cluster 
https://medium.com/devops-dudes/how-to-deploy-elasticsearch-5b1105e3063a

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-25 17:08:32 +02:00
Jakub Sokołowski c82cbc9fbb
replace Tinc VPN with WireGuard 
https://github.com/status-im/infra-hq/issues/58

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-05-19 22:58:13 +02:00
Jakub Sokołowski 4c77212cd9
add es_cluster_bootstrap var to control bootstrapping 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-27 15:05:55 +02:00
Jakub Sokołowski e3307f7ef3
drop the --es.indices flag to not export per-index metrics 
Too many metrics coming from ElasticSearch:
https://github.com/status-im/infra-hq/issues/46

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-04-27 14:57:21 +02:00
Jakub Sokołowski afa5b00c7a
use node.roles instead of node.master 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-15 18:38:41 +01:00
Jakub Sokołowski 51dc205a4a
increase delay and timeout for port waiting task 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-15 17:55:20 +01:00
Jakub Sokołowski 6f781f3150
add -XX:+UseParallelGC to fix JVM GC performance 
https://www.elastic.co/guide/en/elasticsearch/reference/master/_use_serial_collector_check.html

Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-15 14:51:40 +01:00
Jakub Sokołowski c9bba12e54
drop deprecated node.master option 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-02-15 14:50:21 +01:00
Jakub Sokołowski 9b621cd3b9
upgrade 7.8.0 to 7.10.2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-27 12:59:51 +01:00
Jakub Sokołowski 229520183f
fix name of task changing number of replicas 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 19:53:50 +01:00
Jakub Sokołowski 9e653ac9f3
fix type of value for sysctl task 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2021-01-20 15:28:36 +01:00
Jakub Sokołowski 32ac6e3940
fix permissions on config file, explicitly set mode 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-10-08 12:57:22 +02:00
Jakub Sokołowski 9a429d3c44
upgrade 7.6.2 to 7.8.0 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-07-15 17:32:20 +02:00
Jakub Sokołowski e53862756a
parametrize default template mappings 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-05-26 20:01:40 +02:00
Jakub Sokołowski f880715bbf
upgrade 7.5.2 > 7.6.2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-04-19 15:02:06 +02:00
Jakub Sokołowski 13aab15f75
shards_conf: drop deprecated tempalte field 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-02-03 13:05:15 +01:00
Jakub Sokołowski c1bfe6e19e
add container tags for easier container updates 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-24 12:37:25 +01:00
Jakub Sokołowski d6285d8945
upgrade: 7.4.0 > 7.5.2 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-24 10:07:31 +01:00
Jakub Sokołowski cf8e2b744b
add cluster listening port to consul service metadata 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-04 15:25:47 +01:00
Jakub Sokołowski 20d2c788d1
add cluster port to consul service meta 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-04 15:19:17 +01:00
Jakub Sokołowski a9a9c83eb7
use node.master option to initialize a master 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-04 14:46:18 +01:00
Jakub Sokołowski 5f44bf3d7a
use new discovery.seed_hosts setting for ES 7.4.0 
Signed-off-by: Jakub Sokołowski <jakub@status.im>
 2020-01-04 14:17:18 +01:00