165 Commits

Author SHA1 Message Date
gmega
34a179b110
fix: check that cid is not none before removing 2025-01-27 20:02:32 -03:00
gmega
ee67a92726
feat: grant codex runner permissions to launch subworkflows 2025-01-27 18:07:56 -03:00
gmega
ae678bc586
fix: iterated experiment logging 2025-01-27 18:07:27 -03:00
gmega
ba1b93d77c
feat: add structured experiment iteration logs 2025-01-27 17:26:09 -03:00
gmega
63b4c51048
fix: prevent pending tasks from racing teardown 2025-01-27 16:26:25 -03:00
gmega
90dda4f932
fix: add -C so tars do not include parent folders 2025-01-24 19:19:54 -03:00
gmega
4d4d06e7a9
feat: add log parsing workflow with upload to hetzner storage bucket 2025-01-24 18:28:28 -03:00
gmega
557bad8a8c
fix: add hack for multiarch builds of the workflow runner 2025-01-24 17:11:40 -03:00
gmega
d4ddcdec9d
fix: do not output the structured line marker in log dumps 2025-01-24 09:51:54 -03:00
gmega
f7b443239b
feat: add MinIO client to workflow docker image 2025-01-24 09:51:08 -03:00
gmega
fdac384ad8
fix: add autoscaler eviction annotations to prevent pods from being relocated mid-experiment 2025-01-23 12:12:42 -03:00
gmega
fa5eba0a2f
chore: increase retry attempts, add logging to ease debugging 2025-01-23 11:38:10 -03:00
gmega
901d1f14e4
chore: add proper lockfile and deps 2025-01-23 10:30:55 -03:00
gmega
33026681c5
chore: update .gitignore 2025-01-23 10:18:42 -03:00
gmega
44bc03ee24
fix: readiness API verb 2025-01-23 10:18:19 -03:00
gmega
ea25398c96
refactor: rename final analysis folder 2025-01-23 10:17:55 -03:00
gmega
cfd0ca43ac
fix: order logs by timestamp for unordered sources 2025-01-23 10:15:26 -03:00
gmega
cbba235f2e
feat: add ES slicing to CLI 2025-01-23 09:05:48 -03:00
gmega
a9b9fd8332
fix: quotation so argo does not screw up the value array 2025-01-23 08:06:43 -03:00
gmega
6be89f02f0
feat: implement sliced scrolling for logstash source 2025-01-22 20:05:01 -03:00
gmega
8096c9f4e0
feat: add ordering to parameter matrix expander 2025-01-22 17:12:46 -03:00
gmega
aad78b9faa
fix: proper handling of retried removals 2025-01-22 15:28:34 -03:00
gmega
1b6d710d4a
feat: add dump logs from source to CLI 2025-01-22 15:27:51 -03:00
gmega
d70b87d2bb
fix: production values for Argo workflows and RBAC 2025-01-22 10:31:08 -03:00
Giuliano Mega
538f7a75ee
Merge pull request #1 from codex-storage/docker/add-multi-arch-builds
docker: add multi-arch builds
2025-01-21 19:31:54 -03:00
gmega
2e8771fb72
Merge branch 'feat/logstash' 2025-01-21 19:19:24 -03:00
gmega
1ec24bac5f
fix: add synchronization predicates to ES fixtures 2025-01-21 19:18:29 -03:00
Giuliano Mega
d14079cce1
Merge pull request #3 from codex-storage/feat/logstash
feat: add log source for logstash
2025-01-21 18:47:48 -03:00
gmega
02e2fe39d1
feat: add CLI for parsing logs from logstash 2025-01-21 18:44:30 -03:00
gmega
5fc241660b
feat: add logstash log source (elasticsearch) 2025-01-21 17:57:17 -03:00
gmega
485b86465d
refactor: split log source module 2025-01-21 08:43:14 -03:00
gmega
aeb2f044c8
chore: remove leftover values from chart 2025-01-20 20:01:48 -03:00
Giuliano Mega
9ac27230fe
Merge pull request #2 from codex-storage/feat/local-agents
feat: add local agents and localize file generation
2025-01-20 18:51:06 -03:00
gmega
882392bef2
fix: add missing parameters to cleanup hook 2025-01-20 18:41:11 -03:00
gmega
6ae5b1620f
chore: add missing EOL 2025-01-20 17:59:07 -03:00
gmega
7e07eda3c2
feat: allow running workflows from locally loaded images under Minikube 2025-01-20 17:57:21 -03:00
gmega
4a02e86160
fix: add missing PHONY target 2025-01-20 15:38:59 -03:00
gmega
5a203fad18
chore: eliminate 5GB experiment for now 2025-01-20 15:29:27 -03:00
gmega
ab100c4841
feat: runnable experiment with working test runner and agents 2025-01-20 15:24:03 -03:00
gmega
6978b7ef28
fix: local minikube image build 2025-01-20 15:21:29 -03:00
gmega
02f680a91d
feat: make deluge agent client part of the experiment environment 2025-01-20 15:00:02 -03:00
gmega
94556d7a53
working deployment of agents on minikube 2025-01-20 11:39:43 -03:00
gmega
27d0815be8
feat: add local file generation agents and drop requirement for shared volumes with the test runner 2025-01-19 10:32:27 -03:00
gmega
3ed074e56f
fix: make image-{test,release} into PHONY targets 2025-01-17 08:39:06 -03:00
gmega
82f1f9a2ed
refactor: generalize builder types 2025-01-17 08:34:49 -03:00
gmega
60fd274b18
feat: add node affinity/anti-affinity and storage class knobs to run this on a cluster 2025-01-15 11:52:32 -03:00
gmega
47646eb02a
feat: complete the final analysis 2025-01-15 10:22:18 -03:00
gmega
1ee8ea8a35
fix: support nested attributes in client retry wrapper 2025-01-14 19:48:58 -03:00
gmega
742578a3f7
feat: complete final analysis 2025-01-14 19:35:20 -03:00
gmega
8ef05e36a9
feat: add more robust retry policy to Deluge client 2025-01-14 19:32:34 -03:00