195 Commits

Author SHA1 Message Date
gmega
95651ad9d7
feat: add download metric unit to experiment config to ease analysis 2025-02-14 18:37:05 -03:00
gmega
0530b4a10b
feat: standardize download metric 2025-02-14 18:19:45 -03:00
gmega
38434f4590
fix container label for codex experiment runner 2025-02-14 15:59:59 -03:00
gmega
e8441b7bea
fix: respect logger increments even when stream returns less data than expected 2025-02-14 15:59:28 -03:00
gmega
f7adf878eb
feat: add memory parameter to Deluge values file 2025-02-14 14:30:56 -03:00
gmega
205f926f89
feat: add stable bootstrap node 2025-02-14 14:30:18 -03:00
gmega
f336df8da7
fix: adjust Codex logging cooldown, insert polling backoff on download completion, define default Codex experiment 2025-02-14 12:14:52 -03:00
gmega
68ee1bad87
feat: add working Codex helm chart 2025-02-14 11:00:17 -03:00
gmega
6681922e00
feat: add Codex static dissemination experiment 2025-02-12 19:21:34 -03:00
gmega
84f5e1437f
chore: delete redundant test 2025-02-04 19:25:26 -03:00
gmega
74ee71889e
feat: add Codex node and initial integration tests 2025-02-04 19:18:58 -03:00
gmega
820699f001
feat: add Codex agent REST API 2025-02-03 18:00:43 -03:00
gmega
849bcad6c8
refactor: simplify download progress reporting 2025-02-03 16:45:48 -03:00
gmega
bd0ef9ca55
refactor: move Codex agent into its own subpackage 2025-02-03 15:53:15 -03:00
gmega
99992d2e7e
fix: enable cleanup on failure by default 2025-02-03 15:46:26 -03:00
gmega
f01dab84f0
feat: allow experiments to be merged 2025-02-03 15:45:53 -03:00
gmega
7844a3e338
feat: add logging of download metrics (assuming streaming) to Codex agent 2025-02-03 15:23:53 -03:00
gmega
cb941b859f
feat: add tracking of download progress via synchronous API at the Codex agent 2025-01-31 19:39:33 -03:00
gmega
ec44588fab
feat: add basic Codex agent and API client 2025-01-30 19:23:10 -03:00
gmega
5cba77eb99
feat: add confidence interval to table; add IQR to plot 2025-01-30 11:49:39 -03:00
gmega
61f2172304
feat: add workflow for the final experiment 2025-01-30 11:48:09 -03:00
gmega
df087127de
feat: add lossy analysis 2025-01-30 11:07:47 -03:00
gmega
94893c0f93
fix: conditional expression for cleanup 2025-01-29 20:35:26 -03:00
gmega
a29c010e7a
feat: allow keeping pods around on failure, add optional log parsing at end of experiment run 2025-01-29 08:47:01 -03:00
gmega
7ed29ddb4c
fix: add RAM settings on deluge node 2025-01-28 20:33:13 -03:00
gmega
1b83f8047c
feat: update RBAC for codex workflows 2025-01-28 18:20:47 -03:00
gmega
2c4ff52c47
fix: remove pointless retry of removals, add test 2025-01-28 18:20:28 -03:00
gmega
e8d479da69
fix: add retry to download progress queries 2025-01-28 08:30:11 -03:00
gmega
750a19e3e0
fix: add missing test 2025-01-27 20:19:43 -03:00
gmega
32d623f5bd
fix: make retry policy match deluge node for agent client 2025-01-27 20:19:23 -03:00
gmega
34a179b110
fix: check that cid is not none before removing 2025-01-27 20:02:32 -03:00
gmega
ee67a92726
feat: grant codex runner permissions to launch subworkflows 2025-01-27 18:07:56 -03:00
gmega
ae678bc586
fix: iterated experiment logging 2025-01-27 18:07:27 -03:00
gmega
ba1b93d77c
feat: add structured experiment iteration logs 2025-01-27 17:26:09 -03:00
gmega
63b4c51048
fix: prevent pending tasks from racing teardown 2025-01-27 16:26:25 -03:00
gmega
90dda4f932
fix: add -C so tars do not include parent folders 2025-01-24 19:19:54 -03:00
gmega
4d4d06e7a9
feat: add log parsing workflow with upload to hetzner storage bucket 2025-01-24 18:28:28 -03:00
gmega
557bad8a8c
fix: add hack for multiarch builds of the workflow runner 2025-01-24 17:11:40 -03:00
gmega
d4ddcdec9d
fix: do not output the structured line marker in log dumps 2025-01-24 09:51:54 -03:00
gmega
f7b443239b
feat: add MinIO client to workflow docker image 2025-01-24 09:51:08 -03:00
gmega
fdac384ad8
fix: add autoscaler eviction annotations to prevent pods from being relocated mid-experiment 2025-01-23 12:12:42 -03:00
gmega
fa5eba0a2f
chore: increase retry attempts, add logging to ease debugging 2025-01-23 11:38:10 -03:00
gmega
901d1f14e4
chore: add proper lockfile and deps 2025-01-23 10:30:55 -03:00
gmega
33026681c5
chore: update .gitignore 2025-01-23 10:18:42 -03:00
gmega
44bc03ee24
fix: readiness API verb 2025-01-23 10:18:19 -03:00
gmega
ea25398c96
refactor: rename final analysis folder 2025-01-23 10:17:55 -03:00
gmega
cfd0ca43ac
fix: order logs by timestamp for unordered sources 2025-01-23 10:15:26 -03:00
gmega
cbba235f2e
feat: add ES slicing to CLI 2025-01-23 09:05:48 -03:00
gmega
a9b9fd8332
fix: quotation so argo does not screw up the value array 2025-01-23 08:06:43 -03:00
gmega
6be89f02f0
feat: implement sliced scrolling for logstash source 2025-01-22 20:05:01 -03:00