Commit Graph

  • 897fd926ad
    feat: generalize speedup analysis to multiple groups master gmega 2025-11-10 11:02:29 -03:00
  • d3a1bef683
    feat: generalize final analysis (except speedups) to multiple groups gmega 2025-11-10 08:46:10 -03:00
  • 0a68259dc7
    fix(argo): ensure vector scales up even on workflow failure Chrysostomos Nanakos 2025-10-31 13:16:58 +02:00
  • b59ddaf648
    feat(k8s): add DO (Digital Ocean) Kubernetes cluster terraform Chrysostomos Nanakos 2025-10-21 18:17:26 +03:00
  • 200c749cb5
    feat(workflows): add Vector log parsing workflow template and synchronization Chrysostomos Nanakos 2025-10-21 13:25:00 +03:00
  • 0c8e28fa46
    feat(k8s): add Vector logging infrastructure for benchmarks Chrysostomos Nanakos 2025-10-21 12:41:13 +03:00
  • 8d11207e73
    fix(k8s): make codex-node memory resources conditional Chrysostomos Nanakos 2025-10-20 11:46:37 +03:00
  • 884b16d8c5
    Merge pull request #8 from codex-storage/fix-header-assertion Giuliano Mega 2025-10-07 15:15:17 -03:00
  • 162a8f4a54
    fix: Use startswith for Content-Type header assertion Chrysostomos Nanakos 2025-10-07 11:13:02 +03:00
  • b1e4bda940
    fix: switch to bitnamilegacy kubectl image Chrysostomos Nanakos 2025-10-01 15:45:16 +03:00
  • 04828514e4
    feat: port bug fixes and features from swarm branch gmega 2025-06-09 20:06:19 -03:00
  • 4cbb401d12
    feat: add optional data removal with adjusted quotas gmega 2025-04-22 11:52:45 -03:00
  • c5b2daf280
    Merge 5b82e7f6d695f53b572c8c7354757efa5f00d6dd into cd77b20a82ea5c2c7ccea6d9d37ae10fda9b9949 Giuliano Mega 2025-04-26 19:37:09 +00:00
  • 5b82e7f6d6
    add short presentation experiment/simple-swarms gmega 2025-04-26 16:37:01 -03:00
  • f1c6b7a62e
    Merge branch 'master' into experiment/simple-swarms gmega 2025-04-24 12:00:31 -03:00
  • cd77b20a82
    feat: add in-place merging for properly sorting pod logs when dumping from vector flat files gmega 2025-04-24 11:03:33 -03:00
  • af3a07ccd3
    feat: add optional data removal with adjusted quotas gmega 2025-04-22 11:52:45 -03:00
  • e0aadf14b2
    fix env var name in CI gmega 2025-04-22 09:54:04 -03:00
  • 55eca589bc
    feat: add compose image so we can run branch through CI gmega 2025-04-22 09:29:55 -03:00
  • 18e2d868ff
    feat: update static Codex test to new API gmega 2025-04-21 20:28:25 -03:00
  • 4b00bf67a5
    feat: adapt benchmarking harness to provisional swarm API gmega 2025-04-18 11:49:43 -03:00
  • 223276f7c8
    feat: allow image names in compose to be overridden by env vars gmega 2025-04-16 14:09:08 -03:00
  • 67ca362ee7
    misc: minor refactor, add simple network perf test deploy gmega 2025-04-16 12:56:34 -03:00
  • e5fa036e98
    feat: add link to analysis in README gmega 2025-02-27 19:00:49 -03:00
  • b2491c26f9
    fix: fix workflow expressions gmega 2025-02-27 18:49:48 -03:00
  • 81cda58a9d
    feat: add download speed plot, dedup experiment datasets gmega 2025-02-27 18:47:36 -03:00
  • a366f04e7c
    feat: allow re-running failed experiments from previous workflow runs gmega 2025-02-25 12:14:15 -03:00
  • 2061fe6dbe
    feat: add supporting scripts to run workflow retries gmega 2025-02-25 11:00:12 -03:00
  • 5a9543259b
    feat: add support for region k8s annotations gmega 2025-02-24 14:16:59 -03:00
  • 8dbc3faed8
    feat: add tunable parallelism gmega 2025-02-23 11:33:49 -03:00
  • 73219922f6
    feat: add Codex chart values for cluster experiments gmega 2025-02-20 12:16:05 -03:00
  • 48e71a315a
    feat: add support for setting the node tag in benchmark workflow gmega 2025-02-20 12:14:49 -03:00
  • 688091c965
    feat: allow use of custom runner and node tags for Codex gmega 2025-02-20 11:59:24 -03:00
  • a8c19364b7
    fix: minikube env param in workflow gmega 2025-02-20 10:21:45 -03:00
  • 63501c3b79
    fix: simplify and fix adaptation of models to log entries gmega 2025-02-20 09:42:23 -03:00
  • 1ab2112542
    fix: logging for adapted entries should include superclasses gmega 2025-02-19 18:16:26 -03:00
  • 9563a96373
    feat: add explicit logging for experiment stage boundaries gmega 2025-02-19 14:00:27 -03:00
  • 242097abd3
    chore: reify config schema standardization for static dissemination experiments gmega 2025-02-19 12:14:11 -03:00
  • ad6e94db7d
    feat: generalize final analysis to Codex experiments gmega 2025-02-18 17:44:25 -03:00
  • d1077d0972
    feat: allow reading multiple Vector files when splitting logs gmega 2025-02-18 15:59:11 -03:00
  • e47f8848e4
    fix: implement correct timeout behavior for Codex streaming downloads gmega 2025-02-18 15:41:29 -03:00
  • a0e4181123
    feat: add explicit experiment type to experiment config to ease analysis gmega 2025-02-17 11:28:54 -03:00
  • 0d08814929
    feat: generalize benchmark workflow to run Codex in addition to Deluge gmega 2025-02-17 10:44:00 -03:00
  • 4c7f1a4899
    feat: generalize single-experiment download analysis notebook gmega 2025-02-17 09:41:39 -03:00
  • 95651ad9d7
    feat: add download metric unit to experiment config to ease analysis gmega 2025-02-14 18:35:46 -03:00
  • 0530b4a10b
    feat: standardize download metric gmega 2025-02-14 18:19:45 -03:00
  • 38434f4590
    fix container label for codex experiment runner gmega 2025-02-14 15:59:59 -03:00
  • e8441b7bea
    fix: respect logger increments even when stream returns less data than expected gmega 2025-02-14 15:59:28 -03:00
  • f7adf878eb
    feat: add memory parameter to Deluge values file gmega 2025-02-14 14:30:56 -03:00
  • 205f926f89
    feat: add stable bootstrap node gmega 2025-02-14 14:30:18 -03:00
  • f336df8da7
    fix: adjust Codex logging cooldown, insert polling backoff on download completion, define default Codex experiment gmega 2025-02-14 12:14:52 -03:00
  • 68ee1bad87
    feat: add working Codex helm chart gmega 2025-02-14 11:00:17 -03:00
  • 6681922e00
    feat: add Codex static dissemination experiment gmega 2025-02-12 19:21:34 -03:00
  • 84f5e1437f
    chore: delete redundant test gmega 2025-02-04 19:25:26 -03:00
  • 74ee71889e
    feat: add Codex node and initial integration tests gmega 2025-02-04 19:18:58 -03:00
  • 820699f001
    feat: add Codex agent REST API gmega 2025-02-03 18:00:43 -03:00
  • 849bcad6c8
    refactor: simplify download progress reporting gmega 2025-02-03 16:45:48 -03:00
  • bd0ef9ca55
    refactor: move Codex agent into its own subpackage gmega 2025-02-03 15:53:15 -03:00
  • 99992d2e7e
    fix: enable cleanup on failure by default gmega 2025-02-03 15:46:26 -03:00
  • f01dab84f0
    feat: allow experiments to be merged gmega 2025-02-03 15:45:53 -03:00
  • 7844a3e338
    feat: add logging of download metrics (assuming streaming) to Codex agent gmega 2025-02-03 15:23:53 -03:00
  • cb941b859f
    feat: add tracking of download progress via synchronous API at the Codex agent gmega 2025-01-31 15:49:58 -03:00
  • ec44588fab
    feat: add basic Codex agent and API client gmega 2025-01-30 18:34:32 -03:00
  • 5cba77eb99
    feat: add confidence interval to table; add IQR to plot gmega 2025-01-30 11:49:39 -03:00
  • 61f2172304
    feat: add workflow for the final experiment gmega 2025-01-30 11:48:09 -03:00
  • df087127de
    feat: add lossy analysis gmega 2025-01-30 11:07:47 -03:00
  • 94893c0f93
    fix: conditional expression for cleanup gmega 2025-01-29 20:35:26 -03:00
  • a29c010e7a
    feat: allow keeping pods around on failure, add optional log parsing at end of experiment run gmega 2025-01-29 07:20:23 -03:00
  • 7ed29ddb4c
    fix: add RAM settings on deluge node gmega 2025-01-28 20:33:13 -03:00
  • 1b83f8047c
    feat: update RBAC for codex workflows gmega 2025-01-28 18:20:47 -03:00
  • 2c4ff52c47
    fix: remove pointless retry of removals, add test gmega 2025-01-28 18:20:28 -03:00
  • e8d479da69
    fix: add retry to download progress queries gmega 2025-01-28 08:30:11 -03:00
  • 750a19e3e0
    fix: add missing test gmega 2025-01-27 20:19:43 -03:00
  • 32d623f5bd
    fix: make retry policy match deluge node for agent client gmega 2025-01-27 20:19:23 -03:00
  • 34a179b110
    fix: check that cid is not none before removing gmega 2025-01-27 20:02:32 -03:00
  • ee67a92726
    feat: grant codex runner permissions to launch subworkflows gmega 2025-01-27 18:07:56 -03:00
  • ae678bc586
    fix: iterated experiment logging gmega 2025-01-27 18:07:27 -03:00
  • ba1b93d77c
    feat: add structured experiment iteration logs gmega 2025-01-27 17:26:09 -03:00
  • 63b4c51048
    fix: prevent pending tasks from racing teardown gmega 2025-01-27 16:26:25 -03:00
  • 90dda4f932
    fix: add -C so tars do not include parent folders gmega 2025-01-24 19:19:54 -03:00
  • 4d4d06e7a9
    feat: add log parsing workflow with upload to hetzner storage bucket gmega 2025-01-24 18:28:28 -03:00
  • 557bad8a8c
    fix: add hack for multiarch builds of the workflow runner gmega 2025-01-24 17:11:40 -03:00
  • d4ddcdec9d
    fix: do not output the structured line marker in log dumps gmega 2025-01-24 09:51:54 -03:00
  • f7b443239b
    feat: add MinIO client to workflow docker image gmega 2025-01-24 09:51:08 -03:00
  • fdac384ad8
    fix: add autoscaler eviction annotations to prevent pods from being relocated mid-experiment gmega 2025-01-23 12:12:42 -03:00
  • fa5eba0a2f
    chore: increase retry attempts, add logging to ease debugging gmega 2025-01-23 11:38:10 -03:00
  • 901d1f14e4
    chore: add proper lockfile and deps gmega 2025-01-23 10:30:55 -03:00
  • 33026681c5
    chore: update .gitignore gmega 2025-01-23 10:18:42 -03:00
  • 44bc03ee24
    fix: readiness API verb gmega 2025-01-23 10:18:19 -03:00
  • ea25398c96
    refactor: rename final analysis folder gmega 2025-01-23 10:17:55 -03:00
  • cfd0ca43ac
    fix: order logs by timestamp for unordered sources gmega 2025-01-23 10:15:26 -03:00
  • cbba235f2e
    feat: add ES slicing to CLI gmega 2025-01-23 09:05:48 -03:00
  • a9b9fd8332
    fix: quotation so argo does not screw up the value array gmega 2025-01-23 08:06:43 -03:00
  • 6be89f02f0
    feat: implement sliced scrolling for logstash source gmega 2025-01-22 20:03:10 -03:00
  • 8096c9f4e0
    feat: add ordering to parameter matrix expander gmega 2025-01-22 17:12:46 -03:00
  • aad78b9faa
    fix: proper handling of retried removals gmega 2025-01-22 15:28:34 -03:00
  • 1b6d710d4a
    feat: add dump logs from source to CLI gmega 2025-01-22 15:27:51 -03:00
  • d70b87d2bb
    fix: production values for Argo workflows and RBAC gmega 2025-01-22 10:31:08 -03:00
  • 538f7a75ee
    Merge pull request #1 from codex-storage/docker/add-multi-arch-builds Giuliano Mega 2025-01-21 19:31:54 -03:00
  • 2e8771fb72
    Merge branch 'feat/logstash' gmega 2025-01-21 19:19:24 -03:00