Commit Graph

359 Commits

Author SHA1 Message Date
benbierens 75757e37fb
Can fetch storage requests from chain 2023-12-20 10:55:29 +01:00
benbierens 4b74a9d5fe
working block time finder 2023-12-20 09:48:22 +01:00
benbierens d67ddab290
Checking for all unwanted log entries 2023-12-15 09:32:03 +01:00
benbierens b143136590
Merge branch 'feature/public-testnet-deploying' 2023-12-14 15:59:22 +01:00
benbierens 8fc8a3f7cf
Adds check for block verification failures 2023-12-12 14:18:26 +01:00
benbierens 5dc918287c
Merge branch 'master' into feature/public-testnet-deploying 2023-12-11 08:30:25 +01:00
benbierens 09554da362
Adds transfer speeds to status logs. 2023-12-06 10:50:02 +01:00
benbierens 074f5ebfae
Sets up transferSpeed class 2023-12-06 09:59:45 +01:00
benbierens ad05dc07f0
wip report for november 2023-12-05 08:31:28 +01:00
benbierens 46ab3b31ca
Checking that we can bootstrap geth nodes together. 2023-11-21 10:33:11 +01:00
benbierens f4532f3801
Target duration now supports timespan string format. 2023-11-17 14:51:32 +01:00
benbierens db55792f42
Catching exceptions in task-factory. 2023-11-14 13:28:50 +01:00
benbierens 5996c0fa63
Adds involvedpods, error, and duration in seconds to status logs for continuous tests. 2023-11-14 12:56:47 +01:00
benbierens 2565ced7fe
Adds test report for october 2023-11-13 13:29:28 +01:00
benbierens 1f841ca629
Removes modified/clean indicator 2023-11-13 13:05:44 +01:00
benbierens 0f9e01e393
Adds git revision information to logs for testing framework status 2023-11-13 11:56:02 +01:00
benbierens 412a4d3c7a
Sets exit code for continuous tests runner 2023-11-13 11:17:26 +01:00
benbierens 344d3cd44f
Merge branch 'master' into feature/continuous-test-status-logs
# Conflicts:
#	Tests/DistTestCore/Logs/StatusLog.cs
2023-11-13 09:33:24 +01:00
benbierens 6636ef3ac1
Moves routing table test into peerDiscovery tests. 2023-11-13 09:32:10 +01:00
benbierens 71ad471958
Cleanup routing table tests. Adds retry. 2023-11-12 11:24:58 +01:00
benbierens 96ff3c38bb
Adds test for routing table checks. 2023-11-12 10:36:48 +01:00
benbierens ed56d9edcc
Cleanup of kubernetesWorkflow assembly. 2023-11-12 10:07:23 +01:00
benbierens b78f527c39
Adds test-type to STATUS log jsons. 2023-11-10 15:28:53 +01:00
benbierens 0be6df46bc
Merge branch 'deployment-json-rework' into feature/continuous-test-status-logs 2023-11-10 09:49:35 +01:00
benbierens c5cc15daa0
Updates endpoint to match latest Codex 2023-11-10 08:20:08 +01:00
benbierens 0301c3b076
Adds status log entry for each test run in continuous tests. 2023-11-09 11:35:45 +01:00
benbierens b8ce4c49d6
Merge branch 'master' into deployment-json-rework
# Conflicts:
#	Tests/CodexContinuousTests/run.sh
#	Tools/CodexNetDeployer/deploy-continuous-testnet.sh
2023-11-08 09:29:22 +01:00
benbierens 90070de028
Enable debug logging from single environment variable or static field. 2023-11-08 09:24:39 +01:00
benbierens 3f8699a59b
Removes dependency on pod information for elastic search download 2023-11-07 14:33:45 +01:00
benbierens 2b463d060d
Restores debug setting 2023-11-07 14:00:08 +01:00
benbierens ea66b5b408
debugging address selection in cluster 2023-11-07 12:02:17 +01:00
benbierens 655f4895d0
Fixes serialization issue for running containers for discord bot and metrics container 2023-11-07 11:17:20 +01:00
benbierens dc9f3ab090
removes dependency on static pod name and address info 2023-11-06 14:33:47 +01:00
Veaceslav Doina ead1ff7ec6
Automate Continuous Tests using GitHub Actions (#69) 2023-11-06 15:09:51 +02:00
Veaceslav Doina 807e8b7b5f
Fix TwoClientTest metric name
https://github.com/codex-storage/nim-codex/pull/603
2023-11-06 15:06:47 +02:00
benbierens 5241144e99
Locks up deploy-and-run script after tests are started. 2023-11-01 10:27:31 +01:00
benbierens 49300273e0
Cleanup continuous tests nicely even if no tests were selected for running. 2023-10-31 15:33:00 +01:00
benbierens e87f255f48
Creates dockerimage that will deploy-and-run from environment args 2023-10-31 11:01:10 +01:00
benbierens 85ad0b414f
Cleans up some gethnode arguments. 2023-10-30 13:30:14 +01:00
GoodDaisy 65473d8c15 fix Continous typo 2023-10-26 20:27:44 +08:00
benbierens 14e8222dfe
Adds codex debug-info to deployment json. Needed for bootstrapping later on. 2023-10-25 09:14:35 +02:00
benbierens dc0edce251
Moves continuous-tests default log path to persistent volume 2023-10-25 08:56:48 +02:00
benbierens 0e087c6fee
Logs continuous test config at startup. 2023-10-23 14:17:52 +02:00
benbierens 7a6d7d787b
Splits up metrics-scraper from metrics-endpoints configuration in deployer. 2023-10-23 10:57:59 +02:00
benbierens 4adce837ec
Logs total run duration in overview log. 2023-10-23 10:32:11 +02:00
benbierens e11a7d1600
Gives deployments a name. 2023-10-23 10:19:52 +02:00
benbierens 45fbd699a9
Disables calls to custom API endpoints. 2023-10-23 09:36:31 +02:00
benbierens bf18fa03a2
adds sleep to the starting of the test screens 2023-10-22 11:29:16 +02:00
benbierens 45050c34e4
Implements GetAddress method for runningContainers. 2023-10-19 11:18:59 +02:00
benbierens 6b1102efa7
Adds name argument to deploy-and-run script 2023-10-17 14:32:05 +02:00
benbierens d0cafb83a1
Fixes compile error in single test runner 2023-10-16 13:10:45 +02:00
benbierens 8f37b4cf38
Sets long timeouts for debug/repostore call. 2023-10-10 18:08:21 +02:00
benbierens 1a277ef1b5
Logging repostore content on twoclient test failure 2023-10-10 17:54:19 +02:00
benbierens b81d574a4b
adds block exchange tests. Updates namespaces 2023-10-09 16:59:52 +02:00
benbierens b0610393af
rigged for twoclient test with full container log download 2023-10-08 19:11:31 +02:00
benbierens e4b7e461e9
Adds pod name to downloaded logs 2023-10-08 18:58:15 +02:00
benbierens 0dcf3b0b16
Adds pod and deployment name 2023-10-08 18:56:00 +02:00
benbierens f3555f2703
Adds node id to downloaded container logs 2023-10-08 08:31:48 +02:00
benbierens ab9257ce56
moving the deployment json 2023-10-07 10:29:09 +02:00
benbierens 1a48c40ad7
Example of setting codex log topics for libp2p and discv5 2023-10-07 09:48:12 +02:00
benbierens 092128d77b
with working loops this time 2023-10-07 08:04:11 +02:00
benbierens c653afa554
trying with script 2023-10-07 07:53:10 +02:00
benbierens fab855c4bb
adds log and data paths 2023-10-07 07:49:55 +02:00
benbierens 75e263be31
Try with script 2023-10-07 07:47:54 +02:00
benbierens 9cb8c57615
Adds test report for September 2023-10-05 08:31:44 +02:00
benbierens 5db8be3252
Merge branch 'feature/log-mon'
# Conflicts:
#	Tests/CodexContinuousTests/ContinuousTestRunner.cs
2023-10-04 09:48:21 +02:00
benbierens ccc4732752
Cleanup 2023-10-04 09:36:59 +02:00
benbierens 562f886e30
Bumps k8s operation timeout for continuous test runner. 2023-10-04 09:26:11 +02:00
benbierens 3f2c789dd5
Fixes issue where boolean arguments can't be set to false. 2023-10-04 09:19:45 +02:00
benbierens 917d715497
Fixes startup of log reconstruction 2023-10-03 16:11:14 +02:00
benbierens 696fb10386
debugging the downloader in the cluster 2023-10-03 15:36:44 +02:00
benbierens a69bea47af
Debugging downloader in cluster 2023-10-03 15:18:58 +02:00
benbierens adbd481c7c
Sets elasticsearch downloader for in-cluster running. 2023-10-03 14:32:31 +02:00
benbierens 1bca2bb928
Updates parser for new counter format. 2023-10-03 13:34:39 +02:00
benbierens 6fe9d38eb3
Adds filter option for selecting tests. Adds cleanup option for deleting deployment namespace. 2023-10-03 09:53:02 +02:00
benbierens 6a96bd7639
Implements elastic search log downloader. Requires log-counter codex update! 2023-10-02 14:42:36 +02:00
benbierens c3ec64f25e
very very WIP for how to download complete log from elastic search 2023-10-02 12:01:49 +02:00
benbierens 3dcbb78204
Prevents multiple continuous tests from running interleaved. 2023-10-02 11:18:27 +02:00
benbierens 73c49b42c6
Fixes incorrect log message when test run gets cancelled. 2023-10-02 09:24:01 +02:00
benbierens da855b8d0d
Proper log monitoring shutdown 2023-10-01 10:52:05 +02:00
benbierens b23c66c86e
Working timerange limited log download 2023-10-01 09:57:32 +02:00
benbierens ac7fa4905d
Adds dockertag description 2023-09-29 10:40:48 +02:00
benbierens dcdcd110a1
Updates READMEs 2023-09-29 10:19:59 +02:00
benbierens 3e1b361b7b
Fixes cleanup of online codexnodes in Codex test fixture 2023-09-28 15:04:21 +02:00
benbierens 993f2ff813
Fixes issue where autobootstrap node doesn't clear old bootstrap node handles. 2023-09-28 14:23:48 +02:00
benbierens 260294fb35
Fixes marketplace interference check tests. 2023-09-28 14:00:13 +02:00
benbierens b0f72cf453
Automated local docker build is working. 2023-09-28 12:22:35 +02:00
benbierens 453a1a35a2
Adds status log to continuous tests 2023-09-28 09:39:15 +02:00
benbierens dabf836838
Makes default run id static. 2023-09-28 08:53:01 +02:00
benbierens 8caa7ab4fa
Adds option to limit continuous test run to set duration. 2023-09-27 11:33:54 +02:00
benbierens 6a2bd11dd5
Adds codex environment variables to startup log of continuous tests. 2023-09-27 09:09:42 +02:00
benbierens d830ccb48e
Sets timestamp as default runID when environment variable is not set. 2023-09-27 08:49:36 +02:00
benbierens 42b0ab67a0
Logging bytes per millisecond for twoclient upload and download 2023-09-26 15:17:35 +02:00
benbierens 0a2bca9f52
Restores pod labels in deployer. Adds metrics assert for twoclient continuous test. 2023-09-26 14:32:28 +02:00
benbierens 10697f1047
Updates container location support 2023-09-25 08:47:19 +02:00
benbierens d2854bb905
Cleanup 2023-09-22 07:43:46 +02:00
benbierens 418daf1e3f
Updates the docs 2023-09-21 14:39:41 +02:00
benbierens 01b2ff2181
Merge branch 'master' into plugin-refactor
# Conflicts:
#	DistTestCore/CodexStarter.cs
#	DistTestCore/GethStarter.cs
#	ProjectPlugins/CodexPlugin/CodexContainerRecipe.cs
#	ProjectPlugins/CodexPlugin/CodexSetup.cs
#	ProjectPlugins/CodexPlugin/CodexStartupConfig.cs
2023-09-21 11:07:27 +02:00
benbierens dbf0ed714c
Restores continuous test runner. 2023-09-21 10:33:09 +02:00
benbierens 5b2557b3f4
Set up loading of plugins. 2023-09-20 13:56:01 +02:00
benbierens 8cde69a483
Restores continuous test runner 2023-09-20 13:33:58 +02:00
benbierens 75369d68f7
Restores CodexNetDeployer 2023-09-20 12:02:32 +02:00
benbierens bf4c8d8026
Restores project references. 2023-09-20 10:59:52 +02:00
benbierens 09670e00e9
Moves projects into folders 2023-09-20 10:51:47 +02:00
benbierens 5fa4e0ff9f
Sets serialization gate between each deploy and wrap to ensure application lifecycle invariance. 2023-09-20 09:16:57 +02:00
benbierens cedaf84740
Wires up marketplace access 2023-09-20 08:45:55 +02:00
ThatBen 6cbf363bb1 restores balance asserts. 2023-09-19 16:22:07 +02:00
benbierens 6cf86af3b5
Successful testtoken mint and balance 2023-09-19 13:39:24 +02:00
benbierens 58b1c1e03c
Can send eth 2023-09-19 11:51:59 +02:00
benbierens a20fc6864b
working out marketplace details 2023-09-19 10:28:02 +02:00
ThatBen 3d4370b154 deploys codex contract 2023-09-15 16:27:08 +02:00
ThatBen 4cc93eba73 Can start Geth 2023-09-15 15:52:02 +02:00
ThatBen 7ef3f615e1 Moves log downloading to core. 2023-09-14 15:26:46 +02:00
benbierens ec5aebb47b
Restores full-connectivity tests. 2023-09-13 14:24:43 +02:00
benbierens 84dd514517
Restores connectivity test helpers 2023-09-13 12:24:46 +02:00
benbierens d1895bab02
Implements bringOffline for codex nodes 2023-09-13 12:09:44 +02:00
benbierens 53bb9968ff
Metrics test passed 2023-09-13 11:59:21 +02:00
benbierens 1ca3ddc67e
Implements metrics plugin 2023-09-13 11:25:08 +02:00
benbierens 7e7414d491
Removes core-interface associate methods. 2023-09-13 08:55:04 +02:00
benbierens dd6b99c670
Brings back all the tests. 2023-09-12 15:43:30 +02:00
ThatBen 48dda1735c Good progress 2023-09-11 16:57:57 +02:00
benbierens 83d184177a
Moving all codex details to CodexPlugin 2023-09-11 11:59:33 +02:00
benbierens 6915e90861
Extracts file manager utils to separate assembly 2023-09-11 10:43:27 +02:00
benbierens d074f64c42
a 2023-09-08 14:03:47 +02:00
benbierens 9d2dbbbcab
Fixes missing usings 2023-09-08 10:21:40 +02:00
benbierens df6da29a69
Moves ByteSize to Utils assembly. 2023-09-08 09:39:56 +02:00
benbierens 23f5318dfc
More uploads 2023-09-01 14:40:48 +02:00
benbierens 3df4a97bba
debugging local 2023-09-01 10:39:41 +02:00
benbierens 8f61c46ff0
Adds simple test to ensure routing table is correctly filled. 2023-08-29 16:08:40 +02:00
benbierens 249b13d503
Adds tests to ensure marketplace and metrics don't interfere with peer discovery 2023-08-28 11:16:58 +02:00
benbierens b276592daf
Fixes download stream error in peerDownloadHelper 2023-08-24 15:56:56 +02:00
benbierens 7da90fc53b
cleanup 2023-08-24 15:45:21 +02:00
benbierens 7eda26d177
Cleanup of full-connectivity helper. 2023-08-24 10:59:11 +02:00
benbierens 47aedc2ac8
cleanup 2023-08-22 15:51:39 +02:00
benbierens 7e5121a642
Fixes test for cloud environment 2023-08-22 09:06:44 +02:00
benbierens ce3850b0b0
I accidentally filled up my harddrive with random numbers last night. 2023-08-21 07:58:58 +02:00
benbierens 1682dfc08f
Adds holdmybeer test to continuous test runner 2023-08-18 10:31:20 +02:00
benbierens c8cb04d859
Allows downloading only log-tails. 2023-08-16 16:13:29 +02:00
benbierens 30364abf21
Correct checking of upload and download log statements 2023-08-16 11:39:24 +02:00
benbierens 6486dba289
Asserting correct filesize and block numbers in the codex logs 2023-08-16 10:52:44 +02:00
benbierens 57c46004b1
cleanup 2023-08-15 15:00:47 +02:00
benbierens 3abb1770c2
Fixes crash log downloads 2023-08-15 12:55:30 +02:00
benbierens 08ee09af1e
wires crashWatcher into CodexStarter 2023-08-15 11:01:18 +02:00
benbierens 72fa368357
working example of crash log recovery 2023-08-15 10:03:01 +02:00
benbierens 86bae93e98
Wires up block-maintenance number of blocks param 2023-08-14 16:37:31 +02:00
benbierens c0b7d3a747
Hooks up block maintenance interval config param. 2023-08-14 15:51:03 +02:00
benbierens 6e5e30afd4
rigged up a pod crash detector maybe 2023-08-14 15:10:36 +02:00
benbierens 9f0600d6c1
Automatic quota line. Holding test. 2023-08-14 10:35:42 +02:00
benbierens 68d19353aa
moves to 80MB and long timeouts 2023-08-08 14:42:59 +02:00
benbierens eaf5db5e91
Run test against increasing file sizes 2023-08-08 10:45:16 +02:00