Commit Graph

224 Commits

Author SHA1 Message Date
benbierens 6147c14c9b
setting up 2023-07-17 09:26:54 +02:00
benbierens adeba21665
Disables debug output by default 2023-07-17 08:54:07 +02:00
benbierens b295314bde
fixes blockTTL envvar 2023-07-14 10:45:26 +02:00
benbierens f23926636c
Setting up way to run different codex images 2023-07-14 10:18:37 +02:00
benbierens 2de7fc7f20
Bumps to latest official codex image. 2023-07-13 10:36:43 +02:00
benbierens a3a5adaa19
Merge branch 'feature/codex-net-deployer'
# Conflicts:
#	DistTestCore/Marketplace/MarketplaceAccess.cs
2023-07-13 10:34:34 +02:00
benbierens 4a17129204
Merge branch 'feature/continuous-test-future-counting'
# Conflicts:
#	DistTestCore/Marketplace/MarketplaceAccess.cs
2023-07-13 10:33:31 +02:00
benbierens 6109921849
Enables auto-NAT option 2023-07-13 10:05:40 +02:00
benbierens 1ef65f00f9
Merge branch 'master' into feature/codex-net-deployer
# Conflicts:
#	DistTestCore/Marketplace/MarketplaceAccess.cs
2023-07-12 14:55:42 +02:00
benbierens 11502717c3
Fixes hexint interface to marketplace API 2023-07-12 14:53:27 +02:00
benbierens 42acb862b6
Removes docker images from config because they aren't configurable this way. 2023-07-11 14:56:40 +02:00
benbierens 17935f4c9e
Adds metrics container to deployment json 2023-07-11 12:21:48 +02:00
benbierens 7d856c276b
Only display new threshold breaches 2023-07-11 08:19:14 +02:00
benbierens d982f39870
Adds threshold checking test 2023-07-07 08:52:53 +02:00
benbierens 52c9ec9211
Restores two-client test 2023-07-04 16:04:18 +02:00
benbierens 05e60a6b74
Future-counting test 2023-07-03 08:39:11 +02:00
benbierens e7e464b4fa
Adds container alias to log. Useful for transient nodes 2023-06-30 08:39:18 +02:00
benbierens 66e6cdc027
Flattens CodexNode into CodexAccess 2023-06-29 16:07:49 +02:00
benbierens d985e3191a
Adds blockTTL to configuration of codex containers 2023-06-29 16:03:45 +02:00
benbierens b42570be14
Merge branch 'feature/codex-net-deployer' into feature/continuous-testing
# Conflicts:
#	DistTestCore/Marketplace/MarketplaceAccess.cs
2023-06-29 09:09:20 +02:00
benbierens efc638a0f9
Debugging logging output 2023-06-28 15:11:20 +02:00
benbierens fe1ee45775
Debugging and cleanin up marketplace test 2023-06-28 10:41:04 +02:00
benbierens 2f5bf4b76e
Adds configuration for selling of storage space 2023-06-28 08:48:46 +02:00
benbierens 63068aae1d
Debugging marketplace test 2023-06-27 15:28:00 +02:00
benbierens 9d3874c88f
Runner correctly ingests codex-deployment.json 2023-06-23 10:35:23 +02:00
benbierens 2e09c9135e
Adds metadata about codex deployment 2023-06-23 09:08:18 +02:00
benbierens aa9b667940
Writes codex-deployment.json which can be used by the test running. 2023-06-23 08:44:27 +02:00
benbierens f242ad5a16
Adds option to declare validators. 2023-06-22 15:58:18 +02:00
benbierens cd69565c2e
Successful local deploy 2023-06-22 14:37:37 +02:00
benbierens ee5a466940
Wiring up the starter class 2023-06-22 10:17:12 +02:00
benbierens d23f5aa29d
Initial setup for continuous test runner 2023-06-21 08:28:40 +02:00
benbierens 9b03fff032
Time formatting in peer download test helper 2023-06-20 13:37:58 +02:00
benbierens 519069f97f
Cleanup 2023-06-08 13:23:26 +02:00
benbierens b4f144a7fb
Speeds up file-equal assertions hugely 2023-06-07 10:56:25 +02:00
benbierens 677ead4fd3
Faster test file generation. 2023-06-07 09:59:00 +02:00
benbierens 7ae03938c3
Fixes storage quota for large file tests. 2023-06-07 09:32:56 +02:00
benbierens d2d7f3dea5
Logging upload/download times and adds performance threshold assertions to large-file tests. 2023-06-07 08:30:10 +02:00
benbierens 56dc1c632d
Variable size download tests 2023-06-06 16:10:30 +02:00
benbierens e33a6776e5
Cleanup 2023-06-06 14:37:02 +02:00
benbierens 10a0ac3311
Splits up download tests from connectivity tests and improves testfile logging 2023-06-04 08:59:51 +02:00
benbierens ad71cff465
Automatically map location enum to available k8s nodes. 2023-06-02 10:04:07 +02:00
benbierens e7d059ceed
Makes default configuration overridable from environment variables. 2023-06-02 09:03:46 +02:00
benbierens 09e550df79
Adds AssertHelper for better less log-spamming retry-assert. 2023-06-01 16:28:34 +02:00
benbierens 9328f04f4a
Adds retry for assertions of metrics and account balances. 2023-06-01 16:09:38 +02:00
benbierens 44e237e60e
Fixes incorrect call to node interaction from gethCompantionNodeStarter 2023-06-01 15:56:26 +02:00
benbierens 56c716a4ea
force update to new contracts image 2023-06-01 15:33:50 +02:00
benbierens 37f7f5293f
Adds debug logging for containerlog-searching operations 2023-06-01 15:20:21 +02:00
benbierens 99c9b25487
Adds better check for successful deployment of codex contracts 2023-06-01 15:04:04 +02:00
benbierens b590e24de8
Debugging marketplace deploy in cluster 2023-06-01 14:18:09 +02:00
benbierens b16eb4e88a
Fixes issue where fetching of enode fails 2023-06-01 14:03:16 +02:00
benbierens b92c1b970d
Sets up support for internal and external container addresses 2023-06-01 09:35:18 +02:00
Ben Bierens 1d919544af
Merge pull request #14 from codex-storage/fix/check-network-policies
Fix/check network policies
2023-05-31 15:25:07 +02:00
benbierens c22125201f
Fixing host address formatting for cluster run 2023-05-31 15:02:07 +02:00
benbierens 3ecdce7b07
Readies k8sCluster class for run against online cluster. 2023-05-31 13:50:52 +02:00
benbierens 3d1d82f582
pushes codex loglevel to configuration 2023-05-31 13:34:12 +02:00
benbierens f2145a747f
Clearly distinguishes between peer-connections that can't be made and problems with the node-to-test link. 2023-05-31 13:15:41 +02:00
Veaceslav Doina 2aaf55a53c
Use codexstorage/nim-codex Docker images 2023-05-30 22:45:41 +03:00
benbierens 816cd1728b
wires up testfile size in download helper 2023-05-29 09:27:25 +02:00
benbierens 8c85cd22bb
Adds clear logging for peer helper invocations. 2023-05-29 09:25:03 +02:00
benbierens 1016f568b8
Cleanup of peer connection helpers. Adds peer download helpers. 2023-05-29 09:13:38 +02:00
benbierens ab7a334987
Adds assert that nodes have correct addresses in their table of peers. 2023-05-29 08:35:46 +02:00
benbierens 025b03e678
Retain for a while in staged variable nodes peer discovery tests 2023-05-18 10:42:04 +02:00
benbierens 90a5aafa1c
Better peer discovery result logging. Staged discovery test. 2023-05-12 09:11:05 +02:00
benbierens 38d5b172f4
successful peer discovery tests 2023-05-11 12:44:53 +02:00
benbierens d58cb38c79
Cleanup duplicated retry logic. Adds layered and chain tests 2023-05-10 09:55:36 +02:00
benbierens 2a55328d11
Debugs AutoBootstrapDistTest 2023-05-10 09:09:31 +02:00
benbierens 1d224cf2d3
Sets up working peer-discovery tests 2023-05-10 08:53:57 +02:00
benbierens 87f3b9ec00
Turns off debug logging 2023-05-05 08:33:10 +02:00
benbierens eae138f7fd
Adds policy and test for network isolation. This will not work on docker-desktop clusters. 2023-05-04 14:55:39 +02:00
benbierens 533bf32577
Better logging in case codex node fails to respond to debug/info request. 2023-05-04 11:34:43 +02:00
benbierens 5a4a5795b2
Makes timings not static and ties them to test lifecycle 2023-05-04 08:55:20 +02:00
benbierens 2ed6993b58
wip debugging anomalous test failures 2023-05-04 08:25:48 +02:00
benbierens 532eb3d4f9
Fixes single-instance DistTest class being used to run multiple tests in parallel 2023-05-03 14:55:26 +02:00
benbierens 79a40904e4
setup 2023-05-03 14:18:37 +02:00
benbierens 01c8238311
Applies faster geth image 2023-05-03 10:21:15 +02:00
Eric Mastro ea0a690862
clean up 2023-05-02 15:29:05 +10:00
Eric Mastro 050bb85d27
add arch preprocessor directive
Add preprocessor directive that checks if the current platform architecture is ARM64.

The preprocessor directive checks for ARM64 architecture and changes which docker image to load in the recipes.

# Conflicts:
#	DistTestCore/Codex/CodexContainerRecipe.cs
2023-05-02 15:19:28 +10:00
Eric Mastro c16055d7e4
bump to .net 7 2023-05-02 15:17:43 +10:00
benbierens 5c00205f62
Cleanup and support for automatic bootstrap tests 2023-05-01 11:14:42 +02:00
benbierens db4364d336
Much nicer logging by means of container name-override and long-id log replacements 2023-04-30 10:56:19 +02:00
benbierens 4dd02a96e9
Isolating issue with peer tests 2023-04-30 10:08:32 +02:00
benbierens 96c2ade7ff
Allows for the use of UseLongTimeouts in combination with test-case attribute 2023-04-27 15:55:33 +02:00
benbierens 2ba5a1491a
Updates to latest image 2023-04-26 15:31:01 +02:00
benbierens 1c9e59a6ea
Bonus: sets up peer-tests 2023-04-26 14:40:54 +02:00
benbierens ef546a435b
Supports multiple codex nodes from a single geth companion node. 2023-04-26 11:12:33 +02:00
benbierens ff68b8f0f1
Trying to reduce resource usage of geth 2023-04-25 14:58:19 +02:00
benbierens 52a3a3014d
Turns off debug logging 2023-04-25 13:38:26 +02:00
benbierens 62f4eed221
Removes BringOnline method 2023-04-25 12:52:11 +02:00
benbierens f94f4a6d22
Adds debug logging support 2023-04-25 11:31:15 +02:00
benbierens 72bb0132bf
Implements waiting for correct sync metric of geth nodes 2023-04-25 07:46:09 +02:00
benbierens 929fdb1157
wip: marketplace test is starting to work with annoying sleep and unused code in NethereumInteraction.cs 2023-04-24 16:07:32 +02:00
benbierens 9db35be2ec
Allows for nethereum interactions with companion nodes. Verifies that marketplace contract is available before proceeding with codex-node setup. 2023-04-24 14:09:23 +02:00
benbierens f5a1be34c6
Puts geth websocket and http on same port. 2023-04-21 09:57:52 +02:00
benbierens dc9577613f
Debugging geth bootnode setup 2023-04-21 09:11:45 +02:00
benbierens 6c8b2047d9
Makes log path relative 2023-04-19 20:31:50 +02:00
benbierens cdd51f6dc7
Sets up some durability tests. 2023-04-19 14:57:00 +02:00
benbierens 5b132bcb54
Fixes connection from codex node to its companion 2023-04-19 11:23:11 +02:00
benbierens e9d84a5cf7
Better logging for json errors and node actions. 2023-04-19 10:42:08 +02:00
benbierens e4e7afd580
Better logging 2023-04-19 09:57:37 +02:00
benbierens 7e6de4146e
Better logging and much faster initial balance transactions 2023-04-19 09:19:06 +02:00
benbierens 48ca6f41fa
Removes genesis json. 2023-04-19 07:59:28 +02:00
benbierens 12d122ad83
Finishes implementation of marketplace support 2023-04-18 15:33:12 +02:00
benbierens e36d910f2f
Applies BaseStarter type 2023-04-18 13:45:48 +02:00
benbierens 98f5e481d1
We mint test tokens! 2023-04-18 13:22:41 +02:00
benbierens 9b38447dbe
Setting up access to marketplace address 2023-04-18 10:22:11 +02:00
benbierens f06216b931
Deploys codex-contracts along with geth bootstrap node. 2023-04-17 16:28:07 +02:00
benbierens ca822c508d
Adds catch-retry to geth info extractor 2023-04-17 11:28:07 +02:00
benbierens 8880ddd2bd
Attempting to set up geth bootstrap argument 2023-04-17 10:31:14 +02:00
benbierens 802f3459e9
Fixes issue where oneclient-test would fail because node was not ready. 2023-04-17 09:10:39 +02:00
benbierens 60e653b63c
Better logging + time measurement 2023-04-14 14:53:39 +02:00
benbierens 419ea1854f
Marketplace test passes 2023-04-14 12:37:05 +02:00
benbierens 3d908bab6c
Setting up nethereum library 2023-04-14 10:51:35 +02:00
benbierens 4fd00607df
Setting up Geth starters 2023-04-14 09:54:07 +02:00
benbierens 07fbda3f9a
Allows for metrics collection when some codex groups don't have metrics enabled. 2023-04-13 15:04:01 +02:00
benbierens 9a45883278
Restores downloading of metrics on test failure 2023-04-13 15:02:51 +02:00
benbierens 33a3f85136
Metrics example test passes 2023-04-13 14:36:17 +02:00
benbierens 31e034ab67
Restores automatic log download on test failure 2023-04-13 11:53:54 +02:00
benbierens 7eab4840ef
Log accessing test passes 2023-04-13 11:30:19 +02:00
benbierens cbf0fbf5b5
Implements restart test. 2023-04-13 11:07:36 +02:00
benbierens 56063bbbf1
two-client tests pass 2023-04-13 10:11:33 +02:00
benbierens f5c60f0bca
OneClient test passed 2023-04-13 09:33:10 +02:00
benbierens bb81d7f037
rewiring codex node starter 2023-04-12 16:12:04 +02:00
benbierens 68d089874d
wiring up the dist-test backend 2023-04-12 16:06:04 +02:00
benbierens 7b91c83f5b
Moving everything around 2023-04-12 13:53:55 +02:00