logos-storage-nim-cs-dist-tests/CONTRIBUTINGTESTS.MD

Distributed System Tests for Logos Storage

Contributing tests

Do you want to write some tests using this distributed test setup? Great! Here's what you do.

1. Create a branch. Name it something descriptive, but start it with tests/ please. [Example: tests/data-redundancy.]
2. Checkout your branch.
3. Create a new assembly in the /Tests folder. This can be an NUnit test assembly or simply a console app.
4. Add Project references to Core, as well as any project plugin you'll be using.
5. Write tests! Use existing tests for inspiration.

Tips for writing tests for Logos Storage

Transient tests

1. Add new code files to Tests/LogosStorageTests
2. Inherrit from LogosStorageDistTest or AutoBootstrapDistTest.
3. When using LogosStorageDistTest:
   1. You must start your own Codex bootstrap node. You can use AddLogosStorage(...) for this.
   2. When you start other Logos Storage nodes with AddLogosStorage(...) you can pass the bootstrap node by adding the .WithBootstrapNode(...) option.
4. When using AutoBootstrapDistTest:
   1. The test-infra creates the bootstrap node for you, and automatically passes it to each Logos Storage node you create in your tests. Handy for keeping your tests clean and to-the-point.
   2. When using the auto-bootstrap, you have no control over the bootstrap node from your tests. You can't (for example) shut it down during the course of the test. If you need this level of control for your scenario, use the LogosStorageDistTest instead.
5. If your test needs a long time to run, add the [UseLongTimeouts] function attribute. This will greatly increase maximum time-out values for operations like for example uploading and downloading files.

Continuous tests

1. Add new code files to Tests/LogosStorageContinuousTests/Tests
2. Inherrit from ContinuousTest
3. Define one or more methods and decorate them with the [TestMoment(...)] attribute.
4. The TestMoment takes a number of seconds as argument. Each moment will be executed by the continuous test runner applying the given seconds as delay. (Non-cumulative. So two moments at T:10 will be executed one after another without delay, in this case the order of execution should not be depended upon.)
5. Continuous tests automatically receive access to the Logos Storage nodes that the tests are being run against.
6. Additionally, Continuous tests can start their own transient Logos Storage nodes and bootstrap them against the persistent nodes.

Tips for either type of test

1. You can generate files of random test data by calling GenerateTestFile(...).
2. You can enable access to the Logos Storage node metrics by adding the option .EnableMetrics(). Enabling metrics will make the test-infra download and save all Logos Storage metrics in case of a test failure. (The metrics are stored as CSV, in the same location as the test log file.)
3. You can enable access to the blockchain marketplace by adding the option .EnableMarketplace(...).
4. Enabling metrics and/or enabling the marketplace takes extra resources from the test-infra and increases the time needed during Logos Storage node setup. Please don't enable these features unless your tests need them.
5. Tip: Logos Storage nodes can be named. Use the option WithName(...) and make reading your test logs a little nicer!
6. Tip: Commit often.

Don't forget

1. Once you're happy with your tests, please create a pull-request and ask a Logos Storage core contributor to review your changes.