embark/site/source/docs/contracts_testing.md

363 lines
13 KiB
Markdown
Raw Permalink Normal View History

2019-04-18 10:33:52 +00:00
title: Testing Smart Contracts
layout: docs
---
Testing is a crucial part of developing robust and high-quality software. That's why Embark aims to make testing our Smart Contract as easy as possible. In this guide we'll explore Embark specific testing APIs and how to write tests for our Smart Contracts.
## Creating tests
Test files resides in a project's `test` folder. Any JavaScript file within `test/` is considered a spec file and will be executed by Embark as such. A spec file contains test specs which are grouped in `contract()` functions. A single spec is written using `it()` blocks.
2019-04-18 10:33:52 +00:00
Here's what such a test could look like:
```
contract('SomeContract', () => {
it('should pass', () => {
assert.ok(true);
});
});
```
This is a single test spec which will always pass. We're using a globally available `assert` object to make assertions in our specs. If you're familiar with the [Mocha testing framework](https://mochajs.org), this syntax might be familiar. In fact, Embark uses Mocha as a test runner behind the scenes.
`contract()` is just an alias for Mocha's `describe()` function and is globally available. In general, global functions and objects are:
- `contract()`: Same as Mocha's `describe`
- `config()`: Function to configure Embark and deploy contracts
2019-04-18 10:33:52 +00:00
- `web3`: Web3 object
- `assert`: Node's assert
- Mocha functions: `describe()`, `it()`, `before()`, etc.
### Importing EmbarkJS
If we want to use any of EmbarkJS' APIs, we can require it as expected:
```
const EmbarkJS = require('Embark/EmbarkJS');
```
For more information on EmbarkJS's APIs, head over to [this guide](/docs/javascript_usage.html).
## Running tests
Once we've written our tests, we can execute them using Embark's `test` command:
```
$ embark test
```
As mentioned earlier, this will pick up all files inside the `test/` folder and run them as test files.
### Running test subsets
If we aren't interested in running all tests but only a specific subset, we can specify a test file as part of the `test` command like this:
```
$ embark test test/SomeContract_spec.js
```
### Running tests against a different node
By default, tests are run using an Ethereum simulator ([Ganache](https://www.truffleframework.com/ganache)). We can use the `--node` option to change that behavior. Passing `--node embark` to `embark test` will use the Ethereum node associated with an already running embark process. We can also specify a custom endpoint, for example:
```
$ embark test --node ws://localhost:8556
```
### Outputting gas cost details
When running tests, we can even get an idea of what the gas costs of our Smart Contract deployments are. Embark comes with a `--gasDetails` option that makes this possible.
```
$ embark test --gasDetails
```
## Test environment
When running tests, the default [environment}(/docs/environments.html) is `test`. You can obviously change this using the `--env` flag.
The special thing with the `test` environment is that if you do not have a `test` section in your module configuration, that module with be disabled (`enabled: false`). This is done to speed up the test as if you don't need a module, it is disabled.
2019-04-18 10:33:52 +00:00
## Configuring Smart Contracts for tests
Very similar to how we [configure our Smart Contracts](/docs/contracts_configuration.html) for deployment, we have to configure them for our tests as well. This is important, so that our Smart Contracts get deployed with the correct testing data.
2019-04-18 10:33:52 +00:00
To do that, Embark adds a global `config()` function to the execution context, which uses the same API as the configuration object for our application's Smart Contracts. So if we had a `SomeContract` that should be picked up for deployment, this is what the configuration would look like:
```
config({
contracts: {
deploy: {
SomeContract: {} // options as discussed in Smart Contract configuration guide
}
2019-04-18 10:33:52 +00:00
}
});
contract('SomContract', () => {
...
});
```
One thing that's important to note here is that, behind the scenes, Embark has to run `config()` first to deploy the Smart Contracts and only **then** starts running tests. This will have an impact on the developer experience when importing Smart Contract instances within spec files. But more on that later.
{% notification info 'A note on config()' %}
The global `config()` function is used for Smart Contract deployment and therefore delays the execution of tests until deployment is done.
{% endnotification %}
## Accessing Smart Contract instances
To write meaningful tests, we obviously want to interact with our Smart Contracts. As we know, [Embark generates Smart Contract instances](/docs/javascript_usage.html#Embark-Artifacts) for us. All we have to do is importing and using them accordingly.
The following code imports `SomeContract` and calls an imaginary method on it inside a spec:
```
const SomeContract = require('EmbarkJS/contracts/SomeContract');
config({
contracts: {
deploy: {
SomeContract: {}
}
2019-04-18 10:33:52 +00:00
}
});
contract('SomeContract', () => {
it('should do something', async () => {
const result = await SomeContract.methods.doSomething.call();
assert.equal(result, 'foo');
});
});
```
There's one gotcha to keep in mind though. Looking at the snippet above, it seems like we can use `SmartContract` right away once it is imported. However, this is not actually true. As mentioned earlier, Embark first has to actually deploy our Smart Contracts and until that happens, all imported Smart Contract references are empty objects.
This is not a problem anymore when using Smart Contract instances inside spec blocks, because we know that tests are executed after all Smart Contracts have been deployed. Embark will hydrate the imported references with actual data before the tests are run.
{% notification info 'Smart Contract reference hydration' %}
Smart Contract references imported from EmbarkJS are empty until the Smart Contract are actually deployed. This means Smart Contract references can only be used inside `contract()` blocks.
{% endnotification %}
## Configuring accounts
Accounts within the testing environment can be configured [just like we're used to](/docs/contracts_deployment.html). The same rules apply here, and [configuring an Ether balance](/docs/contracts_deployment.html#Configuring-account-balance-for-development) is supported as well. Configuring custom accounts in tests is especially useful if we want to use a specific account for our tests.
2019-04-18 10:33:52 +00:00
```
config({
blockchain: {
2019-04-18 10:33:52 +00:00
accounts: [
{
privateKeyFile: 'path/to/file',
balance: '42 shannon'
}
]
}
});
```
## Accessing Accounts
Obviously, we want to access all configured accounts as well. Sometimes we want to test functions or methods that require us to specify a `from` address to send transactions from. For those cases we very likely want to access any of our our available accounts.
All available accounts are emitted by `config()` and can be accessed using a callback parameter like this:
```
let accounts = [];
config({
...
}, (err, accounts) => {
accounts = accounts;
});
```
You can also grab the accounts from the callback of the `contract()` function (`describe` alias):
```
contract('SomeContract', (accounts) => {
const myAccounts = accounts[0];
it('should do something', async () => {
...
});
});
```
2019-04-18 10:33:52 +00:00
## Connecting to a different node
By default, Embark will use an internal VM to run the tests. However we can also specify a node to connect to and run the tests there, using the `host`, `port` and `type` options as shown below:
```
config({
blockchain: {
"endpoint": "http://localhost:8545"
2019-04-18 10:33:52 +00:00
}
});
```
## Configuring modules
You can configure the different Embark modules directly in your test file. The available modules are: [storage](/docs/storage_configuration.html), [namesystem](/docs/naming_configuration.html) and [communication](/docs/messages_configuration.html).
All configuration options for the respective modules are available. Also, the configurations you put inside the `config` function are merged inside the ones that are in the configuration file (meaning that you don't have to put all the provider options if they are already in the default configs).
```
config({
storage: {
enabled: true
},
communication: {
enabled: true
},
namesystem: {
enabled: true,
register: {
rootDomain: "test.eth"
}
}
});
```
If the module is not started (eg. IPFS), Embark will start it for you.
2019-04-18 10:33:52 +00:00
## Manually deploying Smart Contracts
As mentioned earlier, Embark handles the deployment of our Smart Contracts using the function `config()` function. If we wish to deploy particular Smart Contracts manually, we can do so using an imported Smart Contract reference. We just need to make sure that we're doing this inside a `contract()` block as discussed earlier:
```
const SimpleStorage = require('Embark/contracts/SimpleStorage');
contract('SimpleStorage Deploy', () => {
let SimpleStorageInstance;
before(async function() {
SimpleStorageInstance = await SimpleStorage.deploy({ arguments: [150] }).send();
});
it('should set constructor value', async () => {
let result = await SimpleStorageInstance.methods.storedData().call();
assert.strictEqual(parseInt(result, 10), 150);
});
});
```
## Util functions
### assert.reverts
Using `assert.reverts`, you can easily assert that your transaction reverts.
```javascript
await assert.reverts(contractMethodAndArguments[, options][, message]);
```
- `contractMethodAndArguments`: [Function] Contract method to call `send` on, including the arguments
- `options`: [Object] Optional options to pass to the `send` function
- `message`: [String] Optional string to match the revert message
Returns a promise that you can wait for with `await`.
```javascript
it("should revert with a value lower than 5", async function() {
await assert.reverts(SimpleStorage.methods.setHigher5(2), {from: web3.eth.defaultAccount},
'Returned error: VM Exception while processing transaction: revert Value needs to be higher than 5');
});
```
### assert.eventEmitted
Using `eventEmitted`, you can assert that a transaction has emitted an event. You can also check for the returned values.
```javascript
assert.eventEmitted(transaction, event[, values]);
```
- `transaction`: [Object] Transaction object returned by a `send` call
- `event`: [String] Name of the event being emitted
- `values`: [Array or Object] Optional array or object of the returned values of the event.
- Using array: The order of the values put in the array need to match the order in which the values are returned by the event
- Using object: The object needs to have the right key/value pair(s)
```javascript
it('asserts that the event was triggered', async function() {
const transaction = await SimpleStorage.methods.set(100).send();
assert.eventEmitted(transaction, 'EventOnSet', {value: "100", success: true});
});
```
### increaseTime
This function lets you increase the time of the EVM. It is useful in the case where you want to test expiration times for example.
```javascript
await increaseTime(amount);
```
- `amount`: [Number] Number of seconds to increase
```javascript
it("should have expired after increasing time", async function () {
await increaseTime(5001);
const isExpired = await Expiration.methods.isExpired().call();
assert.strictEqual(isExpired, true);
});
```
### mineAtTimestamp
This function mines a block and sets its `block.timestamp` accordingly. It let's you mine in the future.
```javascript
await mineAtTimestamp(timestamp);
```
`timestamp`: [Number] Timestamp when to mine the block
### getEvmVersion
`getEvmVersion` returns the version and type of EVM.
It is useful if you want to make sure the EVM has the sufficient version to support an RPC call or if you want to make sure that you are using a VM like Ganache-CLI before making a call that only a VM supports.
```javascript
await getEvmVersion();
```
Returns a string, eg: `EthereumJS TestRPC/v2.9.2/ethereum-js`
### evmMethod
If there are EVM methods that are not supported by the web3 library you use, Embark exposes the global function `evmMethod` that lets you call the RPC method directly.
#### Syntax
`evmMethod(rpcMethodName, parameters)`
- `rpcMethodName`: [string] Name of the RPC method to call.
- `parameters`: [Array<any>] Optional array of parameters, as specified by the RPC method API.
#### Usage
For example, let's say you are using `web3.js` in your tests, but would like to call the `eth_signTypedData` RPC method. Because `web3.js` does not support this method, it won't be possible to use `web3.js` for this call. Instead, we can call the `eth_signTypedData` RPC method in our tests using the global `evmMethod` function:
```javascript
const signature = await evmMethod("eth_signTypedData", [
accounts[0],
data
]);
```
2019-04-18 10:33:52 +00:00
## Code coverage
Embark allows you to generate a coverage report for your Solidity Smart Contracts by passing the `--coverage` option on the `embark test` command.
```
$ embark test --coverage
```
The generated report looks something like this:
![Coverage Report: Files](/coverage-files.png)
This gives us a birds-eye view on the state of the coverage of our Smart Contracts: how many of the functions were called, how many lines were hit, even whether all the branch cases were executed. When selecting a file, a more detailed report is produced. Here's what it looks like:
![Coverage Report: Detailed](/coverage-report.png)