react-native-firebase/docs/contributing/testing.md

11 KiB

Testing

Currently due to the blackbox Firebase enviroment, we have found the best way to test the library is to directly test against the library using a live Firebase project. As some modules also work with the offical web SDK, we can directly compare the results against our own library. This is however restrictive as it doesn't directly test the native code/modules. Plans are in place to overhaul the entire testing setup.

## Running the test app

For convenience all of the required NPM scripts are packaged with the main library to run the test app.

Step 1 - Fork & Clone

git clone git@github.com:<username>/react-native-firebase.git

Step 2 - Install dependencies

npm run tests-npm-install

Step 3 - Install WML

WML is a library which copies files & directories to a location. This allows us to copy any changes from the library directly into the tests app, so we can quickly test changes.

npm install -g wml

Step 4 - Start the watcher

npm run tests-watch-init
npm run tests-watch-start

### Step 5 - Start the app

npm run tests-packager

Android

Open the tests/android directory from Android Studio and allow Gradle to sync. Now run the app on an emulator/device.

#### iOS

First install the Pods:

npm run tests-pod-install

Open the tests/ios/ReactNativeFirebaseDemo.xcworkspace file in XCode and build for your preffered device or simulator.

Tests

Tests are bootstrapped and ran when the play button is pressed. The status of each test suite and individual test will update as and when a test has completed or errored.

Running tests

Tests can be run by pressing the play button in the toolbar of the app. Test can be run individually, by suite, or all at once.

Test suite Android

Adding test

To add tests to an existing test suite, you need to pass a function to addTests.

Synchronous tests

Synchronous tests are created by passing a function to it. The next test is run immediately after the last line is executed.

testSuite.addTests(({ describe, it }) => {
    describe('synchronous test', () => {

      it('does something correctly', () => {

      });

    });
});

Asynchronous tests

Tests can be asynchronous if they return a promise. The test suite waits for the promise to resolve before executing the next test.

testSuite.addTests(({ describe, it }) => {
    describe('async successful test', () => {

      it('does something correctly', () => {
        return new Promise((resolve, reject) => {
          // ...
          resolve();
        });
      });

    });
});

Asynchronous tests can also be created using the async function syntax:

testSuite.addTests(({ describe, it }) => {
    describe('async successful test', () => {

      it('does something correctly', async () => {
        // ...

        await somethingAsynchronous();
      });

    });
});

When rejecting, always ensure a valid JavaScript Error is provided.

Creating a new test suite

A test suite groups together test categories under the same Firebase feature. e.g. Realtime Database tests.

To add a new test suite:

  1. Create a new directory within src/tests.
  2. Create an index.js file.

In this file, you need to create an instance of TestSuite - see TestSuite constructor.

import TestSuite from 'lib/TestSuite';

const MyNewSuite = new TestSuite('Realtime Database Storage', 'Upload/Download storage tests');

export default MyNewSuite;
  1. addTests is then used as many times as is necessary to add tests to the test suite, accepting a function that defines one or more tests.
  2. The test suite must then be imported into src/tests/index.js and added to testSuiteInstances in order for it to be included in the list of test suites available to run in the app.

TestSuite API

TestSuite Constructor

The TestSuite constructor accepts 3 arguments:

  • name: String containing the name of the test suite. e.g. 'Realtime Storage'
  • description: String containing description of the test suite
  • firebase: This is the object exported from src/firebase and contains both the native and web firebase instances.
import firebase from '../firebase';

new TestSuite('Realtime Database Storage', 'firebase.database()', firebase);

Test Definition

describe()

The describe() function takes 2 - 3 arguments:

  • description: String describing the context or target of all the tests defined in testDefinitions
  • options: (Optional) object of options:
    • focus: Boolean marking all the tests defined in testDefinitions (and any others marked as focused) as the only one(s) that should run
    • pending: Boolean marking all the tests defined in testDefinitions as excluded from running in the test suite
  • testDefinitions: Function that defines 1 or more tests by calling it, xit or fit
function testCategory({ describe }) {

  describe('a feature', () => {
    it('does something synchronously', () => {

    });

  });
}

export default testCategory;

describe() statements can be arbitrarily nested.

context()

context() is an alias for describe() provided as syntactical sugar. xcontext() and fcontext() work similar to xdescribe() and fdescribe(), respectively.

it()

The it() function takes 2 - 3 arguments:

  • description: String describing the test defined in testDefinition
  • options: (Optional) object of options:
    • focus: Boolean marking the test defined in testDefinition (and any others marked as focused) as the only one(s) that should run
    • pending: Boolean marking the test defined in testDefinition as excluded from running in the test suite
    • timeout: Time in milliseconds a test is allowed to execute before it's considered to have timed out. Default is 5000ms (5 seconds).
  • testDefinition: Function that defines a test with one or more assertions. Can be a synchronous or asynchronous function. Functions that return a promise cause the test environment to wait for the promise to be resolved before proceding to the next test.
it('does something synchronously', () => {

});

it('does something asynchronously', async () => {

});

it('does something else asynchronously', () => {
    return new Promise(/* ... */);
});

it() statements can not be nested.

xdescribe() & xit()

Pending Tests

You can mark all tests within a describe statement as pending by using the xdescribe function instead. The test will appear greyed out and will not be run as part of the test suite.

You can mark a single test as pending by using xit as you would it.

Tests should only be marked as pending temporarily, and should not normally be committed to the test suite unless they are fully implemented.

fdescribe() & fit()

Focused Tests

You can mark all tests within a describe statement as focused by using the fdescribe function instead. Tests that are focused will be the only ones that appear and run in the test suite until all tests are removed from being focused. This is useful for running and working on a few tests at a time.

You can mark a single test as focused by using fit as you would it.

Test Assertions

The assertion library Should.js is used in the tests. The complete list of available assertions is available in the Should.js documentation.

Lifecycle methods

Four lifecycle methods are provided for each test context:

  • before - Run once, before the current test context executes
  • beforeEach - Run before every test in the current test context
  • after - Run once, after the current test context has finished executing
  • afterEach - Run after every test in the current test context

A new test context is created when the test suite encounters any of describe, xdescribe, fdescribe, context, xcontext or fcontext, and close again when it reaches the end of the block. Test contexts can be nested and lifecycle hooks set for parent contexts apply for all descendents.

Each lifecycle hook accepts either a synchronous function, a function that returns a promise or an async function.

function testCategory({ before, beforeEach, afterEach, after }) {

  before(() => console.log('Before all tests start.'));
  beforeEach(() => console.log('Before every test starts.'));

  describe('sync successful test', function() {
    // ...
  });

  afterEach(() => console.log('After each test starts.'));
  after(() => console.log('After all tests are complete, with success or error.'));
}

An optional hash of options can also be passed as the first argument, defining one or more of the following values:

  • timeout: Time in milliseconds a hook is allowed to execute before it's considered to have timed out. Default is 5000ms (5 seconds).

Accessing Firebase

react-native-firebase is available firebase.native:

function testCategory({ describe, firebase }) {

  describe('sync successful test', 'category', function() {
    firebase.native.database();
  });
}

If you need to access the web API for Firebase to compare with the functionality of react-native-firebase, you can access it on firebase.web.

All tests should be written in terms of react-native-firebase's behaviour and should not include direct comparisons with the web API. It's available for reference, only.

Development Notes

JavaScript changes do not require restarting the React Native packager to take effect

Java changes will need to be rebuilt in Android Studio

Objective-C changes need to be rebuilt in Xcode

Debugging or viewing internals of the test suite

react-native-firebase/tests is compatible with react-native-debugger and is the recommended way to view the internal state of the test suite for development or troubleshooting.

It allows you to view state and prop values of the React component tree, view the actions and contents of the Redux store and view and interact with the debugging console.

Make sure Remote JS Debugging when running the application and close any chrome debugging windows that appear and start React Native Debugger.

Running the internal tests

react-native-firebase-tests has its own tests to verify the testing framework is working as expected. These are run from the command line:

npm run internal-tests

Troubleshooting

Invalid React.podspec file: no implicit conversion of nil into String

This error occurs if you are using ruby version 2.1.2. Upgrade your version of ruby and try again.

Unable to resolve module ../../../node_modules/react-native/packager/...

Run the packager separately, clearing the cache:

npm start -- --reset-cache