11 KiB
Testing
Currently due to the blackbox Firebase enviroment, we have found the best way to test the library is to directly test against the library using a live Firebase project. As some modules also work with the offical web SDK, we can directly compare the results against our own library. This is however restrictive as it doesn't directly test the native code/modules. Plans are in place to overhaul the entire testing setup.
## Running the test app
For convenience all of the required NPM scripts are packaged with the main library to run the test app.
Step 1 - Fork & Clone
git clone git@github.com:<username>/react-native-firebase.git
Step 2 - Install dependencies
npm run tests-npm-install
Step 3 - Install WML
WML is a library which copies files & directories to a location. This allows us to copy any changes from the library directly into the tests app, so we can quickly test changes.
npm install -g wml
Step 4 - Start the watcher
npm run tests-watch-init
npm run tests-watch-start
### Step 5 - Start the app
npm run tests-packager
Android
Open the tests/android
directory from Android Studio and allow Gradle to sync. Now run the app on an emulator/device.
#### iOS
First install the Pods:
npm run tests-pod-install
Open the tests/ios/ReactNativeFirebaseDemo.xcworkspace
file in XCode and build for your preffered device or simulator.
Tests
Tests are bootstrapped and ran when the play
button is pressed. The status of each test suite and individual test will update as and when a test has completed or errored.
Running tests
Tests can be run by pressing the play button in the toolbar of the app. Test can be run individually, by suite, or all at once.
Adding test
To add tests to an existing test suite, you need to pass a function to addTests
.
Synchronous tests
Synchronous tests are created by passing a function to it
. The next test is run immediately after the last line is executed.
testSuite.addTests(({ describe, it }) => {
describe('synchronous test', () => {
it('does something correctly', () => {
});
});
});
Asynchronous tests
Tests can be asynchronous if they return a promise. The test suite waits for the promise to resolve before executing the next test.
testSuite.addTests(({ describe, it }) => {
describe('async successful test', () => {
it('does something correctly', () => {
return new Promise((resolve, reject) => {
// ...
resolve();
});
});
});
});
Asynchronous tests can also be created using the async
function syntax:
testSuite.addTests(({ describe, it }) => {
describe('async successful test', () => {
it('does something correctly', async () => {
// ...
await somethingAsynchronous();
});
});
});
When rejecting, always ensure a valid JavaScript Error is provided.
Creating a new test suite
A test suite groups together test categories under the same Firebase feature. e.g. Realtime Database tests.
To add a new test suite:
- Create a new directory within
src/tests
. - Create an
index.js
file.
In this file, you need to create an instance of TestSuite
- see TestSuite constructor.
import TestSuite from 'lib/TestSuite';
const MyNewSuite = new TestSuite('Realtime Database Storage', 'Upload/Download storage tests');
export default MyNewSuite;
addTests
is then used as many times as is necessary to add tests to the test suite, accepting a function that defines one or more tests.- The test suite must then be imported into
src/tests/index.js
and added totestSuiteInstances
in order for it to be included in the list of test suites available to run in the app.
TestSuite API
TestSuite Constructor
The TestSuite constructor accepts 3 arguments:
- name: String containing the name of the test suite. e.g. 'Realtime Storage'
- description: String containing description of the test suite
- firebase: This is the object exported from
src/firebase
and contains both the native and web firebase instances.
import firebase from '../firebase';
new TestSuite('Realtime Database Storage', 'firebase.database()', firebase);
Test Definition
describe()
The describe()
function takes 2 - 3 arguments:
- description: String describing the context or target of all the tests defined in
testDefinitions
- options: (Optional) object of options:
- focus: Boolean marking all the tests defined in
testDefinitions
(and any others marked as focused) as the only one(s) that should run - pending: Boolean marking all the tests defined in
testDefinitions
as excluded from running in the test suite
- focus: Boolean marking all the tests defined in
- testDefinitions: Function that defines 1 or more tests by calling
it
,xit
orfit
function testCategory({ describe }) {
describe('a feature', () => {
it('does something synchronously', () => {
});
});
}
export default testCategory;
describe()
statements can be arbitrarily nested.
context()
context()
is an alias for describe()
provided as syntactical sugar. xcontext()
and fcontext()
work similar to xdescribe()
and fdescribe()
, respectively.
it()
The it()
function takes 2 - 3 arguments:
- description: String describing the test defined in
testDefinition
- options: (Optional) object of options:
- focus: Boolean marking the test defined in
testDefinition
(and any others marked as focused) as the only one(s) that should run - pending: Boolean marking the test defined in
testDefinition
as excluded from running in the test suite - timeout: Time in milliseconds a test is allowed to execute before it's considered to have timed out. Default is 5000ms (5 seconds).
- focus: Boolean marking the test defined in
- testDefinition: Function that defines a test with one or more assertions. Can be a synchronous or asynchronous function. Functions that return a promise cause the test environment to wait for the promise to be resolved before proceding to the next test.
it('does something synchronously', () => {
});
it('does something asynchronously', async () => {
});
it('does something else asynchronously', () => {
return new Promise(/* ... */);
});
it()
statements can not be nested.
xdescribe() & xit()
Pending Tests
You can mark all tests within a describe
statement as pending by using the xdescribe
function instead. The test will appear greyed out and will not be run as part of the test suite.
You can mark a single test as pending by using xit
as you would it
.
Tests should only be marked as pending temporarily, and should not normally be committed to the test suite unless they are fully implemented.
fdescribe() & fit()
Focused Tests
You can mark all tests within a describe
statement as focused by using the fdescribe
function instead. Tests that are focused will be the only ones that appear and run in the test suite until all tests are removed from being focused. This is useful for running and working on a few tests at a time.
You can mark a single test as focused by using fit
as you would it
.
Test Assertions
The assertion library Should.js is used in the tests. The complete list of available assertions is available in the Should.js documentation.
Lifecycle methods
Four lifecycle methods are provided for each test context:
- before - Run once, before the current test context executes
- beforeEach - Run before every test in the current test context
- after - Run once, after the current test context has finished executing
- afterEach - Run after every test in the current test context
A new test context is created when the test suite encounters any of describe
, xdescribe
, fdescribe
, context
, xcontext
or fcontext
, and close again when it reaches the end of the block. Test contexts can be nested and lifecycle hooks set for parent contexts apply for all descendents.
Each lifecycle hook accepts either a synchronous function, a function that returns a promise or an async
function.
function testCategory({ before, beforeEach, afterEach, after }) {
before(() => console.log('Before all tests start.'));
beforeEach(() => console.log('Before every test starts.'));
describe('sync successful test', function() {
// ...
});
afterEach(() => console.log('After each test starts.'));
after(() => console.log('After all tests are complete, with success or error.'));
}
An optional hash of options can also be passed as the first argument, defining one or more of the following values:
- timeout: Time in milliseconds a hook is allowed to execute before it's considered to have timed out. Default is 5000ms (5 seconds).
Accessing Firebase
react-native-firebase
is available firebase.native
:
function testCategory({ describe, firebase }) {
describe('sync successful test', 'category', function() {
firebase.native.database();
});
}
If you need to access the web API for Firebase to compare with the functionality of react-native-firebase
, you can access it on firebase.web
.
All tests should be written in terms of
react-native-firebase
's behaviour and should not include direct comparisons with the web API. It's available for reference, only.
Development Notes
JavaScript changes do not require restarting the React Native packager to take effect
Java changes will need to be rebuilt in Android Studio
Objective-C changes need to be rebuilt in Xcode
Debugging or viewing internals of the test suite
react-native-firebase/tests
is compatible with react-native-debugger and is the recommended way to view the internal state of the test suite for development or troubleshooting.
It allows you to view state and prop values of the React component tree, view the actions and contents of the Redux store and view and interact with the debugging console.
Make sure Remote JS Debugging when running the application and close any chrome debugging windows that appear and start React Native Debugger.
Running the internal tests
react-native-firebase-tests
has its own tests to verify the testing framework is working as expected. These are run from the command line:
npm run internal-tests
Troubleshooting
Invalid React.podspec file: no implicit conversion of nil into String
This error occurs if you are using ruby version 2.1.2. Upgrade your version of ruby and try again.
Unable to resolve module ../../../node_modules/react-native/packager/...
Run the packager separately, clearing the cache:
npm start -- --reset-cache