8.6 KiB
Adding Tests to the project
This document explains a bit about our testing infrastructure, and how you can contribute tests to go with changes to the codebase.
Overview
The tests we have in the repository are found under app/test and are organized
into these subdirectories:
unit- unit tests for small parts of the codebase. This currently makes up the majority of our tests.- the subdirectories defined here are intended to match layout of the
app/src/directory, but this has not been rigorously defined and will be affected by our plans in #5645 to evolve the source layout
- the subdirectories defined here are intended to match layout of the
integration- these tests are for end-to-end testing of the application
Other important folders:
fixtures- this folder contains Git repositories which can be used in testshelpers- modules containing logic to help setup, manage and teardown tests__mocks__- this is a special Jest folder that contains mocks for Electron APIs, which are only stubbed out when tests require it
Adding Unit Tests
Unit tests are ideal for functions that don't depend on the DOM or Electron APIs, so if you are working on some code that will benefit from writing tests here is a guide to getting this working.
First , check under app/test/unit for an existing test module related to the
area you are working in - we want to ensure each test module corresponds to a
specific application module.
Creating a new test module
If no test module exists, create a new file named [app-module]-test.ts where
[app-module] is the filename of the application module you are working in.
Start with this for the contents of the file:
describe('module being tested', () => {
it('can test some code', () => {
expect(true).toEqual(false)
})
})
If you run yarn test:unit from a shell you should see this error, which
indicates the file is loaded into our Jest runner successfully.
Once you're happy that the test is being run, feel free to write some proper tests to exercise your work.
Adding tests to a test module
Feel free to borrow ideas from our current test suite, but here are some guidelines to help you figure out what to test.
- focus on a specific module or function when writing unit tests - complex unit tests are a sign that the code isn't organized in an ideal way for testing
- write tests to cover the scenarios you think we should care about
- keep tests simple and easy to read - code comments shouldn't be necessary
- if you're not confident in writing tests, the Arrange-Act-Assert pattern is a nice way to get started
As you're writing your tests, don't forget to yarn test:unit to verify that
your tests are working as expected.
Transitioning to Jest
For historical reasons, we currently have a mix of chai and jest assertions
floating around. This is because we were previously using electron-mocha to
run these tests, which didn't provide a built-in assertion library.
If you open a PR that updates a test module, the reviewer may ask you to also
update the test module to deprecate the use of chai in existing tests.
The easiest way to do this is to remove the line that looks like this:
import { expect } from 'chai'
This will then trigger a number of compiler errors, which should be easy to update to the relevant built-in assertions.
Here's an example of the changes to a recent PR:
commit c1e5868a95ca0bebee8176d49f6c1401c549ab43
Author: Brendan Forster <github@brendanforster.com>
Date: Tue Oct 23 17:11:14 2018 -0300
port tests over to use jest builtin
diff --git a/app/test/unit/repository-matching-test.ts b/app/test/unit/repository-matching-test.ts
index 35fddfb44..f8edbd741 100644
--- a/app/test/unit/repository-matching-test.ts
+++ b/app/test/unit/repository-matching-test.ts
@@ -1,5 +1,3 @@
-import { expect } from 'chai'
-
import {
matchGitHubRepository,
urlMatchesRemote,
@@ -18,8 +16,8 @@ describe('repository-matching', () => {
accounts,
'https://github.com/someuser/somerepo.git'
)!
- expect(repo.name).to.equal('somerepo')
- expect(repo.owner).to.equal('someuser')
+ expect(repo.name).toEqual('somerepo')
+ expect(repo.owner).toEqual('someuser')
})
it('matches HTTPS URLs without the git extension', () => {
@@ -30,8 +28,8 @@ describe('repository-matching', () => {
accounts,
'https://github.com/someuser/somerepo'
)!
- expect(repo.name).to.equal('somerepo')
- expect(repo.owner).to.equal('someuser')
+ expect(repo.name).toBe('somerepo')
+ expect(repo.owner).toBe('someuser')
})
it('matches git URLs', () => {
@@ -42,8 +40,8 @@ describe('repository-matching', () => {
accounts,
'git:github.com/someuser/somerepo.git'
)!
- expect(repo.name).to.equal('somerepo')
- expect(repo.owner).to.equal('someuser')
+ expect(repo.name).toBe('somerepo')
+ expect(repo.owner).toBe('someuser')
})
it('matches SSH URLs', () => {
@@ -54,8 +52,8 @@ describe('repository-matching', () => {
accounts,
'git@github.com:someuser/somerepo.git'
)!
- expect(repo.name).to.equal('somerepo')
- expect(repo.owner).to.equal('someuser')
+ expect(repo.name).toBe('somerepo')
+ expect(repo.owner).toBe('someuser')
})
it(`doesn't match if there aren't any users with that endpoint`, () => {
@@ -74,7 +72,7 @@ describe('repository-matching', () => {
accounts,
'https://github.com/someuser/somerepo.git'
)
- expect(repo).to.equal(null)
+ expect(repo).toBeNull()
})
})
@@ -90,27 +88,27 @@ describe('repository-matching', () => {
}
it('does not match null', () => {
- expect(urlMatchesRemote(null, remoteWithSuffix)).is.false
+ expect(urlMatchesRemote(null, remoteWithSuffix)).toBe(false)
})
it('matches cloneURL from API', () => {
const cloneURL = 'https://github.com/shiftkey/desktop.git'
- expect(urlMatchesRemote(cloneURL, remoteWithSuffix)).is.true
+ expect(urlMatchesRemote(cloneURL, remoteWithSuffix)).toBe(true)
})
it('matches cloneURL from API without suffix', () => {
const cloneURL = 'https://github.com/shiftkey/desktop.git'
- expect(urlMatchesRemote(cloneURL, remote)).is.true
+ expect(urlMatchesRemote(cloneURL, remote)).toBe(true)
})
it('matches htmlURL from API', () => {
const htmlURL = 'https://github.com/shiftkey/desktop'
- expect(urlMatchesRemote(htmlURL, remoteWithSuffix)).is.true
+ expect(urlMatchesRemote(htmlURL, remoteWithSuffix)).toBe(true)
})
it('matches htmlURL from API without suffix', () => {
const htmlURL = 'https://github.com/shiftkey/desktop'
- expect(urlMatchesRemote(htmlURL, remote)).is.true
+ expect(urlMatchesRemote(htmlURL, remote)).toBe(true)
})
})
@@ -120,16 +118,16 @@ describe('repository-matching', () => {
url: 'git@github.com:shiftkey/desktop.git',
}
it('does not match null', () => {
- expect(urlMatchesRemote(null, remote)).to.be.false
+ expect(urlMatchesRemote(null, remote)).toBe(false)
})
it('matches cloneURL from API', () => {
const cloneURL = 'https://github.com/shiftkey/desktop.git'
- expect(urlMatchesRemote(cloneURL, remote)).to.be.true
+ expect(urlMatchesRemote(cloneURL, remote)).toBe(true)
})
it('matches htmlURL from API', () => {
const htmlURL = 'https://github.com/shiftkey/desktop'
- expect(urlMatchesRemote(htmlURL, remote)).to.be.true
+ expect(urlMatchesRemote(htmlURL, remote)).toBe(true)
})
})
})
@@ -181,13 +179,13 @@ describe('repository-matching', () => {
'https://github.com/shiftkey/desktop.git',
repository
)
- ).is.true
+ ).toBe(true)
})
it(`returns true when URL doesn't have a .git suffix`, () => {
expect(
urlMatchesCloneURL('https://github.com/shiftkey/desktop', repository)
- ).is.true
+ ).toBe(true)
})
it(`returns false when URL belongs to a different owner`, () => {
@@ -196,7 +194,7 @@ describe('repository-matching', () => {
'https://github.com/outofambit/desktop.git',
repository
)
- ).is.false
+ ).toBe(false)
})
it(`returns false if GitHub repository does't have a cloneURL set`, () => {
@@ -205,7 +203,7 @@ describe('repository-matching', () => {
'https://github.com/shiftkey/desktop',
repositoryWithoutCloneURL
)
- ).is.false
+ ).toBe(false)
})
})
})