151 lines
4.4 KiB
Plaintext
151 lines
4.4 KiB
Plaintext
Cypress based test framework for LibreOffice Online
|
|
====================================================
|
|
|
|
|
|
Installation
|
|
------------------
|
|
|
|
You need to have run configure with the --enable-cypress option.
|
|
|
|
In a normal desktop environment you only need to install npm
|
|
packages for running cypress tests. This is done by the build
|
|
system, so running 'make check' will do the basic installation.
|
|
https://docs.cypress.io/guides/getting-started/installing-cypress.html#npm-install
|
|
|
|
For CI you might need to install some additional dependencies:
|
|
https://docs.cypress.io/guides/guides/continuous-integration.html#Dependencies
|
|
|
|
|
|
Running tests
|
|
------------------
|
|
|
|
All tests are part of the make check build. So you can
|
|
just execute it from the root folder or under the
|
|
cypress_test folder to run cypress tests only.
|
|
|
|
make check
|
|
|
|
IMPORTANT: Before stepping under cypress_test folder
|
|
and running any command listed here, make sure you've
|
|
done a top-level make, so everything is up-to-date.
|
|
Running commands from under cypress_test folder won't
|
|
trigger a rebuild.
|
|
|
|
To run cypress test cases selectively, you need to
|
|
go in to the cypress_test folder first and run one of
|
|
the following commands.
|
|
|
|
To run all desktop tests:
|
|
|
|
make check-desktop
|
|
|
|
To run all mobile tests:
|
|
|
|
make check-mobile
|
|
|
|
To run one specific test suite of desktop tests,
|
|
use spec argument with a relative path to
|
|
cypress_test/integration_tests/desktop/:
|
|
|
|
make check-desktop spec=writer/form_field_spec.js
|
|
|
|
To run one specific test suite of mobile tests,
|
|
use spec argument with a relative path to
|
|
cypress_test/integration_tests/mobile/:
|
|
|
|
make check-mobile spec=writer/toolbar_spec.js
|
|
|
|
|
|
Running one specific test
|
|
------------------
|
|
|
|
To run one test case of a test suite you can use Mocha's
|
|
'only' feature. Just replace the it(...) function with
|
|
it.only(...) in the spec file for the selected test case
|
|
and run the test suite using the spec parameter.
|
|
|
|
For example, to run the test with title 'Apply font name.'
|
|
inside apply_font_spec.js file, you need to add it.only():
|
|
|
|
- it('Apply font name.', function() {
|
|
+ it.only('Apply font name.', function() {
|
|
|
|
Then run the test suite with:
|
|
|
|
make check-mobile spec=writer/apply_font_spec.js
|
|
|
|
Or open the test suite in the interactive test runner:
|
|
|
|
make run-mobile spec=writer/apply_font_spec.js
|
|
|
|
Openning interactive test runner
|
|
----------------------------------
|
|
|
|
Cypress has an interactive test runner application which
|
|
runs the test in the browser. So you can see the result of
|
|
the different steps your test makes in the browser. It's useful
|
|
during writing new tests or checking why an existing
|
|
test fails.
|
|
https://docs.cypress.io/guides/core-concepts/test-runner.html
|
|
|
|
To open desktop tests in the test runner:
|
|
|
|
make run-desktop
|
|
|
|
To open mobile tests in the test runner:
|
|
|
|
make run-mobile
|
|
|
|
To open one specific test suite of desktop tests,
|
|
use spec argument with a relative path to
|
|
cypress_test/integration_tests/desktop/:
|
|
|
|
make run-desktop spec=writer/form_field_spec.js
|
|
|
|
To open one specific test suite of mobile tests,
|
|
use spec argument with a relative path to
|
|
cypress_test/integration_tests/mobile/:
|
|
|
|
make run-mobile spec=writer/toolbar_spec.js
|
|
|
|
During the build we run the tests with Chrome browser, so make sure
|
|
you select Chrome browser on the GUI while checking tests.
|
|
We are using different configuration and environment variables for
|
|
mobile and desktop tests, that's why there are two separate commands
|
|
for them and there is no option to open all the tests in the
|
|
test runner.
|
|
|
|
Known issues
|
|
------------
|
|
|
|
1. Different builddir and sourcedir with symlinks.
|
|
|
|
Cypress has an issue with symlinks:
|
|
https://github.com/cypress-io/cypress/issues/3482
|
|
|
|
We use the related feature only when the build directory
|
|
is different from the source directory. So to avoid this
|
|
issue with the supportFile, you should build in the source
|
|
directory or you should avoid symlinks in the path of the
|
|
build directory.
|
|
|
|
Code coverage
|
|
------------
|
|
|
|
We use nyc to instrument the code and then cypress code coverage
|
|
plugin is used to generate coverage numbers. This workflow
|
|
is called by the following command:
|
|
|
|
make run-cov
|
|
|
|
The output is put under cypress_test/covarage folder.
|
|
Open the cypress_test/covarage/lcov-report/index.html
|
|
file to get the summary report.
|
|
|
|
The make command above touches the source files under
|
|
loleaflet/dist/src folder, so after testing the coverage
|
|
doing a clean build is a good idea (e.g. make clean).
|
|
|
|
See also this link:
|
|
https://docs.cypress.io/guides/tooling/code-coverage.html
|