135N/A

2727N/ACopyright (c) 2007, 2012, Oracle and/or its affiliates. All rights reserved.

135N/A

135N/A

135N/A 1. Summary

135N/A

135N/A The global test target, i.e. "make test", should be executed prior to

135N/A requesting code review and prior to integration. That target invokes

548N/A run.py in this directory.

548N/A

548N/A run.py drives the execution of our api and cli test suites, and

548N/A compares the results to a baseline file stored in baseline.txt.

548N/A

548N/A run.py can also be run standalone with a variety of options:

135N/A

2783N/A Usage: run.py [-ghptv] [-c format] [-b filename] [-o regexp]

2783N/A run.py [-hptvx] [-c format] [-b filename] [-s regexp] [-o regexp]

2783N/A -a <dir> Archive failed test cases to <dir>/$pid/$testcasename

2783N/A -b <filename> Baseline filename

2783N/A -c <format> Collect code coverage data in xml or html format

2783N/A -d Show debug output, including commands run, and outputs

2783N/A -f Show fail/error information even when test is expected to fail

548N/A -g Generate result baseline

548N/A -h This help message

2783N/A -j Parallelism

2783N/A -o <regexp> Run only tests that match regexp

548N/A -p Parseable output format

2783N/A -q Quiet output

2783N/A -s <regexp> Run tests starting at regexp

2783N/A -t Generate timing info file

2783N/A -u Enable IPS GUI tests, disabled by default

548N/A -v Verbose output

2783N/A -x Stop after the first baseline mismatch

2783N/A -z <port> Lowest port the test suite should use

548N/A

548N/A When adding, removing, or changing the results of test cases, make

548N/A sure to update baseline.txt and check it in. This can be done with the

548N/A -g option to run.py.

135N/A

1513N/A The code coverage collection is done with Ned Batchelder's "coverage.py"

1513N/A tool [1].

1513N/A

2727N/A 2. References

135N/A

1513N/A [1] N. Batchelder, coverage module, 2009.

1513N/A http://nedbatchelder.com/code/coverage/