cairo/test
Carl Worth f8e632ab1e Add initial regression test suite.
Don't AC_SUBST a dozen different FOO_CFLAGS and FOO_LIBS. Instead, incrementally build up just CAIRO_CFLAGS and CAIRO_LIBS.
Don't list flags that should get picked up via dependency information through Requires.
Add description of move_to_show_surface.
2004-10-26 14:38:43 +00:00
..
.cvsignore Add initial regression test suite. 2004-10-26 14:38:43 +00:00
cairo-test.c Add initial regression test suite. 2004-10-26 14:38:43 +00:00
cairo-test.h Add initial regression test suite. 2004-10-26 14:38:43 +00:00
cairo_test.c Add initial regression test suite. 2004-10-26 14:38:43 +00:00
cairo_test.h Add initial regression test suite. 2004-10-26 14:38:43 +00:00
line-width-ref.png Add initial regression test suite. 2004-10-26 14:38:43 +00:00
line-width.c Add initial regression test suite. 2004-10-26 14:38:43 +00:00
line_width-ref.png Add initial regression test suite. 2004-10-26 14:38:43 +00:00
line_width.c Add initial regression test suite. 2004-10-26 14:38:43 +00:00
Makefile.am Add initial regression test suite. 2004-10-26 14:38:43 +00:00
move-to-show-surface-ref.png Add initial regression test suite. 2004-10-26 14:38:43 +00:00
move-to-show-surface.c Add initial regression test suite. 2004-10-26 14:38:43 +00:00
move_to_show_surface-ref.png Add initial regression test suite. 2004-10-26 14:38:43 +00:00
move_to_show_surface.c Add initial regression test suite. 2004-10-26 14:38:43 +00:00
read-png.c Add initial regression test suite. 2004-10-26 14:38:43 +00:00
read-png.h Add initial regression test suite. 2004-10-26 14:38:43 +00:00
read_png.c Add initial regression test suite. 2004-10-26 14:38:43 +00:00
read_png.h Add initial regression test suite. 2004-10-26 14:38:43 +00:00
README Add initial regression test suite. 2004-10-26 14:38:43 +00:00
write-png.c Add initial regression test suite. 2004-10-26 14:38:43 +00:00
write-png.h Add initial regression test suite. 2004-10-26 14:38:43 +00:00
write_png.c Add initial regression test suite. 2004-10-26 14:38:43 +00:00
write_png.h Add initial regression test suite. 2004-10-26 14:38:43 +00:00
xmalloc.c Add initial regression test suite. 2004-10-26 14:38:43 +00:00
xmalloc.h Add initial regression test suite. 2004-10-26 14:38:43 +00:00

Regression test suite for cairo.

Using this test should be as simple as running:

	make check

assuming that the cairo distribution in the directory above has been
configured and built. The test suite here goes through some effort to
run against the locally compiled library rather than any installed
version.

The test suite needs to be run before any code is committed and before
any release. Here are the rules governing the use of the suite:

Before committing
-----------------

All tests should return a result of PASS or XFAIL. The XFAIL results
indicate known bugs. The final message should be one of the following:

	All XX tests behaved as expected (YY expected failures)
	All XX tests passed

If any tests have a status of FAIL, then the new code has caused a
regression error which should be fixed before the code is committed.

When a new bug is found
-----------------------
A new test case should be added by imitating the style of an existing
test. This means adding the following files:

	new_bug.c
	new_bug-ref.png

Where new_bug.c is a minimal program to demonstrate the bug, following
the style of existing tests. The new_bug-ref.png image should contain
the desired result of new_bug.c if the bug were fixed.

Makefile.am should be edited, adding new_bug.c to both the TESTS and
XFAIL_TESTS lists.

When a bug is fixed
-------------------
The fix shold be verified by running the test suite which should
result in an "unexpected pass" for the test of interest. Rejoice as
appropriate, then remove the relevant file name from the XFAIL_TESTS
variable in Makefile.am.

Before releasing
----------------
All tests should return a result of PASS meaning all known bugs are
fixed, resulting in the happy message:

	All XX tests passed