Commit graph

13 commits

Author SHA1 Message Date
Chris Wilson
655a4dbc36 [test] Track XFAIL using expected results stored as xfail.png
Instead of tagging the sources, which is insensitive to changes, track the
known failure modes by recording the current fail as an xfail.png
reference. (We also introduce a new.png to track a fresh error, so that
they are not lost in the noise of the old XFAILs and hopefully do not
cause everyone to fret).

As we have removed the XFAIL tagging we find, surprise surprise, that some
tests are now working -- so review all the reference images (as also some
.ref.png now should be .xfail.png).

Note: I've only checked image,pdf,ps,svg. The test surfaces report some
failures that probably need to addressed in source. I've not correct the
changes for win32 and quartz. Nor fixed up the experimental backends.
2009-07-13 15:19:51 +01:00
Chris Wilson
c56385eacc [test/make-html.pl] Don't include links to non-existent images.
Some tests do not generate output images, so do not insert a link if we
don't have an image.
2008-08-18 16:18:57 +01:00
Brian Ewins
f8ee0cdf18 [test] Link to the correct reference image.
The generated test html guesses the names of the reference
images used in the tests. This is quite often wrong, and
makes it harder to change policy in cairo-test. Teach
make-html.pl to parse the log for the path to the reference image.
2007-11-10 01:34:01 +00:00
Brian Ewins
7072959e3d Fix to support new similar tests.
The patch to repeat tests for similar surfaces changed the
format of the test log files, which were parsed to produce
index.html. This fixes the parser to understand those changes.
2007-10-20 13:52:08 +01:00
Ian Osgood
acac0c1966 don't squish tiny images in test/index.html 2006-10-26 09:57:32 -07:00
Vladimir Vukicevic
9735cb9a24 Improve make-html.pl, add self-contained output format
Setting CAIRO_TEST_SHOW_INLINE in the environment before running
make-html.pl will generate a html file with all the logs and necessary
images inlined as data URI's.
2006-09-09 18:55:46 -07:00
Carl Worth
5ef4c991f6 test: Add link to test log file in HTML output 2006-08-30 15:38:15 -07:00
Behdad Esfahbod
6c7099b0cc Only generate HTML for log files passed on the command line.
With the make bits already in place, this means that make retest
creates HTML for only the retested tests.
2006-07-13 18:50:14 -04:00
Behdad Esfahbod
da0f348350 ***cworth finds them [the background colors] a bit too bright 2006-07-13 13:16:10 -04:00
Behdad Esfahbod
0ac2bbbf52 Improve test HTML generation:
- Make "make retest" not generate all .log files.
- Format improvements in the generated HTML file.
2006-07-13 11:27:05 -04:00
Vladimir Vukicevic
b3e2252b94 Augment test framework to test everything under device offsets as well.
[With this change, two tests with gradients exhibit subtle differences
under device offsets. I don't think we actually care about them
though. -cworth]
2006-05-03 23:42:45 -07:00
Vladimir Vukicevic
bd265e008b Clean up output some; show only images that fail, otherwise just show pass/fail squares. 2006-01-03 07:29:57 +00:00
Vladimir Vukicevic
c2c4f0bb25 bump glitz req to 0.5.1, test for backends
Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test.
Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00