fdo-mirrors/cairo
1
0
Fork 0
mirror of https://gitlab.freedesktop.org/cairo/cairo.git synced 2025-12-21 08:40:09 +01:00
Code Issues Projects Releases Packages Wiki Activity Actions
cairo/test/make-html.pl

226 lines
6.9 KiB
Perl
Raw Normal View History

bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
#!/usr/bin/perl
#
# Copyright <20> 2005 Mozilla Corporation
#
# Permission to use, copy, modify, distribute, and sell this software
# and its documentation for any purpose is hereby granted without
# fee, provided that the above copyright notice appear in all copies
# and that both that copyright notice and this permission notice
# appear in supporting documentation, and that the name of
# Mozilla Corporation not be used in advertising or publicity pertaining to
# distribution of the software without specific, written prior
# permission. Mozilla Corporation makes no representations about the
# suitability of this software for any purpose. It is provided "as
# is" without express or implied warranty.
#
# MOZILLA CORPORTAION DISCLAIMS ALL WARRANTIES WITH REGARD TO THIS
# SOFTWARE, INCLUDING ALL IMPLIED WARRANTIES OF MERCHANTABILITY AND
# FITNESS, IN NO EVENT SHALL MOZILLA CORPORATION BE LIABLE FOR ANY SPECIAL,
# INDIRECT OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES WHATSOEVER
# RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER IN AN ACTION
# OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION, ARISING OUT OF OR
# IN CONNECTION WITH THE USE OR PERFORMANCE OF THIS SOFTWARE.
#
# Author: Vladimir Vukicevic <vladimir@pobox.com>
#
##
Improve test HTML generation: - Make "make retest" not generate all .log files. - Format improvements in the generated HTML file.
2006-07-13 11:27:05 -04:00
## Takes all the *.log files in the current directory (or those provided
## on the command line) and spits out html to stdout that can be used to
## view all the test results at once.
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
##
Clean up output some; show only images that fail, otherwise just show pass/fail squares.
2006-01-03 07:29:57 +00:00
# show reference images
my $config_show_ref = 0;
# show fail images
my $config_show_fail = 1;
# show all results, even passes
my $config_show_all = 0;
# end of config options
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
my $tests = {};
my $teststats = {};
foreach (<*.log>) {
(open LOG, "$_") || next;
while (<LOG>) {
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
next unless /^TEST: (.*) TARGET: (.*) FORMAT: (.*) OFFSET: (.*) RESULT: (.*)$/;
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
$tests->{$1} = {} unless $tests->{$1};
$tests->{$1}->{$2} = {} unless $tests->{$1}->{$2};
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
$tests->{$1}->{$2}->{$3} = {} unless $tests->{$1}->{$2}->{$3};
$tests->{$1}->{$2}->{$3}->{$4} = $5;
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
Improve test HTML generation: - Make "make retest" not generate all .log files. - Format improvements in the generated HTML file.
2006-07-13 11:27:05 -04:00
$teststats->{$2} = {"PASS" => 0, "FAIL" => 0, "XFAIL" => 0, "UNTESTED" => 0, "CRASHED" =>0}
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
unless $teststats->{$2};
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
($teststats->{$2}->{$5})++;
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
}
close LOG;
}
my $targeth = {};
my $formath = {};
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
my $offseth = {};
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
foreach my $testname (sort(keys %$tests)) {
my $v0 = $tests->{$testname};
foreach my $targetname (sort(keys %$v0)) {
my $v1 = $v0->{$targetname};
$targeth->{$targetname} = 1;
foreach my $formatname (sort(keys %$v1)) {
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
my $v2 = $v1->{$formatname};
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
$formath->{$formatname} = 1;
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
foreach my $offsetval (sort(keys %$v2)) {
$offseth->{$offsetval} = 1;
}
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
}
}
}
my @targets = sort(keys %$targeth);
my @formats = sort(keys %$formath);
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
my @offsets = sort(keys %$offseth);
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
sub printl {
print @_, "\n";
}
printl '<html><head>';
printl '<title>Cairo Test Results</title>';
printl '<style type="text/css">';
Improve test HTML generation: - Make "make retest" not generate all .log files. - Format improvements in the generated HTML file.
2006-07-13 11:27:05 -04:00
printl 'a img { border: solid 1px #FFF; }';
***cworth finds them [the background colors] a bit too bright
2006-07-13 13:16:10 -04:00
printl '.PASS { background-color: #0B0; min-width: 1em; }';
printl '.FAIL { background-color: #B00; }';
printl '.XFAIL { background-color: #BB0; }';
printl '.UNTESTED { background-color: #555; }';
Improve test HTML generation: - Make "make retest" not generate all .log files. - Format improvements in the generated HTML file.
2006-07-13 11:27:05 -04:00
printl '.CRASHED { background-color: #F00; color: #FF0; }';
***cworth finds them [the background colors] a bit too bright
2006-07-13 13:16:10 -04:00
printl '.PASSstr { color: #0B0; }';
printl '.FAILstr { color: #D00; }';
printl '.XFAILstr { color: #BB0; }';
Improve test HTML generation: - Make "make retest" not generate all .log files. - Format improvements in the generated HTML file.
2006-07-13 11:27:05 -04:00
printl '.CRASHEDstr { color: #F00; }';
***cworth finds them [the background colors] a bit too bright
2006-07-13 13:16:10 -04:00
printl '.UNTESTEDstr { color: #555; }';
Improve test HTML generation: - Make "make retest" not generate all .log files. - Format improvements in the generated HTML file.
2006-07-13 11:27:05 -04:00
printl 'img { max-width: 15em; min-width: 3em; margin: 3px; }';
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
printl 'td { vertical-align: top; }';
printl '</style>';
printl '<body>';
printl '<table border="1">';
Clean up output some; show only images that fail, otherwise just show pass/fail squares.
2006-01-03 07:29:57 +00:00
print '<tr><th>Test</th>';
print '<th>Ref</th>' if $config_show_ref;
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
foreach my $target (@targets) {
print '<th>', $target, '</th>';
}
printl '</tr>';
Clean up output some; show only images that fail, otherwise just show pass/fail squares.
2006-01-03 07:29:57 +00:00
print '<tr><td></td>';
print '<td></td>' if $config_show_ref;
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
foreach my $target (@targets) {
print '<td>';
Clean up output some; show only images that fail, otherwise just show pass/fail squares.
2006-01-03 07:29:57 +00:00
print '<span class="PASSstr">', $teststats->{$target}->{"PASS"}, '</span>/';
Improve test HTML generation: - Make "make retest" not generate all .log files. - Format improvements in the generated HTML file.
2006-07-13 11:27:05 -04:00
print '<span class="FAILstr">', $teststats->{$target}->{"FAIL"} + $teststats->{$target}->{"CRASHED"}, '</span>/';
Clean up output some; show only images that fail, otherwise just show pass/fail squares.
2006-01-03 07:29:57 +00:00
print '<span class="XFAILstr">', $teststats->{$target}->{"XFAIL"}, '</span>/';
print '<span class="UNTESTEDstr">', $teststats->{$target}->{"UNTESTED"}; '</span>';
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
print '</td>';
}
printl '</tr>';
sub testref {
my ($test, $format, $rest) = @_;
my $fmtstr = "";
if ($format eq "rgb24") {
$fmtstr = "-rgb24";
}
return "$test$fmtstr-ref.png";
}
sub testfiles {
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
my ($test, $target, $format, $offset, $rest) = @_;
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
my $fmtstr = "";
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
my $offstr = "";
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
if ($format eq "rgb24") {
$fmtstr = "-rgb24";
} elsif ($format eq "argb32") {
$fmtstr = "-argb32";
}
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
if ($offset ne "0") {
$offstr = "-" . $offset;
}
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
return ("out" => "$test-$target$fmtstr$offstr-out.png",
"diff" => "$test-$target$fmtstr$offstr-diff.png");
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
}
foreach my $test (sort(keys %$tests)) {
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
foreach my $offset (@offsets) {
foreach my $format (@formats) {
my $testline = "";
foreach my $target (@targets) {
my $tgtdata = $tests->{$test}->{$target};
if ($tgtdata) {
my $testres = $tgtdata->{$format}->{$offset};
if ($testres) {
my %testfiles = testfiles($test, $target, $format, $offset);
$testline .= "<td class=\"$testres\">";
$stats{$target}{$testres}++;
if ($testres eq "PASS") {
if ($config_show_all) {
$testline .= "<a href=\"" . $testfiles{"out"} . "\"><img src=\"" . $testfiles{"out"} . "\"></a>";
}
} elsif ($testres eq "FAIL") {
if ($config_show_fail || $config_show_all) {
$testline .= "<a href=\"" . $testfiles{"out"} . "\"><img src=\"" . $testfiles{"out"} . "\"></a>";
Improve test HTML generation: - Make "make retest" not generate all .log files. - Format improvements in the generated HTML file.
2006-07-13 11:27:05 -04:00
#$testline .= "<hr size=\"1\">";
$testline .= " ";
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
$testline .= "<a href=\"" . $testfiles{"diff"} . "\"><img src=\"" . $testfiles{"diff"} . "\"></a>";
}
Improve test HTML generation: - Make "make retest" not generate all .log files. - Format improvements in the generated HTML file.
2006-07-13 11:27:05 -04:00
} elsif ($testres eq "CRASHED") {
$testline .= "!!!CRASHED!!!";
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
} elsif ($testres eq "XFAIL") {
#nothing
if ($config_show_all) {
$testline .= "<a href=\"" . $testfiles{"out"} . "\"><img src=\"" . $testfiles{"out"} . "\"></a>";
Improve test HTML generation: - Make "make retest" not generate all .log files. - Format improvements in the generated HTML file.
2006-07-13 11:27:05 -04:00
#$testline .= "<hr size=\"1\">";
$testline .= " ";
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
$testline .= "<a href=\"" . $testfiles{"diff"} . "\"><img src=\"" . $testfiles{"diff"} . "\"></a>";
}
Improve test HTML generation: - Make "make retest" not generate all .log files. - Format improvements in the generated HTML file.
2006-07-13 11:27:05 -04:00
} elsif ($testres eq "UNTESTED") {
#nothing
} else {
$testline .= "UNSUPPORTED STATUS (update make-html.pl)";
}
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
$testline .= "</td>";
} else {
$testline .= '<td></td>';
}
} else {
$testline .= '<td></td>';
}
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
}
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
my $testref = testref($test, $format);
print '<tr><td>', "<a href=\"$testref\">", $test, ' (', $format, '/', $offset, ')</a></td>';
Clean up output some; show only images that fail, otherwise just show pass/fail squares.
2006-01-03 07:29:57 +00:00
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
if ($config_show_ref) {
print "<td><a href=\"$testref\"><img src=\"$testref\"></img></a></td>";
}
Clean up output some; show only images that fail, otherwise just show pass/fail squares.
2006-01-03 07:29:57 +00:00
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
print $testline;
Clean up output some; show only images that fail, otherwise just show pass/fail squares.
2006-01-03 07:29:57 +00:00
Augment test framework to test everything under device offsets as well. [With this change, two tests with gradients exhibit subtle differences under device offsets. I don't think we actually care about them though. -cworth]
2006-02-15 13:46:52 -08:00
print "</tr>\n";
}
bump glitz req to 0.5.1, test for backends Add glitz backend (original patches from sunmoon1997@gmail.com), including glx, wgl, and agl support. Add CAIRO_TEST_TARGET environment variable for limiting backends to test. Takes all *.log files and spits out html to stdout that can be used to view all test results at once.
2005-12-12 11:56:40 +00:00
}
}
print "</table></body></html>\n";
Reference in a new issue Copy permalink