TestPilot40
From The Linux Foundation
Assorted comments and experiences with LSB 4.0 testing. Note that comments about possible waivers are to be considered informal; the way to get a waiver granted is to file a problem report through the certification system. For instructions on installing and running the tests, please see these instructions from ISPRAS.
Note on maintaining this page: start by pasting test results from a given system which has an unknown failure. As analysis proceeds, migrate those raw results into an explanation; don't remove the problems. The idea is to have an in informal log of problems people might run into.
If you need more of a scratch page for collecting specific items from this page for items that need resolving, please use TestPilot40/Unresolved. However, please keep a record here in TestPilot40 of final actions taken.
System resource requirements
The distribution test suite has grown in size considerably since LSB 3.1. Currently, a full install of the distribution tests under /opt/lsb/test takes about 1.2Gb. Application battery packages will add to this, and multiple runs under dtk-manager will accumulate test data rather quickly. Free space of 3-5Gb is probably a reasonable expectation for the system under test before starting LSB testing.
In addition, at this time, lsb-test-olver-core may require about 512Mb of system memory (with an X server and a contemporary desktop running), as well as 300Mb of free disk space to complete a test run.
Distribution packages that may be required for successful testing
- lsb-test-perl - perl-devel (libperl-dev, provides libperls.so), perl-Test-Harness, perl-Test-Simple, perl-ExtUtils-MakeMaker, perl-ExtUtils-Embed (Fedora seems to split these off)
- lsb-test-olver-core - perl-XML-Parser
- lsb-test-desktop - qt4-database-plugin-sqlite-lib or libqt4-sql-sqlite or equivalent (provides libqsqlite.so)
- lsb-test-azov-qt3 - libqt3-mt-sqlite or qt3-sqlite or equivalent (provides libqsqlite.so)
- lsb-test-azov-qt4 - libqt4-sql or equivalent
Locales related issues
One might see a large number of locale related failures, particularly with lsb-test-libstdcpp (also xts5). The tests need a number of locales setup that may not be part of a standard install.
- Ubuntu: locale-gen de_DE de_DE@euro en_HK en_PH en_US en_US.ISO-8859-15 en_US.UTF-8 es_ES es_MX fr_FR fr_FR@euro is_IS it_IT se_NO ta_IN zh_TW (does not seem to accept en_US.ISO-8859-1 or ja_JP? Does accept just "ja". is_IS shows ISO-8859-1 rather than UTF8)
- Debian: dpkg-reconfigure locales (select all-locales or it_IT en_US de_DE en_HK de_DE@euro es_MX fr_FR en_PH fr_FR@euro)
- Many rpm based systems: install locales-de, locales-en, locales-es, locales-fr, locales-is, locales-it, locales-ja, locales-se, locales-ta, locales-zh
See also: http://gcc.gnu.org/onlinedocs/libstdc++/manual/build.html#build.prereq for other suggestions in setting up locales.
Beta Process Links
Core test
- Newer glibc implementations are showing a number of failures in the exec* tests. A typical journal will look something like this:
/tset/POSIX.os/procenv/sysconf/T.sysconf 1 FAIL /tset/POSIX.os/procprim/exec/T.execl 15 FAIL /tset/POSIX.os/procprim/exec/T.execl 16 UNRESOLVED /tset/POSIX.os/procprim/exec/T.execle 15 FAIL /tset/POSIX.os/procprim/exec/T.execle 16 UNRESOLVED /tset/POSIX.os/procprim/exec/T.execlp 15 FAIL /tset/POSIX.os/procprim/exec/T.execlp 16 UNRESOLVED /tset/POSIX.os/procprim/exec/T.execv 15 FAIL /tset/POSIX.os/procprim/exec/T.execv 16 UNRESOLVED /tset/POSIX.os/procprim/exec/T.execve 15 FAIL /tset/POSIX.os/procprim/exec/T.execve 16 UNRESOLVED /tset/POSIX.os/procprim/exec/T.execvp 15 FAIL /tset/POSIX.os/procprim/exec/T.execvp 16 UNRESOLVED
It would appear that the values for _SC_ARG_MAX(glibc) and ARG_MAX(kernel) no longer agree, plus it would seem that the value returned by _SC_ARG_MAX is not actually honored when an application tries to use it. More detail can be found in bug 2288.
- There was an issue with the __fxstat, __lsxtat, __xstat test where a fixed value of "3" for ver was being used, and the 64bit platforms require "1". Tests have been corrected to use _STAT_VER. this is tracked in bug 2424
/tset/LI18NUX2K.L1/base/__fxstat/T.__fxstat 1 FAIL /tset/LI18NUX2K.L1/base/__lxstat/T.__lxstat 1 FAIL /tset/LI18NUX2K.L1/base/__lxstat/T.__lxstat 2 FAIL /tset/LI18NUX2K.L1/base/__xstat/T.__xstat 1 FAIL
- There is an issue with the strerror_r test where it segfaults on 64bit platforms due to clashing definitions of strerror_r. This is tracked in bug 2336. A fix has been pushed (11/25/08) to test in XSI mode which should resolve the crash.
/tset/ANSI.os/string/strerror_r/T.strerror_r 1 UNRESOLVED Checks the functionality of strerror_r() unexpected signal 11 (SIGSEGV) received
- T.sysconf 5 fails on some distributions over a disagreement in the value of OPEN_MAX returned by sysconf and the system headers. This is tracked in bug 2435. OPEN_MAX has been removed from limits.h in LSB-4.0 and the test appears to compile correctly now where it compares _SC_OPEN_MAX >= _POSIX_OPEN_MAX.
/tset/POSIX.os/procenv/sysconf/T.sysconf 5 FAIL sysconf(_SC_OPEN_MAX) did not return the value of OPEN_MAX value returned: 1024, OPEN_MAX: 256 (OPEN_MAX should not be defined in <limits.h> if the run-time value can vary.)
- Distributions that use Red Hat's chkconfig can fail 2 of the initd tests. Previous discussion of these tests seemed to indicate there's some disagreement as to whether the strict dependency called out in the spec/tests is valid.
ref: bug 2443 Feedback from upstream indicates a new version of chkconfig should honor this behavior when called as install_init or remove_initd.
/tset/initd/misc/install/general-tc 3 FAIL Reference 20.3-3(C) Testing activation of initscript If an initscript depends on a boot facility it shall not be activated by a call to install_initd if the dependency is not met Call /usr/lib/lsb/install_initd /etc/init.d/lsb-initA exit code 0 returned, expected 1 Check that lsb-initA is not installed in initscript directories /etc/rc.d/rc0.d/K50lsb-initA: found a symlink exit code 2 returned, expected 1 /etc/rc.d/rc1.d/K50lsb-initA: found a symlink exit code 2 returned, expected 1 /etc/rc.d/rc2.d/S51lsb-initA: found a symlink exit code 2 returned, expected 1 /etc/rc.d/rc3.d/S51lsb-initA: found a symlink exit code 2 returned, expected 1 /etc/rc.d/rc4.d/S51lsb-initA: found a symlink exit code 2 returned, expected 1 /etc/rc.d/rc5.d/S51lsb-initA: found a symlink exit code 2 returned, expected 1 /etc/rc.d/rc6.d/K50lsb-initA: found a symlink exit code 2 returned, expected 1 Cleanup, deactivate initscripts, if any Cleanup, remove initscript files, if any /tset/initd/misc/install/general-tc 5 FAIL Reference 20.4-5(C) Testing deactivation of initscript If a boot facility provided by an initscript is depended on by another initscript the script shall not be deactivated by a call to remove_initd Call /usr/lib/lsb/install_initd /etc/init.d/lsb-initB Call /usr/lib/lsb/install_initd /etc/init.d/lsb-initA Check that lsb-initA is installed in initscript directories /etc/rc.d/rc0.d/K50lsb-initA: found a symlink /etc/rc.d/rc1.d/K50lsb-initA: found a symlink /etc/rc.d/rc2.d/S51lsb-initA: found a symlink /etc/rc.d/rc3.d/S51lsb-initA: found a symlink /etc/rc.d/rc4.d/S51lsb-initA: found a symlink /etc/rc.d/rc5.d/S51lsb-initA: found a symlink /etc/rc.d/rc6.d/K50lsb-initA: found a symlink Check that lsb-initB is installed in initscript directories /etc/rc.d/rc0.d/K50lsb-initB: found a symlink /etc/rc.d/rc1.d/K50lsb-initB: found a symlink /etc/rc.d/rc2.d/S50lsb-initB: found a symlink /etc/rc.d/rc3.d/S50lsb-initB: found a symlink /etc/rc.d/rc4.d/S50lsb-initB: found a symlink /etc/rc.d/rc5.d/S50lsb-initB: found a symlink /etc/rc.d/rc6.d/K50lsb-initB: found a symlink Call /usr/lib/lsb/install_initd /etc/init.d/lsb-initB exit code 0 returned, expected non-zero Check that lsb-initB is installed in initscript directories /etc/rc.d/rc0.d/K??lsb-initB: file not found /etc/rc.d/rc1.d/K??lsb-initB: file not found /etc/rc.d/rc2.d/S??lsb-initB: file not found exit code 1 returned, expected 2 /etc/rc.d/rc3.d/S??lsb-initB: file not found exit code 1 returned, expected 2 /etc/rc.d/rc4.d/S??lsb-initB: file not found exit code 1 returned, expected 2 /etc/rc.d/rc5.d/S??lsb-initB: file not found exit code 1 returned, expected 2 /etc/rc.d/rc6.d/K??lsb-initB: file not found Cleanup, deactivate initscripts, if any Cleanup, remove initscript files, if any
- T.munlock test 2 is failing on some distributions, returning ENOMEM. Root cause is not known yet, but the issue is tracked in bug 2436. A fix has been pushed (11/26/08) to correct this issue.
/tset/LSB.os/procenv/munlock/T.munlock 2 FAIL Checks the munlock() for return vaulue 0 munlock return -1, expected to return zero errno was set to 12
- Fedora 9 / x86_64 observes an issue with strftime, which looks locale-related:
/tset/ANSI.os/time/strftime/T.strftime 9 Failed with TZ=ABC-4:30:20 strftime() gave incorrect standard timezone name observed "MST", expected "ABC" with TZ=JKL3:10PNM4:40 strftime() gave incorrect standard timezone name observed "MST", expected "JKL" with TZ=JKL3:10PNM4:40 strftime() gave incorrect daylight saving timezone name observed "MDT", expected "PNM"
- Fedora 9 / x86_64 observes an issue with pipe:
/tset/POSIX.os/ioprim/pipe/T.pipe 4 Unresolved deletion reason: unable to find an unused file descriptor
- Fedora 9 / x86_64 no longer supplies /usr/X11R6, should this be required?
/tset/LSB.fhs/usr/x11r6/x11r6-tc 1 Failed Reference 4.4-1(A) The /usr/X11R6 directory exists and is searchable /usr/X11R6: directory not found
- Fedora 9 / x86_64 observes an issue with adjtime:
/tset/LSB.fhs/var/lib-hwclock/lib-hwclock-tc 1 Failed Reference 5.8.5.1 /var/lib/hwclock : State directory for hwclock (optional) This directory contains the file /var/lib/hwclock/adjtime In FHS 2.1, this file was /etc/adjtime, but as hwclock updates it, that was obviously incorrect. Found /etc/adjtime, should be in /var/lib/hwclock
This test was added per bug 1483 and few distributions seem to honor the described behavior at this time.
- Fedora 9 / x86_64 observes an issue with nice:
/tset/LSB.os/procenv/nice/T.nice 9 Failed nice(-1) did not return expected values ERRNO VALUES: expected: 1 (EPERM), observed: 0 (NO ERROR)
- Fedora 9 / x86_64 had a problem with daemon 2 after daemon 1 was disabled:
/tset/LSB.os/procprim/daemon/T.daemon 2 Unreported Messages from the test (none)
Note: daemon 2 has also been disabled until the tests can be reworked (12/09/08 Stew)
- SLES11 (only some archs - namely s390x and ppc64) has two failures in /tset/LSB.os/procenv/ulimit/T.ulimit {4,5}:
super user attempt to double its file size limit failed ulimit(2) failed with errno = 0 (NO ERROR)
attempt by process (effective UID not super-user) to increase its file size limit using ulimit() did not return expected values ERRNO VALUES: expected: 1 (EPERM), observed: 0 (NO ERROR)
libstdcpp test
- Seeing these 2 tests fail fairly consistently across distributions. No further diagnosis has been done at this time.
/27_io/objects/char/12048-5.cc 1 FAIL _27_io_objects_char_12048-5.exe: .../lsb-test-libstdcpp-4.1.0/testsuite/27_io/objects/char/12048-5.cc:47: void test01(): Assertion `c3 == std::char_traits<char>::to_char_type(c2)' failed. /27_io/objects/wchar_t/12048-5.cc 1 FAIL _27_io_objects_wchar_t_12048-5.exe: .../lsb-test-libstdcpp-4.1.0/testsuite/27_io/objects/wchar_t/12048-5.cc:45: void test01(): Assertion `c3 == std::char_traits<wchar_t>::to_char_type(c2)' failed.
ref: http://gcc.gnu.org/bugzilla/show_bug.cgi?id=12048
- Also seeing this test fail, although not quite as much as the previous 2:
/27_io/fpos/14320-1.cc 1 FAIL _27_io_fpos_14320-1.exe: .../lsb-test-libstdcpp-4.1.0/testsuite/27_io/fpos/14320-1.cc:54: void test01(): Assertion `found' failed.
ref: http://gcc.gnu.org/bugzilla/show_bug.cgi?id=14320
The previous 3 tests are covered in bug 2459
- Mats adds:
/22_locale/money_put/put/char/9780-3.cc 1 Failed _22_locale_money_put_put_char_9780-3.exe: .../lsb-test-libstdcpp-4.1.0/testsuite/22_locale/money_put/put/char/9780-3.cc:42: int main(): Assertion `res == "-EUR 12.345.678,90"' failed. /27_io/basic_istream/extractors_other/char/1.cc 1 Failed _27_io_basic_istream_extractors_other_char_1.exe: .../lsb-test-libstdcpp-4.1.0/testsuite/27_io/basic_istream/extractors_other/char/1.cc:127: void test01(): Assertion `state1 == state2' failed. /27_io/basic_istream/extractors_other/wchar_t/1.cc 1 Failed _27_io_basic_istream_extractors_other_wchar_t_1.exe: .../lsb-test-libstdcpp-4.1.0/testsuite/27_io/basic_istream/extractors_other/wchar_t/1.cc:125: void test01(): Assertion `state1 == state2' failed.
ref: http://gcc.gnu.org/bugzilla/show_bug.cgi?id=9780
- also see bug 2445 for some locales changes that are impacting the tests
- Seem to be getting a considerable number of failures with libstdc++ > 4.1.0. I had originally discounted these as being locale setup issues, but I'm seeing them on rpm based systems too, where I thought I knew how to setup the locales for testing.
SLES10/ia32 (libstdc++-4.1.0):
/27_io/fpos/14320-1.cc 1 FAIL /27_io/objects/char/12048-5.cc 1 FAIL /27_io/objects/wchar_t/12048-5.cc 1 FAIL Total Tests Passed: 1801 Total Tests Failed (including waived): 3 Total Tests Failed (excluding waived): 3
Mandriva 2009.0/ia32 (libstdc++-4.3.2):
/22_locale/codecvt/always_noconv/wchar_t/3.cc 1 FAIL /22_locale/codecvt/encoding/wchar_t/3.cc 1 FAIL /22_locale/codecvt/in/wchar_t/3.cc 1 FAIL /22_locale/codecvt/length/wchar_t/3.cc 1 FAIL /22_locale/codecvt/max_length/wchar_t/3.cc 1 FAIL /22_locale/codecvt/out/wchar_t/3.cc 1 FAIL /22_locale/codecvt/unshift/wchar_t/3.cc 1 FAIL /22_locale/time_put/put/char/4.cc 1 FAIL /22_locale/time_put/put/char/wrapped_env.cc 1 FAIL /22_locale/time_put/put/char/wrapped_locale.cc 1 FAIL /22_locale/time_put/put/wchar_t/4.cc 1 FAIL /22_locale/time_put/put/wchar_t/wrapped_env.cc 1 FAIL /22_locale/time_put/put/wchar_t/wrapped_locale.cc 1 FAIL /27_io/basic_istream/extractors_other/char/1.cc 1 FAIL /27_io/basic_istream/extractors_other/wchar_t/1.cc 1 FAIL /27_io/fpos/14320-1.cc 1 FAIL /27_io/objects/char/12048-5.cc 1 FAIL /27_io/objects/wchar_t/12048-5.cc 1 FAIL Total Tests Passed: 1786 Total Tests Failed (including waived): 18 Total Tests Failed (excluding waived): 18
Mandriva 2008.1/x86_64 (libstdc++-4.2.3) - nearly the same as Mandriva 2009, but dropping a few (journal compare):
/22_locale/time_put/put/char/4.cc 1 FAIL,PASS /22_locale/time_put/put/char/wrapped_env.cc 1 FAIL,PASS /22_locale/time_put/put/char/wrapped_locale.cc 1 FAIL,PASS /22_locale/time_put/put/wchar_t/4.cc 1 FAIL,PASS /22_locale/time_put/put/wchar_t/wrapped_env.cc 1 FAIL,PASS /22_locale/time_put/put/wchar_t/wrapped_locale.cc 1 FAIL,PASS /27_io/fpos/14320-1.cc 1 FAIL,PASS /ext/pb_assoc/example/mapping_level_neg.cc 1 NOTINUSE,MISSING Total Tests Passed: 1792 Total Tests Failed (including waived): 11 Total Tests Failed (excluding waived): 11
Ubuntu 8.10/ia32 (libstdc++-4.3.2) - somewhat worse than Mandriva 2009, locales issues still?:
/22_locale/codecvt/always_noconv/char/wrapped_locale.cc 1 FAIL /22_locale/codecvt/always_noconv/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/codecvt/encoding/char/wrapped_locale.cc 1 FAIL /22_locale/codecvt/encoding/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/codecvt/in/char/wrapped_locale.cc 1 FAIL /22_locale/codecvt/in/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/codecvt/length/char/wrapped_locale.cc 1 FAIL /22_locale/codecvt/length/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/codecvt/max_length/char/wrapped_locale.cc 1 FAIL /22_locale/codecvt/max_length/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/codecvt/out/char/wrapped_locale.cc 1 FAIL /22_locale/codecvt/out/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/codecvt/unshift/char/wrapped_locale.cc 1 FAIL /22_locale/codecvt/unshift/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/collate/compare/char/wrapped_locale.cc 1 FAIL /22_locale/collate/compare/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/collate/hash/char/wrapped_locale.cc 1 FAIL /22_locale/collate/hash/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/collate/transform/char/wrapped_locale.cc 1 FAIL /22_locale/collate/transform/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/ctype/cons/char/wrapped_locale.cc 1 FAIL /22_locale/ctype/is/char/wrapped_locale.cc 1 FAIL /22_locale/ctype/is/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/ctype/narrow/char/wrapped_locale.cc 1 FAIL /22_locale/ctype/narrow/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/ctype/scan/char/wrapped_locale.cc 1 FAIL /22_locale/ctype/scan/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/ctype/to/char/wrapped_locale.cc 1 FAIL /22_locale/ctype/to/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/ctype/widen/char/wrapped_locale.cc 1 FAIL /22_locale/ctype/widen/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/messages/members/char/wrapped_locale.cc 1 FAIL /22_locale/money_get/get/char/wrapped_locale.cc 1 FAIL /22_locale/money_get/get/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/money_put/put/char/wrapped_locale.cc 1 FAIL /22_locale/money_put/put/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/moneypunct/members/char/wrapped_locale.cc 1 FAIL /22_locale/moneypunct/members/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/num_get/get/char/wrapped_locale.cc 1 FAIL /22_locale/num_get/get/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/num_put/put/char/wrapped_locale.cc 1 FAIL /22_locale/num_put/put/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/numpunct/members/char/wrapped_locale.cc 1 FAIL /22_locale/numpunct/members/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/time_get/date_order/char/wrapped_locale.cc 1 FAIL /22_locale/time_get/date_order/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/time_get/get_date/char/wrapped_locale.cc 1 FAIL /22_locale/time_get/get_date/wchar_t/4.cc 1 FAIL /22_locale/time_get/get_date/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/time_get/get_monthname/char/wrapped_locale.cc 1 FAIL /22_locale/time_get/get_monthname/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/time_get/get_time/char/wrapped_locale.cc 1 FAIL /22_locale/time_get/get_time/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/time_get/get_weekday/char/wrapped_locale.cc 1 FAIL /22_locale/time_get/get_weekday/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/time_get/get_year/char/wrapped_locale.cc 1 FAIL /22_locale/time_get/get_year/wchar_t/wrapped_locale.cc 1 FAIL /22_locale/time_put/put/char/wrapped_locale.cc 1 FAIL /22_locale/time_put/put/wchar_t/wrapped_locale.cc 1 FAIL /27_io/basic_filebuf/imbue/wchar_t/12868.cc 1 FAIL /27_io/basic_istream/extractors_other/char/1.cc 1 FAIL /27_io/basic_istream/extractors_other/wchar_t/1.cc 1 FAIL /27_io/basic_streambuf/imbue/char/13007-1.cc 1 FAIL /27_io/basic_streambuf/imbue/wchar_t/13007-1.cc 1 FAIL /27_io/fpos/14320-1.cc 1 FAIL /27_io/objects/char/12048-5.cc 1 FAIL /27_io/objects/wchar_t/12048-5.cc 1 FAIL /ext/stdio_sync_filebuf/wchar_t/12077.cc 1 FAIL Total Tests Passed: 1736 Total Tests Failed (including waived): 68 Total Tests Failed (excluding waived): 68
FC9/ia32 (libstdc++-4.3.0) - a bit better, why is this 4.3.0 better than 4.2.3 or 4.3.2?
/22_locale/money_put/put/char/9780-3.cc 1 FAIL /27_io/basic_istream/extractors_other/char/1.cc 1 FAIL /27_io/basic_istream/extractors_other/wchar_t/1.cc 1 FAIL /27_io/fpos/14320-1.cc 1 FAIL /27_io/objects/char/12048-5.cc 1 FAIL /27_io/objects/wchar_t/12048-5.cc 1 FAIL Total Tests Passed: 1798 Total Tests Failed (including waived): 6 Total Tests Failed (excluding waived): 6
OpenSuSE 11.1/x86_64 (libstdc++-4.3.3_20081022), also SLES11 (various platforms):
/22_locale/money_put/put/char/9780-3.cc 1 FAIL /22_locale/time_put/put/char/4.cc 1 FAIL /22_locale/time_put/put/char/wrapped_env.cc 1 FAIL /22_locale/time_put/put/char/wrapped_locale.cc 1 FAIL /22_locale/time_put/put/wchar_t/4.cc 1 FAIL /22_locale/time_put/put/wchar_t/wrapped_env.cc 1 FAIL /22_locale/time_put/put/wchar_t/wrapped_locale.cc 1 FAIL /27_io/basic_istream/extractors_other/char/1.cc 1 FAIL /27_io/basic_istream/extractors_other/wchar_t/1.cc 1 FAIL /27_io/objects/char/12048-5.cc 1 FAIL /27_io/objects/wchar_t/12048-5.cc 1 FAIL Total Tests Passed: 1792 Total Tests Failed (including waived): 11 Total Tests Failed (excluding waived): 11
XTS5
In the 4.0 beta release, 64bit platforms will tend to show an excessive number of failures, around 75 or so.
This is tracked in bug 2342, which we believe has been fixed in the snapshot builds.
The following failure shows up in a number of distributions:
/tset/Xlib3/clsdsply/Test 6 FAIL
Journal detail doesn't tell a lot:
Assertion XCloseDisplay-6.(A) When the client has grabbed the server, then a call to XCloseDisplay performs a XUngrabServer. METH: Create a connection for client1 using XOpenDisplay. METH: Create a connection for client2 using XOpenDisplay. METH: Create a window using XCreateWindow. METH: Grab the server for the default display using XGrabServer. METH: Create a process using tet_fork. METH: In child process: METH: Generate a ChangeProperty request using XChangeProperty. METH: Wait sufficient time for the ChangeProperty request to be processed. METH: Verify that no PropertyChange event has been generated by client2 using XCheckWindowEvent. METH: Close the client1 connection using XCloseDisplay. METH: In child process: METH: Wait suffient time for the ChangeProperty request to be processed. METH: Verify that a ChangeProperty request was generated by client2. TRACE: --- Running test with visual class TrueColor, depth 16 CHECK: XCloseDisplay-6 1, line 220 REPORT: XCloseDisplay() did not ungrab the server. CHECK: XCloseDisplay-6 1, line 843
Issue is tracked in bug 2405. It would appear to be xcb-based systems that fail, and there is some feeling that it's a test bug (more detail in the bug).
Perl
- The perl tests are dependent on a number of other features not specified by LSB being present for successful testing. They include libperl.so (and possibly more).
- Some distributions have divided perl up into many different sub-packages, replacing parts of the perl source tarball with "equivalent" CPAN modules that may behave differently than the perl tests expect. It can be a challenge to find all the necessary perl bits to install to re-create what a build of the upstream perl tarball would install. In some cases, pieces of perl required by LSB, such as Test::Harness::Straps are completely missing, which prevents the tests from running at all. Sample run:
System perl version is: 5.10.0 Creating Unicode Character Database symlink... Creating symlink to system blib.pm Creating symlink to system constant.pm Creating symlink to system strict.pm Can't locate Test/Harness/Straps.pm in @INC (@INC contains: /usr/lib64/perl5/5.10.0/x86_64-linux-thread-multi /usr/lib/perl5/5.10.0 /usr/local/lib64/perl5/site_perl/5.10.0/x86_64-linux-thread-multi /usr/local/lib/perl5/site_perl/5.10.0 /usr/lib64/perl5/vendor_perl/5.10.0/x86_64-linux-thread-multi /usr/lib/perl5/vendor_perl/5.10.0 /usr/lib/perl5/vendor_perl /usr/local/lib/perl5/site_perl /usr/local/lib64/perl5/site_perl .) at Harness.pm line 6. BEGIN failed--compilation aborted at Harness.pm line 6. Compilation failed in require at harness line 12. BEGIN failed--compilation aborted at harness line 12. mv: cannot stat `5.10.0/t/tet_xres': No such file or directory Journal file is results/0002e/journal
ref: bug 2461
Printing
- An additional test was added to lsb-test-printing to test for the directory /usr/share/ppd, which may not be present on all distributions (bug 2157).
- A couple of the foomaticrip tests seem to be failing on a number of distributions (FC9 listed, foomatic-3.0.2-67.fc9.i386):
/testfoomaticrip/testfoomaticrip 3 FAIL /testfoomaticrip/testfoomaticrip 11 FAIL
An additional FAIL was observed on SLES11 beta (using foomatic-3.0.2-269.35):
/testfoomaticrip/testfoomaticrip 13 FAIL
Journal Detail:
/testfoomaticrip/testfoomaticrip 3 FAIL Reference III.8.2 foomatic-rip inserts standard PPD options into the correct sections of a DSC-compliant PostScript file and withing the sections also in the correct order. Executing /usr/bin/foomatic-rip --ppd /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test.ppd -o FilterPath=/opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/ /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test-input-ps.ps Checking: JCLSetup: Option6 Checking: Prolog: Option5 Checking: Setup: PageSize Option1 Option7 Option8 Option2 Option3 Checking: PageSetup: Page 1: Option4, Page 2: Option4, Page 3: Option4, Page 4: Option4 Output written to stdout did not contain "\%\%Page:\s*1\s+1.*\%\%BeginFeature:\s*\*Option4\s+Choice\d.*gsave.*\%\%Page:\s*2\s+2.*\%\%BeginFeature:\s*\*Option4\s+Choice\d.*gsave.*\%\%Page:\s*3\s+3.*\%\%BeginFeature:\s*\*Option4\s+Choice\d.*gsave.*\%\%Page:\s*4\s+4.*\%\%BeginFeature:\s*\*Option4\s+Choice\d.*gsave" URL: http://developer.linux-foundation.org/lsbchk?suite=lsb-test-printing&arch=ia32&testcase=/testfoomaticrip/testfoomaticrip&tpnum=3&result=FAIL /testfoomaticrip/testfoomaticrip 11 FAIL Reference III.8.2 Option settings can be applied to selected pages (page overrides) Executing /usr/bin/foomatic-rip --ppd /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test.ppd -o FilterPath=/opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/ -o 3:Option4=Choice3 /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test-input-ps.ps Checking: PageSetup: Page 1: Option4=Choice1, Page 2: Option4=Choice1, Page 3: Option4=Choice3, Page 4: Option4=Choice1 Output written to stdout did not contain "\%\%Page:\s*1\s+1.*\%\%BeginFeature:\s*\*Option4\s+Choice1.*gsave.*\%\%Page:\s*2\s+2.*\%\%BeginFeature:\s*\*Option4\s+Choice1.*gsave.*\%\%Page:\s*3\s+3.*\%\%BeginFeature:\s*\*Option4\s+Choice3.*gsave.*\%\%Page:\s*4\s+4.*\%\%BeginFeature:\s*\*Option4\s+Choice1.*gsave" Executing /usr/bin/foomatic-rip --ppd /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test.ppd -o FilterPath=/opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/ -o 2-4:FoomaticOption1=Choice3 /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test-input-ps.ps Checking: FoomaticOption1=Choice3 for pages 2-4 Executing /usr/bin/foomatic-rip --ppd /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test.ppd -o FilterPath=/opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/ -o odd:FoomaticOption1=Choice3 /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test-input-ps.ps Checking: FoomaticOption1=Choice3 for odd pages Executing /usr/bin/foomatic-rip --ppd /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test.ppd -o FilterPath=/opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/ -o 1-2,4:FoomaticOption1=Choice3 /opt/lsb/test/printing/tet_tmp_dir/26243aa/testfoomaticrip/foomatic-test-input-ps.ps Checking: FoomaticOption1=Choice3 for pages 1-2 and 4 URL: http://developer.linux-foundation.org/lsbchk?suite=lsb-test-printing&arch=ia32&testcase=/testfoomaticrip/testfoomaticrip&tpnum=11&result=FAIL
Mail list threads (with no real resolution, perl issue?): thread start, continuation
And the bug - local testing seems to point to a regression in foomatic-rip itself. This was confirmed by upstream, the bug being introduced with this commit:
revno: 127 committer: Linux Foundation Patch Queue Manager <pqm@linux-foundation.org> branch nick: foomatic-filters timestamp: Sun 2008-04-20 12:20:20 -0700 message: Fixed problem of enumerated choice options with settings \"True\" and \"False\" not handled correctly. Added &rbinumcopies; placeholder.
Distributions shipping snapshots of 3.x should update to the 20081119 commit:
revno: 137 committer: Linux Foundation Patch Queue Manager <pqm@linux-foundation.org> branch nick: foomatic-filters timestamp: Wed 2008-11-19 03:20:10 -0800 message: PageSetup sections were inserted after the first PostScript code line of the p age and not directly after \"%%Page ...\".
- Distributions using the 4.0 branch of foomatic filter exhibit a different set of FAILS, with one test consuming the CPU until it's killed:
/testfoomaticrip/testfoomaticrip 7 FAIL /testfoomaticrip/testfoomaticrip 8 FAIL /testfoomaticrip/testfoomaticrip 10 FAIL /testfoomaticrip/testfoomaticrip 11 FAIL /testfoomaticrip/testfoomaticrip 13 FAIL
from top:
6824 root 20 0 15884 4284 2092 R 99.2 0.4 0:53.85 foomatic-rip
Tracked in bug 2423
This is now fixed in upstream bzr. Distributions should use at least revision 185:
revno: 185 committer: Linux Foundation Patch Queue Manager <pqm@linux-foundation.org> branch nick: foomatic-filters-devel timestamp: Sun 2008-11-30 16:50:04 -0800 message: Fixed several bugs in the merging of PJL options.
Python
Python 2.6 is beginning to show up in some distributions (OpenSuSE 11.1 beta). Our scheme with a dual 2.4/2.5 setup falls apart with a 2.6 version - bug 2363. Changes were pushed to snapshots to partially address this so the tests at least run, but there are still a number of failures:
95 tests OK. 13 tests failed: test_deque test_enumerate test_eof test_format test_gc test_generators test_genexps test_iterlen test_itertools test_list test_syntax test_unicode test_unicodedata
The remaining 13 tests have now been reworked to run correctly under Python-2.6 in post-beta snapshot builds and should not fail in RCs and the final 4.0 test suite.
Desktop Test
xml
We're seeing xml failures against more modern libxml (bug 2274). We went through this once before when 2.6.27 came about. Rather than continue down the path of parallel test setups, a thought is to disable the non-portable regression tests. Typical results (Fedora 10 Beta, x86_64, libxml2-2.7.1):
XML_10 5 FAIL XML_10 6 FAIL XML_10 8 FAIL XML_10 9 FAIL XML_10 14 FAIL XML_10 58 FAIL XML_10 59 FAIL XML_10 63 FAIL XML_10 70 FAIL XML_10 78 FAIL XML_10 81 FAIL XML_10 82 FAIL XML_10 98 FAIL XML_10 100 FAIL XML_30 4 FAIL XML_31 4 FAIL XML_4 8 FAIL XML_5 8 FAIL Test was run: 20081021 16:34:06 Test Suite Version: unset Test Suite Architecture: unset Total Tests Passed: 2449 Total Tests Failed (including waived): 18 Total Tests Failed (excluding waived): 18
There is also an journal issue exposed in these failures (bug 2347), which we believe has been fixed in the snapshot builds.
A modification for bug 2274 to disable the non-portable regression tests has been pushed to both the 3.2 branch and development and should be reflected in snapshot builds and RCs, as well as the next 3.2.X refresh.
cairo
Some initial discussion/results for the new Cairo tests is here: CairoTesting40. I (Stew) decided to treat the image variations as warnings for LSB testing.
There are 2 tests that fail almost everywhere:
path-data-image 0 UNREPORTED
Error: CAIRO_STATUS_NULL_POINTER (cairo_append_path(cr, &path) \
path.data = NULL, path.num_data = 0, path.status = CAIRO_STATUS_SUCCESS)
path-data-xlib 1 UNREPORTED
Error: CAIRO_STATUS_NULL_POINTER (cairo_append_path(cr, &path) \
path.data = NULL, path.num_data = 0, path.status = CAIRO_STATUS_SUCCESS)
These tests do not appear in newer cairo versions and the thought is to disable them (bug 2353).
Two additional failures are showing up in the newest distributions (OpenSuSE 11.1 (cairo-1.7.4), Fedora 10 (cairo-1.7.4)):
surface-finish-twice-image 0 FAIL Error: Function under test failed surface-finish-twice-xlib 1 FAIL Error: Function under test failed
I'm not finding 1.7.4 source, but a diff of the 1.0.2 test code with 1.6.4 only shows test API changes. A diff with 1.8.0 does show:
- if (cairo_surface_status (surface) != CAIRO_STATUS_SURFACE_FINISHED)
+ if (cairo_surface_status (surface) != CAIRO_STATUS_SUCCESS)
+ return CAIRO_TEST_FAILURE;
+
+ cairo_surface_finish (surface);
+ if (cairo_surface_status (surface) != CAIRO_STATUS_SUCCESS)
return CAIRO_TEST_FAILURE;
Checking for only CAIRO_STATUS_SUCCESS fails on older versions of cairo. It looks like this is simply a regression test by the comments, so perhaps it should be disabled too:
* Subject: [Bug 2950] New: *** glibc detected *** double free or corruption * URL: https://bugs.freedesktop.org/show_bug.cgi?id=2950 * * The following short program gives the error message: * * *** glibc detected *** double free or corruption: 0x082a7268 *** * Aborted * * 2005-04-13 Carl Worth <cworth@cworth.org> * * Looks like surface->finished was never being set. Now fixed.
The 4 tests mentioned above have been disabled in post-beta snapshot builds and should not show up the the RCs or final test suites.
gtk
Seeing a number of GtkTreeSelection failures on some distributions. This appears to be from a patch added to upstream and is tracked in bug 2170:
/tests/functions/GtkTreeSelection/GtkTreeSelection 45 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 46 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 47 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 48 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 49 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 50 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 51 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 52 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 53 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 54 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 55 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 56 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 57 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 58 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 59 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 60 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 61 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 62 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 63 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 64 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 65 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 66 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 67 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 68 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 69 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 170 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 171 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 172 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 173 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 174 FAIL /tests/functions/GtkTreeSelection/GtkTreeSelection 175 FAIL
Seeing a number of failures with GtkAdjustment, GtkSpinButton, MainLoop on distribuitions shipping gtk-2.14.0. This is tracked in bug 2380 and would appear to be a regression in 2.14.x with x < 3, as 2.14.3 system do not show the failures. Typical results (F10 beta):
/tests/functions/GtkAdjustment/GtkAdjustment 61 FAIL /tests/functions/GtkAdjustment/GtkAdjustment 62 FAIL /tests/functions/GtkAdjustment/GtkAdjustment 63 FAIL /tests/functions/GtkAdjustment/GtkAdjustment 69 FAIL /tests/functions/GtkAdjustment/GtkAdjustment 72 FAIL /tests/functions/GtkAdjustment/GtkAdjustment 73 FAIL /tests/functions/GtkAdjustment/GtkAdjustment 74 FAIL /tests/functions/GtkAdjustment/GtkAdjustment 75 FAIL /tests/functions/GtkSpinButton/GtkSpinButton 48 FAIL /tests/functions/MainLoop/MainLoop 6 FAIL /tests/functions/MainLoop/MainLoop 7 FAIL
Seeing tests return UNRESOLVED with SIGSEGV on 2.14.0+ based systems. This is tracked in bug 2379. Root cause has not yet been determined. A modification has been applied to the tests to let the tests run and a bug has been filed with upstream, but it's not yet clear whether it's a test or gtk issue. Results are not consistent as to which subtest may fail, but a typical run (Mandriva 2009.0) might look like this:
/tests/functions/GtkFileSelection/GtkFileSelection 2 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 5 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 8 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 9 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 10 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 12 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 13 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 15 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 16 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 17 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 18 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 19 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 20 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 21 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 22 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 23 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 24 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 25 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 26 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 27 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 28 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 29 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 30 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 31 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 32 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 33 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 34 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 35 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 36 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 37 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 38 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 39 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 40 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 41 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 42 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 43 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 44 UNRESOLVED /tests/functions/GtkFileSelection/GtkFileSelection 45 UNRESOLVED /tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 4 UNRESOLVED /tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 8 UNRESOLVED /tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 9 UNRESOLVED /tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 10 UNRESOLVED /tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 11 UNRESOLVED /tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 12 UNRESOLVED /tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 13 UNRESOLVED /tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 14 UNRESOLVED /tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 15 UNRESOLVED /tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 16 UNRESOLVED /tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 17 UNRESOLVED /tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 18 UNRESOLVED /tests/functions/GtkFontSelectionDialog/GtkFontSelectionDialog 19 UNRESOLVED
qt4
These failed on Fedora 9 / x86_64:
tst_QColor_setNamedColor 4 FAIL tst_QIcon_isNull 3 FAIL tst_QItemSelectionModel_selectedRows 10 FAIL tst_QLineEdit_selectedText 30 FAIL tst_QPixmapCache_cacheLimit 1 FAIL tst_QTextDocumentFragment_html_anchorColor 112 FAIL tst_QTreeView_construction 2 FAIL tst_QTreeView_itemDelegate 14 FAIL tst_QUuid_less 6 FAIL
desktop-t2c test
These failed on Fedora 9 / x86_64 and were not marked as "known".
/gdk-pixbuf-t2c/tests/FileSaving/FileSaving 29 UNRESOLVED /gdk-pixbuf-t2c/tests/FileSaving/FileSaving 30 UNRESOLVED /gdk-pixbuf-t2c/tests/FileSaving/FileSaving 31 UNRESOLVED /gdk-pixbuf-t2c/tests/FileSaving/FileSaving 32 UNRESOLVED /gdk-pixbuf-t2c/tests/FileSaving/FileSaving 33 UNRESOLVED /gdk-pixbuf-t2c/tests/FileSaving/FileSaving 34 UNRESOLVED /gdk-pixbuf-t2c/tests/GdkPixbufLoader_external/GdkPixbufLoader_external 1 UNINITIATED /gdk-pixbuf-t2c/tests/GdkPixbufLoader_external/GdkPixbufLoader_external 2 UNINITIATED /gdk-pixbuf-t2c/tests/GdkPixbufLoader_external/GdkPixbufLoader_external 3 UNINITIATED /gdk-pixbuf-t2c/tests/ModuleInterface_external/ModuleInterface_external 1 UNINITIATED /gdk-pixbuf-t2c/tests/ModuleInterface_external/ModuleInterface_external 2 UNINITIATED /gdk-pixbuf-t2c/tests/ModuleInterface_external/ModuleInterface_external 3 UNINITIATED /gdk-pixbuf-t2c/tests/ModuleInterface_external/ModuleInterface_external 4 UNINITIATED /gdk-pixbuf-t2c/tests/ModuleInterface_external/ModuleInterface_external 5 UNINITIATED /gdk-pixbuf-t2c/tests/ModuleInterface_external/ModuleInterface_external 6 UNINITIATED /gdk-pixbuf-t2c/tests/ModuleInterface_external/ModuleInterface_external 7 UNINITIATED /gdk-pixbuf-t2c/tests/ModuleInterface_external/ModuleInterface_external 8 UNINITIATED /gdk-pixbuf-t2c/tests/ModuleInterface_external/ModuleInterface_external 9 UNINITIATED /glib-t2c/tests/glib_key_parser/glib_key_parser 82 FAIL /glib-t2c/tests/glib_key_parser/glib_key_parser 83 FAIL /glib-t2c/tests/glib_key_parser/glib_key_parser 84 FAIL /glib-t2c/tests/glib_key_parser/glib_key_parser 106 FAIL /glib-t2c/tests/glib_key_parser/glib_key_parser 107 FAIL /glib-t2c/tests/glib_key_parser/glib_key_parser 108 FAIL /glib-t2c/tests/glib_key_parser/glib_key_parser 114 FAIL
cpp-tc2 test
These failed on Fedora 9/x86_64 and were not marked as "Known". Exactly the same set of failures was also observed on SLES 11/x86.
/libstdcxx-t2c/tests/codecvt/codecvt 24 FAIL /libstdcxx-t2c/tests/codecvt/codecvt 27 FAIL /libstdcxx-t2c/tests/codecvt/codecvt 29 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 3 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 4 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 5 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 8 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 9 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 10 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 13 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 14 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 15 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 18 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 19 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 20 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 23 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 24 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 25 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 28 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 29 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 30 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 33 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 34 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 35 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 38 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 39 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 40 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 43 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 44 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 47 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 48 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 52 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 53 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 57 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 58 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 62 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 63 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 67 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 68 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 72 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 73 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 77 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 78 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 81 FAIL /libstdcxx-t2c/tests/num_get_do_get4/num_get_do_get4 84 FAIL /libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 4 FAIL /libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 7 FAIL /libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 12 FAIL /libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 15 FAIL /libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 20 FAIL /libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 23 FAIL /libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 28 FAIL /libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 31 FAIL /libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 36 FAIL /libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 39 FAIL /libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 44 FAIL /libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 47 FAIL /libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 52 FAIL /libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 55 FAIL /libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 60 FAIL /libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 63 FAIL /libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 68 FAIL /libstdcxx-t2c/tests/num_get_do_get5/num_get_do_get5 73 FAIL /libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 15 FAIL /libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 16 FAIL /libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 21 FAIL /libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 22 FAIL /libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 28 FAIL /libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 29 FAIL /libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 31 FAIL /libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 32 FAIL /libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 33 FAIL /libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 34 FAIL /libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 35 FAIL /libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 36 FAIL /libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 37 FAIL /libstdcxx-t2c/tests/num_get_do_get6/num_get_do_get6 38 FAIL /libstdcxx-t2c/tests/num_put_do_put5/num_put_do_put5 9 FAIL /libstdcxx-t2c/tests/num_put_do_put5/num_put_do_put5 18 FAIL /libstdcxx-t2c/tests/num_put_do_put7/num_put_do_put7 55 FAIL /libstdcxx-t2c/tests/num_put_do_put7/num_put_do_put7 58 FAIL /libstdcxx-t2c/tests/num_put_do_put7/num_put_do_put7 61 FAIL /libstdcxx-t2c/tests/num_put_do_put7/num_put_do_put7 64 FAIL /libstdcxx-t2c/tests/time_get/time_get 37 FAIL /libstdcxx-t2c/tests/time_get/time_get 38 FAIL /libstdcxx-t2c/tests/time_get/time_get 39 FAIL /libstdcxx-t2c/tests/time_get/time_get 40 FAIL
olver-core test
azov-qt3 test
WIth version 1.0-2, the number of unresolved tests considerably reduced. On Fedora 9 / x86_64, still see:
/Qt3_OpenGL-t2c/tests/QGLWidget/QGLWidget 6 Unresolved Messages from the test Target interface(s): QGLWidget::grabFrameBuffer(bool) -------- unexpected signal 11 (SIGSEGV) received /Qt3_OpenGL-t2c/tests/QGLWidget/QGLWidget 21 Unresolved Messages from the test Target interface(s): QGLWidget::renderText(double, double, double, QString const&, QFont const&, int) -------- unexpected signal 4 (SIGILL) received /Qt3_OpenGL-t2c/tests/QGLWidget/QGLWidget 41 Unresolved Messages from the test Target interface(s): QGLWidget::renderText(int, int, QString const&, QFont const&, int) -------- unexpected signal 11 (SIGSEGV) received /Qt3_OpenGL-t2c/tests/QGLContext/QGLContext 16 Unresolved Messages from the test Target interface(s): QGLContext::generateFontDisplayLists(QFont const&, int) -------- unexpected signal 11 (SIGSEGV) received
azov-qt4 test
With version 1.0-2, the number of unresolveds greatly reduced. On Fedora 9 / x86_64 still see:
/Qt4_Dialogs-t2c/tests/QFileDialog/QFileDialog 16 Unresolved Messages from the test Target interface(s): QFileDialog::resolveSymlinks() const -------- Child process was terminated by signal 6. Abnormal child process termination. errno: 22. /Qt4_Dialogs-t2c/tests/QFileDialog/QFileDialog 22 Unresolved Messages from the test Target interface(s): QFileDialog::currentChanged(QString const&) -------- unexpected signal 11 (SIGSEGV) received