11-check_regression/baseline.xfail | 91 +++++++++++ 11-check_regression/console.log.xz | Bin 0 -> 3752 bytes 11-check_regression/fails.sum | 6 + 11-check_regression/flaky.xfail | 319 +++++++++++++++++++++++++++++++++++++ README.html | 117 +------------- README.txt | 116 +------------- 6 files changed, 421 insertions(+), 228 deletions(-) diff --git a/11-check_regression/baseline.xfail b/11-check_regression/baseline.xfail new file mode 100644 index 000000000..c081dc304 --- /dev/null +++ b/11-check_regression/baseline.xfail @@ -0,0 +1,91 @@ + === gotools tests === + +Running gotools:carchive ... +FAIL: go test misc/cgo/testcarchive + +Running gotools:cgo ... +FAIL: go test misc/cgo/test + +Running gotools:cmd/go ... +FAIL: go test cmd/go + +Running gotools:cmd/vet ... +FAIL: go test cmd/vet + +Running gotools:embed ... +FAIL: go test embed/internal/embedtest + +Running gotools:runtime ... +FAIL: TestAbort +FAIL: TestAbortInCgo +FAIL: TestBigGOMAXPROCS +FAIL: TestBreakpoint +FAIL: TestCatchPanic +FAIL: TestCgoCCodeSIGPROF +FAIL: TestCgoCallbackGC +FAIL: TestCgoCheckBytes +FAIL: TestCgoCrashHandler +FAIL: TestCgoExecSignalMask +FAIL: TestCgoExternalThreadPanic +FAIL: TestCgoExternalThreadSIGPROF +FAIL: TestCgoExternalThreadSignal +FAIL: TestCgoLockOSThreadExit +FAIL: TestCgoNumGoroutine +FAIL: TestCgoPanicCallback +FAIL: TestCgoPanicDeadlock +FAIL: TestCgoPprofCallback +FAIL: TestCgoSignalDeadlock +FAIL: TestCgoTraceback +FAIL: TestCgoTracebackSigpanic +FAIL: TestCrashDumpsAllThreads +FAIL: TestCrashHandler +FAIL: TestDeferLiveness +FAIL: TestDoublePanic +FAIL: TestEINTR +FAIL: TestEnsureDropM +FAIL: TestGCFairness +FAIL: TestGCFairness2 +FAIL: TestGccgoCrashTraceback +FAIL: TestGccgoCrashTracebackNodebug +FAIL: TestGoNil +FAIL: TestGoexitCrash +FAIL: TestGoexitDeadlock +FAIL: TestGoexitInPanic +FAIL: TestInitDeadlock +FAIL: TestLargeStringConcat +FAIL: TestLockOSThreadAvoidsStatePropagation +FAIL: TestLockOSThreadExit +FAIL: TestLockOSThreadTemplateThreadRace +FAIL: TestLockedDeadlock +FAIL: TestLockedDeadlock2 +FAIL: TestMainGoroutineID +FAIL: TestNeedmDeadlock +FAIL: TestNetpollDeadlock +FAIL: TestNoHelperGoroutines +FAIL: TestNumGoroutine +FAIL: TestPanicAfterGoexit +FAIL: TestPanicDeadlockGosched +FAIL: TestPanicDeadlockSyscall +FAIL: TestPanicLoop +FAIL: TestPanicRace +FAIL: TestPanicTraceback +FAIL: TestPanicWithDirectlyPrintableCustomTypes +FAIL: TestPhysicalMemoryUtilization +FAIL: TestRecoverBeforePanicAfterGoexit +FAIL: TestRecoverBeforePanicAfterGoexit2 +FAIL: TestRecoveredPanicAfterGoexit +FAIL: TestRecursivePanic +FAIL: TestRecursivePanic2 +FAIL: TestRecursivePanic3 +FAIL: TestRecursivePanic4 +FAIL: TestRecursivePanic5 +FAIL: TestSegv +FAIL: TestSigStackSwapping +FAIL: TestSignalDuringExec +FAIL: TestSignalExitStatus +FAIL: TestSignalIgnoreSIGTRAP +FAIL: TestSimpleDeadlock +FAIL: TestSpuriousWakeupsNeverHangSemasleep +FAIL: TestThreadExhaustion +FAIL: TestVDSO +FAIL: go test runtime diff --git a/11-check_regression/console.log.xz b/11-check_regression/console.log.xz new file mode 100644 index 000000000..3f4757eff Binary files /dev/null and b/11-check_regression/console.log.xz differ diff --git a/11-check_regression/fails.sum b/11-check_regression/fails.sum new file mode 100644 index 000000000..784114113 --- /dev/null +++ b/11-check_regression/fails.sum @@ -0,0 +1,6 @@ + + === Results Summary === + +# of stable fails 78 +# of flaky entries 233 +# of all tests 48397 diff --git a/11-check_regression/flaky.xfail b/11-check_regression/flaky.xfail new file mode 100644 index 000000000..fedaf409d --- /dev/null +++ b/11-check_regression/flaky.xfail @@ -0,0 +1,319 @@ +################################ +# New flaky tests +# From https://ci.linaro.org/job/tcwg_gnu_native_fast_check_gcc--master-aarch64-build/1231/: + === g++ tests === + +Running g++:g++.dg/analyzer/analyzer.exp ... +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-default.C -std=c++14 at line 12 (test for warnings, line 11) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-default.C -std=c++14 at line 17 (test for warnings, line 10) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-default.C -std=c++14 at line 18 (test for warnings, line 11) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-default.C -std=c++14 at line 19 (test for warnings, line 11) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-default.C -std=c++14 at line 20 (test for warnings, line 11) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-default.C -std=c++14 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-default.C -std=c++17 at line 12 (test for warnings, line 11) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-default.C -std=c++17 at line 18 (test for warnings, line 11) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-default.C -std=c++17 at line 19 (test for warnings, line 11) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-default.C -std=c++17 at line 20 (test for warnings, line 11) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-default.C -std=c++17 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-no.C -std=c++14 at line 13 (test for warnings, line 12) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-no.C -std=c++14 at line 18 (test for warnings, line 11) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-no.C -std=c++14 at line 19 (test for warnings, line 12) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-no.C -std=c++14 at line 20 (test for warnings, line 12) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-no.C -std=c++14 at line 21 (test for warnings, line 12) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-no.C -std=c++14 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-no.C -std=c++17 at line 13 (test for warnings, line 12) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-no.C -std=c++17 at line 19 (test for warnings, line 12) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-no.C -std=c++17 at line 20 (test for warnings, line 12) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-no.C -std=c++17 at line 21 (test for warnings, line 12) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers-no.C -std=c++17 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers.C -std=c++17 at line 12 (test for warnings, line 11) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers.C -std=c++17 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers.C -std=c++17 telltale event that we are going within a deeper frame than 'main' (test for warnings, line 9) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers.C -std=c++26 at line 12 (test for warnings, line 11) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/fanalyzer-show-events-in-system-headers.C -std=c++26 telltale event that we are going within a deeper frame than 'main' (test for warnings, line 9) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/unique_ptr-1.C -std=c++11 (test for warnings, line 11) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/unique_ptr-1.C -std=c++11 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/unique_ptr-1.C -std=c++17 (test for warnings, line 11) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/unique_ptr-1.C -std=c++17 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/unique_ptr-1.C -std=c++26 (test for warnings, line 11) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/unique_ptr-1.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/unique_ptr-2.C -std=c++11 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/unique_ptr-2.C -std=c++17 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/analyzer/unique_ptr-2.C -std=c++26 (test for excess errors) + +Running g++:g++.dg/coroutines/torture/coro-torture.exp ... +flaky,expire=20251008 | FAIL: g++.dg/coroutines/torture/func-params-07.C -O3 -g execution test +flaky,expire=20251008 | FAIL: g++.dg/coroutines/torture/pr103953.C -O2 execution test +flaky,expire=20251008 | FAIL: g++.dg/coroutines/torture/pr103953.C -O3 -g execution test + +Running g++:g++.dg/dg.exp ... +flaky,expire=20251008 | FAIL: g++.dg/coroutines/pr100772-b.C -std=c++20 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/coroutines/pr100772-b.C -std=c++23 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/coroutines/pr100772-b.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/coroutines/pr108620.C -std=c++20 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/coroutines/pr108620.C -std=c++23 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/coroutines/pr108620.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/coroutines/pr95823.C -std=c++20 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/coroutines/pr95823.C -std=c++23 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/coroutines/pr95823.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/cpp0x/initlist48.C -std=c++11 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/cpp0x/initlist48.C -std=c++17 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/cpp0x/initlist48.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/cpp1y/pr57640.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/cpp1z/decomp37.C -std=c++17 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/cpp1z/decomp37.C -std=c++20 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/cpp1z/decomp37.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/cpp26/constexpr-new2.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/diagnostic/pr65923.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | XPASS: g++.dg/ipa/devirt-23.C -std=gnu++17 scan-ipa-dump cp "Discovered a virtual call to" +flaky,expire=20251008 | XPASS: g++.dg/ipa/devirt-23.C -std=gnu++26 scan-ipa-dump cp "Discovered a virtual call to" +flaky,expire=20251008 | XPASS: g++.dg/ipa/devirt-23.C -std=gnu++98 scan-ipa-dump cp "Discovered a virtual call to" +flaky,expire=20251008 | FAIL: g++.dg/ipa/pr67056.C (test for excess errors) +flaky,expire=20251008 | UNRESOLVED: g++.dg/ipa/pr67056.C compilation failed to produce executable +flaky,expire=20251008 | UNRESOLVED: g++.dg/ipa/pr67056.C scan-ipa-dump cp "Speculative outer type:struct CompositeClass" +flaky,expire=20251008 | FAIL: g++.dg/opt/pr103989.C -std=gnu++17 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/opt/pr103989.C -std=gnu++20 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/opt/pr103989.C -std=gnu++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/tree-ssa/pr95638.C (test for excess errors) +flaky,expire=20251008 | UNRESOLVED: g++.dg/tree-ssa/pr95638.C compilation failed to produce executable +flaky,expire=20251008 | FAIL: g++.dg/warn/Wfree-nonheap-object-3.C -std=gnu++11 (test for warnings, line 13) +flaky,expire=20251008 | FAIL: g++.dg/warn/Wfree-nonheap-object-3.C -std=gnu++11 (test for warnings, line 20) +flaky,expire=20251008 | FAIL: g++.dg/warn/Wfree-nonheap-object-3.C -std=gnu++11 (test for warnings, line 25) +flaky,expire=20251008 | FAIL: g++.dg/warn/Wfree-nonheap-object-3.C -std=gnu++11 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/warn/Wfree-nonheap-object-3.C -std=gnu++17 (test for warnings, line 13) +flaky,expire=20251008 | FAIL: g++.dg/warn/Wfree-nonheap-object-3.C -std=gnu++17 (test for warnings, line 20) +flaky,expire=20251008 | FAIL: g++.dg/warn/Wfree-nonheap-object-3.C -std=gnu++17 (test for warnings, line 25) +flaky,expire=20251008 | FAIL: g++.dg/warn/Wfree-nonheap-object-3.C -std=gnu++17 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/warn/Wfree-nonheap-object-3.C -std=gnu++26 (test for warnings, line 13) +flaky,expire=20251008 | FAIL: g++.dg/warn/Wfree-nonheap-object-3.C -std=gnu++26 (test for warnings, line 20) +flaky,expire=20251008 | FAIL: g++.dg/warn/Wfree-nonheap-object-3.C -std=gnu++26 (test for warnings, line 25) +flaky,expire=20251008 | FAIL: g++.dg/warn/Wfree-nonheap-object-3.C -std=gnu++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/warn/Wuninitialized-33.C -std=gnu++17 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/warn/Wuninitialized-33.C -std=gnu++20 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/warn/Wuninitialized-33.C -std=gnu++26 (test for excess errors) +flaky,expire=20251008 | XPASS: g++.dg/warn/Wuninitialized-pr107919-1.C -std=gnu++17 at line 17 (test for bogus messages, line ) +flaky,expire=20251008 | FAIL: g++.dg/warn/Wuninitialized-pr107919-1.C -std=gnu++17 (test for excess errors) +flaky,expire=20251008 | XPASS: g++.dg/warn/Wuninitialized-pr107919-1.C -std=gnu++20 at line 17 (test for bogus messages, line ) +flaky,expire=20251008 | FAIL: g++.dg/warn/Wuninitialized-pr107919-1.C -std=gnu++20 (test for excess errors) +flaky,expire=20251008 | XPASS: g++.dg/warn/Wuninitialized-pr107919-1.C -std=gnu++26 at line 17 (test for bogus messages, line ) +flaky,expire=20251008 | FAIL: g++.dg/warn/Wuninitialized-pr107919-1.C -std=gnu++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/warn/anonymous-namespace-3.C -std=c++11 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/warn/anonymous-namespace-3.C -std=c++17 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/warn/uninit-pr105562.C -std=gnu++11 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/warn/uninit-pr105562.C -std=gnu++17 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/warn/uninit-pr105562.C -std=gnu++26 (test for excess errors) + +Running g++:g++.dg/hwasan/hwasan.exp ... +flaky,expire=20251008 | FAIL: c-c++-common/hwasan/unprotected-allocas-1.c -O3 -g scan-assembler-not __hwasan_tag_memory +flaky,expire=20251008 | FAIL: c-c++-common/hwasan/unprotected-allocas-1.c -O3 -g execution test + +Running g++:g++.dg/lto/lto.exp ... +flaky,expire=20251008 | FAIL: g++.dg/lto/devirt-23 cp_lto_devirt-23_0.o-cp_lto_devirt-23_0.o execute -O3 -fno-early-inlining -fno-ipa-sra -fdump-ipa-cp -flto -fno-devirtualize-speculatively +flaky,expire=20251008 | FAIL: g++.dg/lto/pr118817 cp_lto_pr118817_0.o assemble, -O3 -fPIC -flto -shared -std=c++20 -Wall +flaky,expire=20251008 | UNRESOLVED: g++.dg/lto/pr118817 cp_lto_pr118817_0.o-cp_lto_pr118817_0.o execute -O3 -fPIC -flto -shared -std=c++20 -Wall +flaky,expire=20251008 | UNRESOLVED: g++.dg/lto/pr118817 cp_lto_pr118817_0.o-cp_lto_pr118817_0.o link -O3 -fPIC -flto -shared -std=c++20 -Wall +flaky,expire=20251008 | FAIL: g++.dg/lto/pr66180 cp_lto_pr66180_0.o assemble, -flto -std=c++14 -r -nostdlib +flaky,expire=20251008 | UNRESOLVED: g++.dg/lto/pr66180 cp_lto_pr66180_0.o-cp_lto_pr66180_1.o execute -flto -std=c++14 -r -nostdlib +flaky,expire=20251008 | UNRESOLVED: g++.dg/lto/pr66180 cp_lto_pr66180_0.o-cp_lto_pr66180_1.o link -flto -std=c++14 -r -nostdlib +flaky,expire=20251008 | FAIL: g++.dg/lto/pr66180 cp_lto_pr66180_1.o assemble, -flto -std=c++14 -r -nostdlib + +Running g++:g++.dg/modules/modules.exp ... +flaky,expire=20251008 | FAIL: g++.dg/modules/gmf-xtreme.C -std=c++26 scan-lang-dump module "Wrote 0 clusters" +flaky,expire=20251008 | FAIL: g++.dg/modules/gmf-xtreme.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/gmf-xtreme.C module-cmi empty (gcm.cache/empty.gcm) +flaky,expire=20251008 | FAIL: g++.dg/modules/pr99425-2_b.X -std=c++17 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/pr99425-2_b.X -std=c++20 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/pr99425-2_b.X -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-2_a.H -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-2_a.H module-cmi (gcm.cache/$srcdir/g++.dg/modules/xtreme-header-2_a.H.gcm) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-2_b.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-2_c.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-4_a.H -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-4_a.H module-cmi (gcm.cache/$srcdir/g++.dg/modules/xtreme-header-4_a.H.gcm) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-4_b.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-4_c.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-5_a.H -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-5_a.H module-cmi (gcm.cache/$srcdir/g++.dg/modules/xtreme-header-5_a.H.gcm) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-5_b.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-5_c.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-6_a.H -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-6_a.H module-cmi (gcm.cache/$srcdir/g++.dg/modules/xtreme-header-6_a.H.gcm) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-6_b.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-6_c.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-7_a.H -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-7_a.H module-cmi (gcm.cache/$srcdir/g++.dg/modules/xtreme-header-7_a.H.gcm) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-7_b.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-8.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header-8.C module-cmi xstd (gcm.cache/xstd.gcm) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header_a.H -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header_a.H module-cmi (gcm.cache/$srcdir/g++.dg/modules/xtreme-header_a.H.gcm) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-header_b.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-tr1_a.H -std=c++26 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-tr1_a.H module-cmi (gcm.cache/$srcdir/g++.dg/modules/xtreme-tr1_a.H.gcm) +flaky,expire=20251008 | FAIL: g++.dg/modules/xtreme-tr1_b.C -std=c++26 (test for excess errors) + +Running g++:g++.dg/torture/dg-torture.exp ... +flaky,expire=20251008 | FAIL: c-c++-common/torture/pr116156-1.c -O1 (test for excess errors) +flaky,expire=20251008 | FAIL: c-c++-common/torture/pr116156-1.c -O2 (test for excess errors) +flaky,expire=20251008 | FAIL: c-c++-common/torture/pr116156-1.c -O2 -flto -fno-use-linker-plugin -flto-partition=none (test for excess errors) +flaky,expire=20251008 | FAIL: c-c++-common/torture/pr116156-1.c -O3 -fomit-frame-pointer -funroll-loops -fpeel-loops -ftracer -finline-functions (test for excess errors) +flaky,expire=20251008 | FAIL: c-c++-common/torture/pr116156-1.c -O3 -g (test for excess errors) +flaky,expire=20251008 | FAIL: c-c++-common/torture/pr116156-1.c -Os (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/torture/pr111019.C -O0 (test for excess errors) +flaky,expire=20251008 | UNRESOLVED: g++.dg/torture/pr111019.C -O0 compilation failed to produce executable +flaky,expire=20251008 | FAIL: g++.dg/torture/pr111019.C -O1 (test for excess errors) +flaky,expire=20251008 | UNRESOLVED: g++.dg/torture/pr111019.C -O1 compilation failed to produce executable +flaky,expire=20251008 | FAIL: g++.dg/torture/pr111019.C -O2 (test for excess errors) +flaky,expire=20251008 | UNRESOLVED: g++.dg/torture/pr111019.C -O2 compilation failed to produce executable +flaky,expire=20251008 | FAIL: g++.dg/torture/pr111019.C -O2 -flto -fno-use-linker-plugin -flto-partition=none (test for excess errors) +flaky,expire=20251008 | UNRESOLVED: g++.dg/torture/pr111019.C -O2 -flto -fno-use-linker-plugin -flto-partition=none compilation failed to produce executable +flaky,expire=20251008 | FAIL: g++.dg/torture/pr111019.C -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects (test for excess errors) +flaky,expire=20251008 | UNRESOLVED: g++.dg/torture/pr111019.C -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects compilation failed to produce executable +flaky,expire=20251008 | FAIL: g++.dg/torture/pr111019.C -O3 -fomit-frame-pointer -funroll-loops -fpeel-loops -ftracer -finline-functions (test for excess errors) +flaky,expire=20251008 | UNRESOLVED: g++.dg/torture/pr111019.C -O3 -fomit-frame-pointer -funroll-loops -fpeel-loops -ftracer -finline-functions compilation failed to produce executable +flaky,expire=20251008 | FAIL: g++.dg/torture/pr111019.C -O3 -g (test for excess errors) +flaky,expire=20251008 | UNRESOLVED: g++.dg/torture/pr111019.C -O3 -g compilation failed to produce executable +flaky,expire=20251008 | FAIL: g++.dg/torture/pr111019.C -Os (test for excess errors) +flaky,expire=20251008 | UNRESOLVED: g++.dg/torture/pr111019.C -Os compilation failed to produce executable +flaky,expire=20251008 | FAIL: g++.dg/torture/pr58552.C -O1 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/torture/pr58552.C -O2 (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/torture/pr58552.C -O2 -flto -fno-use-linker-plugin -flto-partition=none (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/torture/pr58552.C -O3 -g (test for excess errors) +flaky,expire=20251008 | FAIL: g++.dg/torture/pr58552.C -Os (test for excess errors) + +Running g++:g++.dg/tsan/tsan.exp ... +flaky,expire=20251008 | FAIL: g++.dg/tsan/pthread_cond_clockwait.C -O0 (test for excess errors) +flaky,expire=20251008 | UNRESOLVED: g++.dg/tsan/pthread_cond_clockwait.C -O0 compilation failed to produce executable +flaky,expire=20251008 | FAIL: g++.dg/tsan/pthread_cond_clockwait.C -O2 (test for excess errors) +flaky,expire=20251008 | UNRESOLVED: g++.dg/tsan/pthread_cond_clockwait.C -O2 compilation failed to produce executable + +Running g++:g++.dg/vect/vect.exp ... +flaky,expire=20251008 | FAIL: g++.dg/vect/pr64410.cc -std=c++17 scan-tree-dump vect "vectorized 1 loops in function" +flaky,expire=20251008 | FAIL: g++.dg/vect/pr64410.cc -std=c++26 scan-tree-dump vect "vectorized 1 loops in function" + +Running g++:g++.old-deja/old-deja.exp ... +flaky,expire=20251008 | FAIL: g++.old-deja/g++.other/headers1.C -std=c++17 (test for excess errors) +flaky,expire=20251008 | UNRESOLVED: g++.old-deja/g++.other/headers1.C -std=c++17 compilation failed to produce executable +flaky,expire=20251008 | FAIL: g++.old-deja/g++.other/headers1.C -std=c++26 (test for excess errors) +flaky,expire=20251008 | UNRESOLVED: g++.old-deja/g++.other/headers1.C -std=c++26 compilation failed to produce executable + === gcc tests === + +Running gcc:gcc.dg/dg.exp ... +flaky,expire=20251008 | FAIL: gcc.dg/pthread-init-1.c (test for excess errors) +flaky,expire=20251008 | FAIL: gcc.dg/pthread-init-2.c (test for excess errors) +flaky,expire=20251008 | FAIL: gcc.dg/vla-1.c scan-tree-dump-times optimized " s=> i" 2 + +Running gcc:gcc.dg/guality/guality.exp ... +flaky,expire=20251008 | FAIL: gcc.dg/guality/pr41447-1.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION execution test + +Running gcc:gcc.dg/hwasan/hwasan.exp ... +flaky,expire=20251008 | FAIL: c-c++-common/hwasan/unprotected-allocas-1.c -O3 -g scan-assembler-not __hwasan_tag_memory +flaky,expire=20251008 | FAIL: c-c++-common/hwasan/unprotected-allocas-1.c -O3 -g execution test + +Running gcc:gcc.dg/torture/dg-torture.exp ... +flaky,expire=20251008 | FAIL: c-c++-common/torture/pr116156-1.c -O1 (test for excess errors) +flaky,expire=20251008 | FAIL: c-c++-common/torture/pr116156-1.c -O2 (test for excess errors) +flaky,expire=20251008 | FAIL: c-c++-common/torture/pr116156-1.c -O2 -flto -fno-use-linker-plugin -flto-partition=none (test for excess errors) +flaky,expire=20251008 | FAIL: c-c++-common/torture/pr116156-1.c -O3 -fomit-frame-pointer -funroll-loops -fpeel-loops -ftracer -finline-functions (test for excess errors) +flaky,expire=20251008 | FAIL: c-c++-common/torture/pr116156-1.c -O3 -g (test for excess errors) +flaky,expire=20251008 | FAIL: c-c++-common/torture/pr116156-1.c -Os (test for excess errors) + +Running gcc:gcc.dg/tree-prof/tree-prof.exp ... +flaky,expire=20251008 | UNRESOLVED: gcc.dg/tree-prof/afdo-crossmodule-1b.c compilation, -fauto-profile -DFOR_AUTOFDO_TESTING -fearly-inlining +flaky,expire=20251008 | FAIL: gcc.dg/tree-prof/afdo-crossmodule-1b.c compilation, -fprofile-generate -D_PROFILE_GENERATE +flaky,expire=20251008 | UNRESOLVED: gcc.dg/tree-prof/afdo-crossmodule-1b.c compilation, -fprofile-use -D_PROFILE_USE +flaky,expire=20251008 | FAIL: gcc.dg/tree-prof/afdo-crossmodule-1b.c compilation, -g -DFOR_AUTOFDO_TESTING +flaky,expire=20251008 | UNRESOLVED: gcc.dg/tree-prof/afdo-crossmodule-1b.c execution, -fauto-profile -DFOR_AUTOFDO_TESTING -fearly-inlining +flaky,expire=20251008 | UNRESOLVED: gcc.dg/tree-prof/afdo-crossmodule-1b.c execution, -fprofile-generate -D_PROFILE_GENERATE +flaky,expire=20251008 | UNRESOLVED: gcc.dg/tree-prof/afdo-crossmodule-1b.c execution, -fprofile-use -D_PROFILE_USE +flaky,expire=20251008 | UNRESOLVED: gcc.dg/tree-prof/afdo-crossmodule-1b.c execution, -g -DFOR_AUTOFDO_TESTING + +Running gcc:gcc.dg/tree-ssa/tree-ssa.exp ... +flaky,expire=20251008 | FAIL: gcc.dg/tree-ssa/cswtch-6.c scan-assembler .rodata.cst16 +flaky,expire=20251008 | FAIL: gcc.dg/tree-ssa/pr81627.c scan-tree-dump-times pcom "Store-stores chain" 1 +flaky,expire=20251008 | FAIL: gcc.dg/tree-ssa/predcom-8.c scan-tree-dump-not pcom "Invalid sum" + +Running gcc:gcc.dg/vect/complex/complex.exp ... +flaky,expire=20251008 | FAIL: gcc.dg/vect/complex/fast-math-complex-mls-double.c -flto -ffat-lto-objects scan-tree-dump vect "Found COMPLEX_ADD_ROT270" +flaky,expire=20251008 | FAIL: gcc.dg/vect/complex/fast-math-complex-mls-double.c scan-tree-dump vect "Found COMPLEX_ADD_ROT270" +flaky,expire=20251008 | FAIL: gcc.dg/vect/complex/fast-math-complex-mls-float.c -flto -ffat-lto-objects scan-tree-dump vect "Found COMPLEX_ADD_ROT270" +flaky,expire=20251008 | FAIL: gcc.dg/vect/complex/fast-math-complex-mls-float.c scan-tree-dump vect "Found COMPLEX_ADD_ROT270" +flaky,expire=20251008 | FAIL: gcc.dg/vect/complex/fast-math-complex-mls-half-float.c -flto -ffat-lto-objects scan-tree-dump vect "Found COMPLEX_ADD_ROT270" +flaky,expire=20251008 | FAIL: gcc.dg/vect/complex/fast-math-complex-mls-half-float.c scan-tree-dump vect "Found COMPLEX_ADD_ROT270" + +Running gcc:gcc.dg/vect/vect.exp ... +flaky,expire=20251008 | FAIL: gcc.dg/vect/vect-early-break_39.c -flto -ffat-lto-objects scan-tree-dump-times vect "vectorized 1 loops in function" 0 +flaky,expire=20251008 | FAIL: gcc.dg/vect/vect-early-break_39.c scan-tree-dump-times vect "vectorized 1 loops in function" 0 +flaky,expire=20251008 | XPASS: gcc.dg/vect/vect-fncall-mask-math.c -flto -ffat-lto-objects scan-tree-dump-not ifcvt " gimple_call " +flaky,expire=20251008 | XPASS: gcc.dg/vect/vect-fncall-mask-math.c scan-tree-dump-not ifcvt " gimple_call " + +Running gcc:gcc.misc-tests/gcov.exp ... +flaky,expire=20251008 | FAIL: gcc.misc-tests/gcov-29.c gcov: 0 failures in line counts, 0 in branch percentages, 0 in condition/decision, 1 in prime-paths, 0 in return percentages, 0 in intermediate format, 0 failed in filters +flaky,expire=20251008 | FAIL: gcc.misc-tests/gcov-29.c line 826: expected 0/5 covered paths, was 0/6 +flaky,expire=20251008 | FAIL: gcc.misc-tests/gcov-30.c gcov: 0 failures in line counts, 0 in branch percentages, 0 in condition/decision, 1 in prime-paths, 0 in return percentages, 0 in intermediate format, 0 failed in filters +flaky,expire=20251008 | FAIL: gcc.misc-tests/gcov-30.c line 826: expected 0/5 covered paths, was 0/6 +flaky,expire=20251008 | FAIL: gcc.misc-tests/gcov-pr83813.c gcov: 1 failures in line counts, 0 in branch percentages, 0 in condition/decision, 0 in prime-paths, 0 in return percentages, 0 in intermediate format, 0 failed in filters +flaky,expire=20251008 | FAIL: gcc.misc-tests/gcov-pr83813.c line 15: is #####:should be 1 +flaky,expire=20251008 | FAIL: gcc.misc-tests/gcov-pr84758.c gcov: 1 failures in line counts, 0 in branch percentages, 0 in condition/decision, 0 in prime-paths, 0 in return percentages, 0 in intermediate format, 0 failed in filters +flaky,expire=20251008 | FAIL: gcc.misc-tests/gcov-pr84758.c line 13: is 2:should be 1 +flaky,expire=20251008 | FAIL: gcc.misc-tests/gcov-pr85332.c gcov: 1 failures in line counts, 0 in branch percentages, 0 in condition/decision, 0 in prime-paths, 0 in return percentages, 0 in intermediate format, 0 failed in filters +flaky,expire=20251008 | FAIL: gcc.misc-tests/gcov-pr85332.c line 10: is 2:should be 3 +flaky,expire=20251008 | FAIL: gcc.misc-tests/gcov-pr85372.c gcov: 1 failures in line counts, 0 in branch percentages, 0 in condition/decision, 0 in prime-paths, 0 in return percentages, 0 in intermediate format, 0 failed in filters +flaky,expire=20251008 | FAIL: gcc.misc-tests/gcov-pr85372.c line 18: is #####:should be 1 + +Running gcc:gcc.target/aarch64/aarch64.exp ... +flaky,expire=20251008 | ERROR: gcc.target/aarch64/cmpbr.c: assemble: syntax error for " dg-do-if 3 assemble { target aarch64_asm_cmpbr_ok } " +flaky,expire=20251008 | FAIL: gcc.target/aarch64/signbitv2sf.c scan-assembler-not -2147483648 +flaky,expire=20251008 | FAIL: gcc.target/aarch64/test_frame_2.c scan-assembler-times stp\tx30, x19, \\[sp, -[0-9]+\\]! 1 + === gfortran tests === + +Running gfortran:gfortran.dg/guality/guality.exp ... +flaky,expire=20251008 | FAIL: gfortran.dg/guality/arg1.f90 -O3 -fomit-frame-pointer -funroll-loops -fpeel-loops -ftracer -finline-functions line 14 a(10) == 10 +flaky,expire=20251008 | FAIL: gfortran.dg/guality/arg1.f90 -O3 -g line 14 a(10) == 10 + === libgomp tests === + +Running libgomp:libgomp.c++/c++.exp ... +flaky,expire=20251008 | FAIL: libgomp.c++/allocator-1.C (test for excess errors) +flaky,expire=20251008 | UNRESOLVED: libgomp.c++/allocator-1.C compilation failed to produce executable + === libphobos tests === + +Running libphobos:libphobos.exceptions/exceptions.exp ... +flaky,expire=20251008 | FAIL: libphobos.exceptions/rt_trap_exceptions.d output pattern test + +Running libphobos:libphobos.lifetime/lifetime.exp ... +flaky,expire=20251008 | FAIL: libphobos.lifetime/large_aggregate_destroy_21097.d (test for excess errors) +flaky,expire=20251008 | UNRESOLVED: libphobos.lifetime/large_aggregate_destroy_21097.d compilation failed to produce executable + +Running libphobos:libphobos.phobos/phobos.exp ... +flaky,expire=20251008 | FAIL: libphobos.phobos/std_math_hardware.d execution test + + === Results Summary === + +# of stable fails 309 +# of flaky entries 0 +# of all tests 1007944 + === acats tests === + +Running acats:chapter cxa ... +flaky,expire=20251008 | FAIL: cxai034 + + === Results Summary === + +# of stable fails 79 +# of flaky entries 0 +# of all tests 1007944 +################################ +# Known flaky tests + +# From https://ci.linaro.org/job/tcwg_gnu_native_fast_check_gcc--master-aarch64-build/1212/: + === libgo tests === + +Running libgo:/home/tcwg-buildslave/workspace/tcwg_gnu_5/abe/snapshots/gcc.git~master/libgo/libgo.exp ... +flaky,expire=20250919 | FAIL: runtime + + === Results Summary === + +# of stable fails 81 +# of flaky entries 0 +# of all tests 196 diff --git a/README.html b/README.html index 52d28cd84..3ff83c35a 100644 --- a/README.html +++ b/README.html @@ -11,14 +11,6 @@ the build. More synthetic information is available in other directories, as described below: