12-check_regression/baseline.xfail | 431 ++++++++++++++++++++++++++++++++ 12-check_regression/console.log.xz | Bin 0 -> 7592 bytes 12-check_regression/extra-bisect-params | 1 + 12-check_regression/fails.sum | 14 ++ 12-check_regression/flaky.xfail | 77 ++++++ 12-check_regression/results.regressions | 1 + 12-check_regression/trigger-bisect | 3 + README.html | 4 +- README.txt | 2 + results | 1 + sumfiles/xfails.xfail | 150 +---------- 11 files changed, 535 insertions(+), 149 deletions(-) diff --git a/12-check_regression/baseline.xfail b/12-check_regression/baseline.xfail new file mode 100644 index 00000000..d483cbd2 --- /dev/null +++ b/12-check_regression/baseline.xfail @@ -0,0 +1,431 @@ + === g++ tests === + +Running g++:g++.dg/analyzer/analyzer.exp ... +FAIL: c-c++-common/analyzer/fileno-1.c -std=c++14 (test for excess errors) +FAIL: c-c++-common/analyzer/fileno-1.c -std=c++17 (test for excess errors) +FAIL: c-c++-common/analyzer/fileno-1.c -std=c++20 (test for excess errors) +FAIL: c-c++-common/analyzer/fileno-1.c -std=c++98 (test for excess errors) +XPASS: c-c++-common/analyzer/flex-with-call-summaries.c -std=c++14 (test for bogus messages, line 1211) +XPASS: c-c++-common/analyzer/flex-with-call-summaries.c -std=c++14 (test for bogus messages, line 888) +FAIL: c-c++-common/analyzer/flex-with-call-summaries.c -std=c++14 (test for warnings, line 881) +FAIL: c-c++-common/analyzer/flex-with-call-summaries.c -std=c++14 (test for excess errors) +XPASS: c-c++-common/analyzer/flex-with-call-summaries.c -std=c++17 (test for bogus messages, line 1211) +XPASS: c-c++-common/analyzer/flex-with-call-summaries.c -std=c++17 (test for bogus messages, line 888) +FAIL: c-c++-common/analyzer/flex-with-call-summaries.c -std=c++17 (test for warnings, line 881) +FAIL: c-c++-common/analyzer/flex-with-call-summaries.c -std=c++17 (test for excess errors) +XPASS: c-c++-common/analyzer/flex-with-call-summaries.c -std=c++20 (test for bogus messages, line 1211) +XPASS: c-c++-common/analyzer/flex-with-call-summaries.c -std=c++20 (test for bogus messages, line 888) +FAIL: c-c++-common/analyzer/flex-with-call-summaries.c -std=c++20 (test for warnings, line 881) +FAIL: c-c++-common/analyzer/flex-with-call-summaries.c -std=c++20 (test for excess errors) +XPASS: c-c++-common/analyzer/flex-with-call-summaries.c -std=c++98 (test for bogus messages, line 1211) +XPASS: c-c++-common/analyzer/flex-with-call-summaries.c -std=c++98 (test for bogus messages, line 888) +FAIL: c-c++-common/analyzer/flex-with-call-summaries.c -std=c++98 (test for warnings, line 881) +FAIL: c-c++-common/analyzer/flex-with-call-summaries.c -std=c++98 (test for excess errors) +XPASS: c-c++-common/analyzer/flex-without-call-summaries.c -std=c++14 (test for bogus messages, line 889) +FAIL: c-c++-common/analyzer/flex-without-call-summaries.c -std=c++14 at line 882 (test for warnings, line 881) +FAIL: c-c++-common/analyzer/flex-without-call-summaries.c -std=c++14 (test for excess errors) +XPASS: c-c++-common/analyzer/flex-without-call-summaries.c -std=c++17 (test for bogus messages, line 889) +FAIL: c-c++-common/analyzer/flex-without-call-summaries.c -std=c++17 at line 882 (test for warnings, line 881) +FAIL: c-c++-common/analyzer/flex-without-call-summaries.c -std=c++17 (test for excess errors) +XPASS: c-c++-common/analyzer/flex-without-call-summaries.c -std=c++20 (test for bogus messages, line 889) +FAIL: c-c++-common/analyzer/flex-without-call-summaries.c -std=c++20 at line 882 (test for warnings, line 881) +FAIL: c-c++-common/analyzer/flex-without-call-summaries.c -std=c++20 (test for excess errors) +XPASS: c-c++-common/analyzer/flex-without-call-summaries.c -std=c++98 (test for bogus messages, line 889) +FAIL: c-c++-common/analyzer/flex-without-call-summaries.c -std=c++98 at line 882 (test for warnings, line 881) +FAIL: c-c++-common/analyzer/flex-without-call-summaries.c -std=c++98 (test for excess errors) +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-11.c -std=c++14 2 blank line(s) in output +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-11.c -std=c++14 expected multiline pattern lines 46-61 +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-11.c -std=c++14 (test for excess errors) +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-11.c -std=c++17 2 blank line(s) in output +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-11.c -std=c++17 expected multiline pattern lines 46-61 +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-11.c -std=c++17 (test for excess errors) +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-11.c -std=c++20 2 blank line(s) in output +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-11.c -std=c++20 expected multiline pattern lines 46-61 +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-11.c -std=c++20 (test for excess errors) +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-11.c -std=c++98 2 blank line(s) in output +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-11.c -std=c++98 expected multiline pattern lines 46-61 +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-11.c -std=c++98 (test for excess errors) +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-8.c -std=c++14 2 blank line(s) in output +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-8.c -std=c++14 expected multiline pattern lines 19-34 +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-8.c -std=c++14 (test for excess errors) +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-8.c -std=c++17 2 blank line(s) in output +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-8.c -std=c++17 expected multiline pattern lines 19-34 +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-8.c -std=c++17 (test for excess errors) +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-8.c -std=c++20 2 blank line(s) in output +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-8.c -std=c++20 expected multiline pattern lines 19-34 +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-8.c -std=c++20 (test for excess errors) +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-8.c -std=c++98 2 blank line(s) in output +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-8.c -std=c++98 expected multiline pattern lines 19-34 +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-8.c -std=c++98 (test for excess errors) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++14 (test for warnings, line 11) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++14 (test for warnings, line 19) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++14 (test for warnings, line 26) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++14 (test for warnings, line 34) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++14 (test for warnings, line 35) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++14 at line 12 (test for warnings, line 11) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++14 (test for excess errors) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++17 (test for warnings, line 11) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++17 (test for warnings, line 19) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++17 (test for warnings, line 26) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++17 (test for warnings, line 34) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++17 (test for warnings, line 35) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++17 at line 12 (test for warnings, line 11) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++17 (test for excess errors) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++20 (test for warnings, line 11) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++20 (test for warnings, line 19) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++20 (test for warnings, line 26) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++20 (test for warnings, line 34) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++20 (test for warnings, line 35) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++20 at line 12 (test for warnings, line 11) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++20 (test for excess errors) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++98 (test for warnings, line 11) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++98 (test for warnings, line 19) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++98 (test for warnings, line 26) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++98 (test for warnings, line 34) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++98 (test for warnings, line 35) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++98 at line 12 (test for warnings, line 11) +FAIL: g++.dg/analyzer/placement-new-size.C -std=c++98 (test for excess errors) + +Running g++:g++.dg/dg.exp ... +FAIL: c-c++-common/pr111309-2.c -std=c++14 (test for errors, line 35) +FAIL: c-c++-common/pr111309-2.c -std=c++14 (test for errors, line 54) +FAIL: c-c++-common/pr111309-2.c -std=c++17 (test for errors, line 35) +FAIL: c-c++-common/pr111309-2.c -std=c++17 (test for errors, line 54) +FAIL: c-c++-common/pr111309-2.c -std=c++20 (test for errors, line 35) +FAIL: c-c++-common/pr111309-2.c -std=c++20 (test for errors, line 54) +FAIL: c-c++-common/pr111309-2.c -std=c++98 (test for errors, line 35) +FAIL: c-c++-common/pr111309-2.c -std=c++98 (test for errors, line 54) +FAIL: g++.dg/contracts/contracts-ctor-dtor2.C (test for errors, line 23) +FAIL: g++.dg/contracts/contracts-ctor-dtor2.C (test for errors, line 27) +FAIL: g++.dg/contracts/contracts-tmpl-spec2.C output pattern test +FAIL: g++.dg/cpp2a/decomp2.C -std=gnu++14 execution test +FAIL: g++.dg/cpp2a/decomp2.C -std=gnu++17 execution test +FAIL: g++.dg/cpp2a/decomp2.C -std=gnu++20 execution test +FAIL: g++.dg/opt/pr97315-1.C -std=gnu++14 (test for excess errors) +FAIL: g++.dg/opt/pr97315-1.C -std=gnu++17 (test for excess errors) +FAIL: g++.dg/opt/pr97315-1.C -std=gnu++20 (test for excess errors) +FAIL: g++.dg/opt/pr97315-1.C -std=gnu++98 (test for excess errors) +XPASS: g++.dg/warn/Wstringop-overflow-4.C -std=gnu++98 pr106120 (test for bogus messages, line 144) +FAIL: g++.dg/warn/Wuse-after-free3.C -std=gnu++14 (test for excess errors) +FAIL: g++.dg/warn/Wuse-after-free3.C -std=gnu++17 (test for excess errors) +FAIL: g++.dg/warn/Wuse-after-free3.C -std=gnu++20 (test for excess errors) +XPASS: g++.dg/warn/pr33738.C -std=gnu++14 (test for warnings, line 18) +XPASS: g++.dg/warn/pr33738.C -std=gnu++14 (test for warnings, line 22) +XPASS: g++.dg/warn/pr33738.C -std=gnu++17 (test for warnings, line 18) +XPASS: g++.dg/warn/pr33738.C -std=gnu++17 (test for warnings, line 22) +XPASS: g++.dg/warn/pr33738.C -std=gnu++20 (test for warnings, line 18) +XPASS: g++.dg/warn/pr33738.C -std=gnu++20 (test for warnings, line 22) +XPASS: g++.dg/warn/pr33738.C -std=gnu++98 (test for warnings, line 18) +XPASS: g++.dg/warn/pr33738.C -std=gnu++98 (test for warnings, line 22) + +Running g++:g++.dg/lto/lto.exp ... +FAIL: g++.dg/lto/pr65276 cp_lto_pr65276_0.o-cp_lto_pr65276_1.o link, -flto -O0 -std=c++11 + +Running g++:g++.dg/modules/modules.exp ... +FAIL: g++.dg/modules/xtreme-header-2_c.C -std=c++2b (test for excess errors) +FAIL: g++.dg/modules/xtreme-header-5_c.C -std=c++2a (test for excess errors) +FAIL: g++.dg/modules/xtreme-header-5_c.C -std=c++2b (test for excess errors) + +Running g++:g++.target/arm/arm.exp ... +XPASS: g++.target/arm/bfloat_cpp_typecheck.C (test for bogus messages, line 10) +XPASS: g++.target/arm/bfloat_cpp_typecheck.C (test for bogus messages, line 11) + === gcc tests === + +Running gcc:gcc.dg/analyzer/analyzer.exp ... +FAIL: c-c++-common/analyzer/null-deref-pr108251-smp_fetch_ssl_fc_has_early-O2.c (test for excess errors) +FAIL: c-c++-common/analyzer/null-deref-pr108251-smp_fetch_ssl_fc_has_early.c (test for excess errors) +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-11.c (test for excess errors) +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-11.c 2 blank line(s) in output +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-11.c expected multiline pattern lines 46-61 +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-8.c (test for excess errors) +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-8.c 2 blank line(s) in output +FAIL: c-c++-common/analyzer/out-of-bounds-diagram-8.c expected multiline pattern lines 19-34 +FAIL: gcc.dg/analyzer/out-of-bounds-diagram-10.c (test for excess errors) +FAIL: gcc.dg/analyzer/out-of-bounds-diagram-10.c 2 blank line(s) in output +FAIL: gcc.dg/analyzer/out-of-bounds-diagram-10.c expected multiline pattern lines 13-28 +FAIL: gcc.dg/analyzer/switch-enum-1.c (test for bogus messages, line 26) +FAIL: gcc.dg/analyzer/switch-enum-1.c (test for bogus messages, line 44) +FAIL: gcc.dg/analyzer/switch-enum-2.c (test for bogus messages, line 34) +FAIL: gcc.dg/analyzer/switch-enum-2.c (test for bogus messages, line 52) + +Running gcc:gcc.dg/analyzer/torture/analyzer-torture.exp ... +FAIL: gcc.dg/analyzer/torture/switch-enum-pr105273-doom-p_floor.c -O0 (test for bogus messages, line 82) +FAIL: gcc.dg/analyzer/torture/switch-enum-pr105273-doom-p_maputl.c -O0 (test for bogus messages, line 83) + +Running gcc:gcc.dg/dg.exp ... +FAIL: gcc.dg/Wnonnull-4.c (test for excess errors) +XPASS: gcc.dg/Wstringop-overflow-47.c pr97027 (test for warnings, line 72) +XPASS: gcc.dg/Wstringop-overflow-47.c pr97027 (test for warnings, line 77) +XPASS: gcc.dg/Wstringop-overflow-47.c pr97027 note (test for warnings, line 68) +FAIL: gcc.dg/c23-stdarg-4.c execution test +FAIL: gcc.dg/pr55152-2.c scan-tree-dump-times optimized ".COPYSIGN" 1 +FAIL: gcc.dg/pr55152-2.c scan-tree-dump-times optimized "ABS_EXPR" 1 + +Running gcc:gcc.dg/ipa/ipa.exp ... +FAIL: gcc.dg/ipa/ipa-icf-38.c scan-ltrans-tree-dump-not optimized "Function bar" +FAIL: gcc.dg/ipa/ipa-icf-38.c scan-wpa-ipa-dump icf "Equal symbols: 1" +FAIL: gcc.dg/ipa/ipa-icf-38.c scan-wpa-ipa-dump icf "Semantic equality hit:foo/[0-9+]+->bar/[0-9+]+" + +Running gcc:gcc.dg/plugin/plugin.exp ... +FAIL: gcc.dg/plugin/must-tail-call-1.c -fplugin=./must_tail_call_plugin.so (internal compiler error: in df_refs_verify, at df-scan.cc:4009) +FAIL: gcc.dg/plugin/must-tail-call-1.c -fplugin=./must_tail_call_plugin.so (test for excess errors) + +Running gcc:gcc.dg/torture/dg-torture.exp ... +FAIL: gcc.dg/torture/builtin-iseqsig-1.c -Os execution test +FAIL: gcc.dg/torture/builtin-iseqsig-2.c -Os execution test +FAIL: gcc.dg/torture/builtin-iseqsig-3.c -Os execution test +FAIL: gcc.dg/torture/c23-stdarg-split-1a.c -O0 execution test +FAIL: gcc.dg/torture/c23-stdarg-split-1a.c -O1 execution test +FAIL: gcc.dg/torture/c23-stdarg-split-1a.c -O2 execution test +FAIL: gcc.dg/torture/c23-stdarg-split-1a.c -O2 -flto -fno-use-linker-plugin -flto-partition=none execution test +FAIL: gcc.dg/torture/c23-stdarg-split-1a.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects execution test +FAIL: gcc.dg/torture/c23-stdarg-split-1a.c -O3 -g execution test +FAIL: gcc.dg/torture/c23-stdarg-split-1a.c -Os execution test + +Running gcc:gcc.dg/tree-ssa/tree-ssa.exp ... +FAIL: gcc.dg/tree-ssa/abs-4.c scan-tree-dump-times optimized "= -" 1 +FAIL: gcc.dg/tree-ssa/abs-4.c scan-tree-dump-times optimized "= .COPYSIGN" 2 +FAIL: gcc.dg/tree-ssa/abs-4.c scan-tree-dump-times optimized "= ABS_EXPR" 1 +FAIL: gcc.dg/tree-ssa/backprop-6.c scan-tree-dump-times backprop "Deleting[^\\n]* = -" 4 +FAIL: gcc.dg/tree-ssa/backprop-6.c scan-tree-dump-times backprop "Deleting[^\\n]* = ABS_EXPR <" 1 +FAIL: gcc.dg/tree-ssa/backprop-6.c scan-tree-dump-times backprop "Deleting[^\\n]* = \\.COPYSIGN" 2 +FAIL: gcc.dg/tree-ssa/copy-sign-2.c scan-tree-dump-times optimized ".COPYSIGN" 1 +FAIL: gcc.dg/tree-ssa/copy-sign-2.c scan-tree-dump-times optimized "ABS" 1 +FAIL: gcc.dg/tree-ssa/phi-opt-24.c scan-tree-dump-not phiopt2 "if" +FAIL: gcc.dg/tree-ssa/predcom-2.c scan-tree-dump-times pcom "Unrolling 2 times." 2 +FAIL: gcc.dg/tree-ssa/scev-3.c scan-tree-dump-times ivopts "&a" 1 +FAIL: gcc.dg/tree-ssa/scev-5.c scan-tree-dump-times ivopts "&a" 1 + +Running gcc:gcc.dg/vect/vect.exp ... +FAIL: gcc.dg/vect/slp-47.c -flto -ffat-lto-objects scan-tree-dump-times vect "vectorizing stmts using SLP" 2 +FAIL: gcc.dg/vect/slp-47.c scan-tree-dump-times vect "vectorizing stmts using SLP" 2 +FAIL: gcc.dg/vect/slp-48.c -flto -ffat-lto-objects scan-tree-dump-times vect "vectorizing stmts using SLP" 2 +FAIL: gcc.dg/vect/slp-48.c scan-tree-dump-times vect "vectorizing stmts using SLP" 2 +FAIL: gcc.dg/vect/slp-mask-store-1.c -flto -ffat-lto-objects execution test +FAIL: gcc.dg/vect/slp-mask-store-1.c execution test +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s124.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s124.c scan-tree-dump vect "vectorized 1 loops" +FAIL: gcc.dg/vect/tsvc/vect-tsvc-s1281.c -flto -ffat-lto-objects execution test +FAIL: gcc.dg/vect/tsvc/vect-tsvc-s1281.c execution test +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s276.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s276.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s3111.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s3111.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s3113.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s3113.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s312.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s312.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s314.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s314.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s316.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s316.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s317.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s317.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s319.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s319.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s441.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s441.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s443.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s443.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s453.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s453.c scan-tree-dump vect "vectorized 1 loops" +FAIL: gcc.dg/vect/vect-fmax-2.c -flto -ffat-lto-objects scan-tree-dump vect "Detected reduction" +FAIL: gcc.dg/vect/vect-fmax-2.c -flto -ffat-lto-objects scan-tree-dump vect "LOOP VECTORIZED" +FAIL: gcc.dg/vect/vect-fmax-2.c scan-tree-dump vect "Detected reduction" +FAIL: gcc.dg/vect/vect-fmax-2.c scan-tree-dump vect "LOOP VECTORIZED" +FAIL: gcc.dg/vect/vect-fmax-3.c -flto -ffat-lto-objects scan-tree-dump vect "Detected reduction" +FAIL: gcc.dg/vect/vect-fmax-3.c -flto -ffat-lto-objects scan-tree-dump vect "LOOP VECTORIZED" +FAIL: gcc.dg/vect/vect-fmax-3.c scan-tree-dump vect "Detected reduction" +FAIL: gcc.dg/vect/vect-fmax-3.c scan-tree-dump vect "LOOP VECTORIZED" +FAIL: gcc.dg/vect/vect-fmin-2.c -flto -ffat-lto-objects scan-tree-dump vect "Detected reduction" +FAIL: gcc.dg/vect/vect-fmin-2.c -flto -ffat-lto-objects scan-tree-dump vect "LOOP VECTORIZED" +FAIL: gcc.dg/vect/vect-fmin-2.c scan-tree-dump vect "Detected reduction" +FAIL: gcc.dg/vect/vect-fmin-2.c scan-tree-dump vect "LOOP VECTORIZED" +FAIL: gcc.dg/vect/vect-fmin-3.c -flto -ffat-lto-objects scan-tree-dump vect "Detected reduction" +FAIL: gcc.dg/vect/vect-fmin-3.c -flto -ffat-lto-objects scan-tree-dump vect "LOOP VECTORIZED" +FAIL: gcc.dg/vect/vect-fmin-3.c scan-tree-dump vect "Detected reduction" +FAIL: gcc.dg/vect/vect-fmin-3.c scan-tree-dump vect "LOOP VECTORIZED" + +Running gcc:gcc.misc-tests/gcov.exp ... +FAIL: gcc.misc-tests/gcov-pr94029.c gcov failed: spawn failed + +Running gcc:gcc.target/arm/acle/acle.exp ... +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O0 check-function-bodies test_cls +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O0 check-function-bodies test_cls_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O0 check-function-bodies test_clsl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O0 check-function-bodies test_clsl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O0 check-function-bodies test_clz +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O0 check-function-bodies test_clz_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O0 check-function-bodies test_clzl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O0 check-function-bodies test_clzl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O0 check-function-bodies test_revll +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O0 check-function-bodies test_ror +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O0 check-function-bodies test_ror_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O0 check-function-bodies test_rorl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O0 check-function-bodies test_rorl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O1 check-function-bodies test_cls +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O1 check-function-bodies test_cls_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O1 check-function-bodies test_clsl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O1 check-function-bodies test_clsl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O1 check-function-bodies test_clz +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O1 check-function-bodies test_clz_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O1 check-function-bodies test_clzl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O1 check-function-bodies test_clzl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O1 check-function-bodies test_revll +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O1 check-function-bodies test_ror +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O1 check-function-bodies test_ror_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O1 check-function-bodies test_rorl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O1 check-function-bodies test_rorl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 check-function-bodies test_cls +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 check-function-bodies test_cls_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 check-function-bodies test_clsl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 check-function-bodies test_clsl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 check-function-bodies test_clz +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 check-function-bodies test_clz_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 check-function-bodies test_clzl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 check-function-bodies test_clzl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 check-function-bodies test_revll +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 check-function-bodies test_ror +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 check-function-bodies test_ror_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 check-function-bodies test_rorl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 check-function-bodies test_rorl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O3 -g check-function-bodies test_cls +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O3 -g check-function-bodies test_cls_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O3 -g check-function-bodies test_clsl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O3 -g check-function-bodies test_clsl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O3 -g check-function-bodies test_clz +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O3 -g check-function-bodies test_clz_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O3 -g check-function-bodies test_clzl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O3 -g check-function-bodies test_clzl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O3 -g check-function-bodies test_revll +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O3 -g check-function-bodies test_ror +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O3 -g check-function-bodies test_ror_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O3 -g check-function-bodies test_rorl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O3 -g check-function-bodies test_rorl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -Os check-function-bodies test_cls +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -Os check-function-bodies test_cls_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -Os check-function-bodies test_clsl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -Os check-function-bodies test_clsl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -Os check-function-bodies test_clz +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -Os check-function-bodies test_clz_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -Os check-function-bodies test_clzl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -Os check-function-bodies test_clzl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -Os check-function-bodies test_revll +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -Os check-function-bodies test_ror +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -Os check-function-bodies test_ror_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -Os check-function-bodies test_rorl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -Os check-function-bodies test_rorl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -ffat-lto-objects check-function-bodies test_cls +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -ffat-lto-objects check-function-bodies test_cls_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -ffat-lto-objects check-function-bodies test_clsl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -ffat-lto-objects check-function-bodies test_clsl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -ffat-lto-objects check-function-bodies test_clz +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -ffat-lto-objects check-function-bodies test_clz_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -ffat-lto-objects check-function-bodies test_clzl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -ffat-lto-objects check-function-bodies test_clzl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -ffat-lto-objects check-function-bodies test_revll +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -ffat-lto-objects check-function-bodies test_ror +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -ffat-lto-objects check-function-bodies test_ror_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -ffat-lto-objects check-function-bodies test_rorl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -ffat-lto-objects check-function-bodies test_rorl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -ffat-lto-objects check-function-bodies test_cls +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -ffat-lto-objects check-function-bodies test_cls_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -ffat-lto-objects check-function-bodies test_clsl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -ffat-lto-objects check-function-bodies test_clsl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -ffat-lto-objects check-function-bodies test_clz +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -ffat-lto-objects check-function-bodies test_clz_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -ffat-lto-objects check-function-bodies test_clzl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -ffat-lto-objects check-function-bodies test_clzl_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -ffat-lto-objects check-function-bodies test_revll +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -ffat-lto-objects check-function-bodies test_ror +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -ffat-lto-objects check-function-bodies test_ror_mem +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -ffat-lto-objects check-function-bodies test_rorl +FAIL: gcc.target/arm/acle/data-intrinsics-assembly.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -ffat-lto-objects check-function-bodies test_rorl_mem + +Running gcc:gcc.target/arm/arm.exp ... +FAIL: gcc.target/arm/addr-modes-float.c scan-assembler vst3.8\t{d[02468], d[02468], d[02468]}, \\[r[0-9]+\\]! +FAIL: gcc.target/arm/addr-modes-int.c (test for excess errors) +UNRESOLVED: gcc.target/arm/addr-modes-int.c scan-assembler ldr.*#4]! +UNRESOLVED: gcc.target/arm/addr-modes-int.c scan-assembler ldr.*], #4 +UNRESOLVED: gcc.target/arm/addr-modes-int.c scan-assembler ldrb.*#1]! +UNRESOLVED: gcc.target/arm/addr-modes-int.c scan-assembler ldrb.*], #1 +UNRESOLVED: gcc.target/arm/addr-modes-int.c scan-assembler ldrd.*#8]! +UNRESOLVED: gcc.target/arm/addr-modes-int.c scan-assembler ldrd.*], #8 +UNRESOLVED: gcc.target/arm/addr-modes-int.c scan-assembler ldrsh.*#2]! +UNRESOLVED: gcc.target/arm/addr-modes-int.c scan-assembler ldrsh.*], #2 +UNRESOLVED: gcc.target/arm/addr-modes-int.c scan-assembler str.*#4]! +UNRESOLVED: gcc.target/arm/addr-modes-int.c scan-assembler str.*], #4 +UNRESOLVED: gcc.target/arm/addr-modes-int.c scan-assembler strb.*#1]! +UNRESOLVED: gcc.target/arm/addr-modes-int.c scan-assembler strb.*], #1 +UNRESOLVED: gcc.target/arm/addr-modes-int.c scan-assembler strd.*#8]! +UNRESOLVED: gcc.target/arm/addr-modes-int.c scan-assembler strd.*], #8 +UNRESOLVED: gcc.target/arm/addr-modes-int.c scan-assembler strh.*#2]! +UNRESOLVED: gcc.target/arm/addr-modes-int.c scan-assembler strh.*], #2 +UNRESOLVED: gcc.target/arm/addr-modes-int.c scan-assembler-not \tadd +FAIL: gcc.target/arm/bfloat16_scalar_typecheck.c (test for errors, line 45) +FAIL: gcc.target/arm/bfloat16_scalar_typecheck.c (test for errors, line 97) +FAIL: gcc.target/arm/cortex-m55-nodsp-flag-hard.c scan-assembler .arch_extension fp +FAIL: gcc.target/arm/cortex-m55-nodsp-flag-hard.c scan-assembler .arch_extension fp.dp +FAIL: gcc.target/arm/cortex-m55-nodsp-flag-hard.c scan-assembler .fpu fpv5-d16 +FAIL: gcc.target/arm/cortex-m55-nodsp-flag-softfp.c scan-assembler .arch_extension fp +FAIL: gcc.target/arm/cortex-m55-nodsp-flag-softfp.c scan-assembler .arch_extension fp.dp +FAIL: gcc.target/arm/cortex-m55-nodsp-flag-softfp.c scan-assembler .fpu fpv5-d16 +FAIL: gcc.target/arm/cortex-m55-nodsp-nofp-flag-softfp.c scan-assembler .fpu softvfp +FAIL: gcc.target/arm/cortex-m55-nofp-flag-hard.c scan-assembler .arch_extension dsp +FAIL: gcc.target/arm/cortex-m55-nofp-flag-hard.c scan-assembler .arch_extension mve +FAIL: gcc.target/arm/cortex-m55-nofp-flag-hard.c scan-assembler .fpu softvfp +FAIL: gcc.target/arm/cortex-m55-nofp-flag-softfp.c scan-assembler .arch_extension dsp +FAIL: gcc.target/arm/cortex-m55-nofp-flag-softfp.c scan-assembler .arch_extension mve +FAIL: gcc.target/arm/cortex-m55-nofp-flag-softfp.c scan-assembler .fpu softvfp +FAIL: gcc.target/arm/cortex-m55-nofp-nomve-flag-softfp.c scan-assembler .arch_extension dsp +FAIL: gcc.target/arm/cortex-m55-nofp-nomve-flag-softfp.c scan-assembler .fpu softvfp +FAIL: gcc.target/arm/cortex-m55-nomve-flag-hard.c scan-assembler .arch_extension dsp +FAIL: gcc.target/arm/cortex-m55-nomve-flag-hard.c scan-assembler .arch_extension fp +FAIL: gcc.target/arm/cortex-m55-nomve-flag-hard.c scan-assembler .arch_extension fp.dp +FAIL: gcc.target/arm/cortex-m55-nomve-flag-hard.c scan-assembler .fpu fpv5-d16 +FAIL: gcc.target/arm/cortex-m55-nomve-flag-softfp.c scan-assembler .arch_extension dsp +FAIL: gcc.target/arm/cortex-m55-nomve-flag-softfp.c scan-assembler .arch_extension fp +FAIL: gcc.target/arm/cortex-m55-nomve-flag-softfp.c scan-assembler .arch_extension fp.dp +FAIL: gcc.target/arm/cortex-m55-nomve-flag-softfp.c scan-assembler .fpu fpv5-d16 +FAIL: gcc.target/arm/cortex-m55-nomve.fp-flag-hard.c scan-assembler .arch_extension dsp +FAIL: gcc.target/arm/cortex-m55-nomve.fp-flag-hard.c scan-assembler .arch_extension fp +FAIL: gcc.target/arm/cortex-m55-nomve.fp-flag-hard.c scan-assembler .arch_extension fp.dp +FAIL: gcc.target/arm/cortex-m55-nomve.fp-flag-hard.c scan-assembler .arch_extension mve +FAIL: gcc.target/arm/cortex-m55-nomve.fp-flag-hard.c scan-assembler .fpu fpv5-d16 +FAIL: gcc.target/arm/cortex-m55-nomve.fp-flag-softfp.c scan-assembler .arch_extension dsp +FAIL: gcc.target/arm/cortex-m55-nomve.fp-flag-softfp.c scan-assembler .arch_extension fp +FAIL: gcc.target/arm/cortex-m55-nomve.fp-flag-softfp.c scan-assembler .arch_extension fp.dp +FAIL: gcc.target/arm/cortex-m55-nomve.fp-flag-softfp.c scan-assembler .arch_extension mve +FAIL: gcc.target/arm/cortex-m55-nomve.fp-flag-softfp.c scan-assembler .fpu fpv5-d16 +FAIL: gcc.target/arm/fmaxmin.c scan-assembler-times vmaxnm.f32\ts[0-9]+, s[0-9]+, s[0-9]+ 1 +FAIL: gcc.target/arm/fmaxmin.c scan-assembler-times vminnm.f32\ts[0-9]+, s[0-9]+, s[0-9]+ 1 +FAIL: gcc.target/arm/memset-inline-8.c scan-assembler-not vstr +FAIL: gcc.target/arm/pr40457-2.c scan-assembler strd|stm +FAIL: gcc.target/arm/pr43920-2.c object-size text <= 54 +FAIL: gcc.target/arm/pr43920-2.c scan-assembler-times pop 2 + === libstdc++ tests === + +Running libstdc++:libstdc++-dg/conformance.exp ... +FAIL: 19_diagnostics/stacktrace/current.cc -std=gnu++23 execution test +FAIL: 19_diagnostics/stacktrace/current.cc -std=gnu++26 execution test +FAIL: 19_diagnostics/stacktrace/entry.cc -std=gnu++23 execution test +FAIL: 19_diagnostics/stacktrace/entry.cc -std=gnu++26 execution test +FAIL: 19_diagnostics/stacktrace/stacktrace.cc -std=gnu++23 execution test +FAIL: 19_diagnostics/stacktrace/stacktrace.cc -std=gnu++26 execution test +FAIL: 22_locale/ctype/scan/wchar_t/1.cc -std=gnu++17 execution test +FAIL: 27_io/basic_filebuf/underflow/wchar_t/11603.cc -std=gnu++17 execution test +FAIL: 27_io/basic_fstream/53984.cc -std=gnu++17 execution test +FAIL: 27_io/objects/wchar_t/12048-1.cc -std=gnu++17 execution test +FAIL: 27_io/objects/wchar_t/12048-2.cc -std=gnu++17 execution test +FAIL: 27_io/objects/wchar_t/12048-3.cc -std=gnu++17 execution test +FAIL: 27_io/objects/wchar_t/12048-4.cc -std=gnu++17 execution test +XPASS: 27_io/objects/wchar_t/12048-5.cc -std=gnu++17 execution test +FAIL: 29_atomics/atomic/compare_exchange_padding.cc -std=gnu++20 execution test +FAIL: 29_atomics/atomic/compare_exchange_padding.cc -std=gnu++26 execution test +XPASS: ext/stdio_filebuf/char/10063-2.cc -std=gnu++17 execution test +XPASS: ext/stdio_filebuf/char/10063-3.cc -std=gnu++17 execution test +FAIL: ext/stdio_sync_filebuf/wchar_t/1.cc -std=gnu++17 execution test +FAIL: ext/stdio_sync_filebuf/wchar_t/12948-1.cc -std=gnu++17 execution test +FAIL: ext/stdio_sync_filebuf/wchar_t/12948-2.cc -std=gnu++17 execution test +FAIL: ext/stdio_sync_filebuf/wchar_t/12948-3.cc -std=gnu++17 execution test +FAIL: ext/stdio_sync_filebuf/wchar_t/12948-4.cc -std=gnu++17 execution test diff --git a/12-check_regression/console.log.xz b/12-check_regression/console.log.xz new file mode 100644 index 00000000..37e18058 Binary files /dev/null and b/12-check_regression/console.log.xz differ diff --git a/12-check_regression/extra-bisect-params b/12-check_regression/extra-bisect-params new file mode 100644 index 00000000..2c989347 --- /dev/null +++ b/12-check_regression/extra-bisect-params @@ -0,0 +1 @@ +extra_build_params=++testsuites gcc:gcc.dg/vect/vect.exp ++testsuites gcc:gcc.target/arm/mve/mve.exp diff --git a/12-check_regression/fails.sum b/12-check_regression/fails.sum new file mode 100644 index 00000000..55715f04 --- /dev/null +++ b/12-check_regression/fails.sum @@ -0,0 +1,14 @@ + === gcc tests === + +Running gcc:gcc.dg/vect/vect.exp ... +FAIL: gcc.dg/vect/tsvc/vect-tsvc-s271.c execution test +FAIL: gcc.dg/vect/tsvc/vect-tsvc-s452.c execution test + +Running gcc:gcc.target/arm/mve/mve.exp ... +FAIL: gcc.target/arm/mve/pr112337.c (test for excess errors) + + === Results Summary === + +# of stable fails 397 +# of flaky entries 2 +# of all tests 409973 diff --git a/12-check_regression/flaky.xfail b/12-check_regression/flaky.xfail new file mode 100644 index 00000000..3dd74a65 --- /dev/null +++ b/12-check_regression/flaky.xfail @@ -0,0 +1,77 @@ +################################ +# Known flaky tests + +# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/212/: + === gcc tests === + +Running gcc:gcc.dg/vect/vect.exp ... +flaky,expire=20231223 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s2712.c -flto -ffat-lto-objects execution test + + === Results Summary === + +# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/193/: + === gcc tests === + +Running gcc:gcc.dg/vect/vect.exp ... +flaky,expire=20231216 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s2712.c execution test + + === Results Summary === + +# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/168/: + === gcc tests === + +Running gcc:gcc.dg/vect/vect.exp ... +flaky,expire=20231104 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s2712.c execution test + + === Results Summary === + +# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/156/: + === gcc tests === + +Running gcc:gcc.dg/vect/vect.exp ... +flaky,expire=20231029 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s271.c -flto -ffat-lto-objects execution test +flaky,expire=20231029 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s271.c execution test + + === Results Summary === + +# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/151/: + === gcc tests === + +Running gcc:gcc.dg/vect/vect.exp ... +flaky,expire=20231028 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s2712.c -flto -ffat-lto-objects execution test +flaky,expire=20231028 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s452.c execution test +flaky,expire=20231028 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-vdotr.c -flto -ffat-lto-objects execution test + + === Results Summary === + +# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/145/: + === gcc tests === + +Running gcc:gcc.dg/vect/vect.exp ... +flaky,expire=20231025 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s2711.c execution test + + === Results Summary === + +# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/116/: + === gcc tests === + +Running gcc:gcc.dg/vect/vect.exp ... +flaky,expire=20231014 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s271.c execution test + + === Results Summary === + +# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/111/: + === gcc tests === + +Running gcc:gcc.dg/vect/vect.exp ... +flaky,expire=20231014 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s271.c -flto -ffat-lto-objects execution test + + === Results Summary === + +# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/5/: + === gcc tests === + +Running gcc:gcc.dg/vect/vect.exp ... +flaky,expire=20230914 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s271.c execution test + + === Results Summary === diff --git a/12-check_regression/results.regressions b/12-check_regression/results.regressions new file mode 100644 index 00000000..b0084ba6 --- /dev/null +++ b/12-check_regression/results.regressions @@ -0,0 +1 @@ +# 3 regressions diff --git a/12-check_regression/trigger-bisect b/12-check_regression/trigger-bisect new file mode 100644 index 00000000..d83080d3 --- /dev/null +++ b/12-check_regression/trigger-bisect @@ -0,0 +1,3 @@ +current_project=gcc +bad_git=https://github.com/gcc-mirror/gcc.git#ddb479e796bee3964ddb6a2daa8f79598e47cede +extra_build_params=++testsuites gcc:gcc.dg/vect/vect.exp ++testsuites gcc:gcc.target/arm/mve/mve.exp diff --git a/README.html b/README.html index 0cf52254..2ba16c92 100644 --- a/README.html +++ b/README.html @@ -61,6 +61,8 @@ List of files below:
  • ./jenkins/run-build.env
  • ./manifest.sh
  • ./notify/configure-make.txt +
  • ./notify/configure-toolchain.txt +
  • ./notify/fixes.sum
  • ./notify/jira/comment-card.txt
  • ./notify/jira/comment-template.txt
  • ./notify/jira/components @@ -69,7 +71,7 @@ List of files below:
  • ./notify/jira/startdate
  • ./notify/jira/summary
  • ./notify/jira/yaml -
  • ./notify/lnt_report.json +
  • ./notify/lnt_report.json
  • ./notify/mail-body.txt
  • ./notify/mail-recipients.txt
  • ./notify/mail-subject.txt diff --git a/README.txt b/README.txt index 417e754c..e35a4f05 100644 --- a/README.txt +++ b/README.txt @@ -58,6 +58,8 @@ List of files below: - ./jenkins/run-build.env - ./manifest.sh - ./notify/configure-make.txt +- ./notify/configure-toolchain.txt +- ./notify/fixes.sum - ./notify/jira/comment-card.txt - ./notify/jira/comment-template.txt - ./notify/jira/components diff --git a/results b/results index e931e39a..482c1f60 100644 --- a/results +++ b/results @@ -17,3 +17,4 @@ # build_abe check_gcc -- --set gcc_override_configure=--disable-multilib --set gcc_override_configure=--with-mode=thumb --set gcc_override_configure=--with-arch=armv8-a+simd --set gcc_override_configure=--with-fpu=crypto-neon-fp-armv8 --set gcc_override_configure=--with-float=hard --set target_board_options={-mthumb/-march=armv8-a+simd/-mfpu=auto/-mfloat-abi=hard} --qemu-cpu any: 0 # 1 regressions +# 3 regressions diff --git a/sumfiles/xfails.xfail b/sumfiles/xfails.xfail index bb7ea1c8..a18042ce 100644 --- a/sumfiles/xfails.xfail +++ b/sumfiles/xfails.xfail @@ -3,65 +3,9 @@ # - known flaky tests (from baseline) # - known failures (from baseline) # +################################ # Known flaky tests -# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/220/: - === gcc tests === - -Running gcc:gcc.dg/vect/vect.exp ... -flaky,expire=20231228 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s112.c execution test -flaky,expire=20231228 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s271.c -flto -ffat-lto-objects execution test - - === Results Summary === - -# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/218/: - === libstdc++ tests === - -Running libstdc++:libstdc++-dg/conformance.exp ... -flaky,expire=20231225 | FAIL: std/time/clock/file/members.cc -std=gnu++26 execution test - - === Results Summary === - === gcc tests === - -Running gcc:gcc.dg/vect/vect.exp ... -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s1111.c execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s1111.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s112.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s116.c execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s116.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s132.c execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s132.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s1351.c execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s1351.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s176.c execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s176.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s251.c execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s251.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s254.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s254.c execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s2711.c execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s2711.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s273.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s276.c execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s276.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s314.c execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s314.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s316.c execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s316.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s351.c execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s351.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s352.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s352.c execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s452.c execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s452.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-vdotr.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-vtv.c execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-vtv.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-vtvtv.c -flto -ffat-lto-objects execution test -flaky,expire=20231225 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-vtvtv.c execution test - - === Results Summary === - # From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/212/: === gcc tests === @@ -70,22 +14,6 @@ flaky,expire=20231223 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s2712.c -flto -ffat-lto === Results Summary === -# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/205/: - === gcc tests === - -Running gcc:gcc.dg/vect/vect.exp ... -flaky,expire=20231222 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-vdotr.c execution test - - === Results Summary === - -# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/197/: - === gcc tests === - -Running gcc:gcc.dg/vect/vect.exp ... -flaky,expire=20231219 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s271.c execution test - - === Results Summary === - # From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/193/: === gcc tests === @@ -94,55 +22,6 @@ flaky,expire=20231216 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s2712.c execution test === Results Summary === -# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/189/: - === gcc tests === - -Running gcc:gcc.dg/vect/vect.exp ... -flaky,expire=20231213 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s271.c -flto -ffat-lto-objects execution test - - === Results Summary === - -# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/188/: - === gcc tests === - -Running gcc:gcc.dg/vect/vect.exp ... -flaky,expire=20231209 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s2711.c -flto -ffat-lto-objects execution test - - === Results Summary === - -# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/183/: - === gcc tests === - -Running gcc:gcc.dg/vect/vect.exp ... -flaky,expire=20231130 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s2712.c execution test - - === Results Summary === - -# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/182/: - === gcc tests === - -Running gcc:gcc.dg/vect/vect.exp ... -flaky,expire=20231130 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s2711.c execution test - - === Results Summary === - -# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/176/: - === gcc tests === - -Running gcc:gcc.dg/vect/vect.exp ... -flaky,expire=20231121 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s271.c execution test -flaky,expire=20231121 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s271.c -flto -ffat-lto-objects execution test - - === Results Summary === - -# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/171/: - === gcc tests === - -Running gcc:gcc.dg/vect/vect.exp ... -flaky,expire=20231106 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s351.c -flto -ffat-lto-objects execution test - - === Results Summary === - # From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/168/: === gcc tests === @@ -151,20 +30,6 @@ flaky,expire=20231104 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s2712.c execution test === Results Summary === -# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/161/: - === gcc tests === - -Running gcc:gcc.dg/dg.exp ... -flaky,expire=20231029 | UNRESOLVED: gcc.dg/long_branch.c compilation failed to produce executable -flaky,expire=20231029 | FAIL: gcc.dg/long_branch.c (test for excess errors) - -Running gcc:gcc.dg/vect/vect.exp ... -flaky,expire=20231029 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s1351.c -flto -ffat-lto-objects execution test -flaky,expire=20231029 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s254.c execution test -flaky,expire=20231029 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-vtv.c execution test - - === Results Summary === - # From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/156/: === gcc tests === @@ -192,18 +57,6 @@ flaky,expire=20231025 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s2711.c execution test === Results Summary === -# From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/119/: - === gcc tests === - -Running gcc:gcc.dg/vect/vect.exp ... -flaky,expire=20231016 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s2712.c execution test -flaky,expire=20231016 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s351.c -flto -ffat-lto-objects execution test -flaky,expire=20231016 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s351.c execution test -flaky,expire=20231016 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s452.c -flto -ffat-lto-objects execution test -flaky,expire=20231016 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-vdotr.c execution test - - === Results Summary === - # From https://ci.linaro.org/job/tcwg_gnu_embed_check_gcc--master-thumb_v8a_hard_eabi-build/116/: === gcc tests === @@ -227,6 +80,7 @@ Running gcc:gcc.dg/vect/vect.exp ... flaky,expire=20230914 | FAIL: gcc.dg/vect/tsvc/vect-tsvc-s271.c execution test === Results Summary === +################################ # Known failures (from baseline) === g++ tests ===