06-check_regression/baseline.xfail | 304 +++++++++++++++++++++++++++++++++++++ 06-check_regression/console.log.xz | Bin 0 -> 5916 bytes 06-check_regression/fails.sum | 6 + 06-check_regression/flaky.xfail | 90 +++++++++++ README.html | 38 ++--- README.txt | 37 +---- jenkins/old_jira_cards.log | 201 ++++++++++++++++++++++++ sumfiles/xfails.xfail | 2 + 8 files changed, 620 insertions(+), 58 deletions(-) diff --git a/06-check_regression/baseline.xfail b/06-check_regression/baseline.xfail new file mode 100644 index 00000000..1cd9f75b --- /dev/null +++ b/06-check_regression/baseline.xfail @@ -0,0 +1,304 @@ + === g++ tests === + +Running g++:g++.dg/dg.exp ... +FAIL: g++.dg/tree-ssa/pr83215.C -std=gnu++14 scan-tree-dump-times fre1 "\\*i" 1 +FAIL: g++.dg/tree-ssa/pr83215.C -std=gnu++17 scan-tree-dump-times fre1 "\\*i" 1 +FAIL: g++.dg/tree-ssa/pr83215.C -std=gnu++20 scan-tree-dump-times fre1 "\\*i" 1 +FAIL: g++.dg/tree-ssa/pr83215.C -std=gnu++98 scan-tree-dump-times fre1 "\\*i" 1 + +Running g++:g++.dg/guality/guality.exp ... +FAIL: g++.dg/guality/pr55665.C -O2 -flto -fno-use-linker-plugin -flto-partition=none line 23 p == 40 + +Running g++:g++.target/arm/arm.exp ... +XPASS: g++.target/arm/bfloat_cpp_typecheck.C (test for bogus messages, line 10) +XPASS: g++.target/arm/bfloat_cpp_typecheck.C (test for bogus messages, line 11) + === gcc tests === + +Running gcc:gcc.dg/dg.exp ... +XPASS: gcc.dg/Wstringop-overflow-47.c pr97027 (test for warnings, line 72) +XPASS: gcc.dg/Wstringop-overflow-47.c pr97027 (test for warnings, line 77) +XPASS: gcc.dg/Wstringop-overflow-47.c pr97027 note (test for warnings, line 68) +FAIL: gcc.dg/fold-copysign-1.c scan-tree-dump-times cddce1 "= ABS_EXPR" 1 +FAIL: gcc.dg/fold-copysign-1.c scan-tree-dump-times cddce1 "__builtin_copysign" 1 +FAIL: gcc.dg/pr55152-2.c scan-tree-dump-times optimized ".COPYSIGN" 1 +FAIL: gcc.dg/pr55152-2.c scan-tree-dump-times optimized "ABS_EXPR" 1 + +Running gcc:gcc.dg/guality/guality.exp ... +XPASS: gcc.dg/guality/example.c -O0 execution test +XPASS: gcc.dg/guality/example.c -O1 -DPREVENT_OPTIMIZATION execution test +XPASS: gcc.dg/guality/example.c -Og -DPREVENT_OPTIMIZATION execution test +XPASS: gcc.dg/guality/guality.c -O0 execution test +XPASS: gcc.dg/guality/guality.c -O1 -DPREVENT_OPTIMIZATION execution test +XPASS: gcc.dg/guality/guality.c -O2 -DPREVENT_OPTIMIZATION execution test +XPASS: gcc.dg/guality/guality.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION execution test +XPASS: gcc.dg/guality/guality.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION execution test +XPASS: gcc.dg/guality/guality.c -O3 -g -DPREVENT_OPTIMIZATION execution test +XPASS: gcc.dg/guality/guality.c -Os -DPREVENT_OPTIMIZATION execution test +XPASS: gcc.dg/guality/guality.c -Og -DPREVENT_OPTIMIZATION execution test +XPASS: gcc.dg/guality/inline-params.c -O2 -DPREVENT_OPTIMIZATION execution test +XPASS: gcc.dg/guality/inline-params.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION execution test +XPASS: gcc.dg/guality/inline-params.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION execution test +XPASS: gcc.dg/guality/inline-params.c -O3 -g -DPREVENT_OPTIMIZATION execution test +XPASS: gcc.dg/guality/inline-params.c -Os -DPREVENT_OPTIMIZATION execution test +FAIL: gcc.dg/guality/loop-1.c -O3 -fomit-frame-pointer -funroll-loops -fpeel-loops -ftracer -finline-functions -DPREVENT_OPTIMIZATION line 20 i == 1 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -DPREVENT_OPTIMIZATION line 16 arg5 == 5 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -DPREVENT_OPTIMIZATION line 18 arg5 == 5 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 16 arg5 == 5 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 18 arg5 == 5 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 16 arg1 == 1 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 16 arg2 == 2 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 16 arg3 == 3 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 16 arg4 == 4 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 16 arg5 == 5 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 16 arg6 == 6 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 16 arg7 == 30 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 16 y == 2 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 18 arg1 == 1 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 18 arg2 == 2 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 18 arg3 == 3 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 18 arg4 == 4 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 18 arg5 == 5 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 18 arg6 == 6 +FAIL: gcc.dg/guality/pr36728-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 18 arg7 == 30 +FAIL: gcc.dg/guality/pr36728-2.c -O3 -g -DPREVENT_OPTIMIZATION line 16 arg1 == 1 +FAIL: gcc.dg/guality/pr36728-2.c -O3 -g -DPREVENT_OPTIMIZATION line 16 arg2 == 2 +FAIL: gcc.dg/guality/pr36728-2.c -O3 -g -DPREVENT_OPTIMIZATION line 16 arg3 == 3 +FAIL: gcc.dg/guality/pr36728-2.c -O3 -g -DPREVENT_OPTIMIZATION line 16 arg4 == 4 +FAIL: gcc.dg/guality/pr36728-2.c -O3 -g -DPREVENT_OPTIMIZATION line 16 arg5 == 5 +FAIL: gcc.dg/guality/pr36728-2.c -O3 -g -DPREVENT_OPTIMIZATION line 16 arg6 == 6 +FAIL: gcc.dg/guality/pr36728-2.c -O3 -g -DPREVENT_OPTIMIZATION line 16 arg7 == 30 +FAIL: gcc.dg/guality/pr36728-2.c -O3 -g -DPREVENT_OPTIMIZATION line 18 arg1 == 1 +FAIL: gcc.dg/guality/pr36728-2.c -O3 -g -DPREVENT_OPTIMIZATION line 18 arg2 == 2 +FAIL: gcc.dg/guality/pr36728-2.c -O3 -g -DPREVENT_OPTIMIZATION line 18 arg3 == 3 +FAIL: gcc.dg/guality/pr36728-2.c -O3 -g -DPREVENT_OPTIMIZATION line 18 arg4 == 4 +FAIL: gcc.dg/guality/pr36728-2.c -O3 -g -DPREVENT_OPTIMIZATION line 18 arg5 == 5 +FAIL: gcc.dg/guality/pr36728-2.c -O3 -g -DPREVENT_OPTIMIZATION line 18 arg6 == 6 +FAIL: gcc.dg/guality/pr36728-2.c -O3 -g -DPREVENT_OPTIMIZATION line 18 arg7 == 30 +FAIL: gcc.dg/guality/pr36728-2.c -Os -DPREVENT_OPTIMIZATION line 16 arg5 == 5 +FAIL: gcc.dg/guality/pr36728-2.c -Os -DPREVENT_OPTIMIZATION line 18 arg5 == 5 +FAIL: gcc.dg/guality/pr36728-4.c -O2 -DPREVENT_OPTIMIZATION line 14 arg5 == 5 +FAIL: gcc.dg/guality/pr36728-4.c -O2 -DPREVENT_OPTIMIZATION line 16 arg5 == 5 +FAIL: gcc.dg/guality/pr36728-4.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 14 arg5 == 5 +FAIL: gcc.dg/guality/pr36728-4.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 16 arg5 == 5 +FAIL: gcc.dg/guality/pr36728-4.c -Os -DPREVENT_OPTIMIZATION line 14 arg5 == 5 +FAIL: gcc.dg/guality/pr36728-4.c -Os -DPREVENT_OPTIMIZATION line 16 arg5 == 5 +FAIL: gcc.dg/guality/pr43051-1.c -O3 -g -DPREVENT_OPTIMIZATION line 35 v == 1 +FAIL: gcc.dg/guality/pr43051-1.c -O3 -g -DPREVENT_OPTIMIZATION line 36 e == &a[1] +FAIL: gcc.dg/guality/pr43051-1.c -O3 -g -DPREVENT_OPTIMIZATION line 40 v == 1 +FAIL: gcc.dg/guality/pr43051-1.c -O3 -g -DPREVENT_OPTIMIZATION line 41 e == &a[1] +FAIL: gcc.dg/guality/pr54200.c -O1 -DPREVENT_OPTIMIZATION line 20 z == 3 +FAIL: gcc.dg/guality/pr54200.c -O2 -DPREVENT_OPTIMIZATION line 20 z == 3 +FAIL: gcc.dg/guality/pr54200.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 20 z == 3 +FAIL: gcc.dg/guality/pr54200.c -O3 -g -DPREVENT_OPTIMIZATION line 20 z == 3 +FAIL: gcc.dg/guality/pr54200.c -Os -DPREVENT_OPTIMIZATION line 20 z == 3 +FAIL: gcc.dg/guality/pr54519-1.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 20 y == 25 +FAIL: gcc.dg/guality/pr54519-1.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 20 z == 6 +FAIL: gcc.dg/guality/pr54519-1.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 23 y == 117 +FAIL: gcc.dg/guality/pr54519-1.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 23 z == 8 +FAIL: gcc.dg/guality/pr54519-1.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 20 y == 25 +FAIL: gcc.dg/guality/pr54519-1.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 20 z == 6 +FAIL: gcc.dg/guality/pr54519-1.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 23 y == 117 +FAIL: gcc.dg/guality/pr54519-1.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 23 z == 8 +FAIL: gcc.dg/guality/pr54519-2.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 17 y == 25 +FAIL: gcc.dg/guality/pr54519-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 17 y == 25 +FAIL: gcc.dg/guality/pr54519-3.c -O1 -DPREVENT_OPTIMIZATION line 20 z == 6 +FAIL: gcc.dg/guality/pr54519-3.c -O1 -DPREVENT_OPTIMIZATION line 23 z == 8 +FAIL: gcc.dg/guality/pr54519-3.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 20 y == 25 +FAIL: gcc.dg/guality/pr54519-3.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 20 z == 6 +FAIL: gcc.dg/guality/pr54519-3.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 23 y == 117 +FAIL: gcc.dg/guality/pr54519-3.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 23 z == 8 +FAIL: gcc.dg/guality/pr54519-3.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 20 y == 25 +FAIL: gcc.dg/guality/pr54519-3.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 20 z == 6 +FAIL: gcc.dg/guality/pr54519-3.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 23 y == 117 +FAIL: gcc.dg/guality/pr54519-3.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 23 z == 8 +FAIL: gcc.dg/guality/pr54519-3.c -Og -DPREVENT_OPTIMIZATION line 20 z == 6 +FAIL: gcc.dg/guality/pr54519-3.c -Og -DPREVENT_OPTIMIZATION line 23 z == 8 +FAIL: gcc.dg/guality/pr54519-4.c -O1 -DPREVENT_OPTIMIZATION line 17 y == 25 +FAIL: gcc.dg/guality/pr54519-4.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 17 y == 25 +FAIL: gcc.dg/guality/pr54519-4.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 17 y == 25 +FAIL: gcc.dg/guality/pr54519-4.c -Og -DPREVENT_OPTIMIZATION line 17 y == 25 +FAIL: gcc.dg/guality/pr54519-5.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 17 y == 25 +FAIL: gcc.dg/guality/pr54519-5.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 17 y == 25 +FAIL: gcc.dg/guality/pr54519-6.c -Os -DPREVENT_OPTIMIZATION line 11 x == 2 +FAIL: gcc.dg/guality/pr54693-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 21 x == 10 - i +FAIL: gcc.dg/guality/pr54693-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 21 y == 20 - 2 * i +FAIL: gcc.dg/guality/pr54693-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 21 z == 30 - 3 * i +FAIL: gcc.dg/guality/pr54693-2.c -Os -DPREVENT_OPTIMIZATION line 21 y == 20 - 2 * i +FAIL: gcc.dg/guality/pr54693-2.c -Os -DPREVENT_OPTIMIZATION line 21 z == 30 - 3 * i +FAIL: gcc.dg/guality/pr56154-1.c -Og -DPREVENT_OPTIMIZATION line pr56154-1.c:20 x.a == 6 +XPASS: gcc.dg/guality/pr59776.c -Og -DPREVENT_OPTIMIZATION line pr59776.c:17 s2.g == 6.0 +XPASS: gcc.dg/guality/pr59776.c -Og -DPREVENT_OPTIMIZATION line pr59776.c:20 s2.g == 6.0 +FAIL: gcc.dg/guality/pr78726.c -Og -DPREVENT_OPTIMIZATION line 21 d3 == ~36U * 1023094746 +FAIL: gcc.dg/guality/pr90074.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 28 c + 1 == 2 +FAIL: gcc.dg/guality/pr90074.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 28 i + 1 == 8 +FAIL: gcc.dg/guality/pr90716.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 23 j + 1 == 9 +FAIL: gcc.dg/guality/sra-1.c -O2 -DPREVENT_OPTIMIZATION line 43 a.i == 4 +FAIL: gcc.dg/guality/sra-1.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 43 a.i == 4 +FAIL: gcc.dg/guality/sra-1.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 21 a.j == 14 +FAIL: gcc.dg/guality/sra-1.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 32 a[1] == 14 +FAIL: gcc.dg/guality/sra-1.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 43 a.j == 14 +FAIL: gcc.dg/guality/sra-1.c -O3 -g -DPREVENT_OPTIMIZATION line 43 a.i == 4 +FAIL: gcc.dg/guality/sra-1.c -Og -DPREVENT_OPTIMIZATION line 43 a.i == 4 +FAIL: gcc.dg/guality/sra-1.c -Og -DPREVENT_OPTIMIZATION line 43 a.j == 14 +FAIL: gcc.dg/guality/vla-1.c -O2 -DPREVENT_OPTIMIZATION line 17 sizeof (a) == 6 +FAIL: gcc.dg/guality/vla-1.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 17 sizeof (a) == 6 +FAIL: gcc.dg/guality/vla-1.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 17 sizeof (a) == 6 +FAIL: gcc.dg/guality/vla-1.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 24 i == 5 +FAIL: gcc.dg/guality/vla-1.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects -DPREVENT_OPTIMIZATION line 24 sizeof (a) == 17 * sizeof (short) +FAIL: gcc.dg/guality/vla-1.c -O3 -g -DPREVENT_OPTIMIZATION line 17 sizeof (a) == 6 +FAIL: gcc.dg/guality/vla-1.c -Os -DPREVENT_OPTIMIZATION line 17 sizeof (a) == 6 +FAIL: gcc.dg/guality/vla-2.c -O2 -DPREVENT_OPTIMIZATION line 25 sizeof (a) == 6 * sizeof (int) +FAIL: gcc.dg/guality/vla-2.c -O2 -flto -fno-use-linker-plugin -flto-partition=none -DPREVENT_OPTIMIZATION line 25 sizeof (a) == 6 * sizeof (int) +FAIL: gcc.dg/guality/vla-2.c -O3 -g -DPREVENT_OPTIMIZATION line 25 sizeof (a) == 6 * sizeof (int) +FAIL: gcc.dg/guality/vla-2.c -Os -DPREVENT_OPTIMIZATION line 25 sizeof (a) == 6 * sizeof (int) + +Running gcc:gcc.dg/plugin/plugin.exp ... +FAIL: gcc.dg/plugin/must-tail-call-1.c -fplugin=./must_tail_call_plugin.so (internal compiler error: in df_refs_verify, at df-scan.cc:4019) +FAIL: gcc.dg/plugin/must-tail-call-1.c -fplugin=./must_tail_call_plugin.so (test for excess errors) + +Running gcc:gcc.dg/simulate-thread/simulate-thread.exp ... +FAIL: gcc.dg/simulate-thread/atomic-load-longlong.c -O0 -g thread simulation test +FAIL: gcc.dg/simulate-thread/atomic-other-int.c -O0 -g thread simulation test +FAIL: gcc.dg/simulate-thread/atomic-other-int.c -O2 -g thread simulation test +FAIL: gcc.dg/simulate-thread/atomic-other-int.c -O3 -g thread simulation test +FAIL: gcc.dg/simulate-thread/atomic-other-longlong.c -O0 -g thread simulation test +FAIL: gcc.dg/simulate-thread/atomic-other-longlong.c -O2 -g thread simulation test +FAIL: gcc.dg/simulate-thread/atomic-other-longlong.c -O3 -g thread simulation test +FAIL: gcc.dg/simulate-thread/atomic-other-short.c -O0 -g thread simulation test +FAIL: gcc.dg/simulate-thread/atomic-other-short.c -O2 -g thread simulation test +FAIL: gcc.dg/simulate-thread/atomic-other-short.c -O3 -g thread simulation test + +Running gcc:gcc.dg/torture/dg-torture.exp ... +FAIL: gcc.dg/torture/builtin-iseqsig-1.c -Os execution test +FAIL: gcc.dg/torture/builtin-iseqsig-2.c -Os execution test +FAIL: gcc.dg/torture/builtin-iseqsig-3.c -Os execution test +FAIL: gcc.dg/torture/fp-uint64-convert-double-1.c -O0 execution test +FAIL: gcc.dg/torture/fp-uint64-convert-double-1.c -O1 execution test +FAIL: gcc.dg/torture/fp-uint64-convert-double-1.c -O2 execution test +FAIL: gcc.dg/torture/fp-uint64-convert-double-1.c -O2 -flto -fno-use-linker-plugin -flto-partition=none execution test +FAIL: gcc.dg/torture/fp-uint64-convert-double-1.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects execution test +FAIL: gcc.dg/torture/fp-uint64-convert-double-1.c -O3 -g execution test +FAIL: gcc.dg/torture/fp-uint64-convert-double-1.c -Os execution test +FAIL: gcc.dg/torture/fp-uint64-convert-double-2.c -O0 execution test +FAIL: gcc.dg/torture/fp-uint64-convert-double-2.c -O1 execution test +FAIL: gcc.dg/torture/fp-uint64-convert-double-2.c -O2 execution test +FAIL: gcc.dg/torture/fp-uint64-convert-double-2.c -O2 -flto -fno-use-linker-plugin -flto-partition=none execution test +FAIL: gcc.dg/torture/fp-uint64-convert-double-2.c -O2 -flto -fuse-linker-plugin -fno-fat-lto-objects execution test +FAIL: gcc.dg/torture/fp-uint64-convert-double-2.c -O3 -g execution test +FAIL: gcc.dg/torture/fp-uint64-convert-double-2.c -Os execution test + +Running gcc:gcc.dg/tree-prof/tree-prof.exp ... +FAIL: gcc.dg/tree-prof/pr77698.c scan-rtl-dump-times alignments "internal loop alignment added" 1 + +Running gcc:gcc.dg/tree-ssa/tree-ssa.exp ... +FAIL: gcc.dg/tree-ssa/abs-4.c scan-tree-dump-times optimized "= -" 1 +FAIL: gcc.dg/tree-ssa/abs-4.c scan-tree-dump-times optimized "= .COPYSIGN" 2 +FAIL: gcc.dg/tree-ssa/abs-4.c scan-tree-dump-times optimized "= ABS_EXPR" 1 +FAIL: gcc.dg/tree-ssa/backprop-6.c scan-tree-dump-times backprop "Deleting[^\\n]* = -" 4 +FAIL: gcc.dg/tree-ssa/backprop-6.c scan-tree-dump-times backprop "Deleting[^\\n]* = ABS_EXPR <" 1 +FAIL: gcc.dg/tree-ssa/backprop-6.c scan-tree-dump-times backprop "Deleting[^\\n]* = \\.COPYSIGN" 2 +FAIL: gcc.dg/tree-ssa/copy-sign-2.c scan-tree-dump-times optimized ".COPYSIGN" 1 +FAIL: gcc.dg/tree-ssa/copy-sign-2.c scan-tree-dump-times optimized "ABS" 1 +FAIL: gcc.dg/tree-ssa/predcom-2.c scan-tree-dump-times pcom "Unrolling 2 times." 2 +FAIL: gcc.dg/tree-ssa/ssa-lim-15.c scan-tree-dump lim2 "Executing store motion" + +Running gcc:gcc.dg/vect/vect.exp ... +FAIL: gcc.dg/vect/slp-47.c -flto -ffat-lto-objects scan-tree-dump-times vect "vectorizing stmts using SLP" 2 +FAIL: gcc.dg/vect/slp-47.c scan-tree-dump-times vect "vectorizing stmts using SLP" 2 +FAIL: gcc.dg/vect/slp-48.c -flto -ffat-lto-objects scan-tree-dump-times vect "vectorizing stmts using SLP" 2 +FAIL: gcc.dg/vect/slp-48.c scan-tree-dump-times vect "vectorizing stmts using SLP" 2 +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s124.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s124.c scan-tree-dump vect "vectorized 1 loops" +FAIL: gcc.dg/vect/tsvc/vect-tsvc-s1281.c -flto -ffat-lto-objects execution test +FAIL: gcc.dg/vect/tsvc/vect-tsvc-s1281.c execution test +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s276.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s276.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s3111.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s3111.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s3113.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s3113.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s312.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s312.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s314.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s314.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s316.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s316.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s317.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s317.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s319.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s319.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s441.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s441.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s443.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s443.c scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s453.c -flto -ffat-lto-objects scan-tree-dump vect "vectorized 1 loops" +XPASS: gcc.dg/vect/tsvc/vect-tsvc-s453.c scan-tree-dump vect "vectorized 1 loops" +FAIL: gcc.dg/vect/vect-fmax-2.c -flto -ffat-lto-objects scan-tree-dump vect "Detected reduction" +FAIL: gcc.dg/vect/vect-fmax-2.c -flto -ffat-lto-objects scan-tree-dump vect "LOOP VECTORIZED" +FAIL: gcc.dg/vect/vect-fmax-2.c scan-tree-dump vect "Detected reduction" +FAIL: gcc.dg/vect/vect-fmax-2.c scan-tree-dump vect "LOOP VECTORIZED" +FAIL: gcc.dg/vect/vect-fmax-3.c -flto -ffat-lto-objects scan-tree-dump vect "Detected reduction" +FAIL: gcc.dg/vect/vect-fmax-3.c -flto -ffat-lto-objects scan-tree-dump vect "LOOP VECTORIZED" +FAIL: gcc.dg/vect/vect-fmax-3.c scan-tree-dump vect "Detected reduction" +FAIL: gcc.dg/vect/vect-fmax-3.c scan-tree-dump vect "LOOP VECTORIZED" +FAIL: gcc.dg/vect/vect-fmin-2.c -flto -ffat-lto-objects scan-tree-dump vect "Detected reduction" +FAIL: gcc.dg/vect/vect-fmin-2.c -flto -ffat-lto-objects scan-tree-dump vect "LOOP VECTORIZED" +FAIL: gcc.dg/vect/vect-fmin-2.c scan-tree-dump vect "Detected reduction" +FAIL: gcc.dg/vect/vect-fmin-2.c scan-tree-dump vect "LOOP VECTORIZED" +FAIL: gcc.dg/vect/vect-fmin-3.c -flto -ffat-lto-objects scan-tree-dump vect "Detected reduction" +FAIL: gcc.dg/vect/vect-fmin-3.c -flto -ffat-lto-objects scan-tree-dump vect "LOOP VECTORIZED" +FAIL: gcc.dg/vect/vect-fmin-3.c scan-tree-dump vect "Detected reduction" +FAIL: gcc.dg/vect/vect-fmin-3.c scan-tree-dump vect "LOOP VECTORIZED" + +Running gcc:gcc.target/arm/arm.exp ... +FAIL: gcc.target/arm/addr-modes-float.c scan-assembler vst3.8\t{d[02468], d[02468], d[02468]}, \\[r[0-9]+\\]! +FAIL: gcc.target/arm/aes_xor_combine.c scan-assembler-not veor +FAIL: gcc.target/arm/fmaxmin.c scan-assembler-times vmaxnm.f32\ts[0-9]+, s[0-9]+, s[0-9]+ 1 +FAIL: gcc.target/arm/fmaxmin.c scan-assembler-times vminnm.f32\ts[0-9]+, s[0-9]+, s[0-9]+ 1 +FAIL: gcc.target/arm/ftest-armv5t-thumb.c (test for excess errors) +FAIL: gcc.target/arm/ftest-armv5te-thumb.c (test for excess errors) +FAIL: gcc.target/arm/ftest-armv6-thumb.c (test for excess errors) +FAIL: gcc.target/arm/ftest-armv6k-thumb.c (test for excess errors) +FAIL: gcc.target/arm/ftest-armv6z-thumb.c (test for excess errors) +FAIL: gcc.target/arm/memset-inline-8.c scan-assembler-not vstr +FAIL: gcc.target/arm/pr40457-2.c scan-assembler strd|stm +FAIL: gcc.target/arm/pr43920-2.c object-size text <= 54 +FAIL: gcc.target/arm/pr43920-2.c scan-assembler-times pop 2 +FAIL: gcc.target/arm/pr59858.c (test for excess errors) +FAIL: gcc.target/arm/pr65647.c (test for excess errors) +FAIL: gcc.target/arm/pr65710.c (test for excess errors) +FAIL: gcc.target/arm/vect-early-break-cbranch.c check-function-bodies f1 +FAIL: gcc.target/arm/vect-early-break-cbranch.c check-function-bodies f2 +FAIL: gcc.target/arm/vect-early-break-cbranch.c check-function-bodies f3 +FAIL: gcc.target/arm/vect-early-break-cbranch.c check-function-bodies f4 +FAIL: gcc.target/arm/vect-early-break-cbranch.c check-function-bodies f5 +FAIL: gcc.target/arm/vect-early-break-cbranch.c check-function-bodies f6 +FAIL: gcc.target/arm/wmul-5.c scan-assembler umlal +FAIL: gcc.target/arm/wmul-6.c scan-assembler smlalbb +FAIL: gcc.target/arm/wmul-7.c scan-assembler umlal + +Running gcc:gcc.target/arm/simd/simd.exp ... +FAIL: gcc.target/arm/simd/mve-vabs.c scan-assembler-times memmove 3 +FAIL: gcc.target/arm/simd/mve-vshr.c scan-assembler-times vneg.s[0-9]+\\tq[0-9]+, q[0-9]+ 6 +FAIL: gcc.target/arm/simd/mve-vshr.c scan-assembler-times vshl.s[0-9]+\\tq[0-9]+, q[0-9]+ 3 +FAIL: gcc.target/arm/simd/mve-vshr.c scan-assembler-times vshl.u[0-9]+\\tq[0-9]+, q[0-9]+ 3 + === gfortran tests === + +Running gfortran:gfortran.dg/ieee/ieee.exp ... +FAIL: gfortran.dg/ieee/comparisons_3.F90 -Os execution test + === libgomp tests === + +Running libgomp:libgomp.c/c.exp ... +XPASS: libgomp.c/alloc-pinned-1.c execution test +XPASS: libgomp.c/alloc-pinned-2.c execution test + === libstdc++ tests === + +Running libstdc++:libstdc++-dg/conformance.exp ... +FAIL: 19_diagnostics/stacktrace/current.cc -std=gnu++23 execution test +FAIL: 19_diagnostics/stacktrace/current.cc -std=gnu++26 execution test +FAIL: 19_diagnostics/stacktrace/entry.cc -std=gnu++23 execution test +FAIL: 19_diagnostics/stacktrace/entry.cc -std=gnu++26 execution test +FAIL: 19_diagnostics/stacktrace/output.cc -std=gnu++23 execution test +FAIL: 19_diagnostics/stacktrace/output.cc -std=gnu++26 execution test +FAIL: 19_diagnostics/stacktrace/stacktrace.cc -std=gnu++23 execution test +FAIL: 19_diagnostics/stacktrace/stacktrace.cc -std=gnu++26 execution test diff --git a/06-check_regression/console.log.xz b/06-check_regression/console.log.xz new file mode 100644 index 00000000..2bba3d53 Binary files /dev/null and b/06-check_regression/console.log.xz differ diff --git a/06-check_regression/fails.sum b/06-check_regression/fails.sum new file mode 100644 index 00000000..63dbdc38 --- /dev/null +++ b/06-check_regression/fails.sum @@ -0,0 +1,6 @@ + + === Results Summary === + +# of stable fails 267 +# of flaky entries 0 +# of all tests 591991 diff --git a/06-check_regression/flaky.xfail b/06-check_regression/flaky.xfail new file mode 100644 index 00000000..c30001d4 --- /dev/null +++ b/06-check_regression/flaky.xfail @@ -0,0 +1,90 @@ +################################ +# Known flaky tests + +# From https://ci.linaro.org/job/tcwg_bootstrap_check--master-arm-check_bootstrap_lto-build/620/: + === libstdc++ tests === + +Running libstdc++:libstdc++-dg/conformance.exp ... +flaky,expire=20240622 | FAIL: 29_atomics/atomic/compare_exchange_padding.cc -std=gnu++20 execution test + + === Results Summary === + +# From https://ci.linaro.org/job/tcwg_bootstrap_check--master-arm-check_bootstrap_lto-build/525/: + === libstdc++ tests === + +Running libstdc++:libstdc++-dg/conformance.exp ... +flaky,expire=20240228 | FAIL: 27_io/basic_istream/ignore/char/94749.cc -std=gnu++17 execution test +flaky,expire=20240228 | FAIL: 27_io/basic_istream/ignore/wchar_t/94749.cc -std=gnu++17 execution test + + === Results Summary === + === gcc tests === + +Running gcc:gcc.dg/dg.exp ... +flaky,expire=20240228 | FAIL: gcc.dg/long_branch.c (test for excess errors) +flaky,expire=20240228 | UNRESOLVED: gcc.dg/long_branch.c compilation failed to produce executable + +Running gcc:gcc.dg/plugin/plugin.exp ... +flaky,expire=20240228 | FAIL: gcc.dg/plugin/poly-int-03_plugin.c compilation +flaky,expire=20240228 | FAIL: gcc.dg/plugin/poly-int-04_plugin.c compilation +flaky,expire=20240228 | FAIL: gcc.dg/plugin/poly-int-05_plugin.c compilation + + === Results Summary === + === g++ tests === + +Running g++:g++.dg/asan/asan.exp ... +flaky,expire=20240228 | FAIL: g++.dg/asan/asan_test.C -O2 AddressSanitizer_BufferOverflowAfterManyFrees execution test + + === Results Summary === + +# From https://ci.linaro.org/job/tcwg_bootstrap_check--master-arm-check_bootstrap_lto-build/482/: + === gcc tests === + +Running gcc:gcc.dg/dg.exp ... +flaky,expire=20240209 | UNRESOLVED: gcc.dg/long_branch.c compilation failed to produce executable +flaky,expire=20240209 | FAIL: gcc.dg/long_branch.c (test for excess errors) + + === Results Summary === + +# From https://ci.linaro.org/job/tcwg_bootstrap_check--master-arm-check_bootstrap_lto-build/449/: + === gcc tests === + +Running gcc:gcc.dg/analyzer/analyzer.exp ... +flaky,expire=20240116 | FAIL: gcc.dg/analyzer/data-model-20.c (test for warnings, line 17) + + === Results Summary === + +# From https://ci.linaro.org/job/tcwg_bootstrap_check--master-arm-check_bootstrap_lto-build/406/: + === gcc tests === + +Running gcc:gcc.dg/analyzer/analyzer.exp ... +flaky,expire=20240101 | FAIL: gcc.dg/analyzer/data-model-20.c (test for warnings, line 17) + + === Results Summary === + +# From https://ci.linaro.org/job/tcwg_bootstrap_check--master-arm-check_bootstrap_lto-build/292/: + === libstdc++ tests === + +Running libstdc++:libstdc++-dg/conformance.exp ... +flaky,expire=20231029 | UNRESOLVED: 20_util/duration/io.cc compilation failed to produce executable + + === Results Summary === + === libstdc++ tests === + +Running libstdc++:libstdc++-dg/conformance.exp ... +flaky,expire=20231029 | FAIL: 27_io/basic_istream/ignore/wchar_t/94749.cc execution test + + === Results Summary === + === g++ tests === + +Running g++:g++.dg/asan/asan.exp ... +flaky,expire=20231029 | FAIL: g++.dg/asan/asan_test.C -O2 AddressSanitizer_BufferOverflowAfterManyFrees execution test + + === Results Summary === + +# From https://ci.linaro.org/job/tcwg_bootstrap_check--master-arm-check_bootstrap_lto-build/118/: + === libstdc++ tests === + +Running libstdc++:libstdc++-dg/conformance.exp ... +flaky,expire=20230815 | FAIL: 29_atomics/atomic_ref/compare_exchange_padding.cc execution test + + === Results Summary === diff --git a/README.html b/README.html index a8fdb200..74b25299 100644 --- a/README.html +++ b/README.html @@ -11,14 +11,6 @@ the build. More synthetic information is available in other directories, as described below: