diff --git a/notify/fixes.sum b/notify/fixes.sum new file mode 100644 index 00000000..c90f9797 --- /dev/null +++ b/notify/fixes.sum @@ -0,0 +1,27 @@ + === test-suite tests === + +Running test-suite:Fujitsu/C/0105 ... +FAIL: test-suite :: Fujitsu/C/0105/Fujitsu-C-0105_0223.test + +Running test-suite:Fujitsu/C/0131 ... +FAIL: test-suite :: Fujitsu/C/0131/Fujitsu-C-0131_0301.test + +Running test-suite:Fujitsu/Fortran/0141 ... +FAIL: test-suite :: Fujitsu/Fortran/0141/Fujitsu-Fortran-0141_0026.test +FAIL: test-suite :: Fujitsu/Fortran/0141/Fujitsu-Fortran-0141_0022.test +FAIL: test-suite :: Fujitsu/Fortran/0141/Fujitsu-Fortran-0141_0028.test +FAIL: test-suite :: Fujitsu/Fortran/0141/Fujitsu-Fortran-0141_0024.test + +Running test-suite:Fujitsu/Fortran/0539 ... +FAIL: test-suite :: Fujitsu/Fortran/0539/Fujitsu-Fortran-0539_0034.test +FAIL: test-suite :: Fujitsu/Fortran/0539/Fujitsu-Fortran-0539_0037.test +FAIL: test-suite :: Fujitsu/Fortran/0539/Fujitsu-Fortran-0539_0047.test +FAIL: test-suite :: Fujitsu/Fortran/0539/Fujitsu-Fortran-0539_0036.test +FAIL: test-suite :: Fujitsu/Fortran/0539/Fujitsu-Fortran-0539_0042.test +FAIL: test-suite :: Fujitsu/Fortran/0539/Fujitsu-Fortran-0539_0035.test + + === Results Summary === + +# of stable fails 130 +# of flaky entries 17 +# of all tests 88889 diff --git a/notify/jira/comment-card.txt b/notify/jira/comment-card.txt index 1096d641..b2e85e37 100644 --- a/notify/jira/comment-card.txt +++ b/notify/jira/comment-card.txt @@ -1,3 +1,3 @@ [LLVM-1632] -7 regressions 12 improvements +7 regressions 12 fixes Details: https://ci.linaro.org/job/tcwg_flang_test--main-aarch64-O0-debug-build/658/artifact/artifacts/notify/mail-body.txt/*view*/ diff --git a/notify/jira/comment-template.txt b/notify/jira/comment-template.txt index bfae233c..3f5fc39e 100644 --- a/notify/jira/comment-template.txt +++ b/notify/jira/comment-template.txt @@ -1,4 +1,4 @@ [LLVM-1290] https://linaro.atlassian.net/browse/LLVM-1632 -7 regressions 12 improvements +7 regressions 12 fixes Details: https://ci.linaro.org/job/tcwg_flang_test--main-aarch64-O0-debug-build/658/artifact/artifacts/notify/mail-body.txt/*view*/ diff --git a/notify/jira/description b/notify/jira/description index 5a2c3764..acd71b82 100644 --- a/notify/jira/description +++ b/notify/jira/description @@ -7,8 +7,20 @@ Date: Mon Mar 17 17:12:47 2025 +0900 * tcwg_flang_test ** main-aarch64-O0-debug -*** 7 regressions 12 improvements -*** https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/fujitsu_testsuite/sha1/011e6d92dd86a39ccc5c28cc30672c158422c191/tcwg_flang_test/main-aarch64-O0-debug/details.txt +*** 7 regressions 12 fixes +*** https://gitlab.com/LinaroLtd/tcwg/ci/interesting-commits/-/raw/master/fujitsu_testsuite/sha1/011e6d92dd86a39ccc5c28cc30672c158422c191/tcwg_flang_test/main-aarch64-O0-debug/details.txt *** https://ci.linaro.org/job/tcwg_flang_test--main-aarch64-O0-debug-build/658/artifact/artifacts +** main-aarch64-O3-neoverse_v1-sve_vla-mpipeliner-stack_arrays +*** 12 regressions 16 improvements +*** https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/fujitsu_testsuite/sha1/011e6d92dd86a39ccc5c28cc30672c158422c191/tcwg_flang_test/main-aarch64-O3-neoverse_v1-sve_vla-mpipeliner-stack_arrays/details.txt +*** https://ci.linaro.org/job/tcwg_flang_test--main-aarch64-O3-neoverse_v1-sve_vla-mpipeliner-stack_arrays-build/628/artifact/artifacts +** main-aarch64-Ofast-sve_vla +*** 18 regressions 17 improvements +*** https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/fujitsu_testsuite/sha1/011e6d92dd86a39ccc5c28cc30672c158422c191/tcwg_flang_test/main-aarch64-Ofast-sve_vla/details.txt +*** https://ci.linaro.org/job/tcwg_flang_test--main-aarch64-Ofast-sve_vla-build/1810/artifact/artifacts +** main-aarch64-Ofast-sve_vls-lto-lld +*** 19 regressions 17 improvements +*** https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/fujitsu_testsuite/sha1/011e6d92dd86a39ccc5c28cc30672c158422c191/tcwg_flang_test/main-aarch64-Ofast-sve_vls-lto-lld/details.txt +*** https://ci.linaro.org/job/tcwg_flang_test--main-aarch64-Ofast-sve_vls-lto-lld-build/1765/artifact/artifacts -Latest data: https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/fujitsu_testsuite/sha1/011e6d92dd86a39ccc5c28cc30672c158422c191/jira/yaml +Latest data: https://gitlab.com/LinaroLtd/tcwg/ci/interesting-commits/-/raw/master/fujitsu_testsuite/sha1/011e6d92dd86a39ccc5c28cc30672c158422c191/jira/yaml diff --git a/notify/jira/summary b/notify/jira/summary index ef3aed52..1f3b77d9 100644 --- a/notify/jira/summary +++ b/notify/jira/summary @@ -1 +1 @@ -fujitsu_testsuite#011e6d92d: 7 regressions 12 improvements +fujitsu_testsuite#011e6d92d: 18 regressions 17 improvements diff --git a/notify/jira/yaml b/notify/jira/yaml index acaf92ea..1de708c4 100644 --- a/notify/jira/yaml +++ b/notify/jira/yaml @@ -2,7 +2,7 @@ IssueType: Sub-task Key: LLVM-1632 Summary: | - fujitsu_testsuite#011e6d92d: 7 regressions 12 improvements + fujitsu_testsuite#011e6d92d: 18 regressions 17 improvements Components: CI Start date: 2025-03-17 Description: | @@ -15,8 +15,20 @@ * tcwg_flang_test ** main-aarch64-O0-debug - *** 7 regressions 12 improvements - *** https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/fujitsu_testsuite/sha1/011e6d92dd86a39ccc5c28cc30672c158422c191/tcwg_flang_test/main-aarch64-O0-debug/details.txt + *** 7 regressions 12 fixes + *** https://gitlab.com/LinaroLtd/tcwg/ci/interesting-commits/-/raw/master/fujitsu_testsuite/sha1/011e6d92dd86a39ccc5c28cc30672c158422c191/tcwg_flang_test/main-aarch64-O0-debug/details.txt *** https://ci.linaro.org/job/tcwg_flang_test--main-aarch64-O0-debug-build/658/artifact/artifacts + ** main-aarch64-O3-neoverse_v1-sve_vla-mpipeliner-stack_arrays + *** 12 regressions 16 improvements + *** https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/fujitsu_testsuite/sha1/011e6d92dd86a39ccc5c28cc30672c158422c191/tcwg_flang_test/main-aarch64-O3-neoverse_v1-sve_vla-mpipeliner-stack_arrays/details.txt + *** https://ci.linaro.org/job/tcwg_flang_test--main-aarch64-O3-neoverse_v1-sve_vla-mpipeliner-stack_arrays-build/628/artifact/artifacts + ** main-aarch64-Ofast-sve_vla + *** 18 regressions 17 improvements + *** https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/fujitsu_testsuite/sha1/011e6d92dd86a39ccc5c28cc30672c158422c191/tcwg_flang_test/main-aarch64-Ofast-sve_vla/details.txt + *** https://ci.linaro.org/job/tcwg_flang_test--main-aarch64-Ofast-sve_vla-build/1810/artifact/artifacts + ** main-aarch64-Ofast-sve_vls-lto-lld + *** 19 regressions 17 improvements + *** https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/fujitsu_testsuite/sha1/011e6d92dd86a39ccc5c28cc30672c158422c191/tcwg_flang_test/main-aarch64-Ofast-sve_vls-lto-lld/details.txt + *** https://ci.linaro.org/job/tcwg_flang_test--main-aarch64-Ofast-sve_vls-lto-lld-build/1765/artifact/artifacts - Latest data: https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/fujitsu_testsuite/sha1/011e6d92dd86a39ccc5c28cc30672c158422c191/jira/yaml + Latest data: https://gitlab.com/LinaroLtd/tcwg/ci/interesting-commits/-/raw/master/fujitsu_testsuite/sha1/011e6d92dd86a39ccc5c28cc30672c158422c191/jira/yaml diff --git a/notify/lnt_report.json b/notify/lnt_report.json index c3632e95..741e51c9 100644 --- a/notify/lnt_report.json +++ b/notify/lnt_report.json @@ -14,12 +14,12 @@ "git_fujitsu_testsuite": "https://github.com/fujitsu/compiler-test-suite/commit/011e6d92dd86a39ccc5c28cc30672c158422c191 (+ 1 commits)", "__report_version__": "1" }, - "Start Time": "2025-03-18 19:42:23" + "Start Time": "2025-03-19 03:04:08" }, "Tests": [ { "Data": [ - 124 + 125 ], "Info": {}, "Name": "tcwg_flang_test.TOTAL.fails.nb_fails" @@ -27,7 +27,7 @@ , { "Data": [ - 23 + 17 ], "Info": {}, "Name": "tcwg_flang_test.TOTAL.flaky.nb_flaky" diff --git a/notify/mail-body.txt b/notify/mail-body.txt index 8e9afaa4..ac8b1393 100644 --- a/notify/mail-body.txt +++ b/notify/mail-body.txt @@ -9,7 +9,7 @@ In tcwg_flang_test/main-aarch64-O0-debug, after: | | Add test programs for the 2025-03 release -Produces 7 regressions 12 improvements: +Produces 7 regressions 12 fixes: | | regressions.sum: | Running test-suite:Fujitsu/Fortran/0410 ... @@ -18,18 +18,14 @@ Produces 7 regressions 12 improvements: | FAIL: test-suite :: Fujitsu/Fortran/1047/Fujitsu-Fortran-1047_0041.test | FAIL: test-suite :: Fujitsu/Fortran/1047/Fujitsu-Fortran-1047_0058.test | ... and 5 more - | # "NOEXE" means : the test program cannot be compiled - | # "FAIL" means : the execution of the compiled binary failed / output of the binary differs from the expected one | - | improvements.sum: + | fixes.sum: | Running test-suite:Fujitsu/C/0105 ... | FAIL: test-suite :: Fujitsu/C/0105/Fujitsu-C-0105_0223.test | Running test-suite:Fujitsu/C/0131 ... | FAIL: test-suite :: Fujitsu/C/0131/Fujitsu-C-0131_0301.test | Running test-suite:Fujitsu/Fortran/0141 ... | ... and 11 more - | # "NOEXE" means : the test program cannot be compiled - | # "FAIL" means : the execution of the compiled binary failed / output of the binary differs from the expected one Used configuration : * Toolchain : cmake -G Ninja ../llvm/llvm "-DLLVM_ENABLE_PROJECTS=clang;lld;flang;openmp;clang-tools-extra" -DCMAKE_BUILD_TYPE=Release -DLLVM_ENABLE_ASSERTIONS=True -DCMAKE_INSTALL_PREFIX=../llvm-install "-DLLVM_TARGETS_TO_BUILD=AArch64" -DCLANG_DEFAULT_LINKER=lld @@ -44,8 +40,8 @@ If you have any questions regarding this report, please ask on linaro-toolchain@ The information below contains the details of the failures, and the ways to reproduce a debug environment: -You can find the failure logs in *.log.1.xz files in - * https://ci.linaro.org/job/tcwg_flang_test--main-aarch64-O0-debug-build/658/artifact/artifacts/00-sumfiles/ +You can find the failure logs in + * https://ci.linaro.org/job/tcwg_flang_test--main-aarch64-O0-debug-build/658/artifact/artifacts/ The full lists of regressions and improvements as well as configure and make commands are in * https://ci.linaro.org/job/tcwg_flang_test--main-aarch64-O0-debug-build/658/artifact/artifacts/notify/ The list of [ignored] baseline and flaky failures are in @@ -56,7 +52,7 @@ Fujitsu testsuite : https://github.com/fujitsu/compiler-test-suite/ Current build : https://ci.linaro.org/job/tcwg_flang_test--main-aarch64-O0-debug-build/658/artifact/artifacts Reference build : https://ci.linaro.org/job/tcwg_flang_test--main-aarch64-O0-debug-build/657/artifact/artifacts -Instruction to reproduce the build : https://git-us.linaro.org/toolchain/ci/interesting-commits.git/plain/fujitsu_testsuite/sha1/011e6d92dd86a39ccc5c28cc30672c158422c191/tcwg_flang_test/main-aarch64-O0-debug/reproduction_instructions.txt +Instruction to reproduce the build : https://gitlab.com/LinaroLtd/tcwg/ci/interesting-commits/-/raw/master/fujitsu_testsuite/sha1/011e6d92dd86a39ccc5c28cc30672c158422c191/tcwg_flang_test/main-aarch64-O0-debug/reproduction_instructions.txt Full commit : https://github.com/fujitsu/compiler-test-suite/commit/011e6d92dd86a39ccc5c28cc30672c158422c191 diff --git a/notify/mail-subject.txt b/notify/mail-subject.txt index ad4519a6..de13699c 100644 --- a/notify/mail-subject.txt +++ b/notify/mail-subject.txt @@ -1 +1 @@ -[Linaro-TCWG-CI] fujitsu_testsuite#011e6d92d: 7 regressions 12 improvements on aarch64 +[Linaro-TCWG-CI] fujitsu_testsuite#011e6d92d: 7 regressions 12 fixes on aarch64 diff --git a/notify/regressions.sum b/notify/regressions.sum index 7317acda..7d228c18 100644 --- a/notify/regressions.sum +++ b/notify/regressions.sum @@ -15,6 +15,6 @@ NOEXE: test-suite :: Fujitsu/Fortran/1052/Fujitsu-Fortran-1052_0141.test === Results Summary === -# of stable fails 124 -# of flaky entries 23 +# of stable fails 125 +# of flaky entries 17 # of all tests 88889 diff --git a/notify/results-summary.txt b/notify/results-summary.txt index 61c2f4ba..b010683f 100644 --- a/notify/results-summary.txt +++ b/notify/results-summary.txt @@ -1,5 +1,5 @@ === Results Summary === -# of stable fails 124 -# of flaky entries 23 +# of stable fails 125 +# of flaky entries 17 # of all tests 88889