diff --git a/notify/configure-toolchain.txt b/notify/configure-toolchain.txt new file mode 100644 index 00000000..8e581352 --- /dev/null +++ b/notify/configure-toolchain.txt @@ -0,0 +1,5 @@ + +Most relevant configure and test flags: none, autodetected on armv8l-unknown-linux-gnueabihf + +Full configure and make flags for each step: + diff --git a/notify/fixes.sum b/notify/fixes.sum new file mode 100644 index 00000000..feff8d66 --- /dev/null +++ b/notify/fixes.sum @@ -0,0 +1,10 @@ + === gdb tests === + +Running gdb:gdb.base/return.exp ... +ERROR: no fileid for a496f139edba + + === Results Summary === + +# of stable fails 1331 +# of flaky entries 1437 +# of all tests 109458 diff --git a/notify/jira/comment-template.txt b/notify/jira/comment-template.txt index 28b49d6d..0524bd2e 100644 --- a/notify/jira/comment-template.txt +++ b/notify/jira/comment-template.txt @@ -1,3 +1,3 @@ [GNU-692] -FAIL: 1 regressions: 1 improvements +1 regression 1 fix Details: https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1621/artifact/artifacts/notify/mail-body.txt/*view*/ diff --git a/notify/lnt_report.json b/notify/lnt_report.json index 1812cbc8..92e84cff 100644 --- a/notify/lnt_report.json +++ b/notify/lnt_report.json @@ -28,7 +28,7 @@ , { "Data": [ - 1623 + 1437 ], "Info": {}, "Name": "tcwg_gnu_native_check_gdb.TOTAL.flaky.nb_flaky" diff --git a/notify/mail-body.txt b/notify/mail-body.txt index 93a7196b..c6c39a7b 100644 --- a/notify/mail-body.txt +++ b/notify/mail-body.txt @@ -1,39 +1,36 @@ -Dear contributor, our automatic CI has detected problems related to your patch(es). Please find some details below. If you have any questions, please follow up on linaro-toolchain@lists.linaro.org mailing list, Libera's #linaro-tcwg channel, or ping your favourite Linaro toolchain developer on the usual project channel. +Dear contributor, -We understand that it might be difficult to find the necessary logs or reproduce the issue locally. If you can't get what you need from our CI within minutes, let us know and we will be happy to help. - -In master-arm after: +Our automatic CI has detected problems related to your patch(es). Please find some details below. +In master-arm, after: | baseline build -FAIL: 1 regressions: 1 improvements - -regressions.sum: - === gdb tests === +Produces 1 regression 1 fix: + | + | regressions.sum: + | Running gdb:gdb.base/return.exp ... + | ERROR: no fileid for 2bbd12196ece + | + | fixes.sum: + | Running gdb:gdb.base/return.exp ... + | ERROR: no fileid for a496f139edba -Running gdb:gdb.base/return.exp ... -ERROR: no fileid for 2bbd12196ece +Used configuration : + *CI config* tcwg_gnu_native_check_gdb master-arm + *configure and test flags:* none, autodetected on armv8l-unknown-linux-gnueabihf +If you have any questions regarding this report, please ask on linaro-toolchain@lists.linaro.org mailing list. -improvements.sum: - === gdb tests === - -Running gdb:gdb.base/return.exp ... -ERROR: no fileid for a496f139edba +-----------------8<--------------------------8<--------------------------8<-------------------------- +The information below contains the details of the failures, and the ways to reproduce a debug environment: -You can find the failure logs in *.log.1.xz files in - - https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1621/artifact/artifacts/00-sumfiles/ +You can find the failure logs in + * https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1621/artifact/artifacts/ The full lists of regressions and improvements as well as configure and make commands are in - - https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1621/artifact/artifacts/notify/ + * https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1621/artifact/artifacts/notify/ The list of [ignored] baseline and flaky failures are in - - https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1621/artifact/artifacts/sumfiles/xfails.xfail - -The configuration of this build is: -CI config tcwg_gnu_native_check_gdb master-arm - ------------------8<--------------------------8<--------------------------8<-------------------------- -The information below can be used to reproduce a debug environment: + * https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1621/artifact/artifacts/sumfiles/xfails.xfail Current build : https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1621/artifact/artifacts Reference build : https://ci.linaro.org/job/tcwg_gnu_native_check_gdb--master-arm-build/1613/artifact/artifacts diff --git a/notify/mail-subject.txt b/notify/mail-subject.txt index 8ca592f1..3b9e18ff 100644 --- a/notify/mail-subject.txt +++ b/notify/mail-subject.txt @@ -1 +1 @@ -[Linaro-TCWG-CI] baseline build: FAIL: 1 regressions: 1 improvements on arm +[Linaro-TCWG-CI] baseline build: 1 regression 1 fix on arm diff --git a/notify/regressions.sum b/notify/regressions.sum index 2d723c5d..467bec82 100644 --- a/notify/regressions.sum +++ b/notify/regressions.sum @@ -6,5 +6,5 @@ ERROR: no fileid for 2bbd12196ece === Results Summary === # of stable fails 1331 -# of flaky entries 1623 +# of flaky entries 1437 # of all tests 109458 diff --git a/notify/results-summary.txt b/notify/results-summary.txt index 9d5f509d..84d588fb 100644 --- a/notify/results-summary.txt +++ b/notify/results-summary.txt @@ -1,5 +1,5 @@ === Results Summary === # of stable fails 1331 -# of flaky entries 1623 +# of flaky entries 1437 # of all tests 109458 diff --git a/notify/results.compare.txt b/notify/results.compare.txt index 30999df8..ffa45c77 100644 --- a/notify/results.compare.txt +++ b/notify/results.compare.txt @@ -1,12 +1,12 @@ # Comparing directories # REFERENCE: base-artifacts/sumfiles -# CURRENT: artifacts/sumfiles +# CURRENT: artifacts/99-rewrite/artifacts.old/sumfiles # Comparing 1 common sum files: gdb.sum Comparing: -REFERENCE:/tmp/gxx-sum1.1514792 -CURRENT: /tmp/gxx-sum2.1514792 +REFERENCE:/tmp/gxx-sum1.1062340 +CURRENT: /tmp/gxx-sum2.1062340 +---------+---------+ o RUN STATUS: | REF | RES | @@ -43,10 +43,11 @@ o REGRESSIONS: o IMPROVEMENTS TO BE CHECKED: +------------------------------------------+---------+ - | PASS disappears [PASS => ] | 422 | - | New PASS [ => PASS] | 22 | + | PASS disappears [PASS => ] | 410 | + | New PASS [ => PASS] | 5 | | XFAIL appears [ =>XFAIL] | 4 | | ERROR disappears [ERROR=> ] | 1 | + | Flaky cases, ignored [~RANDOM ] | 29 | +------------------------------------------+---------+ | TOTAL_IMPROVEMENTS_TO_BE_CHECKED | 449 | +------------------------------------------+---------+ @@ -102,12 +103,9 @@ o IMPROVEMENTS TO BE CHECKED: gdb:gdb.threads/create-fail.exp=gdb.threads/create-fail.exp: iteration 1: run till end Executed from: gdb:gdb.threads/detach-step-over.exp gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=on: displaced=off: test_detach_command: iter 2: break LOC if 0 - gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=on: displaced=off: test_detach_command: iter 2: continue -a & gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=on: displaced=off: test_detach_command: iter 2: print seconds_left gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=on: displaced=off: test_detach_command: iter 2: reset timer in the inferior gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=on: displaced=off: test_detach_command: iter 2: seen all stops - gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=on: displaced=off: test_detach_command: iter 3: attach - gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=on: displaced=off: test_detach_command: iter 3: inferior 1 Executed from: gdb:gdb.threads/next-fork-exec-other-thread.exp gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=10: next to break here gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=10: next to for loop @@ -471,16 +469,6 @@ o IMPROVEMENTS TO BE CHECKED: gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=vfork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=9: next to break here gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=vfork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=9: next to for loop gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=vfork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=9: next to other line - Executed from: gdb:gdb.threads/next-fork-other-thread.exp - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=2: next to break here - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=2: next to for loop - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=3: next to break here - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=3: next to for loop - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=3: next to other line - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=4: next to break here - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=4: next to for loop - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=4: next to other line - gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=5: next to other line - New PASS [ => PASS]: @@ -491,6 +479,29 @@ o IMPROVEMENTS TO BE CHECKED: gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=auto: non-stop=off: displaced-stepping=auto: i=29: next to break here gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=auto: non-stop=off: displaced-stepping=auto: i=29: next to for loop gdb:gdb.threads/next-fork-exec-other-thread.exp=gdb.threads/next-fork-exec-other-thread.exp: fork_func=fork: target-non-stop=auto: non-stop=off: displaced-stepping=auto: i=29: next to other line + + + - XFAIL appears [ =>XFAIL]: + + Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp + gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 10: attach (EPERM) + gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: attach (EPERM) + gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: attach (EPERM) + gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 8: attach (EPERM) + + + - ERROR disappears [ERROR=> ]: + + Executed from: gdb:gdb.base/return.exp + gdb:gdb.base/return.exp=no fileid for a496f139edba + + + - Flaky cases, ignored [~RANDOM ]: + + Executed from: gdb:gdb.threads/detach-step-over.exp + gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=on: displaced=off: test_detach_command: iter 2: continue -a & + gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=on: displaced=off: test_detach_command: iter 3: attach + gdb:gdb.threads/detach-step-over.exp=gdb.threads/detach-step-over.exp: breakpoint-condition-evaluation=host: target-non-stop=on: non-stop=on: displaced=off: test_detach_command: iter 3: inferior 1 Executed from: gdb:gdb.threads/next-fork-other-thread.exp gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=2: next to break here gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=2: next to for loop @@ -507,25 +518,19 @@ o IMPROVEMENTS TO BE CHECKED: gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=6: next to for loop gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=6: next to other line gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=auto: i=7: next to other line + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=2: next to break here + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=2: next to for loop + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=3: next to break here + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=3: next to for loop + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=3: next to other line + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=4: next to break here + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=4: next to for loop + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=4: next to other line + gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=off: i=5: next to other line gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=2: next to break here gdb:gdb.threads/next-fork-other-thread.exp=gdb.threads/next-fork-other-thread.exp: fork_func=fork: target-non-stop=off: non-stop=off: displaced-stepping=on: i=3: next to other line - - XFAIL appears [ =>XFAIL]: - - Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp - gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 10: attach (EPERM) - gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: attach (EPERM) - gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: attach (EPERM) - gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 8: attach (EPERM) - - - - ERROR disappears [ERROR=> ]: - - Executed from: gdb:gdb.base/return.exp - gdb:gdb.base/return.exp=no fileid for a496f139edba - - # Regressions found # Regressions in 1 common sum files found