status

benchmark symbol status_0 status_1
400.perlbench perlbench_base.default
failed-to-build
failed-to-build
401.bzip2 bzip2_base.default
success
success
403.gcc gcc_base.default
failed-to-build
failed-to-build
410.bwaves bwaves_base.default
success
success
416.gamess gamess_base.default
failed-to-build
failed-to-build
429.mcf mcf_base.default
success
success
433.milc milc_base.default
success
success
434.zeusmp zeusmp_base.default
success
success
435.gromacs gromacs_base.default
success
success
436.cactusADM cactusADM_base.default
failed-to-build
failed-to-build
437.leslie3d leslie3d_base.default
success
success
444.namd namd_base.default
success
success
445.gobmk gobmk_base.default
success
success
447.dealII dealII_base.default
success
success
450.soplex soplex_base.default
success
success
453.povray povray_base.default
success
success
454.calculix calculix_base.default
failed-to-build
failed-to-build
456.hmmer hmmer_base.default
failed-to-build
failed-to-build
458.sjeng sjeng_base.default
success
success
459.GemsFDTD GemsFDTD_base.default
success
success
462.libquantum libquantum_base.default
success
success
464.h264ref h264ref_base.default
failed-to-build
failed-to-build
465.tonto tonto_base.default
success
success
470.lbm lbm_base.default
success
success
471.omnetpp omnetpp_base.default
success
success
473.astar astar_base.default
success
success
481.wrf wrf_base.default
failed-to-build
failed-to-build
482.sphinx3 sphinx_livepretend_base.default
success
success
483.xalancbmk Xalan_base.default
failed-to-build
failed-to-build


benchmarks

benchmark symbol sample_0
sample_1 sample_diff sample_rel variability
size_0
size_1 size_diff size_rel
400.perlbench perlbench_base.default
-1
-1  
-1
-1  
401.bzip2 bzip2_base.default
2917
3118 201 6.9% 2.2Σ (Σ=3.2%)
49242
49242 0 0.0%
403.gcc gcc_base.default
-1
-1  
-1
-1  
410.bwaves bwaves_base.default
6161
6248 87 1.4% 1.7Σ (Σ=0.8%)
18744
18744 0 0.0%
416.gamess gamess_base.default
-1
-1  
-1
-1  
429.mcf mcf_base.default
1845
2051 206 11.2% 2.1Σ (Σ=5.4%)
10922
10922 0 0.0%
433.milc milc_base.default
1118
1154 36 3.2% 1.9Σ (Σ=1.7%)
94356
94356 0 0.0%
434.zeusmp zeusmp_base.default
2332
2381 49 2.1% 1.8Σ (Σ=1.1%)
161141
161141 0 0.0%
435.gromacs gromacs_base.default
6865
7016 151 2.2% 1.2Σ (Σ=1.8%)
670300
670300 0 0.0%
436.cactusADM cactusADM_base.default
-1
-1  
-1
-1  
437.leslie3d leslie3d_base.default
10969
10738 -231 -2.1% 0.7Σ (Σ=3.2%)
59264
59264 0 0.0%
444.namd namd_base.default
713
732 19 2.7% 2.2Σ (Σ=1.2%)
183890
183894 4 0.0%
445.gobmk gobmk_base.default
5024
5108 84 1.7% 1.6Σ (Σ=1.0%)
1390273
1390273 0 0.0%
447.dealII dealII_base.default
1869
1918 49 2.6% 2.1Σ (Σ=1.2%)
2081382
2068791 -12591 -0.6%
450.soplex soplex_base.default
519
594 75 14.5% 3.0Σ (Σ=4.9%)
257197
257197 0 0.0%
453.povray povray_base.default
487
504 17 3.5% 2.0Σ (Σ=1.8%)
694870
694870 0 0.0%
454.calculix calculix_base.default
-1
-1  
-1
-1  
456.hmmer hmmer_base.default
-1
-1  
-1
-1  
458.sjeng sjeng_base.default
7487
7585 98 1.3% 1.7Σ (Σ=0.8%)
115692
115692 0 0.0%
459.GemsFDTD GemsFDTD_base.default
4717
4848 131 2.8% 1.3Σ (Σ=2.1%)
247025
247025 0 0.0%
462.libquantum libquantum_base.default
131
136 5 3.8% 1.5Σ (Σ=2.5%)
31131
31131 0 0.0%
464.h264ref h264ref_base.default
-1
-1  
-1
-1  
465.tonto tonto_base.default
10593
10916 323 3.0% 2.0Σ (Σ=1.6%)
2848603
2848603 0 0.0%
470.lbm lbm_base.default
3724
3772 48 1.3% 1.2Σ (Σ=1.1%)
10711
10711 0 0.0%
471.omnetpp omnetpp_base.default
2891
2964 73 2.5% 1.2Σ (Σ=2.2%)
562039
562039 0 0.0%
473.astar astar_base.default
5524
5824 300 5.4% 2.1Σ (Σ=2.6%)
31764
31764 0 0.0%
481.wrf wrf_base.default
-1
-1  
-1
-1  
482.sphinx3 sphinx_livepretend_base.default
908
970 62 6.8% 2.0Σ (Σ=3.4%)
151819
151819 0 0.0%
483.xalancbmk Xalan_base.default
-1
-1  
-1
-1  


interesting symbols

benchmark symbol sample_0
sample_1 sample_diff sample_rel variability
size_0
size_1 size_diff size_rel
400.perlbench
401.bzip2 [.] BZ2_compressBlock
657
704 47 7.2% 1.8Σ (Σ=4.0%)
8540
8540 0 0.0%
[.] BZ2_decompress
318
338 20 6.3% 1.8Σ (Σ=3.5%)
8872
8872 0 0.0%
[.] mainGtU
414
445 31 7.5% 1.5Σ (Σ=4.8%)
672
672 0 0.0%
[.] mainSort
896
975 79 8.8% 1.7Σ (Σ=5.3%)
3044
3044 0 0.0%
403.gcc
410.bwaves [.] mat_times_vec_
5224
5278 54 1.0% 1.2Σ (Σ=0.9%)
948
948 0 0.0%
416.gamess
429.mcf [.] price_out_impl
627
786 159 25.4% 2.4Σ (Σ=10.7%)
568
568 0 0.0%
[.] primal_bea_mpp
761
799 38 5.0% 1.2Σ (Σ=4.1%)
432
432 0 0.0%
433.milc [.] mult_adj_su3_mat_vec
135
144 9 6.7% 0.9Σ (Σ=7.6%)
96
96 0 0.0%
[.] mult_su3_mat_vec
163
147 -16 -9.8% 1.3Σ (Σ=7.5%)
96
96 0 0.0%
[.] mult_su3_na
195
197 2 1.0% 0.2Σ (Σ=6.8%)
124
124 0 0.0%
[.] mult_su3_nn
153
171 18 11.8% 1.6Σ (Σ=7.5%)
124
124 0 0.0%
[.] scalar_mult_add_su3_matrix
116
108 -8 -6.9% 0.7Σ (Σ=10.0%)
92
92 0 0.0%
434.zeusmp [.] hsmoc_
815
834 19 2.3% 1.7Σ (Σ=1.4%)
11888
11888 0 0.0%
[.] lorentz_
586
589 3 0.5% 0.5Σ (Σ=1.0%)
7032
7032 0 0.0%
435.gromacs [.] inl1130_
4724
4896 172 3.6% 1.6Σ (Σ=2.3%)
1868
1868 0 0.0%
[.] search_neighbours
813
822 9 1.1% 0.3Σ (Σ=3.2%)
6808
6808 0 0.0%
436.cactusADM
437.leslie3d [.] extrapi_
1691
1626 -65 -3.8% 0.9Σ (Σ=4.4%)
1456
1456 0 0.0%
[.] extrapj_
1657
1595 -62 -3.7% 0.9Σ (Σ=4.3%)
1528
1528 0 0.0%
[.] extrapk_
1139
1068 -71 -6.2% 1.3Σ (Σ=4.9%)
1476
1476 0 0.0%
[.] fluxi_
1512
1522 10 0.7% 0.1Σ (Σ=4.8%)
4688
4688 0 0.0%
[.] fluxj_
1548
1511 -37 -2.4% 0.5Σ (Σ=4.5%)
4476
4476 0 0.0%
[.] fluxk_
2028
1987 -41 -2.0% 0.3Σ (Σ=5.8%)
4824
4824 0 0.0%
444.namd [.] _ZN20ComputeNonbondedUtil16calc_pair
75
77 2 2.7% 0.8Σ (Σ=3.3%)
3328
3328 0 0.0%
[.] _ZN20ComputeNonbondedUtil19calc_pair
91
92 1 1.1% 0.7Σ (Σ=1.5%)
4044
4044 0 0.0%
[.] _ZN20ComputeNonbondedUtil25calc_pair
67
69 2 3.0% 1.8Σ (Σ=1.7%)
3420
3420 0 0.0%
[.] _ZN20ComputeNonbondedUtil26calc_pair
100
102 2 2.0% 1.1Σ (Σ=1.9%)
4400
4400 0 0.0%
[.] _ZN20ComputeNonbondedUtil32calc_pair
77
80 3 3.9% 2.4Σ (Σ=1.6%)
3700
3700 0 0.0%
[.] _ZN20ComputeNonbondedUtil9calc_pairE
68
71 3 4.4% 2.6Σ (Σ=1.7%)
3080
3080 0 0.0%
445.gobmk [.] do_dfa_matchpat
339
342 3 0.9% 0.2Σ (Σ=5.4%)
1060
1060 0 0.0%
[.] do_play_move
457
489 32 7.0% 1.4Σ (Σ=5.0%)
5788
5788 0 0.0%
447.dealII [.] _ZNK8MappingQILi3EE19transform_covar
208
205 -3 -1.4% 0.2Σ (Σ=6.4%)
244
244 0 0.0%
[.] _ZNK9MappingQ1ILi3EE12compute_fillER
420
437 17 4.0% 1.0Σ (Σ=4.1%)
824
876 52 6.3%
[.] _ZSt18_Rb_tree_incrementPSt18_Rb_tre
145
145 0 0.0% 0.0Σ (Σ=7.8%)
80
80 0 0.0%
450.soplex [.] _ZN6soplex10SPxSteepPR9entered4XENS_
110
120 10 9.1% 0.9Σ (Σ=10.3%)
420
420 0 0.0%
[.] _ZN6soplex8SSVector18assign2productF
73
87 14 19.2% 1.2Σ (Σ=16.4%)
176
176 0 0.0%
453.povray [.] _ZN3pov16Intersect_SphereEPNS_10Ray_
63
44 -19 -30.2% 2.1Σ (Σ=14.3%)
220
220 0 0.0%
[.] _ZN3povL23All_Plane_IntersectionsEPN
58
63 5 8.6% 0.7Σ (Σ=12.2%)
408
408 0 0.0%
[.] _ZN3povL31All_CSG_Intersect_Intersec
44
48 4 9.1% 0.7Σ (Σ=13.0%)
308
308 0 0.0%
454.calculix
456.hmmer
458.sjeng [.] gen
622
632 10 1.6% 0.4Σ (Σ=4.6%)
2524
2524 0 0.0%
[.] std_eval
1702
1668 -34 -2.0% 0.8Σ (Σ=2.4%)
4040
4040 0 0.0%
459.GemsFDTD [.] __nft_mod_MOD_nft_store
529
545 16 3.0% 1.3Σ (Σ=2.3%)
9336
9336 0 0.0%
[.] __update_mod_MOD_updatee_homo
1105
1154 49 4.4% 1.8Σ (Σ=2.5%)
1008
1008 0 0.0%
[.] __update_mod_MOD_updateh_homo
954
1008 54 5.7% 1.8Σ (Σ=3.1%)
520
520 0 0.0%
[.] __upml_mod_MOD_upmlupdatee
977
992 15 1.5% 1.1Σ (Σ=1.4%)
12264
12264 0 0.0%
[.] __upml_mod_MOD_upmlupdateh
1021
1029 8 0.8% 0.5Σ (Σ=1.5%)
6972
6972 0 0.0%
462.libquantum [.] quantum_cnot
18
22 4 22.2% 1.0Σ (Σ=23.1%)
176
176 0 0.0%
[.] quantum_sigma_x
30
20 -10 -33.3% 2.1Σ (Σ=16.1%)
144
144 0 0.0%
[.] quantum_toffoli
71
84 13 18.3% 2.2Σ (Σ=8.4%)
196
196 0 0.0%
464.h264ref
465.tonto [.] __shell1quartet_module_MOD_make_esfs
2010
2029 19 0.9% 0.7Σ (Σ=1.4%)
5520
5520 0 0.0%
[.] __shell2_module_MOD_make_ft_1
2195
2311 116 5.3% 1.6Σ (Σ=3.4%)
21604
21604 0 0.0%
[.] __sincos
1512
1545 33 2.2% 0.6Σ (Σ=3.4%)
1736
1736 0 0.0%
470.lbm [.] LBM_performStreamCollide
3673
3708 35 1.0% 0.9Σ (Σ=1.1%)
1176
1176 0 0.0%
471.omnetpp [.] _ZN12cMessageHeap7shiftupEi
243
271 28 11.5% 1.9Σ (Σ=6.0%)
172
172 0 0.0%
[.] _ZleR8cMessageS0_
316
354 38 12.0% 1.8Σ (Σ=6.7%)
76
76 0 0.0%
473.astar [.] _ZN6wayobj10makebound2EPiiS0_
1846
1961 115 6.2% 2.1Σ (Σ=2.9%)
616
616 0 0.0%
[.] _ZN7way2obj12releasepointEii
1077
1086 9 0.8% 0.3Σ (Σ=2.4%)
420
420 0 0.0%
[.] _ZN9regwayobj10makebound2ER9flexarra
708
769 61 8.6% 1.6Σ (Σ=5.5%)
164
164 0 0.0%
481.wrf
482.sphinx3 [.] mgau_eval
454
454 0 0.0% 0.0Σ (Σ=4.7%)
604
604 0 0.0%
[.] subvq_mgau_shortlist
81
96 15 18.5% 1.1Σ (Σ=16.9%)
408
408 0 0.0%
[.] vector_gautbl_eval_logs3
242
252 10 4.1% 0.6Σ (Σ=6.5%)
384
384 0 0.0%
483.xalancbmk


libraries

benchmark symbol sample_0
sample_1 sample_diff sample_rel variability
size_0
size_1 size_diff size_rel
400.perlbench
401.bzip2 libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
403.gcc
410.bwaves libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
libgfortran.so.5.0.0
-1
-1  
1714294
1714294 0 0.0%
libm.so.6
-1
-1  
591327
591327 0 0.0%
416.gamess
429.mcf libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
libm.so.6
-1
-1  
591327
591327 0 0.0%
433.milc libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
libm.so.6
-1
-1  
591327
591327 0 0.0%
434.zeusmp libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
libgfortran.so.5.0.0
-1
-1  
1714294
1714294 0 0.0%
libm.so.6
-1
-1  
591327
591327 0 0.0%
435.gromacs libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
libgfortran.so.5.0.0
-1
-1  
1714294
1714294 0 0.0%
libm.so.6
-1
-1  
591327
591327 0 0.0%
436.cactusADM
437.leslie3d libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
libgfortran.so.5.0.0
-1
-1  
1714294
1714294 0 0.0%
libm.so.6
-1
-1  
591327
591327 0 0.0%
444.namd libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
libm.so.6
-1
-1  
591327
591327 0 0.0%
libstdc++.so.6.0.34
-1
-1  
2428672
2430294 1622 0.1%
445.gobmk libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
libm.so.6
-1
-1  
591327
591327 0 0.0%
447.dealII libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
libm.so.6
-1
-1  
591327
591327 0 0.0%
libstdc++.so.6.0.34
169
177 8 4.7% 0.6Σ (Σ=8.1%)
2428672
2430294 1622 0.1%
450.soplex libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
libm.so.6
-1
-1  
591327
591327 0 0.0%
libstdc++.so.6.0.34
-1
-1  
2428672
2430294 1622 0.1%
453.povray libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
libm.so.6
-1
-1  
591327
591327 0 0.0%
libstdc++.so.6.0.34
-1
-1  
2428672
2430294 1622 0.1%
454.calculix
456.hmmer
458.sjeng libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
459.GemsFDTD libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
libgfortran.so.5.0.0
-1
-1  
1714294
1714294 0 0.0%
libm.so.6
-1
-1  
591327
591327 0 0.0%
462.libquantum libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
libm.so.6
-1
-1  
591327
591327 0 0.0%
464.h264ref
465.tonto libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
libgfortran.so.5.0.0
-1
-1  
1714294
1714294 0 0.0%
libm.so.6
2538
2526 -12 -0.5% 0.3Σ (Σ=1.8%)
591327
591327 0 0.0%
470.lbm libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
libm.so.6
-1
-1  
591327
591327 0 0.0%
471.omnetpp libc.so.6
545
577 32 5.9% 0.5Σ (Σ=12.3%)
1676286
1676254 -32 -0.0%
libm.so.6
-1
-1  
591327
591327 0 0.0%
libstdc++.so.6.0.34
-1
-1  
2428672
2430294 1622 0.1%
473.astar libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
libm.so.6
-1
-1  
591327
591327 0 0.0%
libstdc++.so.6.0.34
-1
-1  
2428672
2430294 1622 0.1%
481.wrf
482.sphinx3 libc.so.6
-1
-1  
1676286
1676254 -32 -0.0%
libm.so.6
-1
-1  
591327
591327 0 0.0%
483.xalancbmk