status

benchmark symbol status_0 status_1
400.perlbench perlbench_base.default
failed-to-build
failed-to-build
401.bzip2 bzip2_base.default
success
success
403.gcc gcc_base.default
failed-to-build
failed-to-build
410.bwaves bwaves_base.default
success
success
416.gamess gamess_base.default
failed-to-build
failed-to-build
429.mcf mcf_base.default
success
success
433.milc milc_base.default
success
success
434.zeusmp zeusmp_base.default
success
success
435.gromacs gromacs_base.default
success
success
436.cactusADM cactusADM_base.default
failed-to-build
failed-to-build
437.leslie3d leslie3d_base.default
success
success
444.namd namd_base.default
success
success
445.gobmk gobmk_base.default
success
success
447.dealII dealII_base.default
success
success
450.soplex soplex_base.default
success
success
453.povray povray_base.default
success
success
454.calculix calculix_base.default
failed-to-build
failed-to-build
456.hmmer hmmer_base.default
failed-to-build
failed-to-build
458.sjeng sjeng_base.default
success
success
459.GemsFDTD GemsFDTD_base.default
success
success
462.libquantum libquantum_base.default
success
success
464.h264ref h264ref_base.default
failed-to-build
failed-to-build
465.tonto tonto_base.default
success
success
470.lbm lbm_base.default
success
success
471.omnetpp omnetpp_base.default
success
success
473.astar astar_base.default
success
success
481.wrf wrf_base.default
failed-to-build
failed-to-build
482.sphinx3 sphinx_livepretend_base.default
success
success
483.xalancbmk Xalan_base.default
failed-to-build
failed-to-build



benchmarks

benchmark symbol sample_0
sample_1 sample_diff sample_rel variability
size_0
size_1 size_diff size_rel
400.perlbench perlbench_base.default
-1
-1  
-1
-1  
401.bzip2 bzip2_base.default
2757
2748 -9 -0.3% 0.1Σ (Σ=3.7%)
50565
50565 0 0.0%
403.gcc gcc_base.default
-1
-1  
-1
-1  
410.bwaves bwaves_base.default
4213
4260 47 1.1% 0.6Σ (Σ=2.0%)
24420
24420 0 0.0%
416.gamess gamess_base.default
-1
-1  
-1
-1  
429.mcf mcf_base.default
1867
1868 1 0.1% 0.0Σ (Σ=5.5%)
10095
10095 0 0.0%
433.milc milc_base.default
1067
1073 6 0.6% 0.3Σ (Σ=2.2%)
70649
70649 0 0.0%
434.zeusmp zeusmp_base.default
1913
1906 -7 -0.4% 0.3Σ (Σ=1.3%)
227863
227863 0 0.0%
435.gromacs gromacs_base.default
5896
5874 -22 -0.4% 0.2Σ (Σ=2.0%)
597273
597273 0 0.0%
436.cactusADM cactusADM_base.default
-1
-1  
-1
-1  
437.leslie3d leslie3d_base.default
8237
8402 165 2.0% 0.6Σ (Σ=3.5%)
71344
71344 0 0.0%
444.namd namd_base.default
697
691 -6 -0.9% 0.6Σ (Σ=1.5%)
225290
225290 0 0.0%
445.gobmk gobmk_base.default
4371
4370 -1 -0.0% 0.0Σ (Σ=1.1%)
1571771
1571771 0 0.0%
447.dealII dealII_base.default
1107
1093 -14 -1.3% 0.6Σ (Σ=2.1%)
399908
390982 -8926 -2.2%
450.soplex soplex_base.default
505
498 -7 -1.4% 0.3Σ (Σ=5.2%)
281879
281935 56 0.0%
453.povray povray_base.default
410
407 -3 -0.7% 0.4Σ (Σ=2.0%)
841259
837163 -4096 -0.5%
454.calculix calculix_base.default
-1
-1  
-1
-1  
456.hmmer hmmer_base.default
-1
-1  
-1
-1  
458.sjeng sjeng_base.default
6329
6335 6 0.1% 0.1Σ (Σ=0.9%)
119682
119682 0 0.0%
459.GemsFDTD GemsFDTD_base.default
4326
4334 8 0.2% 0.1Σ (Σ=2.1%)
313424
313424 0 0.0%
462.libquantum libquantum_base.default
74
71 -3 -4.1% 1.0Σ (Σ=4.0%)
19372
19340 -32 -0.2%
464.h264ref h264ref_base.default
-1
-1  
-1
-1  
465.tonto tonto_base.default
8730
8781 51 0.6% 0.3Σ (Σ=1.7%)
2306351
2306351 0 0.0%
470.lbm lbm_base.default
3630
3630 0 0.0% 0.0Σ (Σ=1.7%)
10552
10552 0 0.0%
471.omnetpp omnetpp_base.default
2127
2118 -9 -0.4% 0.2Σ (Σ=2.6%)
595533
595533 0 0.0%
473.astar astar_base.default
4487
4421 -66 -1.5% 0.5Σ (Σ=2.8%)
26325
26325 0 0.0%
481.wrf wrf_base.default
-1
-1  
-1
-1  
482.sphinx3 sphinx_livepretend_base.default
712
705 -7 -1.0% 0.2Σ (Σ=4.4%)
145183
145183 0 0.0%
483.xalancbmk Xalan_base.default
-1
-1  
-1
-1  



interesting symbols

benchmark symbol sample_0
sample_1 sample_diff sample_rel variability
size_0
size_1 size_diff size_rel
400.perlbench
401.bzip2 [.] BZ2_compressBlock
562
539 -23 -4.1% 0.8Σ (Σ=5.1%)
10088
10088 0 0.0%
[.] mainGtU.part.0
399
411 12 3.0% 0.7Σ (Σ=4.6%)
712
712 0 0.0%
[.] mainSort
882
869 -13 -1.5% 0.3Σ (Σ=5.8%)
3604
3604 0 0.0%
[.] uncompressStream.constprop.0.isra.0
551
548 -3 -0.5% 0.2Σ (Σ=3.2%)
12904
12904 0 0.0%
403.gcc
410.bwaves [.] MAIN__
733
724 -9 -1.2% 0.6Σ (Σ=2.2%)
17200
17200 0 0.0%
[.] mat_times_vec_.constprop.0
3391
3440 49 1.4% 0.7Σ (Σ=2.2%)
1100
1100 0 0.0%
416.gamess
429.mcf [.] main
1646
1673 27 1.6% 0.3Σ (Σ=6.2%)
5464
5464 0 0.0%
433.milc [.] add_force_to_mom
124
148 24 19.4% 1.7Σ (Σ=11.7%)
320
320 0 0.0%
[.] mult_su3_na
183
190 7 3.8% 0.8Σ (Σ=4.9%)
124
124 0 0.0%
[.] mult_su3_nn
169
174 5 3.0% 0.5Σ (Σ=6.2%)
124
124 0 0.0%
[.] u_shift_fermion
321
302 -19 -5.9% 0.9Σ (Σ=6.7%)
560
560 0 0.0%
434.zeusmp [.] hsmoc_.constprop.0
664
661 -3 -0.5% 0.3Σ (Σ=1.5%)
30996
30996 0 0.0%
[.] lorentz_.constprop.0.isra.0
412
421 9 2.2% 1.2Σ (Σ=1.8%)
18612
18612 0 0.0%
435.gromacs [.] inl1130_.isra.0
4035
3960 -75 -1.9% 0.7Σ (Σ=2.5%)
1728
1728 0 0.0%
[.] ns5_core.constprop.0.isra.0
593
617 24 4.0% 1.5Σ (Σ=2.6%)
5356
5356 0 0.0%
436.cactusADM
437.leslie3d [.] MAIN__.lto_priv.0
2282
2310 28 1.2% 0.3Σ (Σ=4.0%)
17444
17444 0 0.0%
[.] fluxj_
2335
2376 41 1.8% 0.5Σ (Σ=3.9%)
10044
10044 0 0.0%
[.] fluxk_
2223
2334 111 5.0% 0.9Σ (Σ=5.6%)
9392
9392 0 0.0%
[.] setbc_
913
882 -31 -3.4% 0.7Σ (Σ=5.2%)
4344
4344 0 0.0%
444.namd [.] _ZN20ComputeNonbondedUtil16calc_pair
77
76 -1 -1.3% 0.5Σ (Σ=2.5%)
4204
4204 0 0.0%
[.] _ZN20ComputeNonbondedUtil19calc_pair
85
84 -1 -1.2% 0.5Σ (Σ=2.1%)
4708
4708 0 0.0%
[.] _ZN20ComputeNonbondedUtil25calc_pair
69
69 0 0.0% 0.0Σ (Σ=2.2%)
4048
4048 0 0.0%
[.] _ZN20ComputeNonbondedUtil26calc_pair
94
94 0 0.0% 0.0Σ (Σ=1.7%)
5088
5088 0 0.0%
[.] _ZN20ComputeNonbondedUtil32calc_pair
78
77 -1 -1.3% 0.7Σ (Σ=1.9%)
4304
4304 0 0.0%
[.] _ZN20ComputeNonbondedUtil9calc_pairE
68
68 0 0.0% 0.0Σ (Σ=2.0%)
3700
3700 0 0.0%
445.gobmk [.] do_dfa_matchpat
303
311 8 2.6% 0.4Σ (Σ=6.1%)
1088
1088 0 0.0%
[.] do_play_move
516
509 -7 -1.4% 0.3Σ (Σ=5.2%)
7360
7360 0 0.0%
[.] order_moves.lto_priv.0
298
291 -7 -2.3% 0.4Σ (Σ=5.9%)
2600
2600 0 0.0%
447.dealII [.] _ZN4FE_QILi3EEC2Ej.lto_priv.0
107
102 -5 -4.7% 0.8Σ (Σ=6.1%)
8812
8888 76 0.9%
[.] _ZNK13LaplaceSolver6SolverILi3EE15as
122
136 14 11.5% 1.7Σ (Σ=6.7%)
1736
1740 4 0.2%
[.] _ZNK8MappingQILi3EE19transform_covar
169
175 6 3.6% 0.6Σ (Σ=6.1%)
228
228 0 0.0%
[.] _ZNK9MappingQ1ILi3EE12compute_fillER
231
200 -31 -13.4% 2.0Σ (Σ=6.6%)
808
808 0 0.0%
[.] _ZSt18_Rb_tree_incrementPSt18_Rb_tre
115
117 2 1.7% 0.3Σ (Σ=6.9%)
80
80 0 0.0%
450.soplex [.] _ZN6soplex10SPxSteepPR8entered4ENS_5
112
114 2 1.8% 0.2Σ (Σ=8.2%)
460
460 0 0.0%
[.] _ZN6soplex8SSVector20assign2product4
85
79 -6 -7.1% 0.5Σ (Σ=14.8%)
764
764 0 0.0%
[.] _ZN6soplex9SLUFactor4loadEPPKNS_7SVe
44
42 -2 -4.5% 0.3Σ (Σ=14.7%)
9300
9300 0 0.0%
453.povray [.] _ZN3pov16Intersect_SphereEPNS_10Ray_
40
41 1 2.5% 0.1Σ (Σ=17.1%)
184
184 0 0.0%
[.] _ZN3pov17Check_And_EnqueueEPNS_21Pri
25
40 15 60.0% 3.3Σ (Σ=18.3%)
1056
1056 0 0.0%
[.] _ZN3povL23All_Plane_IntersectionsEPN
67
76 9 13.4% 1.2Σ (Σ=10.9%)
484
484 0 0.0%
[.] _ZN3povL31All_CSG_Intersect_Intersec
54
63 9 16.7% 1.1Σ (Σ=14.9%)
592
592 0 0.0%
454.calculix
456.hmmer
458.sjeng [.] eval
1453
1364 -89 -6.1% 2.3Σ (Σ=2.6%)
7672
7672 0 0.0%
[.] gen
563
573 10 1.8% 0.5Σ (Σ=3.5%)
3900
3900 0 0.0%
[.] search
487
513 26 5.3% 1.2Σ (Σ=4.6%)
5240
5240 0 0.0%
[.] see
457
491 34 7.4% 1.8Σ (Σ=4.2%)
1236
1236 0 0.0%
459.GemsFDTD [.] __leapfrog_mod_MOD_leapfrog.constpro
737
749 12 1.6% 0.9Σ (Σ=1.8%)
31784
31784 0 0.0%
[.] __nft_mod_MOD_nft_store
482
476 -6 -1.2% 0.4Σ (Σ=2.9%)
8920
8920 0 0.0%
[.] __update_mod_MOD_updatee_homo.constp
1109
1107 -2 -0.2% 0.1Σ (Σ=2.5%)
2292
2292 0 0.0%
[.] __update_mod_MOD_updateh_homo.constp
1109
1121 12 1.1% 0.5Σ (Σ=2.4%)
1032
1032 0 0.0%
[.] __upml_mod_MOD_upmlupdateh.constprop
754
758 4 0.5% 0.3Σ (Σ=1.9%)
15544
15544 0 0.0%
462.libquantum [.] quantum_cnot
11
7 -4 -36.4% 1.1Σ (Σ=31.6%)
312
312 0 0.0%
[.] quantum_sigma_x
14
17 3 21.4% 0.7Σ (Σ=32.2%)
260
260 0 0.0%
[.] quantum_toffoli
37
40 3 8.1% 0.6Σ (Σ=14.0%)
432
432 0 0.0%
464.h264ref
465.tonto [.] __shell1quartet_module_MOD_make_esfs
1594
1520 -74 -4.6% 1.8Σ (Σ=2.6%)
6528
6528 0 0.0%
[.] __shell2_module_MOD_make_ft_1.constp
2002
1958 -44 -2.2% 0.7Σ (Σ=3.1%)
29300
29300 0 0.0%
[.] __sincos
1569
1538 -31 -2.0% 0.8Σ (Σ=2.4%)
1736
1736 0 0.0%
470.lbm [.] main
3616
3616 0 0.0% 0.0Σ (Σ=1.7%)
4772
4772 0 0.0%
471.omnetpp [.] _ZN12cMessageHeap6insertEP8cMessage.
184
179 -5 -2.7% 0.3Σ (Σ=9.8%)
472
472 0 0.0%
[.] _ZN12cMessageHeap7shiftupEi.isra.0
360
353 -7 -1.9% 0.3Σ (Σ=5.9%)
224
224 0 0.0%
473.astar [.] _ZN6wayobj10makebound2EPiiS0_.constp
1629
1633 4 0.2% 0.1Σ (Σ=2.2%)
584
584 0 0.0%
[.] _ZN7way2obj9createwayEiiiiPhRP6point
1354
1354 0 0.0% 0.0Σ (Σ=1.5%)
1996
1996 0 0.0%
[.] _ZN9regwayobj10makebound2ER9flexarra
1087
980 -107 -9.8% 1.9Σ (Σ=5.2%)
316
316 0 0.0%
481.wrf
482.sphinx3 [.] approx_mgau_eval
80
94 14 17.5% 1.2Σ (Σ=14.3%)
1152
1152 0 0.0%
[.] main
202
220 18 8.9% 1.0Σ (Σ=8.7%)
11720
11720 0 0.0%
[.] mgau_eval
383
343 -40 -10.4% 2.0Σ (Σ=5.3%)
960
960 0 0.0%
483.xalancbmk



libraries

benchmark symbol sample_0
sample_1 sample_diff sample_rel variability
size_0
size_1 size_diff size_rel
400.perlbench
401.bzip2 libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
403.gcc
410.bwaves libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
libm.so.6
-1
-1  
591327
599479 8152 1.4%
416.gamess
429.mcf libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
libm.so.6
-1
-1  
591327
599479 8152 1.4%
433.milc libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
libm.so.6
-1
-1  
591327
599479 8152 1.4%
434.zeusmp libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
libm.so.6
-1
-1  
591327
599479 8152 1.4%
435.gromacs libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
libm.so.6
-1
-1  
591327
599479 8152 1.4%
436.cactusADM
437.leslie3d libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
libm.so.6
-1
-1  
591327
599479 8152 1.4%
444.namd libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
libm.so.6
-1
-1  
591327
599479 8152 1.4%
libstdc++.so.6.0.34
-1
-1  
2428672
2430382 1710 0.1%
445.gobmk libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
libm.so.6
-1
-1  
591327
599479 8152 1.4%
447.dealII libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
libm.so.6
-1
-1  
591327
599479 8152 1.4%
libstdc++.so.6.0.34
141
144 3 2.1% 0.3Σ (Σ=6.2%)
2428672
2430382 1710 0.1%
450.soplex libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
libm.so.6
-1
-1  
591327
599479 8152 1.4%
libstdc++.so.6.0.34
-1
-1  
2428672
2430382 1710 0.1%
453.povray libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
libm.so.6
-1
-1  
591327
599479 8152 1.4%
libstdc++.so.6.0.34
-1
-1  
2428672
2430382 1710 0.1%
454.calculix
456.hmmer
458.sjeng libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
459.GemsFDTD libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
libgfortran.so.5.0.0
-1
-1  
1714294
1714294 0 0.0%
libm.so.6
-1
-1  
591327
599479 8152 1.4%
462.libquantum libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
libm.so.6
-1
-1  
591327
599479 8152 1.4%
464.h264ref
465.tonto libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
libgfortran.so.5.0.0
-1
-1  
1714294
1714294 0 0.0%
libm.so.6
2581
2546 -35 -1.4% 0.9Σ (Σ=1.5%)
591327
599479 8152 1.4%
470.lbm libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
libm.so.6
-1
-1  
591327
599479 8152 1.4%
471.omnetpp libc.so.6
461
478 17 3.7%
1676222
1676190 -32 -0.0%
libm.so.6
-1
-1  
591327
599479 8152 1.4%
libstdc++.so.6.0.34
-1
-1  
2428672
2430382 1710 0.1%
473.astar libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
libm.so.6
-1
-1  
591327
599479 8152 1.4%
libstdc++.so.6.0.34
-1
-1  
2428672
2430382 1710 0.1%
481.wrf
482.sphinx3 libc.so.6
-1
-1  
1676222
1676190 -32 -0.0%
libm.so.6
-1
-1  
591327
599479 8152 1.4%
483.xalancbmk