Residue-Override Project Report

Re-evaluation Limit: 20

Second-order error in MUL: 1

Condition number threshold: 2^46

Timing: LOG

Win summary: Win = 17, Mix = 2, Loss = 0, Normal = 60.
Download LaTeX macro file

microbench

Benchmarks	Raw Data	EFTSan-Fixed	PRO Start	PRO End	#RE	#RO	MPFR_DD	QD	MPFR Precision	Timing
cc	.	✓	✓	✓	1	.	✓	✓	512	.
compare-zero-self	.	✓	✓	✓	1	.	✓	✓	512	.
ContinuedFraction1	.	24 FP	✓	✓	1	.	24 FP	16 FP	512	.
cordic_cos	.	✓	✓	✓	1	.	✓	✓	512	.
cordic_sin	.	✓	✓	✓	1	.	✓	✓	512	.
diff-roots	.	41 FN	41 FN	✓	3	.	✓	38 FN	1024	.
diff-roots-simple	.	✓	✓	✓	1	.	✓	✓	512	.
diff-simple	.	✓	✓	✓	1	.	✓	✓	512	.
dotproduct1	.	✓	✓	✓	1	.	✓	✓	512	.
dotproduct2	.	✓	✓	✓	1	.	✓	✓	512	.
exact-ranges	.	✓	✓	✓	1	.	✓	✓	512	.
gromacs-bondfree-580	.	✓	✓	✓	1	.	✓	✓	512	.
gsl-modpi	.	✓	✓	✓	1	.	✓	✓	512	.
indirect	.	✓	✓	✓	1	.	✓	✓	512	.
indirect1	.	✓	✓	✓	1	.	✓	✓	512	.
MindlessG	.	19995 FP	7885 FP	7885 FP	1	.	19995 FP	19995 FP	512	.
mini	.	✓	✓	✓	1	.	✓	✓	512	.
muller	.	1 FP	✓	✓	1	.	1 FP	✓	512	.
multi-args	.	✓	✓	✓	1	.	✓	✓	512	.
naturalnumber	.	✓	✓	✓	1	.	✓	✓	512	.
newton	.	✓	✓	✓	1	.	✓	✓	512	.
newtonraphson	.	✓	✓	✓	1	.	✓	✓	512	.
newtonraphsonsqrt	.	✓	✓	✓	1	.	✓	✓	512	.
onthefly	.	✓	✓	✓	1	.	✓	✓	512	.
ParallelResistance	.	4 FP	✓	✓	1	.	4 FP	1 FP	512	.
redir	.	✓	✓	✓	1	.	✓	✓	512	.
rootfinding1	.	✓	✓	✓	1	.	✓	✓	512	.
rootfinding2	.	✓	✓	✓	1	.	✓	✓	512	.
same-small	.	✓	✓	✓	1	.	✓	✓	512	.
second_order	.	✓	✓	✓	1	.	✓	✓	512	.
simple-negate	.	✓	✓	✓	1	.	✓	✓	512	.
simpl-swallow-testa	.	✓	✓	✓	1	.	✓	✓	512	.
simpl-swallow-testb	.	✓	✓	✓	1	.	✓	✓	512	.
simpl-swallow-testc	.	✓	✓	✓	1	.	✓	✓	512	.
simpl-swallow-testd	.	✓	✓	✓	1	.	✓	✓	512	.
SimpsonsRule	.	✓	✓	✓	1	.	✓	✓	512	.
SinTaylorExpansion	.	✓	✓	✓	1	.	✓	✓	512	.
small	.	✓	✓	✓	1	.	✓	✓	512	.
some-trig	.	3 FP,19 FN	3 FP,20 FN	3 FP	5	.	✓	✓	512	.
sqrtf	.	✓	✓	✓	1	.	✓	✓	512	.
sum-50	.	✓	✓	✓	1	.	✓	✓	512	.
sum-500	.	✓	✓	✓	1	.	✓	✓	512	.
tiny	.	✓	✓	✓	1	.	✓	✓	512	.
var-test	.	✓	✓	✓	1	.	✓	✓	512	.
var-test-2	.	✓	✓	✓	1	.	✓	✓	512	.

Benchmarks	Uninstrumented	EFTSan-Fixed	Max PRO	QD	MPFR
cc	0m0.023s	0m0.023s	0m0.024s	0m0.023s	0m0.024s
compare-zero-self	0m0.023s	0m0.023s	0m0.024s	0m0.024s	0m0.023s
ContinuedFraction1	0m0.023s	0m0.023s	0m0.024s	0m0.023s	0m0.024s
cordic_cos	0m0.024s	0m0.024s	0m0.024s	0m0.024s	0m0.024s
cordic_sin	0m0.024s	0m0.024s	0m0.024s	0m0.024s	0m0.024s
diff-roots	0m0.023s	0m0.023s	0m0.024s	0m0.024s	0m0.024s
diff-roots-simple	0m0.024s	0m0.023s	0m0.024s	0m0.023s	0m0.024s
diff-simple	0m0.023s	0m0.023s	0m0.024s	0m0.023s	0m0.024s
dotproduct1	0m0.024s	0m0.024s	0m0.024s	0m0.024s	0m0.023s
dotproduct2	0m0.024s	0m0.024s	0m0.024s	0m0.024s	0m0.024s
exact-ranges	0m0.024s	0m0.024s	0m0.024s	0m0.023s	0m0.024s
gromacs-bondfree-580	0m0.023s	0m0.023s	0m0.024s	0m0.023s	0m0.024s
gsl-modpi	0m0.023s	0m0.023s	0m0.024s	0m0.023s	0m0.023s
indirect	0m0.023s	0m0.023s	0m0.024s	0m0.023s	0m0.023s
indirect1	0m0.023s	0m0.024s	0m0.024s	0m0.023s	0m0.024s
MindlessG	0m0.026s	0m0.083s	0m0.102s	0m0.110s	0m0.190s
mini	0m0.024s	0m0.024s	0m0.024s	0m0.023s	0m0.024s
muller	0m0.023s	0m0.023s	0m0.024s	0m0.024s	0m0.024s
multi-args	0m0.023s	0m0.024s	0m0.025s	0m0.024s	0m0.024s
naturalnumber	0m0.023s	0m0.023s	0m0.024s	0m0.023s	0m0.023s
newton	0m0.024s	0m0.024s	0m0.024s	0m0.024s	0m0.024s
newtonraphson	0m0.024s	0m0.024s	0m0.024s	0m0.024s	0m0.024s
newtonraphsonsqrt	0m0.023s	0m0.024s	0m0.024s	0m0.023s	0m0.024s
onthefly	0m0.024s	0m0.023s	0m0.024s	0m0.023s	0m0.024s
ParallelResistance	0m0.024s	0m0.024s	0m0.024s	0m0.024s	0m0.023s
redir	0m0.024s	0m0.024s	0m0.024s	0m0.023s	0m0.023s
rootfinding1	0m0.023s	0m0.023s	0m0.024s	0m0.023s	0m0.024s
rootfinding2	0m0.023s	0m0.024s	0m0.024s	0m0.023s	0m0.025s
same-small	0m0.023s	0m0.023s	0m0.024s	0m0.023s	0m0.024s
second_order	0m0.023s	0m0.023s	0m0.024s	0m0.024s	0m0.023s
simple-negate	0m0.023s	0m0.024s	0m0.024s	0m0.023s	0m0.024s
simpl-swallow-testa	0m0.023s	0m0.024s	0m0.023s	0m0.024s	0m0.024s
simpl-swallow-testb	0m0.023s	0m0.023s	0m0.024s	0m0.024s	0m0.024s
simpl-swallow-testc	0m0.023s	0m0.023s	0m0.024s	0m0.024s	0m0.023s
simpl-swallow-testd	0m0.024s	0m0.023s	0m0.024s	0m0.024s	0m0.023s
SimpsonsRule	0m0.905s	0m23.124s	0m37.049s	0m23.216s	1m25.678s
SinTaylorExpansion	0m0.023s	0m0.023s	0m0.024s	0m0.023s	0m0.024s
small	0m0.023s	0m0.023s	0m0.024s	0m0.023s	0m0.023s
some-trig	0m0.024s	0m0.024s	0m0.024s	0m0.024s	0m0.024s
sqrtf	0m0.023s	0m0.023s	0m0.024s	0m0.024s	0m0.023s
sum-50	0m0.023s	0m0.023s	0m0.024s	0m0.023s	0m0.024s
sum-500	0m0.023s	0m0.024s	0m0.024s	0m0.024s	0m0.024s
tiny	0m0.023s	0m0.023s	0m0.024s	0m0.023s	0m0.023s
var-test	0m0.023s	0m0.023s	0m0.024s	0m0.024s	0m0.024s
var-test-2	0m0.023s	0m0.024s	0m0.024s	0m0.023s	0m0.023s

npb

Benchmarks	Raw Data	EFTSan-Fixed	PRO Start	PRO End	#RE	#RO	MPFR_DD	QD	MPFR Precision	Timing
bt	.	N/A	N/A	N/A	N/A	N/A	N/A	N/A	N/A	.
cg	.	8334 FP,3078 FN	7222 FP,6525 FN	7222 FP,6525 FN	1	.	8334 FP,3078 FN	✓	512	.
ft	.	20 FP,40 FN	20 FP,40 FN	20 FP	5	.	✓	✓	512	.
lu	.	N/A	N/A	N/A	N/A	N/A	N/A	N/A	N/A	.
mg	.	6806 FP	58 FP	58 FP	1	.	✓	6078 FP	512	.
sp	.	8651 FP	✓	✓	1	.	8641 FP	✓	512	.

Benchmarks	Uninstrumented	EFTSan-Fixed	Max PRO	QD	MPFR
bt			N/A		8m51.182s
cg	0m1.398s	0m24.219s	0m33.746s	0m24.296s	1m3.857s
ft	0m0.124s	0m2.236s	0m3.556s	0m2.109s	0m6.507s
lu			N/A		9m22.931s
mg	0m0.351s	0m3.277s	0m4.699s	0m3.124s	0m10.125s
sp	0m2.773s	0m26.118s	0m39.356s	0m24.550s	1m28.067s

polybench

Benchmarks	Raw Data	EFTSan-Fixed	PRO Start	PRO End	#RE	#RO	MPFR_DD	QD	MPFR Precision	Timing
2mm	.	✓	✓	✓	1	.	✓	✓	512	.
3mm	.	✓	✓	✓	1	.	✓	✓	512	.
adi	.	N/A	N/A	N/A	N/A	N/A	N/A	N/A	N/A	.
atax	.	✓	✓	✓	1	.	✓	✓	512	.
bicg	.	✓	✓	✓	1	.	✓	✓	512	.
cholesky	.	N/A	N/A	N/A	N/A	N/A	N/A	N/A	N/A	.
correlation	.	✓	✓	✓	1	.	✓	✓	512	.
covariance	.	✓	✓	✓	1	.	✓	✓	512	.
deriche	.	7284 FP,20373 FN	1 FP	1 FP	1	.	7284 FP,20373 FN	✓	512	.
doitgen	.	✓	✓	✓	1	.	✓	✓	512	.
durbin	.	✓	✓	✓	1	.	✓	✓	512	.
fdtd-2d	.	N/A	N/A	N/A	N/A	N/A	N/A	N/A	N/A	.
gemm	.	✓	✓	✓	1	.	✓	✓	512	.
gemver	.	✓	✓	✓	1	.	✓	✓	512	.
gesummv	.	✓	✓	✓	1	.	✓	✓	512	.
gramschmidt	.	N/A	N/A	N/A	N/A	N/A	N/A	N/A	N/A	.
heat-3d	.	N/A	N/A	N/A	N/A	N/A	N/A	N/A	N/A	.
jacobi-1d	.	✓	✓	✓	1	.	✓	✓	512	.
jacobi-2d	.	✓	✓	✓	1	.	✓	✓	512	.
lu	.	N/A	N/A	N/A	N/A	N/A	N/A	N/A	N/A	.
ludcmp	.	N/A	N/A	N/A	N/A	N/A	N/A	N/A	N/A	.
mvt	.	✓	✓	✓	1	.	✓	✓	512	.
seidel-2d	.	N/A	N/A	N/A	N/A	N/A	N/A	N/A	N/A	.
symm	.	✓	✓	✓	1	.	✓	✓	512	.
syr2k	.	✓	✓	✓	1	.	✓	✓	512	.
syrk	.	✓	✓	✓	1	.	✓	✓	512	.
trisolv	.	✓	✓	✓	1	.	✓	✓	512	.
trmm	.	✓	✓	✓	1	.	✓	✓	512	.

Benchmarks	Uninstrumented	EFTSan-Fixed	Max PRO	QD	MPFR
2mm	0m0.793s	0m9.013s	0m14.582s	0m9.172s	0m29.511s
3mm	0m1.310s	0m11.548s	0m18.242s	0m12.005s	0m37.371s
adi			N/A		24m31.218s
atax	0m0.103s	0m0.281s	0m0.387s	0m0.326s	0m0.745s
bicg	0m0.105s	0m0.285s	0m0.393s	0m0.324s	0m0.759s
cholesky			N/A		15m38.025s
correlation	0m0.474s	0m3.955s	0m6.143s	0m4.086s	0m12.783s
covariance	0m0.506s	0m4.313s	0m6.248s	0m4.125s	0m12.637s
deriche	0m0.229s	0m3.905s	0m5.611s	0m3.982s	0m10.102s
doitgen	0m0.397s	0m3.815s	0m5.846s	0m3.792s	0m11.305s
durbin	0m0.092s	0m0.174s	0m0.223s	0m0.177s	0m0.343s
fdtd-2d			N/A		7m50.270s
gemm	0m0.547s	0m7.613s	0m12.373s	0m7.523s	0m24.057s
gemver	0m0.118s	0m0.520s	0m0.753s	0m0.570s	0m1.510s
gesummv	0m0.094s	0m0.182s	0m0.228s	0m0.209s	0m0.406s
gramschmidt			N/A		0m59.574s
heat-3d			N/A		4m43.718s
jacobi-1d	0m0.090s	0m0.139s	0m0.170s	0m0.139s	0m0.276s
jacobi-2d	0m1.187s	0m13.325s	0m19.429s	0m12.818s	0m44.950s
lu			N/A		25m25.202s
ludcmp			N/A		17m18.973s
mvt	0m0.103s	0m0.284s	0m0.395s	0m0.332s	0m0.763s
seidel-2d			N/A		2m0.013s
symm	0m0.459s	0m6.066s	0m9.664s	0m6.188s	0m19.657s
syr2k	0m0.556s	0m7.747s	0m13.160s	0m8.019s	0m27.243s
syrk	0m0.347s	0m4.233s	0m6.961s	0m4.382s	0m13.702s
trisolv	0m0.090s	0m0.162s	0m0.213s	0m0.178s	0m0.376s
trmm	0m0.349s	0m2.514s	0m3.885s	0m2.510s	0m7.800s

rodinia

Benchmarks	Raw Data	EFTSan-Fixed	PRO Start	PRO End	#RE	#RO	MPFR_DD	QD	MPFR Precision	Timing
backprop	.	✓	✓	✓	1	.	✓	✓	1024	.
hotspot	.	141 FP	3 FP,92 FN	3 FP,92 FN	1	.	133 FP	62 FP	2048	.
hotspot3d	.	32523 FN	✓	✓	1	.	32523 FN	✓	512	.
kmeans	.	140 FN	✓	✓	1	.	140 FN	✓	512	.
lavamd	.	54 FP	✓	✓	1	.	74 FP	86 FP	2048	.
lud	.	63810 FP,6691 FN	6589 FP,278 FN	6589 FP,278 FN	1	.	63810 FP,6691 FN	✓	512	.
myocyte	.	21458 FP,7649 FN	21458 FP,7214 FN	21458 FP,7213 FN	11	.	21458 FP,7649 FN	4896 FP,14 FN	512	.
nn	.	✓	✓	✓	1	.	✓	✓	512	.
particlefilter	.	114960 FN	✓	✓	20	.	114960 FN	3592 FP	2048	.
sradv2	.	5442 FP,5313 FN	1 FP,1 FN	1 FP,1 FN	3	.	5442 FP,5313 FN	✓	512	.

Benchmarks	Uninstrumented	EFTSan-Fixed	Max PRO	QD	MPFR
backprop	0m0.031s	0m0.105s	0m0.142s	0m0.114s	0m0.266s
hotspot	0m4.010s	0m7.001s	0m9.839s	0m7.887s	0m18.811s
hotspot3d	0m0.779s	0m3.333s	0m5.307s	0m3.619s	0m11.080s
kmeans	0m1.229s	0m17.922s	0m25.468s	0m17.393s	0m50.874s
lavamd	0m0.028s	0m0.134s	0m0.198s	0m0.130s	0m0.484s
lud	0m0.041s	0m0.243s	0m0.325s	0m0.234s	0m0.590s
myocyte	0m0.221s	0m7.763s	0m12.944s	0m7.797s	0m23.204s
nn	0m0.181s	0m0.378s	0m0.590s	0m0.488s	0m1.041s
particlefilter	0m0.168s	0m3.549s	0m5.982s	0m3.617s	0m16.788s
sradv2	0m0.043s	0m0.520s	0m0.742s	0m0.557s	0m1.466s