Herbie results

Average Percentage Accurate: 80.3% → 95.9%

Time: 7.4min

Bad Runs: 6/58

Speedup: 2.5×

Output vs Input Accuracy

Each point represents a Herbie run below. Its horizontal position shows initial accuracy, and vertical position shows final accuracy. Points above the line are improved by Herbie.

Accuracy vs Speed

A joint speed-accuracy pareto curve. Accuracy is on the vertical axis, speed is on the horizontal axis. Up and to the right is better. The initial program is shown by the red square.

Test	Start	Result ?	Target ?	Time
powComplex, real part	40.5%	81.0%		10.8s	»
powComplex, imaginary part	39.5%	79.4%		29.8s	»
normal distribution	99.4%	99.7%		8.6s	»
math.square on complex, real part	93.9%	96.5%		1.9s	»
math.square on complex, imaginary part	100.0%	100.0%		0.9s	»
math.sqrt on complex, imaginary part, im greater than 0 branch	40.6%	89.8%		6.4s	»
math.sin on complex, real part	100.0%	100.0%		8.5s	»
math.log10 on complex, real part	52.0%	99.0%		7.7s	»
math.log10 on complex, imaginary part	98.7%	99.8%		3.8s	»
math.log/2 on complex, real part	51.2%	99.4%		8.5s	»
math.log/2 on complex, imaginary part	49.8%	99.5%		7.1s	»
math.log/1 on complex, real part	52.4%	100.0%		1.1s	»
math.log/1 on complex, imaginary part	100.0%	100.0%		0.8s	»
math.exp on complex, real part	100.0%	100.0%		8.9s	»
math.exp on complex, imaginary part	100.0%	100.0%		8.8s	»
math.cos on complex, real part	100.0%	100.0%		6.0s	»
math.arg on complex	100.0%	100.0%		0.7s	»
math.abs on complex (squared)	100.0%	100.0%		0.7s	»
math.abs on complex	54.2%	100.0%		0.9s	»
_multiplyComplex, real part	99.2%	99.6%		1.9s	»
_multiplyComplex, imaginary part	99.3%	99.6%		1.3s	»
_divideComplex, real part	62.1%	77.5%		8.2s	»
_divideComplex, imaginary part	61.4%	85.2%		9.9s	»
Rust f64::atanh				0.7s	»
Rust f32::atanh				1.0s	»
Octave 3.8, oct_fill_randg	99.8%	99.8%		8.9s	»
Octave 3.8, jcobi/4, as called	27.6%	99.2%		3.1s	»
Octave 3.8, jcobi/4	16.1%	84.5%		16.7s	»
Octave 3.8, jcobi/3	94.1%	99.8%		17.5s	»
Octave 3.8, jcobi/2	63.2%	97.6%		21.1s	»
Octave 3.8, jcobi/1	74.1%	99.8%		7.4s	»
Jmat.Real.lambertw, estimator	99.6%	100.0%		2.3s	»
Jmat.Real.gamma, branch z less than 0.5	96.2%	98.2%		1.4min	»
Jmat.Real.gamma, branch z greater than 0.5				0.1s	»
Jmat.Real.erfi, branch x less than or equal to 0.5	99.8%	99.8%		8.4s	»
Jmat.Real.erfi, branch x greater than or equal to 5	100.0%	100.0%		12.5s	»
Jmat.Real.erf	79.6%	99.9%		15.4s	»
Jmat.Real.dawson	54.5%	99.3%		4.3s	»
math.sqrt on complex, real part	40.4%	83.1%	47.6%	8.6s	»
math.sin on complex, imaginary part	53.9%	99.5%	99.8%	9.0s	»
math.cube on real	99.9%	100.0%	100.0%	1.4s	»
math.cube on complex, real part	82.7%	96.4%	87.3%	5.2s	»
math.cube on complex, imaginary part	82.9%	98.5%	91.2%	7.1s	»
math.cos on complex, imaginary part	65.2%	99.5%	99.8%	9.2s	»
Rust f64::asinh				0.7s	»
Rust f64::acosh				0.7s	»
Rust f32::asinh				1.4s	»
Rust f32::acosh				1.1s	»
Jmat.Real.lambertw, newton loop step	77.3%	99.5%	78.4%	6.7s	»
Ian Simplification	6.8%	8.3%	100.0%	24.4s	»
FastMath test5	99.9%	100.0%	100.0%	1.7s	»
FastMath test3	97.8%	100.0%	99.9%	6.5s	»
FastMath test2	99.7%	100.0%	100.0%	2.5s	»
FastMath test1	99.6%	100.0%	100.0%	0.9s	»
FastMath repmul	99.9%	100.0%	100.0%	1.6s	»
FastMath dist4	87.6%	100.0%	100.0%	5.5s	»
FastMath dist3	97.7%	100.0%	100.0%	3.5s	»
FastMath dist	97.8%	100.0%	100.0%	2.2s	»

Test

Start

Result ?

Target ?

Time

powComplex, real part

40.5%

81.0%

10.8s

powComplex, imaginary part

39.5%

79.4%

29.8s

normal distribution

99.4%

99.7%

8.6s

math.square on complex, real part

93.9%

96.5%

1.9s

math.square on complex, imaginary part

100.0%

0.9s

math.sqrt on complex, imaginary part, im greater than 0 branch

40.6%

89.8%

6.4s

math.sin on complex, real part

100.0%

8.5s

math.log10 on complex, real part

52.0%

99.0%

7.7s

math.log10 on complex, imaginary part

98.7%

99.8%

3.8s

math.log/2 on complex, real part

51.2%

99.4%

8.5s

math.log/2 on complex, imaginary part

49.8%

99.5%

7.1s

math.log/1 on complex, real part

52.4%

100.0%

1.1s

math.log/1 on complex, imaginary part

100.0%

0.8s

math.exp on complex, real part

100.0%

8.9s

math.exp on complex, imaginary part

100.0%

8.8s

math.cos on complex, real part

100.0%

6.0s

math.arg on complex

100.0%

0.7s

math.abs on complex (squared)

100.0%

0.7s

math.abs on complex

54.2%

100.0%

0.9s

_multiplyComplex, real part

99.2%

99.6%

1.9s

_multiplyComplex, imaginary part

99.3%

99.6%

1.3s

_divideComplex, real part

62.1%

77.5%

8.2s

_divideComplex, imaginary part

61.4%

85.2%

9.9s

Rust f64::atanh

0.7s

Rust f32::atanh

1.0s

Octave 3.8, oct_fill_randg

99.8%

8.9s

Octave 3.8, jcobi/4, as called

27.6%

99.2%

3.1s

Octave 3.8, jcobi/4

16.1%

84.5%

16.7s

Octave 3.8, jcobi/3

94.1%

99.8%

17.5s

Octave 3.8, jcobi/2

63.2%

97.6%

21.1s

Octave 3.8, jcobi/1

74.1%

99.8%

7.4s

Jmat.Real.lambertw, estimator

99.6%

100.0%

2.3s

Jmat.Real.gamma, branch z less than 0.5

96.2%

98.2%

1.4min

Jmat.Real.gamma, branch z greater than 0.5

0.1s

Jmat.Real.erfi, branch x less than or equal to 0.5

99.8%

8.4s

Jmat.Real.erfi, branch x greater than or equal to 5

100.0%

12.5s

Jmat.Real.erf

79.6%

99.9%

15.4s

Jmat.Real.dawson

54.5%

99.3%

4.3s

math.sqrt on complex, real part

40.4%

83.1%

47.6%

8.6s

math.sin on complex, imaginary part

53.9%

99.5%

99.8%

9.0s

math.cube on real

99.9%

100.0%

1.4s

math.cube on complex, real part

82.7%

96.4%

87.3%

5.2s

math.cube on complex, imaginary part

82.9%

98.5%

91.2%

7.1s

math.cos on complex, imaginary part

65.2%

99.5%

99.8%

9.2s

Rust f64::asinh

0.7s

Rust f64::acosh

0.7s

Rust f32::asinh

1.4s

Rust f32::acosh

1.1s

Jmat.Real.lambertw, newton loop step

77.3%

99.5%

78.4%

6.7s

Ian Simplification

6.8%

8.3%

100.0%

24.4s

FastMath test5

99.9%

100.0%

1.7s

FastMath test3

97.8%

100.0%

99.9%

6.5s

FastMath test2

99.7%

100.0%

2.5s

FastMath test1

99.6%

100.0%

0.9s

FastMath repmul

99.9%

100.0%

1.6s

FastMath dist4

87.6%

100.0%

5.5s

FastMath dist3

97.7%

100.0%

3.5s

FastMath dist

97.8%

100.0%

2.2s