Herbie results

Output vs Input Accuracy

Each point represents a Herbie run below. Its horizontal position shows initial accuracy, and vertical position shows final accuracy. Points above the line are improved by Herbie.

Accuracy vs Cost

A joint cost-accuracy pareto curve for the Herbie runs below. Accuracy is on the vertical axis, and cost is on the vertical axis. Down and to the left is better. The initial programs are shown by the red square.

Test	Start	Result ?	Target ?	Time
powComplex, real part	51.71%	5.13%		20.3s	»
powComplex, imaginary part	51.84%	5.31%		21.4s	»
normal distribution	0.59%	0.36%		13.0s	»
math.square on complex, real part	0.01%	0%		1.3s	»
math.square on complex, imaginary part	0.01%	0.03%		1.2s	»
math.sqrt on complex, imaginary part, im greater than 0 branch	59.99%	11.66%		11.5s	»
math.sin on complex, real part	0.05%	0.05%		11.7s	»
math.log10 on complex, real part	50.21%	0.47%		11.5s	»
math.log10 on complex, imaginary part	1.33%	0.21%		7.5s	»
math.log/2 on complex, real part	49.79%	0.56%		15.1s	»
math.log/2 on complex, imaginary part	49.5%	0.48%		10.8s	»
math.log/1 on complex, real part	49.74%	0%		1.5s	»
math.log/1 on complex, imaginary part	0%	0%		0.9s	»
math.exp on complex, real part	0.01%	0.01%		8.5s	»
math.exp on complex, imaginary part	0.04%	0.04%		9.2s	»
math.cos on complex, real part	0.02%	0.02%		9.2s	»
math.arg on complex	0%	0%		0.7s	»
math.abs on complex (squared)	0.01%	0.01%		1.3s	»
math.abs on complex	49.83%	0%		1.0s	»
_multiplyComplex, real part	0.02%	0.01%		2.4s	»
_multiplyComplex, imaginary part	0.02%	0.01%		2.5s	»
_divideComplex, real part	40.72%	16.66%		17.7s	»
_divideComplex, imaginary part	40.84%	1.58%		13.3s	»
Rust f64::atanh	0.03%	0.03%		2.7s	»
Rust f32::atanh	0.21%	0.21%		6.4s	»
Octave 3.8, oct_fill_randg	0.21%	0.2%		10.7s	»
Octave 3.8, jcobi/4, as called	73.3%	0.77%		2.6s	»
Octave 3.8, jcobi/4	84.46%	14.3%		21.1s	»
Octave 3.8, jcobi/3	6.04%	0.37%		22.4s	»
Octave 3.8, jcobi/2	36.97%	2.15%		21.6s	»
Octave 3.8, jcobi/1	25.26%	0.73%		6.5s	»
Jmat.Real.lambertw, estimator	0.39%	0.01%		2.9s	»
Jmat.Real.gamma, branch z less than 0.5	2.68%	0.75%		1.4min	»
Jmat.Real.gamma, branch z greater than 0.5	6.06%	2.69%		26.5s	»
Jmat.Real.erfi, branch x less than or equal to 0.5	0.21%	0.21%		8.5s	»
Jmat.Real.erfi, branch x greater than or equal to 5	4.49%	1.99%		15.4s	»
Jmat.Real.erf	20.4%	0.31%		28.9s	»
Jmat.Real.dawson	45.31%	0.03%		10.6s	»
math.sqrt on complex, real part	59.93%	15.98%	52.17%	5.7s	»
math.sin on complex, imaginary part	90.59%	1.1%	0.36%	13.0s	»
math.cube on real	0.2%	0%	0%	1.9s	»
math.cube on complex, real part	11.69%	0.26%	0.4%	10.3s	»
math.cube on complex, imaginary part	11.52%	0.27%	0.38%	7.1s	»
math.cos on complex, imaginary part	67.47%	1.04%	0.39%	12.6s	»
Rust f64::asinh	70.1%	0.16%	0.06%	5.6s	»
Rust f64::acosh	48.98%	0.53%	0.11%	1.6s	»
Rust f32::asinh	63.55%	0.66%	0.51%	9.3s	»
Rust f32::acosh	50.4%	0.07%	0.73%	7.9s	»
Jmat.Real.lambertw, newton loop step	21.24%	1.03%	20.24%	13.3s	»
Ian Simplification	93.3%	91.83%	0%	21.6s	»
FastMath test5	0.19%	0%	0%	2.1s	»
FastMath test3	0.11%	0.1%	0.09%	5.7s	»
FastMath test2	0.28%	0.04%	0.04%	3.8s	»
FastMath test1	0.42%	0%	0%	0.9s	»
FastMath repmul	0.21%	0%	0%	1.7s	»
FastMath dist4	0.04%	0.02%	0.04%	11.0s	»
FastMath dist3	0.07%	0.03%	0.04%	5.7s	»
FastMath dist	0.02%	0.01%	0.02%	2.2s	»

Test

Start

Result ?

Target ?

Time

powComplex, real part

51.71%

5.13%

20.3s

powComplex, imaginary part

51.84%

5.31%

21.4s

normal distribution

0.59%

0.36%

13.0s

math.square on complex, real part

0.01%

1.3s

math.square on complex, imaginary part

0.01%

0.03%

1.2s

math.sqrt on complex, imaginary part, im greater than 0 branch

59.99%

11.66%

11.5s

math.sin on complex, real part

0.05%

11.7s

math.log10 on complex, real part

50.21%

0.47%

11.5s

math.log10 on complex, imaginary part

1.33%

0.21%

7.5s

math.log/2 on complex, real part

49.79%

0.56%

15.1s

math.log/2 on complex, imaginary part

49.5%

0.48%

10.8s

math.log/1 on complex, real part

49.74%

1.5s

math.log/1 on complex, imaginary part

0.9s

math.exp on complex, real part

0.01%

8.5s

math.exp on complex, imaginary part

0.04%

9.2s

math.cos on complex, real part

0.02%

9.2s

math.arg on complex

0.7s

math.abs on complex (squared)

0.01%

1.3s

math.abs on complex

49.83%

1.0s

_multiplyComplex, real part

0.02%

0.01%

2.4s

_multiplyComplex, imaginary part

0.02%

0.01%

2.5s

_divideComplex, real part

40.72%

16.66%

17.7s

_divideComplex, imaginary part

40.84%

1.58%

13.3s

Rust f64::atanh

0.03%

2.7s

Rust f32::atanh

0.21%

6.4s

Octave 3.8, oct_fill_randg

0.21%

0.2%

10.7s

Octave 3.8, jcobi/4, as called

73.3%

0.77%

2.6s

Octave 3.8, jcobi/4

84.46%

14.3%

21.1s

Octave 3.8, jcobi/3

6.04%

0.37%

22.4s

Octave 3.8, jcobi/2

36.97%

2.15%

21.6s

Octave 3.8, jcobi/1

25.26%

0.73%

6.5s

Jmat.Real.lambertw, estimator

0.39%

0.01%

2.9s

Jmat.Real.gamma, branch z less than 0.5

2.68%

0.75%

1.4min

Jmat.Real.gamma, branch z greater than 0.5

6.06%

2.69%

26.5s

Jmat.Real.erfi, branch x less than or equal to 0.5

0.21%

8.5s

Jmat.Real.erfi, branch x greater than or equal to 5

4.49%

1.99%

15.4s

Jmat.Real.erf

20.4%

0.31%

28.9s

Jmat.Real.dawson

45.31%

0.03%

10.6s

math.sqrt on complex, real part

59.93%

15.98%

52.17%

5.7s

math.sin on complex, imaginary part

90.59%

1.1%

0.36%

13.0s

math.cube on real

0.2%

1.9s

math.cube on complex, real part

11.69%

0.26%

0.4%

10.3s

math.cube on complex, imaginary part

11.52%

0.27%

0.38%

7.1s

math.cos on complex, imaginary part

67.47%

1.04%

0.39%

12.6s

Rust f64::asinh

70.1%

0.16%

0.06%

5.6s

Rust f64::acosh

48.98%

0.53%

0.11%

1.6s

Rust f32::asinh

63.55%

0.66%

0.51%

9.3s

Rust f32::acosh

50.4%

0.07%

0.73%

7.9s

Jmat.Real.lambertw, newton loop step

21.24%

1.03%

20.24%

13.3s

Ian Simplification

93.3%

91.83%

21.6s

FastMath test5

0.19%

2.1s

FastMath test3

0.11%

0.1%

0.09%

5.7s

FastMath test2

0.28%

0.04%

3.8s

FastMath test1

0.42%

0.9s

FastMath repmul

0.21%

1.7s

FastMath dist4

0.04%

0.02%

0.04%

11.0s

FastMath dist3

0.07%

0.03%

0.04%

5.7s

FastMath dist

0.02%

0.01%

0.02%

2.2s