Herbie results

Output vs Input Accuracy

Each point represents a Herbie run below. Its horizontal position shows initial accuracy, and vertical position shows final accuracy. Points above the line are improved by Herbie.

Accuracy vs Cost

A joint cost-accuracy pareto curve for the Herbie runs below. Accuracy is on the vertical axis, and cost is on the vertical axis. Down and to the left is better. The initial programs are shown by the red square.

Test	Start	Result ?	Target ?	Time
powComplex, real part	52.02%	5.12%		19.1s	»
powComplex, imaginary part	52.12%	6.89%		25.5s	»
normal distribution	0.59%	0.37%		11.6s	»
math.square on complex, real part	0.01%	0.01%		1.1s	»
math.square on complex, imaginary part	0.01%	0%		1.2s	»
math.sqrt on complex, imaginary part, im greater than 0 branch	60.12%	9.58%		9.5s	»
math.sin on complex, real part	0.04%	0.04%		10.1s	»
math.log10 on complex, real part	49.88%	0.87%		10.9s	»
math.log10 on complex, imaginary part	1.33%	0.22%		5.2s	»
math.log/2 on complex, real part	50.68%	0.56%		11.8s	»
math.log/2 on complex, imaginary part	49.66%	0.48%		10.5s	»
math.log/1 on complex, real part	49.41%	0%		1.4s	»
math.log/1 on complex, imaginary part	0%	0%		0.9s	»
math.exp on complex, real part	0.01%	0.02%		8.4s	»
math.exp on complex, imaginary part	0.02%	0.02%		8.9s	»
math.cos on complex, real part	0.02%	0.02%		9.5s	»
math.arg on complex	0%	0%		0.7s	»
math.abs on complex (squared)	0.01%	0%		1.0s	»
math.abs on complex	49.28%	0%		0.9s	»
_multiplyComplex, real part	0.02%	0.01%		2.2s	»
_multiplyComplex, imaginary part	0.02%	0.01%		2.7s	»
_divideComplex, real part	41.47%	15.61%		13.6s	»
_divideComplex, imaginary part	41.55%	19.43%		12.3s	»
Rust f64::atanh	0.03%	0.03%		3.3s	»
Rust f32::atanh	0.22%	0.22%		4.8s	»
Octave 3.8, oct_fill_randg	0.21%	0.19%		13.3s	»
Octave 3.8, jcobi/4, as called	73.64%	0.42%		4.4s	»
Octave 3.8, jcobi/4	84.95%	13.61%		27.1s	»
Octave 3.8, jcobi/3	5.75%	0.18%		23.1s	»
Octave 3.8, jcobi/2	38.26%	2.31%		26.3s	»
Octave 3.8, jcobi/1	24.72%	0.26%		13.6s	»
Jmat.Real.lambertw, estimator	0.41%	0.01%		3.4s	»
Jmat.Real.gamma, branch z less than 0.5	2.66%	0.76%		1.4min	»
Jmat.Real.gamma, branch z greater than 0.5	5.91%	4.84%		25.7s	»
Jmat.Real.erfi, branch x less than or equal to 0.5	0.23%	0.23%		9.2s	»
Jmat.Real.erfi, branch x greater than or equal to 5	4.39%	1.89%		15.4s	»
Jmat.Real.erf	20.83%	0.76%		15.9s	»
Jmat.Real.dawson	45.79%	0.03%		12.3s	»
math.sqrt on complex, real part	60.69%	17.52%	52.7%	11.7s	»
math.sin on complex, imaginary part	90.8%	0.94%	0.36%	12.5s	»
math.cube on real	0.2%	0%	0%	1.6s	»
math.cube on complex, real part	11.2%	0.27%	0.4%	9.8s	»
math.cube on complex, imaginary part	11.06%	0.26%	0.38%	8.7s	»
math.cos on complex, imaginary part	68.25%	1.19%	0.39%	11.8s	»
Rust f64::asinh	71.18%	0.8%	0.04%	4.1s	»
Rust f64::acosh	49.31%	0.49%	0.05%	2.5s	»
Rust f32::asinh	64.45%	1.56%	0.47%	8.4s	»
Rust f32::acosh	50.37%	1.59%	0.61%	6.9s	»
Jmat.Real.lambertw, newton loop step	20.79%	0.86%	19.87%	14.6s	»
Ian Simplification	93.01%	91.52%	0%	16.6s	»
FastMath test5	0.2%	0%	0%	1.8s	»
FastMath test3	0.11%	0.09%	0.1%	7.1s	»
FastMath test2	0.28%	0.05%	0.05%	4.2s	»
FastMath test1	0.41%	0%	0%	0.9s	»
FastMath repmul	0.21%	0%	0%	1.9s	»
FastMath dist4	0.04%	0.03%	0.03%	8.5s	»
FastMath dist3	0.07%	0.04%	0.04%	6.4s	»
FastMath dist	0.02%	0.01%	0.02%	2.5s	»

Test

Start

Result ?

Target ?

Time

powComplex, real part

52.02%

5.12%

19.1s

powComplex, imaginary part

52.12%

6.89%

25.5s

normal distribution

0.59%

0.37%

11.6s

math.square on complex, real part

0.01%

1.1s

math.square on complex, imaginary part

0.01%

1.2s

math.sqrt on complex, imaginary part, im greater than 0 branch

60.12%

9.58%

9.5s

math.sin on complex, real part

0.04%

10.1s

math.log10 on complex, real part

49.88%

0.87%

10.9s

math.log10 on complex, imaginary part

1.33%

0.22%

5.2s

math.log/2 on complex, real part

50.68%

0.56%

11.8s

math.log/2 on complex, imaginary part

49.66%

0.48%

10.5s

math.log/1 on complex, real part

49.41%

1.4s

math.log/1 on complex, imaginary part

0.9s

math.exp on complex, real part

0.01%

0.02%

8.4s

math.exp on complex, imaginary part

0.02%

8.9s

math.cos on complex, real part

0.02%

9.5s

math.arg on complex

0.7s

math.abs on complex (squared)

0.01%

1.0s

math.abs on complex

49.28%

0.9s

_multiplyComplex, real part

0.02%

0.01%

2.2s

_multiplyComplex, imaginary part

0.02%

0.01%

2.7s

_divideComplex, real part

41.47%

15.61%

13.6s

_divideComplex, imaginary part

41.55%

19.43%

12.3s

Rust f64::atanh

0.03%

3.3s

Rust f32::atanh

0.22%

4.8s

Octave 3.8, oct_fill_randg

0.21%

0.19%

13.3s

Octave 3.8, jcobi/4, as called

73.64%

0.42%

4.4s

Octave 3.8, jcobi/4

84.95%

13.61%

27.1s

Octave 3.8, jcobi/3

5.75%

0.18%

23.1s

Octave 3.8, jcobi/2

38.26%

2.31%

26.3s

Octave 3.8, jcobi/1

24.72%

0.26%

13.6s

Jmat.Real.lambertw, estimator

0.41%

0.01%

3.4s

Jmat.Real.gamma, branch z less than 0.5

2.66%

0.76%

1.4min

Jmat.Real.gamma, branch z greater than 0.5

5.91%

4.84%

25.7s

Jmat.Real.erfi, branch x less than or equal to 0.5

0.23%

9.2s

Jmat.Real.erfi, branch x greater than or equal to 5

4.39%

1.89%

15.4s

Jmat.Real.erf

20.83%

0.76%

15.9s

Jmat.Real.dawson

45.79%

0.03%

12.3s

math.sqrt on complex, real part

60.69%

17.52%

52.7%

11.7s

math.sin on complex, imaginary part

90.8%

0.94%

0.36%

12.5s

math.cube on real

0.2%

1.6s

math.cube on complex, real part

11.2%

0.27%

0.4%

9.8s

math.cube on complex, imaginary part

11.06%

0.26%

0.38%

8.7s

math.cos on complex, imaginary part

68.25%

1.19%

0.39%

11.8s

Rust f64::asinh

71.18%

0.8%

0.04%

4.1s

Rust f64::acosh

49.31%

0.49%

0.05%

2.5s

Rust f32::asinh

64.45%

1.56%

0.47%

8.4s

Rust f32::acosh

50.37%

1.59%

0.61%

6.9s

Jmat.Real.lambertw, newton loop step

20.79%

0.86%

19.87%

14.6s

Ian Simplification

93.01%

91.52%

16.6s

FastMath test5

0.2%

1.8s

FastMath test3

0.11%

0.09%

0.1%

7.1s

FastMath test2

0.28%

0.05%

4.2s

FastMath test1

0.41%

0.9s

FastMath repmul

0.21%

1.9s

FastMath dist4

0.04%

0.03%

8.5s

FastMath dist3

0.07%

0.04%

6.4s

FastMath dist

0.02%

0.01%

0.02%

2.5s