Herbie results

Output vs Input Accuracy

Each point represents a Herbie run below. Its horizontal position shows initial accuracy, and vertical position shows final accuracy. Points above the line are improved by Herbie.

Accuracy vs Cost

A joint cost-accuracy pareto curve for the Herbie runs below. Accuracy is on the vertical axis, and cost is on the vertical axis. Down and to the left is better. The initial programs are shown by the red square.

Test	Start	Result ?	Target ?	Time
symmetry log of sum of exp	46.87%	1.59%		18.4s	»
raw-angle from scale-rotated-ellipse				2.5min	»
b parameter of renormalized beta distribution	0.11%	0.11%		9.4s	»
b from scale-rotated-ellipse	99.95%	57%		2.5min	»
ab-angle->ABCF D	25.45%	0.47%		4.0s	»
ab-angle->ABCF C	32.05%	32.26%		15.7s	»
ab-angle->ABCF B	49.35%	33.85%		22.7s	»
ab-angle->ABCF A	31.78%	31.8%		21.3s	»
a parameter of renormalized beta distribution	0.28%	0.28%		8.2s	»
a from scale-rotated-ellipse	99.16%	62.42%		1.6min	»
Trigonometry B	0.51%	0.5%		11.3s	»
Trigonometry A	0.2%	0.21%		9.9s	»
Spherical law of cosines	25.74%	5.77%		44.7s	»
Simplification of discriminant from scale-rotated-ellipse	63.74%	9.82%		1.1min	»
Quadratic roots, wide range	81.88%	0.13%		14.9s	»
Quadratic roots, narrow range	44.36%	1.37%		21.8s	»
Quadratic roots, medium range	69.24%	0.23%		15.9s	»
Quadratic roots, full range	53.05%	16.31%		16.9s	»
Midpoint on a great circle	1.26%	0.37%		27.6s	»
Logistic function from Lakshay Garg	45.57%	2.53%		5.1s	»
Hyperbolic tangent	91.06%	0.02%		4.5s	»
Hyperbolic sine	90.85%	0.01%		3.2s	»
Hyperbolic secant	0.01%	0.02%		3.7s	»
Hyperbolic arc-cosine	49.54%	0.54%		4.3s	»
Hyperbolic arc-(co)tangent	91.31%	0.01%		5.6s	»
Hyperbolic arc-(co)secant	0.07%	0.07%		4.0s	»
Example from Robby	0.19%	0.2%		19.6s	»
Example 2 from Robby	0.2%	0.2%		19.6s	»
Equirectangular approximation to distance on a great circle	61.32%	5.94%		14.6s	»
Eccentricity of an ellipse	22.67%	0.03%		9.4s	»
Distance on a great circle	38.32%	21.1%		2.3min	»
Destination given bearing on a great circle	0.24%	0.24%		28.8s	»
Cubic critical, wide range	81.9%	0.14%		12.9s	»
Cubic critical, narrow range	44.5%	7.8%		30.2s	»
Cubic critical, medium range	69.24%	0.25%		15.9s	»
Cubic critical	53.11%	16.42%		25.6s	»
Bearing on a great circle	21.31%	0.29%		47.9s	»
Asymptote C	46.54%	0.02%		8.7s	»
Asymptote B	0.02%	0.02%		4.9s	»
Asymptote A	22.39%	1.13%		4.1s	»
ABCF->ab-angle b	81.32%	66.86%		1.2min	»
ABCF->ab-angle angle	46.84%	19.39%		20.9s	»
ABCF->ab-angle a	81.68%	49.99%		49.7s	»
2-ancestry mixing, zero discriminant	24.73%	1.3%		5.4s	»
2-ancestry mixing, positive discriminant	56.1%	4.34%		13.2s	»
2-ancestry mixing, negative discriminant	1.55%	1.55%		6.6s	»
Quotient of sum of exps	1.02%	1.4%	0.02%	8.8s	»
Quotient of products	18.15%	4.09%	17.47%	3.7s	»
Logistic regression 2	0.63%	0.67%	0.05%	9.4s	»
Hyperbolic arcsine	82.73%	0.1%	69.83%	8.7s	»
Harley's example				2.5min	»
Exp of sum of logs	8.93%	0%	0%	1.3s	»
(- (/ x0 (- 1 x1)) x0)				0.0s	»

Test

Start

Result ?

Target ?

Time

symmetry log of sum of exp

46.87%

1.59%

18.4s

raw-angle from scale-rotated-ellipse

2.5min

b parameter of renormalized beta distribution

0.11%

9.4s

b from scale-rotated-ellipse

99.95%

57%

2.5min

ab-angle->ABCF D

25.45%

0.47%

4.0s

ab-angle->ABCF C

32.05%

32.26%

15.7s

ab-angle->ABCF B

49.35%

33.85%

22.7s

ab-angle->ABCF A

31.78%

31.8%

21.3s

a parameter of renormalized beta distribution

0.28%

8.2s

a from scale-rotated-ellipse

99.16%

62.42%

1.6min

Trigonometry B

0.51%

0.5%

11.3s

Trigonometry A

0.2%

0.21%

9.9s

Spherical law of cosines

25.74%

5.77%

44.7s

Simplification of discriminant from scale-rotated-ellipse

63.74%

9.82%

1.1min

Quadratic roots, wide range

81.88%

0.13%

14.9s

Quadratic roots, narrow range

44.36%

1.37%

21.8s

Quadratic roots, medium range

69.24%

0.23%

15.9s

Quadratic roots, full range

53.05%

16.31%

16.9s

Midpoint on a great circle

1.26%

0.37%

27.6s

Logistic function from Lakshay Garg

45.57%

2.53%

5.1s

Hyperbolic tangent

91.06%

0.02%

4.5s

Hyperbolic sine

90.85%

0.01%

3.2s

Hyperbolic secant

0.01%

0.02%

3.7s

Hyperbolic arc-cosine

49.54%

0.54%

4.3s

Hyperbolic arc-(co)tangent

91.31%

0.01%

5.6s

Hyperbolic arc-(co)secant

0.07%

4.0s

Example from Robby

0.19%

0.2%

19.6s

Example 2 from Robby

0.2%

19.6s

Equirectangular approximation to distance on a great circle

61.32%

5.94%

14.6s

Eccentricity of an ellipse

22.67%

0.03%

9.4s

Distance on a great circle

38.32%

21.1%

2.3min

Destination given bearing on a great circle

0.24%

28.8s

Cubic critical, wide range

81.9%

0.14%

12.9s

Cubic critical, narrow range

44.5%

7.8%

30.2s

Cubic critical, medium range

69.24%

0.25%

15.9s

Cubic critical

53.11%

16.42%

25.6s

Bearing on a great circle

21.31%

0.29%

47.9s

Asymptote C

46.54%

0.02%

8.7s

Asymptote B

0.02%

4.9s

Asymptote A

22.39%

1.13%

4.1s

ABCF->ab-angle b

81.32%

66.86%

1.2min

ABCF->ab-angle angle

46.84%

19.39%

20.9s

ABCF->ab-angle a

81.68%

49.99%

49.7s

2-ancestry mixing, zero discriminant

24.73%

1.3%

5.4s

2-ancestry mixing, positive discriminant

56.1%

4.34%

13.2s

2-ancestry mixing, negative discriminant

1.55%

6.6s

Quotient of sum of exps

1.02%

1.4%

0.02%

8.8s

Quotient of products

18.15%

4.09%

17.47%

3.7s

Logistic regression 2

0.63%

0.67%

0.05%

9.4s

Hyperbolic arcsine

82.73%

0.1%

69.83%

8.7s

Harley's example

2.5min

Exp of sum of logs

8.93%

1.3s

(- (/ x0 (- 1 x1)) x0)

0.0s