Herbie results

Output vs Input Accuracy

Each point represents a Herbie run below. Its horizontal position shows initial accuracy, and vertical position shows final accuracy. Points above the line are improved by Herbie.

Accuracy vs Cost

A joint cost-accuracy pareto curve for the Herbie runs below. Accuracy is on the horizontal axis, and cost is on the vertical axis. Down and to the left is better. The initial programs are shown by the red square.

Test	Start	Result ?	Target ?	Time
symmetry log of sum of exp				2.5min	»
raw-angle from scale-rotated-ellipse				2.5min	»
b parameter of renormalized beta distribution	99.9%	99.9%		7.7s	»
b from scale-rotated-ellipse				2.5min	»
ab-angle->ABCF D	74.9%	99.5%		8.5s	»
ab-angle->ABCF C	67.8%	67.8%		20.1s	»
ab-angle->ABCF B	50.6%	65.1%		32.7s	»
ab-angle->ABCF A	67.9%	67.7%		27.5s	»
a parameter of renormalized beta distribution	99.7%	99.7%		12.4s	»
a from scale-rotated-ellipse				2.5min	»
Trigonometry B	99.5%	99.5%		18.2s	»
Trigonometry A	99.8%	99.8%		13.4s	»
Spherical law of cosines	73.3%	94.3%		48.1s	»
Simplification of discriminant from scale-rotated-ellipse	36.6%	90.4%		1.6min	»
Quadratic roots, wide range	18.4%	97.6%		12.2s	»
Quadratic roots, narrow range	55.6%	99.3%		23.0s	»
Quadratic roots, medium range	31.1%	95.6%		20.4s	»
Quadratic roots, full range	46.1%	84.0%		26.1s	»
Midpoint on a great circle	98.8%	99.6%		40.4s	»
Logistic function from Lakshay Garg	54.4%	99.7%		15.8s	»
Hyperbolic tangent	9.2%	97.2%		12.5s	»
Hyperbolic sine	9.3%	99.4%		11.9s	»
Hyperbolic secant	100.0%	100.0%		3.6s	»
Hyperbolic arc-cosine	50.2%	99.5%		9.9s	»
Hyperbolic arc-(co)tangent	8.6%	100.0%		14.7s	»
Hyperbolic arc-(co)secant	100.0%	100.0%		4.9s	»
Example from Robby	99.8%	99.8%		32.6s	»
Example 2 from Robby	99.8%	99.8%		31.2s	»
Equirectangular approximation to distance on a great circle	38.8%	94.2%		25.1s	»
Eccentricity of an ellipse	77.9%	100.0%		5.3s	»
Distance on a great circle				2.5min	»
Destination given bearing on a great circle	99.7%	99.7%		49.1s	»
Cubic critical, wide range	18.4%	99.2%		35.3s	»
Cubic critical, narrow range	55.3%	97.9%		35.3s	»
Cubic critical, medium range	31.0%	95.6%		35.1s	»
Cubic critical	46.1%	83.7%		38.6s	»
Bearing on a great circle	78.8%	99.7%		1.3min	»
Asymptote C	54.0%	99.2%		11.9s	»
Asymptote B	100.0%	100.0%		3.8s	»
Asymptote A	78.2%	99.9%		5.9s	»
ABCF->ab-angle b	17.8%	38.0%		1.1min	»
ABCF->ab-angle angle	52.5%	80.8%		22.6s	»
ABCF->ab-angle a	17.8%	49.0%		58.3s	»
2-ancestry mixing, zero discriminant	75.5%	98.7%		14.2s	»
2-ancestry mixing, positive discriminant	43.7%	95.7%		15.1s	»
2-ancestry mixing, negative discriminant	98.5%	98.1%		6.2s	»
Quotient of sum of exps	98.7%	98.6%	100.0%	22.3s	»
Quotient of products	82.2%	95.6%	82.4%	15.7s	»
Logistic regression 2	99.1%	99.2%	99.9%	10.3s	»
Hyperbolic arcsine	17.3%	99.9%	28.3%	19.0s	»
Harley's example				2.5min	»
Exp of sum of logs	91.0%	100.0%	100.0%	2.8s	»
(- (/ x0 (- 1 x1)) x0)				0.0s	»

Test

Start

Result ?

Target ?

Time

symmetry log of sum of exp

2.5min

raw-angle from scale-rotated-ellipse

2.5min

b parameter of renormalized beta distribution

99.9%

7.7s

b from scale-rotated-ellipse

2.5min

ab-angle->ABCF D

74.9%

99.5%

8.5s

ab-angle->ABCF C

67.8%

20.1s

ab-angle->ABCF B

50.6%

65.1%

32.7s

ab-angle->ABCF A

67.9%

67.7%

27.5s

a parameter of renormalized beta distribution

99.7%

12.4s

a from scale-rotated-ellipse

2.5min

Trigonometry B

99.5%

18.2s

Trigonometry A

99.8%

13.4s

Spherical law of cosines

73.3%

94.3%

48.1s

Simplification of discriminant from scale-rotated-ellipse

36.6%

90.4%

1.6min

Quadratic roots, wide range

18.4%

97.6%

12.2s

Quadratic roots, narrow range

55.6%

99.3%

23.0s

Quadratic roots, medium range

31.1%

95.6%

20.4s

Quadratic roots, full range

46.1%

84.0%

26.1s

Midpoint on a great circle

98.8%

99.6%

40.4s

Logistic function from Lakshay Garg

54.4%

99.7%

15.8s

Hyperbolic tangent

9.2%

97.2%

12.5s

Hyperbolic sine

9.3%

99.4%

11.9s

Hyperbolic secant

100.0%

3.6s

Hyperbolic arc-cosine

50.2%

99.5%

9.9s

Hyperbolic arc-(co)tangent

8.6%

100.0%

14.7s

Hyperbolic arc-(co)secant

100.0%

4.9s

Example from Robby

99.8%

32.6s

Example 2 from Robby

99.8%

31.2s

Equirectangular approximation to distance on a great circle

38.8%

94.2%

25.1s

Eccentricity of an ellipse

77.9%

100.0%

5.3s

Distance on a great circle

2.5min

Destination given bearing on a great circle

99.7%

49.1s

Cubic critical, wide range

18.4%

99.2%

35.3s

Cubic critical, narrow range

55.3%

97.9%

35.3s

Cubic critical, medium range

31.0%

95.6%

35.1s

Cubic critical

46.1%

83.7%

38.6s

Bearing on a great circle

78.8%

99.7%

1.3min

Asymptote C

54.0%

99.2%

11.9s

Asymptote B

100.0%

3.8s

Asymptote A

78.2%

99.9%

5.9s

ABCF->ab-angle b

17.8%

38.0%

1.1min

ABCF->ab-angle angle

52.5%

80.8%

22.6s

ABCF->ab-angle a

17.8%

49.0%

58.3s

2-ancestry mixing, zero discriminant

75.5%

98.7%

14.2s

2-ancestry mixing, positive discriminant

43.7%

95.7%

15.1s

2-ancestry mixing, negative discriminant

98.5%

98.1%

6.2s

Quotient of sum of exps

98.7%

98.6%

100.0%

22.3s

Quotient of products

82.2%

95.6%

82.4%

15.7s

Logistic regression 2

99.1%

99.2%

99.9%

10.3s

Hyperbolic arcsine

17.3%

99.9%

28.3%

19.0s

Harley's example

2.5min

Exp of sum of logs

91.0%

100.0%

2.8s

(- (/ x0 (- 1 x1)) x0)

0.0s