Herbie results

Average Percentage Accurate: 71.8% → 91.2%

Time: 22.3min

Bad Runs: 2/53

Speedup: 4.4×

Output vs Input Accuracy

Each point represents a Herbie run below. Its horizontal position shows initial accuracy, and vertical position shows final accuracy. Points above the line are improved by Herbie.

Accuracy vs Speed

A joint speed-accuracy pareto curve. Accuracy is on the vertical axis, speed is on the horizontal axis. Up and to the right is better. The initial program is shown by the red square.

Test	Start	Result ?	Target ?	Time
symmetry log of sum of exp	30.1%	93.5%		14.2s	»
raw-angle from scale-rotated-ellipse				2.5min	»
b parameter of renormalized beta distribution	99.9%	99.9%		19.5s	»
b from scale-rotated-ellipse				2.5min	»
ab-angle->ABCF D	82.0%	99.6%		6.8s	»
ab-angle->ABCF C	79.9%	79.8%		37.3s	»
ab-angle->ABCF B	53.2%	67.3%		34.9s	»
ab-angle->ABCF A	79.8%	79.8%		35.6s	»
a parameter of renormalized beta distribution	99.8%	99.7%		25.1s	»
a from scale-rotated-ellipse	2.4%	41.2%		1.5min	»
Trigonometry B	99.5%	99.5%		15.2s	»
Trigonometry A	99.8%	99.8%		11.1s	»
Spherical law of cosines	73.9%	93.9%		36.0s	»
Simplification of discriminant from scale-rotated-ellipse	25.3%	94.0%		52.3s	»
Quadratic roots, wide range				2.3s	»
Quadratic roots, narrow range				2.5s	»
Quadratic roots, medium range				2.6s	»
Quadratic roots, full range	52.2%	85.3%		18.5s	»
Midpoint on a great circle	98.5%	99.6%		31.5s	»
Logistic function from Lakshay Garg	53.8%	99.5%		13.1s	»
Hyperbolic tangent	4.5%	51.9%		3.7s	»
Hyperbolic sine	54.5%	99.2%		7.9s	»
Hyperbolic secant	100.0%	100.0%		4.8s	»
Hyperbolic arc-cosine	51.1%	99.5%		11.4s	»
Hyperbolic arc-(co)tangent	8.6%	100.0%		8.4s	»
Hyperbolic arc-(co)secant	99.9%	99.9%		11.2s	»
Example from Robby	99.8%	99.8%		34.8s	»
Example 2 from Robby	99.8%	99.8%		30.9s	»
Equirectangular approximation to distance on a great circle	60.3%	99.8%		23.2s	»
Eccentricity of an ellipse				1.8s	»
Distance on a great circle	61.9%	62.7%		1.2min	»
Destination given bearing on a great circle	99.8%	99.8%		20.9s	»
Cubic critical, wide range				1.9s	»
Cubic critical, narrow range				2.0s	»
Cubic critical, medium range				1.9s	»
Cubic critical	52.2%	86.8%		20.3s	»
Bearing on a great circle	79.5%	99.7%		45.9s	»
Asymptote C	53.8%	99.8%		12.3s	»
Asymptote B	100.0%	100.0%		6.1s	»
Asymptote A	77.8%	99.9%		6.2s	»
ABCF->ab-angle b	18.4%	46.6%		34.4s	»
ABCF->ab-angle angle	53.7%	81.1%		23.3s	»
ABCF->ab-angle a	18.7%	43.0%		34.6s	»
2-ancestry mixing, zero discriminant	76.2%	98.7%		12.9s	»
2-ancestry mixing, positive discriminant	43.4%	95.9%		39.8s	»
2-ancestry mixing, negative discriminant	98.5%	98.5%		13.6s	»
Quotient of sum of exps	70.0%	81.6%	100.0%	8.0s	»
Quotient of products	85.5%	92.7%	85.9%	7.0s	»
Logistic regression 2	79.9%	90.0%	99.9%	9.6s	»
Hyperbolic arcsine	17.4%	99.4%	29.4%	4.0s	»
Harley's example	16.6%	77.5%	39.4%	1.1min	»
Exp of sum of logs	92.2%	100.0%	100.0%	6.2s	»
(- (/ x0 (- 1 x1)) x0)				0.0s	»

Test

Start

Result ?

Target ?

Time

symmetry log of sum of exp

30.1%

93.5%

14.2s

raw-angle from scale-rotated-ellipse

2.5min

b parameter of renormalized beta distribution

99.9%

19.5s

b from scale-rotated-ellipse

2.5min

ab-angle->ABCF D

82.0%

99.6%

6.8s

ab-angle->ABCF C

79.9%

79.8%

37.3s

ab-angle->ABCF B

53.2%

67.3%

34.9s

ab-angle->ABCF A

79.8%

35.6s

a parameter of renormalized beta distribution

99.8%

99.7%

25.1s

a from scale-rotated-ellipse

2.4%

41.2%

1.5min

Trigonometry B

99.5%

15.2s

Trigonometry A

99.8%

11.1s

Spherical law of cosines

73.9%

93.9%

36.0s

Simplification of discriminant from scale-rotated-ellipse

25.3%

94.0%

52.3s

Quadratic roots, wide range

2.3s

Quadratic roots, narrow range

2.5s

Quadratic roots, medium range

2.6s

Quadratic roots, full range

52.2%

85.3%

18.5s

Midpoint on a great circle

98.5%

99.6%

31.5s

Logistic function from Lakshay Garg

53.8%

99.5%

13.1s

Hyperbolic tangent

4.5%

51.9%

3.7s

Hyperbolic sine

54.5%

99.2%

7.9s

Hyperbolic secant

100.0%

4.8s

Hyperbolic arc-cosine

51.1%

99.5%

11.4s

Hyperbolic arc-(co)tangent

8.6%

100.0%

8.4s

Hyperbolic arc-(co)secant

99.9%

11.2s

Example from Robby

99.8%

34.8s

Example 2 from Robby

99.8%

30.9s

Equirectangular approximation to distance on a great circle

60.3%

99.8%

23.2s

Eccentricity of an ellipse

1.8s

Distance on a great circle

61.9%

62.7%

1.2min

Destination given bearing on a great circle

99.8%

20.9s

Cubic critical, wide range

1.9s

Cubic critical, narrow range

2.0s

Cubic critical, medium range

1.9s

Cubic critical

52.2%

86.8%

20.3s

Bearing on a great circle

79.5%

99.7%

45.9s

Asymptote C

53.8%

99.8%

12.3s

Asymptote B

100.0%

6.1s

Asymptote A

77.8%

99.9%

6.2s

ABCF->ab-angle b

18.4%

46.6%

34.4s

ABCF->ab-angle angle

53.7%

81.1%

23.3s

ABCF->ab-angle a

18.7%

43.0%

34.6s

2-ancestry mixing, zero discriminant

76.2%

98.7%

12.9s

2-ancestry mixing, positive discriminant

43.4%

95.9%

39.8s

2-ancestry mixing, negative discriminant

98.5%

13.6s

Quotient of sum of exps

70.0%

81.6%

100.0%

8.0s

Quotient of products

85.5%

92.7%

85.9%

7.0s

Logistic regression 2

79.9%

90.0%

99.9%

9.6s

Hyperbolic arcsine

17.4%

99.4%

29.4%

4.0s

Harley's example

16.6%

77.5%

39.4%

1.1min

Exp of sum of logs

92.2%

100.0%

6.2s

(- (/ x0 (- 1 x1)) x0)

0.0s