Herbie results

Average Percentage Accurate: 70.3% → 96.2%

Time: 5.2min

Bad Runs: 3/45

Speedup: 3.5×

Output vs Input Accuracy

Each point represents a Herbie run below. Its horizontal position shows initial accuracy, and vertical position shows final accuracy. Points above the line are improved by Herbie.

Accuracy vs Speed

A joint speed-accuracy pareto curve. Accuracy is on the vertical axis, speed is on the horizontal axis. Up and to the right is better. The initial program is shown by the red square.

Test	Start	Result ?	Target ?	Time
arccos	100.0%	100.0%		2.9s	»
Rump's expression from Stadtherr's award speech	9.2%	9.2%		0.9s	»
Rosa's TurbineBenchmark	84.2%	99.8%		10.6s	»
Rosa's FloatVsDoubleBenchmark	70.1%	99.7%		36.7s	»
Rosa's DopplerBench	73.8%	97.8%		8.7s	»
Rosa's Benchmark	99.8%	99.8%		6.7s	»
Radioactive exchange between two surfaces	85.6%	96.7%		4.0s	»
NMSE Section 6.1 mentioned, B	78.5%	96.0%		10.0s	»
NMSE Section 6.1 mentioned, A	73.0%	99.8%		19.5s	»
Kahan's Unum-Targeted Monster				3.7s	»
Kahan's Monster				2.4s	»
Kahan p13 Example 3	100.0%	100.0%		7.5s	»
Kahan p13 Example 2	100.0%	100.0%		13.8s	»
Kahan p13 Example 1	100.0%	99.9%		7.1s	»
From Warwick Tucker's Validated Numerics	9.2%	100.0%		1.8s	»
From Rump in a 1983 paper, rewritten	3.1%	100.0%		2.7s	»
From Rump in a 1983 paper	18.8%	100.0%		2.7s	»
ENA, Section 1.4, Mentioned, B	87.8%	99.6%		4.4s	»
ENA, Section 1.4, Exercise 4b, n=5	87.5%	97.0%		9.1s	»
ENA, Section 1.4, Exercise 4b, n=2	74.6%	100.0%		4.8s	»
ENA, Section 1.4, Exercise 1	94.4%	99.1%		9.2s	»
x / (x^2 + 1)	76.9%	100.0%	99.8%	1.6s	»
simple fma test	29.3%	100.0%	100.0%	2.6s	»
ln(1 + x)	39.6%	100.0%	99.7%	2.9s	»
fma_test2	34.2%	99.6%	99.6%	6.1s	»
fma_test1	3.4%	99.4%	21.0%	4.0s	»
The quadratic formula (r2)	51.2%	84.9%	70.4%	13.7s	»
The quadratic formula (r1)	52.0%	84.7%	70.1%	11.7s	»
Rectangular parallelepiped of dimension a×b×c	100.0%	100.0%	100.0%	1.2s	»
Kahan's exp quotient	53.7%	100.0%	53.3%	1.4s	»
Kahan p9 Example	67.7%	99.9%	99.9%	6.8s	»
Expression, p6	94.3%	100.0%	94.0%	4.2s	»
Expression, p14	99.9%	100.0%	99.9%	4.4s	»
Expression 4, p15	100.0%	100.0%	100.0%	2.6s	»
Expression 3, p15	100.0%	100.0%	100.0%	2.3s	»
Expression 2, p15	100.0%	100.0%	100.0%	1.3s	»
Expression 1, p15	99.4%	99.6%	99.6%	5.4s	»
ENA, Section 1.4, Mentioned, A	52.4%	100.0%	100.0%	4.8s	»
ENA, Section 1.4, Exercise 4d	61.9%	99.2%	99.5%	6.7s	»
ENA, Section 1.4, Exercise 4a	52.9%	99.6%	98.7%	19.7s	»
Difference of squares	93.3%	96.8%	100.0%	2.1s	»
Compound Interest	28.1%	98.0%	33.2%	19.8s	»
Complex division, real part	62.1%	83.7%	99.2%	6.3s	»
Complex division, imag part	61.0%	89.1%	99.4%	8.8s	»
Area of a triangle				0.2s	»

Test

Start

Result ?

Target ?

Time

arccos

100.0%

2.9s

Rump's expression from Stadtherr's award speech

9.2%

0.9s

Rosa's TurbineBenchmark

84.2%

99.8%

10.6s

Rosa's FloatVsDoubleBenchmark

70.1%

99.7%

36.7s

Rosa's DopplerBench

73.8%

97.8%

8.7s

Rosa's Benchmark

99.8%

6.7s

Radioactive exchange between two surfaces

85.6%

96.7%

4.0s

NMSE Section 6.1 mentioned, B

78.5%

96.0%

10.0s

NMSE Section 6.1 mentioned, A

73.0%

99.8%

19.5s

Kahan's Unum-Targeted Monster

3.7s

Kahan's Monster

2.4s

Kahan p13 Example 3

100.0%

7.5s

Kahan p13 Example 2

100.0%

13.8s

Kahan p13 Example 1

100.0%

99.9%

7.1s

From Warwick Tucker's Validated Numerics

9.2%

100.0%

1.8s

From Rump in a 1983 paper, rewritten

3.1%

100.0%

2.7s

From Rump in a 1983 paper

18.8%

100.0%

2.7s

ENA, Section 1.4, Mentioned, B

87.8%

99.6%

4.4s

ENA, Section 1.4, Exercise 4b, n=5

87.5%

97.0%

9.1s

ENA, Section 1.4, Exercise 4b, n=2

74.6%

100.0%

4.8s

ENA, Section 1.4, Exercise 1

94.4%

99.1%

9.2s

x / (x^2 + 1)

76.9%

100.0%

99.8%

1.6s

simple fma test

29.3%

100.0%

2.6s

ln(1 + x)

39.6%

100.0%

99.7%

2.9s

fma_test2

34.2%

99.6%

6.1s

fma_test1

3.4%

99.4%

21.0%

4.0s

The quadratic formula (r2)

51.2%

84.9%

70.4%

13.7s

The quadratic formula (r1)

52.0%

84.7%

70.1%

11.7s

Rectangular parallelepiped of dimension a×b×c

100.0%

1.2s

Kahan's exp quotient

53.7%

100.0%

53.3%

1.4s

Kahan p9 Example

67.7%

99.9%

6.8s

Expression, p6

94.3%

100.0%

94.0%

4.2s

Expression, p14

99.9%

100.0%

99.9%

4.4s

Expression 4, p15

100.0%

2.6s

Expression 3, p15

100.0%

2.3s

Expression 2, p15

100.0%

1.3s

Expression 1, p15

99.4%

99.6%

5.4s

ENA, Section 1.4, Mentioned, A

52.4%

100.0%

4.8s

ENA, Section 1.4, Exercise 4d

61.9%

99.2%

99.5%

6.7s

ENA, Section 1.4, Exercise 4a

52.9%

99.6%

98.7%

19.7s

Difference of squares

93.3%

96.8%

100.0%

2.1s

Compound Interest

28.1%

98.0%

33.2%

19.8s

Complex division, real part

62.1%

83.7%

99.2%

6.3s

Complex division, imag part

61.0%

89.1%

99.4%

8.8s

Area of a triangle

0.2s