Herbie results

Average Percentage Accurate: 70.4% → 96.2%

Time: 4.9min

Bad Runs: 0/45

Speedup: 3.7×

Output vs Input Accuracy

Each point represents a Herbie run below. Its horizontal position shows initial accuracy, and vertical position shows final accuracy. Points above the line are improved by Herbie.

Accuracy vs Speed

A joint speed-accuracy pareto curve. Accuracy is on the vertical axis, speed is on the horizontal axis. Up and to the right is better. The initial program is shown by the red square.

Test	Start	Result ?	Target ?	Time
arccos	100.0%	100.0%		4.1s	»
Rump's expression from Stadtherr's award speech	9.2%	9.2%		0.9s	»
Rosa's TurbineBenchmark	85.0%	98.4%		9.8s	»
Rosa's FloatVsDoubleBenchmark	70.2%	99.5%		40.4s	»
Rosa's DopplerBench	73.0%	97.9%		7.2s	»
Rosa's Benchmark	99.8%	99.8%		8.2s	»
Radioactive exchange between two surfaces	85.5%	94.7%		4.0s	»
NMSE Section 6.1 mentioned, B	78.7%	99.1%		7.0s	»
NMSE Section 6.1 mentioned, A	73.3%	99.8%		13.3s	»
Kahan's Unum-Targeted Monster				3.9s	»
Kahan's Monster				2.0s	»
Kahan p13 Example 3	100.0%	100.0%		7.4s	»
Kahan p13 Example 2	100.0%	100.0%		13.5s	»
Kahan p13 Example 1	99.9%	100.0%		7.3s	»
From Warwick Tucker's Validated Numerics	9.2%	100.0%		1.8s	»
From Rump in a 1983 paper, rewritten	3.1%	100.0%		2.4s	»
From Rump in a 1983 paper	18.8%	100.0%		3.0s	»
ENA, Section 1.4, Mentioned, B	87.7%	99.6%		4.4s	»
ENA, Section 1.4, Exercise 4b, n=5	87.9%	99.3%		6.9s	»
ENA, Section 1.4, Exercise 4b, n=2	75.0%	100.0%		4.5s	»
ENA, Section 1.4, Exercise 1	94.5%	99.4%		8.3s	»
x / (x^2 + 1)	77.1%	99.2%	99.9%	1.6s	»
simple fma test	28.4%	100.0%	100.0%	2.3s	»
ln(1 + x)	39.0%	100.0%	99.7%	2.7s	»
fma_test2	34.4%	99.6%	99.6%	5.8s	»
fma_test1	3.4%	99.4%	21.0%	3.2s	»
The quadratic formula (r2)	52.4%	80.5%	70.2%	12.2s	»
The quadratic formula (r1)	52.1%	85.1%	69.9%	10.5s	»
Rectangular parallelepiped of dimension a×b×c	100.0%	100.0%	100.0%	1.0s	»
Kahan's exp quotient	53.7%	100.0%	53.3%	1.6s	»
Kahan p9 Example	68.6%	100.0%	99.9%	8.0s	»
Expression, p6	94.4%	100.0%	94.1%	3.8s	»
Expression, p14	99.9%	100.0%	99.9%	3.5s	»
Expression 4, p15	100.0%	100.0%	100.0%	2.7s	»
Expression 3, p15	100.0%	100.0%	100.0%	2.3s	»
Expression 2, p15	100.0%	100.0%	100.0%	1.6s	»
Expression 1, p15	99.4%	99.6%	99.6%	4.6s	»
ENA, Section 1.4, Mentioned, A	53.5%	100.0%	100.0%	5.1s	»
ENA, Section 1.4, Exercise 4d	61.0%	99.0%	99.6%	5.8s	»
ENA, Section 1.4, Exercise 4a	53.9%	99.5%	98.7%	18.1s	»
Difference of squares	93.4%	96.6%	100.0%	1.9s	»
Compound Interest	27.6%	99.2%	33.6%	21.0s	»
Complex division, real part	61.6%	83.9%	99.5%	6.2s	»
Complex division, imag part	62.1%	89.3%	99.4%	8.5s	»
Area of a triangle				0.2s	»

Test

Start

Result ?

Target ?

Time

arccos

100.0%

4.1s

Rump's expression from Stadtherr's award speech

9.2%

0.9s

Rosa's TurbineBenchmark

85.0%

98.4%

9.8s

Rosa's FloatVsDoubleBenchmark

70.2%

99.5%

40.4s

Rosa's DopplerBench

73.0%

97.9%

7.2s

Rosa's Benchmark

99.8%

8.2s

Radioactive exchange between two surfaces

85.5%

94.7%

4.0s

NMSE Section 6.1 mentioned, B

78.7%

99.1%

7.0s

NMSE Section 6.1 mentioned, A

73.3%

99.8%

13.3s

Kahan's Unum-Targeted Monster

3.9s

Kahan's Monster

2.0s

Kahan p13 Example 3

100.0%

7.4s

Kahan p13 Example 2

100.0%

13.5s

Kahan p13 Example 1

99.9%

100.0%

7.3s

From Warwick Tucker's Validated Numerics

9.2%

100.0%

1.8s

From Rump in a 1983 paper, rewritten

3.1%

100.0%

2.4s

From Rump in a 1983 paper

18.8%

100.0%

3.0s

ENA, Section 1.4, Mentioned, B

87.7%

99.6%

4.4s

ENA, Section 1.4, Exercise 4b, n=5

87.9%

99.3%

6.9s

ENA, Section 1.4, Exercise 4b, n=2

75.0%

100.0%

4.5s

ENA, Section 1.4, Exercise 1

94.5%

99.4%

8.3s

x / (x^2 + 1)

77.1%

99.2%

99.9%

1.6s

simple fma test

28.4%

100.0%

2.3s

ln(1 + x)

39.0%

100.0%

99.7%

2.7s

fma_test2

34.4%

99.6%

5.8s

fma_test1

3.4%

99.4%

21.0%

3.2s

The quadratic formula (r2)

52.4%

80.5%

70.2%

12.2s

The quadratic formula (r1)

52.1%

85.1%

69.9%

10.5s

Rectangular parallelepiped of dimension a×b×c

100.0%

1.0s

Kahan's exp quotient

53.7%

100.0%

53.3%

1.6s

Kahan p9 Example

68.6%

100.0%

99.9%

8.0s

Expression, p6

94.4%

100.0%

94.1%

3.8s

Expression, p14

99.9%

100.0%

99.9%

3.5s

Expression 4, p15

100.0%

2.7s

Expression 3, p15

100.0%

2.3s

Expression 2, p15

100.0%

1.6s

Expression 1, p15

99.4%

99.6%

4.6s

ENA, Section 1.4, Mentioned, A

53.5%

100.0%

5.1s

ENA, Section 1.4, Exercise 4d

61.0%

99.0%

99.6%

5.8s

ENA, Section 1.4, Exercise 4a

53.9%

99.5%

98.7%

18.1s

Difference of squares

93.4%

96.6%

100.0%

1.9s

Compound Interest

27.6%

99.2%

33.6%

21.0s

Complex division, real part

61.6%

83.9%

99.5%

6.2s

Complex division, imag part

62.1%

89.3%

99.4%

8.5s

Area of a triangle

0.2s