Herbie results

Average Percentage Accurate: 70.6% → 96.3%

Time: 8.0min

Bad Runs: 0/45

Speedup: 3.6×

Output vs Input Accuracy

Each point represents a Herbie run below. Its horizontal position shows initial accuracy, and vertical position shows final accuracy. Points above the line are improved by Herbie.

Accuracy vs Speed

A joint speed-accuracy pareto curve. Accuracy is on the vertical axis, speed is on the horizontal axis. Up and to the right is better. The initial program is shown by the red square.

Test	Start	Result ?	Target ?	Time
arccos	100.0%	100.0%		5.7s	»
Rump's expression from Stadtherr's award speech	9.2%	9.2%		2.2s	»
Rosa's TurbineBenchmark	84.5%	99.8%		20.2s	»
Rosa's FloatVsDoubleBenchmark	70.9%	92.8%		57.3s	»
Rosa's DopplerBench	71.5%	97.9%		15.1s	»
Rosa's Benchmark	99.8%	99.8%		7.3s	»
Radioactive exchange between two surfaces	86.0%	96.8%		5.9s	»
NMSE Section 6.1 mentioned, B	78.8%	99.7%		14.0s	»
NMSE Section 6.1 mentioned, A	64.2%	99.9%		21.5s	»
Kahan's Unum-Targeted Monster				4.0s	»
Kahan's Monster				3.4s	»
Kahan p13 Example 3	100.0%	100.0%		13.4s	»
Kahan p13 Example 2	100.0%	100.0%		12.9s	»
Kahan p13 Example 1	99.9%	100.0%		14.1s	»
From Warwick Tucker's Validated Numerics	9.2%	100.0%		1.5s	»
From Rump in a 1983 paper, rewritten	3.1%	100.0%		3.8s	»
From Rump in a 1983 paper	18.8%	100.0%		4.0s	»
ENA, Section 1.4, Mentioned, B	87.7%	99.6%		7.4s	»
ENA, Section 1.4, Exercise 4b, n=5	92.9%	98.8%		8.4s	»
ENA, Section 1.4, Exercise 4b, n=2	77.8%	100.0%		7.3s	»
ENA, Section 1.4, Exercise 1	94.5%	98.8%		23.4s	»
x / (x^2 + 1)	75.8%	100.0%	99.9%	3.7s	»
simple fma test	29.2%	100.0%	100.0%	3.8s	»
ln(1 + x)	39.2%	100.0%	99.7%	3.4s	»
fma_test2	34.1%	99.6%	99.6%	7.7s	»
fma_test1	3.4%	99.5%	21.0%	4.8s	»
The quadratic formula (r2)	52.1%	83.7%	70.3%	16.5s	»
The quadratic formula (r1)	52.2%	85.3%	70.5%	17.4s	»
Rectangular parallelepiped of dimension a×b×c	100.0%	100.0%	100.0%	1.0s	»
Kahan's exp quotient	53.4%	100.0%	52.8%	2.9s	»
Kahan p9 Example	68.0%	99.9%	99.9%	19.7s	»
Expression, p6	94.3%	100.0%	94.0%	9.5s	»
Expression, p14	99.9%	100.0%	99.9%	32.0s	»
Expression 4, p15	100.0%	100.0%	100.0%	6.1s	»
Expression 3, p15	100.0%	100.0%	100.0%	4.2s	»
Expression 2, p15	100.0%	100.0%	100.0%	3.8s	»
Expression 1, p15	99.4%	99.6%	99.6%	11.5s	»
ENA, Section 1.4, Mentioned, A	54.0%	100.0%	100.0%	2.7s	»
ENA, Section 1.4, Exercise 4d	67.9%	98.9%	99.5%	14.8s	»
ENA, Section 1.4, Exercise 4a	61.3%	99.8%	99.8%	9.6s	»
Difference of squares	94.1%	97.1%	100.0%	2.9s	»
Compound Interest	29.9%	99.3%	33.1%	19.6s	»
Complex division, real part	61.1%	85.0%	99.3%	12.5s	»
Complex division, imag part	61.2%	92.3%	99.2%	12.6s	»
Area of a triangle				2.2s	»

Test

Start

Result ?

Target ?

Time

arccos

100.0%

5.7s

Rump's expression from Stadtherr's award speech

9.2%

2.2s

Rosa's TurbineBenchmark

84.5%

99.8%

20.2s

Rosa's FloatVsDoubleBenchmark

70.9%

92.8%

57.3s

Rosa's DopplerBench

71.5%

97.9%

15.1s

Rosa's Benchmark

99.8%

7.3s

Radioactive exchange between two surfaces

86.0%

96.8%

5.9s

NMSE Section 6.1 mentioned, B

78.8%

99.7%

14.0s

NMSE Section 6.1 mentioned, A

64.2%

99.9%

21.5s

Kahan's Unum-Targeted Monster

4.0s

Kahan's Monster

3.4s

Kahan p13 Example 3

100.0%

13.4s

Kahan p13 Example 2

100.0%

12.9s

Kahan p13 Example 1

99.9%

100.0%

14.1s

From Warwick Tucker's Validated Numerics

9.2%

100.0%

1.5s

From Rump in a 1983 paper, rewritten

3.1%

100.0%

3.8s

From Rump in a 1983 paper

18.8%

100.0%

4.0s

ENA, Section 1.4, Mentioned, B

87.7%

99.6%

7.4s

ENA, Section 1.4, Exercise 4b, n=5

92.9%

98.8%

8.4s

ENA, Section 1.4, Exercise 4b, n=2

77.8%

100.0%

7.3s

ENA, Section 1.4, Exercise 1

94.5%

98.8%

23.4s

x / (x^2 + 1)

75.8%

100.0%

99.9%

3.7s

simple fma test

29.2%

100.0%

3.8s

ln(1 + x)

39.2%

100.0%

99.7%

3.4s

fma_test2

34.1%

99.6%

7.7s

fma_test1

3.4%

99.5%

21.0%

4.8s

The quadratic formula (r2)

52.1%

83.7%

70.3%

16.5s

The quadratic formula (r1)

52.2%

85.3%

70.5%

17.4s

Rectangular parallelepiped of dimension a×b×c

100.0%

1.0s

Kahan's exp quotient

53.4%

100.0%

52.8%

2.9s

Kahan p9 Example

68.0%

99.9%

19.7s

Expression, p6

94.3%

100.0%

94.0%

9.5s

Expression, p14

99.9%

100.0%

99.9%

32.0s

Expression 4, p15

100.0%

6.1s

Expression 3, p15

100.0%

4.2s

Expression 2, p15

100.0%

3.8s

Expression 1, p15

99.4%

99.6%

11.5s

ENA, Section 1.4, Mentioned, A

54.0%

100.0%

2.7s

ENA, Section 1.4, Exercise 4d

67.9%

98.9%

99.5%

14.8s

ENA, Section 1.4, Exercise 4a

61.3%

99.8%

9.6s

Difference of squares

94.1%

97.1%

100.0%

2.9s

Compound Interest

29.9%

99.3%

33.1%

19.6s

Complex division, real part

61.1%

85.0%

99.3%

12.5s

Complex division, imag part

61.2%

92.3%

99.2%

12.6s

Area of a triangle

2.2s