Herbie results

Average Percentage Accurate: 81.0% → 98.4%

Time: 11.4min

Bad Runs: 0/45

Speedup: 4.3×

Output vs Input Accuracy

Each point represents a Herbie run below. Its horizontal position shows initial accuracy, and vertical position shows final accuracy. Points above the line are improved by Herbie.

Accuracy vs Speed

A joint speed-accuracy pareto curve. Accuracy is on the vertical axis, speed is on the horizontal axis. Up and to the right is better. The initial program is shown by the red square.

Test	Start	Result ?	Target ?	Time
arccos	100.0%	98.9%		11.8s	»
Rump's expression from Stadtherr's award speech				0.0s	»
Rosa's TurbineBenchmark	82.3%	99.9%		55.8s	»
Rosa's FloatVsDoubleBenchmark	99.2%	99.6%		57.8s	»
Rosa's DopplerBench	77.1%	97.6%		27.7s	»
Rosa's Benchmark	99.8%	99.8%		8.9s	»
Radioactive exchange between two surfaces	86.1%	99.8%		10.1s	»
NMSE Section 6.1 mentioned, B				2.0s	»
NMSE Section 6.1 mentioned, A				2.8s	»
Kahan's Unum-Targeted Monster				5.4s	»
Kahan's Monster				3.9s	»
Kahan p13 Example 3	100.0%	100.0%		35.6s	»
Kahan p13 Example 2	99.9%	99.9%		37.9s	»
Kahan p13 Example 1	100.0%	100.0%		26.3s	»
From Warwick Tucker's Validated Numerics				0.1s	»
From Rump in a 1983 paper, rewritten				0.2s	»
From Rump in a 1983 paper				0.1s	»
ENA, Section 1.4, Mentioned, B	87.7%	99.6%		9.0s	»
ENA, Section 1.4, Exercise 4b, n=5	92.8%	99.3%		12.3s	»
ENA, Section 1.4, Exercise 4b, n=2	78.0%	100.0%		6.6s	»
ENA, Section 1.4, Exercise 1	94.5%	99.2%		25.3s	»
x / (x^2 + 1)	100.0%	100.0%	99.7%	15.0s	»
simple fma test	29.2%	100.0%	100.0%	5.8s	»
ln(1 + x)	38.4%	100.0%	99.6%	5.2s	»
fma_test2	34.0%	99.6%	99.6%	9.4s	»
fma_test1	3.4%	99.7%	21.0%	6.5s	»
The quadratic formula (r2)	57.4%	86.6%	79.2%	26.0s	»
The quadratic formula (r1)	58.0%	86.4%	79.1%	33.0s	»
Rectangular parallelepiped of dimension a×b×c				0.0s	»
Kahan's exp quotient	10.8%	100.0%	9.8%	11.3s	»
Kahan p9 Example	68.4%	91.6%	99.9%	28.3s	»
Expression, p6	94.3%	100.0%	94.0%	10.6s	»
Expression, p14	99.9%	100.0%	99.9%	32.6s	»
Expression 4, p15	100.0%	100.0%	100.0%	4.5s	»
Expression 3, p15	100.0%	100.0%	100.0%	6.6s	»
Expression 2, p15	100.0%	100.0%	100.0%	5.8s	»
Expression 1, p15	99.4%	99.6%	99.6%	16.0s	»
ENA, Section 1.4, Mentioned, A	54.2%	100.0%	100.0%	3.9s	»
ENA, Section 1.4, Exercise 4d	68.9%	99.5%	99.5%	14.4s	»
ENA, Section 1.4, Exercise 4a	62.2%	99.8%	99.8%	12.4s	»
Difference of squares	93.7%	96.2%	100.0%	7.2s	»
Compound Interest	33.9%	99.6%	23.8%	38.3s	»
Complex division, real part	70.1%	88.8%	99.4%	20.7s	»
Complex division, imag part	70.1%	89.2%	99.2%	25.7s	»
Area of a triangle				2.6s	»

Test

Start

Result ?

Target ?

Time

arccos

100.0%

98.9%

11.8s

Rump's expression from Stadtherr's award speech

0.0s

Rosa's TurbineBenchmark

82.3%

99.9%

55.8s

Rosa's FloatVsDoubleBenchmark

99.2%

99.6%

57.8s

Rosa's DopplerBench

77.1%

97.6%

27.7s

Rosa's Benchmark

99.8%

8.9s

Radioactive exchange between two surfaces

86.1%

99.8%

10.1s

NMSE Section 6.1 mentioned, B

2.0s

NMSE Section 6.1 mentioned, A

2.8s

Kahan's Unum-Targeted Monster

5.4s

Kahan's Monster

3.9s

Kahan p13 Example 3

100.0%

35.6s

Kahan p13 Example 2

99.9%

37.9s

Kahan p13 Example 1

100.0%

26.3s

From Warwick Tucker's Validated Numerics

0.1s

From Rump in a 1983 paper, rewritten

0.2s

From Rump in a 1983 paper

0.1s

ENA, Section 1.4, Mentioned, B

87.7%

99.6%

9.0s

ENA, Section 1.4, Exercise 4b, n=5

92.8%

99.3%

12.3s

ENA, Section 1.4, Exercise 4b, n=2

78.0%

100.0%

6.6s

ENA, Section 1.4, Exercise 1

94.5%

99.2%

25.3s

x / (x^2 + 1)

100.0%

99.7%

15.0s

simple fma test

29.2%

100.0%

5.8s

ln(1 + x)

38.4%

100.0%

99.6%

5.2s

fma_test2

34.0%

99.6%

9.4s

fma_test1

3.4%

99.7%

21.0%

6.5s

The quadratic formula (r2)

57.4%

86.6%

79.2%

26.0s

The quadratic formula (r1)

58.0%

86.4%

79.1%

33.0s

Rectangular parallelepiped of dimension a×b×c

0.0s

Kahan's exp quotient

10.8%

100.0%

9.8%

11.3s

Kahan p9 Example

68.4%

91.6%

99.9%

28.3s

Expression, p6

94.3%

100.0%

94.0%

10.6s

Expression, p14

99.9%

100.0%

99.9%

32.6s

Expression 4, p15

100.0%

4.5s

Expression 3, p15

100.0%

6.6s

Expression 2, p15

100.0%

5.8s

Expression 1, p15

99.4%

99.6%

16.0s

ENA, Section 1.4, Mentioned, A

54.2%

100.0%

3.9s

ENA, Section 1.4, Exercise 4d

68.9%

99.5%

14.4s

ENA, Section 1.4, Exercise 4a

62.2%

99.8%

12.4s

Difference of squares

93.7%

96.2%

100.0%

7.2s

Compound Interest

33.9%

99.6%

23.8%

38.3s

Complex division, real part

70.1%

88.8%

99.4%

20.7s

Complex division, imag part

70.1%

89.2%

99.2%

25.7s

Area of a triangle

2.6s