Herbie results

Time: 20.9min

Passed: 7/17

Crashes: 4

Tests: 19

Bits: 251/315

Output vs Input Accuracy

Each point represents a Herbie run below. Its horizontal position shows initial accuracy, and vertical position shows final accuracy. Points above the line are improved by Herbie.

Accuracy vs Cost

A joint cost-accuracy pareto curve for the Herbie runs below. Accuracy is on the vertical axis, and cost is on the vertical axis. Down and to the left is better. The initial programs are shown by the red square.

Test	Start	Result ?	Target ?	Time
xlohi (overflows)	62.0	52.0		1.7min	»
x (used to be hard to sample)	0	0		5.3s	»
tan-example (used to crash)	13.6	0.2		2.3min	»
sqrt E (should all be same)				18.5s	»
sqrt D (should all be same)	30.1	0.0		33.2s	»
sqrt C (should all be same)	30.1	0.0		31.0s	»
sqrt B (should all be same)				17.6s	»
sqrt A (should all be same)				18.7s	»
rsin B (should all be same)	15.2	0.3		2.0min	»
rsin A (should all be same)	15.2	0.3		2.3min	»
mixedcos				2.5min	»
expfmod (used to be hard to sample)				2.5min	»
exp-w (used to crash)	0.3	0.3		2.0min	»
bug500 (missed optimization)	19.5	0.8	0.1	1.5min	»
bug366, discussion (missed optimization)	31.4	0.7	0.5	15.4s	»
bug366 (missed optimization)	38.5	8.8	0	28.4s	»
bug333 (missed optimization)	58.7	0.3	0.0	17.9s	»
bug329 (missed optimization)	0.0	0.0	0	12.3s	»
bug323 (missed optimization)				49.3s	»