Average Accuracy: 52.1% → 88.6%
Time: 3.3min
Crashes and Timeouts: 0/19

Output vs Input Accuracy

Each point represents a Herbie run below. Its horizontal position shows initial accuracy, and vertical position shows final accuracy. Points above the line are improved by Herbie.

Accuracy vs Cost

A joint cost-accuracy pareto curve for the Herbie runs below. Accuracy is on the vertical axis, and cost is on the horizontal axis. Down and to the left is better. The initial programs are shown by the red square.
TestStartResult ?Target ?Time
xlohi (overflows)3.1%99.1%14.4s»
x (used to be hard to sample)100.0%100.0%0.5s»
tan-example (used to crash)78.8%99.7%34.1s»
sqrt E (should all be same)54.0%100.0%2.2s»
sqrt D (should all be same)54.0%100.0%2.9s»
sqrt C (should all be same)51.8%100.0%1.7s»
sqrt B (should all be same)51.8%100.0%2.6s»
sqrt A (should all be same)51.8%100.0%2.3s»
rsin B (should all be same)76.6%99.5%22.9s»
rsin A (should all be same)76.6%99.5%19.7s»
mixedcos38.1%67.6%17.2s»
expfmod (used to be hard to sample)7.1%63.0%20.8s»
exp-w (used to crash)71.3%72.8%19.6s»
bug500 (missed optimization)69.6%98.9%99.8%8.1s»
bug366, discussion (missed optimization)49.7%74.2%99.2%2.5s»
bug366 (missed optimization)41.2%99.4%100.0%3.1s»
bug333 (missed optimization)8.1%99.6%100.0%2.8s»
bug329 (missed optimization)100.0%100.0%100.0%0.9s»
bug323 (missed optimization)6.9%10.5%100.0%21.5s»