Physics Results

Average Percentage Accurate: 76.9% → 94.7%
Time: 11.6min
Bad Runs: 0/31
Speedup: 2.8×

Output vs Input Accuracy

Each point represents a Herbie run below. Its horizontal position shows initial accuracy, and vertical position shows final accuracy. Points above the line are improved by Herbie.

Accuracy vs Speed

A joint speed-accuracy pareto curve. Accuracy is on the vertical axis, speed is on the horizontal axis. Up and to the right is better. The initial program is shown by the red square.
TestStartResult ?Target ?Time
VandenBroeck and Keller, Equation (6)76.6%99.2%16.6s»
VandenBroeck and Keller, Equation (24)99.7%99.8%11.0s»
VandenBroeck and Keller, Equation (23)77.2%99.7%32.5s»
VandenBroeck and Keller, Equation (20)7.0%98.3%33.0s»
Toniolo and Linder, Equation (7)34.2%89.3%35.8s»
Toniolo and Linder, Equation (3b), real94.1%99.6%36.0s»
Toniolo and Linder, Equation (3a)98.3%100.0%22.0s»
Toniolo and Linder, Equation (2)84.6%98.3%20.8s»
Toniolo and Linder, Equation (13)49.0%66.2%36.1s»
Toniolo and Linder, Equation (10-)35.3%99.0%25.2s»
Toniolo and Linder, Equation (10+)55.9%92.4%38.1s»
Migdal et al, Equation (64)99.5%99.6%16.3s»
Migdal et al, Equation (51)99.5%99.6%16.1s»
Maksimov and Kolovsky, Equation (4)86.7%99.8%18.7s»
Maksimov and Kolovsky, Equation (32)76.5%96.7%18.6s»
Maksimov and Kolovsky, Equation (3)73.9%85.6%23.8s»
Henrywood and Agarwal, Equation (9a)81.0%89.1%27.7s»
Henrywood and Agarwal, Equation (3)74.1%90.6%13.2s»
Henrywood and Agarwal, Equation (13)24.8%59.8%38.9s»
Henrywood and Agarwal, Equation (12)66.3%81.9%51.6s»
Given's Rotation SVD example, simplified75.5%99.8%11.5s»
Falkner and Boettcher, Equation (22+)98.5%100.0%5.6s»
Falkner and Boettcher, Equation (20:1,3)99.3%99.6%11.9s»
Falkner and Boettcher, Appendix B, 2100.0%100.0%7.1s»
Falkner and Boettcher, Appendix B, 199.2%99.2%21.2s»
Falkner and Boettcher, Appendix A90.3%97.5%13.7s»
Bulmash initializePoisson100.0%99.9%58.3s»
Bouland and Aaronson, Equation (26)99.9%100.0%3.7s»
Bouland and Aaronson, Equation (25)73.9%98.4%10.2s»
Bouland and Aaronson, Equation (24)73.7%98.2%11.1s»
Given's Rotation SVD example79.5%99.9%79.5%11.7s»