Data.Array.Repa.Algorithms.Pixel:doubleRmsOfRGB8 from repa-algorithms-3.4.0.1

Average Error: 37.0 → 25.3

Time: 4.0s

Precision: binary64

Math

\[\sqrt{\frac{\left(x \cdot x + y \cdot y\right) + z \cdot z}{3}}\]

↓

\[\begin{array}{l} \mathbf{if}\;x \le -3.88176526474888586 \cdot 10^{100}:\\ \;\;\;\;\frac{-x}{\sqrt{3}}\\ \mathbf{elif}\;x \le 9.82318124646624427 \cdot 10^{101}:\\ \;\;\;\;\sqrt{\left(x \cdot x + \left(y \cdot y + z \cdot z\right)\right) \cdot 0.333333333333333315}\\ \mathbf{else}:\\ \;\;\;\;x \cdot \sqrt{0.333333333333333315}\\ \end{array}\]

Error

Bits error versus x

Bits error versus y

Bits error versus z

Target

Original	37.0
Target	25.0
Herbie	25.3

\[\begin{array}{l} \mathbf{if}\;z \lt -6.3964793941097758 \cdot 10^{136}:\\ \;\;\;\;\frac{-z}{\sqrt{3}}\\ \mathbf{elif}\;z \lt 7.3202936944041821 \cdot 10^{117}:\\ \;\;\;\;\frac{\sqrt{\left(z \cdot z + x \cdot x\right) + y \cdot y}}{\sqrt{3}}\\ \mathbf{else}:\\ \;\;\;\;\sqrt{0.333333333333333315} \cdot z\\ \end{array}\]

Derivation

1. Split input into 3 regimes

2. if x < -3.88176526474888586e100

   1. Initial program 53.8

      \[\sqrt{\frac{\left(x \cdot x + y \cdot y\right) + z \cdot z}{3}}\]
   2. Using strategy rm

   3. Applied sqrt-div 53.8

      \[\leadsto \color{blue}{\frac{\sqrt{\left(x \cdot x + y \cdot y\right) + z \cdot z}}{\sqrt{3}}}\]

   4. Simplified 53.8

      \[\leadsto \frac{\color{blue}{\sqrt{x \cdot x + \left(y \cdot y + z \cdot z\right)}}}{\sqrt{3}}\]

   5. Taylor expanded around -inf 19.8

      \[\leadsto \frac{\color{blue}{-1 \cdot x}}{\sqrt{3}}\]

   6. Simplified 19.8

      \[\leadsto \frac{\color{blue}{-x}}{\sqrt{3}}\]

   if -3.88176526474888586e100 < x < 9.82318124646624427e101

   1. Initial program 28.5

      \[\sqrt{\frac{\left(x \cdot x + y \cdot y\right) + z \cdot z}{3}}\]

   2. Taylor expanded around 0 28.5

      \[\leadsto \sqrt{\color{blue}{0.333333333333333315 \cdot {x}^{2} + \left(0.333333333333333315 \cdot {y}^{2} + 0.333333333333333315 \cdot {z}^{2}\right)}}\]

   3. Simplified 28.5

      \[\leadsto \sqrt{\color{blue}{\left(x \cdot x + \left(y \cdot y + z \cdot z\right)\right) \cdot 0.333333333333333315}}\]

   if 9.82318124646624427e101 < x

   1. Initial program 54.3

      \[\sqrt{\frac{\left(x \cdot x + y \cdot y\right) + z \cdot z}{3}}\]

   2. Taylor expanded around inf 18.3

      \[\leadsto \color{blue}{x \cdot \sqrt{0.333333333333333315}}\]
3. Recombined 3 regimes into one program.

4. Final simplification 25.3

   \[\leadsto \begin{array}{l} \mathbf{if}\;x \le -3.88176526474888586 \cdot 10^{100}:\\ \;\;\;\;\frac{-x}{\sqrt{3}}\\ \mathbf{elif}\;x \le 9.82318124646624427 \cdot 10^{101}:\\ \;\;\;\;\sqrt{\left(x \cdot x + \left(y \cdot y + z \cdot z\right)\right) \cdot 0.333333333333333315}\\ \mathbf{else}:\\ \;\;\;\;x \cdot \sqrt{0.333333333333333315}\\ \end{array}\]

Reproduce

herbie shell --seed 2020184 
(FPCore (x y z)
  :name "Data.Array.Repa.Algorithms.Pixel:doubleRmsOfRGB8 from repa-algorithms-3.4.0.1"
  :precision binary64

  :herbie-target
  (if (< z -6.396479394109776e+136) (/ (neg z) (sqrt 3.0)) (if (< z 7.320293694404182e+117) (/ (sqrt (+ (+ (* z z) (* x x)) (* y y))) (sqrt 3.0)) (* (sqrt 0.3333333333333333) z)))

  (sqrt (/ (+ (+ (* x x) (* y y)) (* z z)) 3.0)))