Logistic function from Lakshay Garg

Percentage Accurate: 53.6% → 99.4%
Time: 7.5s
Alternatives: 10
Speedup: 4.7×

Specification

?
\[\begin{array}{l} \\ \frac{2}{1 + e^{-2 \cdot x}} - 1 \end{array} \]
(FPCore (x y) :precision binary64 (- (/ 2.0 (+ 1.0 (exp (* -2.0 x)))) 1.0))
double code(double x, double y) {
	return (2.0 / (1.0 + exp((-2.0 * x)))) - 1.0;
}
real(8) function code(x, y)
    real(8), intent (in) :: x
    real(8), intent (in) :: y
    code = (2.0d0 / (1.0d0 + exp(((-2.0d0) * x)))) - 1.0d0
end function
public static double code(double x, double y) {
	return (2.0 / (1.0 + Math.exp((-2.0 * x)))) - 1.0;
}
def code(x, y):
	return (2.0 / (1.0 + math.exp((-2.0 * x)))) - 1.0
function code(x, y)
	return Float64(Float64(2.0 / Float64(1.0 + exp(Float64(-2.0 * x)))) - 1.0)
end
function tmp = code(x, y)
	tmp = (2.0 / (1.0 + exp((-2.0 * x)))) - 1.0;
end
code[x_, y_] := N[(N[(2.0 / N[(1.0 + N[Exp[N[(-2.0 * x), $MachinePrecision]], $MachinePrecision]), $MachinePrecision]), $MachinePrecision] - 1.0), $MachinePrecision]
\begin{array}{l}

\\
\frac{2}{1 + e^{-2 \cdot x}} - 1
\end{array}

Sampling outcomes in binary64 precision:

Local Percentage Accuracy vs ?

The average percentage accuracy by input value. Horizontal axis shows value of an input variable; the variable is choosen in the title. Vertical axis is accuracy; higher is better. Red represent the original program, while blue represents Herbie's suggestion. These can be toggled with buttons below the plot. The line is an average while dots represent individual samples.

Accuracy vs Speed?

Herbie found 10 alternatives:

AlternativeAccuracySpeedup
The accuracy (vertical axis) and speed (horizontal axis) of each alternatives. Up and to the right is better. The red square shows the initial program, and each blue circle shows an alternative.The line shows the best available speed-accuracy tradeoffs.

Initial Program: 53.6% accurate, 1.0× speedup?

\[\begin{array}{l} \\ \frac{2}{1 + e^{-2 \cdot x}} - 1 \end{array} \]
(FPCore (x y) :precision binary64 (- (/ 2.0 (+ 1.0 (exp (* -2.0 x)))) 1.0))
double code(double x, double y) {
	return (2.0 / (1.0 + exp((-2.0 * x)))) - 1.0;
}
real(8) function code(x, y)
    real(8), intent (in) :: x
    real(8), intent (in) :: y
    code = (2.0d0 / (1.0d0 + exp(((-2.0d0) * x)))) - 1.0d0
end function
public static double code(double x, double y) {
	return (2.0 / (1.0 + Math.exp((-2.0 * x)))) - 1.0;
}
def code(x, y):
	return (2.0 / (1.0 + math.exp((-2.0 * x)))) - 1.0
function code(x, y)
	return Float64(Float64(2.0 / Float64(1.0 + exp(Float64(-2.0 * x)))) - 1.0)
end
function tmp = code(x, y)
	tmp = (2.0 / (1.0 + exp((-2.0 * x)))) - 1.0;
end
code[x_, y_] := N[(N[(2.0 / N[(1.0 + N[Exp[N[(-2.0 * x), $MachinePrecision]], $MachinePrecision]), $MachinePrecision]), $MachinePrecision] - 1.0), $MachinePrecision]
\begin{array}{l}

\\
\frac{2}{1 + e^{-2 \cdot x}} - 1
\end{array}

Alternative 1: 99.4% accurate, 0.3× speedup?

\[\begin{array}{l} \\ \begin{array}{l} \mathbf{if}\;x \cdot -2 \leq -0.5:\\ \;\;\;\;\mathsf{expm1}\left(\log 2 - \mathsf{log1p}\left(e^{x \cdot -2}\right)\right)\\ \mathbf{elif}\;x \cdot -2 \leq 5 \cdot 10^{-5}:\\ \;\;\;\;\mathsf{fma}\left(\mathsf{fma}\left(x \cdot x, 0.13333333333333333, -0.3333333333333333\right) \cdot \left(x \cdot x\right), x, x\right)\\ \mathbf{else}:\\ \;\;\;\;\frac{2}{\left(\left(-1.3333333333333333 \cdot x\right) \cdot x\right) \cdot x} - 1\\ \end{array} \end{array} \]
(FPCore (x y)
 :precision binary64
 (if (<= (* x -2.0) -0.5)
   (expm1 (- (log 2.0) (log1p (exp (* x -2.0)))))
   (if (<= (* x -2.0) 5e-5)
     (fma
      (* (fma (* x x) 0.13333333333333333 -0.3333333333333333) (* x x))
      x
      x)
     (- (/ 2.0 (* (* (* -1.3333333333333333 x) x) x)) 1.0))))
double code(double x, double y) {
	double tmp;
	if ((x * -2.0) <= -0.5) {
		tmp = expm1((log(2.0) - log1p(exp((x * -2.0)))));
	} else if ((x * -2.0) <= 5e-5) {
		tmp = fma((fma((x * x), 0.13333333333333333, -0.3333333333333333) * (x * x)), x, x);
	} else {
		tmp = (2.0 / (((-1.3333333333333333 * x) * x) * x)) - 1.0;
	}
	return tmp;
}
function code(x, y)
	tmp = 0.0
	if (Float64(x * -2.0) <= -0.5)
		tmp = expm1(Float64(log(2.0) - log1p(exp(Float64(x * -2.0)))));
	elseif (Float64(x * -2.0) <= 5e-5)
		tmp = fma(Float64(fma(Float64(x * x), 0.13333333333333333, -0.3333333333333333) * Float64(x * x)), x, x);
	else
		tmp = Float64(Float64(2.0 / Float64(Float64(Float64(-1.3333333333333333 * x) * x) * x)) - 1.0);
	end
	return tmp
end
code[x_, y_] := If[LessEqual[N[(x * -2.0), $MachinePrecision], -0.5], N[(Exp[N[(N[Log[2.0], $MachinePrecision] - N[Log[1 + N[Exp[N[(x * -2.0), $MachinePrecision]], $MachinePrecision]], $MachinePrecision]), $MachinePrecision]] - 1), $MachinePrecision], If[LessEqual[N[(x * -2.0), $MachinePrecision], 5e-5], N[(N[(N[(N[(x * x), $MachinePrecision] * 0.13333333333333333 + -0.3333333333333333), $MachinePrecision] * N[(x * x), $MachinePrecision]), $MachinePrecision] * x + x), $MachinePrecision], N[(N[(2.0 / N[(N[(N[(-1.3333333333333333 * x), $MachinePrecision] * x), $MachinePrecision] * x), $MachinePrecision]), $MachinePrecision] - 1.0), $MachinePrecision]]]
\begin{array}{l}

\\
\begin{array}{l}
\mathbf{if}\;x \cdot -2 \leq -0.5:\\
\;\;\;\;\mathsf{expm1}\left(\log 2 - \mathsf{log1p}\left(e^{x \cdot -2}\right)\right)\\

\mathbf{elif}\;x \cdot -2 \leq 5 \cdot 10^{-5}:\\
\;\;\;\;\mathsf{fma}\left(\mathsf{fma}\left(x \cdot x, 0.13333333333333333, -0.3333333333333333\right) \cdot \left(x \cdot x\right), x, x\right)\\

\mathbf{else}:\\
\;\;\;\;\frac{2}{\left(\left(-1.3333333333333333 \cdot x\right) \cdot x\right) \cdot x} - 1\\


\end{array}
\end{array}
Derivation
  1. Split input into 3 regimes
  2. if (*.f64 #s(literal -2 binary64) x) < -0.5

    1. Initial program 99.9%

      \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
    2. Add Preprocessing
    3. Step-by-step derivation
      1. lift--.f64N/A

        \[\leadsto \color{blue}{\frac{2}{1 + e^{-2 \cdot x}} - 1} \]
      2. lift-/.f64N/A

        \[\leadsto \color{blue}{\frac{2}{1 + e^{-2 \cdot x}}} - 1 \]
      3. clear-numN/A

        \[\leadsto \color{blue}{\frac{1}{\frac{1 + e^{-2 \cdot x}}{2}}} - 1 \]
      4. inv-powN/A

        \[\leadsto \color{blue}{{\left(\frac{1 + e^{-2 \cdot x}}{2}\right)}^{-1}} - 1 \]
      5. metadata-evalN/A

        \[\leadsto {\left(\frac{1 + e^{-2 \cdot x}}{2}\right)}^{\color{blue}{\left(\mathsf{neg}\left(1\right)\right)}} - 1 \]
      6. pow-to-expN/A

        \[\leadsto \color{blue}{e^{\log \left(\frac{1 + e^{-2 \cdot x}}{2}\right) \cdot \left(\mathsf{neg}\left(1\right)\right)}} - 1 \]
      7. lower-expm1.f64N/A

        \[\leadsto \color{blue}{\mathsf{expm1}\left(\log \left(\frac{1 + e^{-2 \cdot x}}{2}\right) \cdot \left(\mathsf{neg}\left(1\right)\right)\right)} \]
      8. lower-*.f64N/A

        \[\leadsto \mathsf{expm1}\left(\color{blue}{\log \left(\frac{1 + e^{-2 \cdot x}}{2}\right) \cdot \left(\mathsf{neg}\left(1\right)\right)}\right) \]
      9. log-divN/A

        \[\leadsto \mathsf{expm1}\left(\color{blue}{\left(\log \left(1 + e^{-2 \cdot x}\right) - \log 2\right)} \cdot \left(\mathsf{neg}\left(1\right)\right)\right) \]
      10. lower--.f64N/A

        \[\leadsto \mathsf{expm1}\left(\color{blue}{\left(\log \left(1 + e^{-2 \cdot x}\right) - \log 2\right)} \cdot \left(\mathsf{neg}\left(1\right)\right)\right) \]
      11. lift-+.f64N/A

        \[\leadsto \mathsf{expm1}\left(\left(\log \color{blue}{\left(1 + e^{-2 \cdot x}\right)} - \log 2\right) \cdot \left(\mathsf{neg}\left(1\right)\right)\right) \]
      12. lower-log1p.f64N/A

        \[\leadsto \mathsf{expm1}\left(\left(\color{blue}{\mathsf{log1p}\left(e^{-2 \cdot x}\right)} - \log 2\right) \cdot \left(\mathsf{neg}\left(1\right)\right)\right) \]
      13. lift-exp.f64N/A

        \[\leadsto \mathsf{expm1}\left(\left(\mathsf{log1p}\left(\color{blue}{e^{-2 \cdot x}}\right) - \log 2\right) \cdot \left(\mathsf{neg}\left(1\right)\right)\right) \]
      14. lift-*.f64N/A

        \[\leadsto \mathsf{expm1}\left(\left(\mathsf{log1p}\left(e^{\color{blue}{-2 \cdot x}}\right) - \log 2\right) \cdot \left(\mathsf{neg}\left(1\right)\right)\right) \]
      15. *-commutativeN/A

        \[\leadsto \mathsf{expm1}\left(\left(\mathsf{log1p}\left(e^{\color{blue}{x \cdot -2}}\right) - \log 2\right) \cdot \left(\mathsf{neg}\left(1\right)\right)\right) \]
      16. exp-prodN/A

        \[\leadsto \mathsf{expm1}\left(\left(\mathsf{log1p}\left(\color{blue}{{\left(e^{x}\right)}^{-2}}\right) - \log 2\right) \cdot \left(\mathsf{neg}\left(1\right)\right)\right) \]
      17. lower-pow.f64N/A

        \[\leadsto \mathsf{expm1}\left(\left(\mathsf{log1p}\left(\color{blue}{{\left(e^{x}\right)}^{-2}}\right) - \log 2\right) \cdot \left(\mathsf{neg}\left(1\right)\right)\right) \]
      18. lower-exp.f64N/A

        \[\leadsto \mathsf{expm1}\left(\left(\mathsf{log1p}\left({\color{blue}{\left(e^{x}\right)}}^{-2}\right) - \log 2\right) \cdot \left(\mathsf{neg}\left(1\right)\right)\right) \]
      19. lower-log.f64N/A

        \[\leadsto \mathsf{expm1}\left(\left(\mathsf{log1p}\left({\left(e^{x}\right)}^{-2}\right) - \color{blue}{\log 2}\right) \cdot \left(\mathsf{neg}\left(1\right)\right)\right) \]
      20. metadata-eval100.0

        \[\leadsto \mathsf{expm1}\left(\left(\mathsf{log1p}\left({\left(e^{x}\right)}^{-2}\right) - \log 2\right) \cdot \color{blue}{-1}\right) \]
    4. Applied rewrites100.0%

      \[\leadsto \color{blue}{\mathsf{expm1}\left(\left(\mathsf{log1p}\left({\left(e^{x}\right)}^{-2}\right) - \log 2\right) \cdot -1\right)} \]
    5. Step-by-step derivation
      1. lift-pow.f64N/A

        \[\leadsto \mathsf{expm1}\left(\left(\mathsf{log1p}\left(\color{blue}{{\left(e^{x}\right)}^{-2}}\right) - \log 2\right) \cdot -1\right) \]
      2. lift-exp.f64N/A

        \[\leadsto \mathsf{expm1}\left(\left(\mathsf{log1p}\left({\color{blue}{\left(e^{x}\right)}}^{-2}\right) - \log 2\right) \cdot -1\right) \]
      3. pow-expN/A

        \[\leadsto \mathsf{expm1}\left(\left(\mathsf{log1p}\left(\color{blue}{e^{x \cdot -2}}\right) - \log 2\right) \cdot -1\right) \]
      4. *-commutativeN/A

        \[\leadsto \mathsf{expm1}\left(\left(\mathsf{log1p}\left(e^{\color{blue}{-2 \cdot x}}\right) - \log 2\right) \cdot -1\right) \]
      5. lower-exp.f64N/A

        \[\leadsto \mathsf{expm1}\left(\left(\mathsf{log1p}\left(\color{blue}{e^{-2 \cdot x}}\right) - \log 2\right) \cdot -1\right) \]
      6. lower-*.f64100.0

        \[\leadsto \mathsf{expm1}\left(\left(\mathsf{log1p}\left(e^{\color{blue}{-2 \cdot x}}\right) - \log 2\right) \cdot -1\right) \]
    6. Applied rewrites100.0%

      \[\leadsto \mathsf{expm1}\left(\left(\mathsf{log1p}\left(\color{blue}{e^{-2 \cdot x}}\right) - \log 2\right) \cdot -1\right) \]

    if -0.5 < (*.f64 #s(literal -2 binary64) x) < 5.00000000000000024e-5

    1. Initial program 9.0%

      \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
    2. Add Preprocessing
    3. Taylor expanded in x around 0

      \[\leadsto \color{blue}{1} - 1 \]
    4. Step-by-step derivation
      1. Applied rewrites5.6%

        \[\leadsto \color{blue}{1} - 1 \]
      2. Taylor expanded in x around 0

        \[\leadsto \color{blue}{x \cdot \left(1 + {x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)\right)} \]
      3. Step-by-step derivation
        1. +-commutativeN/A

          \[\leadsto x \cdot \color{blue}{\left({x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + 1\right)} \]
        2. distribute-lft-inN/A

          \[\leadsto \color{blue}{x \cdot \left({x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)\right) + x \cdot 1} \]
        3. associate-*r*N/A

          \[\leadsto \color{blue}{\left(x \cdot {x}^{2}\right) \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)} + x \cdot 1 \]
        4. unpow2N/A

          \[\leadsto \left(x \cdot \color{blue}{\left(x \cdot x\right)}\right) \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + x \cdot 1 \]
        5. cube-multN/A

          \[\leadsto \color{blue}{{x}^{3}} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + x \cdot 1 \]
        6. *-rgt-identityN/A

          \[\leadsto {x}^{3} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + \color{blue}{x} \]
        7. lower-fma.f64N/A

          \[\leadsto \color{blue}{\mathsf{fma}\left({x}^{3}, \frac{2}{15} \cdot {x}^{2} - \frac{1}{3}, x\right)} \]
        8. lower-pow.f64N/A

          \[\leadsto \mathsf{fma}\left(\color{blue}{{x}^{3}}, \frac{2}{15} \cdot {x}^{2} - \frac{1}{3}, x\right) \]
        9. sub-negN/A

          \[\leadsto \mathsf{fma}\left({x}^{3}, \color{blue}{\frac{2}{15} \cdot {x}^{2} + \left(\mathsf{neg}\left(\frac{1}{3}\right)\right)}, x\right) \]
        10. metadata-evalN/A

          \[\leadsto \mathsf{fma}\left({x}^{3}, \frac{2}{15} \cdot {x}^{2} + \color{blue}{\frac{-1}{3}}, x\right) \]
        11. lower-fma.f64N/A

          \[\leadsto \mathsf{fma}\left({x}^{3}, \color{blue}{\mathsf{fma}\left(\frac{2}{15}, {x}^{2}, \frac{-1}{3}\right)}, x\right) \]
        12. unpow2N/A

          \[\leadsto \mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(\frac{2}{15}, \color{blue}{x \cdot x}, \frac{-1}{3}\right), x\right) \]
        13. lower-*.f64100.0

          \[\leadsto \mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(0.13333333333333333, \color{blue}{x \cdot x}, -0.3333333333333333\right), x\right) \]
      4. Applied rewrites100.0%

        \[\leadsto \color{blue}{\mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(0.13333333333333333, x \cdot x, -0.3333333333333333\right), x\right)} \]
      5. Step-by-step derivation
        1. Applied rewrites100.0%

          \[\leadsto \mathsf{fma}\left(\mathsf{fma}\left(x \cdot x, 0.13333333333333333, -0.3333333333333333\right) \cdot \left(x \cdot x\right), \color{blue}{x}, x\right) \]

        if 5.00000000000000024e-5 < (*.f64 #s(literal -2 binary64) x)

        1. Initial program 100.0%

          \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
        2. Add Preprocessing
        3. Taylor expanded in x around 0

          \[\leadsto \frac{2}{\color{blue}{2 + x \cdot \left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2\right)}} - 1 \]
        4. Step-by-step derivation
          1. +-commutativeN/A

            \[\leadsto \frac{2}{\color{blue}{x \cdot \left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2\right) + 2}} - 1 \]
          2. *-commutativeN/A

            \[\leadsto \frac{2}{\color{blue}{\left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2\right) \cdot x} + 2} - 1 \]
          3. lower-fma.f64N/A

            \[\leadsto \frac{2}{\color{blue}{\mathsf{fma}\left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2, x, 2\right)}} - 1 \]
          4. sub-negN/A

            \[\leadsto \frac{2}{\mathsf{fma}\left(\color{blue}{x \cdot \left(2 + \frac{-4}{3} \cdot x\right) + \left(\mathsf{neg}\left(2\right)\right)}, x, 2\right)} - 1 \]
          5. *-commutativeN/A

            \[\leadsto \frac{2}{\mathsf{fma}\left(\color{blue}{\left(2 + \frac{-4}{3} \cdot x\right) \cdot x} + \left(\mathsf{neg}\left(2\right)\right), x, 2\right)} - 1 \]
          6. metadata-evalN/A

            \[\leadsto \frac{2}{\mathsf{fma}\left(\left(2 + \frac{-4}{3} \cdot x\right) \cdot x + \color{blue}{-2}, x, 2\right)} - 1 \]
          7. lower-fma.f64N/A

            \[\leadsto \frac{2}{\mathsf{fma}\left(\color{blue}{\mathsf{fma}\left(2 + \frac{-4}{3} \cdot x, x, -2\right)}, x, 2\right)} - 1 \]
          8. +-commutativeN/A

            \[\leadsto \frac{2}{\mathsf{fma}\left(\mathsf{fma}\left(\color{blue}{\frac{-4}{3} \cdot x + 2}, x, -2\right), x, 2\right)} - 1 \]
          9. lower-fma.f64100.0

            \[\leadsto \frac{2}{\mathsf{fma}\left(\mathsf{fma}\left(\color{blue}{\mathsf{fma}\left(-1.3333333333333333, x, 2\right)}, x, -2\right), x, 2\right)} - 1 \]
        5. Applied rewrites100.0%

          \[\leadsto \frac{2}{\color{blue}{\mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(-1.3333333333333333, x, 2\right), x, -2\right), x, 2\right)}} - 1 \]
        6. Taylor expanded in x around inf

          \[\leadsto \frac{2}{{x}^{3} \cdot \color{blue}{\left(2 \cdot \frac{1}{x} - \frac{4}{3}\right)}} - 1 \]
        7. Step-by-step derivation
          1. Applied rewrites100.0%

            \[\leadsto \frac{2}{\left(\mathsf{fma}\left(-1.3333333333333333, x, 2\right) \cdot x\right) \cdot \color{blue}{x}} - 1 \]
          2. Taylor expanded in x around inf

            \[\leadsto \frac{2}{\left(\left(\frac{-4}{3} \cdot x\right) \cdot x\right) \cdot x} - 1 \]
          3. Step-by-step derivation
            1. Applied rewrites100.0%

              \[\leadsto \frac{2}{\left(\left(-1.3333333333333333 \cdot x\right) \cdot x\right) \cdot x} - 1 \]
          4. Recombined 3 regimes into one program.
          5. Final simplification100.0%

            \[\leadsto \begin{array}{l} \mathbf{if}\;x \cdot -2 \leq -0.5:\\ \;\;\;\;\mathsf{expm1}\left(\log 2 - \mathsf{log1p}\left(e^{x \cdot -2}\right)\right)\\ \mathbf{elif}\;x \cdot -2 \leq 5 \cdot 10^{-5}:\\ \;\;\;\;\mathsf{fma}\left(\mathsf{fma}\left(x \cdot x, 0.13333333333333333, -0.3333333333333333\right) \cdot \left(x \cdot x\right), x, x\right)\\ \mathbf{else}:\\ \;\;\;\;\frac{2}{\left(\left(-1.3333333333333333 \cdot x\right) \cdot x\right) \cdot x} - 1\\ \end{array} \]
          6. Add Preprocessing

          Alternative 2: 99.4% accurate, 0.9× speedup?

          \[\begin{array}{l} \\ \begin{array}{l} \mathbf{if}\;x \cdot -2 \leq -0.5:\\ \;\;\;\;\frac{2}{1 + e^{x \cdot -2}} - 1\\ \mathbf{elif}\;x \cdot -2 \leq 5 \cdot 10^{-5}:\\ \;\;\;\;\mathsf{fma}\left(\mathsf{fma}\left(x \cdot x, 0.13333333333333333, -0.3333333333333333\right) \cdot \left(x \cdot x\right), x, x\right)\\ \mathbf{else}:\\ \;\;\;\;\frac{2}{\left(\left(-1.3333333333333333 \cdot x\right) \cdot x\right) \cdot x} - 1\\ \end{array} \end{array} \]
          (FPCore (x y)
           :precision binary64
           (if (<= (* x -2.0) -0.5)
             (- (/ 2.0 (+ 1.0 (exp (* x -2.0)))) 1.0)
             (if (<= (* x -2.0) 5e-5)
               (fma
                (* (fma (* x x) 0.13333333333333333 -0.3333333333333333) (* x x))
                x
                x)
               (- (/ 2.0 (* (* (* -1.3333333333333333 x) x) x)) 1.0))))
          double code(double x, double y) {
          	double tmp;
          	if ((x * -2.0) <= -0.5) {
          		tmp = (2.0 / (1.0 + exp((x * -2.0)))) - 1.0;
          	} else if ((x * -2.0) <= 5e-5) {
          		tmp = fma((fma((x * x), 0.13333333333333333, -0.3333333333333333) * (x * x)), x, x);
          	} else {
          		tmp = (2.0 / (((-1.3333333333333333 * x) * x) * x)) - 1.0;
          	}
          	return tmp;
          }
          
          function code(x, y)
          	tmp = 0.0
          	if (Float64(x * -2.0) <= -0.5)
          		tmp = Float64(Float64(2.0 / Float64(1.0 + exp(Float64(x * -2.0)))) - 1.0);
          	elseif (Float64(x * -2.0) <= 5e-5)
          		tmp = fma(Float64(fma(Float64(x * x), 0.13333333333333333, -0.3333333333333333) * Float64(x * x)), x, x);
          	else
          		tmp = Float64(Float64(2.0 / Float64(Float64(Float64(-1.3333333333333333 * x) * x) * x)) - 1.0);
          	end
          	return tmp
          end
          
          code[x_, y_] := If[LessEqual[N[(x * -2.0), $MachinePrecision], -0.5], N[(N[(2.0 / N[(1.0 + N[Exp[N[(x * -2.0), $MachinePrecision]], $MachinePrecision]), $MachinePrecision]), $MachinePrecision] - 1.0), $MachinePrecision], If[LessEqual[N[(x * -2.0), $MachinePrecision], 5e-5], N[(N[(N[(N[(x * x), $MachinePrecision] * 0.13333333333333333 + -0.3333333333333333), $MachinePrecision] * N[(x * x), $MachinePrecision]), $MachinePrecision] * x + x), $MachinePrecision], N[(N[(2.0 / N[(N[(N[(-1.3333333333333333 * x), $MachinePrecision] * x), $MachinePrecision] * x), $MachinePrecision]), $MachinePrecision] - 1.0), $MachinePrecision]]]
          
          \begin{array}{l}
          
          \\
          \begin{array}{l}
          \mathbf{if}\;x \cdot -2 \leq -0.5:\\
          \;\;\;\;\frac{2}{1 + e^{x \cdot -2}} - 1\\
          
          \mathbf{elif}\;x \cdot -2 \leq 5 \cdot 10^{-5}:\\
          \;\;\;\;\mathsf{fma}\left(\mathsf{fma}\left(x \cdot x, 0.13333333333333333, -0.3333333333333333\right) \cdot \left(x \cdot x\right), x, x\right)\\
          
          \mathbf{else}:\\
          \;\;\;\;\frac{2}{\left(\left(-1.3333333333333333 \cdot x\right) \cdot x\right) \cdot x} - 1\\
          
          
          \end{array}
          \end{array}
          
          Derivation
          1. Split input into 3 regimes
          2. if (*.f64 #s(literal -2 binary64) x) < -0.5

            1. Initial program 99.9%

              \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
            2. Add Preprocessing

            if -0.5 < (*.f64 #s(literal -2 binary64) x) < 5.00000000000000024e-5

            1. Initial program 9.0%

              \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
            2. Add Preprocessing
            3. Taylor expanded in x around 0

              \[\leadsto \color{blue}{1} - 1 \]
            4. Step-by-step derivation
              1. Applied rewrites5.6%

                \[\leadsto \color{blue}{1} - 1 \]
              2. Taylor expanded in x around 0

                \[\leadsto \color{blue}{x \cdot \left(1 + {x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)\right)} \]
              3. Step-by-step derivation
                1. +-commutativeN/A

                  \[\leadsto x \cdot \color{blue}{\left({x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + 1\right)} \]
                2. distribute-lft-inN/A

                  \[\leadsto \color{blue}{x \cdot \left({x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)\right) + x \cdot 1} \]
                3. associate-*r*N/A

                  \[\leadsto \color{blue}{\left(x \cdot {x}^{2}\right) \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)} + x \cdot 1 \]
                4. unpow2N/A

                  \[\leadsto \left(x \cdot \color{blue}{\left(x \cdot x\right)}\right) \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + x \cdot 1 \]
                5. cube-multN/A

                  \[\leadsto \color{blue}{{x}^{3}} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + x \cdot 1 \]
                6. *-rgt-identityN/A

                  \[\leadsto {x}^{3} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + \color{blue}{x} \]
                7. lower-fma.f64N/A

                  \[\leadsto \color{blue}{\mathsf{fma}\left({x}^{3}, \frac{2}{15} \cdot {x}^{2} - \frac{1}{3}, x\right)} \]
                8. lower-pow.f64N/A

                  \[\leadsto \mathsf{fma}\left(\color{blue}{{x}^{3}}, \frac{2}{15} \cdot {x}^{2} - \frac{1}{3}, x\right) \]
                9. sub-negN/A

                  \[\leadsto \mathsf{fma}\left({x}^{3}, \color{blue}{\frac{2}{15} \cdot {x}^{2} + \left(\mathsf{neg}\left(\frac{1}{3}\right)\right)}, x\right) \]
                10. metadata-evalN/A

                  \[\leadsto \mathsf{fma}\left({x}^{3}, \frac{2}{15} \cdot {x}^{2} + \color{blue}{\frac{-1}{3}}, x\right) \]
                11. lower-fma.f64N/A

                  \[\leadsto \mathsf{fma}\left({x}^{3}, \color{blue}{\mathsf{fma}\left(\frac{2}{15}, {x}^{2}, \frac{-1}{3}\right)}, x\right) \]
                12. unpow2N/A

                  \[\leadsto \mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(\frac{2}{15}, \color{blue}{x \cdot x}, \frac{-1}{3}\right), x\right) \]
                13. lower-*.f64100.0

                  \[\leadsto \mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(0.13333333333333333, \color{blue}{x \cdot x}, -0.3333333333333333\right), x\right) \]
              4. Applied rewrites100.0%

                \[\leadsto \color{blue}{\mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(0.13333333333333333, x \cdot x, -0.3333333333333333\right), x\right)} \]
              5. Step-by-step derivation
                1. Applied rewrites100.0%

                  \[\leadsto \mathsf{fma}\left(\mathsf{fma}\left(x \cdot x, 0.13333333333333333, -0.3333333333333333\right) \cdot \left(x \cdot x\right), \color{blue}{x}, x\right) \]

                if 5.00000000000000024e-5 < (*.f64 #s(literal -2 binary64) x)

                1. Initial program 100.0%

                  \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
                2. Add Preprocessing
                3. Taylor expanded in x around 0

                  \[\leadsto \frac{2}{\color{blue}{2 + x \cdot \left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2\right)}} - 1 \]
                4. Step-by-step derivation
                  1. +-commutativeN/A

                    \[\leadsto \frac{2}{\color{blue}{x \cdot \left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2\right) + 2}} - 1 \]
                  2. *-commutativeN/A

                    \[\leadsto \frac{2}{\color{blue}{\left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2\right) \cdot x} + 2} - 1 \]
                  3. lower-fma.f64N/A

                    \[\leadsto \frac{2}{\color{blue}{\mathsf{fma}\left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2, x, 2\right)}} - 1 \]
                  4. sub-negN/A

                    \[\leadsto \frac{2}{\mathsf{fma}\left(\color{blue}{x \cdot \left(2 + \frac{-4}{3} \cdot x\right) + \left(\mathsf{neg}\left(2\right)\right)}, x, 2\right)} - 1 \]
                  5. *-commutativeN/A

                    \[\leadsto \frac{2}{\mathsf{fma}\left(\color{blue}{\left(2 + \frac{-4}{3} \cdot x\right) \cdot x} + \left(\mathsf{neg}\left(2\right)\right), x, 2\right)} - 1 \]
                  6. metadata-evalN/A

                    \[\leadsto \frac{2}{\mathsf{fma}\left(\left(2 + \frac{-4}{3} \cdot x\right) \cdot x + \color{blue}{-2}, x, 2\right)} - 1 \]
                  7. lower-fma.f64N/A

                    \[\leadsto \frac{2}{\mathsf{fma}\left(\color{blue}{\mathsf{fma}\left(2 + \frac{-4}{3} \cdot x, x, -2\right)}, x, 2\right)} - 1 \]
                  8. +-commutativeN/A

                    \[\leadsto \frac{2}{\mathsf{fma}\left(\mathsf{fma}\left(\color{blue}{\frac{-4}{3} \cdot x + 2}, x, -2\right), x, 2\right)} - 1 \]
                  9. lower-fma.f64100.0

                    \[\leadsto \frac{2}{\mathsf{fma}\left(\mathsf{fma}\left(\color{blue}{\mathsf{fma}\left(-1.3333333333333333, x, 2\right)}, x, -2\right), x, 2\right)} - 1 \]
                5. Applied rewrites100.0%

                  \[\leadsto \frac{2}{\color{blue}{\mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(-1.3333333333333333, x, 2\right), x, -2\right), x, 2\right)}} - 1 \]
                6. Taylor expanded in x around inf

                  \[\leadsto \frac{2}{{x}^{3} \cdot \color{blue}{\left(2 \cdot \frac{1}{x} - \frac{4}{3}\right)}} - 1 \]
                7. Step-by-step derivation
                  1. Applied rewrites100.0%

                    \[\leadsto \frac{2}{\left(\mathsf{fma}\left(-1.3333333333333333, x, 2\right) \cdot x\right) \cdot \color{blue}{x}} - 1 \]
                  2. Taylor expanded in x around inf

                    \[\leadsto \frac{2}{\left(\left(\frac{-4}{3} \cdot x\right) \cdot x\right) \cdot x} - 1 \]
                  3. Step-by-step derivation
                    1. Applied rewrites100.0%

                      \[\leadsto \frac{2}{\left(\left(-1.3333333333333333 \cdot x\right) \cdot x\right) \cdot x} - 1 \]
                  4. Recombined 3 regimes into one program.
                  5. Final simplification100.0%

                    \[\leadsto \begin{array}{l} \mathbf{if}\;x \cdot -2 \leq -0.5:\\ \;\;\;\;\frac{2}{1 + e^{x \cdot -2}} - 1\\ \mathbf{elif}\;x \cdot -2 \leq 5 \cdot 10^{-5}:\\ \;\;\;\;\mathsf{fma}\left(\mathsf{fma}\left(x \cdot x, 0.13333333333333333, -0.3333333333333333\right) \cdot \left(x \cdot x\right), x, x\right)\\ \mathbf{else}:\\ \;\;\;\;\frac{2}{\left(\left(-1.3333333333333333 \cdot x\right) \cdot x\right) \cdot x} - 1\\ \end{array} \]
                  6. Add Preprocessing

                  Alternative 3: 75.6% accurate, 3.4× speedup?

                  \[\begin{array}{l} \\ \begin{array}{l} \mathbf{if}\;x \leq -1.5:\\ \;\;\;\;\frac{2}{\left(\left(-1.3333333333333333 \cdot x\right) \cdot x\right) \cdot x} - 1\\ \mathbf{else}:\\ \;\;\;\;\mathsf{fma}\left(\mathsf{fma}\left(x \cdot x, 0.13333333333333333, -0.3333333333333333\right) \cdot \left(x \cdot x\right), x, x\right)\\ \end{array} \end{array} \]
                  (FPCore (x y)
                   :precision binary64
                   (if (<= x -1.5)
                     (- (/ 2.0 (* (* (* -1.3333333333333333 x) x) x)) 1.0)
                     (fma
                      (* (fma (* x x) 0.13333333333333333 -0.3333333333333333) (* x x))
                      x
                      x)))
                  double code(double x, double y) {
                  	double tmp;
                  	if (x <= -1.5) {
                  		tmp = (2.0 / (((-1.3333333333333333 * x) * x) * x)) - 1.0;
                  	} else {
                  		tmp = fma((fma((x * x), 0.13333333333333333, -0.3333333333333333) * (x * x)), x, x);
                  	}
                  	return tmp;
                  }
                  
                  function code(x, y)
                  	tmp = 0.0
                  	if (x <= -1.5)
                  		tmp = Float64(Float64(2.0 / Float64(Float64(Float64(-1.3333333333333333 * x) * x) * x)) - 1.0);
                  	else
                  		tmp = fma(Float64(fma(Float64(x * x), 0.13333333333333333, -0.3333333333333333) * Float64(x * x)), x, x);
                  	end
                  	return tmp
                  end
                  
                  code[x_, y_] := If[LessEqual[x, -1.5], N[(N[(2.0 / N[(N[(N[(-1.3333333333333333 * x), $MachinePrecision] * x), $MachinePrecision] * x), $MachinePrecision]), $MachinePrecision] - 1.0), $MachinePrecision], N[(N[(N[(N[(x * x), $MachinePrecision] * 0.13333333333333333 + -0.3333333333333333), $MachinePrecision] * N[(x * x), $MachinePrecision]), $MachinePrecision] * x + x), $MachinePrecision]]
                  
                  \begin{array}{l}
                  
                  \\
                  \begin{array}{l}
                  \mathbf{if}\;x \leq -1.5:\\
                  \;\;\;\;\frac{2}{\left(\left(-1.3333333333333333 \cdot x\right) \cdot x\right) \cdot x} - 1\\
                  
                  \mathbf{else}:\\
                  \;\;\;\;\mathsf{fma}\left(\mathsf{fma}\left(x \cdot x, 0.13333333333333333, -0.3333333333333333\right) \cdot \left(x \cdot x\right), x, x\right)\\
                  
                  
                  \end{array}
                  \end{array}
                  
                  Derivation
                  1. Split input into 2 regimes
                  2. if x < -1.5

                    1. Initial program 100.0%

                      \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
                    2. Add Preprocessing
                    3. Taylor expanded in x around 0

                      \[\leadsto \frac{2}{\color{blue}{2 + x \cdot \left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2\right)}} - 1 \]
                    4. Step-by-step derivation
                      1. +-commutativeN/A

                        \[\leadsto \frac{2}{\color{blue}{x \cdot \left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2\right) + 2}} - 1 \]
                      2. *-commutativeN/A

                        \[\leadsto \frac{2}{\color{blue}{\left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2\right) \cdot x} + 2} - 1 \]
                      3. lower-fma.f64N/A

                        \[\leadsto \frac{2}{\color{blue}{\mathsf{fma}\left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2, x, 2\right)}} - 1 \]
                      4. sub-negN/A

                        \[\leadsto \frac{2}{\mathsf{fma}\left(\color{blue}{x \cdot \left(2 + \frac{-4}{3} \cdot x\right) + \left(\mathsf{neg}\left(2\right)\right)}, x, 2\right)} - 1 \]
                      5. *-commutativeN/A

                        \[\leadsto \frac{2}{\mathsf{fma}\left(\color{blue}{\left(2 + \frac{-4}{3} \cdot x\right) \cdot x} + \left(\mathsf{neg}\left(2\right)\right), x, 2\right)} - 1 \]
                      6. metadata-evalN/A

                        \[\leadsto \frac{2}{\mathsf{fma}\left(\left(2 + \frac{-4}{3} \cdot x\right) \cdot x + \color{blue}{-2}, x, 2\right)} - 1 \]
                      7. lower-fma.f64N/A

                        \[\leadsto \frac{2}{\mathsf{fma}\left(\color{blue}{\mathsf{fma}\left(2 + \frac{-4}{3} \cdot x, x, -2\right)}, x, 2\right)} - 1 \]
                      8. +-commutativeN/A

                        \[\leadsto \frac{2}{\mathsf{fma}\left(\mathsf{fma}\left(\color{blue}{\frac{-4}{3} \cdot x + 2}, x, -2\right), x, 2\right)} - 1 \]
                      9. lower-fma.f64100.0

                        \[\leadsto \frac{2}{\mathsf{fma}\left(\mathsf{fma}\left(\color{blue}{\mathsf{fma}\left(-1.3333333333333333, x, 2\right)}, x, -2\right), x, 2\right)} - 1 \]
                    5. Applied rewrites100.0%

                      \[\leadsto \frac{2}{\color{blue}{\mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(-1.3333333333333333, x, 2\right), x, -2\right), x, 2\right)}} - 1 \]
                    6. Taylor expanded in x around inf

                      \[\leadsto \frac{2}{{x}^{3} \cdot \color{blue}{\left(2 \cdot \frac{1}{x} - \frac{4}{3}\right)}} - 1 \]
                    7. Step-by-step derivation
                      1. Applied rewrites100.0%

                        \[\leadsto \frac{2}{\left(\mathsf{fma}\left(-1.3333333333333333, x, 2\right) \cdot x\right) \cdot \color{blue}{x}} - 1 \]
                      2. Taylor expanded in x around inf

                        \[\leadsto \frac{2}{\left(\left(\frac{-4}{3} \cdot x\right) \cdot x\right) \cdot x} - 1 \]
                      3. Step-by-step derivation
                        1. Applied rewrites100.0%

                          \[\leadsto \frac{2}{\left(\left(-1.3333333333333333 \cdot x\right) \cdot x\right) \cdot x} - 1 \]

                        if -1.5 < x

                        1. Initial program 42.2%

                          \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
                        2. Add Preprocessing
                        3. Taylor expanded in x around 0

                          \[\leadsto \color{blue}{1} - 1 \]
                        4. Step-by-step derivation
                          1. Applied rewrites4.7%

                            \[\leadsto \color{blue}{1} - 1 \]
                          2. Taylor expanded in x around 0

                            \[\leadsto \color{blue}{x \cdot \left(1 + {x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)\right)} \]
                          3. Step-by-step derivation
                            1. +-commutativeN/A

                              \[\leadsto x \cdot \color{blue}{\left({x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + 1\right)} \]
                            2. distribute-lft-inN/A

                              \[\leadsto \color{blue}{x \cdot \left({x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)\right) + x \cdot 1} \]
                            3. associate-*r*N/A

                              \[\leadsto \color{blue}{\left(x \cdot {x}^{2}\right) \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)} + x \cdot 1 \]
                            4. unpow2N/A

                              \[\leadsto \left(x \cdot \color{blue}{\left(x \cdot x\right)}\right) \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + x \cdot 1 \]
                            5. cube-multN/A

                              \[\leadsto \color{blue}{{x}^{3}} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + x \cdot 1 \]
                            6. *-rgt-identityN/A

                              \[\leadsto {x}^{3} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + \color{blue}{x} \]
                            7. lower-fma.f64N/A

                              \[\leadsto \color{blue}{\mathsf{fma}\left({x}^{3}, \frac{2}{15} \cdot {x}^{2} - \frac{1}{3}, x\right)} \]
                            8. lower-pow.f64N/A

                              \[\leadsto \mathsf{fma}\left(\color{blue}{{x}^{3}}, \frac{2}{15} \cdot {x}^{2} - \frac{1}{3}, x\right) \]
                            9. sub-negN/A

                              \[\leadsto \mathsf{fma}\left({x}^{3}, \color{blue}{\frac{2}{15} \cdot {x}^{2} + \left(\mathsf{neg}\left(\frac{1}{3}\right)\right)}, x\right) \]
                            10. metadata-evalN/A

                              \[\leadsto \mathsf{fma}\left({x}^{3}, \frac{2}{15} \cdot {x}^{2} + \color{blue}{\frac{-1}{3}}, x\right) \]
                            11. lower-fma.f64N/A

                              \[\leadsto \mathsf{fma}\left({x}^{3}, \color{blue}{\mathsf{fma}\left(\frac{2}{15}, {x}^{2}, \frac{-1}{3}\right)}, x\right) \]
                            12. unpow2N/A

                              \[\leadsto \mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(\frac{2}{15}, \color{blue}{x \cdot x}, \frac{-1}{3}\right), x\right) \]
                            13. lower-*.f6465.1

                              \[\leadsto \mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(0.13333333333333333, \color{blue}{x \cdot x}, -0.3333333333333333\right), x\right) \]
                          4. Applied rewrites65.1%

                            \[\leadsto \color{blue}{\mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(0.13333333333333333, x \cdot x, -0.3333333333333333\right), x\right)} \]
                          5. Step-by-step derivation
                            1. Applied rewrites65.1%

                              \[\leadsto \mathsf{fma}\left(\mathsf{fma}\left(x \cdot x, 0.13333333333333333, -0.3333333333333333\right) \cdot \left(x \cdot x\right), \color{blue}{x}, x\right) \]
                          6. Recombined 2 regimes into one program.
                          7. Add Preprocessing

                          Alternative 4: 75.5% accurate, 3.6× speedup?

                          \[\begin{array}{l} \\ \begin{array}{l} \mathbf{if}\;x \leq -1.55:\\ \;\;\;\;\frac{2}{\left(2 \cdot x\right) \cdot x} - 1\\ \mathbf{else}:\\ \;\;\;\;\mathsf{fma}\left(\mathsf{fma}\left(x \cdot x, 0.13333333333333333, -0.3333333333333333\right) \cdot \left(x \cdot x\right), x, x\right)\\ \end{array} \end{array} \]
                          (FPCore (x y)
                           :precision binary64
                           (if (<= x -1.55)
                             (- (/ 2.0 (* (* 2.0 x) x)) 1.0)
                             (fma
                              (* (fma (* x x) 0.13333333333333333 -0.3333333333333333) (* x x))
                              x
                              x)))
                          double code(double x, double y) {
                          	double tmp;
                          	if (x <= -1.55) {
                          		tmp = (2.0 / ((2.0 * x) * x)) - 1.0;
                          	} else {
                          		tmp = fma((fma((x * x), 0.13333333333333333, -0.3333333333333333) * (x * x)), x, x);
                          	}
                          	return tmp;
                          }
                          
                          function code(x, y)
                          	tmp = 0.0
                          	if (x <= -1.55)
                          		tmp = Float64(Float64(2.0 / Float64(Float64(2.0 * x) * x)) - 1.0);
                          	else
                          		tmp = fma(Float64(fma(Float64(x * x), 0.13333333333333333, -0.3333333333333333) * Float64(x * x)), x, x);
                          	end
                          	return tmp
                          end
                          
                          code[x_, y_] := If[LessEqual[x, -1.55], N[(N[(2.0 / N[(N[(2.0 * x), $MachinePrecision] * x), $MachinePrecision]), $MachinePrecision] - 1.0), $MachinePrecision], N[(N[(N[(N[(x * x), $MachinePrecision] * 0.13333333333333333 + -0.3333333333333333), $MachinePrecision] * N[(x * x), $MachinePrecision]), $MachinePrecision] * x + x), $MachinePrecision]]
                          
                          \begin{array}{l}
                          
                          \\
                          \begin{array}{l}
                          \mathbf{if}\;x \leq -1.55:\\
                          \;\;\;\;\frac{2}{\left(2 \cdot x\right) \cdot x} - 1\\
                          
                          \mathbf{else}:\\
                          \;\;\;\;\mathsf{fma}\left(\mathsf{fma}\left(x \cdot x, 0.13333333333333333, -0.3333333333333333\right) \cdot \left(x \cdot x\right), x, x\right)\\
                          
                          
                          \end{array}
                          \end{array}
                          
                          Derivation
                          1. Split input into 2 regimes
                          2. if x < -1.55000000000000004

                            1. Initial program 100.0%

                              \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
                            2. Add Preprocessing
                            3. Taylor expanded in x around 0

                              \[\leadsto \frac{2}{\color{blue}{2 + x \cdot \left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2\right)}} - 1 \]
                            4. Step-by-step derivation
                              1. +-commutativeN/A

                                \[\leadsto \frac{2}{\color{blue}{x \cdot \left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2\right) + 2}} - 1 \]
                              2. *-commutativeN/A

                                \[\leadsto \frac{2}{\color{blue}{\left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2\right) \cdot x} + 2} - 1 \]
                              3. lower-fma.f64N/A

                                \[\leadsto \frac{2}{\color{blue}{\mathsf{fma}\left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2, x, 2\right)}} - 1 \]
                              4. sub-negN/A

                                \[\leadsto \frac{2}{\mathsf{fma}\left(\color{blue}{x \cdot \left(2 + \frac{-4}{3} \cdot x\right) + \left(\mathsf{neg}\left(2\right)\right)}, x, 2\right)} - 1 \]
                              5. *-commutativeN/A

                                \[\leadsto \frac{2}{\mathsf{fma}\left(\color{blue}{\left(2 + \frac{-4}{3} \cdot x\right) \cdot x} + \left(\mathsf{neg}\left(2\right)\right), x, 2\right)} - 1 \]
                              6. metadata-evalN/A

                                \[\leadsto \frac{2}{\mathsf{fma}\left(\left(2 + \frac{-4}{3} \cdot x\right) \cdot x + \color{blue}{-2}, x, 2\right)} - 1 \]
                              7. lower-fma.f64N/A

                                \[\leadsto \frac{2}{\mathsf{fma}\left(\color{blue}{\mathsf{fma}\left(2 + \frac{-4}{3} \cdot x, x, -2\right)}, x, 2\right)} - 1 \]
                              8. +-commutativeN/A

                                \[\leadsto \frac{2}{\mathsf{fma}\left(\mathsf{fma}\left(\color{blue}{\frac{-4}{3} \cdot x + 2}, x, -2\right), x, 2\right)} - 1 \]
                              9. lower-fma.f64100.0

                                \[\leadsto \frac{2}{\mathsf{fma}\left(\mathsf{fma}\left(\color{blue}{\mathsf{fma}\left(-1.3333333333333333, x, 2\right)}, x, -2\right), x, 2\right)} - 1 \]
                            5. Applied rewrites100.0%

                              \[\leadsto \frac{2}{\color{blue}{\mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(-1.3333333333333333, x, 2\right), x, -2\right), x, 2\right)}} - 1 \]
                            6. Taylor expanded in x around inf

                              \[\leadsto \frac{2}{{x}^{3} \cdot \color{blue}{\left(2 \cdot \frac{1}{x} - \frac{4}{3}\right)}} - 1 \]
                            7. Step-by-step derivation
                              1. Applied rewrites100.0%

                                \[\leadsto \frac{2}{\left(\mathsf{fma}\left(-1.3333333333333333, x, 2\right) \cdot x\right) \cdot \color{blue}{x}} - 1 \]
                              2. Taylor expanded in x around 0

                                \[\leadsto \frac{2}{\left(2 \cdot x\right) \cdot x} - 1 \]
                              3. Step-by-step derivation
                                1. Applied rewrites100.0%

                                  \[\leadsto \frac{2}{\left(2 \cdot x\right) \cdot x} - 1 \]

                                if -1.55000000000000004 < x

                                1. Initial program 42.2%

                                  \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
                                2. Add Preprocessing
                                3. Taylor expanded in x around 0

                                  \[\leadsto \color{blue}{1} - 1 \]
                                4. Step-by-step derivation
                                  1. Applied rewrites4.7%

                                    \[\leadsto \color{blue}{1} - 1 \]
                                  2. Taylor expanded in x around 0

                                    \[\leadsto \color{blue}{x \cdot \left(1 + {x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)\right)} \]
                                  3. Step-by-step derivation
                                    1. +-commutativeN/A

                                      \[\leadsto x \cdot \color{blue}{\left({x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + 1\right)} \]
                                    2. distribute-lft-inN/A

                                      \[\leadsto \color{blue}{x \cdot \left({x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)\right) + x \cdot 1} \]
                                    3. associate-*r*N/A

                                      \[\leadsto \color{blue}{\left(x \cdot {x}^{2}\right) \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)} + x \cdot 1 \]
                                    4. unpow2N/A

                                      \[\leadsto \left(x \cdot \color{blue}{\left(x \cdot x\right)}\right) \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + x \cdot 1 \]
                                    5. cube-multN/A

                                      \[\leadsto \color{blue}{{x}^{3}} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + x \cdot 1 \]
                                    6. *-rgt-identityN/A

                                      \[\leadsto {x}^{3} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + \color{blue}{x} \]
                                    7. lower-fma.f64N/A

                                      \[\leadsto \color{blue}{\mathsf{fma}\left({x}^{3}, \frac{2}{15} \cdot {x}^{2} - \frac{1}{3}, x\right)} \]
                                    8. lower-pow.f64N/A

                                      \[\leadsto \mathsf{fma}\left(\color{blue}{{x}^{3}}, \frac{2}{15} \cdot {x}^{2} - \frac{1}{3}, x\right) \]
                                    9. sub-negN/A

                                      \[\leadsto \mathsf{fma}\left({x}^{3}, \color{blue}{\frac{2}{15} \cdot {x}^{2} + \left(\mathsf{neg}\left(\frac{1}{3}\right)\right)}, x\right) \]
                                    10. metadata-evalN/A

                                      \[\leadsto \mathsf{fma}\left({x}^{3}, \frac{2}{15} \cdot {x}^{2} + \color{blue}{\frac{-1}{3}}, x\right) \]
                                    11. lower-fma.f64N/A

                                      \[\leadsto \mathsf{fma}\left({x}^{3}, \color{blue}{\mathsf{fma}\left(\frac{2}{15}, {x}^{2}, \frac{-1}{3}\right)}, x\right) \]
                                    12. unpow2N/A

                                      \[\leadsto \mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(\frac{2}{15}, \color{blue}{x \cdot x}, \frac{-1}{3}\right), x\right) \]
                                    13. lower-*.f6465.1

                                      \[\leadsto \mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(0.13333333333333333, \color{blue}{x \cdot x}, -0.3333333333333333\right), x\right) \]
                                  4. Applied rewrites65.1%

                                    \[\leadsto \color{blue}{\mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(0.13333333333333333, x \cdot x, -0.3333333333333333\right), x\right)} \]
                                  5. Step-by-step derivation
                                    1. Applied rewrites65.1%

                                      \[\leadsto \mathsf{fma}\left(\mathsf{fma}\left(x \cdot x, 0.13333333333333333, -0.3333333333333333\right) \cdot \left(x \cdot x\right), \color{blue}{x}, x\right) \]
                                  6. Recombined 2 regimes into one program.
                                  7. Add Preprocessing

                                  Alternative 5: 74.7% accurate, 4.0× speedup?

                                  \[\begin{array}{l} \\ \begin{array}{l} \mathbf{if}\;x \leq -1.4:\\ \;\;\;\;\frac{2}{\left(2 \cdot x\right) \cdot x} - 1\\ \mathbf{else}:\\ \;\;\;\;\mathsf{fma}\left(-0.3333333333333333 \cdot \left(x \cdot x\right), x, x\right)\\ \end{array} \end{array} \]
                                  (FPCore (x y)
                                   :precision binary64
                                   (if (<= x -1.4)
                                     (- (/ 2.0 (* (* 2.0 x) x)) 1.0)
                                     (fma (* -0.3333333333333333 (* x x)) x x)))
                                  double code(double x, double y) {
                                  	double tmp;
                                  	if (x <= -1.4) {
                                  		tmp = (2.0 / ((2.0 * x) * x)) - 1.0;
                                  	} else {
                                  		tmp = fma((-0.3333333333333333 * (x * x)), x, x);
                                  	}
                                  	return tmp;
                                  }
                                  
                                  function code(x, y)
                                  	tmp = 0.0
                                  	if (x <= -1.4)
                                  		tmp = Float64(Float64(2.0 / Float64(Float64(2.0 * x) * x)) - 1.0);
                                  	else
                                  		tmp = fma(Float64(-0.3333333333333333 * Float64(x * x)), x, x);
                                  	end
                                  	return tmp
                                  end
                                  
                                  code[x_, y_] := If[LessEqual[x, -1.4], N[(N[(2.0 / N[(N[(2.0 * x), $MachinePrecision] * x), $MachinePrecision]), $MachinePrecision] - 1.0), $MachinePrecision], N[(N[(-0.3333333333333333 * N[(x * x), $MachinePrecision]), $MachinePrecision] * x + x), $MachinePrecision]]
                                  
                                  \begin{array}{l}
                                  
                                  \\
                                  \begin{array}{l}
                                  \mathbf{if}\;x \leq -1.4:\\
                                  \;\;\;\;\frac{2}{\left(2 \cdot x\right) \cdot x} - 1\\
                                  
                                  \mathbf{else}:\\
                                  \;\;\;\;\mathsf{fma}\left(-0.3333333333333333 \cdot \left(x \cdot x\right), x, x\right)\\
                                  
                                  
                                  \end{array}
                                  \end{array}
                                  
                                  Derivation
                                  1. Split input into 2 regimes
                                  2. if x < -1.3999999999999999

                                    1. Initial program 100.0%

                                      \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
                                    2. Add Preprocessing
                                    3. Taylor expanded in x around 0

                                      \[\leadsto \frac{2}{\color{blue}{2 + x \cdot \left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2\right)}} - 1 \]
                                    4. Step-by-step derivation
                                      1. +-commutativeN/A

                                        \[\leadsto \frac{2}{\color{blue}{x \cdot \left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2\right) + 2}} - 1 \]
                                      2. *-commutativeN/A

                                        \[\leadsto \frac{2}{\color{blue}{\left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2\right) \cdot x} + 2} - 1 \]
                                      3. lower-fma.f64N/A

                                        \[\leadsto \frac{2}{\color{blue}{\mathsf{fma}\left(x \cdot \left(2 + \frac{-4}{3} \cdot x\right) - 2, x, 2\right)}} - 1 \]
                                      4. sub-negN/A

                                        \[\leadsto \frac{2}{\mathsf{fma}\left(\color{blue}{x \cdot \left(2 + \frac{-4}{3} \cdot x\right) + \left(\mathsf{neg}\left(2\right)\right)}, x, 2\right)} - 1 \]
                                      5. *-commutativeN/A

                                        \[\leadsto \frac{2}{\mathsf{fma}\left(\color{blue}{\left(2 + \frac{-4}{3} \cdot x\right) \cdot x} + \left(\mathsf{neg}\left(2\right)\right), x, 2\right)} - 1 \]
                                      6. metadata-evalN/A

                                        \[\leadsto \frac{2}{\mathsf{fma}\left(\left(2 + \frac{-4}{3} \cdot x\right) \cdot x + \color{blue}{-2}, x, 2\right)} - 1 \]
                                      7. lower-fma.f64N/A

                                        \[\leadsto \frac{2}{\mathsf{fma}\left(\color{blue}{\mathsf{fma}\left(2 + \frac{-4}{3} \cdot x, x, -2\right)}, x, 2\right)} - 1 \]
                                      8. +-commutativeN/A

                                        \[\leadsto \frac{2}{\mathsf{fma}\left(\mathsf{fma}\left(\color{blue}{\frac{-4}{3} \cdot x + 2}, x, -2\right), x, 2\right)} - 1 \]
                                      9. lower-fma.f64100.0

                                        \[\leadsto \frac{2}{\mathsf{fma}\left(\mathsf{fma}\left(\color{blue}{\mathsf{fma}\left(-1.3333333333333333, x, 2\right)}, x, -2\right), x, 2\right)} - 1 \]
                                    5. Applied rewrites100.0%

                                      \[\leadsto \frac{2}{\color{blue}{\mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(-1.3333333333333333, x, 2\right), x, -2\right), x, 2\right)}} - 1 \]
                                    6. Taylor expanded in x around inf

                                      \[\leadsto \frac{2}{{x}^{3} \cdot \color{blue}{\left(2 \cdot \frac{1}{x} - \frac{4}{3}\right)}} - 1 \]
                                    7. Step-by-step derivation
                                      1. Applied rewrites100.0%

                                        \[\leadsto \frac{2}{\left(\mathsf{fma}\left(-1.3333333333333333, x, 2\right) \cdot x\right) \cdot \color{blue}{x}} - 1 \]
                                      2. Taylor expanded in x around 0

                                        \[\leadsto \frac{2}{\left(2 \cdot x\right) \cdot x} - 1 \]
                                      3. Step-by-step derivation
                                        1. Applied rewrites100.0%

                                          \[\leadsto \frac{2}{\left(2 \cdot x\right) \cdot x} - 1 \]

                                        if -1.3999999999999999 < x

                                        1. Initial program 42.2%

                                          \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
                                        2. Add Preprocessing
                                        3. Taylor expanded in x around 0

                                          \[\leadsto \color{blue}{1} - 1 \]
                                        4. Step-by-step derivation
                                          1. Applied rewrites4.7%

                                            \[\leadsto \color{blue}{1} - 1 \]
                                          2. Taylor expanded in x around 0

                                            \[\leadsto \color{blue}{x \cdot \left(1 + {x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)\right)} \]
                                          3. Step-by-step derivation
                                            1. +-commutativeN/A

                                              \[\leadsto x \cdot \color{blue}{\left({x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + 1\right)} \]
                                            2. distribute-lft-inN/A

                                              \[\leadsto \color{blue}{x \cdot \left({x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)\right) + x \cdot 1} \]
                                            3. associate-*r*N/A

                                              \[\leadsto \color{blue}{\left(x \cdot {x}^{2}\right) \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)} + x \cdot 1 \]
                                            4. unpow2N/A

                                              \[\leadsto \left(x \cdot \color{blue}{\left(x \cdot x\right)}\right) \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + x \cdot 1 \]
                                            5. cube-multN/A

                                              \[\leadsto \color{blue}{{x}^{3}} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + x \cdot 1 \]
                                            6. *-rgt-identityN/A

                                              \[\leadsto {x}^{3} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + \color{blue}{x} \]
                                            7. lower-fma.f64N/A

                                              \[\leadsto \color{blue}{\mathsf{fma}\left({x}^{3}, \frac{2}{15} \cdot {x}^{2} - \frac{1}{3}, x\right)} \]
                                            8. lower-pow.f64N/A

                                              \[\leadsto \mathsf{fma}\left(\color{blue}{{x}^{3}}, \frac{2}{15} \cdot {x}^{2} - \frac{1}{3}, x\right) \]
                                            9. sub-negN/A

                                              \[\leadsto \mathsf{fma}\left({x}^{3}, \color{blue}{\frac{2}{15} \cdot {x}^{2} + \left(\mathsf{neg}\left(\frac{1}{3}\right)\right)}, x\right) \]
                                            10. metadata-evalN/A

                                              \[\leadsto \mathsf{fma}\left({x}^{3}, \frac{2}{15} \cdot {x}^{2} + \color{blue}{\frac{-1}{3}}, x\right) \]
                                            11. lower-fma.f64N/A

                                              \[\leadsto \mathsf{fma}\left({x}^{3}, \color{blue}{\mathsf{fma}\left(\frac{2}{15}, {x}^{2}, \frac{-1}{3}\right)}, x\right) \]
                                            12. unpow2N/A

                                              \[\leadsto \mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(\frac{2}{15}, \color{blue}{x \cdot x}, \frac{-1}{3}\right), x\right) \]
                                            13. lower-*.f6465.1

                                              \[\leadsto \mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(0.13333333333333333, \color{blue}{x \cdot x}, -0.3333333333333333\right), x\right) \]
                                          4. Applied rewrites65.1%

                                            \[\leadsto \color{blue}{\mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(0.13333333333333333, x \cdot x, -0.3333333333333333\right), x\right)} \]
                                          5. Step-by-step derivation
                                            1. Applied rewrites65.1%

                                              \[\leadsto \mathsf{fma}\left(\mathsf{fma}\left(x \cdot x, 0.13333333333333333, -0.3333333333333333\right) \cdot \left(x \cdot x\right), \color{blue}{x}, x\right) \]
                                            2. Taylor expanded in x around 0

                                              \[\leadsto \mathsf{fma}\left(\frac{-1}{3} \cdot \left(x \cdot x\right), x, x\right) \]
                                            3. Step-by-step derivation
                                              1. Applied rewrites64.0%

                                                \[\leadsto \mathsf{fma}\left(-0.3333333333333333 \cdot \left(x \cdot x\right), x, x\right) \]
                                            4. Recombined 2 regimes into one program.
                                            5. Add Preprocessing

                                            Alternative 6: 74.4% accurate, 4.6× speedup?

                                            \[\begin{array}{l} \\ \begin{array}{l} \mathbf{if}\;x \leq -1.3:\\ \;\;\;\;\frac{2}{\mathsf{fma}\left(-2, x, 2\right)} - 1\\ \mathbf{else}:\\ \;\;\;\;\mathsf{fma}\left(-0.3333333333333333 \cdot \left(x \cdot x\right), x, x\right)\\ \end{array} \end{array} \]
                                            (FPCore (x y)
                                             :precision binary64
                                             (if (<= x -1.3)
                                               (- (/ 2.0 (fma -2.0 x 2.0)) 1.0)
                                               (fma (* -0.3333333333333333 (* x x)) x x)))
                                            double code(double x, double y) {
                                            	double tmp;
                                            	if (x <= -1.3) {
                                            		tmp = (2.0 / fma(-2.0, x, 2.0)) - 1.0;
                                            	} else {
                                            		tmp = fma((-0.3333333333333333 * (x * x)), x, x);
                                            	}
                                            	return tmp;
                                            }
                                            
                                            function code(x, y)
                                            	tmp = 0.0
                                            	if (x <= -1.3)
                                            		tmp = Float64(Float64(2.0 / fma(-2.0, x, 2.0)) - 1.0);
                                            	else
                                            		tmp = fma(Float64(-0.3333333333333333 * Float64(x * x)), x, x);
                                            	end
                                            	return tmp
                                            end
                                            
                                            code[x_, y_] := If[LessEqual[x, -1.3], N[(N[(2.0 / N[(-2.0 * x + 2.0), $MachinePrecision]), $MachinePrecision] - 1.0), $MachinePrecision], N[(N[(-0.3333333333333333 * N[(x * x), $MachinePrecision]), $MachinePrecision] * x + x), $MachinePrecision]]
                                            
                                            \begin{array}{l}
                                            
                                            \\
                                            \begin{array}{l}
                                            \mathbf{if}\;x \leq -1.3:\\
                                            \;\;\;\;\frac{2}{\mathsf{fma}\left(-2, x, 2\right)} - 1\\
                                            
                                            \mathbf{else}:\\
                                            \;\;\;\;\mathsf{fma}\left(-0.3333333333333333 \cdot \left(x \cdot x\right), x, x\right)\\
                                            
                                            
                                            \end{array}
                                            \end{array}
                                            
                                            Derivation
                                            1. Split input into 2 regimes
                                            2. if x < -1.30000000000000004

                                              1. Initial program 100.0%

                                                \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
                                              2. Add Preprocessing
                                              3. Taylor expanded in x around 0

                                                \[\leadsto \frac{2}{\color{blue}{2 + -2 \cdot x}} - 1 \]
                                              4. Step-by-step derivation
                                                1. +-commutativeN/A

                                                  \[\leadsto \frac{2}{\color{blue}{-2 \cdot x + 2}} - 1 \]
                                                2. lower-fma.f6499.3

                                                  \[\leadsto \frac{2}{\color{blue}{\mathsf{fma}\left(-2, x, 2\right)}} - 1 \]
                                              5. Applied rewrites99.3%

                                                \[\leadsto \frac{2}{\color{blue}{\mathsf{fma}\left(-2, x, 2\right)}} - 1 \]

                                              if -1.30000000000000004 < x

                                              1. Initial program 42.2%

                                                \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
                                              2. Add Preprocessing
                                              3. Taylor expanded in x around 0

                                                \[\leadsto \color{blue}{1} - 1 \]
                                              4. Step-by-step derivation
                                                1. Applied rewrites4.7%

                                                  \[\leadsto \color{blue}{1} - 1 \]
                                                2. Taylor expanded in x around 0

                                                  \[\leadsto \color{blue}{x \cdot \left(1 + {x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)\right)} \]
                                                3. Step-by-step derivation
                                                  1. +-commutativeN/A

                                                    \[\leadsto x \cdot \color{blue}{\left({x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + 1\right)} \]
                                                  2. distribute-lft-inN/A

                                                    \[\leadsto \color{blue}{x \cdot \left({x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)\right) + x \cdot 1} \]
                                                  3. associate-*r*N/A

                                                    \[\leadsto \color{blue}{\left(x \cdot {x}^{2}\right) \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)} + x \cdot 1 \]
                                                  4. unpow2N/A

                                                    \[\leadsto \left(x \cdot \color{blue}{\left(x \cdot x\right)}\right) \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + x \cdot 1 \]
                                                  5. cube-multN/A

                                                    \[\leadsto \color{blue}{{x}^{3}} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + x \cdot 1 \]
                                                  6. *-rgt-identityN/A

                                                    \[\leadsto {x}^{3} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + \color{blue}{x} \]
                                                  7. lower-fma.f64N/A

                                                    \[\leadsto \color{blue}{\mathsf{fma}\left({x}^{3}, \frac{2}{15} \cdot {x}^{2} - \frac{1}{3}, x\right)} \]
                                                  8. lower-pow.f64N/A

                                                    \[\leadsto \mathsf{fma}\left(\color{blue}{{x}^{3}}, \frac{2}{15} \cdot {x}^{2} - \frac{1}{3}, x\right) \]
                                                  9. sub-negN/A

                                                    \[\leadsto \mathsf{fma}\left({x}^{3}, \color{blue}{\frac{2}{15} \cdot {x}^{2} + \left(\mathsf{neg}\left(\frac{1}{3}\right)\right)}, x\right) \]
                                                  10. metadata-evalN/A

                                                    \[\leadsto \mathsf{fma}\left({x}^{3}, \frac{2}{15} \cdot {x}^{2} + \color{blue}{\frac{-1}{3}}, x\right) \]
                                                  11. lower-fma.f64N/A

                                                    \[\leadsto \mathsf{fma}\left({x}^{3}, \color{blue}{\mathsf{fma}\left(\frac{2}{15}, {x}^{2}, \frac{-1}{3}\right)}, x\right) \]
                                                  12. unpow2N/A

                                                    \[\leadsto \mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(\frac{2}{15}, \color{blue}{x \cdot x}, \frac{-1}{3}\right), x\right) \]
                                                  13. lower-*.f6465.1

                                                    \[\leadsto \mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(0.13333333333333333, \color{blue}{x \cdot x}, -0.3333333333333333\right), x\right) \]
                                                4. Applied rewrites65.1%

                                                  \[\leadsto \color{blue}{\mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(0.13333333333333333, x \cdot x, -0.3333333333333333\right), x\right)} \]
                                                5. Step-by-step derivation
                                                  1. Applied rewrites65.1%

                                                    \[\leadsto \mathsf{fma}\left(\mathsf{fma}\left(x \cdot x, 0.13333333333333333, -0.3333333333333333\right) \cdot \left(x \cdot x\right), \color{blue}{x}, x\right) \]
                                                  2. Taylor expanded in x around 0

                                                    \[\leadsto \mathsf{fma}\left(\frac{-1}{3} \cdot \left(x \cdot x\right), x, x\right) \]
                                                  3. Step-by-step derivation
                                                    1. Applied rewrites64.0%

                                                      \[\leadsto \mathsf{fma}\left(-0.3333333333333333 \cdot \left(x \cdot x\right), x, x\right) \]
                                                  4. Recombined 2 regimes into one program.
                                                  5. Add Preprocessing

                                                  Alternative 7: 74.4% accurate, 4.7× speedup?

                                                  \[\begin{array}{l} \\ \begin{array}{l} \mathbf{if}\;x \leq -1.5:\\ \;\;\;\;\frac{2}{x \cdot -2} - 1\\ \mathbf{else}:\\ \;\;\;\;\mathsf{fma}\left(-0.3333333333333333 \cdot \left(x \cdot x\right), x, x\right)\\ \end{array} \end{array} \]
                                                  (FPCore (x y)
                                                   :precision binary64
                                                   (if (<= x -1.5)
                                                     (- (/ 2.0 (* x -2.0)) 1.0)
                                                     (fma (* -0.3333333333333333 (* x x)) x x)))
                                                  double code(double x, double y) {
                                                  	double tmp;
                                                  	if (x <= -1.5) {
                                                  		tmp = (2.0 / (x * -2.0)) - 1.0;
                                                  	} else {
                                                  		tmp = fma((-0.3333333333333333 * (x * x)), x, x);
                                                  	}
                                                  	return tmp;
                                                  }
                                                  
                                                  function code(x, y)
                                                  	tmp = 0.0
                                                  	if (x <= -1.5)
                                                  		tmp = Float64(Float64(2.0 / Float64(x * -2.0)) - 1.0);
                                                  	else
                                                  		tmp = fma(Float64(-0.3333333333333333 * Float64(x * x)), x, x);
                                                  	end
                                                  	return tmp
                                                  end
                                                  
                                                  code[x_, y_] := If[LessEqual[x, -1.5], N[(N[(2.0 / N[(x * -2.0), $MachinePrecision]), $MachinePrecision] - 1.0), $MachinePrecision], N[(N[(-0.3333333333333333 * N[(x * x), $MachinePrecision]), $MachinePrecision] * x + x), $MachinePrecision]]
                                                  
                                                  \begin{array}{l}
                                                  
                                                  \\
                                                  \begin{array}{l}
                                                  \mathbf{if}\;x \leq -1.5:\\
                                                  \;\;\;\;\frac{2}{x \cdot -2} - 1\\
                                                  
                                                  \mathbf{else}:\\
                                                  \;\;\;\;\mathsf{fma}\left(-0.3333333333333333 \cdot \left(x \cdot x\right), x, x\right)\\
                                                  
                                                  
                                                  \end{array}
                                                  \end{array}
                                                  
                                                  Derivation
                                                  1. Split input into 2 regimes
                                                  2. if x < -1.5

                                                    1. Initial program 100.0%

                                                      \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
                                                    2. Add Preprocessing
                                                    3. Taylor expanded in x around 0

                                                      \[\leadsto \frac{2}{\color{blue}{2 + -2 \cdot x}} - 1 \]
                                                    4. Step-by-step derivation
                                                      1. +-commutativeN/A

                                                        \[\leadsto \frac{2}{\color{blue}{-2 \cdot x + 2}} - 1 \]
                                                      2. lower-fma.f6499.3

                                                        \[\leadsto \frac{2}{\color{blue}{\mathsf{fma}\left(-2, x, 2\right)}} - 1 \]
                                                    5. Applied rewrites99.3%

                                                      \[\leadsto \frac{2}{\color{blue}{\mathsf{fma}\left(-2, x, 2\right)}} - 1 \]
                                                    6. Taylor expanded in x around inf

                                                      \[\leadsto \frac{2}{-2 \cdot \color{blue}{x}} - 1 \]
                                                    7. Step-by-step derivation
                                                      1. Applied rewrites99.3%

                                                        \[\leadsto \frac{2}{-2 \cdot \color{blue}{x}} - 1 \]

                                                      if -1.5 < x

                                                      1. Initial program 42.2%

                                                        \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
                                                      2. Add Preprocessing
                                                      3. Taylor expanded in x around 0

                                                        \[\leadsto \color{blue}{1} - 1 \]
                                                      4. Step-by-step derivation
                                                        1. Applied rewrites4.7%

                                                          \[\leadsto \color{blue}{1} - 1 \]
                                                        2. Taylor expanded in x around 0

                                                          \[\leadsto \color{blue}{x \cdot \left(1 + {x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)\right)} \]
                                                        3. Step-by-step derivation
                                                          1. +-commutativeN/A

                                                            \[\leadsto x \cdot \color{blue}{\left({x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + 1\right)} \]
                                                          2. distribute-lft-inN/A

                                                            \[\leadsto \color{blue}{x \cdot \left({x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)\right) + x \cdot 1} \]
                                                          3. associate-*r*N/A

                                                            \[\leadsto \color{blue}{\left(x \cdot {x}^{2}\right) \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)} + x \cdot 1 \]
                                                          4. unpow2N/A

                                                            \[\leadsto \left(x \cdot \color{blue}{\left(x \cdot x\right)}\right) \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + x \cdot 1 \]
                                                          5. cube-multN/A

                                                            \[\leadsto \color{blue}{{x}^{3}} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + x \cdot 1 \]
                                                          6. *-rgt-identityN/A

                                                            \[\leadsto {x}^{3} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + \color{blue}{x} \]
                                                          7. lower-fma.f64N/A

                                                            \[\leadsto \color{blue}{\mathsf{fma}\left({x}^{3}, \frac{2}{15} \cdot {x}^{2} - \frac{1}{3}, x\right)} \]
                                                          8. lower-pow.f64N/A

                                                            \[\leadsto \mathsf{fma}\left(\color{blue}{{x}^{3}}, \frac{2}{15} \cdot {x}^{2} - \frac{1}{3}, x\right) \]
                                                          9. sub-negN/A

                                                            \[\leadsto \mathsf{fma}\left({x}^{3}, \color{blue}{\frac{2}{15} \cdot {x}^{2} + \left(\mathsf{neg}\left(\frac{1}{3}\right)\right)}, x\right) \]
                                                          10. metadata-evalN/A

                                                            \[\leadsto \mathsf{fma}\left({x}^{3}, \frac{2}{15} \cdot {x}^{2} + \color{blue}{\frac{-1}{3}}, x\right) \]
                                                          11. lower-fma.f64N/A

                                                            \[\leadsto \mathsf{fma}\left({x}^{3}, \color{blue}{\mathsf{fma}\left(\frac{2}{15}, {x}^{2}, \frac{-1}{3}\right)}, x\right) \]
                                                          12. unpow2N/A

                                                            \[\leadsto \mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(\frac{2}{15}, \color{blue}{x \cdot x}, \frac{-1}{3}\right), x\right) \]
                                                          13. lower-*.f6465.1

                                                            \[\leadsto \mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(0.13333333333333333, \color{blue}{x \cdot x}, -0.3333333333333333\right), x\right) \]
                                                        4. Applied rewrites65.1%

                                                          \[\leadsto \color{blue}{\mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(0.13333333333333333, x \cdot x, -0.3333333333333333\right), x\right)} \]
                                                        5. Step-by-step derivation
                                                          1. Applied rewrites65.1%

                                                            \[\leadsto \mathsf{fma}\left(\mathsf{fma}\left(x \cdot x, 0.13333333333333333, -0.3333333333333333\right) \cdot \left(x \cdot x\right), \color{blue}{x}, x\right) \]
                                                          2. Taylor expanded in x around 0

                                                            \[\leadsto \mathsf{fma}\left(\frac{-1}{3} \cdot \left(x \cdot x\right), x, x\right) \]
                                                          3. Step-by-step derivation
                                                            1. Applied rewrites64.0%

                                                              \[\leadsto \mathsf{fma}\left(-0.3333333333333333 \cdot \left(x \cdot x\right), x, x\right) \]
                                                          4. Recombined 2 regimes into one program.
                                                          5. Final simplification73.7%

                                                            \[\leadsto \begin{array}{l} \mathbf{if}\;x \leq -1.5:\\ \;\;\;\;\frac{2}{x \cdot -2} - 1\\ \mathbf{else}:\\ \;\;\;\;\mathsf{fma}\left(-0.3333333333333333 \cdot \left(x \cdot x\right), x, x\right)\\ \end{array} \]
                                                          6. Add Preprocessing

                                                          Alternative 8: 50.7% accurate, 7.2× speedup?

                                                          \[\begin{array}{l} \\ \mathsf{fma}\left(-0.3333333333333333 \cdot \left(x \cdot x\right), x, x\right) \end{array} \]
                                                          (FPCore (x y) :precision binary64 (fma (* -0.3333333333333333 (* x x)) x x))
                                                          double code(double x, double y) {
                                                          	return fma((-0.3333333333333333 * (x * x)), x, x);
                                                          }
                                                          
                                                          function code(x, y)
                                                          	return fma(Float64(-0.3333333333333333 * Float64(x * x)), x, x)
                                                          end
                                                          
                                                          code[x_, y_] := N[(N[(-0.3333333333333333 * N[(x * x), $MachinePrecision]), $MachinePrecision] * x + x), $MachinePrecision]
                                                          
                                                          \begin{array}{l}
                                                          
                                                          \\
                                                          \mathsf{fma}\left(-0.3333333333333333 \cdot \left(x \cdot x\right), x, x\right)
                                                          \end{array}
                                                          
                                                          Derivation
                                                          1. Initial program 58.0%

                                                            \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
                                                          2. Add Preprocessing
                                                          3. Taylor expanded in x around 0

                                                            \[\leadsto \color{blue}{1} - 1 \]
                                                          4. Step-by-step derivation
                                                            1. Applied rewrites4.3%

                                                              \[\leadsto \color{blue}{1} - 1 \]
                                                            2. Taylor expanded in x around 0

                                                              \[\leadsto \color{blue}{x \cdot \left(1 + {x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)\right)} \]
                                                            3. Step-by-step derivation
                                                              1. +-commutativeN/A

                                                                \[\leadsto x \cdot \color{blue}{\left({x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + 1\right)} \]
                                                              2. distribute-lft-inN/A

                                                                \[\leadsto \color{blue}{x \cdot \left({x}^{2} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)\right) + x \cdot 1} \]
                                                              3. associate-*r*N/A

                                                                \[\leadsto \color{blue}{\left(x \cdot {x}^{2}\right) \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right)} + x \cdot 1 \]
                                                              4. unpow2N/A

                                                                \[\leadsto \left(x \cdot \color{blue}{\left(x \cdot x\right)}\right) \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + x \cdot 1 \]
                                                              5. cube-multN/A

                                                                \[\leadsto \color{blue}{{x}^{3}} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + x \cdot 1 \]
                                                              6. *-rgt-identityN/A

                                                                \[\leadsto {x}^{3} \cdot \left(\frac{2}{15} \cdot {x}^{2} - \frac{1}{3}\right) + \color{blue}{x} \]
                                                              7. lower-fma.f64N/A

                                                                \[\leadsto \color{blue}{\mathsf{fma}\left({x}^{3}, \frac{2}{15} \cdot {x}^{2} - \frac{1}{3}, x\right)} \]
                                                              8. lower-pow.f64N/A

                                                                \[\leadsto \mathsf{fma}\left(\color{blue}{{x}^{3}}, \frac{2}{15} \cdot {x}^{2} - \frac{1}{3}, x\right) \]
                                                              9. sub-negN/A

                                                                \[\leadsto \mathsf{fma}\left({x}^{3}, \color{blue}{\frac{2}{15} \cdot {x}^{2} + \left(\mathsf{neg}\left(\frac{1}{3}\right)\right)}, x\right) \]
                                                              10. metadata-evalN/A

                                                                \[\leadsto \mathsf{fma}\left({x}^{3}, \frac{2}{15} \cdot {x}^{2} + \color{blue}{\frac{-1}{3}}, x\right) \]
                                                              11. lower-fma.f64N/A

                                                                \[\leadsto \mathsf{fma}\left({x}^{3}, \color{blue}{\mathsf{fma}\left(\frac{2}{15}, {x}^{2}, \frac{-1}{3}\right)}, x\right) \]
                                                              12. unpow2N/A

                                                                \[\leadsto \mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(\frac{2}{15}, \color{blue}{x \cdot x}, \frac{-1}{3}\right), x\right) \]
                                                              13. lower-*.f6448.2

                                                                \[\leadsto \mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(0.13333333333333333, \color{blue}{x \cdot x}, -0.3333333333333333\right), x\right) \]
                                                            4. Applied rewrites48.2%

                                                              \[\leadsto \color{blue}{\mathsf{fma}\left({x}^{3}, \mathsf{fma}\left(0.13333333333333333, x \cdot x, -0.3333333333333333\right), x\right)} \]
                                                            5. Step-by-step derivation
                                                              1. Applied rewrites48.2%

                                                                \[\leadsto \mathsf{fma}\left(\mathsf{fma}\left(x \cdot x, 0.13333333333333333, -0.3333333333333333\right) \cdot \left(x \cdot x\right), \color{blue}{x}, x\right) \]
                                                              2. Taylor expanded in x around 0

                                                                \[\leadsto \mathsf{fma}\left(\frac{-1}{3} \cdot \left(x \cdot x\right), x, x\right) \]
                                                              3. Step-by-step derivation
                                                                1. Applied rewrites46.7%

                                                                  \[\leadsto \mathsf{fma}\left(-0.3333333333333333 \cdot \left(x \cdot x\right), x, x\right) \]
                                                                2. Add Preprocessing

                                                                Alternative 9: 6.5% accurate, 17.6× speedup?

                                                                \[\begin{array}{l} \\ \left(1 + x\right) - 1 \end{array} \]
                                                                (FPCore (x y) :precision binary64 (- (+ 1.0 x) 1.0))
                                                                double code(double x, double y) {
                                                                	return (1.0 + x) - 1.0;
                                                                }
                                                                
                                                                real(8) function code(x, y)
                                                                    real(8), intent (in) :: x
                                                                    real(8), intent (in) :: y
                                                                    code = (1.0d0 + x) - 1.0d0
                                                                end function
                                                                
                                                                public static double code(double x, double y) {
                                                                	return (1.0 + x) - 1.0;
                                                                }
                                                                
                                                                def code(x, y):
                                                                	return (1.0 + x) - 1.0
                                                                
                                                                function code(x, y)
                                                                	return Float64(Float64(1.0 + x) - 1.0)
                                                                end
                                                                
                                                                function tmp = code(x, y)
                                                                	tmp = (1.0 + x) - 1.0;
                                                                end
                                                                
                                                                code[x_, y_] := N[(N[(1.0 + x), $MachinePrecision] - 1.0), $MachinePrecision]
                                                                
                                                                \begin{array}{l}
                                                                
                                                                \\
                                                                \left(1 + x\right) - 1
                                                                \end{array}
                                                                
                                                                Derivation
                                                                1. Initial program 58.0%

                                                                  \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
                                                                2. Add Preprocessing
                                                                3. Taylor expanded in x around 0

                                                                  \[\leadsto \color{blue}{\left(1 + x\right)} - 1 \]
                                                                4. Step-by-step derivation
                                                                  1. lower-+.f646.9

                                                                    \[\leadsto \color{blue}{\left(1 + x\right)} - 1 \]
                                                                5. Applied rewrites6.9%

                                                                  \[\leadsto \color{blue}{\left(1 + x\right)} - 1 \]
                                                                6. Add Preprocessing

                                                                Alternative 10: 4.3% accurate, 30.8× speedup?

                                                                \[\begin{array}{l} \\ 1 - 1 \end{array} \]
                                                                (FPCore (x y) :precision binary64 (- 1.0 1.0))
                                                                double code(double x, double y) {
                                                                	return 1.0 - 1.0;
                                                                }
                                                                
                                                                real(8) function code(x, y)
                                                                    real(8), intent (in) :: x
                                                                    real(8), intent (in) :: y
                                                                    code = 1.0d0 - 1.0d0
                                                                end function
                                                                
                                                                public static double code(double x, double y) {
                                                                	return 1.0 - 1.0;
                                                                }
                                                                
                                                                def code(x, y):
                                                                	return 1.0 - 1.0
                                                                
                                                                function code(x, y)
                                                                	return Float64(1.0 - 1.0)
                                                                end
                                                                
                                                                function tmp = code(x, y)
                                                                	tmp = 1.0 - 1.0;
                                                                end
                                                                
                                                                code[x_, y_] := N[(1.0 - 1.0), $MachinePrecision]
                                                                
                                                                \begin{array}{l}
                                                                
                                                                \\
                                                                1 - 1
                                                                \end{array}
                                                                
                                                                Derivation
                                                                1. Initial program 58.0%

                                                                  \[\frac{2}{1 + e^{-2 \cdot x}} - 1 \]
                                                                2. Add Preprocessing
                                                                3. Taylor expanded in x around 0

                                                                  \[\leadsto \color{blue}{1} - 1 \]
                                                                4. Step-by-step derivation
                                                                  1. Applied rewrites4.3%

                                                                    \[\leadsto \color{blue}{1} - 1 \]
                                                                  2. Add Preprocessing

                                                                  Reproduce

                                                                  ?
                                                                  herbie shell --seed 2024270 
                                                                  (FPCore (x y)
                                                                    :name "Logistic function from Lakshay Garg"
                                                                    :precision binary64
                                                                    (- (/ 2.0 (+ 1.0 (exp (* -2.0 x)))) 1.0))