symmetry log of sum of exp

Percentage Accurate: 53.0% → 98.9%
Time: 12.1s
Alternatives: 16
Speedup: 1.5×

Specification

?
\[\begin{array}{l} \\ \log \left(e^{a} + e^{b}\right) \end{array} \]
(FPCore (a b) :precision binary64 (log (+ (exp a) (exp b))))
double code(double a, double b) {
	return log((exp(a) + exp(b)));
}
real(8) function code(a, b)
    real(8), intent (in) :: a
    real(8), intent (in) :: b
    code = log((exp(a) + exp(b)))
end function
public static double code(double a, double b) {
	return Math.log((Math.exp(a) + Math.exp(b)));
}
def code(a, b):
	return math.log((math.exp(a) + math.exp(b)))
function code(a, b)
	return log(Float64(exp(a) + exp(b)))
end
function tmp = code(a, b)
	tmp = log((exp(a) + exp(b)));
end
code[a_, b_] := N[Log[N[(N[Exp[a], $MachinePrecision] + N[Exp[b], $MachinePrecision]), $MachinePrecision]], $MachinePrecision]
\begin{array}{l}

\\
\log \left(e^{a} + e^{b}\right)
\end{array}

Sampling outcomes in binary64 precision:

Local Percentage Accuracy vs ?

The average percentage accuracy by input value. Horizontal axis shows value of an input variable; the variable is choosen in the title. Vertical axis is accuracy; higher is better. Red represent the original program, while blue represents Herbie's suggestion. These can be toggled with buttons below the plot. The line is an average while dots represent individual samples.

Accuracy vs Speed?

Herbie found 16 alternatives:

AlternativeAccuracySpeedup
The accuracy (vertical axis) and speed (horizontal axis) of each alternatives. Up and to the right is better. The red square shows the initial program, and each blue circle shows an alternative.The line shows the best available speed-accuracy tradeoffs.

Initial Program: 53.0% accurate, 1.0× speedup?

\[\begin{array}{l} \\ \log \left(e^{a} + e^{b}\right) \end{array} \]
(FPCore (a b) :precision binary64 (log (+ (exp a) (exp b))))
double code(double a, double b) {
	return log((exp(a) + exp(b)));
}
real(8) function code(a, b)
    real(8), intent (in) :: a
    real(8), intent (in) :: b
    code = log((exp(a) + exp(b)))
end function
public static double code(double a, double b) {
	return Math.log((Math.exp(a) + Math.exp(b)));
}
def code(a, b):
	return math.log((math.exp(a) + math.exp(b)))
function code(a, b)
	return log(Float64(exp(a) + exp(b)))
end
function tmp = code(a, b)
	tmp = log((exp(a) + exp(b)));
end
code[a_, b_] := N[Log[N[(N[Exp[a], $MachinePrecision] + N[Exp[b], $MachinePrecision]), $MachinePrecision]], $MachinePrecision]
\begin{array}{l}

\\
\log \left(e^{a} + e^{b}\right)
\end{array}

Alternative 1: 98.9% accurate, 0.7× speedup?

\[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} \leq 0:\\ \;\;\;\;\frac{b}{1 + e^{a}}\\ \mathbf{else}:\\ \;\;\;\;\log \left(e^{a} + e^{b}\right)\\ \end{array} \end{array} \]
NOTE: a and b should be sorted in increasing order before calling this function.
(FPCore (a b)
 :precision binary64
 (if (<= (exp a) 0.0) (/ b (+ 1.0 (exp a))) (log (+ (exp a) (exp b)))))
assert(a < b);
double code(double a, double b) {
	double tmp;
	if (exp(a) <= 0.0) {
		tmp = b / (1.0 + exp(a));
	} else {
		tmp = log((exp(a) + exp(b)));
	}
	return tmp;
}
NOTE: a and b should be sorted in increasing order before calling this function.
real(8) function code(a, b)
    real(8), intent (in) :: a
    real(8), intent (in) :: b
    real(8) :: tmp
    if (exp(a) <= 0.0d0) then
        tmp = b / (1.0d0 + exp(a))
    else
        tmp = log((exp(a) + exp(b)))
    end if
    code = tmp
end function
assert a < b;
public static double code(double a, double b) {
	double tmp;
	if (Math.exp(a) <= 0.0) {
		tmp = b / (1.0 + Math.exp(a));
	} else {
		tmp = Math.log((Math.exp(a) + Math.exp(b)));
	}
	return tmp;
}
[a, b] = sort([a, b])
def code(a, b):
	tmp = 0
	if math.exp(a) <= 0.0:
		tmp = b / (1.0 + math.exp(a))
	else:
		tmp = math.log((math.exp(a) + math.exp(b)))
	return tmp
a, b = sort([a, b])
function code(a, b)
	tmp = 0.0
	if (exp(a) <= 0.0)
		tmp = Float64(b / Float64(1.0 + exp(a)));
	else
		tmp = log(Float64(exp(a) + exp(b)));
	end
	return tmp
end
a, b = num2cell(sort([a, b])){:}
function tmp_2 = code(a, b)
	tmp = 0.0;
	if (exp(a) <= 0.0)
		tmp = b / (1.0 + exp(a));
	else
		tmp = log((exp(a) + exp(b)));
	end
	tmp_2 = tmp;
end
NOTE: a and b should be sorted in increasing order before calling this function.
code[a_, b_] := If[LessEqual[N[Exp[a], $MachinePrecision], 0.0], N[(b / N[(1.0 + N[Exp[a], $MachinePrecision]), $MachinePrecision]), $MachinePrecision], N[Log[N[(N[Exp[a], $MachinePrecision] + N[Exp[b], $MachinePrecision]), $MachinePrecision]], $MachinePrecision]]
\begin{array}{l}
[a, b] = \mathsf{sort}([a, b])\\
\\
\begin{array}{l}
\mathbf{if}\;e^{a} \leq 0:\\
\;\;\;\;\frac{b}{1 + e^{a}}\\

\mathbf{else}:\\
\;\;\;\;\log \left(e^{a} + e^{b}\right)\\


\end{array}
\end{array}
Derivation
  1. Split input into 2 regimes
  2. if (exp.f64 a) < 0.0

    1. Initial program 9.5%

      \[\log \left(e^{a} + e^{b}\right) \]
    2. Add Preprocessing
    3. Taylor expanded in b around 0

      \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
    4. Step-by-step derivation
      1. *-rgt-identityN/A

        \[\leadsto \log \left(1 + e^{a}\right) + \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} \]
      2. associate-*r/N/A

        \[\leadsto \log \left(1 + e^{a}\right) + \color{blue}{b \cdot \frac{1}{1 + e^{a}}} \]
      3. lower-+.f64N/A

        \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \frac{1}{1 + e^{a}}} \]
      4. lower-log1p.f64N/A

        \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} + b \cdot \frac{1}{1 + e^{a}} \]
      5. lower-exp.f64N/A

        \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) + b \cdot \frac{1}{1 + e^{a}} \]
      6. associate-*r/N/A

        \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} \]
      7. *-rgt-identityN/A

        \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{\color{blue}{b}}{1 + e^{a}} \]
      8. lower-/.f64N/A

        \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b}{1 + e^{a}}} \]
      9. lower-+.f64N/A

        \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{\color{blue}{1 + e^{a}}} \]
      10. lower-exp.f64100.0

        \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + \color{blue}{e^{a}}} \]
    5. Applied rewrites100.0%

      \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}}} \]
    6. Taylor expanded in b around inf

      \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
    7. Step-by-step derivation
      1. Applied rewrites100.0%

        \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]

      if 0.0 < (exp.f64 a)

      1. Initial program 71.0%

        \[\log \left(e^{a} + e^{b}\right) \]
      2. Add Preprocessing
    8. Recombined 2 regimes into one program.
    9. Add Preprocessing

    Alternative 2: 98.8% accurate, 0.5× speedup?

    \[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} t_0 := 1 + e^{a}\\ \mathsf{fma}\left(b, \mathsf{fma}\left(\mathsf{fma}\left(b, 0.5, 1\right), \frac{1}{t\_0}, \frac{b \cdot -0.5}{{t\_0}^{2}}\right), \mathsf{log1p}\left(e^{a}\right)\right) \end{array} \end{array} \]
    NOTE: a and b should be sorted in increasing order before calling this function.
    (FPCore (a b)
     :precision binary64
     (let* ((t_0 (+ 1.0 (exp a))))
       (fma
        b
        (fma (fma b 0.5 1.0) (/ 1.0 t_0) (/ (* b -0.5) (pow t_0 2.0)))
        (log1p (exp a)))))
    assert(a < b);
    double code(double a, double b) {
    	double t_0 = 1.0 + exp(a);
    	return fma(b, fma(fma(b, 0.5, 1.0), (1.0 / t_0), ((b * -0.5) / pow(t_0, 2.0))), log1p(exp(a)));
    }
    
    a, b = sort([a, b])
    function code(a, b)
    	t_0 = Float64(1.0 + exp(a))
    	return fma(b, fma(fma(b, 0.5, 1.0), Float64(1.0 / t_0), Float64(Float64(b * -0.5) / (t_0 ^ 2.0))), log1p(exp(a)))
    end
    
    NOTE: a and b should be sorted in increasing order before calling this function.
    code[a_, b_] := Block[{t$95$0 = N[(1.0 + N[Exp[a], $MachinePrecision]), $MachinePrecision]}, N[(b * N[(N[(b * 0.5 + 1.0), $MachinePrecision] * N[(1.0 / t$95$0), $MachinePrecision] + N[(N[(b * -0.5), $MachinePrecision] / N[Power[t$95$0, 2.0], $MachinePrecision]), $MachinePrecision]), $MachinePrecision] + N[Log[1 + N[Exp[a], $MachinePrecision]], $MachinePrecision]), $MachinePrecision]]
    
    \begin{array}{l}
    [a, b] = \mathsf{sort}([a, b])\\
    \\
    \begin{array}{l}
    t_0 := 1 + e^{a}\\
    \mathsf{fma}\left(b, \mathsf{fma}\left(\mathsf{fma}\left(b, 0.5, 1\right), \frac{1}{t\_0}, \frac{b \cdot -0.5}{{t\_0}^{2}}\right), \mathsf{log1p}\left(e^{a}\right)\right)
    \end{array}
    \end{array}
    
    Derivation
    1. Initial program 53.2%

      \[\log \left(e^{a} + e^{b}\right) \]
    2. Add Preprocessing
    3. Taylor expanded in b around 0

      \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \left(\frac{1}{2} \cdot \left(b \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right) + \frac{1}{1 + e^{a}}\right)} \]
    4. Step-by-step derivation
      1. +-commutativeN/A

        \[\leadsto \color{blue}{b \cdot \left(\frac{1}{2} \cdot \left(b \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right) + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right)} \]
      2. associate-*r*N/A

        \[\leadsto b \cdot \left(\color{blue}{\left(\frac{1}{2} \cdot b\right) \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)} + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right) \]
      3. *-commutativeN/A

        \[\leadsto b \cdot \left(\color{blue}{\left(b \cdot \frac{1}{2}\right)} \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right) + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right) \]
      4. associate-*r*N/A

        \[\leadsto b \cdot \left(\color{blue}{b \cdot \left(\frac{1}{2} \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right)} + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right) \]
      5. lower-fma.f64N/A

        \[\leadsto \color{blue}{\mathsf{fma}\left(b, b \cdot \left(\frac{1}{2} \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right) + \frac{1}{1 + e^{a}}, \log \left(1 + e^{a}\right)\right)} \]
    5. Applied rewrites77.4%

      \[\leadsto \color{blue}{\mathsf{fma}\left(b, \mathsf{fma}\left(\mathsf{fma}\left(b, 0.5, 1\right), \frac{1}{1 + e^{a}}, \frac{b \cdot -0.5}{{\left(1 + e^{a}\right)}^{2}}\right), \mathsf{log1p}\left(e^{a}\right)\right)} \]
    6. Add Preprocessing

    Alternative 3: 98.5% accurate, 0.9× speedup?

    \[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} \leq 0:\\ \;\;\;\;\frac{b}{1 + e^{a}}\\ \mathbf{else}:\\ \;\;\;\;\log \left(e^{a} + \mathsf{fma}\left(b, \mathsf{fma}\left(b, \mathsf{fma}\left(b, 0.16666666666666666, 0.5\right), 1\right), 1\right)\right)\\ \end{array} \end{array} \]
    NOTE: a and b should be sorted in increasing order before calling this function.
    (FPCore (a b)
     :precision binary64
     (if (<= (exp a) 0.0)
       (/ b (+ 1.0 (exp a)))
       (log (+ (exp a) (fma b (fma b (fma b 0.16666666666666666 0.5) 1.0) 1.0)))))
    assert(a < b);
    double code(double a, double b) {
    	double tmp;
    	if (exp(a) <= 0.0) {
    		tmp = b / (1.0 + exp(a));
    	} else {
    		tmp = log((exp(a) + fma(b, fma(b, fma(b, 0.16666666666666666, 0.5), 1.0), 1.0)));
    	}
    	return tmp;
    }
    
    a, b = sort([a, b])
    function code(a, b)
    	tmp = 0.0
    	if (exp(a) <= 0.0)
    		tmp = Float64(b / Float64(1.0 + exp(a)));
    	else
    		tmp = log(Float64(exp(a) + fma(b, fma(b, fma(b, 0.16666666666666666, 0.5), 1.0), 1.0)));
    	end
    	return tmp
    end
    
    NOTE: a and b should be sorted in increasing order before calling this function.
    code[a_, b_] := If[LessEqual[N[Exp[a], $MachinePrecision], 0.0], N[(b / N[(1.0 + N[Exp[a], $MachinePrecision]), $MachinePrecision]), $MachinePrecision], N[Log[N[(N[Exp[a], $MachinePrecision] + N[(b * N[(b * N[(b * 0.16666666666666666 + 0.5), $MachinePrecision] + 1.0), $MachinePrecision] + 1.0), $MachinePrecision]), $MachinePrecision]], $MachinePrecision]]
    
    \begin{array}{l}
    [a, b] = \mathsf{sort}([a, b])\\
    \\
    \begin{array}{l}
    \mathbf{if}\;e^{a} \leq 0:\\
    \;\;\;\;\frac{b}{1 + e^{a}}\\
    
    \mathbf{else}:\\
    \;\;\;\;\log \left(e^{a} + \mathsf{fma}\left(b, \mathsf{fma}\left(b, \mathsf{fma}\left(b, 0.16666666666666666, 0.5\right), 1\right), 1\right)\right)\\
    
    
    \end{array}
    \end{array}
    
    Derivation
    1. Split input into 2 regimes
    2. if (exp.f64 a) < 0.0

      1. Initial program 9.5%

        \[\log \left(e^{a} + e^{b}\right) \]
      2. Add Preprocessing
      3. Taylor expanded in b around 0

        \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
      4. Step-by-step derivation
        1. *-rgt-identityN/A

          \[\leadsto \log \left(1 + e^{a}\right) + \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} \]
        2. associate-*r/N/A

          \[\leadsto \log \left(1 + e^{a}\right) + \color{blue}{b \cdot \frac{1}{1 + e^{a}}} \]
        3. lower-+.f64N/A

          \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \frac{1}{1 + e^{a}}} \]
        4. lower-log1p.f64N/A

          \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} + b \cdot \frac{1}{1 + e^{a}} \]
        5. lower-exp.f64N/A

          \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) + b \cdot \frac{1}{1 + e^{a}} \]
        6. associate-*r/N/A

          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} \]
        7. *-rgt-identityN/A

          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{\color{blue}{b}}{1 + e^{a}} \]
        8. lower-/.f64N/A

          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b}{1 + e^{a}}} \]
        9. lower-+.f64N/A

          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{\color{blue}{1 + e^{a}}} \]
        10. lower-exp.f64100.0

          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + \color{blue}{e^{a}}} \]
      5. Applied rewrites100.0%

        \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}}} \]
      6. Taylor expanded in b around inf

        \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
      7. Step-by-step derivation
        1. Applied rewrites100.0%

          \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]

        if 0.0 < (exp.f64 a)

        1. Initial program 71.0%

          \[\log \left(e^{a} + e^{b}\right) \]
        2. Add Preprocessing
        3. Taylor expanded in b around 0

          \[\leadsto \log \left(e^{a} + \color{blue}{\left(1 + b \cdot \left(1 + b \cdot \left(\frac{1}{2} + \frac{1}{6} \cdot b\right)\right)\right)}\right) \]
        4. Step-by-step derivation
          1. +-commutativeN/A

            \[\leadsto \log \left(e^{a} + \color{blue}{\left(b \cdot \left(1 + b \cdot \left(\frac{1}{2} + \frac{1}{6} \cdot b\right)\right) + 1\right)}\right) \]
          2. lower-fma.f64N/A

            \[\leadsto \log \left(e^{a} + \color{blue}{\mathsf{fma}\left(b, 1 + b \cdot \left(\frac{1}{2} + \frac{1}{6} \cdot b\right), 1\right)}\right) \]
          3. +-commutativeN/A

            \[\leadsto \log \left(e^{a} + \mathsf{fma}\left(b, \color{blue}{b \cdot \left(\frac{1}{2} + \frac{1}{6} \cdot b\right) + 1}, 1\right)\right) \]
          4. lower-fma.f64N/A

            \[\leadsto \log \left(e^{a} + \mathsf{fma}\left(b, \color{blue}{\mathsf{fma}\left(b, \frac{1}{2} + \frac{1}{6} \cdot b, 1\right)}, 1\right)\right) \]
          5. +-commutativeN/A

            \[\leadsto \log \left(e^{a} + \mathsf{fma}\left(b, \mathsf{fma}\left(b, \color{blue}{\frac{1}{6} \cdot b + \frac{1}{2}}, 1\right), 1\right)\right) \]
          6. *-commutativeN/A

            \[\leadsto \log \left(e^{a} + \mathsf{fma}\left(b, \mathsf{fma}\left(b, \color{blue}{b \cdot \frac{1}{6}} + \frac{1}{2}, 1\right), 1\right)\right) \]
          7. lower-fma.f6467.6

            \[\leadsto \log \left(e^{a} + \mathsf{fma}\left(b, \mathsf{fma}\left(b, \color{blue}{\mathsf{fma}\left(b, 0.16666666666666666, 0.5\right)}, 1\right), 1\right)\right) \]
        5. Applied rewrites67.6%

          \[\leadsto \log \left(e^{a} + \color{blue}{\mathsf{fma}\left(b, \mathsf{fma}\left(b, \mathsf{fma}\left(b, 0.16666666666666666, 0.5\right), 1\right), 1\right)}\right) \]
      8. Recombined 2 regimes into one program.
      9. Add Preprocessing

      Alternative 4: 98.7% accurate, 1.0× speedup?

      \[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} \leq 0:\\ \;\;\;\;\frac{b}{1 + e^{a}}\\ \mathbf{else}:\\ \;\;\;\;\mathsf{fma}\left(b, \mathsf{fma}\left(b, 0.125, 0.5\right), \mathsf{log1p}\left(e^{a}\right)\right)\\ \end{array} \end{array} \]
      NOTE: a and b should be sorted in increasing order before calling this function.
      (FPCore (a b)
       :precision binary64
       (if (<= (exp a) 0.0)
         (/ b (+ 1.0 (exp a)))
         (fma b (fma b 0.125 0.5) (log1p (exp a)))))
      assert(a < b);
      double code(double a, double b) {
      	double tmp;
      	if (exp(a) <= 0.0) {
      		tmp = b / (1.0 + exp(a));
      	} else {
      		tmp = fma(b, fma(b, 0.125, 0.5), log1p(exp(a)));
      	}
      	return tmp;
      }
      
      a, b = sort([a, b])
      function code(a, b)
      	tmp = 0.0
      	if (exp(a) <= 0.0)
      		tmp = Float64(b / Float64(1.0 + exp(a)));
      	else
      		tmp = fma(b, fma(b, 0.125, 0.5), log1p(exp(a)));
      	end
      	return tmp
      end
      
      NOTE: a and b should be sorted in increasing order before calling this function.
      code[a_, b_] := If[LessEqual[N[Exp[a], $MachinePrecision], 0.0], N[(b / N[(1.0 + N[Exp[a], $MachinePrecision]), $MachinePrecision]), $MachinePrecision], N[(b * N[(b * 0.125 + 0.5), $MachinePrecision] + N[Log[1 + N[Exp[a], $MachinePrecision]], $MachinePrecision]), $MachinePrecision]]
      
      \begin{array}{l}
      [a, b] = \mathsf{sort}([a, b])\\
      \\
      \begin{array}{l}
      \mathbf{if}\;e^{a} \leq 0:\\
      \;\;\;\;\frac{b}{1 + e^{a}}\\
      
      \mathbf{else}:\\
      \;\;\;\;\mathsf{fma}\left(b, \mathsf{fma}\left(b, 0.125, 0.5\right), \mathsf{log1p}\left(e^{a}\right)\right)\\
      
      
      \end{array}
      \end{array}
      
      Derivation
      1. Split input into 2 regimes
      2. if (exp.f64 a) < 0.0

        1. Initial program 9.5%

          \[\log \left(e^{a} + e^{b}\right) \]
        2. Add Preprocessing
        3. Taylor expanded in b around 0

          \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
        4. Step-by-step derivation
          1. *-rgt-identityN/A

            \[\leadsto \log \left(1 + e^{a}\right) + \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} \]
          2. associate-*r/N/A

            \[\leadsto \log \left(1 + e^{a}\right) + \color{blue}{b \cdot \frac{1}{1 + e^{a}}} \]
          3. lower-+.f64N/A

            \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \frac{1}{1 + e^{a}}} \]
          4. lower-log1p.f64N/A

            \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} + b \cdot \frac{1}{1 + e^{a}} \]
          5. lower-exp.f64N/A

            \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) + b \cdot \frac{1}{1 + e^{a}} \]
          6. associate-*r/N/A

            \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} \]
          7. *-rgt-identityN/A

            \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{\color{blue}{b}}{1 + e^{a}} \]
          8. lower-/.f64N/A

            \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b}{1 + e^{a}}} \]
          9. lower-+.f64N/A

            \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{\color{blue}{1 + e^{a}}} \]
          10. lower-exp.f64100.0

            \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + \color{blue}{e^{a}}} \]
        5. Applied rewrites100.0%

          \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}}} \]
        6. Taylor expanded in b around inf

          \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
        7. Step-by-step derivation
          1. Applied rewrites100.0%

            \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]

          if 0.0 < (exp.f64 a)

          1. Initial program 71.0%

            \[\log \left(e^{a} + e^{b}\right) \]
          2. Add Preprocessing
          3. Taylor expanded in b around 0

            \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \left(\frac{1}{2} \cdot \left(b \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right) + \frac{1}{1 + e^{a}}\right)} \]
          4. Step-by-step derivation
            1. +-commutativeN/A

              \[\leadsto \color{blue}{b \cdot \left(\frac{1}{2} \cdot \left(b \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right) + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right)} \]
            2. associate-*r*N/A

              \[\leadsto b \cdot \left(\color{blue}{\left(\frac{1}{2} \cdot b\right) \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)} + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right) \]
            3. *-commutativeN/A

              \[\leadsto b \cdot \left(\color{blue}{\left(b \cdot \frac{1}{2}\right)} \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right) + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right) \]
            4. associate-*r*N/A

              \[\leadsto b \cdot \left(\color{blue}{b \cdot \left(\frac{1}{2} \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right)} + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right) \]
            5. lower-fma.f64N/A

              \[\leadsto \color{blue}{\mathsf{fma}\left(b, b \cdot \left(\frac{1}{2} \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right) + \frac{1}{1 + e^{a}}, \log \left(1 + e^{a}\right)\right)} \]
          5. Applied rewrites68.3%

            \[\leadsto \color{blue}{\mathsf{fma}\left(b, \mathsf{fma}\left(\mathsf{fma}\left(b, 0.5, 1\right), \frac{1}{1 + e^{a}}, \frac{b \cdot -0.5}{{\left(1 + e^{a}\right)}^{2}}\right), \mathsf{log1p}\left(e^{a}\right)\right)} \]
          6. Taylor expanded in a around 0

            \[\leadsto \mathsf{fma}\left(b, \frac{1}{2} + \color{blue}{\left(\frac{-1}{8} \cdot b + \frac{1}{4} \cdot b\right)}, \mathsf{log1p}\left(e^{a}\right)\right) \]
          7. Step-by-step derivation
            1. Applied rewrites68.1%

              \[\leadsto \mathsf{fma}\left(b, \mathsf{fma}\left(b, \color{blue}{0.125}, 0.5\right), \mathsf{log1p}\left(e^{a}\right)\right) \]
          8. Recombined 2 regimes into one program.
          9. Add Preprocessing

          Alternative 5: 98.6% accurate, 1.0× speedup?

          \[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}} \end{array} \]
          NOTE: a and b should be sorted in increasing order before calling this function.
          (FPCore (a b) :precision binary64 (+ (log1p (exp a)) (/ b (+ 1.0 (exp a)))))
          assert(a < b);
          double code(double a, double b) {
          	return log1p(exp(a)) + (b / (1.0 + exp(a)));
          }
          
          assert a < b;
          public static double code(double a, double b) {
          	return Math.log1p(Math.exp(a)) + (b / (1.0 + Math.exp(a)));
          }
          
          [a, b] = sort([a, b])
          def code(a, b):
          	return math.log1p(math.exp(a)) + (b / (1.0 + math.exp(a)))
          
          a, b = sort([a, b])
          function code(a, b)
          	return Float64(log1p(exp(a)) + Float64(b / Float64(1.0 + exp(a))))
          end
          
          NOTE: a and b should be sorted in increasing order before calling this function.
          code[a_, b_] := N[(N[Log[1 + N[Exp[a], $MachinePrecision]], $MachinePrecision] + N[(b / N[(1.0 + N[Exp[a], $MachinePrecision]), $MachinePrecision]), $MachinePrecision]), $MachinePrecision]
          
          \begin{array}{l}
          [a, b] = \mathsf{sort}([a, b])\\
          \\
          \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}}
          \end{array}
          
          Derivation
          1. Initial program 53.2%

            \[\log \left(e^{a} + e^{b}\right) \]
          2. Add Preprocessing
          3. Taylor expanded in b around 0

            \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
          4. Step-by-step derivation
            1. *-rgt-identityN/A

              \[\leadsto \log \left(1 + e^{a}\right) + \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} \]
            2. associate-*r/N/A

              \[\leadsto \log \left(1 + e^{a}\right) + \color{blue}{b \cdot \frac{1}{1 + e^{a}}} \]
            3. lower-+.f64N/A

              \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \frac{1}{1 + e^{a}}} \]
            4. lower-log1p.f64N/A

              \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} + b \cdot \frac{1}{1 + e^{a}} \]
            5. lower-exp.f64N/A

              \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) + b \cdot \frac{1}{1 + e^{a}} \]
            6. associate-*r/N/A

              \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} \]
            7. *-rgt-identityN/A

              \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{\color{blue}{b}}{1 + e^{a}} \]
            8. lower-/.f64N/A

              \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b}{1 + e^{a}}} \]
            9. lower-+.f64N/A

              \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{\color{blue}{1 + e^{a}}} \]
            10. lower-exp.f6477.3

              \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + \color{blue}{e^{a}}} \]
          5. Applied rewrites77.3%

            \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}}} \]
          6. Add Preprocessing

          Alternative 6: 56.4% accurate, 1.0× speedup?

          \[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} + e^{b} \leq 1.1:\\ \;\;\;\;b \cdot 0.5\\ \mathbf{else}:\\ \;\;\;\;\mathsf{fma}\left(b, 0.5, \log 2\right)\\ \end{array} \end{array} \]
          NOTE: a and b should be sorted in increasing order before calling this function.
          (FPCore (a b)
           :precision binary64
           (if (<= (+ (exp a) (exp b)) 1.1) (* b 0.5) (fma b 0.5 (log 2.0))))
          assert(a < b);
          double code(double a, double b) {
          	double tmp;
          	if ((exp(a) + exp(b)) <= 1.1) {
          		tmp = b * 0.5;
          	} else {
          		tmp = fma(b, 0.5, log(2.0));
          	}
          	return tmp;
          }
          
          a, b = sort([a, b])
          function code(a, b)
          	tmp = 0.0
          	if (Float64(exp(a) + exp(b)) <= 1.1)
          		tmp = Float64(b * 0.5);
          	else
          		tmp = fma(b, 0.5, log(2.0));
          	end
          	return tmp
          end
          
          NOTE: a and b should be sorted in increasing order before calling this function.
          code[a_, b_] := If[LessEqual[N[(N[Exp[a], $MachinePrecision] + N[Exp[b], $MachinePrecision]), $MachinePrecision], 1.1], N[(b * 0.5), $MachinePrecision], N[(b * 0.5 + N[Log[2.0], $MachinePrecision]), $MachinePrecision]]
          
          \begin{array}{l}
          [a, b] = \mathsf{sort}([a, b])\\
          \\
          \begin{array}{l}
          \mathbf{if}\;e^{a} + e^{b} \leq 1.1:\\
          \;\;\;\;b \cdot 0.5\\
          
          \mathbf{else}:\\
          \;\;\;\;\mathsf{fma}\left(b, 0.5, \log 2\right)\\
          
          
          \end{array}
          \end{array}
          
          Derivation
          1. Split input into 2 regimes
          2. if (+.f64 (exp.f64 a) (exp.f64 b)) < 1.1000000000000001

            1. Initial program 9.4%

              \[\log \left(e^{a} + e^{b}\right) \]
            2. Add Preprocessing
            3. Taylor expanded in b around 0

              \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
            4. Step-by-step derivation
              1. *-rgt-identityN/A

                \[\leadsto \log \left(1 + e^{a}\right) + \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} \]
              2. associate-*r/N/A

                \[\leadsto \log \left(1 + e^{a}\right) + \color{blue}{b \cdot \frac{1}{1 + e^{a}}} \]
              3. lower-+.f64N/A

                \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \frac{1}{1 + e^{a}}} \]
              4. lower-log1p.f64N/A

                \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} + b \cdot \frac{1}{1 + e^{a}} \]
              5. lower-exp.f64N/A

                \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) + b \cdot \frac{1}{1 + e^{a}} \]
              6. associate-*r/N/A

                \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} \]
              7. *-rgt-identityN/A

                \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{\color{blue}{b}}{1 + e^{a}} \]
              8. lower-/.f64N/A

                \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b}{1 + e^{a}}} \]
              9. lower-+.f64N/A

                \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{\color{blue}{1 + e^{a}}} \]
              10. lower-exp.f6457.7

                \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + \color{blue}{e^{a}}} \]
            5. Applied rewrites57.7%

              \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}}} \]
            6. Taylor expanded in b around inf

              \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
            7. Step-by-step derivation
              1. Applied rewrites57.7%

                \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
              2. Taylor expanded in a around 0

                \[\leadsto \frac{1}{2} \cdot b \]
              3. Step-by-step derivation
                1. Applied rewrites11.8%

                  \[\leadsto b \cdot 0.5 \]

                if 1.1000000000000001 < (+.f64 (exp.f64 a) (exp.f64 b))

                1. Initial program 99.1%

                  \[\log \left(e^{a} + e^{b}\right) \]
                2. Add Preprocessing
                3. Taylor expanded in b around 0

                  \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                4. Step-by-step derivation
                  1. *-rgt-identityN/A

                    \[\leadsto \log \left(1 + e^{a}\right) + \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} \]
                  2. associate-*r/N/A

                    \[\leadsto \log \left(1 + e^{a}\right) + \color{blue}{b \cdot \frac{1}{1 + e^{a}}} \]
                  3. lower-+.f64N/A

                    \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \frac{1}{1 + e^{a}}} \]
                  4. lower-log1p.f64N/A

                    \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} + b \cdot \frac{1}{1 + e^{a}} \]
                  5. lower-exp.f64N/A

                    \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) + b \cdot \frac{1}{1 + e^{a}} \]
                  6. associate-*r/N/A

                    \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} \]
                  7. *-rgt-identityN/A

                    \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{\color{blue}{b}}{1 + e^{a}} \]
                  8. lower-/.f64N/A

                    \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b}{1 + e^{a}}} \]
                  9. lower-+.f64N/A

                    \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{\color{blue}{1 + e^{a}}} \]
                  10. lower-exp.f6497.9

                    \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + \color{blue}{e^{a}}} \]
                5. Applied rewrites97.9%

                  \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                6. Taylor expanded in a around 0

                  \[\leadsto \log 2 + \color{blue}{\frac{1}{2} \cdot b} \]
                7. Step-by-step derivation
                  1. Applied rewrites95.2%

                    \[\leadsto \mathsf{fma}\left(b, \color{blue}{0.5}, \log 2\right) \]
                8. Recombined 2 regimes into one program.
                9. Add Preprocessing

                Alternative 7: 98.2% accurate, 1.2× speedup?

                \[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} \leq 0:\\ \;\;\;\;\frac{b}{1 + e^{a}}\\ \mathbf{else}:\\ \;\;\;\;\mathsf{fma}\left(b, \mathsf{fma}\left(b, 0.125, 0.5\right), \mathsf{fma}\left(a, \mathsf{fma}\left(a, \mathsf{fma}\left(b, b \cdot -0.03125, 0.125\right), \mathsf{fma}\left(b, -0.25, 0.5\right)\right), \log 2\right)\right)\\ \end{array} \end{array} \]
                NOTE: a and b should be sorted in increasing order before calling this function.
                (FPCore (a b)
                 :precision binary64
                 (if (<= (exp a) 0.0)
                   (/ b (+ 1.0 (exp a)))
                   (fma
                    b
                    (fma b 0.125 0.5)
                    (fma a (fma a (fma b (* b -0.03125) 0.125) (fma b -0.25 0.5)) (log 2.0)))))
                assert(a < b);
                double code(double a, double b) {
                	double tmp;
                	if (exp(a) <= 0.0) {
                		tmp = b / (1.0 + exp(a));
                	} else {
                		tmp = fma(b, fma(b, 0.125, 0.5), fma(a, fma(a, fma(b, (b * -0.03125), 0.125), fma(b, -0.25, 0.5)), log(2.0)));
                	}
                	return tmp;
                }
                
                a, b = sort([a, b])
                function code(a, b)
                	tmp = 0.0
                	if (exp(a) <= 0.0)
                		tmp = Float64(b / Float64(1.0 + exp(a)));
                	else
                		tmp = fma(b, fma(b, 0.125, 0.5), fma(a, fma(a, fma(b, Float64(b * -0.03125), 0.125), fma(b, -0.25, 0.5)), log(2.0)));
                	end
                	return tmp
                end
                
                NOTE: a and b should be sorted in increasing order before calling this function.
                code[a_, b_] := If[LessEqual[N[Exp[a], $MachinePrecision], 0.0], N[(b / N[(1.0 + N[Exp[a], $MachinePrecision]), $MachinePrecision]), $MachinePrecision], N[(b * N[(b * 0.125 + 0.5), $MachinePrecision] + N[(a * N[(a * N[(b * N[(b * -0.03125), $MachinePrecision] + 0.125), $MachinePrecision] + N[(b * -0.25 + 0.5), $MachinePrecision]), $MachinePrecision] + N[Log[2.0], $MachinePrecision]), $MachinePrecision]), $MachinePrecision]]
                
                \begin{array}{l}
                [a, b] = \mathsf{sort}([a, b])\\
                \\
                \begin{array}{l}
                \mathbf{if}\;e^{a} \leq 0:\\
                \;\;\;\;\frac{b}{1 + e^{a}}\\
                
                \mathbf{else}:\\
                \;\;\;\;\mathsf{fma}\left(b, \mathsf{fma}\left(b, 0.125, 0.5\right), \mathsf{fma}\left(a, \mathsf{fma}\left(a, \mathsf{fma}\left(b, b \cdot -0.03125, 0.125\right), \mathsf{fma}\left(b, -0.25, 0.5\right)\right), \log 2\right)\right)\\
                
                
                \end{array}
                \end{array}
                
                Derivation
                1. Split input into 2 regimes
                2. if (exp.f64 a) < 0.0

                  1. Initial program 9.5%

                    \[\log \left(e^{a} + e^{b}\right) \]
                  2. Add Preprocessing
                  3. Taylor expanded in b around 0

                    \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                  4. Step-by-step derivation
                    1. *-rgt-identityN/A

                      \[\leadsto \log \left(1 + e^{a}\right) + \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} \]
                    2. associate-*r/N/A

                      \[\leadsto \log \left(1 + e^{a}\right) + \color{blue}{b \cdot \frac{1}{1 + e^{a}}} \]
                    3. lower-+.f64N/A

                      \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \frac{1}{1 + e^{a}}} \]
                    4. lower-log1p.f64N/A

                      \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} + b \cdot \frac{1}{1 + e^{a}} \]
                    5. lower-exp.f64N/A

                      \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) + b \cdot \frac{1}{1 + e^{a}} \]
                    6. associate-*r/N/A

                      \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} \]
                    7. *-rgt-identityN/A

                      \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{\color{blue}{b}}{1 + e^{a}} \]
                    8. lower-/.f64N/A

                      \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b}{1 + e^{a}}} \]
                    9. lower-+.f64N/A

                      \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{\color{blue}{1 + e^{a}}} \]
                    10. lower-exp.f64100.0

                      \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + \color{blue}{e^{a}}} \]
                  5. Applied rewrites100.0%

                    \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                  6. Taylor expanded in b around inf

                    \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
                  7. Step-by-step derivation
                    1. Applied rewrites100.0%

                      \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]

                    if 0.0 < (exp.f64 a)

                    1. Initial program 71.0%

                      \[\log \left(e^{a} + e^{b}\right) \]
                    2. Add Preprocessing
                    3. Taylor expanded in b around 0

                      \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \left(\frac{1}{2} \cdot \left(b \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right) + \frac{1}{1 + e^{a}}\right)} \]
                    4. Step-by-step derivation
                      1. +-commutativeN/A

                        \[\leadsto \color{blue}{b \cdot \left(\frac{1}{2} \cdot \left(b \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right) + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right)} \]
                      2. associate-*r*N/A

                        \[\leadsto b \cdot \left(\color{blue}{\left(\frac{1}{2} \cdot b\right) \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)} + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right) \]
                      3. *-commutativeN/A

                        \[\leadsto b \cdot \left(\color{blue}{\left(b \cdot \frac{1}{2}\right)} \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right) + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right) \]
                      4. associate-*r*N/A

                        \[\leadsto b \cdot \left(\color{blue}{b \cdot \left(\frac{1}{2} \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right)} + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right) \]
                      5. lower-fma.f64N/A

                        \[\leadsto \color{blue}{\mathsf{fma}\left(b, b \cdot \left(\frac{1}{2} \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right) + \frac{1}{1 + e^{a}}, \log \left(1 + e^{a}\right)\right)} \]
                    5. Applied rewrites68.3%

                      \[\leadsto \color{blue}{\mathsf{fma}\left(b, \mathsf{fma}\left(\mathsf{fma}\left(b, 0.5, 1\right), \frac{1}{1 + e^{a}}, \frac{b \cdot -0.5}{{\left(1 + e^{a}\right)}^{2}}\right), \mathsf{log1p}\left(e^{a}\right)\right)} \]
                    6. Taylor expanded in a around 0

                      \[\leadsto \log 2 + \color{blue}{\left(a \cdot \left(\frac{1}{2} + \left(a \cdot \left(\frac{1}{8} + b \cdot \left(\frac{-1}{2} \cdot \left(\frac{-1}{8} \cdot b + \frac{1}{8} \cdot b\right) + \frac{1}{2} \cdot \left(\frac{-1}{4} \cdot b + \frac{3}{16} \cdot b\right)\right)\right) + b \cdot \left(\left(\frac{-1}{8} \cdot b + \frac{1}{8} \cdot b\right) - \frac{1}{4}\right)\right)\right) + b \cdot \left(\frac{1}{2} + \left(\frac{-1}{8} \cdot b + \frac{1}{4} \cdot b\right)\right)\right)} \]
                    7. Applied rewrites67.6%

                      \[\leadsto \mathsf{fma}\left(b, \color{blue}{\mathsf{fma}\left(b, 0.125, 0.5\right)}, \mathsf{fma}\left(a, \mathsf{fma}\left(a, \mathsf{fma}\left(b, b \cdot -0.03125, 0.125\right), \mathsf{fma}\left(b, -0.25, 0.5\right)\right), \log 2\right)\right) \]
                  8. Recombined 2 regimes into one program.
                  9. Add Preprocessing

                  Alternative 8: 98.1% accurate, 1.3× speedup?

                  \[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} \leq 0:\\ \;\;\;\;\frac{b}{1 + e^{a}}\\ \mathbf{else}:\\ \;\;\;\;\log \left(\mathsf{fma}\left(a, \mathsf{fma}\left(a, 0.5, 1\right), 1\right) + \mathsf{fma}\left(b, \mathsf{fma}\left(b, 0.5, 1\right), 1\right)\right)\\ \end{array} \end{array} \]
                  NOTE: a and b should be sorted in increasing order before calling this function.
                  (FPCore (a b)
                   :precision binary64
                   (if (<= (exp a) 0.0)
                     (/ b (+ 1.0 (exp a)))
                     (log (+ (fma a (fma a 0.5 1.0) 1.0) (fma b (fma b 0.5 1.0) 1.0)))))
                  assert(a < b);
                  double code(double a, double b) {
                  	double tmp;
                  	if (exp(a) <= 0.0) {
                  		tmp = b / (1.0 + exp(a));
                  	} else {
                  		tmp = log((fma(a, fma(a, 0.5, 1.0), 1.0) + fma(b, fma(b, 0.5, 1.0), 1.0)));
                  	}
                  	return tmp;
                  }
                  
                  a, b = sort([a, b])
                  function code(a, b)
                  	tmp = 0.0
                  	if (exp(a) <= 0.0)
                  		tmp = Float64(b / Float64(1.0 + exp(a)));
                  	else
                  		tmp = log(Float64(fma(a, fma(a, 0.5, 1.0), 1.0) + fma(b, fma(b, 0.5, 1.0), 1.0)));
                  	end
                  	return tmp
                  end
                  
                  NOTE: a and b should be sorted in increasing order before calling this function.
                  code[a_, b_] := If[LessEqual[N[Exp[a], $MachinePrecision], 0.0], N[(b / N[(1.0 + N[Exp[a], $MachinePrecision]), $MachinePrecision]), $MachinePrecision], N[Log[N[(N[(a * N[(a * 0.5 + 1.0), $MachinePrecision] + 1.0), $MachinePrecision] + N[(b * N[(b * 0.5 + 1.0), $MachinePrecision] + 1.0), $MachinePrecision]), $MachinePrecision]], $MachinePrecision]]
                  
                  \begin{array}{l}
                  [a, b] = \mathsf{sort}([a, b])\\
                  \\
                  \begin{array}{l}
                  \mathbf{if}\;e^{a} \leq 0:\\
                  \;\;\;\;\frac{b}{1 + e^{a}}\\
                  
                  \mathbf{else}:\\
                  \;\;\;\;\log \left(\mathsf{fma}\left(a, \mathsf{fma}\left(a, 0.5, 1\right), 1\right) + \mathsf{fma}\left(b, \mathsf{fma}\left(b, 0.5, 1\right), 1\right)\right)\\
                  
                  
                  \end{array}
                  \end{array}
                  
                  Derivation
                  1. Split input into 2 regimes
                  2. if (exp.f64 a) < 0.0

                    1. Initial program 9.5%

                      \[\log \left(e^{a} + e^{b}\right) \]
                    2. Add Preprocessing
                    3. Taylor expanded in b around 0

                      \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                    4. Step-by-step derivation
                      1. *-rgt-identityN/A

                        \[\leadsto \log \left(1 + e^{a}\right) + \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} \]
                      2. associate-*r/N/A

                        \[\leadsto \log \left(1 + e^{a}\right) + \color{blue}{b \cdot \frac{1}{1 + e^{a}}} \]
                      3. lower-+.f64N/A

                        \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \frac{1}{1 + e^{a}}} \]
                      4. lower-log1p.f64N/A

                        \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} + b \cdot \frac{1}{1 + e^{a}} \]
                      5. lower-exp.f64N/A

                        \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) + b \cdot \frac{1}{1 + e^{a}} \]
                      6. associate-*r/N/A

                        \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} \]
                      7. *-rgt-identityN/A

                        \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{\color{blue}{b}}{1 + e^{a}} \]
                      8. lower-/.f64N/A

                        \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b}{1 + e^{a}}} \]
                      9. lower-+.f64N/A

                        \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{\color{blue}{1 + e^{a}}} \]
                      10. lower-exp.f64100.0

                        \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + \color{blue}{e^{a}}} \]
                    5. Applied rewrites100.0%

                      \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                    6. Taylor expanded in b around inf

                      \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
                    7. Step-by-step derivation
                      1. Applied rewrites100.0%

                        \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]

                      if 0.0 < (exp.f64 a)

                      1. Initial program 71.0%

                        \[\log \left(e^{a} + e^{b}\right) \]
                      2. Add Preprocessing
                      3. Taylor expanded in b around 0

                        \[\leadsto \log \left(e^{a} + \color{blue}{\left(1 + b \cdot \left(1 + \frac{1}{2} \cdot b\right)\right)}\right) \]
                      4. Step-by-step derivation
                        1. +-commutativeN/A

                          \[\leadsto \log \left(e^{a} + \color{blue}{\left(b \cdot \left(1 + \frac{1}{2} \cdot b\right) + 1\right)}\right) \]
                        2. lower-fma.f64N/A

                          \[\leadsto \log \left(e^{a} + \color{blue}{\mathsf{fma}\left(b, 1 + \frac{1}{2} \cdot b, 1\right)}\right) \]
                        3. +-commutativeN/A

                          \[\leadsto \log \left(e^{a} + \mathsf{fma}\left(b, \color{blue}{\frac{1}{2} \cdot b + 1}, 1\right)\right) \]
                        4. *-commutativeN/A

                          \[\leadsto \log \left(e^{a} + \mathsf{fma}\left(b, \color{blue}{b \cdot \frac{1}{2}} + 1, 1\right)\right) \]
                        5. lower-fma.f6468.3

                          \[\leadsto \log \left(e^{a} + \mathsf{fma}\left(b, \color{blue}{\mathsf{fma}\left(b, 0.5, 1\right)}, 1\right)\right) \]
                      5. Applied rewrites68.3%

                        \[\leadsto \log \left(e^{a} + \color{blue}{\mathsf{fma}\left(b, \mathsf{fma}\left(b, 0.5, 1\right), 1\right)}\right) \]
                      6. Taylor expanded in a around 0

                        \[\leadsto \log \left(\color{blue}{\left(1 + a \cdot \left(1 + \frac{1}{2} \cdot a\right)\right)} + \mathsf{fma}\left(b, \mathsf{fma}\left(b, \frac{1}{2}, 1\right), 1\right)\right) \]
                      7. Step-by-step derivation
                        1. +-commutativeN/A

                          \[\leadsto \log \left(\color{blue}{\left(a \cdot \left(1 + \frac{1}{2} \cdot a\right) + 1\right)} + \mathsf{fma}\left(b, \mathsf{fma}\left(b, \frac{1}{2}, 1\right), 1\right)\right) \]
                        2. lower-fma.f64N/A

                          \[\leadsto \log \left(\color{blue}{\mathsf{fma}\left(a, 1 + \frac{1}{2} \cdot a, 1\right)} + \mathsf{fma}\left(b, \mathsf{fma}\left(b, \frac{1}{2}, 1\right), 1\right)\right) \]
                        3. +-commutativeN/A

                          \[\leadsto \log \left(\mathsf{fma}\left(a, \color{blue}{\frac{1}{2} \cdot a + 1}, 1\right) + \mathsf{fma}\left(b, \mathsf{fma}\left(b, \frac{1}{2}, 1\right), 1\right)\right) \]
                        4. *-commutativeN/A

                          \[\leadsto \log \left(\mathsf{fma}\left(a, \color{blue}{a \cdot \frac{1}{2}} + 1, 1\right) + \mathsf{fma}\left(b, \mathsf{fma}\left(b, \frac{1}{2}, 1\right), 1\right)\right) \]
                        5. lower-fma.f6467.4

                          \[\leadsto \log \left(\mathsf{fma}\left(a, \color{blue}{\mathsf{fma}\left(a, 0.5, 1\right)}, 1\right) + \mathsf{fma}\left(b, \mathsf{fma}\left(b, 0.5, 1\right), 1\right)\right) \]
                      8. Applied rewrites67.4%

                        \[\leadsto \log \left(\color{blue}{\mathsf{fma}\left(a, \mathsf{fma}\left(a, 0.5, 1\right), 1\right)} + \mathsf{fma}\left(b, \mathsf{fma}\left(b, 0.5, 1\right), 1\right)\right) \]
                    8. Recombined 2 regimes into one program.
                    9. Add Preprocessing

                    Alternative 9: 98.1% accurate, 1.3× speedup?

                    \[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} \leq 0.2:\\ \;\;\;\;\frac{b}{1 + e^{a}}\\ \mathbf{else}:\\ \;\;\;\;\mathsf{fma}\left(b, \mathsf{fma}\left(b, 0.125, 0.5\right), \mathsf{fma}\left(a, \mathsf{fma}\left(b, -0.25, 0.5\right), \log 2\right)\right)\\ \end{array} \end{array} \]
                    NOTE: a and b should be sorted in increasing order before calling this function.
                    (FPCore (a b)
                     :precision binary64
                     (if (<= (exp a) 0.2)
                       (/ b (+ 1.0 (exp a)))
                       (fma b (fma b 0.125 0.5) (fma a (fma b -0.25 0.5) (log 2.0)))))
                    assert(a < b);
                    double code(double a, double b) {
                    	double tmp;
                    	if (exp(a) <= 0.2) {
                    		tmp = b / (1.0 + exp(a));
                    	} else {
                    		tmp = fma(b, fma(b, 0.125, 0.5), fma(a, fma(b, -0.25, 0.5), log(2.0)));
                    	}
                    	return tmp;
                    }
                    
                    a, b = sort([a, b])
                    function code(a, b)
                    	tmp = 0.0
                    	if (exp(a) <= 0.2)
                    		tmp = Float64(b / Float64(1.0 + exp(a)));
                    	else
                    		tmp = fma(b, fma(b, 0.125, 0.5), fma(a, fma(b, -0.25, 0.5), log(2.0)));
                    	end
                    	return tmp
                    end
                    
                    NOTE: a and b should be sorted in increasing order before calling this function.
                    code[a_, b_] := If[LessEqual[N[Exp[a], $MachinePrecision], 0.2], N[(b / N[(1.0 + N[Exp[a], $MachinePrecision]), $MachinePrecision]), $MachinePrecision], N[(b * N[(b * 0.125 + 0.5), $MachinePrecision] + N[(a * N[(b * -0.25 + 0.5), $MachinePrecision] + N[Log[2.0], $MachinePrecision]), $MachinePrecision]), $MachinePrecision]]
                    
                    \begin{array}{l}
                    [a, b] = \mathsf{sort}([a, b])\\
                    \\
                    \begin{array}{l}
                    \mathbf{if}\;e^{a} \leq 0.2:\\
                    \;\;\;\;\frac{b}{1 + e^{a}}\\
                    
                    \mathbf{else}:\\
                    \;\;\;\;\mathsf{fma}\left(b, \mathsf{fma}\left(b, 0.125, 0.5\right), \mathsf{fma}\left(a, \mathsf{fma}\left(b, -0.25, 0.5\right), \log 2\right)\right)\\
                    
                    
                    \end{array}
                    \end{array}
                    
                    Derivation
                    1. Split input into 2 regimes
                    2. if (exp.f64 a) < 0.20000000000000001

                      1. Initial program 10.7%

                        \[\log \left(e^{a} + e^{b}\right) \]
                      2. Add Preprocessing
                      3. Taylor expanded in b around 0

                        \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                      4. Step-by-step derivation
                        1. *-rgt-identityN/A

                          \[\leadsto \log \left(1 + e^{a}\right) + \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} \]
                        2. associate-*r/N/A

                          \[\leadsto \log \left(1 + e^{a}\right) + \color{blue}{b \cdot \frac{1}{1 + e^{a}}} \]
                        3. lower-+.f64N/A

                          \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \frac{1}{1 + e^{a}}} \]
                        4. lower-log1p.f64N/A

                          \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} + b \cdot \frac{1}{1 + e^{a}} \]
                        5. lower-exp.f64N/A

                          \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) + b \cdot \frac{1}{1 + e^{a}} \]
                        6. associate-*r/N/A

                          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} \]
                        7. *-rgt-identityN/A

                          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{\color{blue}{b}}{1 + e^{a}} \]
                        8. lower-/.f64N/A

                          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b}{1 + e^{a}}} \]
                        9. lower-+.f64N/A

                          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{\color{blue}{1 + e^{a}}} \]
                        10. lower-exp.f64100.0

                          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + \color{blue}{e^{a}}} \]
                      5. Applied rewrites100.0%

                        \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                      6. Taylor expanded in b around inf

                        \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
                      7. Step-by-step derivation
                        1. Applied rewrites98.7%

                          \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]

                        if 0.20000000000000001 < (exp.f64 a)

                        1. Initial program 70.8%

                          \[\log \left(e^{a} + e^{b}\right) \]
                        2. Add Preprocessing
                        3. Taylor expanded in b around 0

                          \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \left(\frac{1}{2} \cdot \left(b \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right) + \frac{1}{1 + e^{a}}\right)} \]
                        4. Step-by-step derivation
                          1. +-commutativeN/A

                            \[\leadsto \color{blue}{b \cdot \left(\frac{1}{2} \cdot \left(b \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right) + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right)} \]
                          2. associate-*r*N/A

                            \[\leadsto b \cdot \left(\color{blue}{\left(\frac{1}{2} \cdot b\right) \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)} + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right) \]
                          3. *-commutativeN/A

                            \[\leadsto b \cdot \left(\color{blue}{\left(b \cdot \frac{1}{2}\right)} \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right) + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right) \]
                          4. associate-*r*N/A

                            \[\leadsto b \cdot \left(\color{blue}{b \cdot \left(\frac{1}{2} \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right)} + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right) \]
                          5. lower-fma.f64N/A

                            \[\leadsto \color{blue}{\mathsf{fma}\left(b, b \cdot \left(\frac{1}{2} \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right) + \frac{1}{1 + e^{a}}, \log \left(1 + e^{a}\right)\right)} \]
                        5. Applied rewrites68.1%

                          \[\leadsto \color{blue}{\mathsf{fma}\left(b, \mathsf{fma}\left(\mathsf{fma}\left(b, 0.5, 1\right), \frac{1}{1 + e^{a}}, \frac{b \cdot -0.5}{{\left(1 + e^{a}\right)}^{2}}\right), \mathsf{log1p}\left(e^{a}\right)\right)} \]
                        6. Taylor expanded in a around 0

                          \[\leadsto \log 2 + \color{blue}{\left(a \cdot \left(\frac{1}{2} + b \cdot \left(\left(\frac{-1}{8} \cdot b + \frac{1}{8} \cdot b\right) - \frac{1}{4}\right)\right) + b \cdot \left(\frac{1}{2} + \left(\frac{-1}{8} \cdot b + \frac{1}{4} \cdot b\right)\right)\right)} \]
                        7. Step-by-step derivation
                          1. Applied rewrites67.2%

                            \[\leadsto \mathsf{fma}\left(b, \color{blue}{\mathsf{fma}\left(b, 0.125, 0.5\right)}, \mathsf{fma}\left(a, \mathsf{fma}\left(b, -0.25, 0.5\right), \log 2\right)\right) \]
                        8. Recombined 2 regimes into one program.
                        9. Add Preprocessing

                        Alternative 10: 98.1% accurate, 1.4× speedup?

                        \[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} \leq 0.2:\\ \;\;\;\;\frac{b}{1 + e^{a}}\\ \mathbf{else}:\\ \;\;\;\;\mathsf{fma}\left(b, \mathsf{fma}\left(b, 0.125, 0.5\right), \mathsf{log1p}\left(a + 1\right)\right)\\ \end{array} \end{array} \]
                        NOTE: a and b should be sorted in increasing order before calling this function.
                        (FPCore (a b)
                         :precision binary64
                         (if (<= (exp a) 0.2)
                           (/ b (+ 1.0 (exp a)))
                           (fma b (fma b 0.125 0.5) (log1p (+ a 1.0)))))
                        assert(a < b);
                        double code(double a, double b) {
                        	double tmp;
                        	if (exp(a) <= 0.2) {
                        		tmp = b / (1.0 + exp(a));
                        	} else {
                        		tmp = fma(b, fma(b, 0.125, 0.5), log1p((a + 1.0)));
                        	}
                        	return tmp;
                        }
                        
                        a, b = sort([a, b])
                        function code(a, b)
                        	tmp = 0.0
                        	if (exp(a) <= 0.2)
                        		tmp = Float64(b / Float64(1.0 + exp(a)));
                        	else
                        		tmp = fma(b, fma(b, 0.125, 0.5), log1p(Float64(a + 1.0)));
                        	end
                        	return tmp
                        end
                        
                        NOTE: a and b should be sorted in increasing order before calling this function.
                        code[a_, b_] := If[LessEqual[N[Exp[a], $MachinePrecision], 0.2], N[(b / N[(1.0 + N[Exp[a], $MachinePrecision]), $MachinePrecision]), $MachinePrecision], N[(b * N[(b * 0.125 + 0.5), $MachinePrecision] + N[Log[1 + N[(a + 1.0), $MachinePrecision]], $MachinePrecision]), $MachinePrecision]]
                        
                        \begin{array}{l}
                        [a, b] = \mathsf{sort}([a, b])\\
                        \\
                        \begin{array}{l}
                        \mathbf{if}\;e^{a} \leq 0.2:\\
                        \;\;\;\;\frac{b}{1 + e^{a}}\\
                        
                        \mathbf{else}:\\
                        \;\;\;\;\mathsf{fma}\left(b, \mathsf{fma}\left(b, 0.125, 0.5\right), \mathsf{log1p}\left(a + 1\right)\right)\\
                        
                        
                        \end{array}
                        \end{array}
                        
                        Derivation
                        1. Split input into 2 regimes
                        2. if (exp.f64 a) < 0.20000000000000001

                          1. Initial program 10.7%

                            \[\log \left(e^{a} + e^{b}\right) \]
                          2. Add Preprocessing
                          3. Taylor expanded in b around 0

                            \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                          4. Step-by-step derivation
                            1. *-rgt-identityN/A

                              \[\leadsto \log \left(1 + e^{a}\right) + \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} \]
                            2. associate-*r/N/A

                              \[\leadsto \log \left(1 + e^{a}\right) + \color{blue}{b \cdot \frac{1}{1 + e^{a}}} \]
                            3. lower-+.f64N/A

                              \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \frac{1}{1 + e^{a}}} \]
                            4. lower-log1p.f64N/A

                              \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} + b \cdot \frac{1}{1 + e^{a}} \]
                            5. lower-exp.f64N/A

                              \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) + b \cdot \frac{1}{1 + e^{a}} \]
                            6. associate-*r/N/A

                              \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} \]
                            7. *-rgt-identityN/A

                              \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{\color{blue}{b}}{1 + e^{a}} \]
                            8. lower-/.f64N/A

                              \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b}{1 + e^{a}}} \]
                            9. lower-+.f64N/A

                              \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{\color{blue}{1 + e^{a}}} \]
                            10. lower-exp.f64100.0

                              \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + \color{blue}{e^{a}}} \]
                          5. Applied rewrites100.0%

                            \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                          6. Taylor expanded in b around inf

                            \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
                          7. Step-by-step derivation
                            1. Applied rewrites98.7%

                              \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]

                            if 0.20000000000000001 < (exp.f64 a)

                            1. Initial program 70.8%

                              \[\log \left(e^{a} + e^{b}\right) \]
                            2. Add Preprocessing
                            3. Taylor expanded in b around 0

                              \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \left(\frac{1}{2} \cdot \left(b \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right) + \frac{1}{1 + e^{a}}\right)} \]
                            4. Step-by-step derivation
                              1. +-commutativeN/A

                                \[\leadsto \color{blue}{b \cdot \left(\frac{1}{2} \cdot \left(b \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right) + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right)} \]
                              2. associate-*r*N/A

                                \[\leadsto b \cdot \left(\color{blue}{\left(\frac{1}{2} \cdot b\right) \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)} + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right) \]
                              3. *-commutativeN/A

                                \[\leadsto b \cdot \left(\color{blue}{\left(b \cdot \frac{1}{2}\right)} \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right) + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right) \]
                              4. associate-*r*N/A

                                \[\leadsto b \cdot \left(\color{blue}{b \cdot \left(\frac{1}{2} \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right)} + \frac{1}{1 + e^{a}}\right) + \log \left(1 + e^{a}\right) \]
                              5. lower-fma.f64N/A

                                \[\leadsto \color{blue}{\mathsf{fma}\left(b, b \cdot \left(\frac{1}{2} \cdot \left(\frac{1}{1 + e^{a}} - \frac{1}{{\left(1 + e^{a}\right)}^{2}}\right)\right) + \frac{1}{1 + e^{a}}, \log \left(1 + e^{a}\right)\right)} \]
                            5. Applied rewrites68.1%

                              \[\leadsto \color{blue}{\mathsf{fma}\left(b, \mathsf{fma}\left(\mathsf{fma}\left(b, 0.5, 1\right), \frac{1}{1 + e^{a}}, \frac{b \cdot -0.5}{{\left(1 + e^{a}\right)}^{2}}\right), \mathsf{log1p}\left(e^{a}\right)\right)} \]
                            6. Taylor expanded in a around 0

                              \[\leadsto \mathsf{fma}\left(b, \frac{1}{2} + \color{blue}{\left(\frac{-1}{8} \cdot b + \frac{1}{4} \cdot b\right)}, \mathsf{log1p}\left(e^{a}\right)\right) \]
                            7. Step-by-step derivation
                              1. Applied rewrites67.9%

                                \[\leadsto \mathsf{fma}\left(b, \mathsf{fma}\left(b, \color{blue}{0.125}, 0.5\right), \mathsf{log1p}\left(e^{a}\right)\right) \]
                              2. Taylor expanded in a around 0

                                \[\leadsto \mathsf{fma}\left(b, \mathsf{fma}\left(b, \frac{1}{8}, \frac{1}{2}\right), \mathsf{log1p}\left(1 + a\right)\right) \]
                              3. Step-by-step derivation
                                1. Applied rewrites67.2%

                                  \[\leadsto \mathsf{fma}\left(b, \mathsf{fma}\left(b, 0.125, 0.5\right), \mathsf{log1p}\left(1 + a\right)\right) \]
                              4. Recombined 2 regimes into one program.
                              5. Final simplification76.4%

                                \[\leadsto \begin{array}{l} \mathbf{if}\;e^{a} \leq 0.2:\\ \;\;\;\;\frac{b}{1 + e^{a}}\\ \mathbf{else}:\\ \;\;\;\;\mathsf{fma}\left(b, \mathsf{fma}\left(b, 0.125, 0.5\right), \mathsf{log1p}\left(a + 1\right)\right)\\ \end{array} \]
                              6. Add Preprocessing

                              Alternative 11: 97.7% accurate, 1.4× speedup?

                              \[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} \leq 0.2:\\ \;\;\;\;\frac{b}{1 + e^{a}}\\ \mathbf{else}:\\ \;\;\;\;\log \left(\left(a + 1\right) + \left(b + 1\right)\right)\\ \end{array} \end{array} \]
                              NOTE: a and b should be sorted in increasing order before calling this function.
                              (FPCore (a b)
                               :precision binary64
                               (if (<= (exp a) 0.2) (/ b (+ 1.0 (exp a))) (log (+ (+ a 1.0) (+ b 1.0)))))
                              assert(a < b);
                              double code(double a, double b) {
                              	double tmp;
                              	if (exp(a) <= 0.2) {
                              		tmp = b / (1.0 + exp(a));
                              	} else {
                              		tmp = log(((a + 1.0) + (b + 1.0)));
                              	}
                              	return tmp;
                              }
                              
                              NOTE: a and b should be sorted in increasing order before calling this function.
                              real(8) function code(a, b)
                                  real(8), intent (in) :: a
                                  real(8), intent (in) :: b
                                  real(8) :: tmp
                                  if (exp(a) <= 0.2d0) then
                                      tmp = b / (1.0d0 + exp(a))
                                  else
                                      tmp = log(((a + 1.0d0) + (b + 1.0d0)))
                                  end if
                                  code = tmp
                              end function
                              
                              assert a < b;
                              public static double code(double a, double b) {
                              	double tmp;
                              	if (Math.exp(a) <= 0.2) {
                              		tmp = b / (1.0 + Math.exp(a));
                              	} else {
                              		tmp = Math.log(((a + 1.0) + (b + 1.0)));
                              	}
                              	return tmp;
                              }
                              
                              [a, b] = sort([a, b])
                              def code(a, b):
                              	tmp = 0
                              	if math.exp(a) <= 0.2:
                              		tmp = b / (1.0 + math.exp(a))
                              	else:
                              		tmp = math.log(((a + 1.0) + (b + 1.0)))
                              	return tmp
                              
                              a, b = sort([a, b])
                              function code(a, b)
                              	tmp = 0.0
                              	if (exp(a) <= 0.2)
                              		tmp = Float64(b / Float64(1.0 + exp(a)));
                              	else
                              		tmp = log(Float64(Float64(a + 1.0) + Float64(b + 1.0)));
                              	end
                              	return tmp
                              end
                              
                              a, b = num2cell(sort([a, b])){:}
                              function tmp_2 = code(a, b)
                              	tmp = 0.0;
                              	if (exp(a) <= 0.2)
                              		tmp = b / (1.0 + exp(a));
                              	else
                              		tmp = log(((a + 1.0) + (b + 1.0)));
                              	end
                              	tmp_2 = tmp;
                              end
                              
                              NOTE: a and b should be sorted in increasing order before calling this function.
                              code[a_, b_] := If[LessEqual[N[Exp[a], $MachinePrecision], 0.2], N[(b / N[(1.0 + N[Exp[a], $MachinePrecision]), $MachinePrecision]), $MachinePrecision], N[Log[N[(N[(a + 1.0), $MachinePrecision] + N[(b + 1.0), $MachinePrecision]), $MachinePrecision]], $MachinePrecision]]
                              
                              \begin{array}{l}
                              [a, b] = \mathsf{sort}([a, b])\\
                              \\
                              \begin{array}{l}
                              \mathbf{if}\;e^{a} \leq 0.2:\\
                              \;\;\;\;\frac{b}{1 + e^{a}}\\
                              
                              \mathbf{else}:\\
                              \;\;\;\;\log \left(\left(a + 1\right) + \left(b + 1\right)\right)\\
                              
                              
                              \end{array}
                              \end{array}
                              
                              Derivation
                              1. Split input into 2 regimes
                              2. if (exp.f64 a) < 0.20000000000000001

                                1. Initial program 10.7%

                                  \[\log \left(e^{a} + e^{b}\right) \]
                                2. Add Preprocessing
                                3. Taylor expanded in b around 0

                                  \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                                4. Step-by-step derivation
                                  1. *-rgt-identityN/A

                                    \[\leadsto \log \left(1 + e^{a}\right) + \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} \]
                                  2. associate-*r/N/A

                                    \[\leadsto \log \left(1 + e^{a}\right) + \color{blue}{b \cdot \frac{1}{1 + e^{a}}} \]
                                  3. lower-+.f64N/A

                                    \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \frac{1}{1 + e^{a}}} \]
                                  4. lower-log1p.f64N/A

                                    \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} + b \cdot \frac{1}{1 + e^{a}} \]
                                  5. lower-exp.f64N/A

                                    \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) + b \cdot \frac{1}{1 + e^{a}} \]
                                  6. associate-*r/N/A

                                    \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} \]
                                  7. *-rgt-identityN/A

                                    \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{\color{blue}{b}}{1 + e^{a}} \]
                                  8. lower-/.f64N/A

                                    \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b}{1 + e^{a}}} \]
                                  9. lower-+.f64N/A

                                    \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{\color{blue}{1 + e^{a}}} \]
                                  10. lower-exp.f64100.0

                                    \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + \color{blue}{e^{a}}} \]
                                5. Applied rewrites100.0%

                                  \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                                6. Taylor expanded in b around inf

                                  \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
                                7. Step-by-step derivation
                                  1. Applied rewrites98.7%

                                    \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]

                                  if 0.20000000000000001 < (exp.f64 a)

                                  1. Initial program 70.8%

                                    \[\log \left(e^{a} + e^{b}\right) \]
                                  2. Add Preprocessing
                                  3. Taylor expanded in b around 0

                                    \[\leadsto \log \left(e^{a} + \color{blue}{\left(1 + b\right)}\right) \]
                                  4. Step-by-step derivation
                                    1. lower-+.f6467.0

                                      \[\leadsto \log \left(e^{a} + \color{blue}{\left(1 + b\right)}\right) \]
                                  5. Applied rewrites67.0%

                                    \[\leadsto \log \left(e^{a} + \color{blue}{\left(1 + b\right)}\right) \]
                                  6. Taylor expanded in a around 0

                                    \[\leadsto \log \left(\color{blue}{\left(1 + a\right)} + \left(1 + b\right)\right) \]
                                  7. Step-by-step derivation
                                    1. lower-+.f6466.3

                                      \[\leadsto \log \left(\color{blue}{\left(1 + a\right)} + \left(1 + b\right)\right) \]
                                  8. Applied rewrites66.3%

                                    \[\leadsto \log \left(\color{blue}{\left(1 + a\right)} + \left(1 + b\right)\right) \]
                                8. Recombined 2 regimes into one program.
                                9. Final simplification75.8%

                                  \[\leadsto \begin{array}{l} \mathbf{if}\;e^{a} \leq 0.2:\\ \;\;\;\;\frac{b}{1 + e^{a}}\\ \mathbf{else}:\\ \;\;\;\;\log \left(\left(a + 1\right) + \left(b + 1\right)\right)\\ \end{array} \]
                                10. Add Preprocessing

                                Alternative 12: 56.7% accurate, 1.4× speedup?

                                \[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} \leq 0.2:\\ \;\;\;\;b \cdot 0.5\\ \mathbf{else}:\\ \;\;\;\;\log \left(\left(a + 1\right) + \left(b + 1\right)\right)\\ \end{array} \end{array} \]
                                NOTE: a and b should be sorted in increasing order before calling this function.
                                (FPCore (a b)
                                 :precision binary64
                                 (if (<= (exp a) 0.2) (* b 0.5) (log (+ (+ a 1.0) (+ b 1.0)))))
                                assert(a < b);
                                double code(double a, double b) {
                                	double tmp;
                                	if (exp(a) <= 0.2) {
                                		tmp = b * 0.5;
                                	} else {
                                		tmp = log(((a + 1.0) + (b + 1.0)));
                                	}
                                	return tmp;
                                }
                                
                                NOTE: a and b should be sorted in increasing order before calling this function.
                                real(8) function code(a, b)
                                    real(8), intent (in) :: a
                                    real(8), intent (in) :: b
                                    real(8) :: tmp
                                    if (exp(a) <= 0.2d0) then
                                        tmp = b * 0.5d0
                                    else
                                        tmp = log(((a + 1.0d0) + (b + 1.0d0)))
                                    end if
                                    code = tmp
                                end function
                                
                                assert a < b;
                                public static double code(double a, double b) {
                                	double tmp;
                                	if (Math.exp(a) <= 0.2) {
                                		tmp = b * 0.5;
                                	} else {
                                		tmp = Math.log(((a + 1.0) + (b + 1.0)));
                                	}
                                	return tmp;
                                }
                                
                                [a, b] = sort([a, b])
                                def code(a, b):
                                	tmp = 0
                                	if math.exp(a) <= 0.2:
                                		tmp = b * 0.5
                                	else:
                                		tmp = math.log(((a + 1.0) + (b + 1.0)))
                                	return tmp
                                
                                a, b = sort([a, b])
                                function code(a, b)
                                	tmp = 0.0
                                	if (exp(a) <= 0.2)
                                		tmp = Float64(b * 0.5);
                                	else
                                		tmp = log(Float64(Float64(a + 1.0) + Float64(b + 1.0)));
                                	end
                                	return tmp
                                end
                                
                                a, b = num2cell(sort([a, b])){:}
                                function tmp_2 = code(a, b)
                                	tmp = 0.0;
                                	if (exp(a) <= 0.2)
                                		tmp = b * 0.5;
                                	else
                                		tmp = log(((a + 1.0) + (b + 1.0)));
                                	end
                                	tmp_2 = tmp;
                                end
                                
                                NOTE: a and b should be sorted in increasing order before calling this function.
                                code[a_, b_] := If[LessEqual[N[Exp[a], $MachinePrecision], 0.2], N[(b * 0.5), $MachinePrecision], N[Log[N[(N[(a + 1.0), $MachinePrecision] + N[(b + 1.0), $MachinePrecision]), $MachinePrecision]], $MachinePrecision]]
                                
                                \begin{array}{l}
                                [a, b] = \mathsf{sort}([a, b])\\
                                \\
                                \begin{array}{l}
                                \mathbf{if}\;e^{a} \leq 0.2:\\
                                \;\;\;\;b \cdot 0.5\\
                                
                                \mathbf{else}:\\
                                \;\;\;\;\log \left(\left(a + 1\right) + \left(b + 1\right)\right)\\
                                
                                
                                \end{array}
                                \end{array}
                                
                                Derivation
                                1. Split input into 2 regimes
                                2. if (exp.f64 a) < 0.20000000000000001

                                  1. Initial program 10.7%

                                    \[\log \left(e^{a} + e^{b}\right) \]
                                  2. Add Preprocessing
                                  3. Taylor expanded in b around 0

                                    \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                                  4. Step-by-step derivation
                                    1. *-rgt-identityN/A

                                      \[\leadsto \log \left(1 + e^{a}\right) + \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} \]
                                    2. associate-*r/N/A

                                      \[\leadsto \log \left(1 + e^{a}\right) + \color{blue}{b \cdot \frac{1}{1 + e^{a}}} \]
                                    3. lower-+.f64N/A

                                      \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \frac{1}{1 + e^{a}}} \]
                                    4. lower-log1p.f64N/A

                                      \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} + b \cdot \frac{1}{1 + e^{a}} \]
                                    5. lower-exp.f64N/A

                                      \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) + b \cdot \frac{1}{1 + e^{a}} \]
                                    6. associate-*r/N/A

                                      \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} \]
                                    7. *-rgt-identityN/A

                                      \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{\color{blue}{b}}{1 + e^{a}} \]
                                    8. lower-/.f64N/A

                                      \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b}{1 + e^{a}}} \]
                                    9. lower-+.f64N/A

                                      \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{\color{blue}{1 + e^{a}}} \]
                                    10. lower-exp.f64100.0

                                      \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + \color{blue}{e^{a}}} \]
                                  5. Applied rewrites100.0%

                                    \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                                  6. Taylor expanded in b around inf

                                    \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
                                  7. Step-by-step derivation
                                    1. Applied rewrites98.7%

                                      \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
                                    2. Taylor expanded in a around 0

                                      \[\leadsto \frac{1}{2} \cdot b \]
                                    3. Step-by-step derivation
                                      1. Applied rewrites18.5%

                                        \[\leadsto b \cdot 0.5 \]

                                      if 0.20000000000000001 < (exp.f64 a)

                                      1. Initial program 70.8%

                                        \[\log \left(e^{a} + e^{b}\right) \]
                                      2. Add Preprocessing
                                      3. Taylor expanded in b around 0

                                        \[\leadsto \log \left(e^{a} + \color{blue}{\left(1 + b\right)}\right) \]
                                      4. Step-by-step derivation
                                        1. lower-+.f6467.0

                                          \[\leadsto \log \left(e^{a} + \color{blue}{\left(1 + b\right)}\right) \]
                                      5. Applied rewrites67.0%

                                        \[\leadsto \log \left(e^{a} + \color{blue}{\left(1 + b\right)}\right) \]
                                      6. Taylor expanded in a around 0

                                        \[\leadsto \log \left(\color{blue}{\left(1 + a\right)} + \left(1 + b\right)\right) \]
                                      7. Step-by-step derivation
                                        1. lower-+.f6466.3

                                          \[\leadsto \log \left(\color{blue}{\left(1 + a\right)} + \left(1 + b\right)\right) \]
                                      8. Applied rewrites66.3%

                                        \[\leadsto \log \left(\color{blue}{\left(1 + a\right)} + \left(1 + b\right)\right) \]
                                    4. Recombined 2 regimes into one program.
                                    5. Final simplification52.3%

                                      \[\leadsto \begin{array}{l} \mathbf{if}\;e^{a} \leq 0.2:\\ \;\;\;\;b \cdot 0.5\\ \mathbf{else}:\\ \;\;\;\;\log \left(\left(a + 1\right) + \left(b + 1\right)\right)\\ \end{array} \]
                                    6. Add Preprocessing

                                    Alternative 13: 56.2% accurate, 1.4× speedup?

                                    \[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} \leq 0.2:\\ \;\;\;\;b \cdot 0.5\\ \mathbf{else}:\\ \;\;\;\;\mathsf{fma}\left(a, 0.5, \log 2\right)\\ \end{array} \end{array} \]
                                    NOTE: a and b should be sorted in increasing order before calling this function.
                                    (FPCore (a b)
                                     :precision binary64
                                     (if (<= (exp a) 0.2) (* b 0.5) (fma a 0.5 (log 2.0))))
                                    assert(a < b);
                                    double code(double a, double b) {
                                    	double tmp;
                                    	if (exp(a) <= 0.2) {
                                    		tmp = b * 0.5;
                                    	} else {
                                    		tmp = fma(a, 0.5, log(2.0));
                                    	}
                                    	return tmp;
                                    }
                                    
                                    a, b = sort([a, b])
                                    function code(a, b)
                                    	tmp = 0.0
                                    	if (exp(a) <= 0.2)
                                    		tmp = Float64(b * 0.5);
                                    	else
                                    		tmp = fma(a, 0.5, log(2.0));
                                    	end
                                    	return tmp
                                    end
                                    
                                    NOTE: a and b should be sorted in increasing order before calling this function.
                                    code[a_, b_] := If[LessEqual[N[Exp[a], $MachinePrecision], 0.2], N[(b * 0.5), $MachinePrecision], N[(a * 0.5 + N[Log[2.0], $MachinePrecision]), $MachinePrecision]]
                                    
                                    \begin{array}{l}
                                    [a, b] = \mathsf{sort}([a, b])\\
                                    \\
                                    \begin{array}{l}
                                    \mathbf{if}\;e^{a} \leq 0.2:\\
                                    \;\;\;\;b \cdot 0.5\\
                                    
                                    \mathbf{else}:\\
                                    \;\;\;\;\mathsf{fma}\left(a, 0.5, \log 2\right)\\
                                    
                                    
                                    \end{array}
                                    \end{array}
                                    
                                    Derivation
                                    1. Split input into 2 regimes
                                    2. if (exp.f64 a) < 0.20000000000000001

                                      1. Initial program 10.7%

                                        \[\log \left(e^{a} + e^{b}\right) \]
                                      2. Add Preprocessing
                                      3. Taylor expanded in b around 0

                                        \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                                      4. Step-by-step derivation
                                        1. *-rgt-identityN/A

                                          \[\leadsto \log \left(1 + e^{a}\right) + \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} \]
                                        2. associate-*r/N/A

                                          \[\leadsto \log \left(1 + e^{a}\right) + \color{blue}{b \cdot \frac{1}{1 + e^{a}}} \]
                                        3. lower-+.f64N/A

                                          \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \frac{1}{1 + e^{a}}} \]
                                        4. lower-log1p.f64N/A

                                          \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} + b \cdot \frac{1}{1 + e^{a}} \]
                                        5. lower-exp.f64N/A

                                          \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) + b \cdot \frac{1}{1 + e^{a}} \]
                                        6. associate-*r/N/A

                                          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} \]
                                        7. *-rgt-identityN/A

                                          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{\color{blue}{b}}{1 + e^{a}} \]
                                        8. lower-/.f64N/A

                                          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b}{1 + e^{a}}} \]
                                        9. lower-+.f64N/A

                                          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{\color{blue}{1 + e^{a}}} \]
                                        10. lower-exp.f64100.0

                                          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + \color{blue}{e^{a}}} \]
                                      5. Applied rewrites100.0%

                                        \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                                      6. Taylor expanded in b around inf

                                        \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
                                      7. Step-by-step derivation
                                        1. Applied rewrites98.7%

                                          \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
                                        2. Taylor expanded in a around 0

                                          \[\leadsto \frac{1}{2} \cdot b \]
                                        3. Step-by-step derivation
                                          1. Applied rewrites18.5%

                                            \[\leadsto b \cdot 0.5 \]

                                          if 0.20000000000000001 < (exp.f64 a)

                                          1. Initial program 70.8%

                                            \[\log \left(e^{a} + e^{b}\right) \]
                                          2. Add Preprocessing
                                          3. Taylor expanded in b around 0

                                            \[\leadsto \color{blue}{\log \left(1 + e^{a}\right)} \]
                                          4. Step-by-step derivation
                                            1. lower-log1p.f64N/A

                                              \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]
                                            2. lower-exp.f6467.4

                                              \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]
                                          5. Applied rewrites67.4%

                                            \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]
                                          6. Taylor expanded in a around 0

                                            \[\leadsto \log 2 + \color{blue}{\frac{1}{2} \cdot a} \]
                                          7. Step-by-step derivation
                                            1. Applied rewrites66.8%

                                              \[\leadsto \mathsf{fma}\left(a, \color{blue}{0.5}, \log 2\right) \]
                                          8. Recombined 2 regimes into one program.
                                          9. Add Preprocessing

                                          Alternative 14: 56.2% accurate, 1.4× speedup?

                                          \[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} \leq 0.2:\\ \;\;\;\;b \cdot 0.5\\ \mathbf{else}:\\ \;\;\;\;\mathsf{log1p}\left(a + 1\right)\\ \end{array} \end{array} \]
                                          NOTE: a and b should be sorted in increasing order before calling this function.
                                          (FPCore (a b)
                                           :precision binary64
                                           (if (<= (exp a) 0.2) (* b 0.5) (log1p (+ a 1.0))))
                                          assert(a < b);
                                          double code(double a, double b) {
                                          	double tmp;
                                          	if (exp(a) <= 0.2) {
                                          		tmp = b * 0.5;
                                          	} else {
                                          		tmp = log1p((a + 1.0));
                                          	}
                                          	return tmp;
                                          }
                                          
                                          assert a < b;
                                          public static double code(double a, double b) {
                                          	double tmp;
                                          	if (Math.exp(a) <= 0.2) {
                                          		tmp = b * 0.5;
                                          	} else {
                                          		tmp = Math.log1p((a + 1.0));
                                          	}
                                          	return tmp;
                                          }
                                          
                                          [a, b] = sort([a, b])
                                          def code(a, b):
                                          	tmp = 0
                                          	if math.exp(a) <= 0.2:
                                          		tmp = b * 0.5
                                          	else:
                                          		tmp = math.log1p((a + 1.0))
                                          	return tmp
                                          
                                          a, b = sort([a, b])
                                          function code(a, b)
                                          	tmp = 0.0
                                          	if (exp(a) <= 0.2)
                                          		tmp = Float64(b * 0.5);
                                          	else
                                          		tmp = log1p(Float64(a + 1.0));
                                          	end
                                          	return tmp
                                          end
                                          
                                          NOTE: a and b should be sorted in increasing order before calling this function.
                                          code[a_, b_] := If[LessEqual[N[Exp[a], $MachinePrecision], 0.2], N[(b * 0.5), $MachinePrecision], N[Log[1 + N[(a + 1.0), $MachinePrecision]], $MachinePrecision]]
                                          
                                          \begin{array}{l}
                                          [a, b] = \mathsf{sort}([a, b])\\
                                          \\
                                          \begin{array}{l}
                                          \mathbf{if}\;e^{a} \leq 0.2:\\
                                          \;\;\;\;b \cdot 0.5\\
                                          
                                          \mathbf{else}:\\
                                          \;\;\;\;\mathsf{log1p}\left(a + 1\right)\\
                                          
                                          
                                          \end{array}
                                          \end{array}
                                          
                                          Derivation
                                          1. Split input into 2 regimes
                                          2. if (exp.f64 a) < 0.20000000000000001

                                            1. Initial program 10.7%

                                              \[\log \left(e^{a} + e^{b}\right) \]
                                            2. Add Preprocessing
                                            3. Taylor expanded in b around 0

                                              \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                                            4. Step-by-step derivation
                                              1. *-rgt-identityN/A

                                                \[\leadsto \log \left(1 + e^{a}\right) + \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} \]
                                              2. associate-*r/N/A

                                                \[\leadsto \log \left(1 + e^{a}\right) + \color{blue}{b \cdot \frac{1}{1 + e^{a}}} \]
                                              3. lower-+.f64N/A

                                                \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \frac{1}{1 + e^{a}}} \]
                                              4. lower-log1p.f64N/A

                                                \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} + b \cdot \frac{1}{1 + e^{a}} \]
                                              5. lower-exp.f64N/A

                                                \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) + b \cdot \frac{1}{1 + e^{a}} \]
                                              6. associate-*r/N/A

                                                \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} \]
                                              7. *-rgt-identityN/A

                                                \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{\color{blue}{b}}{1 + e^{a}} \]
                                              8. lower-/.f64N/A

                                                \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b}{1 + e^{a}}} \]
                                              9. lower-+.f64N/A

                                                \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{\color{blue}{1 + e^{a}}} \]
                                              10. lower-exp.f64100.0

                                                \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + \color{blue}{e^{a}}} \]
                                            5. Applied rewrites100.0%

                                              \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                                            6. Taylor expanded in b around inf

                                              \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
                                            7. Step-by-step derivation
                                              1. Applied rewrites98.7%

                                                \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
                                              2. Taylor expanded in a around 0

                                                \[\leadsto \frac{1}{2} \cdot b \]
                                              3. Step-by-step derivation
                                                1. Applied rewrites18.5%

                                                  \[\leadsto b \cdot 0.5 \]

                                                if 0.20000000000000001 < (exp.f64 a)

                                                1. Initial program 70.8%

                                                  \[\log \left(e^{a} + e^{b}\right) \]
                                                2. Add Preprocessing
                                                3. Taylor expanded in b around 0

                                                  \[\leadsto \color{blue}{\log \left(1 + e^{a}\right)} \]
                                                4. Step-by-step derivation
                                                  1. lower-log1p.f64N/A

                                                    \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]
                                                  2. lower-exp.f6467.4

                                                    \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]
                                                5. Applied rewrites67.4%

                                                  \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]
                                                6. Taylor expanded in a around 0

                                                  \[\leadsto \mathsf{log1p}\left(1 + a\right) \]
                                                7. Step-by-step derivation
                                                  1. Applied rewrites66.7%

                                                    \[\leadsto \mathsf{log1p}\left(1 + a\right) \]
                                                8. Recombined 2 regimes into one program.
                                                9. Final simplification52.6%

                                                  \[\leadsto \begin{array}{l} \mathbf{if}\;e^{a} \leq 0.2:\\ \;\;\;\;b \cdot 0.5\\ \mathbf{else}:\\ \;\;\;\;\mathsf{log1p}\left(a + 1\right)\\ \end{array} \]
                                                10. Add Preprocessing

                                                Alternative 15: 55.8% accurate, 1.5× speedup?

                                                \[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} \leq 0:\\ \;\;\;\;b \cdot 0.5\\ \mathbf{else}:\\ \;\;\;\;\mathsf{log1p}\left(1\right)\\ \end{array} \end{array} \]
                                                NOTE: a and b should be sorted in increasing order before calling this function.
                                                (FPCore (a b) :precision binary64 (if (<= (exp a) 0.0) (* b 0.5) (log1p 1.0)))
                                                assert(a < b);
                                                double code(double a, double b) {
                                                	double tmp;
                                                	if (exp(a) <= 0.0) {
                                                		tmp = b * 0.5;
                                                	} else {
                                                		tmp = log1p(1.0);
                                                	}
                                                	return tmp;
                                                }
                                                
                                                assert a < b;
                                                public static double code(double a, double b) {
                                                	double tmp;
                                                	if (Math.exp(a) <= 0.0) {
                                                		tmp = b * 0.5;
                                                	} else {
                                                		tmp = Math.log1p(1.0);
                                                	}
                                                	return tmp;
                                                }
                                                
                                                [a, b] = sort([a, b])
                                                def code(a, b):
                                                	tmp = 0
                                                	if math.exp(a) <= 0.0:
                                                		tmp = b * 0.5
                                                	else:
                                                		tmp = math.log1p(1.0)
                                                	return tmp
                                                
                                                a, b = sort([a, b])
                                                function code(a, b)
                                                	tmp = 0.0
                                                	if (exp(a) <= 0.0)
                                                		tmp = Float64(b * 0.5);
                                                	else
                                                		tmp = log1p(1.0);
                                                	end
                                                	return tmp
                                                end
                                                
                                                NOTE: a and b should be sorted in increasing order before calling this function.
                                                code[a_, b_] := If[LessEqual[N[Exp[a], $MachinePrecision], 0.0], N[(b * 0.5), $MachinePrecision], N[Log[1 + 1.0], $MachinePrecision]]
                                                
                                                \begin{array}{l}
                                                [a, b] = \mathsf{sort}([a, b])\\
                                                \\
                                                \begin{array}{l}
                                                \mathbf{if}\;e^{a} \leq 0:\\
                                                \;\;\;\;b \cdot 0.5\\
                                                
                                                \mathbf{else}:\\
                                                \;\;\;\;\mathsf{log1p}\left(1\right)\\
                                                
                                                
                                                \end{array}
                                                \end{array}
                                                
                                                Derivation
                                                1. Split input into 2 regimes
                                                2. if (exp.f64 a) < 0.0

                                                  1. Initial program 9.5%

                                                    \[\log \left(e^{a} + e^{b}\right) \]
                                                  2. Add Preprocessing
                                                  3. Taylor expanded in b around 0

                                                    \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                                                  4. Step-by-step derivation
                                                    1. *-rgt-identityN/A

                                                      \[\leadsto \log \left(1 + e^{a}\right) + \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} \]
                                                    2. associate-*r/N/A

                                                      \[\leadsto \log \left(1 + e^{a}\right) + \color{blue}{b \cdot \frac{1}{1 + e^{a}}} \]
                                                    3. lower-+.f64N/A

                                                      \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \frac{1}{1 + e^{a}}} \]
                                                    4. lower-log1p.f64N/A

                                                      \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} + b \cdot \frac{1}{1 + e^{a}} \]
                                                    5. lower-exp.f64N/A

                                                      \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) + b \cdot \frac{1}{1 + e^{a}} \]
                                                    6. associate-*r/N/A

                                                      \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} \]
                                                    7. *-rgt-identityN/A

                                                      \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{\color{blue}{b}}{1 + e^{a}} \]
                                                    8. lower-/.f64N/A

                                                      \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b}{1 + e^{a}}} \]
                                                    9. lower-+.f64N/A

                                                      \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{\color{blue}{1 + e^{a}}} \]
                                                    10. lower-exp.f64100.0

                                                      \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + \color{blue}{e^{a}}} \]
                                                  5. Applied rewrites100.0%

                                                    \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                                                  6. Taylor expanded in b around inf

                                                    \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
                                                  7. Step-by-step derivation
                                                    1. Applied rewrites100.0%

                                                      \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
                                                    2. Taylor expanded in a around 0

                                                      \[\leadsto \frac{1}{2} \cdot b \]
                                                    3. Step-by-step derivation
                                                      1. Applied rewrites18.8%

                                                        \[\leadsto b \cdot 0.5 \]

                                                      if 0.0 < (exp.f64 a)

                                                      1. Initial program 71.0%

                                                        \[\log \left(e^{a} + e^{b}\right) \]
                                                      2. Add Preprocessing
                                                      3. Taylor expanded in b around 0

                                                        \[\leadsto \color{blue}{\log \left(1 + e^{a}\right)} \]
                                                      4. Step-by-step derivation
                                                        1. lower-log1p.f64N/A

                                                          \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]
                                                        2. lower-exp.f6467.5

                                                          \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]
                                                      5. Applied rewrites67.5%

                                                        \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]
                                                      6. Taylor expanded in a around 0

                                                        \[\leadsto \mathsf{log1p}\left(1\right) \]
                                                      7. Step-by-step derivation
                                                        1. Applied rewrites65.9%

                                                          \[\leadsto \mathsf{log1p}\left(1\right) \]
                                                      8. Recombined 2 regimes into one program.
                                                      9. Add Preprocessing

                                                      Alternative 16: 12.1% accurate, 50.7× speedup?

                                                      \[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ b \cdot 0.5 \end{array} \]
                                                      NOTE: a and b should be sorted in increasing order before calling this function.
                                                      (FPCore (a b) :precision binary64 (* b 0.5))
                                                      assert(a < b);
                                                      double code(double a, double b) {
                                                      	return b * 0.5;
                                                      }
                                                      
                                                      NOTE: a and b should be sorted in increasing order before calling this function.
                                                      real(8) function code(a, b)
                                                          real(8), intent (in) :: a
                                                          real(8), intent (in) :: b
                                                          code = b * 0.5d0
                                                      end function
                                                      
                                                      assert a < b;
                                                      public static double code(double a, double b) {
                                                      	return b * 0.5;
                                                      }
                                                      
                                                      [a, b] = sort([a, b])
                                                      def code(a, b):
                                                      	return b * 0.5
                                                      
                                                      a, b = sort([a, b])
                                                      function code(a, b)
                                                      	return Float64(b * 0.5)
                                                      end
                                                      
                                                      a, b = num2cell(sort([a, b])){:}
                                                      function tmp = code(a, b)
                                                      	tmp = b * 0.5;
                                                      end
                                                      
                                                      NOTE: a and b should be sorted in increasing order before calling this function.
                                                      code[a_, b_] := N[(b * 0.5), $MachinePrecision]
                                                      
                                                      \begin{array}{l}
                                                      [a, b] = \mathsf{sort}([a, b])\\
                                                      \\
                                                      b \cdot 0.5
                                                      \end{array}
                                                      
                                                      Derivation
                                                      1. Initial program 53.2%

                                                        \[\log \left(e^{a} + e^{b}\right) \]
                                                      2. Add Preprocessing
                                                      3. Taylor expanded in b around 0

                                                        \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                                                      4. Step-by-step derivation
                                                        1. *-rgt-identityN/A

                                                          \[\leadsto \log \left(1 + e^{a}\right) + \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} \]
                                                        2. associate-*r/N/A

                                                          \[\leadsto \log \left(1 + e^{a}\right) + \color{blue}{b \cdot \frac{1}{1 + e^{a}}} \]
                                                        3. lower-+.f64N/A

                                                          \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + b \cdot \frac{1}{1 + e^{a}}} \]
                                                        4. lower-log1p.f64N/A

                                                          \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} + b \cdot \frac{1}{1 + e^{a}} \]
                                                        5. lower-exp.f64N/A

                                                          \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) + b \cdot \frac{1}{1 + e^{a}} \]
                                                        6. associate-*r/N/A

                                                          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} \]
                                                        7. *-rgt-identityN/A

                                                          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{\color{blue}{b}}{1 + e^{a}} \]
                                                        8. lower-/.f64N/A

                                                          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{\frac{b}{1 + e^{a}}} \]
                                                        9. lower-+.f64N/A

                                                          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{\color{blue}{1 + e^{a}}} \]
                                                        10. lower-exp.f6477.3

                                                          \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + \color{blue}{e^{a}}} \]
                                                      5. Applied rewrites77.3%

                                                        \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}}} \]
                                                      6. Taylor expanded in b around inf

                                                        \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
                                                      7. Step-by-step derivation
                                                        1. Applied rewrites31.5%

                                                          \[\leadsto \frac{b}{\color{blue}{1 + e^{a}}} \]
                                                        2. Taylor expanded in a around 0

                                                          \[\leadsto \frac{1}{2} \cdot b \]
                                                        3. Step-by-step derivation
                                                          1. Applied rewrites8.0%

                                                            \[\leadsto b \cdot 0.5 \]
                                                          2. Add Preprocessing

                                                          Reproduce

                                                          ?
                                                          herbie shell --seed 2024221 
                                                          (FPCore (a b)
                                                            :name "symmetry log of sum of exp"
                                                            :precision binary64
                                                            (log (+ (exp a) (exp b))))