symmetry log of sum of exp

Percentage Accurate: 53.4% → 98.6%

Time: 11.2s

Alternatives: 12

Speedup: 1.5×

• could not determine a ground truth

  1. a = -2.8561019106275855e+76
  2. b = 1.7245935183621262e+43

Specification

Math

\[\begin{array}{l} \\ \log \left(e^{a} + e^{b}\right) \end{array} \]

FPCore

(FPCore (a b) :precision binary64 (log (+ (exp a) (exp b))))

C

double code(double a, double b) {
	return log((exp(a) + exp(b)));
}

Fortran

real(8) function code(a, b)
    real(8), intent (in) :: a
    real(8), intent (in) :: b
    code = log((exp(a) + exp(b)))
end function

Java

public static double code(double a, double b) {
	return Math.log((Math.exp(a) + Math.exp(b)));
}

Python

def code(a, b):
	return math.log((math.exp(a) + math.exp(b)))

Julia

function code(a, b)
	return log(Float64(exp(a) + exp(b)))
end

MATLAB

function tmp = code(a, b)
	tmp = log((exp(a) + exp(b)));
end

Wolfram

code[a_, b_] := N[Log[N[(N[Exp[a], $MachinePrecision] + N[Exp[b], $MachinePrecision]), $MachinePrecision]], $MachinePrecision]

Initial Program: 53.4% accurate, 1.0× speedup

Math

\[\begin{array}{l} \\ \log \left(e^{a} + e^{b}\right) \end{array} \]

FPCore

(FPCore (a b) :precision binary64 (log (+ (exp a) (exp b))))

C

double code(double a, double b) {
	return log((exp(a) + exp(b)));
}

Fortran

real(8) function code(a, b)
    real(8), intent (in) :: a
    real(8), intent (in) :: b
    code = log((exp(a) + exp(b)))
end function

Java

public static double code(double a, double b) {
	return Math.log((Math.exp(a) + Math.exp(b)));
}

Python

def code(a, b):
	return math.log((math.exp(a) + math.exp(b)))

Julia

function code(a, b)
	return log(Float64(exp(a) + exp(b)))
end

MATLAB

function tmp = code(a, b)
	tmp = log((exp(a) + exp(b)));
end

Wolfram

code[a_, b_] := N[Log[N[(N[Exp[a], $MachinePrecision] + N[Exp[b], $MachinePrecision]), $MachinePrecision]], $MachinePrecision]

Alternative 1: 98.6% accurate, 1.0× speedup

Math

\[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}} \end{array} \]

FPCore

NOTE: a and b should be sorted in increasing order before calling this function.
(FPCore (a b) :precision binary64 (+ (log1p (exp a)) (/ b (+ 1.0 (exp a)))))

C

assert(a < b);
double code(double a, double b) {
	return log1p(exp(a)) + (b / (1.0 + exp(a)));
}

Java

assert a < b;
public static double code(double a, double b) {
	return Math.log1p(Math.exp(a)) + (b / (1.0 + Math.exp(a)));
}

Python

[a, b] = sort([a, b])
def code(a, b):
	return math.log1p(math.exp(a)) + (b / (1.0 + math.exp(a)))

Julia

a, b = sort([a, b])
function code(a, b)
	return Float64(log1p(exp(a)) + Float64(b / Float64(1.0 + exp(a))))
end

Wolfram

NOTE: a and b should be sorted in increasing order before calling this function.
code[a_, b_] := N[(N[Log[1 + N[Exp[a], $MachinePrecision]], $MachinePrecision] + N[(b / N[(1.0 + N[Exp[a], $MachinePrecision]), $MachinePrecision]), $MachinePrecision]), $MachinePrecision]

Derivation

1. Initial program 54.0%

   \[\log \left(e^{a} + e^{b}\right) \]
2. Add Preprocessing

3. Taylor expanded in b around 0

   \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
4. Step-by-step derivation

   1. +-commutative N/A

      \[\leadsto \color{blue}{\frac{b}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

   2. *-rgt-identity N/A

      \[\leadsto \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

   3. associate-*r/ N/A

      \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

   4. lower-+.f64 N/A

      \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

   5. associate-*r/ N/A

      \[\leadsto \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

   6. *-rgt-identity N/A

      \[\leadsto \frac{\color{blue}{b}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

   7. lower-/.f64 N/A

      \[\leadsto \color{blue}{\frac{b}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

   8. +-commutative N/A

      \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

   9. lower-+.f64 N/A

      \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

   10. lower-exp.f64 N/A

       \[\leadsto \frac{b}{\color{blue}{e^{a}} + 1} + \log \left(1 + e^{a}\right) \]

   11. lower-log1p.f64 N/A

       \[\leadsto \frac{b}{e^{a} + 1} + \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

   12. lower-exp.f64 74.8

       \[\leadsto \frac{b}{e^{a} + 1} + \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]

5. Applied rewrites 74.8%

   \[\leadsto \color{blue}{\frac{b}{e^{a} + 1} + \mathsf{log1p}\left(e^{a}\right)} \]

6. Final simplification 74.8%

   \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \frac{b}{1 + e^{a}} \]
7. Add Preprocessing

Alternative 2: 97.9% accurate, 1.0× speedup

Math

\[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} \leq 0:\\ \;\;\;\;\mathsf{fma}\left(e^{a}, b, b\right)\\ \mathbf{else}:\\ \;\;\;\;\mathsf{log1p}\left(e^{a}\right)\\ \end{array} \end{array} \]

FPCore

NOTE: a and b should be sorted in increasing order before calling this function.
(FPCore (a b)
 :precision binary64
 (if (<= (exp a) 0.0) (fma (exp a) b b) (log1p (exp a))))

C

assert(a < b);
double code(double a, double b) {
	double tmp;
	if (exp(a) <= 0.0) {
		tmp = fma(exp(a), b, b);
	} else {
		tmp = log1p(exp(a));
	}
	return tmp;
}

Julia

a, b = sort([a, b])
function code(a, b)
	tmp = 0.0
	if (exp(a) <= 0.0)
		tmp = fma(exp(a), b, b);
	else
		tmp = log1p(exp(a));
	end
	return tmp
end

Wolfram

NOTE: a and b should be sorted in increasing order before calling this function.
code[a_, b_] := If[LessEqual[N[Exp[a], $MachinePrecision], 0.0], N[(N[Exp[a], $MachinePrecision] * b + b), $MachinePrecision], N[Log[1 + N[Exp[a], $MachinePrecision]], $MachinePrecision]]

Derivation

1. Split input into 2 regimes

2. if (exp.f64 a) < 0.0

   1. Initial program 6.7%

      \[\log \left(e^{a} + e^{b}\right) \]
   2. Add Preprocessing

   3. Taylor expanded in b around 0

      \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
   4. Step-by-step derivation

      1. +-commutative N/A

         \[\leadsto \color{blue}{\frac{b}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

      2. *-rgt-identity N/A

         \[\leadsto \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

      3. associate-*r/ N/A

         \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      4. lower-+.f64 N/A

         \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

      5. associate-*r/ N/A

         \[\leadsto \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      6. *-rgt-identity N/A

         \[\leadsto \frac{\color{blue}{b}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

      7. lower-/.f64 N/A

         \[\leadsto \color{blue}{\frac{b}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      8. +-commutative N/A

         \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

      9. lower-+.f64 N/A

         \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

      10. lower-exp.f64 N/A

          \[\leadsto \frac{b}{\color{blue}{e^{a}} + 1} + \log \left(1 + e^{a}\right) \]

      11. lower-log1p.f64 N/A

          \[\leadsto \frac{b}{e^{a} + 1} + \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

      12. lower-exp.f64 100.0

          \[\leadsto \frac{b}{e^{a} + 1} + \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]

   5. Applied rewrites 100.0%

      \[\leadsto \color{blue}{\frac{b}{e^{a} + 1} + \mathsf{log1p}\left(e^{a}\right)} \]
   6. Step-by-step derivation

   7. Applied rewrites 100.0%

      \[\leadsto \frac{b}{\mathsf{expm1}\left(a + a\right) \cdot \frac{1}{\mathsf{expm1}\left(a\right)}} + \mathsf{log1p}\left(e^{a}\right) \]

   9. Applied rewrites 100.0%

      \[\leadsto \mathsf{fma}\left(e^{a} + 1, \color{blue}{b}, \mathsf{log1p}\left(e^{a}\right)\right) \]

   10. Taylor expanded in b around inf

       \[\leadsto b \cdot \color{blue}{\left(1 + e^{a}\right)} \]
   11. Step-by-step derivation

   12. Applied rewrites 100.0%

       \[\leadsto \mathsf{fma}\left(e^{a}, \color{blue}{b}, b\right) \]

   if 0.0 < (exp.f64 a)

   1. Initial program 69.1%

      \[\log \left(e^{a} + e^{b}\right) \]
   2. Add Preprocessing

   3. Taylor expanded in b around 0

      \[\leadsto \color{blue}{\log \left(1 + e^{a}\right)} \]
   4. Step-by-step derivation

      1. lower-log1p.f64 N/A

         \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

      2. lower-exp.f64 66.8

         \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]

   5. Applied rewrites 66.8%

      \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]
3. Recombined 2 regimes into one program.
4. Add Preprocessing

Alternative 3: 97.5% accurate, 1.3× speedup

Math

\[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} \leq 0:\\ \;\;\;\;\mathsf{fma}\left(e^{a}, b, b\right)\\ \mathbf{else}:\\ \;\;\;\;-\log \left(\frac{1}{1 + \mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(0.16666666666666666, b, 0.5\right), b, 1\right), b, 1\right)}\right)\\ \end{array} \end{array} \]

FPCore

NOTE: a and b should be sorted in increasing order before calling this function.
(FPCore (a b)
 :precision binary64
 (if (<= (exp a) 0.0)
   (fma (exp a) b b)
   (-
    (log
     (/
      1.0
      (+ 1.0 (fma (fma (fma 0.16666666666666666 b 0.5) b 1.0) b 1.0)))))))

C

assert(a < b);
double code(double a, double b) {
	double tmp;
	if (exp(a) <= 0.0) {
		tmp = fma(exp(a), b, b);
	} else {
		tmp = -log((1.0 / (1.0 + fma(fma(fma(0.16666666666666666, b, 0.5), b, 1.0), b, 1.0))));
	}
	return tmp;
}

Julia

a, b = sort([a, b])
function code(a, b)
	tmp = 0.0
	if (exp(a) <= 0.0)
		tmp = fma(exp(a), b, b);
	else
		tmp = Float64(-log(Float64(1.0 / Float64(1.0 + fma(fma(fma(0.16666666666666666, b, 0.5), b, 1.0), b, 1.0)))));
	end
	return tmp
end

Wolfram

NOTE: a and b should be sorted in increasing order before calling this function.
code[a_, b_] := If[LessEqual[N[Exp[a], $MachinePrecision], 0.0], N[(N[Exp[a], $MachinePrecision] * b + b), $MachinePrecision], (-N[Log[N[(1.0 / N[(1.0 + N[(N[(N[(0.16666666666666666 * b + 0.5), $MachinePrecision] * b + 1.0), $MachinePrecision] * b + 1.0), $MachinePrecision]), $MachinePrecision]), $MachinePrecision]], $MachinePrecision])]

Derivation

1. Split input into 2 regimes

2. if (exp.f64 a) < 0.0

   1. Initial program 6.7%

      \[\log \left(e^{a} + e^{b}\right) \]
   2. Add Preprocessing

   3. Taylor expanded in b around 0

      \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
   4. Step-by-step derivation

      1. +-commutative N/A

         \[\leadsto \color{blue}{\frac{b}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

      2. *-rgt-identity N/A

         \[\leadsto \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

      3. associate-*r/ N/A

         \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      4. lower-+.f64 N/A

         \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

      5. associate-*r/ N/A

         \[\leadsto \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      6. *-rgt-identity N/A

         \[\leadsto \frac{\color{blue}{b}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

      7. lower-/.f64 N/A

         \[\leadsto \color{blue}{\frac{b}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      8. +-commutative N/A

         \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

      9. lower-+.f64 N/A

         \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

      10. lower-exp.f64 N/A

          \[\leadsto \frac{b}{\color{blue}{e^{a}} + 1} + \log \left(1 + e^{a}\right) \]

      11. lower-log1p.f64 N/A

          \[\leadsto \frac{b}{e^{a} + 1} + \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

      12. lower-exp.f64 100.0

          \[\leadsto \frac{b}{e^{a} + 1} + \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]

   5. Applied rewrites 100.0%

      \[\leadsto \color{blue}{\frac{b}{e^{a} + 1} + \mathsf{log1p}\left(e^{a}\right)} \]
   6. Step-by-step derivation

   7. Applied rewrites 100.0%

      \[\leadsto \frac{b}{\mathsf{expm1}\left(a + a\right) \cdot \frac{1}{\mathsf{expm1}\left(a\right)}} + \mathsf{log1p}\left(e^{a}\right) \]

   9. Applied rewrites 100.0%

      \[\leadsto \mathsf{fma}\left(e^{a} + 1, \color{blue}{b}, \mathsf{log1p}\left(e^{a}\right)\right) \]

   10. Taylor expanded in b around inf

       \[\leadsto b \cdot \color{blue}{\left(1 + e^{a}\right)} \]
   11. Step-by-step derivation

   12. Applied rewrites 100.0%

       \[\leadsto \mathsf{fma}\left(e^{a}, \color{blue}{b}, b\right) \]

   if 0.0 < (exp.f64 a)

   1. Initial program 69.1%

      \[\log \left(e^{a} + e^{b}\right) \]
   2. Add Preprocessing

   3. Taylor expanded in a around 0

      \[\leadsto \log \left(\color{blue}{1} + e^{b}\right) \]
   4. Step-by-step derivation

   5. Applied rewrites 65.9%

      \[\leadsto \log \left(\color{blue}{1} + e^{b}\right) \]

   6. Taylor expanded in b around 0

      \[\leadsto \log \left(1 + \color{blue}{\left(1 + b \cdot \left(1 + b \cdot \left(\frac{1}{2} + \frac{1}{6} \cdot b\right)\right)\right)}\right) \]
   7. Step-by-step derivation

      1. +-commutative N/A

         \[\leadsto \log \left(1 + \color{blue}{\left(b \cdot \left(1 + b \cdot \left(\frac{1}{2} + \frac{1}{6} \cdot b\right)\right) + 1\right)}\right) \]

      2. *-commutative N/A

         \[\leadsto \log \left(1 + \left(\color{blue}{\left(1 + b \cdot \left(\frac{1}{2} + \frac{1}{6} \cdot b\right)\right) \cdot b} + 1\right)\right) \]

      3. lower-fma.f64 N/A

         \[\leadsto \log \left(1 + \color{blue}{\mathsf{fma}\left(1 + b \cdot \left(\frac{1}{2} + \frac{1}{6} \cdot b\right), b, 1\right)}\right) \]

      4. +-commutative N/A

         \[\leadsto \log \left(1 + \mathsf{fma}\left(\color{blue}{b \cdot \left(\frac{1}{2} + \frac{1}{6} \cdot b\right) + 1}, b, 1\right)\right) \]

      5. *-commutative N/A

         \[\leadsto \log \left(1 + \mathsf{fma}\left(\color{blue}{\left(\frac{1}{2} + \frac{1}{6} \cdot b\right) \cdot b} + 1, b, 1\right)\right) \]

      6. lower-fma.f64 N/A

         \[\leadsto \log \left(1 + \mathsf{fma}\left(\color{blue}{\mathsf{fma}\left(\frac{1}{2} + \frac{1}{6} \cdot b, b, 1\right)}, b, 1\right)\right) \]

      7. +-commutative N/A

         \[\leadsto \log \left(1 + \mathsf{fma}\left(\mathsf{fma}\left(\color{blue}{\frac{1}{6} \cdot b + \frac{1}{2}}, b, 1\right), b, 1\right)\right) \]

      8. lower-fma.f64 64.2

         \[\leadsto \log \left(1 + \mathsf{fma}\left(\mathsf{fma}\left(\color{blue}{\mathsf{fma}\left(0.16666666666666666, b, 0.5\right)}, b, 1\right), b, 1\right)\right) \]

   8. Applied rewrites 64.2%

      \[\leadsto \log \left(1 + \color{blue}{\mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(0.16666666666666666, b, 0.5\right), b, 1\right), b, 1\right)}\right) \]
   9. Step-by-step derivation

      1. lift-log.f64 N/A

         \[\leadsto \color{blue}{\log \left(1 + \mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(\frac{1}{6}, b, \frac{1}{2}\right), b, 1\right), b, 1\right)\right)} \]

      2. lift-+.f64 N/A

         \[\leadsto \log \color{blue}{\left(1 + \mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(\frac{1}{6}, b, \frac{1}{2}\right), b, 1\right), b, 1\right)\right)} \]

      3. flip-+ N/A

         \[\leadsto \log \color{blue}{\left(\frac{1 \cdot 1 - \mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(\frac{1}{6}, b, \frac{1}{2}\right), b, 1\right), b, 1\right) \cdot \mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(\frac{1}{6}, b, \frac{1}{2}\right), b, 1\right), b, 1\right)}{1 - \mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(\frac{1}{6}, b, \frac{1}{2}\right), b, 1\right), b, 1\right)}\right)} \]

      4. clear-num N/A

         \[\leadsto \log \color{blue}{\left(\frac{1}{\frac{1 - \mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(\frac{1}{6}, b, \frac{1}{2}\right), b, 1\right), b, 1\right)}{1 \cdot 1 - \mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(\frac{1}{6}, b, \frac{1}{2}\right), b, 1\right), b, 1\right) \cdot \mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(\frac{1}{6}, b, \frac{1}{2}\right), b, 1\right), b, 1\right)}}\right)} \]

      5. log-rec N/A

         \[\leadsto \color{blue}{\mathsf{neg}\left(\log \left(\frac{1 - \mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(\frac{1}{6}, b, \frac{1}{2}\right), b, 1\right), b, 1\right)}{1 \cdot 1 - \mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(\frac{1}{6}, b, \frac{1}{2}\right), b, 1\right), b, 1\right) \cdot \mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(\frac{1}{6}, b, \frac{1}{2}\right), b, 1\right), b, 1\right)}\right)\right)} \]

      6. lower-neg.f64 N/A

         \[\leadsto \color{blue}{\mathsf{neg}\left(\log \left(\frac{1 - \mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(\frac{1}{6}, b, \frac{1}{2}\right), b, 1\right), b, 1\right)}{1 \cdot 1 - \mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(\frac{1}{6}, b, \frac{1}{2}\right), b, 1\right), b, 1\right) \cdot \mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(\frac{1}{6}, b, \frac{1}{2}\right), b, 1\right), b, 1\right)}\right)\right)} \]

   10. Applied rewrites 64.7%

       \[\leadsto \color{blue}{-\log \left(\frac{1}{\mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(0.16666666666666666, b, 0.5\right), b, 1\right), b, 1\right) + 1}\right)} \]
3. Recombined 2 regimes into one program.

4. Final simplification 73.2%

   \[\leadsto \begin{array}{l} \mathbf{if}\;e^{a} \leq 0:\\ \;\;\;\;\mathsf{fma}\left(e^{a}, b, b\right)\\ \mathbf{else}:\\ \;\;\;\;-\log \left(\frac{1}{1 + \mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(0.16666666666666666, b, 0.5\right), b, 1\right), b, 1\right)}\right)\\ \end{array} \]
5. Add Preprocessing

Alternative 4: 97.5% accurate, 1.3× speedup

Math

\[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} \leq 0:\\ \;\;\;\;\mathsf{fma}\left(e^{a}, b, b\right)\\ \mathbf{else}:\\ \;\;\;\;\log \left(1 + \mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(0.16666666666666666, b, 0.5\right), b, 1\right), b, 1\right)\right)\\ \end{array} \end{array} \]

FPCore

NOTE: a and b should be sorted in increasing order before calling this function.
(FPCore (a b)
 :precision binary64
 (if (<= (exp a) 0.0)
   (fma (exp a) b b)
   (log (+ 1.0 (fma (fma (fma 0.16666666666666666 b 0.5) b 1.0) b 1.0)))))

C

assert(a < b);
double code(double a, double b) {
	double tmp;
	if (exp(a) <= 0.0) {
		tmp = fma(exp(a), b, b);
	} else {
		tmp = log((1.0 + fma(fma(fma(0.16666666666666666, b, 0.5), b, 1.0), b, 1.0)));
	}
	return tmp;
}

Julia

a, b = sort([a, b])
function code(a, b)
	tmp = 0.0
	if (exp(a) <= 0.0)
		tmp = fma(exp(a), b, b);
	else
		tmp = log(Float64(1.0 + fma(fma(fma(0.16666666666666666, b, 0.5), b, 1.0), b, 1.0)));
	end
	return tmp
end

Wolfram

NOTE: a and b should be sorted in increasing order before calling this function.
code[a_, b_] := If[LessEqual[N[Exp[a], $MachinePrecision], 0.0], N[(N[Exp[a], $MachinePrecision] * b + b), $MachinePrecision], N[Log[N[(1.0 + N[(N[(N[(0.16666666666666666 * b + 0.5), $MachinePrecision] * b + 1.0), $MachinePrecision] * b + 1.0), $MachinePrecision]), $MachinePrecision]], $MachinePrecision]]

Derivation

1. Split input into 2 regimes

2. if (exp.f64 a) < 0.0

   1. Initial program 6.7%

      \[\log \left(e^{a} + e^{b}\right) \]
   2. Add Preprocessing

   3. Taylor expanded in b around 0

      \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
   4. Step-by-step derivation

      1. +-commutative N/A

         \[\leadsto \color{blue}{\frac{b}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

      2. *-rgt-identity N/A

         \[\leadsto \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

      3. associate-*r/ N/A

         \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      4. lower-+.f64 N/A

         \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

      5. associate-*r/ N/A

         \[\leadsto \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      6. *-rgt-identity N/A

         \[\leadsto \frac{\color{blue}{b}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

      7. lower-/.f64 N/A

         \[\leadsto \color{blue}{\frac{b}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      8. +-commutative N/A

         \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

      9. lower-+.f64 N/A

         \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

      10. lower-exp.f64 N/A

          \[\leadsto \frac{b}{\color{blue}{e^{a}} + 1} + \log \left(1 + e^{a}\right) \]

      11. lower-log1p.f64 N/A

          \[\leadsto \frac{b}{e^{a} + 1} + \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

      12. lower-exp.f64 100.0

          \[\leadsto \frac{b}{e^{a} + 1} + \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]

   5. Applied rewrites 100.0%

      \[\leadsto \color{blue}{\frac{b}{e^{a} + 1} + \mathsf{log1p}\left(e^{a}\right)} \]
   6. Step-by-step derivation

   7. Applied rewrites 100.0%

      \[\leadsto \frac{b}{\mathsf{expm1}\left(a + a\right) \cdot \frac{1}{\mathsf{expm1}\left(a\right)}} + \mathsf{log1p}\left(e^{a}\right) \]

   9. Applied rewrites 100.0%

      \[\leadsto \mathsf{fma}\left(e^{a} + 1, \color{blue}{b}, \mathsf{log1p}\left(e^{a}\right)\right) \]

   10. Taylor expanded in b around inf

       \[\leadsto b \cdot \color{blue}{\left(1 + e^{a}\right)} \]
   11. Step-by-step derivation

   12. Applied rewrites 100.0%

       \[\leadsto \mathsf{fma}\left(e^{a}, \color{blue}{b}, b\right) \]

   if 0.0 < (exp.f64 a)

   1. Initial program 69.1%

      \[\log \left(e^{a} + e^{b}\right) \]
   2. Add Preprocessing

   3. Taylor expanded in a around 0

      \[\leadsto \log \left(\color{blue}{1} + e^{b}\right) \]
   4. Step-by-step derivation

   5. Applied rewrites 65.9%

      \[\leadsto \log \left(\color{blue}{1} + e^{b}\right) \]

   6. Taylor expanded in b around 0

      \[\leadsto \log \left(1 + \color{blue}{\left(1 + b \cdot \left(1 + b \cdot \left(\frac{1}{2} + \frac{1}{6} \cdot b\right)\right)\right)}\right) \]
   7. Step-by-step derivation

      1. +-commutative N/A

         \[\leadsto \log \left(1 + \color{blue}{\left(b \cdot \left(1 + b \cdot \left(\frac{1}{2} + \frac{1}{6} \cdot b\right)\right) + 1\right)}\right) \]

      2. *-commutative N/A

         \[\leadsto \log \left(1 + \left(\color{blue}{\left(1 + b \cdot \left(\frac{1}{2} + \frac{1}{6} \cdot b\right)\right) \cdot b} + 1\right)\right) \]

      3. lower-fma.f64 N/A

         \[\leadsto \log \left(1 + \color{blue}{\mathsf{fma}\left(1 + b \cdot \left(\frac{1}{2} + \frac{1}{6} \cdot b\right), b, 1\right)}\right) \]

      4. +-commutative N/A

         \[\leadsto \log \left(1 + \mathsf{fma}\left(\color{blue}{b \cdot \left(\frac{1}{2} + \frac{1}{6} \cdot b\right) + 1}, b, 1\right)\right) \]

      5. *-commutative N/A

         \[\leadsto \log \left(1 + \mathsf{fma}\left(\color{blue}{\left(\frac{1}{2} + \frac{1}{6} \cdot b\right) \cdot b} + 1, b, 1\right)\right) \]

      6. lower-fma.f64 N/A

         \[\leadsto \log \left(1 + \mathsf{fma}\left(\color{blue}{\mathsf{fma}\left(\frac{1}{2} + \frac{1}{6} \cdot b, b, 1\right)}, b, 1\right)\right) \]

      7. +-commutative N/A

         \[\leadsto \log \left(1 + \mathsf{fma}\left(\mathsf{fma}\left(\color{blue}{\frac{1}{6} \cdot b + \frac{1}{2}}, b, 1\right), b, 1\right)\right) \]

      8. lower-fma.f64 64.2

         \[\leadsto \log \left(1 + \mathsf{fma}\left(\mathsf{fma}\left(\color{blue}{\mathsf{fma}\left(0.16666666666666666, b, 0.5\right)}, b, 1\right), b, 1\right)\right) \]

   8. Applied rewrites 64.2%

      \[\leadsto \log \left(1 + \color{blue}{\mathsf{fma}\left(\mathsf{fma}\left(\mathsf{fma}\left(0.16666666666666666, b, 0.5\right), b, 1\right), b, 1\right)}\right) \]
3. Recombined 2 regimes into one program.
4. Add Preprocessing

Alternative 5: 97.5% accurate, 1.4× speedup

Math

\[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} \leq 0:\\ \;\;\;\;\mathsf{fma}\left(e^{a}, b, b\right)\\ \mathbf{else}:\\ \;\;\;\;\mathsf{fma}\left(\mathsf{fma}\left(0.125, a, 0.5\right), a, \log 2\right)\\ \end{array} \end{array} \]

FPCore

NOTE: a and b should be sorted in increasing order before calling this function.
(FPCore (a b)
 :precision binary64
 (if (<= (exp a) 0.0) (fma (exp a) b b) (fma (fma 0.125 a 0.5) a (log 2.0))))

C

assert(a < b);
double code(double a, double b) {
	double tmp;
	if (exp(a) <= 0.0) {
		tmp = fma(exp(a), b, b);
	} else {
		tmp = fma(fma(0.125, a, 0.5), a, log(2.0));
	}
	return tmp;
}

Julia

a, b = sort([a, b])
function code(a, b)
	tmp = 0.0
	if (exp(a) <= 0.0)
		tmp = fma(exp(a), b, b);
	else
		tmp = fma(fma(0.125, a, 0.5), a, log(2.0));
	end
	return tmp
end

Wolfram

NOTE: a and b should be sorted in increasing order before calling this function.
code[a_, b_] := If[LessEqual[N[Exp[a], $MachinePrecision], 0.0], N[(N[Exp[a], $MachinePrecision] * b + b), $MachinePrecision], N[(N[(0.125 * a + 0.5), $MachinePrecision] * a + N[Log[2.0], $MachinePrecision]), $MachinePrecision]]

Derivation

1. Split input into 2 regimes

2. if (exp.f64 a) < 0.0

   1. Initial program 6.7%

      \[\log \left(e^{a} + e^{b}\right) \]
   2. Add Preprocessing

   3. Taylor expanded in b around 0

      \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
   4. Step-by-step derivation

      1. +-commutative N/A

         \[\leadsto \color{blue}{\frac{b}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

      2. *-rgt-identity N/A

         \[\leadsto \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

      3. associate-*r/ N/A

         \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      4. lower-+.f64 N/A

         \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

      5. associate-*r/ N/A

         \[\leadsto \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      6. *-rgt-identity N/A

         \[\leadsto \frac{\color{blue}{b}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

      7. lower-/.f64 N/A

         \[\leadsto \color{blue}{\frac{b}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      8. +-commutative N/A

         \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

      9. lower-+.f64 N/A

         \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

      10. lower-exp.f64 N/A

          \[\leadsto \frac{b}{\color{blue}{e^{a}} + 1} + \log \left(1 + e^{a}\right) \]

      11. lower-log1p.f64 N/A

          \[\leadsto \frac{b}{e^{a} + 1} + \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

      12. lower-exp.f64 100.0

          \[\leadsto \frac{b}{e^{a} + 1} + \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]

   5. Applied rewrites 100.0%

      \[\leadsto \color{blue}{\frac{b}{e^{a} + 1} + \mathsf{log1p}\left(e^{a}\right)} \]
   6. Step-by-step derivation

   7. Applied rewrites 100.0%

      \[\leadsto \frac{b}{\mathsf{expm1}\left(a + a\right) \cdot \frac{1}{\mathsf{expm1}\left(a\right)}} + \mathsf{log1p}\left(e^{a}\right) \]

   9. Applied rewrites 100.0%

      \[\leadsto \mathsf{fma}\left(e^{a} + 1, \color{blue}{b}, \mathsf{log1p}\left(e^{a}\right)\right) \]

   10. Taylor expanded in b around inf

       \[\leadsto b \cdot \color{blue}{\left(1 + e^{a}\right)} \]
   11. Step-by-step derivation

   12. Applied rewrites 100.0%

       \[\leadsto \mathsf{fma}\left(e^{a}, \color{blue}{b}, b\right) \]

   if 0.0 < (exp.f64 a)

   1. Initial program 69.1%

      \[\log \left(e^{a} + e^{b}\right) \]
   2. Add Preprocessing

   3. Taylor expanded in b around 0

      \[\leadsto \color{blue}{\log \left(1 + e^{a}\right)} \]
   4. Step-by-step derivation

      1. lower-log1p.f64 N/A

         \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

      2. lower-exp.f64 66.8

         \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]

   5. Applied rewrites 66.8%

      \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

   6. Taylor expanded in a around 0

      \[\leadsto \log 2 + \color{blue}{a \cdot \left(\frac{1}{2} + \frac{1}{8} \cdot a\right)} \]
   7. Step-by-step derivation

   8. Applied rewrites 66.2%

      \[\leadsto \mathsf{fma}\left(\mathsf{fma}\left(0.125, a, 0.5\right), \color{blue}{a}, \log 2\right) \]
3. Recombined 2 regimes into one program.
4. Add Preprocessing

Alternative 6: 97.3% accurate, 1.4× speedup

Math

\[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} \leq 0:\\ \;\;\;\;\mathsf{fma}\left(e^{a}, b, b\right)\\ \mathbf{else}:\\ \;\;\;\;\mathsf{fma}\left(0.5, b, \log 2\right)\\ \end{array} \end{array} \]

FPCore

NOTE: a and b should be sorted in increasing order before calling this function.
(FPCore (a b)
 :precision binary64
 (if (<= (exp a) 0.0) (fma (exp a) b b) (fma 0.5 b (log 2.0))))

C

assert(a < b);
double code(double a, double b) {
	double tmp;
	if (exp(a) <= 0.0) {
		tmp = fma(exp(a), b, b);
	} else {
		tmp = fma(0.5, b, log(2.0));
	}
	return tmp;
}

Julia

a, b = sort([a, b])
function code(a, b)
	tmp = 0.0
	if (exp(a) <= 0.0)
		tmp = fma(exp(a), b, b);
	else
		tmp = fma(0.5, b, log(2.0));
	end
	return tmp
end

Wolfram

NOTE: a and b should be sorted in increasing order before calling this function.
code[a_, b_] := If[LessEqual[N[Exp[a], $MachinePrecision], 0.0], N[(N[Exp[a], $MachinePrecision] * b + b), $MachinePrecision], N[(0.5 * b + N[Log[2.0], $MachinePrecision]), $MachinePrecision]]

Derivation

1. Split input into 2 regimes

2. if (exp.f64 a) < 0.0

   1. Initial program 6.7%

      \[\log \left(e^{a} + e^{b}\right) \]
   2. Add Preprocessing

   3. Taylor expanded in b around 0

      \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
   4. Step-by-step derivation

      1. +-commutative N/A

         \[\leadsto \color{blue}{\frac{b}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

      2. *-rgt-identity N/A

         \[\leadsto \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

      3. associate-*r/ N/A

         \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      4. lower-+.f64 N/A

         \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

      5. associate-*r/ N/A

         \[\leadsto \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      6. *-rgt-identity N/A

         \[\leadsto \frac{\color{blue}{b}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

      7. lower-/.f64 N/A

         \[\leadsto \color{blue}{\frac{b}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      8. +-commutative N/A

         \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

      9. lower-+.f64 N/A

         \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

      10. lower-exp.f64 N/A

          \[\leadsto \frac{b}{\color{blue}{e^{a}} + 1} + \log \left(1 + e^{a}\right) \]

      11. lower-log1p.f64 N/A

          \[\leadsto \frac{b}{e^{a} + 1} + \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

      12. lower-exp.f64 100.0

          \[\leadsto \frac{b}{e^{a} + 1} + \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]

   5. Applied rewrites 100.0%

      \[\leadsto \color{blue}{\frac{b}{e^{a} + 1} + \mathsf{log1p}\left(e^{a}\right)} \]
   6. Step-by-step derivation

   7. Applied rewrites 100.0%

      \[\leadsto \frac{b}{\mathsf{expm1}\left(a + a\right) \cdot \frac{1}{\mathsf{expm1}\left(a\right)}} + \mathsf{log1p}\left(e^{a}\right) \]

   9. Applied rewrites 100.0%

      \[\leadsto \mathsf{fma}\left(e^{a} + 1, \color{blue}{b}, \mathsf{log1p}\left(e^{a}\right)\right) \]

   10. Taylor expanded in b around inf

       \[\leadsto b \cdot \color{blue}{\left(1 + e^{a}\right)} \]
   11. Step-by-step derivation

   12. Applied rewrites 100.0%

       \[\leadsto \mathsf{fma}\left(e^{a}, \color{blue}{b}, b\right) \]

   if 0.0 < (exp.f64 a)

   1. Initial program 69.1%

      \[\log \left(e^{a} + e^{b}\right) \]
   2. Add Preprocessing

   3. Taylor expanded in b around 0

      \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
   4. Step-by-step derivation

      1. +-commutative N/A

         \[\leadsto \color{blue}{\frac{b}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

      2. *-rgt-identity N/A

         \[\leadsto \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

      3. associate-*r/ N/A

         \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      4. lower-+.f64 N/A

         \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

      5. associate-*r/ N/A

         \[\leadsto \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      6. *-rgt-identity N/A

         \[\leadsto \frac{\color{blue}{b}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

      7. lower-/.f64 N/A

         \[\leadsto \color{blue}{\frac{b}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      8. +-commutative N/A

         \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

      9. lower-+.f64 N/A

         \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

      10. lower-exp.f64 N/A

          \[\leadsto \frac{b}{\color{blue}{e^{a}} + 1} + \log \left(1 + e^{a}\right) \]

      11. lower-log1p.f64 N/A

          \[\leadsto \frac{b}{e^{a} + 1} + \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

      12. lower-exp.f64 66.7

          \[\leadsto \frac{b}{e^{a} + 1} + \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]

   5. Applied rewrites 66.7%

      \[\leadsto \color{blue}{\frac{b}{e^{a} + 1} + \mathsf{log1p}\left(e^{a}\right)} \]

   6. Taylor expanded in a around 0

      \[\leadsto \log 2 + \color{blue}{\frac{1}{2} \cdot b} \]
   7. Step-by-step derivation

   8. Applied rewrites 64.6%

      \[\leadsto \mathsf{fma}\left(0.5, \color{blue}{b}, \log 2\right) \]
3. Recombined 2 regimes into one program.
4. Add Preprocessing

Alternative 7: 97.2% accurate, 1.4× speedup

Math

\[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \begin{array}{l} \mathbf{if}\;e^{a} \leq 0.0005:\\ \;\;\;\;\mathsf{fma}\left(e^{a}, b, b\right)\\ \mathbf{else}:\\ \;\;\;\;\mathsf{fma}\left(0.5, a, \log 2\right)\\ \end{array} \end{array} \]

FPCore

NOTE: a and b should be sorted in increasing order before calling this function.
(FPCore (a b)
 :precision binary64
 (if (<= (exp a) 0.0005) (fma (exp a) b b) (fma 0.5 a (log 2.0))))

C

assert(a < b);
double code(double a, double b) {
	double tmp;
	if (exp(a) <= 0.0005) {
		tmp = fma(exp(a), b, b);
	} else {
		tmp = fma(0.5, a, log(2.0));
	}
	return tmp;
}

Julia

a, b = sort([a, b])
function code(a, b)
	tmp = 0.0
	if (exp(a) <= 0.0005)
		tmp = fma(exp(a), b, b);
	else
		tmp = fma(0.5, a, log(2.0));
	end
	return tmp
end

Wolfram

NOTE: a and b should be sorted in increasing order before calling this function.
code[a_, b_] := If[LessEqual[N[Exp[a], $MachinePrecision], 0.0005], N[(N[Exp[a], $MachinePrecision] * b + b), $MachinePrecision], N[(0.5 * a + N[Log[2.0], $MachinePrecision]), $MachinePrecision]]

Derivation

1. Split input into 2 regimes

2. if (exp.f64 a) < 5.0000000000000001e-4

   1. Initial program 7.8%

      \[\log \left(e^{a} + e^{b}\right) \]
   2. Add Preprocessing

   3. Taylor expanded in b around 0

      \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
   4. Step-by-step derivation

      1. +-commutative N/A

         \[\leadsto \color{blue}{\frac{b}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

      2. *-rgt-identity N/A

         \[\leadsto \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

      3. associate-*r/ N/A

         \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      4. lower-+.f64 N/A

         \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

      5. associate-*r/ N/A

         \[\leadsto \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      6. *-rgt-identity N/A

         \[\leadsto \frac{\color{blue}{b}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

      7. lower-/.f64 N/A

         \[\leadsto \color{blue}{\frac{b}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

      8. +-commutative N/A

         \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

      9. lower-+.f64 N/A

         \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

      10. lower-exp.f64 N/A

          \[\leadsto \frac{b}{\color{blue}{e^{a}} + 1} + \log \left(1 + e^{a}\right) \]

      11. lower-log1p.f64 N/A

          \[\leadsto \frac{b}{e^{a} + 1} + \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

      12. lower-exp.f64 100.0

          \[\leadsto \frac{b}{e^{a} + 1} + \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]

   5. Applied rewrites 100.0%

      \[\leadsto \color{blue}{\frac{b}{e^{a} + 1} + \mathsf{log1p}\left(e^{a}\right)} \]
   6. Step-by-step derivation

   7. Applied rewrites 100.0%

      \[\leadsto \frac{b}{\mathsf{expm1}\left(a + a\right) \cdot \frac{1}{\mathsf{expm1}\left(a\right)}} + \mathsf{log1p}\left(e^{a}\right) \]

   9. Applied rewrites 100.0%

      \[\leadsto \mathsf{fma}\left(e^{a} + 1, \color{blue}{b}, \mathsf{log1p}\left(e^{a}\right)\right) \]

   10. Taylor expanded in b around inf

       \[\leadsto b \cdot \color{blue}{\left(1 + e^{a}\right)} \]
   11. Step-by-step derivation

   12. Applied rewrites 96.9%

       \[\leadsto \mathsf{fma}\left(e^{a}, \color{blue}{b}, b\right) \]

   if 5.0000000000000001e-4 < (exp.f64 a)

   1. Initial program 69.4%

      \[\log \left(e^{a} + e^{b}\right) \]
   2. Add Preprocessing

   3. Taylor expanded in b around 0

      \[\leadsto \color{blue}{\log \left(1 + e^{a}\right)} \]
   4. Step-by-step derivation

      1. lower-log1p.f64 N/A

         \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

      2. lower-exp.f64 66.6

         \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]

   5. Applied rewrites 66.6%

      \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

   6. Taylor expanded in a around 0

      \[\leadsto \log 2 + \color{blue}{\frac{1}{2} \cdot a} \]
   7. Step-by-step derivation

   8. Applied rewrites 66.5%

      \[\leadsto \mathsf{fma}\left(0.5, \color{blue}{a}, \log 2\right) \]
3. Recombined 2 regimes into one program.
4. Add Preprocessing

Alternative 8: 98.3% accurate, 1.5× speedup

Math

\[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \mathsf{log1p}\left(e^{a}\right) + b \end{array} \]

FPCore

NOTE: a and b should be sorted in increasing order before calling this function.
(FPCore (a b) :precision binary64 (+ (log1p (exp a)) b))

C

assert(a < b);
double code(double a, double b) {
	return log1p(exp(a)) + b;
}

Java

assert a < b;
public static double code(double a, double b) {
	return Math.log1p(Math.exp(a)) + b;
}

Python

[a, b] = sort([a, b])
def code(a, b):
	return math.log1p(math.exp(a)) + b

Julia

a, b = sort([a, b])
function code(a, b)
	return Float64(log1p(exp(a)) + b)
end

Wolfram

NOTE: a and b should be sorted in increasing order before calling this function.
code[a_, b_] := N[(N[Log[1 + N[Exp[a], $MachinePrecision]], $MachinePrecision] + b), $MachinePrecision]

Derivation

1. Initial program 54.0%

   \[\log \left(e^{a} + e^{b}\right) \]
2. Add Preprocessing

3. Taylor expanded in b around 0

   \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
4. Step-by-step derivation

   1. +-commutative N/A

      \[\leadsto \color{blue}{\frac{b}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

   2. *-rgt-identity N/A

      \[\leadsto \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

   3. associate-*r/ N/A

      \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

   4. lower-+.f64 N/A

      \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

   5. associate-*r/ N/A

      \[\leadsto \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

   6. *-rgt-identity N/A

      \[\leadsto \frac{\color{blue}{b}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

   7. lower-/.f64 N/A

      \[\leadsto \color{blue}{\frac{b}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

   8. +-commutative N/A

      \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

   9. lower-+.f64 N/A

      \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

   10. lower-exp.f64 N/A

       \[\leadsto \frac{b}{\color{blue}{e^{a}} + 1} + \log \left(1 + e^{a}\right) \]

   11. lower-log1p.f64 N/A

       \[\leadsto \frac{b}{e^{a} + 1} + \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

   12. lower-exp.f64 74.8

       \[\leadsto \frac{b}{e^{a} + 1} + \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]

5. Applied rewrites 74.8%

   \[\leadsto \color{blue}{\frac{b}{e^{a} + 1} + \mathsf{log1p}\left(e^{a}\right)} \]
6. Step-by-step derivation

7. Applied rewrites 74.7%

   \[\leadsto \frac{b}{\mathsf{expm1}\left(a + a\right) \cdot \frac{1}{\mathsf{expm1}\left(a\right)}} + \mathsf{log1p}\left(e^{a}\right) \]

9. Applied rewrites 74.4%

   \[\leadsto \frac{b}{\mathsf{expm1}\left(a\right)} \cdot \mathsf{expm1}\left(a\right) + \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]

10. Taylor expanded in b around 0

    \[\leadsto b + \color{blue}{\log \left(1 + e^{a}\right)} \]
11. Step-by-step derivation

12. Applied rewrites 74.5%

    \[\leadsto \mathsf{log1p}\left(e^{a}\right) + \color{blue}{b} \]
13. Add Preprocessing

Alternative 9: 49.5% accurate, 2.9× speedup

Math

\[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \log 2 + b \end{array} \]

FPCore

NOTE: a and b should be sorted in increasing order before calling this function.
(FPCore (a b) :precision binary64 (+ (log 2.0) b))

C

assert(a < b);
double code(double a, double b) {
	return log(2.0) + b;
}

Fortran

NOTE: a and b should be sorted in increasing order before calling this function.
real(8) function code(a, b)
    real(8), intent (in) :: a
    real(8), intent (in) :: b
    code = log(2.0d0) + b
end function

Java

assert a < b;
public static double code(double a, double b) {
	return Math.log(2.0) + b;
}

Python

[a, b] = sort([a, b])
def code(a, b):
	return math.log(2.0) + b

Julia

a, b = sort([a, b])
function code(a, b)
	return Float64(log(2.0) + b)
end

MATLAB

a, b = num2cell(sort([a, b])){:}
function tmp = code(a, b)
	tmp = log(2.0) + b;
end

Wolfram

NOTE: a and b should be sorted in increasing order before calling this function.
code[a_, b_] := N[(N[Log[2.0], $MachinePrecision] + b), $MachinePrecision]

Derivation

1. Initial program 54.0%

   \[\log \left(e^{a} + e^{b}\right) \]
2. Add Preprocessing

3. Taylor expanded in b around 0

   \[\leadsto \color{blue}{\log \left(1 + e^{a}\right) + \frac{b}{1 + e^{a}}} \]
4. Step-by-step derivation

   1. +-commutative N/A

      \[\leadsto \color{blue}{\frac{b}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

   2. *-rgt-identity N/A

      \[\leadsto \frac{\color{blue}{b \cdot 1}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

   3. associate-*r/ N/A

      \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

   4. lower-+.f64 N/A

      \[\leadsto \color{blue}{b \cdot \frac{1}{1 + e^{a}} + \log \left(1 + e^{a}\right)} \]

   5. associate-*r/ N/A

      \[\leadsto \color{blue}{\frac{b \cdot 1}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

   6. *-rgt-identity N/A

      \[\leadsto \frac{\color{blue}{b}}{1 + e^{a}} + \log \left(1 + e^{a}\right) \]

   7. lower-/.f64 N/A

      \[\leadsto \color{blue}{\frac{b}{1 + e^{a}}} + \log \left(1 + e^{a}\right) \]

   8. +-commutative N/A

      \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

   9. lower-+.f64 N/A

      \[\leadsto \frac{b}{\color{blue}{e^{a} + 1}} + \log \left(1 + e^{a}\right) \]

   10. lower-exp.f64 N/A

       \[\leadsto \frac{b}{\color{blue}{e^{a}} + 1} + \log \left(1 + e^{a}\right) \]

   11. lower-log1p.f64 N/A

       \[\leadsto \frac{b}{e^{a} + 1} + \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

   12. lower-exp.f64 74.8

       \[\leadsto \frac{b}{e^{a} + 1} + \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]

5. Applied rewrites 74.8%

   \[\leadsto \color{blue}{\frac{b}{e^{a} + 1} + \mathsf{log1p}\left(e^{a}\right)} \]
6. Step-by-step derivation

7. Applied rewrites 74.7%

   \[\leadsto \frac{b}{\mathsf{expm1}\left(a + a\right) \cdot \frac{1}{\mathsf{expm1}\left(a\right)}} + \mathsf{log1p}\left(e^{a}\right) \]

9. Applied rewrites 74.4%

   \[\leadsto \frac{b}{\mathsf{expm1}\left(a\right)} \cdot \mathsf{expm1}\left(a\right) + \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]

10. Taylor expanded in a around 0

    \[\leadsto b + \color{blue}{\log 2} \]
11. Step-by-step derivation

12. Applied rewrites 49.5%

    \[\leadsto \log 2 + \color{blue}{b} \]
13. Add Preprocessing

Alternative 10: 48.7% accurate, 3.0× speedup

Math

\[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \mathsf{log1p}\left(1\right) \end{array} \]

FPCore

NOTE: a and b should be sorted in increasing order before calling this function.
(FPCore (a b) :precision binary64 (log1p 1.0))

C

assert(a < b);
double code(double a, double b) {
	return log1p(1.0);
}

Java

assert a < b;
public static double code(double a, double b) {
	return Math.log1p(1.0);
}

Python

[a, b] = sort([a, b])
def code(a, b):
	return math.log1p(1.0)

Julia

a, b = sort([a, b])
function code(a, b)
	return log1p(1.0)
end

Wolfram

NOTE: a and b should be sorted in increasing order before calling this function.
code[a_, b_] := N[Log[1 + 1.0], $MachinePrecision]

Derivation

1. Initial program 54.0%

   \[\log \left(e^{a} + e^{b}\right) \]
2. Add Preprocessing

3. Taylor expanded in b around 0

   \[\leadsto \color{blue}{\log \left(1 + e^{a}\right)} \]
4. Step-by-step derivation

   1. lower-log1p.f64 N/A

      \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

   2. lower-exp.f64 52.0

      \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]

5. Applied rewrites 52.0%

   \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

6. Taylor expanded in a around 0

   \[\leadsto \mathsf{log1p}\left(1\right) \]
7. Step-by-step derivation

8. Applied rewrites 50.0%

   \[\leadsto \mathsf{log1p}\left(1\right) \]
9. Add Preprocessing

Alternative 11: 3.2% accurate, 27.6× speedup

Math

\[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ \left(a \cdot a\right) \cdot 0.125 \end{array} \]

FPCore

NOTE: a and b should be sorted in increasing order before calling this function.
(FPCore (a b) :precision binary64 (* (* a a) 0.125))

C

assert(a < b);
double code(double a, double b) {
	return (a * a) * 0.125;
}

Fortran

NOTE: a and b should be sorted in increasing order before calling this function.
real(8) function code(a, b)
    real(8), intent (in) :: a
    real(8), intent (in) :: b
    code = (a * a) * 0.125d0
end function

Java

assert a < b;
public static double code(double a, double b) {
	return (a * a) * 0.125;
}

Python

[a, b] = sort([a, b])
def code(a, b):
	return (a * a) * 0.125

Julia

a, b = sort([a, b])
function code(a, b)
	return Float64(Float64(a * a) * 0.125)
end

MATLAB

a, b = num2cell(sort([a, b])){:}
function tmp = code(a, b)
	tmp = (a * a) * 0.125;
end

Wolfram

NOTE: a and b should be sorted in increasing order before calling this function.
code[a_, b_] := N[(N[(a * a), $MachinePrecision] * 0.125), $MachinePrecision]

Derivation

1. Initial program 54.0%

   \[\log \left(e^{a} + e^{b}\right) \]
2. Add Preprocessing

3. Taylor expanded in b around 0

   \[\leadsto \color{blue}{\log \left(1 + e^{a}\right)} \]
4. Step-by-step derivation

   1. lower-log1p.f64 N/A

      \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

   2. lower-exp.f64 52.0

      \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]

5. Applied rewrites 52.0%

   \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

6. Taylor expanded in a around 0

   \[\leadsto \log 2 + \color{blue}{a \cdot \left(\frac{1}{2} + \frac{1}{8} \cdot a\right)} \]
7. Step-by-step derivation

8. Applied rewrites 50.6%

   \[\leadsto \mathsf{fma}\left(\mathsf{fma}\left(0.125, a, 0.5\right), \color{blue}{a}, \log 2\right) \]

9. Taylor expanded in a around inf

   \[\leadsto \frac{1}{8} \cdot {a}^{\color{blue}{2}} \]
10. Step-by-step derivation

11. Applied rewrites 4.2%

    \[\leadsto \left(a \cdot a\right) \cdot 0.125 \]
12. Add Preprocessing

Alternative 12: 2.6% accurate, 50.7× speedup

Math

\[\begin{array}{l} [a, b] = \mathsf{sort}([a, b])\\ \\ 0.5 \cdot a \end{array} \]

FPCore

NOTE: a and b should be sorted in increasing order before calling this function.
(FPCore (a b) :precision binary64 (* 0.5 a))

C

assert(a < b);
double code(double a, double b) {
	return 0.5 * a;
}

Fortran

NOTE: a and b should be sorted in increasing order before calling this function.
real(8) function code(a, b)
    real(8), intent (in) :: a
    real(8), intent (in) :: b
    code = 0.5d0 * a
end function

Java

assert a < b;
public static double code(double a, double b) {
	return 0.5 * a;
}

Python

[a, b] = sort([a, b])
def code(a, b):
	return 0.5 * a

Julia

a, b = sort([a, b])
function code(a, b)
	return Float64(0.5 * a)
end

MATLAB

a, b = num2cell(sort([a, b])){:}
function tmp = code(a, b)
	tmp = 0.5 * a;
end

Wolfram

NOTE: a and b should be sorted in increasing order before calling this function.
code[a_, b_] := N[(0.5 * a), $MachinePrecision]

Derivation

1. Initial program 54.0%

   \[\log \left(e^{a} + e^{b}\right) \]
2. Add Preprocessing

3. Taylor expanded in b around 0

   \[\leadsto \color{blue}{\log \left(1 + e^{a}\right)} \]
4. Step-by-step derivation

   1. lower-log1p.f64 N/A

      \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

   2. lower-exp.f64 52.0

      \[\leadsto \mathsf{log1p}\left(\color{blue}{e^{a}}\right) \]

5. Applied rewrites 52.0%

   \[\leadsto \color{blue}{\mathsf{log1p}\left(e^{a}\right)} \]

6. Taylor expanded in a around 0

   \[\leadsto \log 2 + \color{blue}{\frac{1}{2} \cdot a} \]
7. Step-by-step derivation

8. Applied rewrites 50.4%

   \[\leadsto \mathsf{fma}\left(0.5, \color{blue}{a}, \log 2\right) \]

9. Taylor expanded in a around inf

   \[\leadsto \frac{1}{2} \cdot a \]
10. Step-by-step derivation

11. Applied rewrites 7.3%

    \[\leadsto 0.5 \cdot a \]
12. Add Preprocessing

Reproduce

herbie shell --seed 2024235 
(FPCore (a b)
  :name "symmetry log of sum of exp"
  :precision binary64
  (log (+ (exp a) (exp b))))