Sample trimmed logistic on [-pi, pi]

Percentage Accurate: 98.9% → 99.0%
Time: 20.8s
Alternatives: 20
Speedup: 0.5×

Specification

?
\[\left(2.328306437 \cdot 10^{-10} \leq u \land u \leq 1\right) \land \left(0 \leq s \land s \leq 1.0651631\right)\]
\[\begin{array}{l} \\ \begin{array}{l} t_0 := \frac{1}{1 + e^{\frac{\pi}{s}}}\\ \left(-s\right) \cdot \log \left(\frac{1}{u \cdot \left(\frac{1}{1 + e^{\frac{-\pi}{s}}} - t\_0\right) + t\_0} - 1\right) \end{array} \end{array} \]
(FPCore (u s)
 :precision binary32
 (let* ((t_0 (/ 1.0 (+ 1.0 (exp (/ PI s))))))
   (*
    (- s)
    (log
     (-
      (/ 1.0 (+ (* u (- (/ 1.0 (+ 1.0 (exp (/ (- PI) s)))) t_0)) t_0))
      1.0)))))
float code(float u, float s) {
	float t_0 = 1.0f / (1.0f + expf((((float) M_PI) / s)));
	return -s * logf(((1.0f / ((u * ((1.0f / (1.0f + expf((-((float) M_PI) / s)))) - t_0)) + t_0)) - 1.0f));
}
function code(u, s)
	t_0 = Float32(Float32(1.0) / Float32(Float32(1.0) + exp(Float32(Float32(pi) / s))))
	return Float32(Float32(-s) * log(Float32(Float32(Float32(1.0) / Float32(Float32(u * Float32(Float32(Float32(1.0) / Float32(Float32(1.0) + exp(Float32(Float32(-Float32(pi)) / s)))) - t_0)) + t_0)) - Float32(1.0))))
end
function tmp = code(u, s)
	t_0 = single(1.0) / (single(1.0) + exp((single(pi) / s)));
	tmp = -s * log(((single(1.0) / ((u * ((single(1.0) / (single(1.0) + exp((-single(pi) / s)))) - t_0)) + t_0)) - single(1.0)));
end
\begin{array}{l}

\\
\begin{array}{l}
t_0 := \frac{1}{1 + e^{\frac{\pi}{s}}}\\
\left(-s\right) \cdot \log \left(\frac{1}{u \cdot \left(\frac{1}{1 + e^{\frac{-\pi}{s}}} - t\_0\right) + t\_0} - 1\right)
\end{array}
\end{array}

Sampling outcomes in binary32 precision:

Local Percentage Accuracy vs ?

The average percentage accuracy by input value. Horizontal axis shows value of an input variable; the variable is choosen in the title. Vertical axis is accuracy; higher is better. Red represent the original program, while blue represents Herbie's suggestion. These can be toggled with buttons below the plot. The line is an average while dots represent individual samples.

Accuracy vs Speed?

Herbie found 20 alternatives:

AlternativeAccuracySpeedup
The accuracy (vertical axis) and speed (horizontal axis) of each alternatives. Up and to the right is better. The red square shows the initial program, and each blue circle shows an alternative.The line shows the best available speed-accuracy tradeoffs.

Initial Program: 98.9% accurate, 1.0× speedup?

\[\begin{array}{l} \\ \begin{array}{l} t_0 := \frac{1}{1 + e^{\frac{\pi}{s}}}\\ \left(-s\right) \cdot \log \left(\frac{1}{u \cdot \left(\frac{1}{1 + e^{\frac{-\pi}{s}}} - t\_0\right) + t\_0} - 1\right) \end{array} \end{array} \]
(FPCore (u s)
 :precision binary32
 (let* ((t_0 (/ 1.0 (+ 1.0 (exp (/ PI s))))))
   (*
    (- s)
    (log
     (-
      (/ 1.0 (+ (* u (- (/ 1.0 (+ 1.0 (exp (/ (- PI) s)))) t_0)) t_0))
      1.0)))))
float code(float u, float s) {
	float t_0 = 1.0f / (1.0f + expf((((float) M_PI) / s)));
	return -s * logf(((1.0f / ((u * ((1.0f / (1.0f + expf((-((float) M_PI) / s)))) - t_0)) + t_0)) - 1.0f));
}
function code(u, s)
	t_0 = Float32(Float32(1.0) / Float32(Float32(1.0) + exp(Float32(Float32(pi) / s))))
	return Float32(Float32(-s) * log(Float32(Float32(Float32(1.0) / Float32(Float32(u * Float32(Float32(Float32(1.0) / Float32(Float32(1.0) + exp(Float32(Float32(-Float32(pi)) / s)))) - t_0)) + t_0)) - Float32(1.0))))
end
function tmp = code(u, s)
	t_0 = single(1.0) / (single(1.0) + exp((single(pi) / s)));
	tmp = -s * log(((single(1.0) / ((u * ((single(1.0) / (single(1.0) + exp((-single(pi) / s)))) - t_0)) + t_0)) - single(1.0)));
end
\begin{array}{l}

\\
\begin{array}{l}
t_0 := \frac{1}{1 + e^{\frac{\pi}{s}}}\\
\left(-s\right) \cdot \log \left(\frac{1}{u \cdot \left(\frac{1}{1 + e^{\frac{-\pi}{s}}} - t\_0\right) + t\_0} - 1\right)
\end{array}
\end{array}

Alternative 1: 99.0% accurate, 0.3× speedup?

\[\begin{array}{l} \\ \begin{array}{l} t_0 := e^{\frac{\pi}{s}}\\ t_1 := \frac{1}{1 + t\_0} + \left(\frac{u}{1 + e^{\frac{\pi}{-s}}} + \frac{u}{-1 - t\_0}\right)\\ s \cdot \log \left(\frac{{t\_1}^{-2} + \left(1 + \frac{1}{t\_1}\right)}{{t\_1}^{-3} + -1}\right) \end{array} \end{array} \]
(FPCore (u s)
 :precision binary32
 (let* ((t_0 (exp (/ PI s)))
        (t_1
         (+
          (/ 1.0 (+ 1.0 t_0))
          (+ (/ u (+ 1.0 (exp (/ PI (- s))))) (/ u (- -1.0 t_0))))))
   (*
    s
    (log (/ (+ (pow t_1 -2.0) (+ 1.0 (/ 1.0 t_1))) (+ (pow t_1 -3.0) -1.0))))))
float code(float u, float s) {
	float t_0 = expf((((float) M_PI) / s));
	float t_1 = (1.0f / (1.0f + t_0)) + ((u / (1.0f + expf((((float) M_PI) / -s)))) + (u / (-1.0f - t_0)));
	return s * logf(((powf(t_1, -2.0f) + (1.0f + (1.0f / t_1))) / (powf(t_1, -3.0f) + -1.0f)));
}
function code(u, s)
	t_0 = exp(Float32(Float32(pi) / s))
	t_1 = Float32(Float32(Float32(1.0) / Float32(Float32(1.0) + t_0)) + Float32(Float32(u / Float32(Float32(1.0) + exp(Float32(Float32(pi) / Float32(-s))))) + Float32(u / Float32(Float32(-1.0) - t_0))))
	return Float32(s * log(Float32(Float32((t_1 ^ Float32(-2.0)) + Float32(Float32(1.0) + Float32(Float32(1.0) / t_1))) / Float32((t_1 ^ Float32(-3.0)) + Float32(-1.0)))))
end
function tmp = code(u, s)
	t_0 = exp((single(pi) / s));
	t_1 = (single(1.0) / (single(1.0) + t_0)) + ((u / (single(1.0) + exp((single(pi) / -s)))) + (u / (single(-1.0) - t_0)));
	tmp = s * log((((t_1 ^ single(-2.0)) + (single(1.0) + (single(1.0) / t_1))) / ((t_1 ^ single(-3.0)) + single(-1.0))));
end
\begin{array}{l}

\\
\begin{array}{l}
t_0 := e^{\frac{\pi}{s}}\\
t_1 := \frac{1}{1 + t\_0} + \left(\frac{u}{1 + e^{\frac{\pi}{-s}}} + \frac{u}{-1 - t\_0}\right)\\
s \cdot \log \left(\frac{{t\_1}^{-2} + \left(1 + \frac{1}{t\_1}\right)}{{t\_1}^{-3} + -1}\right)
\end{array}
\end{array}
Derivation
  1. Initial program 98.9%

    \[\left(-s\right) \cdot \log \left(\frac{1}{u \cdot \left(\frac{1}{1 + e^{\frac{-\pi}{s}}} - \frac{1}{1 + e^{\frac{\pi}{s}}}\right) + \frac{1}{1 + e^{\frac{\pi}{s}}}} - 1\right) \]
  2. Add Preprocessing
  3. Step-by-step derivation
    1. lift-+.f32N/A

      \[\leadsto \left(\mathsf{neg}\left(s\right)\right) \cdot \log \left(\frac{1}{\color{blue}{u \cdot \left(\frac{1}{1 + e^{\frac{\mathsf{neg}\left(\mathsf{PI}\left(\right)\right)}{s}}} - \frac{1}{1 + e^{\frac{\mathsf{PI}\left(\right)}{s}}}\right) + \frac{1}{1 + e^{\frac{\mathsf{PI}\left(\right)}{s}}}}} - 1\right) \]
    2. lift-*.f32N/A

      \[\leadsto \left(\mathsf{neg}\left(s\right)\right) \cdot \log \left(\frac{1}{\color{blue}{u \cdot \left(\frac{1}{1 + e^{\frac{\mathsf{neg}\left(\mathsf{PI}\left(\right)\right)}{s}}} - \frac{1}{1 + e^{\frac{\mathsf{PI}\left(\right)}{s}}}\right)} + \frac{1}{1 + e^{\frac{\mathsf{PI}\left(\right)}{s}}}} - 1\right) \]
    3. *-commutativeN/A

      \[\leadsto \left(\mathsf{neg}\left(s\right)\right) \cdot \log \left(\frac{1}{\color{blue}{\left(\frac{1}{1 + e^{\frac{\mathsf{neg}\left(\mathsf{PI}\left(\right)\right)}{s}}} - \frac{1}{1 + e^{\frac{\mathsf{PI}\left(\right)}{s}}}\right) \cdot u} + \frac{1}{1 + e^{\frac{\mathsf{PI}\left(\right)}{s}}}} - 1\right) \]
    4. lower-fma.f3298.9

      \[\leadsto \left(-s\right) \cdot \log \left(\frac{1}{\color{blue}{\mathsf{fma}\left(\frac{1}{1 + e^{\frac{-\pi}{s}}} - \frac{1}{1 + e^{\frac{\pi}{s}}}, u, \frac{1}{1 + e^{\frac{\pi}{s}}}\right)}} - 1\right) \]
  4. Applied rewrites98.9%

    \[\leadsto \left(-s\right) \cdot \log \left(\frac{1}{\color{blue}{\mathsf{fma}\left(\frac{1}{1 + e^{\frac{\pi}{-s}}} + \frac{-1}{1 + e^{\frac{\pi}{s}}}, u, \frac{1}{1 + e^{\frac{\pi}{s}}}\right)}} - 1\right) \]
  5. Applied rewrites99.0%

    \[\leadsto \left(-s\right) \cdot \color{blue}{\left(-\log \left(\frac{{\left(\frac{1}{1 + e^{\frac{\pi}{s}}} + \left(\frac{u}{1 + e^{-\frac{\pi}{s}}} + \frac{u}{-\left(1 + e^{\frac{\pi}{s}}\right)}\right)\right)}^{-2} + \left(1 + \frac{1}{\frac{1}{1 + e^{\frac{\pi}{s}}} + \left(\frac{u}{1 + e^{-\frac{\pi}{s}}} + \frac{u}{-\left(1 + e^{\frac{\pi}{s}}\right)}\right)}\right)}{{\left(\frac{1}{1 + e^{\frac{\pi}{s}}} + \left(\frac{u}{1 + e^{-\frac{\pi}{s}}} + \frac{u}{-\left(1 + e^{\frac{\pi}{s}}\right)}\right)\right)}^{-3} + -1}\right)\right)} \]
  6. Final simplification99.0%

    \[\leadsto s \cdot \log \left(\frac{{\left(\frac{1}{1 + e^{\frac{\pi}{s}}} + \left(\frac{u}{1 + e^{\frac{\pi}{-s}}} + \frac{u}{-1 - e^{\frac{\pi}{s}}}\right)\right)}^{-2} + \left(1 + \frac{1}{\frac{1}{1 + e^{\frac{\pi}{s}}} + \left(\frac{u}{1 + e^{\frac{\pi}{-s}}} + \frac{u}{-1 - e^{\frac{\pi}{s}}}\right)}\right)}{{\left(\frac{1}{1 + e^{\frac{\pi}{s}}} + \left(\frac{u}{1 + e^{\frac{\pi}{-s}}} + \frac{u}{-1 - e^{\frac{\pi}{s}}}\right)\right)}^{-3} + -1}\right) \]
  7. Add Preprocessing

Alternative 2: 98.9% accurate, 0.5× speedup?

\[\begin{array}{l} \\ \begin{array}{l} t_0 := e^{\frac{\pi}{s}}\\ t_1 := \frac{1}{1 + t\_0} + \left(\frac{u}{1 + e^{\frac{\pi}{-s}}} + \frac{u}{-1 - t\_0}\right)\\ s \cdot \log \left(\frac{1 + \frac{1}{t\_1}}{{t\_1}^{-2} + -1}\right) \end{array} \end{array} \]
(FPCore (u s)
 :precision binary32
 (let* ((t_0 (exp (/ PI s)))
        (t_1
         (+
          (/ 1.0 (+ 1.0 t_0))
          (+ (/ u (+ 1.0 (exp (/ PI (- s))))) (/ u (- -1.0 t_0))))))
   (* s (log (/ (+ 1.0 (/ 1.0 t_1)) (+ (pow t_1 -2.0) -1.0))))))
float code(float u, float s) {
	float t_0 = expf((((float) M_PI) / s));
	float t_1 = (1.0f / (1.0f + t_0)) + ((u / (1.0f + expf((((float) M_PI) / -s)))) + (u / (-1.0f - t_0)));
	return s * logf(((1.0f + (1.0f / t_1)) / (powf(t_1, -2.0f) + -1.0f)));
}
function code(u, s)
	t_0 = exp(Float32(Float32(pi) / s))
	t_1 = Float32(Float32(Float32(1.0) / Float32(Float32(1.0) + t_0)) + Float32(Float32(u / Float32(Float32(1.0) + exp(Float32(Float32(pi) / Float32(-s))))) + Float32(u / Float32(Float32(-1.0) - t_0))))
	return Float32(s * log(Float32(Float32(Float32(1.0) + Float32(Float32(1.0) / t_1)) / Float32((t_1 ^ Float32(-2.0)) + Float32(-1.0)))))
end
function tmp = code(u, s)
	t_0 = exp((single(pi) / s));
	t_1 = (single(1.0) / (single(1.0) + t_0)) + ((u / (single(1.0) + exp((single(pi) / -s)))) + (u / (single(-1.0) - t_0)));
	tmp = s * log(((single(1.0) + (single(1.0) / t_1)) / ((t_1 ^ single(-2.0)) + single(-1.0))));
end
\begin{array}{l}

\\
\begin{array}{l}
t_0 := e^{\frac{\pi}{s}}\\
t_1 := \frac{1}{1 + t\_0} + \left(\frac{u}{1 + e^{\frac{\pi}{-s}}} + \frac{u}{-1 - t\_0}\right)\\
s \cdot \log \left(\frac{1 + \frac{1}{t\_1}}{{t\_1}^{-2} + -1}\right)
\end{array}
\end{array}
Derivation
  1. Initial program 98.9%

    \[\left(-s\right) \cdot \log \left(\frac{1}{u \cdot \left(\frac{1}{1 + e^{\frac{-\pi}{s}}} - \frac{1}{1 + e^{\frac{\pi}{s}}}\right) + \frac{1}{1 + e^{\frac{\pi}{s}}}} - 1\right) \]
  2. Add Preprocessing
  3. Step-by-step derivation
    1. lift-+.f32N/A

      \[\leadsto \left(\mathsf{neg}\left(s\right)\right) \cdot \log \left(\frac{1}{\color{blue}{u \cdot \left(\frac{1}{1 + e^{\frac{\mathsf{neg}\left(\mathsf{PI}\left(\right)\right)}{s}}} - \frac{1}{1 + e^{\frac{\mathsf{PI}\left(\right)}{s}}}\right) + \frac{1}{1 + e^{\frac{\mathsf{PI}\left(\right)}{s}}}}} - 1\right) \]
    2. lift-*.f32N/A

      \[\leadsto \left(\mathsf{neg}\left(s\right)\right) \cdot \log \left(\frac{1}{\color{blue}{u \cdot \left(\frac{1}{1 + e^{\frac{\mathsf{neg}\left(\mathsf{PI}\left(\right)\right)}{s}}} - \frac{1}{1 + e^{\frac{\mathsf{PI}\left(\right)}{s}}}\right)} + \frac{1}{1 + e^{\frac{\mathsf{PI}\left(\right)}{s}}}} - 1\right) \]
    3. *-commutativeN/A

      \[\leadsto \left(\mathsf{neg}\left(s\right)\right) \cdot \log \left(\frac{1}{\color{blue}{\left(\frac{1}{1 + e^{\frac{\mathsf{neg}\left(\mathsf{PI}\left(\right)\right)}{s}}} - \frac{1}{1 + e^{\frac{\mathsf{PI}\left(\right)}{s}}}\right) \cdot u} + \frac{1}{1 + e^{\frac{\mathsf{PI}\left(\right)}{s}}}} - 1\right) \]
    4. lower-fma.f3298.9

      \[\leadsto \left(-s\right) \cdot \log \left(\frac{1}{\color{blue}{\mathsf{fma}\left(\frac{1}{1 + e^{\frac{-\pi}{s}}} - \frac{1}{1 + e^{\frac{\pi}{s}}}, u, \frac{1}{1 + e^{\frac{\pi}{s}}}\right)}} - 1\right) \]
  4. Applied rewrites98.9%

    \[\leadsto \left(-s\right) \cdot \log \left(\frac{1}{\color{blue}{\mathsf{fma}\left(\frac{1}{1 + e^{\frac{\pi}{-s}}} + \frac{-1}{1 + e^{\frac{\pi}{s}}}, u, \frac{1}{1 + e^{\frac{\pi}{s}}}\right)}} - 1\right) \]
  5. Applied rewrites98.9%

    \[\leadsto \left(-s\right) \cdot \color{blue}{\left(-\log \left(\frac{1 + \frac{1}{\frac{1}{1 + e^{\frac{\pi}{s}}} + \left(\frac{u}{1 + e^{-\frac{\pi}{s}}} + \frac{u}{-\left(1 + e^{\frac{\pi}{s}}\right)}\right)}}{{\left(\frac{1}{1 + e^{\frac{\pi}{s}}} + \left(\frac{u}{1 + e^{-\frac{\pi}{s}}} + \frac{u}{-\left(1 + e^{\frac{\pi}{s}}\right)}\right)\right)}^{-2} + -1}\right)\right)} \]
  6. Final simplification98.9%

    \[\leadsto s \cdot \log \left(\frac{1 + \frac{1}{\frac{1}{1 + e^{\frac{\pi}{s}}} + \left(\frac{u}{1 + e^{\frac{\pi}{-s}}} + \frac{u}{-1 - e^{\frac{\pi}{s}}}\right)}}{{\left(\frac{1}{1 + e^{\frac{\pi}{s}}} + \left(\frac{u}{1 + e^{\frac{\pi}{-s}}} + \frac{u}{-1 - e^{\frac{\pi}{s}}}\right)\right)}^{-2} + -1}\right) \]
  7. Add Preprocessing

Reproduce

?
herbie shell --seed 2024222 
(FPCore (u s)
  :name "Sample trimmed logistic on [-pi, pi]"
  :precision binary32
  :pre (and (and (<= 2.328306437e-10 u) (<= u 1.0)) (and (<= 0.0 s) (<= s 1.0651631)))
  (* (- s) (log (- (/ 1.0 (+ (* u (- (/ 1.0 (+ 1.0 (exp (/ (- PI) s)))) (/ 1.0 (+ 1.0 (exp (/ PI s)))))) (/ 1.0 (+ 1.0 (exp (/ PI s)))))) 1.0))))