Average Error: 0.5 → 0.5
Time: 15.9s
Precision: 64
Internal Precision: 128
\[\log \left(1 + e^{x}\right) - x \cdot y\]
\[\left(\log \left({\left(e^{x}\right)}^{3} + 1\right) - \log \left(1 + \left(e^{x} \cdot e^{x} - e^{x}\right)\right)\right) - x \cdot y\]

Error

Bits error versus x

Bits error versus y

Try it out

Your Program's Arguments

Results

Enter valid numbers for all inputs

Target

Original0.5
Target0.1
Herbie0.5
\[\begin{array}{l} \mathbf{if}\;x \le 0:\\ \;\;\;\;\log \left(1 + e^{x}\right) - x \cdot y\\ \mathbf{else}:\\ \;\;\;\;\log \left(1 + e^{-x}\right) - \left(-x\right) \cdot \left(1 - y\right)\\ \end{array}\]

Derivation

  1. Initial program 0.5

    \[\log \left(1 + e^{x}\right) - x \cdot y\]
  2. Initial simplification0.5

    \[\leadsto \log \left(1 + e^{x}\right) - y \cdot x\]
  3. Using strategy rm
  4. Applied flip3-+0.5

    \[\leadsto \log \color{blue}{\left(\frac{{1}^{3} + {\left(e^{x}\right)}^{3}}{1 \cdot 1 + \left(e^{x} \cdot e^{x} - 1 \cdot e^{x}\right)}\right)} - y \cdot x\]
  5. Applied log-div0.5

    \[\leadsto \color{blue}{\left(\log \left({1}^{3} + {\left(e^{x}\right)}^{3}\right) - \log \left(1 \cdot 1 + \left(e^{x} \cdot e^{x} - 1 \cdot e^{x}\right)\right)\right)} - y \cdot x\]
  6. Simplified0.5

    \[\leadsto \left(\color{blue}{\log \left({\left(e^{x}\right)}^{3} + 1\right)} - \log \left(1 \cdot 1 + \left(e^{x} \cdot e^{x} - 1 \cdot e^{x}\right)\right)\right) - y \cdot x\]
  7. Final simplification0.5

    \[\leadsto \left(\log \left({\left(e^{x}\right)}^{3} + 1\right) - \log \left(1 + \left(e^{x} \cdot e^{x} - e^{x}\right)\right)\right) - x \cdot y\]

Reproduce

herbie shell --seed 2018360 
(FPCore (x y)
  :name "Logistic regression 2"

  :herbie-target
  (if (<= x 0) (- (log (+ 1 (exp x))) (* x y)) (- (log (+ 1 (exp (- x)))) (* (- x) (- 1 y))))

  (- (log (+ 1 (exp x))) (* x y)))

Details

Time bar (total: 10.4s)Debug log

start126.0ms

Algorithm
intervals

setup29.0ms

Pruning

1 alts after pruning (1 fresh and 0 done)

Merged error: 0.5b

localize25.0ms

Local error

Found 3 expressions with local error:

0.5b
(log (+ 1 (exp x)))
0.0b
(- (log (+ 1 (exp x))) (* y x))
0.0b
(+ 1 (exp x))

rewrite7.0ms

Algorithm
rewrite-expression-head
Counts
3 → 41
Calls

3 calls. Slowest were:

5.0ms
(- (log (+ 1 (exp x))) (* y x))
1.0ms
(log (+ 1 (exp x)))
1.0ms
(+ 1 (exp x))

series105.0ms

Counts
3 → 9
Calls

3 calls. Slowest were:

63.0ms
(log (+ 1 (exp x)))
35.0ms
(- (log (+ 1 (exp x))) (* y x))
7.0ms
(+ 1 (exp x))

simplify159.0ms

Counts
21 → 50
Calls

21 calls. Slowest were:

35.0ms
(+ x (+ (* 1/2 (pow x 2)) 2))
30.0ms
(+ (log 2) (+ (* 1/2 x) (* 1/8 (pow x 2))))
18.0ms
(+ (log 2) (+ (* 1/2 x) (* 1/8 (pow x 2))))

prune525.0ms

Pruning

5 alts after pruning (5 fresh and 0 done)

Merged error: 0.2b

localize45.0ms

Local error

Found 4 expressions with local error:

5.9b
(log (+ (* 1 1) (- (* (exp x) (exp x)) (* 1 (exp x)))))
5.8b
(- (* (exp x) (exp x)) (* 1 (exp x)))
0.5b
(log (+ (pow (exp x) 3) 1))
0.0b
(pow (exp x) 3)

rewrite17.0ms

Algorithm
rewrite-expression-head
Counts
4 → 61
Calls

4 calls. Slowest were:

6.0ms
(log (+ (* 1 1) (- (* (exp x) (exp x)) (* 1 (exp x)))))
5.0ms
(- (* (exp x) (exp x)) (* 1 (exp x)))
3.0ms
(log (+ (pow (exp x) 3) 1))

series228.0ms

Counts
4 → 12
Calls

4 calls. Slowest were:

129.0ms
(log (+ (* 1 1) (- (* (exp x) (exp x)) (* 1 (exp x)))))
62.0ms
(log (+ (pow (exp x) 3) 1))
21.0ms
(- (* (exp x) (exp x)) (* 1 (exp x)))
16.0ms
(pow (exp x) 3)

simplify1.3s

Counts
37 → 73
Calls

37 calls. Slowest were:

307.0ms
(log (- (* (* 1 1) (* 1 1)) (* (- (* (exp x) (exp x)) (* 1 (exp x))) (- (* (exp x) (exp x)) (* 1 (exp x))))))
185.0ms
(log (+ (pow (* 1 1) 3) (pow (- (* (exp x) (exp x)) (* 1 (exp x))) 3)))
92.0ms
(log (+ (pow (pow (exp x) 3) 3) (pow 1 3)))

prune1.2s

Pruning

5 alts after pruning (4 fresh and 1 done)

Merged error: 0.2b

localize15.0ms

Local error

Found 4 expressions with local error:

5.9b
(log (+ (* 1 1) (- (* (exp x) (exp x)) (* 1 (exp x)))))
5.8b
(- (* (exp x) (exp x)) (* 1 (exp x)))
0.8b
(* (log (+ (pow (exp x) 3) 1)) (log (+ (pow (exp x) 3) 1)))
0.7b
(cbrt (* (* (log (+ (pow (exp x) 3) 1)) (log (+ (pow (exp x) 3) 1))) (log (+ (pow (exp x) 3) 1))))

rewrite36.0ms

Algorithm
rewrite-expression-head
Counts
4 → 66
Calls

4 calls. Slowest were:

12.0ms
(* (log (+ (pow (exp x) 3) 1)) (log (+ (pow (exp x) 3) 1)))
11.0ms
(cbrt (* (* (log (+ (pow (exp x) 3) 1)) (log (+ (pow (exp x) 3) 1))) (log (+ (pow (exp x) 3) 1))))
6.0ms
(log (+ (* 1 1) (- (* (exp x) (exp x)) (* 1 (exp x)))))

series316.0ms

Counts
4 → 12
Calls

4 calls. Slowest were:

103.0ms
(log (+ (* 1 1) (- (* (exp x) (exp x)) (* 1 (exp x)))))
95.0ms
(cbrt (* (* (log (+ (pow (exp x) 3) 1)) (log (+ (pow (exp x) 3) 1))) (log (+ (pow (exp x) 3) 1))))
83.0ms
(* (log (+ (pow (exp x) 3) 1)) (log (+ (pow (exp x) 3) 1)))
35.0ms
(- (* (exp x) (exp x)) (* 1 (exp x)))

simplify1.4s

Counts
42 → 78
Calls

42 calls. Slowest were:

276.0ms
(log (- (* (* 1 1) (* 1 1)) (* (- (* (exp x) (exp x)) (* 1 (exp x))) (- (* (exp x) (exp x)) (* 1 (exp x))))))
220.0ms
(+ (* 9/4 (* (log 2) (pow x 2))) (+ (* 3 (* (log 2) x)) (+ (* 9/4 (pow x 2)) (pow (log 2) 2))))
143.0ms
(log (+ (pow (* 1 1) 3) (pow (- (* (exp x) (exp x)) (* 1 (exp x))) 3)))

prune1.5s

Pruning

5 alts after pruning (3 fresh and 2 done)

Merged error: 0.2b

localize24.0ms

Local error

Found 4 expressions with local error:

1.2b
(log (sqrt (+ 1 (exp x))))
1.2b
(log (sqrt (+ 1 (exp x))))
0.0b
(+ (log (sqrt (+ 1 (exp x)))) (- (log (sqrt (+ 1 (exp x)))) (* y x)))
0.0b
(- (log (sqrt (+ 1 (exp x)))) (* y x))

rewrite27.0ms

Algorithm
rewrite-expression-head
Counts
4 → 87
Calls

4 calls. Slowest were:

13.0ms
(+ (log (sqrt (+ 1 (exp x)))) (- (log (sqrt (+ 1 (exp x)))) (* y x)))
5.0ms
(- (log (sqrt (+ 1 (exp x)))) (* y x))
3.0ms
(log (sqrt (+ 1 (exp x))))

series326.0ms

Counts
4 → 12
Calls

4 calls. Slowest were:

94.0ms
(+ (log (sqrt (+ 1 (exp x)))) (- (log (sqrt (+ 1 (exp x)))) (* y x)))
92.0ms
(- (log (sqrt (+ 1 (exp x)))) (* y x))
74.0ms
(log (sqrt (+ 1 (exp x))))
67.0ms
(log (sqrt (+ 1 (exp x))))

simplify1.4s

Counts
60 → 99
Calls

60 calls. Slowest were:

330.0ms
(- (+ (* 1/4 (/ (pow x 2) (pow (sqrt 2) 2))) (+ (log (sqrt 2)) (* 1/2 (/ x (pow (sqrt 2) 2))))) (* 1/4 (/ (pow x 2) (pow (sqrt 2) 4))))
284.0ms
(- (+ (* 1/4 (/ (pow x 2) (pow (sqrt 2) 2))) (+ (log (sqrt 2)) (* 1/2 (/ x (pow (sqrt 2) 2))))) (* 1/4 (/ (pow x 2) (pow (sqrt 2) 4))))
243.0ms
(- (+ (* 1/4 (/ (pow x 2) (pow (sqrt 2) 2))) (+ (log (sqrt 2)) (* 1/2 (/ x (pow (sqrt 2) 2))))) (* 1/4 (/ (pow x 2) (pow (sqrt 2) 4))))

prune1.5s

Pruning

5 alts after pruning (2 fresh and 3 done)

Merged error: 0.2b

regimes121.0ms

Accuracy

0% (0.3b remaining)

Error of 0.5b against oracle of 0.3b and baseline of 0.5b

bsearch4.0ms