Metrics for Herbie run

Date:	Monday, October 14th, 2024
Commit:	01116aa6 on bhargav-log-space
Hostname:	nightly with Racket 8.10
Seed:	2024288
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample3.5min (25.7%)

Memory

153.2MiB live, 99 653.3MiB allocated

Samples

1.8min	438 411×	0	valid
7.6s	22 590×	1	valid
3.8s	8 691×	2	valid
2.1s	4 457×	0	invalid
1.0s	8 672×	0	exit
263.0ms	932×	3	valid

Precisions

Click to see histograms. Total time spent on operations: 1.3min

ival-mult: 28.6s (37.1% of total)

ival-add: 21.0s (27.2% of total)

const: 4.2s (5.4% of total)

ival-div: 3.8s (4.9% of total)

ival-exp: 3.0s (3.9% of total)

ival-hypot: 2.2s (2.9% of total)

ival-sub: 2.1s (2.8% of total)

ival-log: 2.1s (2.7% of total)

adjust: 1.3s (1.7% of total)

ival-asin: 1.3s (1.6% of total)

ival-sqrt: 1.0s (1.3% of total)

ival-sin: 998.0ms (1.3% of total)

ival-cos: 938.0ms (1.2% of total)

ival-atan2: 838.0ms (1.1% of total)

exact: 374.0ms (0.5% of total)

ival-pow: 324.0ms (0.4% of total)

ival-acosh: 299.0ms (0.4% of total)

ival-sinu: 293.0ms (0.4% of total)

ival-true: 292.0ms (0.4% of total)

ival->: 288.0ms (0.4% of total)

ival-pi: 285.0ms (0.4% of total)

ival-asinh: 257.0ms (0.3% of total)

ival-<=: 222.0ms (0.3% of total)

ival-fabs: 221.0ms (0.3% of total)

ival-cosu: 212.0ms (0.3% of total)

ival-assert: 197.0ms (0.3% of total)

ival-neg: 186.0ms (0.2% of total)

ival-atanh: 151.0ms (0.2% of total)

ival->=: 86.0ms (0.1% of total)

ival-and: 82.0ms (0.1% of total)

Bogosity

soundness2.9min (21.3%)

Memory

97.7MiB live, 23 199.5MiB allocated

Stop Event

235×	iter limit
147×	node limit
23×	fuel
17×	done
3×	unsound
2×	saturated

Compiler

Compiled 23 366 to 10 942 computations (53.2% saved)

explain2.3min (16.5%)

Memory

-307.1MiB live, 13 232.2MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`+.f64`	`#f`	nan-rescue	1247	0
`sqrt.f64`	`#f`	oflow-rescue	693	0
`-.f64`	`#f`	cancellation	394	0
`/.f64`	`#f`	o/o	356	0
`/.f64`	`#f`	o/n	205	0
`+.f64`	`#f`	cancellation	182	1
`/.f64`	`#f`	n/o	107	0
`sqrt.f64`	`#f`	uflow-rescue	75	0
`*.f64`	(.f64 (/.f64 (+.f64 (+.f64 (+.f64 (+.f64 (+.f64 #s(literal 1 binary64) (.f64 #s(literal 1049934947/10000000000 binary64) (.f64 x x))) (.f64 #s(literal 106015151/2500000000 binary64) (.f64 (.f64 x x) (.f64 x x)))) (.f64 #s(literal 36322091/5000000000 binary64) (.f64 (.f64 (.f64 x x) (.f64 x x)) (.f64 x x)))) (.f64 #s(literal 2532017/5000000000 binary64) (.f64 (.f64 (.f64 (.f64 x x) (.f64 x x)) (.f64 x x)) (.f64 x x)))) (.f64 #s(literal 1789971/10000000000 binary64) (.f64 (.f64 (.f64 (.f64 (.f64 x x) (.f64 x x)) (.f64 x x)) (.f64 x x)) (.f64 x x)))) (+.f64 (+.f64 (+.f64 (+.f64 (+.f64 (+.f64 #s(literal 1 binary64) (.f64 #s(literal 7715471019/10000000000 binary64) (.f64 x x))) (.f64 #s(literal 2909738639/10000000000 binary64) (.f64 (.f64 x x) (.f64 x x)))) (.f64 #s(literal 694555761/10000000000 binary64) (.f64 (.f64 (.f64 x x) (.f64 x x)) (.f64 x x)))) (.f64 #s(literal 70002721/5000000000 binary64) (.f64 (.f64 (.f64 (.f64 x x) (.f64 x x)) (.f64 x x)) (.f64 x x)))) (.f64 #s(literal 1665589/2000000000 binary64) (.f64 (.f64 (.f64 (.f64 (.f64 x x) (.f64 x x)) (.f64 x x)) (.f64 x x)) (.f64 x x)))) (.f64 (.f64 #s(literal 2 binary64) #s(literal 1789971/10000000000 binary64)) (.f64 (.f64 (.f64 (.f64 (.f64 (.f64 x x) (.f64 x x)) (.f64 x x)) (.f64 x x)) (.f64 x x)) (.f64 x x))))) x)	*nu**	73	0
`*.f64`	`#f`	*no**	38	0
`/.f64`	`#f`	u/n	30	0
`/.f64`	`#f`	n/u	13	0
`/.f64`	`#f`	u/u	3	0
`exp.f64`	`#f`	sensitivity	2	0

Confusion

	Predicted +	Predicted -
+	2072	232
-	164	7772

Precision

0.9266547406082289

Recall

0.8993055555555556

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	2072	0	232
-	164	1	7771

Precision?

0.9262405006705409

Recall?

0.8993055555555556

Freqs

test

number	freq
0	8004
1	1871
2	231
3	19
4	6
6	9
8	25
10	75

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	25	0	3
-	4	0	8

Precision?

0.8620689655172413

Recall?

0.8928571428571429

Samples

34.1s	19 201×	0	valid
245.0ms	459×	2	valid
183.0ms	766×	1	valid
20.0ms	56×	3	valid

Compiler

Compiled 17 933 to 5 386 computations (70% saved)

Precisions

Click to see histograms. Total time spent on operations: 33.5s

ival-mult: 17.3s (51.8% of total)

ival-add: 15.4s (45.9% of total)

ival-exp: 184.0ms (0.5% of total)

ival-sub: 102.0ms (0.3% of total)

const: 90.0ms (0.3% of total)

ival-div: 72.0ms (0.2% of total)

ival-log: 70.0ms (0.2% of total)

ival-hypot: 58.0ms (0.2% of total)

adjust: 51.0ms (0.2% of total)

ival-cos: 47.0ms (0.1% of total)

ival-sin: 41.0ms (0.1% of total)

ival-sqrt: 22.0ms (0.1% of total)

ival-true: 20.0ms (0.1% of total)

exact: 11.0ms (0% of total)

ival-assert: 9.0ms (0% of total)

ival-neg: 8.0ms (0% of total)

ival-pow: 0.0ms (0% of total)

ival-pi: 0.0ms (0% of total)

ival-cosu: 0.0ms (0% of total)

ival-sinu: 0.0ms (0% of total)

rewrite2.2min (16.3%)

Memory

91.1MiB live, 28 386.4MiB allocated

Stop Event

284×	iter limit
127×	node limit
4×	unsound
3×	saturated

Counts

1 747 → 55 914

simplify1.2min (8.4%)

Memory

228.6MiB live, 41 583.9MiB allocated

Algorithm

308×	egg-herbie

Stop Event

402×	iter limit
177×	node limit
131×	saturated

Counts

37 584 → 37 025

eval40.7s (5%)

Memory: -391.4MiB live, 30 703.8MiB allocated
Compiler: Compiled 2 847 880 to 272 565 computations (90.4% saved)

localize15.9s (1.9%)

Memory

-250.7MiB live, 17 930.1MiB allocated

Samples

8.9s	30 621×	0	valid
1.4s	1 704×	1	valid
1.1s	957×	2	valid
238.0ms	544×	0	invalid
153.0ms	242×	0	exit
141.0ms	109×	3	valid
95.0ms	123×	5	exit
2.0ms	4×	4	valid

Compiler

Compiled 48 045 to 6 408 computations (86.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 8.8s

ival-mult: 2.9s (33.2% of total)

ival-add: 1.2s (13.9% of total)

ival-div: 1.2s (13.1% of total)

const: 570.0ms (6.5% of total)

ival-exp: 448.0ms (5.1% of total)

ival-sqrt: 372.0ms (4.2% of total)

ival-sub: 367.0ms (4.2% of total)

ival-pow: 361.0ms (4.1% of total)

adjust: 335.0ms (3.8% of total)

ival-log: 243.0ms (2.8% of total)

ival-cos: 158.0ms (1.8% of total)

ival-hypot: 156.0ms (1.8% of total)

ival-cosh: 136.0ms (1.5% of total)

ival-sin: 93.0ms (1.1% of total)

ival-neg: 91.0ms (1% of total)

ival-pow2: 72.0ms (0.8% of total)

exact: 46.0ms (0.5% of total)

ival-true: 30.0ms (0.3% of total)

ival-assert: 15.0ms (0.2% of total)

ival-sinh: 3.0ms (0% of total)

preprocess11.4s (1.4%)

Memory

367.5MiB live, 10 783.2MiB allocated

Algorithm

40×	egg-herbie

Stop Event

80×	iter limit
56×	saturated
24×	node limit

Compiler

Compiled 27 821 to 8 047 computations (71.1% saved)

regimes8.9s (1.1%)

Memory

76.1MiB live, 11 600.2MiB allocated

Counts

5 450 → 742

Calls

91 calls:

906.0ms	re
657.0ms	im
304.0ms	beta
280.0ms	(*.f64 (exp.f64 re) (sin.f64 im))
279.0ms	y.im

Compiler

Compiled 6 493 to 5 476 computations (15.7% saved)

prune7.6s (0.9%)

Memory: 292.2MiB live, 11 878.1MiB allocated
Counts: 104 252 → 1 838
Compiler: Compiled 59 874 to 36 228 computations (39.5% saved)

series7.0s (0.8%)

Memory

82.0MiB live, 8 062.3MiB allocated

Counts

1 747 → 37 584

Calls

867 calls:

Time	Variable		Point	Expression
224.0ms	im	@	inf	((* (sin re) (cosh im)) (sin re) (cosh im) (* (* 1/2 (sin re)) (+ (exp (- 0 im)) (exp im))) (* 1/2 (sin re)) (* re 1/2) (+ (exp (- 0 im)) (exp im)) (* (* 1/2 (sin re)) (+ (exp (- 0 im)) (exp im))) (* 1/2 (sin re)) (* (+ (* (+ (* 1/240 (* re re)) -1/12) (* re re)) 1/2) re) (+ (* (+ (* 1/240 (* re re)) -1/12) (* re re)) 1/2) (* (* 1 (cosh im)) (sin re)) (* 1 (cosh im)) (+ (* (* (+ (* 1/24 (* im im)) 1/2) im) im) 1) (* (+ (* 1/24 (* im im)) 1/2) im) (* 1/2 (+ (* (sin re) (exp im)) (* (exp (neg im)) (sin re)))) (+ (* (sin re) (exp im)) (* (exp (neg im)) (sin re))) (exp im) (+ (* 1/240 (* re re)) -1/12) (+ (* 1/24 (* im im)) 1/2) (* (exp (neg im)) (sin re)) (exp (neg im)))
110.0ms	x	@	0	((log (+ x (sqrt (- (* x x) 1)))) (+ x (sqrt (- (* x x) 1))) (sqrt (- (* x x) 1)) (- x (/ 1/2 x)) (log (+ x (sqrt (- (* x x) 1)))) (+ x (sqrt (- (* x x) 1))) (* 2 x) (log (+ (sqrt (+ (* x x) -1)) x)) (+ (sqrt (+ (* x x) -1)) x) (sqrt (+ (* x x) -1)) (+ (* x x) -1) (log (+ x (sqrt (- (* x x) 1)))) (+ (log x) (log 2)) (log x) (log 2) (- (+ (pow x 4) 1) (* -1 (* x x))) (* -1 (* x x)) (log (+ x (sqrt (/ (- (pow x 6) 1) (- (+ (pow x 4) 1) (* -1 (* x x))))))) (+ x (sqrt (/ (- (pow x 6) 1) (- (+ (pow x 4) 1) (* -1 (* x x)))))) (/ (- (pow x 6) 1) (- (+ (pow x 4) 1) (* -1 (* x x)))) (sqrt (/ (- (pow x 6) 1) (- (+ (pow x 4) 1) (* -1 (* x x))))))
93.0ms	re	@	-inf	((* 1 (cosh im)) (* (* 1 (cosh im)) (sin re)) (cosh im) (sin re) (* (* 1/2 (sin re)) (+ (exp (- 0 im)) (exp im))) (* (* 1/2 (sin re)) (+ (exp (- 0 im)) (exp im))) (* 1/2 (sin re)) (+ (exp (- 0 im)) (exp im)) (+ (* (* (sin re) 1/2) (exp im)) (* (/ 1/2 (exp im)) (sin re))) (* (sin re) 1/2) (exp im) (* (pow (- (exp (neg im)) (exp im)) -1) (* (sin re) 1/2)) (* (- (pow (exp im) -2) (pow (exp im) 2)) (* (pow (- (exp (neg im)) (exp im)) -1) (* (sin re) 1/2))) (- (pow (exp im) -2) (pow (exp im) 2)) (pow (exp im) -2) (* (/ 1/2 (exp im)) (sin re)) (/ 1/2 (exp im)) (- (exp (neg im)) (exp im)))
87.0ms	im	@	-inf	((/ (+ (* re re) -1) (- re 1)) (* (exp re) (sin im)) (exp re) (+ (* re re) -1) (* (exp re) (sin im)) (* (exp re) im) (+ (* re im) im) (* (exp re) (sin im)) (* (exp re) im) (+ (* (+ (* (* re im) 1/2) im) re) im) (* (* (+ (* 1/2 re) 1) re) im) (* (exp re) (sin im)) (* (exp re) im) (+ (* (* im (+ (* (+ (* 1/6 re) 1/2) re) 1)) re) im) (* (* (+ (* (+ (* 1/6 re) 1/2) re) 1) im) re) (/ (- (* (* 1/36 (* re re)) (+ (* 1/6 re) -1/2)) (* (+ (* 1/6 re) -1/2) 1/4)) (* (+ (* 1/6 re) -1/2) (+ (* 1/6 re) -1/2))) (- (* (* 1/36 (* re re)) (+ (* 1/6 re) -1/2)) (* (+ (* 1/6 re) -1/2) 1/4)) (* (* 1/36 (* re re)) (+ (* 1/6 re) -1/2)) (* (+ (* 1/6 re) -1/2) 1/4) (sin im) (* (+ (* (+ (* 1/6 re) 1/2) re) 1) im) (* (exp re) im) (* (exp re) (sin im)) (* im (+ (* (/ (- (* (* 1/36 (* re re)) (+ (* 1/6 re) -1/2)) (* (+ (* 1/6 re) -1/2) 1/4)) (* (+ (* 1/6 re) -1/2) (+ (* 1/6 re) -1/2))) re) 1)))
82.0ms	d3	@	-inf	((- (+ (- (* d1 d2) (* d1 d3)) (* d4 d1)) (* d1 d1)) (* (- (+ d4 d2) d3) d1) (- (+ d4 d2) d3) (+ d4 d2) (- (+ (- (* d1 d2) (* d1 d3)) (* d4 d1)) (* d1 d1)) (* (- (- d2 d3) d1) d1) (- (- d2 d3) d1) (- d2 d3) (+ (* (- d2 d3) d1) (* d1 (- d4 d1))) (* d1 (- d4 d1)) (- d4 d1) (neg d1))

bsearch2.7s (0.3%)

Memory

17.1MiB live, 3 007.8MiB allocated

Algorithm

232×	left-value
177×	binary-search

Stop Event

166×	narrow-enough
11×	predicate-same

Samples

1.3s	11 406×	0	valid
64.0ms	168×	2	valid
43.0ms	131×	1	valid
15.0ms	55×	3	valid

Compiler

Compiled 33 277 to 29 845 computations (10.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 956.0ms

ival-mult: 397.0ms (41.5% of total)

ival-add: 123.0ms (12.9% of total)

ival-sub: 98.0ms (10.3% of total)

ival-div: 96.0ms (10% of total)

const: 60.0ms (6.3% of total)

ival-sqrt: 47.0ms (4.9% of total)

ival-hypot: 39.0ms (4.1% of total)

ival-sin: 39.0ms (4.1% of total)

adjust: 34.0ms (3.6% of total)

ival-true: 9.0ms (0.9% of total)

ival-assert: 5.0ms (0.5% of total)

exact: 5.0ms (0.5% of total)

ival-exp: 4.0ms (0.4% of total)

analyze2.5s (0.3%)

Memory

241.8MiB live, 3 375.3MiB allocated

Algorithm

58×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	86.3%	13.7%	0%	0%	0%	0
55.4%	47.8%	38.5%	13.7%	0%	0%	0%	1
65.9%	55.7%	28.9%	13.7%	0%	1.7%	0%	2
71.2%	58.4%	23.6%	13.7%	0%	4.3%	0%	3
77.4%	62%	18.1%	13.7%	0%	6.2%	0%	4
83.5%	66.8%	13.2%	13.7%	0%	6.3%	0%	5
85.8%	68.3%	11.3%	13.7%	0%	6.6%	0%	6
88.3%	70.3%	9.4%	13.7%	0%	6.6%	0%	7
89.9%	71.5%	8%	13.7%	0%	6.8%	0%	8
91.1%	72.5%	7.1%	13.7%	0%	6.8%	0%	9
92.6%	73.6%	5.9%	13.7%	0%	6.8%	0%	10
94%	74.7%	4.8%	13.7%	0%	6.8%	0%	11
94.5%	75.1%	4.4%	13.7%	0%	6.9%	0%	12

Compiler

Compiled 1 498 to 816 computations (45.5% saved)

start2.0ms (0%)

Memory: 4.8MiB live, 4.7MiB allocated

end0.0ms (0%)

Memory: 0.8MiB live, 0.7MiB allocated

sample3.5min (25.7%)

soundness2.9min (21.3%)

explain2.3min (16.5%)

rewrite2.2min (16.3%)

simplify1.2min (8.4%)

eval40.7s (5%)

localize15.9s (1.9%)

preprocess11.4s (1.4%)

regimes8.9s (1.1%)

prune7.6s (0.9%)

series7.0s (0.8%)

bsearch2.7s (0.3%)

analyze2.5s (0.3%)

start2.0ms (0%)

end0.0ms (0%)

Profiling