Metrics for Herbie run

Date:	Tuesday, November 26th, 2024
Commit:	0bc53aaa on bhargav-bigfloat
Hostname:	nightly with Racket 8.10
Seed:	2024331
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.5min (36.1%)

Memory

265.7MiB live, 39 044.8MiB allocated

Samples

36.8s	43 355×	1	valid
25.4s	110 004×	0	valid
8.8s	6 281×	5	exit
5.1s	11 761×	2	valid
1.0s	10 151×	1	exit
585.0ms	3 873×	0	invalid
174.0ms	1 404×	0	exit

Precisions

Click to see histograms. Total time spent on operations: 54.5s

ival-tan: 23.5s (43.1% of total)

const: 4.8s (8.8% of total)

ival-exp: 3.5s (6.5% of total)

ival-pow: 3.5s (6.4% of total)

ival-cos: 3.1s (5.6% of total)

ival-mult: 2.4s (4.5% of total)

adjust: 2.1s (3.9% of total)

ival-sub: 1.3s (2.4% of total)

ival-log: 1.2s (2.2% of total)

ival-sqrt: 1.2s (2.1% of total)

ival-<=: 1.1s (2.1% of total)

ival-add: 848.0ms (1.6% of total)

ival-pow2: 817.0ms (1.5% of total)

ival-sin: 803.0ms (1.5% of total)

ival-fmod: 788.0ms (1.4% of total)

ival-sinh: 715.0ms (1.3% of total)

ival-atan: 675.0ms (1.2% of total)

ival-div: 652.0ms (1.2% of total)

ival-acos: 408.0ms (0.7% of total)

ival-neg: 233.0ms (0.4% of total)

ival-hypot: 147.0ms (0.3% of total)

ival-and: 122.0ms (0.2% of total)

ival-true: 105.0ms (0.2% of total)

ival-==: 94.0ms (0.2% of total)

exact: 83.0ms (0.2% of total)

ival-assert: 78.0ms (0.1% of total)

ival-<: 73.0ms (0.1% of total)

ival->=: 46.0ms (0.1% of total)

ival-or: 40.0ms (0.1% of total)

ival->: 21.0ms (0% of total)

Bogosity

simplify58.9s (24.2%)

Memory

133.2MiB live, 15 095.3MiB allocated

Algorithm

168×	egg-herbie

Stop Event

219×	iter limit
87×	node limit
84×	saturated

Counts

4 094 → 4 032

soundness27.5s (11.3%)

Memory

-1.4MiB live, 9 574.3MiB allocated

Stop Event

156×	iter limit
81×	node limit
15×	fuel
6×	saturated
5×	done
4×	unsound

Compiler

Compiled 11 585 to 5 587 computations (51.8% saved)

eval15.7s (6.5%)

Memory: 504.5MiB live, 9 446.0MiB allocated
Compiler: Compiled 1 406 778 to 161 033 computations (88.6% saved)

rewrite14.1s (5.8%)

Memory

-188.1MiB live, 12 133.2MiB allocated

Stop Event

164×	iter limit
66×	node limit
6×	unsound
4×	saturated

Counts

1 041 → 41 279

localize12.1s (5%)

Memory

-63.7MiB live, 11 351.9MiB allocated

Samples

4.9s	5 084×	1	valid
2.5s	11 544×	0	valid
1.8s	1 555×	2	valid
229.0ms	176×	1	invalid
86.0ms	160×	1	exit
73.0ms	356×	0	invalid
48.0ms	67×	0	exit
4.0ms	2×	5	exit

Compiler

Compiled 28 217 to 3 965 computations (85.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 7.3s

ival-mult: 1.6s (22.2% of total)

adjust: 794.0ms (10.9% of total)

ival-div: 636.0ms (8.7% of total)

ival-add: 611.0ms (8.4% of total)

const: 560.0ms (7.7% of total)

ival-pow: 508.0ms (6.9% of total)

ival-sin: 425.0ms (5.8% of total)

ival-tan: 356.0ms (4.9% of total)

ival-sqrt: 320.0ms (4.4% of total)

ival-cos: 305.0ms (4.2% of total)

ival-sub: 273.0ms (3.7% of total)

ival-log: 268.0ms (3.7% of total)

ival-pow2: 106.0ms (1.4% of total)

ival-exp: 103.0ms (1.4% of total)

ival-sinh: 101.0ms (1.4% of total)

ival-neg: 95.0ms (1.3% of total)

ival-fmod: 69.0ms (0.9% of total)

ival-acos: 51.0ms (0.7% of total)

ival-asin: 27.0ms (0.4% of total)

exact: 24.0ms (0.3% of total)

ival-hypot: 19.0ms (0.3% of total)

ival-true: 17.0ms (0.2% of total)

ival-assert: 9.0ms (0.1% of total)

ival-cbrt: 8.0ms (0.1% of total)

ival-pi: 7.0ms (0.1% of total)

ival-atan: 6.0ms (0.1% of total)

regimes8.8s (3.6%)

Memory

7.4MiB live, 8 308.5MiB allocated

Counts

3 747 → 221

Calls

55 calls:

1.5s	lo
903.0ms	x
740.0ms	a
547.0ms	r
519.0ms	b

Compiler

Compiled 2 121 to 2 340 computations (-10.3% saved)

series4.4s (1.8%)

Memory

43.5MiB live, 4 207.0MiB allocated

Counts

1 041 → 4 094

Calls

411 calls:

Time	Variable		Point	Expression
201.0ms	s	@	inf	((cos (* 2 x)) (* 2 x) (* (* x c) s) (* x c) (* (* x c) x) (* (* x x) (* (* s c) c)) (* x x) (* (* (* (* x c) s) c) (sqrt s)) (* (* (* x c) s) c) (* (* (pow (* x s) 2) c) c) (* (pow (* x s) 2) c) (/ (cos (* 2 x)) (* (* (* x c) s) (* (* x c) s))) (* (* (* x c) s) (* (* x c) s)) (* (* (* x c) x) (* (* s c) s)) (/ (cos (* 2 x)) (* (* (* x c) x) (* (* s c) s))) (* (* s c) s) (* (* (* x x) (* (* s c) c)) s) (/ (cos (* 2 x)) (* (* (* x x) (* (* s c) c)) s)) (* (* (* (* (* x c) s) c) (sqrt s)) (* (sqrt s) x)) (/ (cos (* 2 x)) (* (* (pow (* x s) 2) c) c)))
199.0ms	hi	@	0	((- 1 (/ (+ (* (/ (- x hi) lo) hi) (- x hi)) lo)) (+ (* (/ (- x hi) lo) hi) (- x hi)) (/ (- x lo) (- hi lo)) (/ (+ (* (/ (- x hi) lo) hi) (- x hi)) lo) (/ (- x lo) (- hi lo)) (/ (- x lo) (- hi lo)) (- (/ (- hi x) lo) -1) (/ (- hi x) lo) (- hi x) (/ (- x lo) (- hi lo)) (+ (* (- (/ hi lo) -1) (/ (- hi x) lo)) 1) (- (/ hi lo) -1) (/ hi lo) (+ (* (/ (- x lo) hi) (+ (* lo (/ lo hi)) lo)) (- x lo)) (/ (- x lo) (- hi lo)) (/ (+ (* (/ (- x lo) hi) (+ (* lo (/ lo hi)) lo)) (- x lo)) hi) (/ (- x lo) hi) (+ (* lo (/ lo hi)) lo))
120.0ms	x	@	0	((* (pow x 7/8) (sqrt (* (sqrt (sqrt x)) 2))) (pow x 7/8) (sqrt (* (sqrt (sqrt x)) 2)) (* (sqrt (sqrt x)) 2) (* (* (* 2 x) (sqrt x)) (sqrt x)) (sqrt (* (* (* 2 x) (sqrt x)) (sqrt x))) (* (* 2 x) (sqrt x)) (* 2 x) (pow (* 2 x) 1/2) (* (pow (* 2 x) 1/2) (sqrt x)) (sqrt x) (* (* (* (* x x) 2) (* 2 x)) x) (pow (* (* (* (* x x) 2) (* 2 x)) x) 1/4) (* (* x x) 2) (* x x) (pow (pow 16 1/16) 2) (* (pow (pow 16 1/16) 2) x) (pow 16 1/16) (sqrt (sqrt x)) (* (* (* x x) 2) (* 2 x)))
113.0ms	x	@	-inf	((log (/ (sinh x) x)) (* (* (+ (* (+ (* 1/2835 (* x x)) -1/180) (* x x)) 1/6) x) x) (* (+ (* (+ (* 1/2835 (* x x)) -1/180) (* x x)) 1/6) x) (+ (* (+ (* 1/2835 (* x x)) -1/180) (* x x)) 1/6) (log (/ (sinh x) x)) (* (* x x) 1/6) (* x x) (log (/ (sinh x) x)) (* (* (+ (* (+ (* (+ (* -1/37800 (* x x)) 1/2835) (* x x)) -1/180) (* x x)) 1/6) x) x) (* (+ (* (+ (* (+ (* -1/37800 (* x x)) 1/2835) (* x x)) -1/180) (* x x)) 1/6) x) (+ (* (+ (* (+ (* -1/37800 (* x x)) 1/2835) (* x x)) -1/180) (* x x)) 1/6) (log (/ (sinh x) x)) (/ (sinh x) x) (+ (* (+ (* 1/120 (* x x)) 1/6) (* x x)) 1) (+ (* 1/120 (* x x)) 1/6) (/ (* (log (* x (sinh x))) (log (/ x (sinh x)))) (neg (log (* x (sinh x))))) (* (log (* x (sinh x))) (log (/ x (sinh x)))) (log (* x (sinh x))) (* x (sinh x)) (+ (* 1/2835 (* x x)) -1/180) (log (/ x (sinh x))))
101.0ms	l	@	-inf	((exp (neg w)) (neg w) (pow l (exp w)) (exp w) (* (exp (neg w)) (pow l (exp w))))

prune3.8s (1.6%)

Memory: -307.1MiB live, 4 874.2MiB allocated
Counts: 44 541 → 1 763
Compiler: Compiled 92 359 to 48 194 computations (47.8% saved)

analyze3.5s (1.5%)

Memory

20.3MiB live, 4 167.2MiB allocated

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
28.8%	21.3%	52.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.2%	0%	6
71.1%	51.1%	20.8%	26.3%	0%	1.9%	0%	7
72.1%	51.6%	20%	26.3%	0%	2.1%	0%	8
74.4%	53%	18.2%	26.3%	0%	2.5%	0%	9
75.8%	53.9%	17.2%	26.3%	0%	2.6%	0%	10
76.6%	54.3%	16.6%	26.3%	0%	2.8%	0%	11
77.3%	54.8%	16.1%	26.3%	0%	2.9%	0%	12

Compiler

Compiled 279 to 216 computations (22.6% saved)

preprocess3.1s (1.3%)

Memory

105.9MiB live, 2 737.6MiB allocated

Algorithm

20×	egg-herbie

Stop Event

39×	saturated
38×	iter limit
3×	node limit

Compiler

Compiled 13 999 to 4 880 computations (65.1% saved)

explain2.6s (1.1%)

Memory

-73.5MiB live, 2 710.3MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`sqrt.f64`	`#f`	oflow-rescue	548	0
`cos.f64`	`#f`	sensitivity	470	2
`-.f64`	`#f`	cancellation	335	0
`sqrt.f64`	`#f`	uflow-rescue	333	0
`/.f64`	`#f`	n/o	257	0
`acos.f64`	`(acos.f64 (-.f64 #s(literal 1 binary64) x))`	sensitivity	254	0
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	sensitivity	250	0
`tan.f64`	`(tan.f64 (+.f64 y z))`	sensitivity	200	0
`pow.f64`	`(pow.f64 l (exp.f64 w))`	sensitivity	129	17
`*.f64`	`#f`	*nu**	33	0
`*.f64`	`#f`	*no**	29	0
`-.f64`	`(-.f64 (.f64 a a) (.f64 b b))`	nan-rescue	21	0
↳	`(*.f64 a a)`	overflow	121
↳	`(*.f64 b b)`	overflow	21
`*.f64`	`(.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (*.f64 x (pow.f64 s #s(literal 2 binary64))) x))`	*ou**	19	0
↳	`(pow.f64 c #s(literal 2 binary64))`	overflow	62
↳	`(.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)`	underflow	73
↳	`(*.f64 x (pow.f64 s #s(literal 2 binary64)))`	underflow	61
↳	`(pow.f64 s #s(literal 2 binary64))`	underflow	67
`*.f64`	`#f`	*uo**	14	0
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	oflow-rescue	4	0
↳	`(sinh.f64 x)`	overflow	4
↳	`(/.f64 (sinh.f64 x) x)`	overflow	4
`/.f64`	`(/.f64 (-.f64 x lo) (-.f64 hi lo))`	o/o	1	0
↳	`(-.f64 x lo)`	overflow	1
↳	`(-.f64 hi lo)`	overflow	256
`cos.f64`	`(cos.f64 (*.f64 #s(literal 2 binary64) x))`	oflow-rescue	1	0
↳	`(*.f64 #s(literal 2 binary64) x)`	overflow	1

Confusion

	Predicted +	Predicted -
+	2144	256
-	684	2036

Precision

0.7581329561527581

Recall

0.8933333333333333

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	2144	0	256
-	684	19	2017

Precision?

0.7530734106076572

Recall?

0.8933333333333333

Freqs

test

number	freq
0	2292
1	2759
2	68
3	1

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	18	0	0
-	0	0	2

Precision?

1.0

Recall?

1.0

Samples

461.0ms	2 642×	1	valid
373.0ms	6 740×	0	valid
343.0ms	778×	2	valid
11.0ms	80×	1	exit

Compiler

Compiled 1 486 to 560 computations (62.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 863.0ms

ival-cos: 120.0ms (13.9% of total)

adjust: 83.0ms (9.6% of total)

ival-tan: 80.0ms (9.3% of total)

ival-sqrt: 78.0ms (9% of total)

ival-add: 73.0ms (8.5% of total)

ival-log: 72.0ms (8.3% of total)

ival-mult: 68.0ms (7.9% of total)

ival-exp: 41.0ms (4.7% of total)

ival-sinh: 38.0ms (4.4% of total)

ival-sub: 37.0ms (4.3% of total)

ival-div: 33.0ms (3.8% of total)

ival-sin: 32.0ms (3.7% of total)

ival-fmod: 27.0ms (3.1% of total)

ival-pow2: 22.0ms (2.5% of total)

ival-acos: 20.0ms (2.3% of total)

ival-pow: 9.0ms (1% of total)

ival-true: 9.0ms (1% of total)

ival-hypot: 8.0ms (0.9% of total)

ival-neg: 5.0ms (0.6% of total)

ival-assert: 4.0ms (0.5% of total)

ival-atan: 3.0ms (0.3% of total)

exact: 2.0ms (0.2% of total)

bsearch933.0ms (0.4%)

Memory

76.8MiB live, 906.9MiB allocated

Algorithm

43×	binary-search
29×	left-value

Stop Event

41×	narrow-enough
1×	predicate-same
1×	predicate-failed

Samples

247.0ms	916×	1	valid
129.0ms	1 724×	0	valid
70.0ms	112×	2	valid
14.0ms	101×	0	invalid

Compiler

Compiled 17 225 to 13 152 computations (23.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 378.0ms

ival-cos: 92.0ms (24.3% of total)

ival-tan: 69.0ms (18.2% of total)

ival-exp: 50.0ms (13.2% of total)

ival-fmod: 50.0ms (13.2% of total)

adjust: 26.0ms (6.9% of total)

ival-mult: 21.0ms (5.5% of total)

ival-add: 18.0ms (4.8% of total)

ival-pow2: 15.0ms (4% of total)

ival-sqrt: 11.0ms (2.9% of total)

ival-div: 6.0ms (1.6% of total)

ival-sub: 5.0ms (1.3% of total)

ival-sin: 5.0ms (1.3% of total)

ival-neg: 4.0ms (1.1% of total)

ival-pow: 2.0ms (0.5% of total)

ival-true: 2.0ms (0.5% of total)

ival-assert: 1.0ms (0.3% of total)

exact: 0.0ms (0% of total)

start1.0ms (0%)

Memory: 1.1MiB live, 1.1MiB allocated

end0.0ms (0%)

Memory: 0.2MiB live, 0.2MiB allocated

sample1.5min (36.1%)

simplify58.9s (24.2%)

soundness27.5s (11.3%)

eval15.7s (6.5%)

rewrite14.1s (5.8%)

localize12.1s (5%)

regimes8.8s (3.6%)

series4.4s (1.8%)

prune3.8s (1.6%)

analyze3.5s (1.5%)

preprocess3.1s (1.3%)

explain2.6s (1.1%)

bsearch933.0ms (0.4%)

start1.0ms (0%)

end0.0ms (0%)

Profiling