Metrics for Herbie run

Date:	Sunday, August 25th, 2024
Commit:	a6ae8219 on bhargav-log-space
Hostname:	nightly with Racket 8.11.1
Seed:	2024238
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample21.1min (29.2%)

Memory

4 830.3MiB live, 1 152 446.0MiB allocated

Samples

7.0min	3 900 748×	0	valid
3.5min	428 941×	1	valid
3.0min	29 384×	5	exit
1.4min	127 655×	2	valid
48.5s	317 043×	0	invalid
12.1s	14 329×	3	valid
7.3s	50 068×	0	exit
6.6s	25 747×	1	invalid
6.4s	25 250×	1	exit
668.0ms	538×	4	exit
491.0ms	1 270×	2	invalid
273.0ms	127×	3	exit
218.0ms	45×	4	valid
25.0ms	15×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 13.0min

ival-sin: 2.3min (17.5% of total)

ival-mult: 2.3min (17.4% of total)

ival-div: 1.1min (8.7% of total)

ival-sub: 54.9s (7.1% of total)

const: 48.9s (6.3% of total)

ival-pow: 43.7s (5.6% of total)

ival-add: 43.5s (5.6% of total)

ival-asin: 33.4s (4.3% of total)

ival-cos: 32.1s (4.1% of total)

adjust: 30.1s (3.9% of total)

ival-tan: 26.5s (3.4% of total)

ival-log: 22.2s (2.9% of total)

ival-exp: 20.1s (2.6% of total)

ival-sqrt: 16.9s (2.2% of total)

ival-pow2: 11.3s (1.5% of total)

ival-<=: 10.1s (1.3% of total)

ival-neg: 4.7s (0.6% of total)

ival-fabs: 4.6s (0.6% of total)

ival-hypot: 3.9s (0.5% of total)

exact: 3.4s (0.4% of total)

ival-pi: 2.9s (0.4% of total)

ival-true: 2.9s (0.4% of total)

ival-<: 2.7s (0.3% of total)

ival-and: 2.6s (0.3% of total)

ival-acos: 2.0s (0.3% of total)

ival-assert: 1.9s (0.2% of total)

ival-expm1: 1.8s (0.2% of total)

ival-atan2: 1.6s (0.2% of total)

ival-log1p: 1.3s (0.2% of total)

ival-atan: 1.3s (0.2% of total)

ival-sinh: 1.0s (0.1% of total)

ival->: 818.0ms (0.1% of total)

ival-fmod: 764.0ms (0.1% of total)

ival-cbrt: 761.0ms (0.1% of total)

ival-fmin: 679.0ms (0.1% of total)

ival-floor: 612.0ms (0.1% of total)

ival-acosh: 582.0ms (0.1% of total)

ival-log2: 442.0ms (0.1% of total)

ival-cosh: 413.0ms (0.1% of total)

ival-if: 391.0ms (0.1% of total)

ival-==: 372.0ms (0% of total)

ival-asinh: 340.0ms (0% of total)

ival->=: 274.0ms (0% of total)

ival-fmax: 264.0ms (0% of total)

ival-atanh: 139.0ms (0% of total)

ival-tanh: 128.0ms (0% of total)

ival-or: 35.0ms (0% of total)

Bogosity

simplify14.2min (19.6%)

Memory

247.6MiB live, 918 054.1MiB allocated

Algorithm

2 888×

egg-herbie

Rules

20 174 094×	`lower-fma.f32`
20 169 400×	`lower-fma.f64`
7 086 088×	`lower-*.f32`
7 075 278×	`lower-*.f64`
4 218 016×	`lower-+.f32`

Stop Event

3 749×	iter limit
1 666×	node limit
1 253×	saturated

Counts

412 908 → 403 722

soundness9.0min (12.4%)

Memory

-1 245.0MiB live, 219 610.0MiB allocated

Rules

10 919 122×	`lower-fma.f32`
10 916 952×	`lower-fma.f64`
5 643 084×	`lower-*.f32`
5 637 922×	`lower-*.f64`
3 120 292×	`lower-/.f32`

Stop Event

1 944×	iter limit
1 279×	node limit
199×	fuel
169×	done
30×	saturated
9×	unsound

Compiler

Compiled 204 455 to 90 152 computations (55.9% saved)

rewrite8.9min (12.3%)

Memory

2 332.5MiB live, 652 719.4MiB allocated

Rules

6 723 276×	`lower-fma.f32`
6 718 598×	`lower-fma.f64`
5 262 010×	`lower-*.f32`
5 251 456×	`lower-*.f64`
4 436 646×	`lower-/.f32`

Stop Event

2 592×	iter limit
1 219×	node limit
33×	saturated
25×	unsound

Counts

15 629 → 677 761

eval3.8min (5.3%)

Memory: 3 323.2MiB live, 310 996.4MiB allocated
Compiler: Compiled 34 256 683 to 2 268 223 computations (93.4% saved)

prune3.5min (4.9%)

Memory: -5 468.5MiB live, 299 573.3MiB allocated
Counts: 1 214 651 → 19 631
Compiler: Compiled 754 663 to 372 664 computations (50.6% saved)

preprocess3.3min (4.5%)

Memory

2 070.7MiB live, 121 562.5MiB allocated

Algorithm

368×	egg-herbie

Rules

1 411 016×	`lower-fma.f64`
1 411 016×	`lower-fma.f32`
286 072×	`lower-*.f32`
284 630×	`lower-*.f64`
254 970×	`unsub-neg`

Stop Event

733×	iter limit
546×	saturated
193×	node limit

Compiler

Compiled 234 488 to 66 451 computations (71.7% saved)

localize3.0min (4.1%)

Memory

522.0MiB live, 186 847.1MiB allocated

Samples

1.3min	279 181×	0	valid
20.3s	28 328×	1	valid
11.2s	10 189×	2	valid
1.2s	3 285×	0	invalid
1.1s	621×	3	valid
265.0ms	81×	5	exit
238.0ms	633×	0	exit
147.0ms	120×	1	exit
104.0ms	96×	1	invalid
60.0ms	26×	4	valid

Compiler

Compiled 210 090 to 31 090 computations (85.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.4min

ival-mult: 21.8s (25.8% of total)

ival-add: 19.0s (22.4% of total)

ival-div: 11.0s (13% of total)

ival-sqrt: 7.9s (9.3% of total)

const: 4.1s (4.9% of total)

adjust: 4.0s (4.8% of total)

ival-sub: 3.9s (4.7% of total)

ival-cos: 3.0s (3.5% of total)

ival-tan: 2.3s (2.7% of total)

ival-sin: 2.0s (2.3% of total)

ival-log: 1.2s (1.4% of total)

ival-neg: 982.0ms (1.2% of total)

ival-pow: 965.0ms (1.1% of total)

ival-exp: 669.0ms (0.8% of total)

exact: 346.0ms (0.4% of total)

ival-true: 266.0ms (0.3% of total)

ival-pow2: 252.0ms (0.3% of total)

ival-hypot: 222.0ms (0.3% of total)

ival-cbrt: 194.0ms (0.2% of total)

ival-log1p: 189.0ms (0.2% of total)

ival-assert: 133.0ms (0.2% of total)

ival-expm1: 103.0ms (0.1% of total)

ival-copysign: 24.0ms (0% of total)

ival-cosh: 8.0ms (0% of total)

ival-fabs: 8.0ms (0% of total)

regimes2.1min (2.9%)

Memory

101.4MiB live, 143 771.7MiB allocated

Counts

57 307 → 6 090

Calls

706 calls:

14.0s	x
12.2s	y
9.4s	(*.f64 y y)
9.2s	(.f64 x (exp.f64 (.f64 y y)))
8.7s	z

Compiler

Compiled 94 564 to 66 305 computations (29.9% saved)

analyze1.3min (1.9%)

Memory

283.1MiB live, 96 247.7MiB allocated

Algorithm

545×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	84.4%	15.6%	0%	0%	0%	0
39.8%	33.6%	50.8%	15.6%	0%	0%	0%	1
45.9%	38.4%	45.3%	15.6%	0%	0.8%	0%	2
54.5%	44.5%	37.2%	15.6%	0%	2.8%	0%	3
61.4%	49.5%	31.1%	15.6%	0%	3.8%	0%	4
67.7%	54.3%	25.9%	15.6%	0%	4.3%	0%	5
71.6%	57.1%	22.7%	15.6%	0%	4.7%	0%	6
75.5%	59.8%	19.4%	15.6%	0%	5.2%	0%	7
77.5%	61.1%	17.7%	15.6%	0%	5.6%	0%	8
80.1%	62.9%	15.6%	15.6%	0%	5.9%	0%	9
81.7%	63.9%	14.3%	15.6%	0%	6.2%	0%	10
83.9%	65.5%	12.6%	15.6%	0%	6.4%	0%	11
85%	66.2%	11.6%	15.6%	0%	6.6%	0%	12

Compiler

Compiled 12 518 to 7 841 computations (37.4% saved)

explain57.6s (1.3%)

Memory

-2 189.0MiB live, 74 864.2MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	7621	51
`+.f64`	`#f`	oflow-right	2287	0
`*.f64`	`#f`	*no**	2136	0
`sqrt.f64`	`#f`	oflow-rescue	1870	0
`+.f64`	`#f`	nan-rescue	1687	0
`/.f64`	`#f`	o/n	1312	0
`/.f64`	`#f`	o/o	1071	0
`cos.f64`	`#f`	sensitivity	1034	0
`-.f64`	`#f`	oflow-right	826	0
`/.f64`	`#f`	n/o	780	0
`+.f64`	`#f`	cancellation	722	90
`-.f64`	`#f`	oflow-left	513	0
`sqrt.f64`	`#f`	uflow-rescue	497	0
`*.f64`	`#f`	*nu**	470	0
`+.f64`	`#f`	oflow-left	411	0
`log.f64`	`#f`	oflow-rescue	394	0
`/.f64`	`#f`	u/n	368	0
`log.f64`	`#f`	sensitivity	311	4
`tan.f64`	`#f`	sensitivity	293	0
`sin.f64`	`#f`	sensitivity	236	0
`/.f64`	`#f`	n/u	232	0
`/.f64`	`#f`	u/u	163	0
`cos.f64`	`#f`	oflow-rescue	149	0
`*.f64`	`#f`	*ou**	51	0
`log.f64`	`#f`	uflow-rescue	44	0
`cbrt.f64`	`(cbrt.f64 (/.f64 g (*.f64 #s(literal 2 binary64) a)))`	uflow-rescue	32	0
↳	`(/.f64 g (*.f64 #s(literal 2 binary64) a))`	underflow	31
`cbrt.f64`	`(cbrt.f64 (/.f64 g (*.f64 #s(literal 2 binary64) a)))`	oflow-rescue	31	0
↳	`(/.f64 g (*.f64 #s(literal 2 binary64) a))`	overflow	32
`sin.f64`	`(sin.f64 (/.f64 x (*.f64 y #s(literal 2 binary64))))`	oflow-rescue	31	0
↳	`(/.f64 x (*.f64 y #s(literal 2 binary64)))`	overflow	26
↳	`(*.f64 y #s(literal 2 binary64))`	overflow	1
`tan.f64`	`(tan.f64 (/.f64 x (*.f64 y #s(literal 2 binary64))))`	oflow-rescue	31	0
↳	`(/.f64 x (*.f64 y #s(literal 2 binary64)))`	overflow	26
↳	`(*.f64 y #s(literal 2 binary64))`	overflow	1
`exp.f64`	`#f`	sensitivity	5	0
`sin.f64`	`(sin.f64 (/.f64 x (*.f64 y #s(literal 2 binary64))))`	cancelation	4	0
`tan.f64`	`(tan.f64 (/.f64 x (*.f64 y #s(literal 2 binary64))))`	cancellation	4	0

Confusion

	Predicted +	Predicted -
+	13073	4798
-	5667	70670

Precision

0.697598719316969

Recall

0.7315203402159924

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	13073	179	4619
-	5667	224	70446

Precision?

0.6922634905709659

Recall?

0.7415365676235242

Freqs

test

number	freq
0	75468
1	14017
2	3055
3	1067
4	273
5	155
6	18
7	59
8	5
9	51
10	27
11	5
12	8

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	197	1	18
-	30	0	122

Precision?

0.868421052631579

Recall?

0.9166666666666666

Samples

15.8s	168 770×	0	valid
4.0s	15 104×	1	valid
2.6s	4 703×	2	valid
105.0ms	257×	3	valid
2.0ms	5×	5	exit
1.0ms	2×	4	valid

Compiler

Compiled 61 940 to 20 851 computations (66.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 13.4s

ival-mult: 3.6s (26.9% of total)

ival-add: 1.6s (12.3% of total)

ival-sub: 1.5s (10.9% of total)

ival-div: 1.3s (10% of total)

ival-tan: 938.0ms (7% of total)

ival-sin: 839.0ms (6.3% of total)

adjust: 755.0ms (5.6% of total)

ival-sqrt: 578.0ms (4.3% of total)

ival-cos: 555.0ms (4.1% of total)

const: 471.0ms (3.5% of total)

ival-log: 405.0ms (3% of total)

ival-exp: 214.0ms (1.6% of total)

ival-true: 161.0ms (1.2% of total)

exact: 89.0ms (0.7% of total)

ival-hypot: 80.0ms (0.6% of total)

ival-assert: 74.0ms (0.6% of total)

ival-log1p: 71.0ms (0.5% of total)

ival-pow: 53.0ms (0.4% of total)

ival-expm1: 29.0ms (0.2% of total)

ival-pow2: 27.0ms (0.2% of total)

ival-cbrt: 24.0ms (0.2% of total)

series39.1s (0.9%)

Memory

-735.5MiB live, 46 281.6MiB allocated

Counts

15 629 → 412 908

Calls

45639 calls:

Time	Variable		Point	Expression
1.4s	t	@	-inf	(* z t)
321.0ms	y	@	0	(+ (* y (exp (* 2 (- (* z (sqrt (/ 1 t))) (* (- b c) (+ a 5/6)))))) (+ (* y (+ (* (exp (* 2 (- (* z (sqrt (/ 1 t))) (* (- b c) (+ a 5/6))))) (/ (+ (* (- b c) (* (- b c) 8/9)) (* z (* a (sqrt t)))) (* t t))) (/ (* (exp (* 2 (- (* z (sqrt (/ 1 t))) (* (- b c) (+ a 5/6))))) (+ (* a (* (* (- b c) (* z (sqrt t))) 4/3)) (* (- b c) (* (* (- b c) (- b c)) 32/81)))) (* t (* t t))))) (* (* 4/3 y) (* (exp (* 2 (- (* z (sqrt (/ 1 t))) (* (- b c) (+ a 5/6))))) (/ (- b c) t)))))
292.0ms	z	@	-inf	(* (* y y) (/ (* (sqrt 1/3) 1/2) z))
260.0ms	t	@	-inf	(pow (/ 1 (+ (* 170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 t) -170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000)) -1/2)
188.0ms	x	@	0	(+ (* y (- x z)) z)

bsearch33.3s (0.8%)

Memory

620.6MiB live, 41 530.9MiB allocated

Algorithm

1 877×	binary-search
1 387×	left-value

Stop Event

1 845×	narrow-enough
32×	predicate-same

Samples

19.6s	143 446×	0	valid
985.0ms	4 196×	1	valid
118.0ms	1 796×	0	invalid
41.0ms	221×	2	valid
18.0ms	83×	1	invalid
8.0ms	36×	3	valid
2.0ms	5×	4	valid
1.0ms	33×	0	exit
1.0ms	4×	2	invalid

Compiler

Compiled 528 948 to 350 675 computations (33.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 14.0s

ival-mult: 6.8s (48.9% of total)

ival-sub: 2.5s (17.8% of total)

ival-add: 2.0s (14.1% of total)

ival-div: 882.0ms (6.3% of total)

const: 431.0ms (3.1% of total)

ival-sin: 383.0ms (2.7% of total)

ival-cos: 334.0ms (2.4% of total)

adjust: 127.0ms (0.9% of total)

ival-sqrt: 118.0ms (0.8% of total)

ival-true: 111.0ms (0.8% of total)

ival-tan: 68.0ms (0.5% of total)

ival-assert: 56.0ms (0.4% of total)

exact: 51.0ms (0.4% of total)

ival-exp: 39.0ms (0.3% of total)

ival-pow: 37.0ms (0.3% of total)

ival-hypot: 21.0ms (0.2% of total)

ival-pow2: 12.0ms (0.1% of total)

ival-log: 6.0ms (0% of total)

ival-expm1: 5.0ms (0% of total)

ival-log1p: 4.0ms (0% of total)

ival-cbrt: 3.0ms (0% of total)

start15.0ms (0%)

Memory: -20.7MiB live, 23.5MiB allocated

end3.0ms (0%)

Memory: 8.9MiB live, 8.5MiB allocated

sample21.1min (29.2%)

simplify14.2min (19.6%)

soundness9.0min (12.4%)

rewrite8.9min (12.3%)

eval3.8min (5.3%)

prune3.5min (4.9%)

preprocess3.3min (4.5%)

localize3.0min (4.1%)

regimes2.1min (2.9%)

analyze1.3min (1.9%)

explain57.6s (1.3%)

series39.1s (0.9%)

bsearch33.3s (0.8%)

start15.0ms (0%)

end3.0ms (0%)

Profiling