Metrics for Herbie run

Date:	Tuesday, August 6th, 2024
Commit:	2.2 on release
Hostname:	nightly with Racket 8.11.1
Seed:	2024219
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

simplify1.8min (26.4%)

Memory

-1 255.0MiB live, 129 773.2MiB allocated

Algorithm

342×	egg-herbie

Rules

2 964 050×	`lower-fma.f32`
2 963 498×	`lower-fma.f64`
956 280×	`lower-*.f32`
954 808×	`lower-*.f64`
585 982×	`lower-+.f32`

Stop Event

436×	iter limit
224×	node limit
132×	saturated

Counts

39 420 → 38 372

sample1.1min (16.5%)

Memory

993.0MiB live, 83 834.7MiB allocated

Samples

28.6s	285 736×	0	valid
11.6s	43 644×	1	valid
6.8s	16 983×	2	valid
508.0ms	4 214×	0	invalid
180.0ms	1 026×	0	exit
174.0ms	389×	3	valid
105.0ms	101×	3	exit
100.0ms	101×	4	exit
5.0ms	33×	1	exit

Precisions

Click to see histograms. Total time spent on operations: 36.5s

ival-mult: 9.1s (25% of total)

ival-add: 4.2s (11.5% of total)

ival-div: 3.1s (8.6% of total)

const: 2.9s (8% of total)

ival-pow: 2.8s (7.8% of total)

adjust: 2.8s (7.5% of total)

ival-sub: 2.7s (7.4% of total)

ival-<=: 2.2s (6% of total)

ival-sin: 1.9s (5.2% of total)

ival-cos: 1.3s (3.5% of total)

ival-sqrt: 513.0ms (1.4% of total)

ival-exp: 493.0ms (1.3% of total)

exact: 456.0ms (1.2% of total)

ival-and: 362.0ms (1% of total)

ival-neg: 318.0ms (0.9% of total)

ival-==: 315.0ms (0.9% of total)

ival-pow2: 249.0ms (0.7% of total)

ival-true: 143.0ms (0.4% of total)

ival-assert: 139.0ms (0.4% of total)

ival-<: 102.0ms (0.3% of total)

ival-atan: 92.0ms (0.3% of total)

ival-expm1: 83.0ms (0.2% of total)

ival-log1p: 79.0ms (0.2% of total)

ival-tan: 55.0ms (0.2% of total)

ival-pi: 35.0ms (0.1% of total)

ival-hypot: 32.0ms (0.1% of total)

ival-fabs: 6.0ms (0% of total)

ival-if: 4.0ms (0% of total)

Bogosity

rewrite1.1min (16%)

Memory

31.3MiB live, 85 360.2MiB allocated

Algorithm

150×	batch-egg-rewrite

Rules

814 400×	`lower-fma.f32`
813 844×	`lower-fma.f64`
624 682×	`lower-*.f32`
623 228×	`lower-*.f64`
531 104×	`lower-/.f32`

Stop Event

298×	iter limit
145×	node limit
13×	saturated

Counts

1 895 → 89 087

soundness40.9s (10.1%)

Memory

61.7MiB live, 26 626.9MiB allocated

Rules

1 547 694×	`lower-fma.f32`
1 547 362×	`lower-fma.f64`
749 044×	`lower-*.f32`
748 174×	`lower-*.f64`
403 560×	`lower-+.f32`

Stop Event

250×	iter limit
168×	node limit
25×	fuel
17×	done
8×	saturated

Compiler

Compiled 20 719 to 7 556 computations (63.5% saved)

eval32.3s (8%)

Memory: 617.1MiB live, 41 428.3MiB allocated
Compiler: Compiled 4 852 295 to 315 817 computations (93.5% saved)

prune25.4s (6.3%)

Memory: -490.4MiB live, 41 278.1MiB allocated
Counts: 152 576 → 2 193
Compiler: Compiled 82 930 to 38 924 computations (53.1% saved)

localize25.1s (6.2%)

Memory

244.5MiB live, 28 996.6MiB allocated

Samples

9.0s	30 367×	0	valid
3.3s	4 685×	1	valid
3.0s	2 569×	2	valid
475.0ms	491×	1	exit
249.0ms	86×	5	exit
181.0ms	185×	3	valid
6.0ms	17×	0	invalid

Compiler

Compiled 31 885 to 4 022 computations (87.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 11.2s

ival-mult: 3.6s (32.5% of total)

ival-add: 1.9s (17.2% of total)

ival-div: 1.5s (13.5% of total)

adjust: 1.2s (10.3% of total)

ival-pow: 719.0ms (6.4% of total)

const: 707.0ms (6.3% of total)

ival-sub: 510.0ms (4.6% of total)

ival-sin: 237.0ms (2.1% of total)

ival-exp: 168.0ms (1.5% of total)

ival-cos: 148.0ms (1.3% of total)

ival-neg: 115.0ms (1% of total)

ival-sqrt: 96.0ms (0.9% of total)

ival-expm1: 64.0ms (0.6% of total)

exact: 57.0ms (0.5% of total)

ival-pow2: 35.0ms (0.3% of total)

ival-true: 33.0ms (0.3% of total)

ival-assert: 17.0ms (0.2% of total)

ival-atan: 16.0ms (0.1% of total)

ival-log1p: 15.0ms (0.1% of total)

ival-log: 12.0ms (0.1% of total)

ival-tan: 6.0ms (0.1% of total)

ival-pi: 4.0ms (0% of total)

preprocess15.6s (3.8%)

Memory

32.5MiB live, 17 248.9MiB allocated

Algorithm

42×	egg-herbie

Rules

284 538×	`lower-fma.f32`
284 536×	`lower-fma.f64`
55 266×	`lower-*.f32`
55 078×	`lower-*.f64`
37 652×	`lower-+.f32`

Stop Event

82×	iter limit
54×	saturated
32×	node limit

Compiler

Compiled 28 132 to 6 804 computations (75.8% saved)

explain10.1s (2.5%)

Memory

3.5MiB live, 14 522.5MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	1354	2
`+.f64`	`#f`	cancellation	361	95
`-.f64`	(-.f64 (*.f64 #s(literal 170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 binary64) t) #s(literal 170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 binary64))	oflow-left	231	0
`sqrt.f64`	`#f`	oflow-rescue	198	0
`log.f64`	`(log.f64 (+.f64 #s(literal 1 binary64) x))`	sensitivity	165	0
`/.f64`	`#f`	n/o	156	0
`/.f64`	`#f`	o/o	147	0
`pow.f64`	`(pow.f64 (+.f64 #s(literal 1 binary64) (/.f64 i n)) n)`	sensitivity	109	0
`/.f64`	`#f`	u/n	102	0
`-.f64`	`#f`	nan-rescue	75	0
`/.f64`	`#f`	n/u	46	0
`/.f64`	`#f`	u/u	46	0
`/.f64`	`#f`	o/n	45	0
`+.f64`	`#f`	nan-rescue	44	0
`*.f64`	`#f`	*nu**	39	0
`*.f64`	`#f`	*no**	35	0
`pow.f64`	`(pow.f64 (+.f64 #s(literal 1 binary64) (/.f64 i n)) n)`	oflow-rescue	19	0
↳	`(pow.f64 (+.f64 #s(literal 1 binary64) (/.f64 i n)) n)`	overflow	29
↳	`(/.f64 i n)`	overflow	19
↳	`(+.f64 #s(literal 1 binary64) (/.f64 i n))`	overflow	19
`sqrt.f64`	`#f`	uflow-rescue	10	0

Confusion

	Predicted +	Predicted -
+	3606	483
-	139	6524

Precision

0.9628838451268358

Recall

0.8818782098312545

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	3606	167	316
-	139	186	6338

Precision?

0.9206930209858467

Recall?

0.9227194913181707

Freqs

test

number	freq
0	7007
1	3324
2	385
3	36

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	29	1	1
-	2	0	9

Precision?

0.9375

Recall?

0.967741935483871

Samples

1.9s	16 866×	0	valid
956.0ms	3 220×	1	valid
623.0ms	1 366×	2	valid
57.0ms	52×	3	valid

Compiler

Compiled 8 448 to 1 926 computations (77.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.4s

ival-mult: 682.0ms (28.3% of total)

ival-div: 354.0ms (14.7% of total)

adjust: 259.0ms (10.8% of total)

ival-add: 252.0ms (10.5% of total)

ival-sub: 236.0ms (9.8% of total)

ival-pow: 200.0ms (8.3% of total)

ival-sin: 124.0ms (5.2% of total)

ival-cos: 77.0ms (3.2% of total)

ival-exp: 57.0ms (2.4% of total)

const: 42.0ms (1.7% of total)

ival-sqrt: 23.0ms (1% of total)

ival-true: 19.0ms (0.8% of total)

exact: 19.0ms (0.8% of total)

ival-neg: 18.0ms (0.7% of total)

ival-pow2: 14.0ms (0.6% of total)

ival-assert: 9.0ms (0.4% of total)

ival-tan: 5.0ms (0.2% of total)

ival-atan: 5.0ms (0.2% of total)

ival-log1p: 5.0ms (0.2% of total)

ival-expm1: 4.0ms (0.2% of total)

ival-pi: 2.0ms (0.1% of total)

regimes7.6s (1.9%)

Memory

-383.5MiB live, 10 483.2MiB allocated

Counts

5 683 → 550

Calls

96 calls:

989.0ms	x
329.0ms	e
318.0ms	a
305.0ms	t
291.0ms	b

Compiler

Compiled 10 459 to 5 596 computations (46.5% saved)

analyze4.1s (1%)

Memory

131.7MiB live, 5 504.3MiB allocated

Algorithm

43×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	54.5%	45.5%	0%	0%	0%	0
21.4%	11.7%	42.9%	45.5%	0%	0%	0%	1
37.4%	20.4%	34.1%	45.5%	0%	0%	0%	2
48.7%	26.2%	27.7%	45.5%	0%	0.6%	0%	3
57.7%	30.7%	22.6%	45.5%	0%	1.2%	0%	4
71.2%	37.7%	15.3%	45.5%	0%	1.6%	0%	5
72.9%	38.4%	14.3%	45.5%	0%	1.8%	0%	6
77.9%	40.7%	11.6%	45.5%	0%	2.2%	0%	7
81.5%	42.6%	9.7%	45.5%	0%	2.3%	0%	8
84.1%	43.8%	8.3%	45.5%	0%	2.5%	0%	9
86.2%	44.6%	7.2%	45.5%	0%	2.7%	0%	10
88.2%	45.6%	6.1%	45.5%	0%	2.8%	0%	11
89.1%	45.9%	5.6%	45.5%	0%	2.9%	0%	12

Compiler

Compiled 1 402 to 721 computations (48.6% saved)

series3.1s (0.8%)

Memory

334.9MiB live, 4 566.8MiB allocated

Counts

1 895 → 39 420

Calls

5379 calls:

Time	Variable		Point	Expression
92.0ms	x	@	0	(- x (sqrt (- (* x x) eps)))
83.0ms	x	@	0	(pow (exp 20) (sqrt x))
77.0ms	v	@	inf	(/ v u)
71.0ms	t	@	0	(* (pow (/ 1 (+ (* 170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 t) -170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000)) -1/2) (* (pow (+ (* t 170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000) -170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000) 3/8) (pow (+ (* t 170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000) -170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000) 1/8)))
58.0ms	x	@	0	(* (* x (* x x)) (* eps (+ (* eps 10) (* 5 x))))

bsearch2.3s (0.6%)

Memory

129.5MiB live, 2 684.7MiB allocated

Algorithm

152×	binary-search
107×	left-value

Stop Event

145×	narrow-enough
7×	predicate-same

Samples

997.0ms	8 006×	0	valid
356.0ms	1 368×	1	valid
145.0ms	438×	2	valid
42.0ms	623×	0	invalid
3.0ms	12×	3	valid
0.0ms	4×	1	exit

Compiler

Compiled 37 517 to 22 776 computations (39.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.1s

ival-mult: 351.0ms (32.9% of total)

ival-pow: 198.0ms (18.5% of total)

ival-div: 131.0ms (12.3% of total)

ival-add: 120.0ms (11.2% of total)

ival-sub: 96.0ms (9% of total)

ival-exp: 63.0ms (5.9% of total)

adjust: 57.0ms (5.3% of total)

ival-neg: 16.0ms (1.5% of total)

ival-sqrt: 14.0ms (1.3% of total)

ival-true: 8.0ms (0.7% of total)

exact: 7.0ms (0.7% of total)

ival-assert: 4.0ms (0.4% of total)

ival-expm1: 3.0ms (0.3% of total)

ival-pi: 1.0ms (0.1% of total)

end0.0ms (0%)

Memory: 0.8MiB live, 0.8MiB allocated

simplify1.8min (26.4%)

sample1.1min (16.5%)

rewrite1.1min (16%)

soundness40.9s (10.1%)

eval32.3s (8%)

prune25.4s (6.3%)

localize25.1s (6.2%)

preprocess15.6s (3.8%)

explain10.1s (2.5%)

regimes7.6s (1.9%)

analyze4.1s (1%)

series3.1s (0.8%)

bsearch2.3s (0.6%)

end0.0ms (0%)

Profiling