Metrics for Herbie run

Date:	Wednesday, July 17th, 2024
Commit:	c34c16ee on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024199
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

simplify1.8min (25%)

Memory

-418.0MiB live, 130 806.2MiB allocated

Algorithm

344×	egg-herbie

Rules

2 739 082×	`accelerator-lowering-fma.f32`
2 739 082×	`accelerator-lowering-fma.f64`
958 198×	`-lowering-.f32`
958 198×	`-lowering-.f64`
545 756×	`+-lowering-+.f32`

Stop Event

286×	iter limit
215×	node limit
145×	saturated

Counts

32 376 → 32 376

rewrite1.2min (16.5%)

Memory

-156.3MiB live, 88 677.6MiB allocated

Algorithm

151×	batch-egg-rewrite

Rules

805 458×	`accelerator-lowering-fma.f32`
805 458×	`accelerator-lowering-fma.f64`
632 770×	`-lowering-.f32`
632 770×	`-lowering-.f64`
507 124×	`/-lowering-/.f64`

Stop Event

148×	iter limit
141×	node limit
17×	saturated
1×	unsound

Counts

1 676 → 97 508

sample1.2min (16.4%)

Memory

460.6MiB live, 87 724.4MiB allocated

Samples

29.8s	285 571×	0	valid
12.5s	25 061×	2	valid
9.5s	35 595×	1	valid
428.0ms	4 161×	0	invalid
194.0ms	977×	0	exit
152.0ms	411×	3	valid
65.0ms	101×	3	exit
61.0ms	101×	4	exit
38.0ms	114×	4	valid
7.0ms	21×	5	exit
3.0ms	26×	1	exit

Precisions

Click to see histograms. Total time spent on operations: 40.2s

ival-mult: 10.4s (25.8% of total)

ival-add: 4.2s (10.4% of total)

ival-div: 3.6s (9.1% of total)

ival-pow: 3.2s (7.9% of total)

ival-sub: 3.0s (7.4% of total)

const: 2.8s (6.9% of total)

ival-<=: 2.7s (6.7% of total)

adjust: 2.4s (5.9% of total)

ival-sin: 2.3s (5.7% of total)

ival-cos: 1.9s (4.7% of total)

ival-neg: 592.0ms (1.5% of total)

ival-sqrt: 561.0ms (1.4% of total)

ival-exp: 500.0ms (1.2% of total)

exact: 467.0ms (1.2% of total)

ival-and: 351.0ms (0.9% of total)

ival-pow2: 349.0ms (0.9% of total)

ival-==: 319.0ms (0.8% of total)

ival-true: 138.0ms (0.3% of total)

ival-assert: 131.0ms (0.3% of total)

ival-log1p: 100.0ms (0.2% of total)

ival-expm1: 97.0ms (0.2% of total)

ival-atan: 81.0ms (0.2% of total)

ival-<: 76.0ms (0.2% of total)

ival-tan: 55.0ms (0.1% of total)

ival-pi: 38.0ms (0.1% of total)

ival-hypot: 17.0ms (0% of total)

ival-fabs: 5.0ms (0% of total)

ival-if: 4.0ms (0% of total)

Bogosity

soundness50.2s (11.9%)

Memory

-82.0MiB live, 28 139.9MiB allocated

Rules

1 561 902×	`accelerator-lowering-fma.f32`
1 561 902×	`accelerator-lowering-fma.f64`
791 768×	`-lowering-.f32`
791 768×	`-lowering-.f64`
408 346×	`/-lowering-/.f64`

Stop Event

179×	iter limit
172×	node limit
28×	fuel
14×	done
8×	saturated
1×	unsound

Compiler

Compiled 24 777 to 10 372 computations (58.1% saved)

eval31.8s (7.5%)

Memory: 1 005.3MiB live, 42 525.9MiB allocated
Compiler: Compiled 4 973 935 to 353 077 computations (92.9% saved)

prune25.9s (6.2%)

Memory: -568.2MiB live, 41 141.9MiB allocated
Counts: 154 351 → 2 351
Compiler: Compiled 85 587 to 42 741 computations (50.1% saved)

localize20.5s (4.9%)

Memory

44.0MiB live, 31 691.7MiB allocated

Samples

6.1s	31 998×	0	valid
3.1s	2 695×	2	valid
1.8s	2 984×	1	valid
1.1s	270×	5	exit
351.0ms	247×	3	valid
128.0ms	60×	4	valid
100.0ms	390×	0	invalid
17.0ms	6×	4	exit
9.0ms	6×	2	exit

Compiler

Compiled 27 010 to 3 600 computations (86.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 9.3s

ival-mult: 3.2s (34.8% of total)

ival-add: 1.5s (15.9% of total)

ival-div: 1.2s (12.7% of total)

adjust: 953.0ms (10.3% of total)

const: 604.0ms (6.5% of total)

ival-sub: 404.0ms (4.4% of total)

ival-tan: 355.0ms (3.8% of total)

ival-pow: 325.0ms (3.5% of total)

ival-sin: 149.0ms (1.6% of total)

ival-cos: 144.0ms (1.6% of total)

ival-sqrt: 124.0ms (1.3% of total)

ival-neg: 87.0ms (0.9% of total)

ival-exp: 83.0ms (0.9% of total)

exact: 58.0ms (0.6% of total)

ival-true: 31.0ms (0.3% of total)

ival-atan: 20.0ms (0.2% of total)

ival-assert: 15.0ms (0.2% of total)

ival-expm1: 11.0ms (0.1% of total)

ival-log1p: 8.0ms (0.1% of total)

ival-pow2: 6.0ms (0.1% of total)

ival-pi: 4.0ms (0% of total)

ival-fabs: 1.0ms (0% of total)

preprocess16.1s (3.8%)

Memory

77.7MiB live, 18 297.9MiB allocated

Algorithm

84×	egg-herbie

Rules

283 340×	`accelerator-lowering-fma.f32`
283 340×	`accelerator-lowering-fma.f64`
55 342×	`-lowering-.f32`
55 342×	`-lowering-.f64`
38 680×	`unsub-neg`

Stop Event

55×	saturated
40×	iter limit
31×	node limit

Compiler

Compiled 26 038 to 6 952 computations (73.3% saved)

regimes10.4s (2.5%)

Memory

13.0MiB live, 12 100.4MiB allocated

Counts

6 537 → 649

Calls

96 calls:

991.0ms	x
934.0ms	b
606.0ms	a
588.0ms	(+.f64 (+.f64 (+.f64 (+.f64 e d) c) b) a)
518.0ms	(+.f64 (+.f64 e d) c)

Compiler

Compiled 11 320 to 6 043 computations (46.6% saved)

explain10.3s (2.4%)

Memory

32.1MiB live, 14 410.2MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	1270	1
`+.f64`	`#f`	cancellation	376	85
`-.f64`	(-.f64 (*.f64 #s(literal 170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 binary64) t) #s(literal 170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 binary64))	oflow-left	220	0
`sqrt.f64`	`#f`	oflow-rescue	179	0
`log.f64`	`(log.f64 (+.f64 #s(literal 1 binary64) x))`	sensitivity	168	0
`/.f64`	`#f`	n/o	160	0
`/.f64`	`#f`	o/o	131	0
`-.f64`	`#f`	nan-rescue	124	0
`pow.f64`	`(pow.f64 (+.f64 #s(literal 1 binary64) (/.f64 i n)) n)`	sensitivity	115	0
`/.f64`	`#f`	u/n	85	0
`/.f64`	`#f`	n/u	56	0
`/.f64`	`#f`	u/u	44	0
`*.f64`	`#f`	*nu**	41	0
`/.f64`	`#f`	o/n	39	0
`+.f64`	`#f`	nan-rescue	37	0
`*.f64`	`#f`	*no**	31	0
`pow.f64`	`(pow.f64 (+.f64 #s(literal 1 binary64) (/.f64 i n)) n)`	oflow-rescue	19	0
↳	`(pow.f64 (+.f64 #s(literal 1 binary64) (/.f64 i n)) n)`	overflow	43
↳	`(/.f64 i n)`	overflow	19
↳	`(+.f64 #s(literal 1 binary64) (/.f64 i n))`	overflow	19
`sqrt.f64`	`#f`	uflow-rescue	10	0

Confusion

	Predicted +	Predicted -
+	3541	459
-	118	6634

Precision

0.9677507515714676

Recall

0.88525

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	3541	158	301
-	118	184	6450

Precision?

0.9245188702824294

Recall?

0.92475

Freqs

test

number	freq
0	7093
1	3235
2	382
3	42

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	29	1	1
-	2	0	9

Precision?

0.9375

Recall?

0.967741935483871

Samples

1.6s	16 924×	0	valid
1.2s	1 934×	2	valid
571.0ms	2 518×	1	valid
76.0ms	56×	5	exit
47.0ms	60×	3	valid
5.0ms	12×	4	valid

Compiler

Compiled 8 444 to 1 926 computations (77.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.4s

ival-mult: 718.0ms (29.6% of total)

ival-add: 396.0ms (16.4% of total)

ival-div: 278.0ms (11.5% of total)

adjust: 240.0ms (9.9% of total)

ival-pow: 204.0ms (8.4% of total)

ival-sub: 179.0ms (7.4% of total)

ival-sin: 133.0ms (5.5% of total)

ival-cos: 69.0ms (2.8% of total)

const: 41.0ms (1.7% of total)

ival-exp: 34.0ms (1.4% of total)

ival-sqrt: 24.0ms (1% of total)

exact: 22.0ms (0.9% of total)

ival-pow2: 20.0ms (0.8% of total)

ival-neg: 19.0ms (0.8% of total)

ival-true: 18.0ms (0.7% of total)

ival-assert: 9.0ms (0.4% of total)

ival-atan: 5.0ms (0.2% of total)

ival-log1p: 5.0ms (0.2% of total)

ival-tan: 4.0ms (0.2% of total)

ival-expm1: 4.0ms (0.2% of total)

ival-pi: 2.0ms (0.1% of total)

bsearch5.4s (1.3%)

Memory

11.0MiB live, 7 226.3MiB allocated

Algorithm

191×	binary-search
132×	left-value

Stop Event

185×	narrow-enough
5×	predicate-same
1×	predicate-failed

Samples

2.2s	19 102×	0	valid
671.0ms	3 159×	1	valid
634.0ms	1 810×	2	valid
226.0ms	3 478×	0	invalid
49.0ms	87×	3	valid
6.0ms	18×	4	valid
2.0ms	12×	1	exit

Compiler

Compiled 47 183 to 31 307 computations (33.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.9s

ival-mult: 932.0ms (32.2% of total)

ival-pow: 460.0ms (15.9% of total)

ival-div: 425.0ms (14.7% of total)

ival-add: 339.0ms (11.7% of total)

ival-sub: 319.0ms (11% of total)

adjust: 146.0ms (5% of total)

ival-exp: 93.0ms (3.2% of total)

ival-neg: 65.0ms (2.2% of total)

ival-sqrt: 62.0ms (2.1% of total)

exact: 27.0ms (0.9% of total)

ival-true: 19.0ms (0.7% of total)

ival-assert: 10.0ms (0.3% of total)

ival-pi: 2.0ms (0.1% of total)

analyze3.5s (0.8%)

Memory

140.2MiB live, 5 695.2MiB allocated

Algorithm

43×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	54.5%	45.5%	0%	0%	0%	0
21.4%	11.7%	42.9%	45.5%	0%	0%	0%	1
37.4%	20.4%	34.1%	45.5%	0%	0%	0%	2
48.7%	26.2%	27.7%	45.5%	0%	0.6%	0%	3
57.7%	30.7%	22.6%	45.5%	0%	1.2%	0%	4
71.2%	37.7%	15.3%	45.5%	0%	1.6%	0%	5
72.9%	38.4%	14.3%	45.5%	0%	1.8%	0%	6
77.9%	40.7%	11.6%	45.5%	0%	2.2%	0%	7
81.5%	42.6%	9.7%	45.5%	0%	2.3%	0%	8
84.1%	43.8%	8.3%	45.5%	0%	2.5%	0%	9
86.2%	44.6%	7.2%	45.5%	0%	2.7%	0%	10
88.2%	45.6%	6.1%	45.5%	0%	2.8%	0%	11
89.1%	45.9%	5.6%	45.5%	0%	2.9%	0%	12

Compiler

Compiled 1 401 to 721 computations (48.5% saved)

series3.1s (0.7%)

Memory

129.4MiB live, 4 316.6MiB allocated

Counts

1 676 → 32 376

Calls

6588 calls:

Time	Variable		Point	Expression
167.0ms	x	@	-inf	(/ (- x (+ (* (* x (* x x)) (+ (* x (* x (+ (* x (* x -1/5040)) 1/120))) -1/6)) x)) (tan x))
114.0ms	t	@	0	(* (sqrt (sqrt (sqrt (+ (* t 170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000) -170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000)))) (* (sqrt (+ (* t 170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000) -170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000)) (sqrt (sqrt (+ (* t 170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000) -170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000)))))
77.0ms	t	@	0	(* (* (sqrt (sqrt (sqrt (+ (* t 170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000) -170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000)))) (* (sqrt (+ (* t 170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000) -170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000)) (sqrt (sqrt (+ (* t 170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000) -170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000))))) (sqrt (sqrt (sqrt (+ (* t 170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000) -170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000)))))
63.0ms	t	@	0	(sqrt (sqrt (+ (* t 170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000) -170000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000)))
44.0ms	a	@	0	(- (* b b) (* 4 (* a c)))

end0.0ms (0%)

Memory: 0.9MiB live, 0.9MiB allocated

simplify1.8min (25%)

rewrite1.2min (16.5%)

sample1.2min (16.4%)

soundness50.2s (11.9%)

eval31.8s (7.5%)

prune25.9s (6.2%)

localize20.5s (4.9%)

preprocess16.1s (3.8%)

regimes10.4s (2.5%)

explain10.3s (2.4%)

bsearch5.4s (1.3%)

analyze3.5s (0.8%)

series3.1s (0.7%)

end0.0ms (0%)

Profiling