Metrics for Herbie run

Date:	Thursday, July 25th, 2024
Commit:	2a1d9f8a on ir-cleanup
Hostname:	nightly with Racket 8.11.1
Seed:	2024207
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

simplify1.7min (22.3%)

Memory

-208.6MiB live, 137 702.8MiB allocated

Algorithm

288×	egg-herbie

Rules

2 526 128×	`lower-fma.f32`
2 525 488×	`lower-fma.f64`
1 273 426×	`lower-*.f32`
1 270 942×	`lower-*.f64`
669 394×	`lower-+.f32`

Stop Event

384×	iter limit
224×	node limit
64×	saturated

Counts

56 484 → 56 048

sample1.4min (18.3%)

Memory

608.5MiB live, 104 857.1MiB allocated

Samples

32.4s	221 687×	0	valid
10.5s	26 535×	1	valid
9.2s	65 115×	0	invalid
3.8s	12 565×	1	invalid
3.8s	9 664×	2	valid
2.5s	6 166×	3	valid
342.0ms	1 891×	1	exit
184.0ms	584×	2	invalid
59.0ms	140×	4	valid
27.0ms	234×	0	exit
17.0ms	41×	5	exit
1.0ms	3×	4	exit

Precisions

Click to see histograms. Total time spent on operations: 49.5s

ival-mult: 11.8s (23.8% of total)

ival-div: 7.5s (15.1% of total)

ival-sub: 4.4s (8.8% of total)

ival-tan: 4.0s (8.1% of total)

ival-add: 2.9s (5.8% of total)

ival-pow: 2.8s (5.6% of total)

ival-pow2: 2.7s (5.4% of total)

ival-sqrt: 2.5s (5% of total)

ival-sin: 2.1s (4.2% of total)

ival-exp: 2.1s (4.1% of total)

adjust: 1.8s (3.6% of total)

ival-cos: 884.0ms (1.8% of total)

ival-acos: 617.0ms (1.2% of total)

ival-neg: 555.0ms (1.1% of total)

ival-log: 493.0ms (1% of total)

ival-pi: 468.0ms (0.9% of total)

ival-hypot: 460.0ms (0.9% of total)

const: 410.0ms (0.8% of total)

exact: 387.0ms (0.8% of total)

ival-true: 261.0ms (0.5% of total)

ival-asin: 220.0ms (0.4% of total)

ival-assert: 138.0ms (0.3% of total)

ival-fabs: 134.0ms (0.3% of total)

ival-atan: 95.0ms (0.2% of total)

ival-<: 81.0ms (0.2% of total)

ival-and: 11.0ms (0% of total)

Bogosity

rewrite49.3s (10.8%)

Memory

475.6MiB live, 70 301.2MiB allocated

Algorithm

128×	batch-egg-rewrite

Rules

587 040×	`lower-*.f32`
584 618×	`lower-*.f64`
570 418×	`lower-fma.f32`
569 790×	`lower-fma.f64`
458 466×	`lower-/.f32`

Stop Event

264×	iter limit
128×	node limit

Counts

2 268 → 107 626

soundness45.1s (9.9%)

Memory

314.0MiB live, 36 567.2MiB allocated

Rules

1 614 402×	`lower-fma.f32`
1 614 004×	`lower-fma.f64`
1 080 582×	`lower-*.f32`
1 078 696×	`lower-*.f64`
517 734×	`lower-+.f32`

Stop Event

298×	iter limit
194×	node limit
30×	fuel
2×	done

Compiler

Compiled 44 029 to 21 527 computations (51.1% saved)

eval35.2s (7.7%)

Memory: 1 035.6MiB live, 53 715.7MiB allocated
Compiler: Compiled 6 992 525 to 491 773 computations (93% saved)

prune32.3s (7.1%)

Memory: -1 210.0MiB live, 52 121.0MiB allocated
Counts: 194 874 → 3 647
Compiler: Compiled 201 729 to 96 273 computations (52.3% saved)

regimes28.2s (6.2%)

Memory

-266.4MiB live, 42 897.2MiB allocated

Counts

17 319 → 956

Calls

156 calls:

1.6s	l
977.0ms	t
860.0ms	x
708.0ms	k
676.0ms	F

Compiler

Compiled 20 179 to 13 921 computations (31% saved)

localize28.2s (6.2%)

Memory

114.6MiB live, 39 749.9MiB allocated

Samples

7.0s	21 564×	0	valid
4.1s	2 556×	2	valid
3.3s	3 655×	1	valid
1.7s	807×	3	valid
1.4s	3 281×	0	invalid
764.0ms	292×	5	exit
135.0ms	65×	4	valid
95.0ms	438×	0	exit
43.0ms	70×	1	invalid
15.0ms	35×	2	exit
11.0ms	5×	4	exit

Compiler

Compiled 41 129 to 4 809 computations (88.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 14.0s

ival-mult: 3.8s (26.7% of total)

ival-div: 2.1s (15% of total)

ival-add: 1.2s (8.2% of total)

ival-cos: 1.1s (7.6% of total)

adjust: 1.0s (7.1% of total)

ival-sin: 888.0ms (6.3% of total)

ival-tan: 787.0ms (5.6% of total)

ival-sqrt: 733.0ms (5.2% of total)

ival-sub: 421.0ms (3% of total)

ival-pow: 405.0ms (2.9% of total)

ival-asin: 224.0ms (1.6% of total)

const: 199.0ms (1.4% of total)

ival-exp: 188.0ms (1.3% of total)

ival-pow2: 183.0ms (1.3% of total)

ival-neg: 167.0ms (1.2% of total)

ival-log: 160.0ms (1.1% of total)

ival-acos: 160.0ms (1.1% of total)

exact: 81.0ms (0.6% of total)

ival-cbrt: 63.0ms (0.4% of total)

ival-hypot: 57.0ms (0.4% of total)

ival-fabs: 41.0ms (0.3% of total)

ival-pi: 38.0ms (0.3% of total)

ival-log1p: 32.0ms (0.2% of total)

ival-cosh: 32.0ms (0.2% of total)

ival-true: 30.0ms (0.2% of total)

ival-atan: 28.0ms (0.2% of total)

ival-sinh: 21.0ms (0.1% of total)

ival-tanh: 16.0ms (0.1% of total)

ival-assert: 14.0ms (0.1% of total)

preprocess14.1s (3.1%)

Memory

-280.7MiB live, 18 226.8MiB allocated

Algorithm

32×	egg-herbie

Rules

229 844×	`lower-fma.f64`
229 844×	`lower-fma.f32`
79 498×	`lower-*.f32`
79 270×	`lower-*.f64`
36 848×	`lower-/.f32`

Stop Event

64×	iter limit
41×	node limit
23×	saturated

Compiler

Compiled 49 770 to 15 048 computations (69.8% saved)

bsearch10.0s (2.2%)

Memory

192.3MiB live, 14 920.7MiB allocated

Algorithm

275×	left-value
263×	binary-search

Stop Event

252×	narrow-enough
11×	predicate-same

Samples

4.9s	29 909×	0	valid
1.6s	9 295×	0	invalid
236.0ms	891×	1	valid
79.0ms	238×	2	valid
35.0ms	175×	1	invalid
23.0ms	48×	3	valid
4.0ms	13×	2	invalid
1.0ms	2×	4	valid

Compiler

Compiled 82 119 to 57 696 computations (29.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 5.3s

ival-mult: 1.4s (26.3% of total)

ival-div: 994.0ms (18.8% of total)

ival-pow: 772.0ms (14.6% of total)

ival-sin: 366.0ms (6.9% of total)

ival-add: 338.0ms (6.4% of total)

ival-tan: 320.0ms (6% of total)

ival-pow2: 291.0ms (5.5% of total)

ival-sub: 267.0ms (5% of total)

ival-sqrt: 110.0ms (2.1% of total)

ival-neg: 105.0ms (2% of total)

ival-cos: 92.0ms (1.7% of total)

ival-exp: 73.0ms (1.4% of total)

adjust: 46.0ms (0.9% of total)

exact: 38.0ms (0.7% of total)

ival-true: 30.0ms (0.6% of total)

const: 24.0ms (0.5% of total)

ival-assert: 16.0ms (0.3% of total)

ival-atan: 8.0ms (0.2% of total)

ival-fabs: 5.0ms (0.1% of total)

ival-pi: 1.0ms (0% of total)

explain9.9s (2.2%)

Memory

-316.4MiB live, 14 303.3MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	461	2
`sqrt.f64`	`#f`	oflow-rescue	451	0
`cos.f64`	`#f`	sensitivity	378	2
`acos.f64`	`(acos.f64 (/.f64 (-.f64 #s(literal 1 binary64) (.f64 #s(literal 5 binary64) (.f64 v v))) (-.f64 (*.f64 v v) #s(literal 1 binary64))))`	sensitivity	255	0
`*.f64`	`#f`	*no**	243	0
`+.f64`	`#f`	nan-rescue	217	0
`sqrt.f64`	`#f`	uflow-rescue	150	0
`pow.f64`	`#f`	oflow-rescue	137	0
`asin.f64`	`(asin.f64 (sqrt.f64 (/.f64 (-.f64 #s(literal 1 binary64) (pow.f64 (/.f64 Om Omc) #s(literal 2 binary64))) (+.f64 #s(literal 1 binary64) (*.f64 #s(literal 2 binary64) (pow.f64 (/.f64 t l) #s(literal 2 binary64)))))))`	sensitivity	131	1
`tan.f64`	`(tan.f64 (*.f64 (PI.f64) l))`	sensitivity	126	0
`*.f64`	`#f`	*uo**	107	0
`-.f64`	`#f`	nan-rescue	104	0
`pow.f64`	`(pow.f64 (.f64 (.f64 #s(literal 2 binary64) (PI.f64)) n) (/.f64 (-.f64 #s(literal 1 binary64) k) #s(literal 2 binary64)))`	sensitivity	82	37
`/.f64`	`#f`	o/o	79	0
`*.f64`	`#f`	*nu**	64	0
`/.f64`	`#f`	u/u	61	0
`cos.f64`	`(cos.f64 (-.f64 (/.f64 (*.f64 K (+.f64 m n)) #s(literal 2 binary64)) M))`	oflow-rescue	60	0
↳	`(/.f64 (*.f64 K (+.f64 m n)) #s(literal 2 binary64))`	overflow	60
↳	`(-.f64 (/.f64 (*.f64 K (+.f64 m n)) #s(literal 2 binary64)) M)`	overflow	60
↳	`(*.f64 K (+.f64 m n))`	overflow	60
`/.f64`	`#f`	o/n	57	0
`*.f64`	`#f`	*ou**	56	0
`pow.f64`	`#f`	uflow-rescue	54	0
`+.f64`	`#f`	cancellation	38	0
`/.f64`	`#f`	n/o	37	0
`/.f64`	`#f`	n/u	34	0
`/.f64`	`#f`	u/n	11	0
`log.f64`	`(log.f64 (/.f64 (+.f64 (exp.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f)) (exp.f64 (neg.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f)))) (-.f64 (exp.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f)) (exp.f64 (neg.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f))))))`	sensitivity	5	1
`exp.f64`	`#f`	sensitivity	4	5
`tan.f64`	`(tan.f64 (*.f64 (PI.f64) l))`	oflow-rescue	1	0
↳	`(*.f64 (PI.f64) l)`	overflow	1

Confusion

	Predicted +	Predicted -
+	1899	33
-	1104	5156

Precision

0.6323676323676324

Recall

0.9829192546583851

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	1899	0	33
-	1104	43	5113

Precision?

0.6234405778069599

Recall?

0.9829192546583851

Freqs

test

number	freq
0	5189
1	2647
2	319
3	31
4	5
5	1

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	25	0	0
-	1	0	6

Precision?

0.9615384615384616

Recall?

1.0

Samples

2.4s	13 178×	0	valid
699.0ms	2 030×	1	valid
393.0ms	764×	2	valid
240.0ms	396×	3	valid
9.0ms	10×	5	exit
3.0ms	6×	4	valid

Compiler

Compiled 8 490 to 2 164 computations (74.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.7s

ival-div: 592.0ms (22.1% of total)

ival-mult: 544.0ms (20.3% of total)

ival-tan: 321.0ms (12% of total)

ival-sin: 172.0ms (6.4% of total)

ival-sub: 145.0ms (5.4% of total)

ival-add: 139.0ms (5.2% of total)

ival-sqrt: 126.0ms (4.7% of total)

ival-pow2: 120.0ms (4.5% of total)

adjust: 112.0ms (4.2% of total)

ival-exp: 96.0ms (3.6% of total)

ival-pow: 69.0ms (2.6% of total)

ival-cos: 60.0ms (2.2% of total)

ival-neg: 30.0ms (1.1% of total)

ival-acos: 28.0ms (1% of total)

exact: 22.0ms (0.8% of total)

ival-hypot: 21.0ms (0.8% of total)

ival-true: 16.0ms (0.6% of total)

ival-pi: 14.0ms (0.5% of total)

ival-log: 10.0ms (0.4% of total)

ival-asin: 9.0ms (0.3% of total)

const: 8.0ms (0.3% of total)

ival-fabs: 8.0ms (0.3% of total)

ival-assert: 7.0ms (0.3% of total)

ival-atan: 5.0ms (0.2% of total)

series9.7s (2.1%)

Memory

63.2MiB live, 11 569.0MiB allocated

Counts

2 268 → 56 484

Calls

12231 calls:

Time	Variable		Point	Expression
341.0ms	h	@	0	(* h (* w w))
235.0ms	f	@	inf	(neg (* (/ 1 (/ (PI) 4)) (log (/ 1/2 (* (/ 1 (* 2 (cosh (* (* (PI) 1/4) f)))) (sinh (* (* (PI) 1/4) f)))))))
202.0ms	f	@	inf	(neg (* (/ 1 (/ (PI) 4)) (+ (log 2) (- (log (cosh (* (* (PI) 1/4) f))) (log (* 2 (sinh (* (* (PI) 1/4) f))))))))
138.0ms	d	@	-inf	(/ (* -1/4 (* (* M M) h)) (* (* d d) l))
110.0ms	x	@	-inf	(/ (* (sqrt 2) t) (sqrt (+ (* (neg l) l) (/ (* (+ (* 2 (* t t)) (* l l)) (+ x 1)) (+ x -1)))))

analyze8.7s (1.9%)

Memory

150.9MiB live, 12 122.2MiB allocated

Algorithm

32×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	98.2%	1.8%	0%	0%	0%	0
22.2%	21.8%	76.4%	1.8%	0%	0%	0%	1
22.6%	21.8%	74.8%	1.8%	0%	1.6%	0%	2
28.6%	26.5%	66.3%	1.8%	0%	5.5%	0%	3
32.6%	29.6%	61.2%	1.8%	0%	7.4%	0%	4
35.8%	32.3%	58%	1.8%	0%	8%	0%	5
40.1%	36.1%	54%	1.8%	0%	8.1%	0%	6
45.5%	40.6%	48.7%	1.8%	0%	8.9%	0%	7
47.9%	42.1%	45.8%	1.8%	0%	10.3%	0%	8
51%	44.7%	42.9%	1.8%	0%	10.6%	0%	9
52.2%	45.5%	41.7%	1.8%	0%	11%	0%	10
53.9%	46.8%	39.9%	1.8%	0%	11.5%	0%	11
55.7%	47.9%	38.2%	1.8%	0%	12.2%	0%	12

Compiler

Compiled 798 to 574 computations (28.1% saved)

end0.0ms (0%)

Memory: 0.6MiB live, 0.6MiB allocated

simplify1.7min (22.3%)

sample1.4min (18.3%)

rewrite49.3s (10.8%)

soundness45.1s (9.9%)

eval35.2s (7.7%)

prune32.3s (7.1%)

regimes28.2s (6.2%)

localize28.2s (6.2%)

preprocess14.1s (3.1%)

bsearch10.0s (2.2%)

explain9.9s (2.2%)

series9.7s (2.1%)

analyze8.7s (1.9%)

end0.0ms (0%)

Profiling