Metrics for Herbie run

Date:	Thursday, July 25th, 2024
Commit:	2a1d9f8a on ir-cleanup
Hostname:	nightly with Racket 8.11.1
Seed:	2024207
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample3.5min (24.9%)

Memory

818.0MiB live, 243 840.4MiB allocated

Samples

59.3s	122 120×	1	valid
37.3s	279 884×	0	valid
30.9s	14 418×	5	exit
16.2s	22 959×	2	valid
9.3s	4 208×	3	valid
5.9s	35 084×	0	exit
4.2s	10 854×	1	exit
3.0s	20 830×	0	invalid
2.8s	11 362×	1	invalid
759.0ms	34×	4	exit
488.0ms	24×	3	exit
301.0ms	823×	2	invalid
266.0ms	141×	4	valid
23.0ms	11×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 2.5min

ival-pow: 25.7s (17.4% of total)

ival-mult: 18.7s (12.7% of total)

ival-cos: 18.7s (12.7% of total)

ival-sin: 16.4s (11.1% of total)

ival-div: 12.4s (8.4% of total)

adjust: 9.1s (6.2% of total)

ival-pow2: 8.3s (5.6% of total)

ival-sub: 7.2s (4.8% of total)

ival-add: 6.2s (4.2% of total)

ival-exp: 5.4s (3.7% of total)

ival-log: 4.3s (2.9% of total)

ival-sqrt: 3.7s (2.5% of total)

ival-neg: 2.2s (1.5% of total)

const: 1.9s (1.3% of total)

ival-<: 1.6s (1.1% of total)

ival-hypot: 892.0ms (0.6% of total)

ival-atan2: 850.0ms (0.6% of total)

ival-tan: 534.0ms (0.4% of total)

ival-pi: 523.0ms (0.4% of total)

exact: 505.0ms (0.3% of total)

ival-acos: 491.0ms (0.3% of total)

ival-atan: 390.0ms (0.3% of total)

ival-and: 331.0ms (0.2% of total)

ival-true: 304.0ms (0.2% of total)

ival-cbrt: 270.0ms (0.2% of total)

ival-assert: 221.0ms (0.1% of total)

ival-<=: 208.0ms (0.1% of total)

ival-asin: 139.0ms (0.1% of total)

ival-log1p: 117.0ms (0.1% of total)

ival-fabs: 116.0ms (0.1% of total)

ival-==: 1.0ms (0% of total)

ival-or: 0.0ms (0% of total)

Bogosity

simplify2.4min (17.6%)

Memory

-121.1MiB live, 186 768.9MiB allocated

Algorithm

458×	egg-herbie

Rules

3 470 430×	`lower-fma.f32`
3 469 352×	`lower-fma.f64`
1 733 962×	`lower-*.f32`
1 729 664×	`lower-*.f64`
925 618×	`lower-+.f32`

Stop Event

607×	iter limit
318×	node limit
143×	saturated

Counts

82 788 → 82 133

rewrite1.2min (8.9%)

Memory

832.7MiB live, 102 462.0MiB allocated

Algorithm

203×	batch-egg-rewrite

Rules

895 242×	`lower-fma.f32`
894 184×	`lower-fma.f64`
878 438×	`lower-*.f32`
874 268×	`lower-*.f64`
675 276×	`lower-/.f32`

Stop Event

412×	iter limit
201×	node limit
4×	saturated

Counts

3 370 → 150 675

soundness1.2min (8.5%)

Memory

399.6MiB live, 52 817.0MiB allocated

Rules

2 248 446×	`lower-fma.f32`
2 247 750×	`lower-fma.f64`
1 486 716×	`lower-*.f32`
1 483 528×	`lower-*.f64`
760 296×	`lower-+.f32`

Stop Event

422×	iter limit
283×	node limit
46×	fuel
6×	done
2×	saturated

Compiler

Compiled 50 366 to 25 177 computations (50% saved)

localize1.1min (7.7%)

Memory

145.7MiB live, 87 531.8MiB allocated

Samples

13.9s	12 970×	1	valid
11.1s	4 950×	2	valid
7.5s	28 835×	0	valid
5.2s	788×	5	exit
2.6s	781×	3	valid
1.0s	440×	1	invalid
958.0ms	2 995×	0	invalid
575.0ms	81×	4	exit
310.0ms	72×	4	valid
134.0ms	9×	3	exit
24.0ms	14×	2	invalid
22.0ms	27×	1	exit
15.0ms	5×	2	exit
4.0ms	1×	3	invalid

Compiler

Compiled 94 558 to 8 052 computations (91.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 34.0s

ival-mult: 8.0s (23.4% of total)

ival-sin: 5.4s (16% of total)

ival-cos: 4.9s (14.6% of total)

ival-div: 3.4s (10.1% of total)

adjust: 2.7s (8% of total)

ival-add: 1.9s (5.6% of total)

ival-pow2: 1.2s (3.5% of total)

const: 1.2s (3.4% of total)

ival-sqrt: 912.0ms (2.7% of total)

ival-sub: 823.0ms (2.4% of total)

ival-pow: 453.0ms (1.3% of total)

ival-atan2: 410.0ms (1.2% of total)

ival-neg: 400.0ms (1.2% of total)

ival-log: 383.0ms (1.1% of total)

ival-exp: 352.0ms (1% of total)

ival-atan: 213.0ms (0.6% of total)

ival-cbrt: 184.0ms (0.5% of total)

ival-tan: 171.0ms (0.5% of total)

ival-hypot: 168.0ms (0.5% of total)

ival-log1p: 162.0ms (0.5% of total)

ival-acos: 128.0ms (0.4% of total)

ival-fabs: 120.0ms (0.4% of total)

exact: 116.0ms (0.3% of total)

ival-pi: 93.0ms (0.3% of total)

ival-asin: 52.0ms (0.2% of total)

ival-true: 47.0ms (0.1% of total)

ival-assert: 25.0ms (0.1% of total)

ival-cosh: 7.0ms (0% of total)

ival-tanh: 2.0ms (0% of total)

ival-sinh: 2.0ms (0% of total)

ival-copysign: 2.0ms (0% of total)

eval59.8s (7.2%)

Memory: 758.9MiB live, 81 465.0MiB allocated
Compiler: Compiled 12 880 620 to 800 167 computations (93.8% saved)

prune59.3s (7.1%)

Memory: -1 272.2MiB live, 91 186.0MiB allocated
Counts: 296 215 → 8 227
Compiler: Compiled 669 864 to 294 390 computations (56.1% saved)

regimes52.5s (6.3%)

Memory

128.2MiB live, 72 739.1MiB allocated

Counts

27 336 → 1 013

Calls

155 calls:

3.9s	phi1
3.4s	phi2
2.8s	lambda1
2.6s	lambda2
2.6s	b

Compiler

Compiled 27 780 to 16 602 computations (40.2% saved)

explain22.8s (2.7%)

Memory

-402.1MiB live, 28 920.5MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`cos.f64`	`#f`	sensitivity	1800	3
`+.f64`	`#f`	cancellation	1692	35
`sin.f64`	`#f`	sensitivity	1535	3
`sqrt.f64`	`#f`	oflow-rescue	1422	0
`-.f64`	`#f`	cancellation	949	13
`log.f64`	`#f`	sensitivity	617	0
`-.f64`	`#f`	nan-rescue	511	0
`/.f64`	`#f`	o/n	427	0
`/.f64`	`#f`	u/u	338	0
`/.f64`	`#f`	o/o	290	0
`*.f64`	`#f`	*no**	223	0
`/.f64`	`#f`	u/n	186	0
`sqrt.f64`	`#f`	uflow-rescue	173	0
`exp.f64`	`#f`	sensitivity	165	31
`*.f64`	`#f`	*nu**	112	0
`/.f64`	`#f`	n/o	103	0
`cbrt.f64`	`#f`	oflow-rescue	89	0
`/.f64`	`#f`	n/u	41	0
`*.f64`	`#f`	*uo**	34	0
`cbrt.f64`	`#f`	uflow-rescue	30	0
`*.f64`	`#f`	*ou**	30	0
`acos.f64`	`(acos.f64 (+.f64 (.f64 (sin.f64 phi1) (sin.f64 phi2)) (.f64 (*.f64 (cos.f64 phi1) (cos.f64 phi2)) (cos.f64 (-.f64 lambda1 lambda2)))))`	sensitivity	18	1
`pow.f64`	`#f`	sensitivity	9	2
`pow.f64`	`#f`	uflow-rescue	9	0
`log.f64`	`#f`	oflow-rescue	5	0

Confusion

	Predicted +	Predicted -
+	5719	70
-	1381	6142

Precision

0.8054929577464789

Recall

0.9879081015719468

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5719	45	25
-	1381	31	6111

Precision?

0.8032329988851727

Recall?

0.9956814648471238

Freqs

test

number	freq
0	6212
1	4753
2	1620
3	357
4	214
5	92
6	33
7	22
8	5
9	4

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	42	0	0
-	2	0	8

Precision?

0.9545454545454546

Recall?

1.0

Samples

4.2s	8 024×	1	valid
2.8s	16 278×	0	valid
2.0s	1 914×	2	valid
679.0ms	396×	3	valid
18.0ms	12×	4	valid

Compiler

Compiled 21 748 to 3 336 computations (84.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 7.5s

ival-sin: 1.9s (24.9% of total)

ival-cos: 1.1s (14.7% of total)

ival-mult: 1.0s (13.4% of total)

ival-pow2: 752.0ms (10% of total)

ival-div: 558.0ms (7.4% of total)

adjust: 446.0ms (5.9% of total)

ival-add: 285.0ms (3.8% of total)

ival-sub: 283.0ms (3.8% of total)

ival-exp: 270.0ms (3.6% of total)

ival-log: 236.0ms (3.1% of total)

ival-sqrt: 213.0ms (2.8% of total)

ival-neg: 80.0ms (1.1% of total)

ival-hypot: 79.0ms (1% of total)

ival-tan: 69.0ms (0.9% of total)

ival-atan2: 41.0ms (0.5% of total)

ival-pi: 31.0ms (0.4% of total)

ival-fabs: 31.0ms (0.4% of total)

ival-atan: 26.0ms (0.3% of total)

ival-true: 25.0ms (0.3% of total)

exact: 24.0ms (0.3% of total)

ival-acos: 24.0ms (0.3% of total)

ival-pow: 20.0ms (0.3% of total)

ival-cbrt: 18.0ms (0.2% of total)

ival-assert: 13.0ms (0.2% of total)

ival-asin: 9.0ms (0.1% of total)

ival-log1p: 5.0ms (0.1% of total)

preprocess21.1s (2.5%)

Memory

39.3MiB live, 21 455.7MiB allocated

Algorithm

52×	egg-herbie

Rules

238 304×	`lower-fma.f64`
238 304×	`lower-fma.f32`
81 478×	`lower-*.f32`
81 146×	`lower-*.f64`
46 832×	`unsub-neg`

Stop Event

104×	iter limit
61×	saturated
43×	node limit

Compiler

Compiled 61 550 to 20 086 computations (67.4% saved)

bsearch19.3s (2.3%)

Memory

41.8MiB live, 26 604.9MiB allocated

Algorithm

319×	binary-search
140×	left-value

Stop Event

315×	narrow-enough
4×	predicate-same

Samples

8.8s	12 802×	1	valid
4.2s	23 984×	0	valid
1.6s	1 404×	2	valid
306.0ms	161×	3	valid
119.0ms	1 377×	0	invalid
86.0ms	236×	1	exit
8.0ms	180×	0	exit
0.0ms	1×	4	valid
0.0ms	2×	1	invalid

Compiler

Compiled 113 029 to 76 576 computations (32.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 13.1s

ival-cos: 3.3s (25.4% of total)

ival-sin: 2.9s (22.3% of total)

ival-mult: 1.9s (14.5% of total)

ival-pow2: 1.3s (10.2% of total)

ival-div: 864.0ms (6.6% of total)

adjust: 709.0ms (5.4% of total)

ival-sub: 682.0ms (5.2% of total)

ival-add: 318.0ms (2.4% of total)

ival-sqrt: 220.0ms (1.7% of total)

ival-acos: 198.0ms (1.5% of total)

ival-atan2: 165.0ms (1.3% of total)

ival-neg: 81.0ms (0.6% of total)

ival-atan: 68.0ms (0.5% of total)

ival-exp: 55.0ms (0.4% of total)

ival-pi: 54.0ms (0.4% of total)

ival-hypot: 51.0ms (0.4% of total)

ival-asin: 32.0ms (0.2% of total)

ival-true: 31.0ms (0.2% of total)

exact: 26.0ms (0.2% of total)

ival-tan: 26.0ms (0.2% of total)

ival-assert: 18.0ms (0.1% of total)

ival-log: 9.0ms (0.1% of total)

ival-fabs: 7.0ms (0.1% of total)

ival-log1p: 6.0ms (0% of total)

series17.3s (2.1%)

Memory

64.7MiB live, 22 063.2MiB allocated

Counts

3 370 → 82 788

Calls

16332 calls:

Time	Variable		Point	Expression
350.0ms	lambda2	@	0	(+ (pow (sin (/ (- phi1 phi2) 2)) 2) (* (* (* (cos phi1) (cos phi2)) (sin (/ (- lambda1 lambda2) 2))) (sin (/ (- lambda1 lambda2) 2))))
177.0ms	s	@	0	(/ (pow (+ 1 (/ -1 (+ 1 (exp (neg s))))) c_n) (pow (+ 1 (/ -1 (+ 1 (exp (neg t))))) c_n))
169.0ms	s	@	inf	(/ (* (pow (/ 1 (+ 1 (exp (neg s)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg s))))) c_n)) (* (pow (/ 1 (+ 1 (exp (neg t)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg t))))) c_n)))
144.0ms	b	@	-inf	(/ (* (* 2 (+ (* (* a a) (+ 1/2 (* -1/2 (cos (* angle (* (* 1/180 (PI)) 2)))))) (* (* b b) (+ (* 1/2 (cos (* angle (* (* 1/180 (PI)) 2)))) 1/2)))) (* y-scale -1/2)) (* (* x-scale (cos (* 1/180 (* angle (PI))))) (* (* (+ b a) (- b a)) (sin (* 1/180 (* angle (PI)))))))
138.0ms	t	@	inf	(/ (* (pow (/ 1 (+ 1 (exp (neg s)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg s))))) c_n)) (* (pow (/ 1 (+ 1 (exp (neg t)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg t))))) c_n)))

analyze16.5s (2%)

Memory

-103.9MiB live, 21 970.1MiB allocated

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
17.2%	13.7%	65.7%	20.6%	0%	0%	0%	1
25%	19.6%	58.5%	20.6%	0%	1.3%	0%	2
35.2%	26.6%	48.9%	20.6%	0%	3.8%	0%	3
42.3%	31.7%	43.1%	20.6%	0%	4.5%	0%	4
47.9%	35.6%	38.7%	20.6%	0%	5.1%	0%	5
51%	37.6%	36.1%	20.6%	0%	5.7%	0%	6
54.4%	39.7%	33.2%	20.6%	0%	6.5%	0%	7
56.2%	40.7%	31.8%	20.6%	0%	6.8%	0%	8
59%	42.5%	29.5%	20.6%	0%	7.4%	0%	9
60.3%	43.2%	28.4%	20.6%	0%	7.7%	0%	10
62.1%	44.3%	27%	20.6%	0%	8.1%	0%	11
63.6%	45.1%	25.8%	20.6%	0%	8.5%	0%	12

Compiler

Compiled 1 826 to 990 computations (45.8% saved)

end0.0ms (0%)

Memory: 0.7MiB live, 0.7MiB allocated

sample3.5min (24.9%)

simplify2.4min (17.6%)

rewrite1.2min (8.9%)

soundness1.2min (8.5%)

localize1.1min (7.7%)

eval59.8s (7.2%)

prune59.3s (7.1%)

regimes52.5s (6.3%)

explain22.8s (2.7%)

preprocess21.1s (2.5%)

bsearch19.3s (2.3%)

series17.3s (2.1%)

analyze16.5s (2%)

end0.0ms (0%)

Profiling