Metrics for Herbie run

Date:	Wednesday, July 17th, 2024
Commit:	c34c16ee on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024199
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample3.4min (23.1%)

Memory

261.1MiB live, 246 577.5MiB allocated

Samples

1.0min	121 935×	1	valid
36.4s	280 042×	0	valid
29.0s	14 204×	5	exit
17.6s	22 993×	2	valid
8.1s	4 174×	3	valid
5.6s	35 406×	0	exit
4.0s	10 944×	1	exit
3.6s	21 094×	0	invalid
2.4s	11 448×	1	invalid
444.0ms	29×	4	exit
419.0ms	856×	2	invalid
394.0ms	168×	4	valid
228.0ms	10×	3	exit
19.0ms	10×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 2.4min

ival-pow: 23.3s (16% of total)

ival-mult: 18.4s (12.6% of total)

ival-cos: 17.8s (12.2% of total)

ival-sin: 16.7s (11.5% of total)

ival-div: 12.5s (8.6% of total)

adjust: 10.0s (6.8% of total)

ival-pow2: 9.0s (6.2% of total)

ival-sub: 6.4s (4.4% of total)

ival-add: 6.2s (4.2% of total)

ival-exp: 5.5s (3.8% of total)

ival-log: 4.1s (2.8% of total)

ival-sqrt: 3.9s (2.7% of total)

ival-neg: 2.7s (1.8% of total)

const: 1.5s (1% of total)

ival-<: 1.4s (1% of total)

ival-pi: 807.0ms (0.6% of total)

ival-hypot: 796.0ms (0.5% of total)

ival-atan2: 767.0ms (0.5% of total)

ival-tan: 639.0ms (0.4% of total)

exact: 513.0ms (0.4% of total)

ival-acos: 496.0ms (0.3% of total)

ival-and: 333.0ms (0.2% of total)

ival-true: 305.0ms (0.2% of total)

ival-atan: 294.0ms (0.2% of total)

ival-<=: 282.0ms (0.2% of total)

ival-cbrt: 257.0ms (0.2% of total)

ival-fabs: 235.0ms (0.2% of total)

ival-assert: 211.0ms (0.1% of total)

ival-asin: 148.0ms (0.1% of total)

ival-log1p: 118.0ms (0.1% of total)

ival-==: 1.0ms (0% of total)

ival-or: 0.0ms (0% of total)

Bogosity

simplify2.6min (18.1%)

Memory

-488.3MiB live, 204 353.8MiB allocated

Algorithm

452×	egg-herbie

Rules

3 656 858×	`accelerator-lowering-fma.f32`
3 656 858×	`accelerator-lowering-fma.f64`
1 733 146×	`-lowering-.f32`
1 733 146×	`-lowering-.f64`
973 760×	`+-lowering-+.f32`

Stop Event

401×	iter limit
315×	node limit
137×	saturated

Counts

84 228 → 84 228

rewrite1.4min (9.2%)

Memory

1 031.9MiB live, 114 681.0MiB allocated

Algorithm

200×	batch-egg-rewrite

Rules

893 052×	`accelerator-lowering-fma.f32`
893 052×	`accelerator-lowering-fma.f64`
865 946×	`-lowering-.f32`
865 946×	`-lowering-.f64`
687 866×	`/-lowering-/.f32`

Stop Event

210×	iter limit
199×	node limit
1×	saturated

Counts

3 334 → 155 856

soundness1.1min (7.6%)

Memory

125.4MiB live, 51 468.2MiB allocated

Rules

2 111 298×	`accelerator-lowering-fma.f32`
2 111 298×	`accelerator-lowering-fma.f64`
1 418 438×	`-lowering-.f32`
1 418 438×	`-lowering-.f64`
724 930×	`+-lowering-+.f32`

Stop Event

274×	iter limit
269×	node limit
45×	fuel
7×	done

Compiler

Compiled 52 790 to 25 500 computations (51.7% saved)

localize1.1min (7.4%)

Memory

-3.9MiB live, 88 328.4MiB allocated

Samples

17.0s	13 341×	1	valid
11.4s	4 981×	2	valid
8.0s	27 894×	0	valid
5.1s	722×	5	exit
1.5s	671×	3	valid
1.2s	2 813×	0	invalid
816.0ms	329×	1	invalid
354.0ms	65×	4	exit
199.0ms	51×	4	valid
82.0ms	92×	1	exit
54.0ms	240×	0	exit
4.0ms	1×	3	exit

Compiler

Compiled 97 550 to 8 072 computations (91.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 35.9s

ival-mult: 8.7s (24.3% of total)

ival-sin: 5.9s (16.5% of total)

ival-cos: 5.6s (15.7% of total)

ival-div: 3.4s (9.5% of total)

adjust: 2.9s (8% of total)

ival-add: 2.1s (5.9% of total)

ival-sub: 1.0s (2.9% of total)

const: 1.0s (2.9% of total)

ival-sqrt: 1.0s (2.8% of total)

ival-pow2: 882.0ms (2.5% of total)

ival-pow: 508.0ms (1.4% of total)

ival-atan2: 498.0ms (1.4% of total)

ival-log: 483.0ms (1.3% of total)

ival-neg: 314.0ms (0.9% of total)

ival-exp: 292.0ms (0.8% of total)

ival-tan: 171.0ms (0.5% of total)

ival-cbrt: 166.0ms (0.5% of total)

ival-acos: 159.0ms (0.4% of total)

ival-hypot: 149.0ms (0.4% of total)

exact: 119.0ms (0.3% of total)

ival-atan: 117.0ms (0.3% of total)

ival-fabs: 91.0ms (0.3% of total)

ival-pi: 66.0ms (0.2% of total)

ival-log1p: 54.0ms (0.2% of total)

ival-true: 47.0ms (0.1% of total)

ival-e: 27.0ms (0.1% of total)

ival-assert: 22.0ms (0.1% of total)

ival-asin: 19.0ms (0.1% of total)

ival-copysign: 4.0ms (0% of total)

ival-cosh: 3.0ms (0% of total)

ival-sinh: 2.0ms (0% of total)

ival-tanh: 1.0ms (0% of total)

eval1.1min (7.3%)

Memory: 599.0MiB live, 89 246.5MiB allocated
Compiler: Compiled 14 890 321 to 815 922 computations (94.5% saved)

prune59.4s (6.8%)

Memory: -1 020.1MiB live, 94 107.9MiB allocated
Counts: 312 251 → 8 007
Compiler: Compiled 688 185 to 296 054 computations (57% saved)

bsearch55.9s (6.4%)

Memory

10.9MiB live, 62 445.1MiB allocated

Algorithm

320×	binary-search
184×	left-value

Stop Event

302×	narrow-enough
16×	predicate-same
2×	predicate-failed

Samples

34.4s	6 066×	5	exit
8.3s	11 293×	1	valid
4.6s	26 084×	0	valid
1.4s	1 370×	2	valid
1.0s	190×	4	valid
699.0ms	193×	3	valid
150.0ms	239×	1	exit
140.0ms	1 411×	0	invalid

Compiler

Compiled 111 015 to 74 825 computations (32.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 48.0s

ival-pow: 31.2s (65.1% of total)

ival-sin: 2.9s (6% of total)

ival-cos: 2.7s (5.6% of total)

ival-div: 2.3s (4.7% of total)

ival-mult: 2.1s (4.4% of total)

adjust: 2.1s (4.3% of total)

ival-sub: 1.3s (2.8% of total)

ival-pow2: 1.1s (2.2% of total)

ival-add: 733.0ms (1.5% of total)

ival-exp: 302.0ms (0.6% of total)

ival-sqrt: 294.0ms (0.6% of total)

ival-neg: 227.0ms (0.5% of total)

ival-atan2: 186.0ms (0.4% of total)

ival-pi: 121.0ms (0.3% of total)

ival-acos: 120.0ms (0.3% of total)

ival-hypot: 111.0ms (0.2% of total)

ival-atan: 69.0ms (0.1% of total)

exact: 56.0ms (0.1% of total)

ival-tan: 52.0ms (0.1% of total)

ival-true: 37.0ms (0.1% of total)

ival-assert: 20.0ms (0% of total)

ival-log: 18.0ms (0% of total)

ival-fabs: 12.0ms (0% of total)

ival-log1p: 4.0ms (0% of total)

regimes49.8s (5.7%)

Memory

-2.9MiB live, 62 782.2MiB allocated

Counts

25 829 → 1 077

Calls

155 calls:

3.2s	phi1
3.2s	phi2
2.9s	lambda1
2.9s	b
2.3s	a

Compiler

Compiled 26 997 to 16 145 computations (40.2% saved)

explain22.5s (2.6%)

Memory

-22.5MiB live, 31 327.1MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`cos.f64`	`#f`	sensitivity	1808	1
`+.f64`	`#f`	cancellation	1739	42
`sin.f64`	`#f`	sensitivity	1550	2
`sqrt.f64`	`#f`	oflow-rescue	1416	0
`-.f64`	`#f`	cancellation	982	10
`log.f64`	`#f`	sensitivity	586	2
`-.f64`	`#f`	nan-rescue	524	0
`/.f64`	`#f`	o/n	446	0
`/.f64`	`#f`	u/u	330	0
`/.f64`	`#f`	o/o	291	0
`*.f64`	`#f`	*no**	256	0
`/.f64`	`#f`	u/n	184	0
`sqrt.f64`	`#f`	uflow-rescue	182	0
`exp.f64`	`#f`	sensitivity	140	35
`/.f64`	`#f`	n/o	115	0
`*.f64`	`#f`	*nu**	103	0
`cbrt.f64`	`#f`	oflow-rescue	83	0
`cbrt.f64`	`#f`	uflow-rescue	44	0
`/.f64`	`#f`	n/u	42	0
`*.f64`	`#f`	*uo**	31	0
`*.f64`	`#f`	*ou**	23	0
`acos.f64`	`(acos.f64 (+.f64 (.f64 (sin.f64 phi1) (sin.f64 phi2)) (.f64 (*.f64 (cos.f64 phi1) (cos.f64 phi2)) (cos.f64 (-.f64 lambda1 lambda2)))))`	sensitivity	21	2
`pow.f64`	`#f`	uflow-rescue	12	0
`pow.f64`	`#f`	sensitivity	7	2
`log.f64`	`#f`	oflow-rescue	6	0
`log.f64`	`(log.f64 (+.f64 (exp.f64 a) (exp.f64 b)))`	uflow-rescue	2	0
↳	`(+.f64 (exp.f64 a) (exp.f64 b))`	underflow	2
↳	`(exp.f64 a)`	underflow	129
↳	`(exp.f64 b)`	underflow	2

Confusion

	Predicted +	Predicted -
+	5731	69
-	1377	6135

Precision

0.806274620146314

Recall

0.988103448275862

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5731	48	21
-	1377	40	6095

Precision?

0.8030850472484714

Recall?

0.9963793103448276

Freqs

test

number	freq
0	6204
1	4712
2	1648
3	349
4	233
5	104
6	38
7	12
8	5
9	6
10	1

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	43	0	0
-	3	0	6

Precision?

0.9347826086956522

Recall?

1.0

Samples

4.6s	8 128×	1	valid
2.1s	1 834×	2	valid
2.1s	16 242×	0	valid
603.0ms	400×	3	valid
76.0ms	20×	4	valid

Compiler

Compiled 21 748 to 3 336 computations (84.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 7.3s

ival-sin: 1.5s (20.5% of total)

ival-cos: 1.3s (17.6% of total)

ival-mult: 988.0ms (13.5% of total)

ival-add: 632.0ms (8.6% of total)

ival-div: 599.0ms (8.2% of total)

ival-pow2: 471.0ms (6.4% of total)

adjust: 421.0ms (5.7% of total)

ival-sub: 315.0ms (4.3% of total)

ival-exp: 239.0ms (3.3% of total)

ival-log: 195.0ms (2.7% of total)

ival-sqrt: 166.0ms (2.3% of total)

ival-neg: 106.0ms (1.4% of total)

ival-pow: 91.0ms (1.2% of total)

ival-tan: 45.0ms (0.6% of total)

ival-atan2: 41.0ms (0.6% of total)

ival-hypot: 35.0ms (0.5% of total)

ival-pi: 34.0ms (0.5% of total)

ival-atan: 26.0ms (0.4% of total)

exact: 25.0ms (0.3% of total)

ival-true: 25.0ms (0.3% of total)

ival-acos: 22.0ms (0.3% of total)

ival-cbrt: 20.0ms (0.3% of total)

ival-asin: 12.0ms (0.2% of total)

ival-assert: 12.0ms (0.2% of total)

ival-fabs: 10.0ms (0.1% of total)

ival-log1p: 5.0ms (0.1% of total)

preprocess18.4s (2.1%)

Memory

-140.8MiB live, 23 036.1MiB allocated

Algorithm

104×	egg-herbie

Rules

237 718×	`accelerator-lowering-fma.f32`
237 718×	`accelerator-lowering-fma.f64`
81 446×	`-lowering-.f32`
81 446×	`-lowering-.f64`
46 320×	`unsub-neg`

Stop Event

60×	saturated
52×	iter limit
44×	node limit

Compiler

Compiled 64 932 to 19 968 computations (69.2% saved)

series17.4s (2%)

Memory

129.5MiB live, 23 864.5MiB allocated

Counts

3 334 → 84 228

Calls

16845 calls:

Time	Variable		Point	Expression
213.0ms	s	@	inf	(/ (* (pow (/ 1 (+ 1 (exp (neg s)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg s))))) c_n)) (* (pow (/ 1 (+ 1 (exp (neg t)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg t))))) c_n)))
143.0ms	c	@	inf	(* (pow a 4) (* (pow c 4) 405/64))
136.0ms	x	@	inf	(log (/ 2 x))
111.0ms	t	@	inf	(/ (* (pow (/ 1 (+ 1 (exp (neg s)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg s))))) c_n)) (* (pow (/ 1 (+ 1 (exp (neg t)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg t))))) c_n)))
109.0ms	x-scale	@	0	(/ (* -1/2 (* y-scale (+ (* (* a a) (pow (sin (* 1/180 (* angle (PI)))) 2)) (+ (* (* b b) (pow (cos (* 1/180 (* angle (PI)))) 2)) (* b b))))) (* x-scale (* (cos (* 1/180 (* angle (PI)))) (* (sin (* 1/180 (* angle (PI)))) (- (* b b) (* a a))))))

analyze16.3s (1.9%)

Memory

131.0MiB live, 20 798.1MiB allocated

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
17.2%	13.7%	65.7%	20.6%	0%	0%	0%	1
25%	19.6%	58.5%	20.6%	0%	1.3%	0%	2
35.2%	26.6%	48.9%	20.6%	0%	3.8%	0%	3
42.3%	31.7%	43.1%	20.6%	0%	4.5%	0%	4
47.9%	35.6%	38.7%	20.6%	0%	5.1%	0%	5
51%	37.6%	36.1%	20.6%	0%	5.7%	0%	6
54.4%	39.7%	33.2%	20.6%	0%	6.5%	0%	7
56.2%	40.7%	31.8%	20.6%	0%	6.8%	0%	8
59%	42.5%	29.5%	20.6%	0%	7.4%	0%	9
60.3%	43.2%	28.4%	20.6%	0%	7.7%	0%	10
62.1%	44.3%	27%	20.6%	0%	8.1%	0%	11
63.6%	45.1%	25.8%	20.6%	0%	8.5%	0%	12

Compiler

Compiled 1 826 to 990 computations (45.8% saved)

end0.0ms (0%)

Memory: 1.9MiB live, 1.8MiB allocated

sample3.4min (23.1%)

simplify2.6min (18.1%)

rewrite1.4min (9.2%)

soundness1.1min (7.6%)

localize1.1min (7.4%)

eval1.1min (7.3%)

prune59.4s (6.8%)

bsearch55.9s (6.4%)

regimes49.8s (5.7%)

explain22.5s (2.6%)

preprocess18.4s (2.1%)

series17.4s (2%)

analyze16.3s (1.9%)

end0.0ms (0%)

Profiling