Metrics for Herbie run

Date:	Tuesday, July 23rd, 2024
Commit:	4c9fd745 on zane-merge-alt-and-improve
Hostname:	nightly with Racket 8.11.1
Seed:	2024205
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample3.4min (24.4%)

Memory

335.6MiB live, 252 824.3MiB allocated

Samples

58.3s	121 601×	1	valid
38.5s	280 324×	0	valid
29.9s	14 491×	5	exit
17.1s	23 035×	2	valid
8.6s	4 199×	3	valid
5.9s	35 336×	0	exit
4.0s	10 735×	1	exit
3.5s	20 893×	0	invalid
3.2s	11 142×	1	invalid
442.0ms	37×	4	exit
368.0ms	807×	2	invalid
257.0ms	24×	3	exit
204.0ms	153×	4	valid
10.0ms	4×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 2.5min

ival-pow: 24.6s (16.6% of total)

ival-mult: 19.8s (13.4% of total)

ival-cos: 17.3s (11.7% of total)

ival-sin: 16.7s (11.3% of total)

ival-div: 11.8s (7.9% of total)

adjust: 9.5s (6.4% of total)

ival-pow2: 9.1s (6.1% of total)

ival-sub: 6.6s (4.5% of total)

ival-exp: 6.1s (4.1% of total)

ival-add: 5.9s (4% of total)

ival-log: 4.4s (3% of total)

ival-sqrt: 4.1s (2.8% of total)

ival-neg: 2.4s (1.6% of total)

const: 1.9s (1.3% of total)

ival-<: 1.4s (0.9% of total)

ival-atan2: 1.3s (0.9% of total)

ival-pi: 818.0ms (0.6% of total)

ival-hypot: 780.0ms (0.5% of total)

ival-tan: 621.0ms (0.4% of total)

exact: 507.0ms (0.3% of total)

ival-acos: 418.0ms (0.3% of total)

ival-atan: 339.0ms (0.2% of total)

ival-and: 325.0ms (0.2% of total)

ival-true: 309.0ms (0.2% of total)

ival-cbrt: 262.0ms (0.2% of total)

ival-assert: 208.0ms (0.1% of total)

ival-<=: 204.0ms (0.1% of total)

ival-fabs: 185.0ms (0.1% of total)

ival-asin: 161.0ms (0.1% of total)

ival-log1p: 123.0ms (0.1% of total)

ival-==: 1.0ms (0% of total)

ival-or: 0.0ms (0% of total)

Bogosity

simplify2.6min (18.7%)

Memory

-1 019.3MiB live, 207 312.0MiB allocated

Algorithm

460×	egg-herbie

Rules

3 654 744×	`accelerator-lowering-fma.f32`
3 654 744×	`accelerator-lowering-fma.f64`
1 733 034×	`-lowering-.f32`
1 733 034×	`-lowering-.f64`
1 016 160×	`+-lowering-+.f32`

Stop Event

409×	iter limit
324×	node limit
136×	saturated

Counts

83 496 → 83 496

rewrite1.4min (9.7%)

Memory

334.0MiB live, 112 400.8MiB allocated

Algorithm

204×	batch-egg-rewrite

Rules

902 586×	`accelerator-lowering-fma.f32`
902 586×	`accelerator-lowering-fma.f64`
886 384×	`-lowering-.f32`
886 384×	`-lowering-.f64`
698 328×	`/-lowering-/.f32`

Stop Event

213×	iter limit
203×	node limit
1×	saturated

Counts

3 369 → 155 261

soundness1.2min (8.4%)

Memory

411.7MiB live, 54 626.9MiB allocated

Rules

2 268 908×	`accelerator-lowering-fma.f32`
2 268 908×	`accelerator-lowering-fma.f64`
1 516 088×	`-lowering-.f32`
1 516 088×	`-lowering-.f64`
801 086×	`+-lowering-+.f32`

Stop Event

295×	iter limit
290×	node limit
47×	fuel
5×	done

Compiler

Compiled 59 590 to 29 340 computations (50.8% saved)

localize1.1min (7.5%)

Memory

-18.1MiB live, 85 528.4MiB allocated

Samples

15.3s	12 777×	1	valid
9.2s	4 527×	2	valid
8.1s	28 344×	0	valid
6.1s	807×	5	exit
2.1s	4 206×	0	invalid
1.9s	703×	3	valid
559.0ms	97×	4	exit
504.0ms	242×	1	invalid
236.0ms	61×	4	valid
179.0ms	238×	2	exit
103.0ms	85×	1	exit
37.0ms	135×	0	exit
11.0ms	2×	3	exit

Compiler

Compiled 95 217 to 8 176 computations (91.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 34.6s

ival-mult: 8.1s (23.4% of total)

ival-cos: 5.4s (15.7% of total)

ival-sin: 5.2s (15% of total)

ival-div: 3.2s (9.3% of total)

adjust: 2.7s (7.7% of total)

ival-add: 1.8s (5.3% of total)

ival-sub: 1.3s (3.6% of total)

const: 1.2s (3.5% of total)

ival-pow2: 950.0ms (2.7% of total)

ival-sqrt: 847.0ms (2.5% of total)

ival-log: 634.0ms (1.8% of total)

ival-atan2: 525.0ms (1.5% of total)

ival-pow: 491.0ms (1.4% of total)

ival-exp: 339.0ms (1% of total)

ival-neg: 265.0ms (0.8% of total)

ival-log1p: 252.0ms (0.7% of total)

ival-tan: 219.0ms (0.6% of total)

ival-atan: 198.0ms (0.6% of total)

ival-cbrt: 135.0ms (0.4% of total)

ival-hypot: 134.0ms (0.4% of total)

ival-acos: 123.0ms (0.4% of total)

ival-expm1: 123.0ms (0.4% of total)

exact: 119.0ms (0.3% of total)

ival-fabs: 96.0ms (0.3% of total)

ival-pi: 87.0ms (0.3% of total)

ival-true: 50.0ms (0.1% of total)

ival-assert: 23.0ms (0.1% of total)

ival-e: 20.0ms (0.1% of total)

ival-asin: 20.0ms (0.1% of total)

ival-cosh: 6.0ms (0% of total)

ival-sinh: 4.0ms (0% of total)

ival-tanh: 3.0ms (0% of total)

ival-copysign: 3.0ms (0% of total)

eval56.9s (6.8%)

Memory: 1 366.2MiB live, 88 305.2MiB allocated
Compiler: Compiled 13 793 527 to 823 258 computations (94% saved)

prune56.2s (6.7%)

Memory: -658.6MiB live, 94 150.4MiB allocated
Counts: 305 724 → 8 328
Compiler: Compiled 684 796 to 295 929 computations (56.8% saved)

regimes50.8s (6%)

Memory

-163.8MiB live, 74 057.3MiB allocated

Counts

28 056 → 1 162

Calls

155 calls:

3.6s	phi2
3.4s	phi1
3.1s	b
2.9s	lambda1
2.4s	lambda2

Compiler

Compiled 28 023 to 16 713 computations (40.4% saved)

bsearch22.4s (2.7%)

Memory

-168.0MiB live, 28 316.4MiB allocated

Algorithm

358×	binary-search
217×	left-value

Stop Event

346×	narrow-enough
12×	predicate-same

Samples

11.2s	15 916×	1	valid
4.1s	25 031×	0	valid
1.7s	2 439×	2	valid
315.0ms	202×	3	valid
232.0ms	1 581×	0	invalid
159.0ms	122×	1	exit
11.0ms	28×	4	valid
3.0ms	2×	5	exit

Compiler

Compiled 124 192 to 84 595 computations (31.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 15.5s

ival-cos: 4.1s (26.7% of total)

ival-sin: 3.3s (21% of total)

ival-mult: 2.2s (14.1% of total)

ival-pow2: 1.0s (6.7% of total)

adjust: 968.0ms (6.2% of total)

ival-div: 922.0ms (6% of total)

ival-sub: 702.0ms (4.5% of total)

ival-sqrt: 541.0ms (3.5% of total)

ival-add: 462.0ms (3% of total)

ival-atan2: 330.0ms (2.1% of total)

ival-acos: 218.0ms (1.4% of total)

ival-exp: 147.0ms (0.9% of total)

ival-atan: 124.0ms (0.8% of total)

ival-neg: 85.0ms (0.5% of total)

ival-tan: 82.0ms (0.5% of total)

ival-hypot: 74.0ms (0.5% of total)

ival-log: 73.0ms (0.5% of total)

ival-pi: 50.0ms (0.3% of total)

ival-true: 36.0ms (0.2% of total)

exact: 33.0ms (0.2% of total)

ival-assert: 19.0ms (0.1% of total)

ival-fabs: 11.0ms (0.1% of total)

ival-asin: 10.0ms (0.1% of total)

ival-log1p: 3.0ms (0% of total)

explain20.9s (2.5%)

Memory

141.9MiB live, 30 092.0MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`cos.f64`	`#f`	sensitivity	1829	2
`+.f64`	`#f`	cancellation	1708	55
`sin.f64`	`#f`	sensitivity	1577	3
`sqrt.f64`	`#f`	oflow-rescue	1440	0
`-.f64`	`#f`	cancellation	933	6
`log.f64`	`#f`	sensitivity	597	2
`-.f64`	`#f`	nan-rescue	556	0
`/.f64`	`#f`	o/n	488	0
`/.f64`	`#f`	u/u	345	0
`/.f64`	`#f`	o/o	313	0
`*.f64`	`#f`	*no**	228	0
`exp.f64`	`#f`	sensitivity	176	18
`/.f64`	`#f`	u/n	169	0
`sqrt.f64`	`#f`	uflow-rescue	151	0
`*.f64`	`#f`	*nu**	120	0
`/.f64`	`#f`	n/o	105	0
`cbrt.f64`	`#f`	oflow-rescue	97	0
`cbrt.f64`	`#f`	uflow-rescue	43	0
`/.f64`	`#f`	n/u	42	0
`*.f64`	`#f`	*uo**	33	0
`*.f64`	`#f`	*ou**	28	0
`acos.f64`	`(acos.f64 (+.f64 (.f64 (sin.f64 phi1) (sin.f64 phi2)) (.f64 (*.f64 (cos.f64 phi1) (cos.f64 phi2)) (cos.f64 (-.f64 lambda1 lambda2)))))`	sensitivity	17	5
`pow.f64`	`#f`	sensitivity	13	3
`log.f64`	`#f`	oflow-rescue	10	0
`pow.f64`	`#f`	uflow-rescue	7	0
`log.f64`	`(log.f64 (+.f64 (exp.f64 a) (exp.f64 b)))`	uflow-rescue	3	0
↳	`(+.f64 (exp.f64 a) (exp.f64 b))`	underflow	3
↳	`(exp.f64 a)`	underflow	137
↳	`(exp.f64 b)`	underflow	3
`asin.f64`	`(asin.f64 (+.f64 (.f64 (sin.f64 phi1) (cos.f64 delta)) (.f64 (*.f64 (cos.f64 phi1) (sin.f64 delta)) (cos.f64 theta))))`	sensitivity	1	2

Confusion

	Predicted +	Predicted -
+	5785	81
-	1367	6079

Precision

0.8088646532438478

Recall

0.9861916126832595

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5785	49	32
-	1367	42	6037

Precision?

0.8054673477840674

Recall?

0.9945448346403001

Freqs

test

number	freq
0	6160
1	4709
2	1682
3	365
4	226
5	101
6	43
7	18
8	5
9	2
10	1

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	42	1	0
-	2	1	6

Precision?

0.9347826086956522

Recall?

1.0

Samples

4.1s	8 200×	1	valid
2.1s	16 150×	0	valid
2.1s	1 852×	2	valid
602.0ms	414×	3	valid
8.0ms	8×	4	valid

Compiler

Compiled 21 748 to 3 336 computations (84.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 7.0s

ival-sin: 1.4s (20.4% of total)

ival-cos: 1.2s (17.1% of total)

ival-mult: 896.0ms (12.7% of total)

ival-div: 661.0ms (9.4% of total)

ival-pow2: 442.0ms (6.3% of total)

adjust: 436.0ms (6.2% of total)

ival-sub: 383.0ms (5.4% of total)

ival-add: 299.0ms (4.2% of total)

ival-log: 285.0ms (4% of total)

ival-exp: 246.0ms (3.5% of total)

ival-sqrt: 216.0ms (3.1% of total)

ival-neg: 138.0ms (2% of total)

ival-hypot: 63.0ms (0.9% of total)

ival-tan: 57.0ms (0.8% of total)

ival-atan2: 45.0ms (0.6% of total)

ival-pi: 39.0ms (0.6% of total)

ival-pow: 34.0ms (0.5% of total)

ival-atan: 30.0ms (0.4% of total)

ival-acos: 26.0ms (0.4% of total)

ival-true: 26.0ms (0.4% of total)

exact: 24.0ms (0.3% of total)

ival-cbrt: 21.0ms (0.3% of total)

ival-assert: 12.0ms (0.2% of total)

ival-fabs: 10.0ms (0.1% of total)

ival-asin: 9.0ms (0.1% of total)

ival-log1p: 6.0ms (0.1% of total)

preprocess20.7s (2.5%)

Memory

-374.9MiB live, 22 509.4MiB allocated

Algorithm

52×	egg-herbie

Rules

237 718×	`accelerator-lowering-fma.f32`
237 718×	`accelerator-lowering-fma.f64`
81 446×	`-lowering-.f32`
81 446×	`-lowering-.f64`
46 834×	`unsub-neg`

Stop Event

61×	saturated
52×	iter limit
43×	node limit

Compiler

Compiled 68 978 to 19 752 computations (71.4% saved)

series18.9s (2.2%)

Memory

-132.5MiB live, 25 085.4MiB allocated

Counts

3 369 → 83 496

Calls

16794 calls:

Time	Variable		Point	Expression
299.0ms	a	@	0	(+ (* (exp (log (* b (+ 1/2 (* 1/2 (cos (* 2 (* (* angle 1/180) (PI))))))))) b) (* a (* a (- 1/2 (* 1/2 (cos (* 2 (* (* angle 1/180) (PI)))))))))
262.0ms	phi2	@	inf	(* (* (* (cos phi1) (cos phi2)) (sin (/ (- lambda1 lambda2) 2))) (sin (/ (- 2 (* (/ 2 lambda1) lambda2)) (* (/ 2 lambda1) 2))))
259.0ms	a	@	inf	(cbrt (* (/ 1 (* 2 a)) (+ (neg g) (sqrt (- (* g g) (* h h))))))
256.0ms	ew	@	0	(* (* ew (cos t)) (cos (atan (/ (* (neg eh) (tan t)) ew))))
234.0ms	x	@	0	(log (+ (* x (neg x)) (+ (* x x) 1)))

analyze16.4s (1.9%)

Memory

7.9MiB live, 21 786.5MiB allocated

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
17.2%	13.7%	65.7%	20.6%	0%	0%	0%	1
25%	19.6%	58.5%	20.6%	0%	1.3%	0%	2
35.2%	26.6%	48.9%	20.6%	0%	3.8%	0%	3
42.3%	31.7%	43.1%	20.6%	0%	4.5%	0%	4
47.9%	35.6%	38.7%	20.6%	0%	5.1%	0%	5
51%	37.6%	36.1%	20.6%	0%	5.7%	0%	6
54.4%	39.7%	33.2%	20.6%	0%	6.5%	0%	7
56.2%	40.7%	31.8%	20.6%	0%	6.8%	0%	8
59%	42.5%	29.5%	20.6%	0%	7.4%	0%	9
60.3%	43.2%	28.4%	20.6%	0%	7.7%	0%	10
62.1%	44.3%	27%	20.6%	0%	8.1%	0%	11
63.6%	45.1%	25.8%	20.6%	0%	8.5%	0%	12

Compiler

Compiled 1 826 to 990 computations (45.8% saved)

end0.0ms (0%)

Memory: 0.6MiB live, 0.6MiB allocated

sample3.4min (24.4%)

simplify2.6min (18.7%)

rewrite1.4min (9.7%)

soundness1.2min (8.4%)

localize1.1min (7.5%)

eval56.9s (6.8%)

prune56.2s (6.7%)

regimes50.8s (6%)

bsearch22.4s (2.7%)

explain20.9s (2.5%)

preprocess20.7s (2.5%)

series18.9s (2.2%)

analyze16.4s (1.9%)

end0.0ms (0%)

Profiling