Metrics for Herbie run

Date:	Saturday, June 29th, 2024
Commit:	e9990e25 on zane-job-abstraction5
Hostname:	nightly with Racket 8.11.1
Seed:	2024181
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample2.1min (25.1%)

Memory

-119.8MiB live, 141 689.0MiB allocated

Samples

50.7s	434 143×	0	valid
39.3s	3 796×	5	exit
12.1s	30 289×	1	valid
2.2s	6 196×	2	valid
1.1s	9 068×	0	exit
44.0ms	579×	0	invalid

Precisions

Click to see histograms. Total time spent on operations: 1.4min

ival-sin: 33.9s (39.3% of total)

ival-mult: 15.6s (18% of total)

ival-add: 6.1s (7% of total)

...in/eval/compile.rkt:111:19: 5.1s (6% of total)

ival-div: 4.7s (5.4% of total)

ival-exp: 3.7s (4.3% of total)

adjust: 2.6s (3% of total)

ival-hypot: 2.2s (2.5% of total)

ival-sub: 2.1s (2.5% of total)

ival-log: 1.9s (2.2% of total)

ival-sqrt: 1.5s (1.7% of total)

ival-cos: 1.2s (1.4% of total)

ival-asin: 1.1s (1.2% of total)

ival-atan2: 861.0ms (1% of total)

ival-pi: 534.0ms (0.6% of total)

ival-pow: 464.0ms (0.5% of total)

ival-asinh: 377.0ms (0.4% of total)

ival->: 370.0ms (0.4% of total)

ival-acosh: 301.0ms (0.3% of total)

ival-true: 283.0ms (0.3% of total)

...in/eval/compile.rkt:110:19: 278.0ms (0.3% of total)

ival-neg: 242.0ms (0.3% of total)

ival-atanh: 241.0ms (0.3% of total)

ival-fabs: 195.0ms (0.2% of total)

ival-assert: 186.0ms (0.2% of total)

ival-<=: 175.0ms (0.2% of total)

ival->=: 73.0ms (0.1% of total)

ival-and: 71.0ms (0.1% of total)

Bogosity

simplify1.6min (19%)

Memory

460.9MiB live, 89 807.1MiB allocated

Algorithm

440×	egg-herbie

Rules

158 795×	`fma-define`
118 444×	`fmm-def`
95 907×	`distribute-lft-in`
82 810×	`distribute-rgt-in`
82 189×	`associate-r`

Stop Event

295×	node limit
137×	saturated
8×	unsound

Counts

97 126 → 93 942

soundness55.2s (10.9%)

Memory

-289.8MiB live, 48 089.6MiB allocated

Rules

60 175×	`fma-define`
52 232×	`log1p-expm1-u`
46 823×	`fmm-def`
42 853×	`associate-r`
35 890×	`distribute-lft-in`

Stop Event

188×	node limit
39×	fuel
20×	saturated
18×	done
9×	unsound

Compiler

Compiled 45 609 to 12 936 computations (71.6% saved)

rewrite50.4s (10%)

Memory

-158.6MiB live, 40 402.7MiB allocated

Algorithm

190×	batch-egg-rewrite

Rules

126 068×	`log1p-expm1-u`
86 301×	`expm1-log1p-u`
40 358×	`pow1`
39 496×	`add-exp-log`
38 303×	`add-log-exp`

Stop Event

181×	node limit
9×	unsound

Counts

2 177 → 59 759

localize38.2s (7.5%)

Memory

64.7MiB live, 42 521.2MiB allocated

Samples

12.0s	38 130×	0	valid
4.3s	4 202×	1	valid
3.4s	722×	5	exit
2.5s	4 581×	0	invalid
2.3s	1 494×	2	valid
139.0ms	204×	0	exit
56.0ms	48×	1	invalid
24.0ms	24×	3	valid
4.0ms	3×	1	exit

Compiler

Compiled 51 584 to 5 661 computations (89% saved)

Precisions

Click to see histograms. Total time spent on operations: 19.0s

ival-mult: 4.2s (22.3% of total)

ival-add: 2.7s (14.5% of total)

ival-div: 1.7s (8.8% of total)

...in/eval/compile.rkt:111:19: 1.5s (7.9% of total)

ival-pow: 1.5s (7.9% of total)

ival-log: 1.3s (6.8% of total)

ival-hypot: 1.0s (5.3% of total)

ival-exp: 807.0ms (4.3% of total)

adjust: 705.0ms (3.7% of total)

ival-sin: 507.0ms (2.7% of total)

ival-sub: 440.0ms (2.3% of total)

ival-cos: 422.0ms (2.2% of total)

ival-pow2: 339.0ms (1.8% of total)

ival-sqrt: 262.0ms (1.4% of total)

ival-acos: 253.0ms (1.3% of total)

ival-expm1: 251.0ms (1.3% of total)

ival-asin: 232.0ms (1.2% of total)

ival-atan2: 150.0ms (0.8% of total)

ival-log1p: 145.0ms (0.8% of total)

ival-neg: 134.0ms (0.7% of total)

ival-cbrt: 73.0ms (0.4% of total)

ival-copysign: 71.0ms (0.4% of total)

...in/eval/compile.rkt:110:19: 66.0ms (0.3% of total)

ival-fabs: 64.0ms (0.3% of total)

ival-true: 44.0ms (0.2% of total)

ival-pi: 34.0ms (0.2% of total)

ival-assert: 20.0ms (0.1% of total)

ival-e: 3.0ms (0% of total)

prune35.2s (7%)

Memory: -556.3MiB live, 51 088.1MiB allocated
Counts: 145 311 → 3 190
Compiler: Compiled 144 828 to 74 909 computations (48.3% saved)

eval33.0s (6.5%)

Memory: 627.0MiB live, 41 054.0MiB allocated
Compiler: Compiled 4 774 544 to 588 513 computations (87.7% saved)

series16.9s (3.3%)

Memory

707.5MiB live, 21 261.9MiB allocated

Counts

2 177 → 37 367

Calls

9588 calls:

Time	Variable		Point	Expression
401.0ms	beta	@	0	(/ (* (* i (+ (+ alpha beta) i)) (+ (* beta alpha) (* i i))) (* (+ (+ alpha beta) (* 2 i)) (+ (+ alpha beta) (* 2 i))))
196.0ms	y.re	@	inf	(log (sin (+ (* (log (sqrt (+ (* x.im x.im) (* x.re x.re)))) y.im) (* y.re (atan2 x.im x.re)))))
187.0ms	im	@	-inf	(/ 1 (log (pow base (/ 1 (atan2 im re)))))
186.0ms	x.im	@	inf	(pow (exp (atan2 x.im x.re)) y.im)
166.0ms	x	@	0	(log (+ x x))

explain15.1s (3%)

Memory

-32.0MiB live, 18 708.6MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`sqrt.f64`	`#f`	oflow-rescue	1200	0
`-.f64`	`#f`	cancellation	764	0
`/.f64`	`#f`	o/o	656	0
`sqrt.f32`	`#f`	oflow-rescue	216	0
`/.f64`	`#f`	o/n	199	0
`sin.f64`	`#f`	sensitivity	185	0
`cos.f64`	`(cos.f64 (+.f64 (.f64 (log.f64 (sqrt.f64 (+.f64 (.f64 x.re x.re) (.f64 x.im x.im)))) y.im) (.f64 (atan2.f64 x.im x.re) y.re)))`	sensitivity	177	0
`+.f64`	`#f`	cancellation	155	0
`sqrt.f64`	`#f`	uflow-rescue	147	0
`log.f64`	`(log.f64 (+.f64 (fabs.f64 x) (sqrt.f64 (+.f64 (*.f64 x x) #s(literal 1 binary64)))))`	sensitivity	132	0
`log.f32`	`(log.f32 (+.f32 (fabs.f32 x) (sqrt.f32 (+.f32 (*.f32 x x) #s(literal 1 binary32)))))`	sensitivity	122	0
`/.f64`	`#f`	n/o	112	0
`-.f64`	`#f`	nan-rescue	96	0
`*.f64`	`#f`	*nu**	62	0
`/.f64`	`#f`	u/u	59	0
`+.f64`	`#f`	nan-rescue	59	0
`/.f64`	`#f`	u/n	40	0
`*.f64`	`#f`	*no**	29	0
`/.f64`	`#f`	n/u	8	0
`*.f64`	`(.f64 (.f64 (sqrt.f64 (*.f64 (PI.f64) #s(literal 2 binary64))) (pow.f64 (+.f64 (+.f64 (-.f64 (-.f64 #s(literal 1 binary64) z) #s(literal 1 binary64)) #s(literal 7 binary64)) #s(literal 1/2 binary64)) (+.f64 (-.f64 (-.f64 #s(literal 1 binary64) z) #s(literal 1 binary64)) #s(literal 1/2 binary64)))) (exp.f64 (neg.f64 (+.f64 (+.f64 (-.f64 (-.f64 #s(literal 1 binary64) z) #s(literal 1 binary64)) #s(literal 7 binary64)) #s(literal 1/2 binary64)))))`	*ou**	8	0
↳	`(.f64 (sqrt.f64 (.f64 (PI.f64) #s(literal 2 binary64))) (pow.f64 (+.f64 (+.f64 (-.f64 (-.f64 #s(literal 1 binary64) z) #s(literal 1 binary64)) #s(literal 7 binary64)) #s(literal 1/2 binary64)) (+.f64 (-.f64 (-.f64 #s(literal 1 binary64) z) #s(literal 1 binary64)) #s(literal 1/2 binary64))))`	overflow	8
↳	`(pow.f64 (+.f64 (+.f64 (-.f64 (-.f64 #s(literal 1 binary64) z) #s(literal 1 binary64)) #s(literal 7 binary64)) #s(literal 1/2 binary64)) (+.f64 (-.f64 (-.f64 #s(literal 1 binary64) z) #s(literal 1 binary64)) #s(literal 1/2 binary64)))`	overflow	8
↳	`(exp.f64 (neg.f64 (+.f64 (+.f64 (-.f64 (-.f64 #s(literal 1 binary64) z) #s(literal 1 binary64)) #s(literal 7 binary64)) #s(literal 1/2 binary64))))`	underflow	8
`log.f32`	`#f`	oflow-rescue	2	0
`exp.f64`	`#f`	sensitivity	2	0
`cos.f64`	`(cos.f64 (+.f64 (.f64 (log.f64 (sqrt.f64 (+.f64 (.f64 x.re x.re) (.f64 x.im x.im)))) y.im) (.f64 (atan2.f64 x.im x.re) y.re)))`	oflow-rescue	1	0
↳	`(+.f64 (.f64 (log.f64 (sqrt.f64 (+.f64 (.f64 x.re x.re) (.f64 x.im x.im)))) y.im) (.f64 (atan2.f64 x.im x.re) y.re))`	overflow	1
↳	`(*.f64 x.re x.re)`	overflow	66
↳	`(+.f64 (.f64 x.re x.re) (.f64 x.im x.im))`	overflow	106
↳	`(.f64 (log.f64 (sqrt.f64 (+.f64 (.f64 x.re x.re) (*.f64 x.im x.im)))) y.im)`	overflow	1
↳	`(*.f64 x.im x.im)`	overflow	57
`sin.f64`	`(sin.f64 (+.f64 (.f64 (log.f64 (sqrt.f64 (+.f64 (.f64 x.re x.re) (.f64 x.im x.im)))) y.im) (.f64 (atan2.f64 x.im x.re) y.re)))`	oflow-rescue	1	0
↳	`(+.f64 (.f64 (log.f64 (sqrt.f64 (+.f64 (.f64 x.re x.re) (.f64 x.im x.im)))) y.im) (.f64 (atan2.f64 x.im x.re) y.re))`	overflow	1
↳	`(*.f64 x.re x.re)`	overflow	66
↳	`(+.f64 (.f64 x.re x.re) (.f64 x.im x.im))`	overflow	106
↳	`(.f64 (log.f64 (sqrt.f64 (+.f64 (.f64 x.re x.re) (*.f64 x.im x.im)))) y.im)`	overflow	1
↳	`(*.f64 x.im x.im)`	overflow	57

Confusion

	Predicted +	Predicted -
+	3691	33
-	181	10687

Precision

0.953254132231405

Recall

0.9911385606874329

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	3691	0	33
-	181	0	10687

Precision?

0.953254132231405

Recall?

0.9911385606874329

Freqs

test

number	freq
0	10720
1	3318
2	548
3	6

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	37	0	0
-	0	0	20

Precision?

1.0

Recall?

1.0

Samples

3.1s	25 620×	0	valid
1.5s	2 972×	1	valid
339.0ms	584×	2	valid
2.0ms	8×	3	valid

Compiler

Compiled 15 052 to 2 968 computations (80.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 3.6s

ival-mult: 1.2s (33% of total)

ival-add: 479.0ms (13.4% of total)

ival-log: 408.0ms (11.4% of total)

ival-div: 235.0ms (6.6% of total)

ival-exp: 232.0ms (6.5% of total)

...in/eval/compile.rkt:111:19: 193.0ms (5.4% of total)

adjust: 148.0ms (4.1% of total)

ival-hypot: 147.0ms (4.1% of total)

ival-sub: 107.0ms (3% of total)

ival-sqrt: 78.0ms (2.2% of total)

ival-asin: 63.0ms (1.8% of total)

ival-sin: 60.0ms (1.7% of total)

ival-atan2: 53.0ms (1.5% of total)

ival-cos: 51.0ms (1.4% of total)

ival-true: 27.0ms (0.8% of total)

ival-fabs: 20.0ms (0.6% of total)

ival-pow: 18.0ms (0.5% of total)

...in/eval/compile.rkt:110:19: 15.0ms (0.4% of total)

ival-pi: 15.0ms (0.4% of total)

ival-assert: 12.0ms (0.3% of total)

ival-neg: 11.0ms (0.3% of total)

ival-copysign: 11.0ms (0.3% of total)

ival-log1p: 8.0ms (0.2% of total)

regimes12.6s (2.5%)

Memory

-19.7MiB live, 15 414.9MiB allocated

Counts

8 431 → 834

Calls

132 calls:

1.4s	y.im
1.1s	im
721.0ms	x.im
651.0ms	y.re
618.0ms	x.re

Compiler

Compiled 6 221 to 3 876 computations (37.7% saved)

preprocess12.6s (2.5%)

Memory

-169.8MiB live, 12 964.0MiB allocated

Algorithm

57×	egg-herbie

Rules

20 513×	`fmm-def`
20 193×	`fma-define`
9 595×	`unsub-neg`
9 128×	`sub-neg`
8 864×	`distribute-lft-in`

Stop Event

32×	saturated
25×	node limit

Compiler

Compiled 33 906 to 12 134 computations (64.2% saved)

bsearch10.7s (2.1%)

Memory

206.7MiB live, 12 698.6MiB allocated

Algorithm

353×	binary-search
57×	left-value

Stop Event

345×	narrow-enough
8×	predicate-same

Samples

5.8s	38 823×	0	valid
1.4s	3 431×	1	valid
115.0ms	434×	2	valid

Compiler

Compiled 84 676 to 57 263 computations (32.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 5.4s

ival-mult: 1.5s (27.2% of total)

ival-cos: 519.0ms (9.6% of total)

ival-hypot: 488.0ms (9% of total)

ival-add: 482.0ms (8.9% of total)

ival-sin: 413.0ms (7.6% of total)

ival-sub: 408.0ms (7.5% of total)

ival-exp: 339.0ms (6.3% of total)

ival-log: 258.0ms (4.8% of total)

ival-atan2: 255.0ms (4.7% of total)

ival-div: 251.0ms (4.6% of total)

...in/eval/compile.rkt:111:19: 133.0ms (2.5% of total)

ival-copysign: 109.0ms (2% of total)

adjust: 73.0ms (1.4% of total)

ival-sqrt: 65.0ms (1.2% of total)

ival-fabs: 62.0ms (1.1% of total)

ival-true: 33.0ms (0.6% of total)

ival-neg: 18.0ms (0.3% of total)

ival-assert: 16.0ms (0.3% of total)

...in/eval/compile.rkt:110:19: 12.0ms (0.2% of total)

ival-pow: 3.0ms (0.1% of total)

ival-pi: 1.0ms (0% of total)

analyze2.5s (0.5%)

Memory

157.6MiB live, 3 528.7MiB allocated

Algorithm

58×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	86.3%	13.7%	0%	0%	0%	0
55.4%	47.8%	38.5%	13.7%	0%	0%	0%	1
65.9%	55.7%	28.9%	13.7%	0%	1.7%	0%	2
71.2%	58.4%	23.6%	13.7%	0%	4.3%	0%	3
77.4%	62%	18.1%	13.7%	0%	6.2%	0%	4
83.5%	66.8%	13.2%	13.7%	0%	6.3%	0%	5
85.8%	68.3%	11.3%	13.7%	0%	6.6%	0%	6
88.3%	70.3%	9.4%	13.7%	0%	6.6%	0%	7
89.9%	71.5%	8%	13.7%	0%	6.8%	0%	8
91.1%	72.5%	7.1%	13.7%	0%	6.8%	0%	9
92.6%	73.6%	5.9%	13.7%	0%	6.8%	0%	10
94%	74.7%	4.8%	13.7%	0%	6.8%	0%	11
94.5%	75.1%	4.4%	13.7%	0%	6.9%	0%	12

Compiler

Compiled 1 498 to 821 computations (45.2% saved)

end0.0ms (0%)

Memory: 1.1MiB live, 1.1MiB allocated

sample2.1min (25.1%)

simplify1.6min (19%)

soundness55.2s (10.9%)

rewrite50.4s (10%)

localize38.2s (7.5%)

prune35.2s (7%)

eval33.0s (6.5%)

series16.9s (3.3%)

explain15.1s (3%)

regimes12.6s (2.5%)

preprocess12.6s (2.5%)

bsearch10.7s (2.1%)

analyze2.5s (0.5%)

end0.0ms (0%)

Profiling