Metrics for Herbie run

Date:	Friday, June 28th, 2024
Commit:	698d17c4 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024180
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample2.1min (24.6%)

Memory

646.5MiB live, 135 972.0MiB allocated

Samples

51.5s	434 315×	0	valid
40.7s	7 697×	5	exit
11.9s	29 895×	1	valid
2.8s	6 382×	2	valid
560.0ms	3 916×	0	exit
35.0ms	473×	0	invalid

Precisions

Click to see histograms. Total time spent on operations: 1.5min

ival-sin: 33.1s (36.8% of total)

ival-mult: 16.2s (18.1% of total)

ival-add: 6.8s (7.6% of total)

ival-div: 5.6s (6.3% of total)

...in/eval/compile.rkt:105:19: 4.3s (4.8% of total)

ival-exp: 3.5s (3.9% of total)

adjust: 3.5s (3.9% of total)

ival-hypot: 3.1s (3.4% of total)

ival-sub: 2.9s (3.2% of total)

ival-log: 2.3s (2.5% of total)

ival-cos: 1.6s (1.8% of total)

ival-asin: 1.0s (1.1% of total)

ival-sqrt: 946.0ms (1.1% of total)

ival-atan2: 858.0ms (1% of total)

ival-pow: 626.0ms (0.7% of total)

ival->: 555.0ms (0.6% of total)

ival-pi: 468.0ms (0.5% of total)

ival-<=: 379.0ms (0.4% of total)

ival-acosh: 295.0ms (0.3% of total)

...in/eval/compile.rkt:104:19: 269.0ms (0.3% of total)

ival-true: 255.0ms (0.3% of total)

ival-asinh: 247.0ms (0.3% of total)

ival-neg: 225.0ms (0.3% of total)

ival-fabs: 205.0ms (0.2% of total)

ival-assert: 181.0ms (0.2% of total)

ival-atanh: 133.0ms (0.1% of total)

ival->=: 78.0ms (0.1% of total)

ival-and: 74.0ms (0.1% of total)

Bogosity

simplify1.7min (19.3%)

Memory

1 007.6MiB live, 91 565.3MiB allocated

Algorithm

435×	egg-herbie

Rules

147 671×	`fma-define`
104 631×	`fmm-def`
100 940×	`associate-r`
93 385×	`distribute-lft-in`
80 208×	`distribute-rgt-in`

Stop Event

276×	node limit
151×	saturated
8×	unsound

Counts

98 371 → 93 467

soundness1.1min (12.8%)

Memory

-28.2MiB live, 51 369.9MiB allocated

Rules

65 407×	`fma-define`
57 245×	`log1p-expm1-u`
47 353×	`fmm-def`
46 001×	`associate-r`
41 432×	`expm1-log1p-u`

Stop Event

203×	node limit
35×	fuel
22×	done
19×	saturated
9×	unsound

Compiler

Compiled 51 893 to 13 820 computations (73.4% saved)

rewrite49.5s (9.5%)

Memory

-54.5MiB live, 42 029.1MiB allocated

Algorithm

187×	batch-egg-rewrite

Rules

122 494×	`log1p-expm1-u`
87 328×	`expm1-log1p-u`
39 514×	`pow1`
39 231×	`add-exp-log`
37 321×	`add-log-exp`

Stop Event

180×	node limit
7×	unsound

Counts

2 173 → 61 784

localize36.6s (7%)

Memory

258.7MiB live, 40 500.1MiB allocated

Samples

10.2s	37 519×	0	valid
5.9s	5 033×	1	valid
3.7s	695×	5	exit
2.1s	4 590×	0	invalid
1.4s	978×	2	valid
66.0ms	76×	0	exit
5.0ms	5×	3	valid

Compiler

Compiled 47 635 to 5 412 computations (88.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 17.6s

ival-mult: 4.0s (22.4% of total)

ival-add: 2.0s (11.3% of total)

ival-div: 1.8s (10.2% of total)

...in/eval/compile.rkt:105:19: 1.6s (9% of total)

ival-pow: 1.2s (6.7% of total)

ival-asin: 1.0s (5.9% of total)

ival-log: 948.0ms (5.4% of total)

ival-sqrt: 688.0ms (3.9% of total)

ival-sub: 685.0ms (3.9% of total)

ival-hypot: 624.0ms (3.5% of total)

adjust: 559.0ms (3.2% of total)

ival-exp: 550.0ms (3.1% of total)

ival-cos: 331.0ms (1.9% of total)

ival-pow2: 296.0ms (1.7% of total)

ival-acos: 259.0ms (1.5% of total)

ival-sin: 244.0ms (1.4% of total)

ival-atan2: 204.0ms (1.2% of total)

ival-log1p: 118.0ms (0.7% of total)

ival-cbrt: 112.0ms (0.6% of total)

ival-neg: 101.0ms (0.6% of total)

ival-expm1: 94.0ms (0.5% of total)

ival-copysign: 74.0ms (0.4% of total)

...in/eval/compile.rkt:104:19: 62.0ms (0.4% of total)

ival-true: 41.0ms (0.2% of total)

ival-pi: 38.0ms (0.2% of total)

ival-fabs: 37.0ms (0.2% of total)

ival-assert: 22.0ms (0.1% of total)

ival-e: 4.0ms (0% of total)

prune34.9s (6.7%)

Memory: -1 084.9MiB live, 48 528.7MiB allocated
Counts: 137 535 → 3 063
Compiler: Compiled 124 307 to 68 563 computations (44.8% saved)

eval32.2s (6.2%)

Memory: 361.3MiB live, 39 045.2MiB allocated
Compiler: Compiled 4 226 436 to 545 858 computations (87.1% saved)

series18.6s (3.6%)

Memory

212.2MiB live, 21 349.8MiB allocated

Counts

2 173 → 36 587

Calls

9522 calls:

Time	Variable		Point	Expression
448.0ms	re	@	0	(* 1/2 (pow (exp 1/2) (log (/ (pow im 2) (neg re)))))
392.0ms	re	@	inf	(* (log (sqrt (+ (* re re) (* im im)))) (/ 1 (log base)))
376.0ms	y.re	@	0	(* (/ x.im (sqrt (+ (* y.im y.im) (* y.re y.re)))) (neg y.im))
364.0ms	x.re	@	-inf	(log (* y.re (atan2 x.im x.re)))
307.0ms	base	@	0	(log (+ 1 (log base)))

explain15.6s (3%)

Memory

31.0MiB live, 17 916.6MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`sqrt.f64`	`#f`	oflow-rescue	1139	0
`-.f64`	`#f`	cancellation	807	1
`/.f64`	`#f`	o/o	680	0
`sqrt.f32`	`#f`	oflow-rescue	199	0
`/.f64`	`#f`	o/n	194	0
`sin.f64`	`#f`	sensitivity	182	0
`cos.f64`	`(cos.f64 (+.f64 (.f64 (log.f64 (sqrt.f64 (+.f64 (.f64 x.re x.re) (.f64 x.im x.im)))) y.im) (.f64 (atan2.f64 x.im x.re) y.re)))`	sensitivity	180	0
`+.f64`	`#f`	cancellation	158	2
`sqrt.f64`	`#f`	uflow-rescue	157	0
`log.f64`	`(log.f64 (+.f64 (fabs.f64 x) (sqrt.f64 (+.f64 (*.f64 x x) #s(literal 1 binary64)))))`	sensitivity	141	1
`log.f32`	`(log.f32 (+.f32 (fabs.f32 x) (sqrt.f32 (+.f32 (*.f32 x x) #s(literal 1 binary32)))))`	sensitivity	115	2
`/.f64`	`#f`	n/o	99	0
`-.f64`	`#f`	nan-rescue	84	0
`/.f64`	`#f`	u/u	59	0
`*.f64`	`#f`	*nu**	54	0
`+.f64`	`#f`	nan-rescue	50	0
`*.f64`	`#f`	*no**	39	0
`/.f64`	`#f`	u/n	28	0
`/.f64`	`#f`	n/u	9	0
`log.f32`	`(log.f32 (+.f32 x (sqrt.f32 (-.f32 (*.f32 x x) #s(literal 1 binary32)))))`	oflow-rescue	2	0
↳	`(+.f32 x (sqrt.f32 (-.f32 (*.f32 x x) #s(literal 1 binary32))))`	overflow	2
↳	`(*.f32 x x)`	overflow	133
↳	`(-.f32 (*.f32 x x) #s(literal 1 binary32))`	overflow	133
`*.f64`	`(.f64 (.f64 (sqrt.f64 (*.f64 (PI.f64) #s(literal 2 binary64))) (pow.f64 (+.f64 (+.f64 (-.f64 (-.f64 #s(literal 1 binary64) z) #s(literal 1 binary64)) #s(literal 7 binary64)) #s(literal 1/2 binary64)) (+.f64 (-.f64 (-.f64 #s(literal 1 binary64) z) #s(literal 1 binary64)) #s(literal 1/2 binary64)))) (exp.f64 (neg.f64 (+.f64 (+.f64 (-.f64 (-.f64 #s(literal 1 binary64) z) #s(literal 1 binary64)) #s(literal 7 binary64)) #s(literal 1/2 binary64)))))`	*ou**	2	0
↳	`(.f64 (sqrt.f64 (.f64 (PI.f64) #s(literal 2 binary64))) (pow.f64 (+.f64 (+.f64 (-.f64 (-.f64 #s(literal 1 binary64) z) #s(literal 1 binary64)) #s(literal 7 binary64)) #s(literal 1/2 binary64)) (+.f64 (-.f64 (-.f64 #s(literal 1 binary64) z) #s(literal 1 binary64)) #s(literal 1/2 binary64))))`	overflow	2
↳	`(pow.f64 (+.f64 (+.f64 (-.f64 (-.f64 #s(literal 1 binary64) z) #s(literal 1 binary64)) #s(literal 7 binary64)) #s(literal 1/2 binary64)) (+.f64 (-.f64 (-.f64 #s(literal 1 binary64) z) #s(literal 1 binary64)) #s(literal 1/2 binary64)))`	overflow	2
↳	`(exp.f64 (neg.f64 (+.f64 (+.f64 (-.f64 (-.f64 #s(literal 1 binary64) z) #s(literal 1 binary64)) #s(literal 7 binary64)) #s(literal 1/2 binary64))))`	underflow	2

Confusion

	Predicted +	Predicted -
+	3622	38
-	209	10723

Precision

0.9454450535108326

Recall

0.9896174863387979

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	3622	5	33
-	209	1	10722

Precision?

0.9452697419859265

Recall?

0.990983606557377

Freqs

test

number	freq
0	10761
1	3285
2	545
3	1

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	37	1	0
-	1	0	18

Precision?

0.9743589743589743

Recall?

1.0

Samples

3.3s	25 500×	0	valid
1.3s	3 080×	1	valid
449.0ms	602×	2	valid
0.0ms	2×	3	valid

Compiler

Compiled 15 052 to 2 968 computations (80.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 3.2s

ival-mult: 1.1s (34.2% of total)

ival-add: 310.0ms (9.6% of total)

ival-div: 309.0ms (9.6% of total)

ival-exp: 249.0ms (7.7% of total)

...in/eval/compile.rkt:105:19: 187.0ms (5.8% of total)

ival-log: 175.0ms (5.4% of total)

ival-sub: 173.0ms (5.3% of total)

ival-hypot: 141.0ms (4.4% of total)

adjust: 93.0ms (2.9% of total)

ival-sin: 90.0ms (2.8% of total)

ival-asin: 78.0ms (2.4% of total)

ival-cos: 62.0ms (1.9% of total)

ival-sqrt: 46.0ms (1.4% of total)

ival-atan2: 46.0ms (1.4% of total)

ival-fabs: 39.0ms (1.2% of total)

ival-pow: 27.0ms (0.8% of total)

ival-true: 25.0ms (0.8% of total)

ival-pi: 17.0ms (0.5% of total)

...in/eval/compile.rkt:104:19: 15.0ms (0.5% of total)

ival-neg: 15.0ms (0.5% of total)

ival-copysign: 12.0ms (0.4% of total)

ival-assert: 12.0ms (0.4% of total)

ival-log1p: 10.0ms (0.3% of total)

preprocess13.5s (2.6%)

Memory

-155.4MiB live, 12 638.0MiB allocated

Algorithm

57×	egg-herbie

Rules

20 513×	`fmm-def`
20 193×	`fma-define`
9 595×	`unsub-neg`
9 128×	`sub-neg`
8 864×	`distribute-lft-in`

Stop Event

32×	saturated
25×	node limit

Compiler

Compiled 29 970 to 11 394 computations (62% saved)

regimes12.4s (2.4%)

Memory

-190.4MiB live, 16 348.9MiB allocated

Counts

8 087 → 775

Calls

132 calls:

1.2s	y.re
749.0ms	im
699.0ms	re
644.0ms	x.re
616.0ms	x.im

Compiler

Compiled 6 552 to 4 142 computations (36.8% saved)

bsearch10.2s (1.9%)

Memory

105.6MiB live, 11 762.5MiB allocated

Algorithm

324×	binary-search
44×	left-value

Stop Event

309×	narrow-enough
15×	predicate-same

Samples

5.4s	33 684×	0	valid
1.7s	4 245×	1	valid
173.0ms	247×	2	valid

Compiler

Compiled 74 258 to 50 090 computations (32.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 5.5s

ival-mult: 1.5s (27.9% of total)

ival-add: 617.0ms (11.3% of total)

ival-hypot: 578.0ms (10.6% of total)

ival-exp: 537.0ms (9.8% of total)

ival-log: 488.0ms (8.9% of total)

ival-sub: 403.0ms (7.4% of total)

ival-sin: 390.0ms (7.1% of total)

ival-cos: 237.0ms (4.3% of total)

...in/eval/compile.rkt:105:19: 155.0ms (2.8% of total)

ival-atan2: 154.0ms (2.8% of total)

ival-div: 148.0ms (2.7% of total)

adjust: 99.0ms (1.8% of total)

ival-true: 28.0ms (0.5% of total)

ival-sqrt: 25.0ms (0.5% of total)

ival-copysign: 20.0ms (0.4% of total)

ival-fabs: 20.0ms (0.4% of total)

ival-assert: 15.0ms (0.3% of total)

ival-neg: 13.0ms (0.2% of total)

...in/eval/compile.rkt:104:19: 10.0ms (0.2% of total)

ival-pi: 1.0ms (0% of total)

analyze2.3s (0.4%)

Memory

18.9MiB live, 3 548.7MiB allocated

Algorithm

58×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	86.3%	13.7%	0%	0%	0%	0
55.4%	47.8%	38.5%	13.7%	0%	0%	0%	1
65.9%	55.7%	28.9%	13.7%	0%	1.7%	0%	2
71.2%	58.4%	23.6%	13.7%	0%	4.3%	0%	3
77.4%	62%	18.1%	13.7%	0%	6.2%	0%	4
83.5%	66.8%	13.2%	13.7%	0%	6.3%	0%	5
85.8%	68.3%	11.3%	13.7%	0%	6.6%	0%	6
88.3%	70.3%	9.4%	13.7%	0%	6.6%	0%	7
89.9%	71.5%	8%	13.7%	0%	6.8%	0%	8
91.1%	72.5%	7.1%	13.7%	0%	6.8%	0%	9
92.6%	73.6%	5.9%	13.7%	0%	6.8%	0%	10
94%	74.7%	4.8%	13.7%	0%	6.8%	0%	11
94.5%	75.1%	4.4%	13.7%	0%	6.9%	0%	12

Compiler

Compiled 1 498 to 821 computations (45.2% saved)

end0.0ms (0%)

Memory: 1.0MiB live, 0.9MiB allocated

sample2.1min (24.6%)

simplify1.7min (19.3%)

soundness1.1min (12.8%)

rewrite49.5s (9.5%)

localize36.6s (7%)

prune34.9s (6.7%)

eval32.2s (6.2%)

series18.6s (3.6%)

explain15.6s (3%)

preprocess13.5s (2.6%)

regimes12.4s (2.4%)

bsearch10.2s (1.9%)

analyze2.3s (0.4%)

end0.0ms (0%)

Profiling