Metrics for Herbie run

Date:	Thursday, November 21st, 2024
Commit:	d1b0bfd6 on main
Hostname:	nightly with Racket 8.10
Seed:	2024326
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample5.6min (20.5%)

Memory

825.1MiB live, 332 138.0MiB allocated

Samples

3.3min	2 146 651×	0	valid
22.7s	68 037×	1	valid
10.9s	64 064×	0	invalid
2.0s	5 596×	2	valid
1.2s	1 175×	5	exit
464.0ms	1 700×	1	invalid
197.0ms	372×	4	exit
177.0ms	576×	3	valid
1.0ms	13×	1	exit
1.0ms	4×	4	valid

Precisions

Click to see histograms. Total time spent on operations: 2.4min

ival-mult: 45.6s (31.9% of total)

ival-sub: 20.4s (14.2% of total)

ival-add: 19.8s (13.8% of total)

ival-div: 17.9s (12.5% of total)

ival-log: 9.5s (6.6% of total)

const: 6.6s (4.6% of total)

ival-sqrt: 5.5s (3.8% of total)

ival-sin: 3.9s (2.7% of total)

adjust: 3.1s (2.2% of total)

ival-cos: 3.1s (2.2% of total)

ival-exp: 2.2s (1.5% of total)

ival-true: 1.7s (1.2% of total)

exact: 1.1s (0.8% of total)

ival-assert: 964.0ms (0.7% of total)

ival-tan: 372.0ms (0.3% of total)

ival-cosh: 335.0ms (0.2% of total)

ival-hypot: 288.0ms (0.2% of total)

ival-sinh: 282.0ms (0.2% of total)

ival-acos: 197.0ms (0.1% of total)

ival-fabs: 184.0ms (0.1% of total)

ival-tanh: 92.0ms (0.1% of total)

Bogosity

simplify5.0min (18.2%)

Memory

2 617.6MiB live, 242 178.3MiB allocated

Algorithm

2 179×

egg-herbie

Stop Event

2 862×	iter limit
1 461×	node limit
729×	saturated
6×	unsound

Counts

73 684 → 72 524

soundness4.4min (16%)

Memory

-216.0MiB live, 142 997.6MiB allocated

Stop Event

1 427×	iter limit
975×	node limit
157×	fuel
112×	done
24×	saturated
7×	unsound

Compiler

Compiled 226 458 to 91 205 computations (59.7% saved)

rewrite3.8min (13.9%)

Memory

-451.4MiB live, 202 049.2MiB allocated

Stop Event

1 988×	iter limit
914×	node limit
30×	unsound
18×	saturated

Counts

12 008 → 355 752

localize1.8min (6.7%)

Memory

-1 129.4MiB live, 109 435.0MiB allocated

Samples

58.2s	217 821×	0	valid
14.6s	13 017×	1	valid
4.8s	3 130×	2	valid
4.2s	8 971×	0	invalid
1.1s	612×	5	exit
297.0ms	610×	0	exit
279.0ms	17×	4	valid
244.0ms	241×	3	valid
65.0ms	54×	2	exit
3.0ms	7×	1	exit

Compiler

Compiled 148 614 to 23 907 computations (83.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 59.8s

ival-mult: 20.6s (34.5% of total)

ival-add: 8.6s (14.3% of total)

ival-div: 8.2s (13.6% of total)

ival-sub: 4.6s (7.7% of total)

const: 4.4s (7.4% of total)

adjust: 2.3s (3.8% of total)

ival-log: 2.1s (3.5% of total)

ival-pow: 1.7s (2.8% of total)

ival-sin: 1.4s (2.4% of total)

ival-neg: 1.3s (2.2% of total)

ival-sqrt: 1.0s (1.7% of total)

ival-cos: 980.0ms (1.6% of total)

ival-exp: 563.0ms (0.9% of total)

ival-pow2: 481.0ms (0.8% of total)

ival-cosh: 348.0ms (0.6% of total)

exact: 251.0ms (0.4% of total)

ival-true: 222.0ms (0.4% of total)

ival-sinh: 213.0ms (0.4% of total)

ival-assert: 106.0ms (0.2% of total)

ival-hypot: 86.0ms (0.1% of total)

ival-acos: 75.0ms (0.1% of total)

ival-fabs: 70.0ms (0.1% of total)

ival-expm1: 61.0ms (0.1% of total)

ival-tan: 46.0ms (0.1% of total)

ival-log1p: 39.0ms (0.1% of total)

ival-asin: 39.0ms (0.1% of total)

ival-pi: 23.0ms (0% of total)

ival-asinh: 13.0ms (0% of total)

ival-tanh: 13.0ms (0% of total)

eval1.5min (5.4%)

Memory: -315.8MiB live, 98 433.1MiB allocated
Compiler: Compiled 16 680 474 to 1 580 957 computations (90.5% saved)

regimes1.2min (4.5%)

Memory

-527.7MiB live, 79 912.1MiB allocated

Counts

32 196 → 4 701

Calls

509 calls:

11.7s	x
9.6s	y
7.5s	z
5.2s	t
2.8s	a

Compiler

Compiled 37 458 to 56 928 computations (-52% saved)

preprocess55.5s (3.4%)

Memory

1 390.4MiB live, 54 139.9MiB allocated

Algorithm

269×	egg-herbie

Stop Event

536×	iter limit
398×	saturated
142×	node limit

Compiler

Compiled 320 534 to 60 430 computations (81.1% saved)

series54.9s (3.4%)

Memory

208.3MiB live, 59 316.3MiB allocated

Counts

12 008 → 73 684

Calls

9087 calls:

Time	Variable		Point	Expression
485.0ms	z	@	0	((+ (* x -3) (* (* z 6) x)) (+ x (* (* (- y x) 6) (- (/ 2 3) z))) (+ (* (- y x) (+ (* -6 z) 4)) x) (* (* z 6) x) (+ x (* (* (- y x) 6) (- (/ 2 3) z))) (+ (* (- y x) 4) x) (* 4 y) (+ x (* (* (- y x) 6) (- (/ 2 3) z))) (+ (* (- y x) (+ (* -6 z) 4)) x) (* (+ (* z 6) -3) x) (+ (* z 6) -3) (+ x (* (* (- y x) 6) (- (/ 2 3) z))) (+ (* -3 x) (* 4 y)) (+ x (* (* (- y x) 6) (- (/ 2 3) z))) (* (* -6 (- y x)) z) (* -6 (- y x)) (- y x))
315.0ms	t	@	0	((* (pow (* z 2) 1/4) (* (pow (* z 2) 1/4) (- (* 1/2 x) y))) (exp (/ (* t t) 2)) (* (* (pow (* z 2) 1/4) (* (pow (* z 2) 1/4) (- (* 1/2 x) y))) (exp (/ (* t t) 2))) (pow (* z 2) 1/4) (* (* (- (* x 1/2) y) (sqrt (* z 2))) (exp (/ (* t t) 2))) (* (- (* x 1/2) y) (sqrt (* z 2))) (- (* x 1/2) y) (neg y) (* (* (- (* x 1/2) y) (sqrt (* z 2))) (exp (/ (* t t) 2))) (* (- (* x 1/2) y) (sqrt (* z 2))) (- (* x 1/2) y) (* (- (* (/ x y) 1/2) 1) y) (* (* (- (* x 1/2) y) (sqrt (* z 2))) (exp (/ (* t t) 2))) (* (- (* x 1/2) y) (sqrt (* z 2))) (- (* x 1/2) y) (* x 1/2) (* (* 2 z) (* 2 z)) (* (* (- (* x 1/2) y) (pow (* (* 2 z) (* 2 z)) 1/4)) (exp (/ (* t t) 2))) (* (- (* x 1/2) y) (pow (* (* 2 z) (* 2 z)) 1/4)) (* (pow (* z 2) 1/4) (- (* 1/2 x) y)) (/ (* t t) 2) (exp (/ (* t t) 2)) (+ (* 1/48 (* t t)) 1/8) (exp (/ (* t t) 2)) (* 1/48 (* t t)) (pow (* (* 2 z) (* 2 z)) 1/4))
311.0ms	y	@	-inf	((/ (+ (* (neg z) y) x) (+ (* (neg a) z) t)) (+ (* (neg z) y) x) (neg z) (+ (* (neg a) z) t) (/ (- x (* y z)) (- t (* a z))) (/ y a) (/ (- x (* y z)) (- t (* a z))) (/ x (- t (* a z))) (- t (* a z)) (* a z) (/ (- x (* y z)) (- t (* a z))) (/ (* z y) (+ (* a z) (neg t))) (* z y) (+ (* a z) (neg t)) (/ (- x (* y z)) (- t (* a z))) (* (/ (- (/ x y) z) (- t (* a z))) y) (/ (- (/ x y) z) (- t (* a z))) (- (/ x y) z) (neg a) (- (* a z) t))
298.0ms	y	@	inf	((+ (* (* (pow (log y) 2) x) (/ x (+ (* (neg z) (log (+ 1 (neg y)))) (* (log y) x)))) (/ (neg (pow (* (log (+ 1 (neg y))) z) 2)) (+ (* (neg z) (log (+ 1 (neg y)))) (* (log y) x)))) (/ (neg (pow (* (log (+ 1 (neg y))) z) 2)) (+ (* (neg z) (log (+ 1 (neg y)))) (* (log y) x))) (- (+ (* (* (pow (log y) 2) x) (/ x (+ (* (neg z) (log (+ 1 (neg y)))) (* (log y) x)))) (/ (neg (pow (* (log (+ 1 (neg y))) z) 2)) (+ (* (neg z) (log (+ 1 (neg y)))) (* (log y) x)))) t) (* (pow (log y) 2) x) (- (+ (* x (log y)) (* z (log (- 1 y)))) t) (- (* (log y) x) (+ (* z y) t)) (neg (+ (* z y) t)) (+ (* z y) t) (- (+ (* x (log y)) (* z (log (- 1 y)))) t) (- (* (log y) x) (+ (* z y) t)) (+ (* (neg z) y) (* (log y) x)) (* (+ (* x (/ (log y) z)) (neg y)) z) (* (+ (* (/ (+ (* (neg z) y) (* (log y) x)) t) -1) 1) (neg t)) (+ (* (/ (+ (* (neg z) y) (* (log y) x)) t) -1) 1) (- (+ (* x (log y)) (* z (log (- 1 y)))) t) (- (* (log y) x) (+ (* z y) t)) (* (log y) (/ (log y) (+ (* (log (+ 1 (neg y))) (neg z)) (* x (log y))))) (- (+ (* (* x x) (* (log y) (/ (log y) (+ (* (log (+ 1 (neg y))) (neg z)) (* x (log y)))))) (/ (neg (pow (* (log (+ 1 (neg y))) z) 2)) (+ (* (neg z) (log (+ 1 (neg y)))) (* (log y) x)))) t) (+ (* (* x x) (* (log y) (/ (log y) (+ (* (log (+ 1 (neg y))) (neg z)) (* x (log y)))))) (/ (neg (pow (* (log (+ 1 (neg y))) z) 2)) (+ (* (neg z) (log (+ 1 (neg y)))) (* (log y) x)))) (* x x) (pow (log y) 2) (pow (* (log (+ 1 (neg y))) z) 2) (+ (* x (/ (log y) z)) (neg y)) (* (log y) x) (/ (+ (* (neg z) y) (* (log y) x)) t) (/ (neg (pow (* (log (+ 1 (neg y))) z) 2)) (+ (* (neg z) (log (+ 1 (neg y)))) (* (log y) x))) (* (* y y) (/ (/ (* z z) x) (neg (log y)))) (/ (* z z) x))
239.0ms	x	@	0	((* x (- (log (neg x)) (log (neg y)))) (- (log (neg x)) (log (neg y))) (log (neg x)) (neg x) (* x (- (log x) (log y))) (- (log x) (log y)) (log x) (log y) (* (- (pow (log x) 2) (pow (log y) 2)) (/ x (log (* y x)))) (- (pow (log x) 2) (pow (log y) 2)) (pow (log x) 2) (/ (* (- (pow (log x) 3) (pow (log y) 3)) x) (+ (* (log (* y x)) (log y)) (pow (log x) 2))) (* (- (pow (log x) 3) (pow (log y) 3)) x) (- (pow (log x) 3) (pow (log y) 3)) (pow (log x) 3) (- (/ (pow (log (neg x)) 3) (+ (* (log (neg y)) (log (* (neg y) (neg x)))) (pow (log (neg x)) 2))) (/ (pow (log (neg y)) 3) (+ (* (log (neg y)) (log (* (neg y) (neg x)))) (pow (log (neg x)) 2)))) (* (neg y) (neg x)) (* x (- (/ (pow (log (neg x)) 3) (+ (* (log (neg y)) (log (* (neg y) (neg x)))) (pow (log (neg x)) 2))) (/ (pow (log (neg y)) 3) (+ (* (log (neg y)) (log (* (neg y) (neg x)))) (pow (log (neg x)) 2))))) (/ (pow (log (neg x)) 3) (+ (* (log (neg y)) (log (* (neg y) (neg x)))) (pow (log (neg x)) 2))) (log (neg y)) (neg y) (log (* y x)) (* y x) (log (* (neg y) (neg x))))

explain44.6s (2.7%)

Memory

-641.4MiB live, 46 952.6MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`log.f64`	`#f`	sensitivity	1570	4
`/.f64`	`#f`	o/n	1228	0
`sqrt.f64`	`#f`	oflow-rescue	765	0
`-.f64`	`#f`	cancellation	587	5
`/.f64`	`#f`	o/o	575	0
`*.f64`	`#f`	*no**	558	0
`+.f64`	`#f`	nan-rescue	475	0
`-.f64`	`#f`	nan-rescue	431	0
`cos.f64`	`#f`	sensitivity	352	0
`/.f64`	`#f`	n/o	340	0
`+.f64`	`#f`	cancellation	322	1
`/.f64`	`#f`	u/n	245	0
`sin.f64`	`#f`	sensitivity	233	0
`*.f64`	`#f`	*nu**	201	0
`/.f64`	`#f`	n/u	161	0
`cos.f64`	`#f`	oflow-rescue	141	0
`/.f64`	`#f`	u/u	106	0
`tan.f64`	`(tan.f64 (/.f64 x (*.f64 y #s(literal 2 binary64))))`	sensitivity	100	0
`log.f64`	`#f`	oflow-rescue	100	0
`log.f64`	`#f`	uflow-rescue	63	0
`sqrt.f64`	`#f`	uflow-rescue	56	0
`*.f64`	`#f`	*ou**	37	0
`exp.f64`	`#f`	sensitivity	29	1
`sin.f64`	`(sin.f64 (/.f64 x (*.f64 y #s(literal 2 binary64))))`	oflow-rescue	26	0
↳	`(/.f64 x (*.f64 y #s(literal 2 binary64)))`	overflow	26
`tan.f64`	`(tan.f64 (/.f64 x (*.f64 y #s(literal 2 binary64))))`	oflow-rescue	26	0
↳	`(/.f64 x (*.f64 y #s(literal 2 binary64)))`	overflow	26
`*.f64`	`(.f64 (-.f64 (.f64 k y2) (.f64 j y3)) (-.f64 (.f64 y4 y1) (*.f64 y5 y0)))`	*uo**	1	0
↳	`(*.f64 j y3)`	underflow	33
↳	`(-.f64 (.f64 k y2) (.f64 j y3))`	underflow	3
↳	`(*.f64 k y2)`	underflow	29
↳	`(*.f64 y4 y1)`	overflow	30
↳	`(-.f64 (.f64 y4 y1) (.f64 y5 y0))`	overflow	55
↳	`(*.f64 y5 y0)`	overflow	31

Confusion

	Predicted +	Predicted -
+	6139	199
-	1724	60802

Precision

0.7807452626224087

Recall

0.968602082675923

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	6139	1	198
-	1724	12	60790

Precision?

0.7795835449466735

Recall?

0.9687598611549385

Freqs

test

number	freq
0	61001
1	7105
2	674
3	64
4	18
5	1
6	1

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	136	0	0
-	4	1	128

Precision?

0.9645390070921985

Recall?

1.0

Samples

13.3s	130 542×	0	valid
2.2s	5 934×	1	valid
883.0ms	1 180×	2	valid
23.0ms	70×	3	valid
1.0ms	2×	4	valid

Compiler

Compiled 24 442 to 8 402 computations (65.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 9.2s

ival-mult: 2.6s (28.9% of total)

ival-sub: 1.3s (14.1% of total)

ival-add: 1.1s (12.3% of total)

ival-div: 1.1s (12.2% of total)

ival-log: 1.0s (11.4% of total)

const: 338.0ms (3.7% of total)

adjust: 326.0ms (3.6% of total)

ival-sin: 291.0ms (3.2% of total)

ival-sqrt: 268.0ms (2.9% of total)

ival-cos: 260.0ms (2.8% of total)

ival-true: 121.0ms (1.3% of total)

ival-exp: 106.0ms (1.2% of total)

exact: 66.0ms (0.7% of total)

ival-assert: 60.0ms (0.7% of total)

ival-hypot: 34.0ms (0.4% of total)

ival-tan: 24.0ms (0.3% of total)

ival-cosh: 11.0ms (0.1% of total)

ival-fabs: 11.0ms (0.1% of total)

ival-sinh: 11.0ms (0.1% of total)

ival-tanh: 7.0ms (0.1% of total)

ival-acos: 4.0ms (0% of total)

prune36.3s (2.2%)

Memory: -1 364.7MiB live, 43 437.3MiB allocated
Counts: 410 405 → 12 636
Compiler: Compiled 802 101 to 432 484 computations (46.1% saved)

bsearch33.5s (2%)

Memory

342.0MiB live, 33 526.7MiB allocated

Algorithm

1 629×	binary-search
1 037×	left-value

Stop Event

1 598×	narrow-enough
31×	predicate-same

Samples

18.2s	128 053×	0	valid
806.0ms	3 050×	1	valid
270.0ms	2 187×	0	invalid
24.0ms	116×	2	valid
12.0ms	28×	3	valid
12.0ms	43×	1	invalid
0.0ms	1×	4	valid

Compiler

Compiled 979 528 to 694 812 computations (29.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 13.2s

ival-mult: 6.4s (48.8% of total)

ival-sub: 2.5s (18.9% of total)

ival-add: 1.4s (10.7% of total)

ival-div: 724.0ms (5.5% of total)

ival-log: 697.0ms (5.3% of total)

ival-sin: 338.0ms (2.6% of total)

const: 300.0ms (2.3% of total)

ival-cos: 225.0ms (1.7% of total)

adjust: 165.0ms (1.3% of total)

ival-true: 101.0ms (0.8% of total)

ival-exp: 80.0ms (0.6% of total)

ival-sqrt: 70.0ms (0.5% of total)

ival-assert: 56.0ms (0.4% of total)

exact: 48.0ms (0.4% of total)

ival-cosh: 19.0ms (0.1% of total)

ival-sinh: 7.0ms (0.1% of total)

ival-tanh: 6.0ms (0% of total)

ival-fabs: 5.0ms (0% of total)

analyze19.1s (1.2%)

Memory

-12.7MiB live, 19 776.4MiB allocated

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.8%	46.8%	53.1%	0.1%	0%	0%	0%	1
50.5%	50.1%	49.2%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.2%	68.2%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.3%	23%	0.1%	0%	4.6%	0%	6
79.8%	75.6%	19.1%	0.1%	0%	5.1%	0%	7
81.7%	77%	17.3%	0.1%	0%	5.6%	0%	8
84.3%	79.3%	14.7%	0.1%	0%	5.9%	0%	9
85.9%	80.5%	13.2%	0.1%	0%	6.2%	0%	10
88.5%	82.8%	10.8%	0.1%	0%	6.2%	0%	11
89.6%	83.6%	9.8%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 3 462 to 2 977 computations (14% saved)

start10.0ms (0%)

Memory: 14.3MiB live, 14.2MiB allocated

end2.0ms (0%)

Memory: 4.3MiB live, 4.1MiB allocated

sample5.6min (20.5%)

simplify5.0min (18.2%)

soundness4.4min (16%)

rewrite3.8min (13.9%)

localize1.8min (6.7%)

eval1.5min (5.4%)

regimes1.2min (4.5%)

preprocess55.5s (3.4%)

series54.9s (3.4%)

explain44.6s (2.7%)

prune36.3s (2.2%)

bsearch33.5s (2%)

analyze19.1s (1.2%)

start10.0ms (0%)

end2.0ms (0%)

Profiling