Metrics for Herbie run

Date:	Saturday, August 31st, 2024
Commit:	ac261103 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024244
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

simplify5.8min (17.6%)

Memory

2 735.5MiB live, 292 798.1MiB allocated

Algorithm

2 127×

egg-herbie

Rules

13 771 802×	`lower-fma.f32`
13 768 706×	`lower-fma.f64`
5 221 468×	`lower-*.f32`
5 214 560×	`lower-*.f64`
2 999 740×	`lower-+.f32`

Stop Event

2 774×	iter limit
1 225×	node limit
915×	saturated

Counts

350 820 → 342 767

sample5.7min (17.2%)

Memory

2 273.7MiB live, 379 978.1MiB allocated

Samples

3.3min	2 146 673×	0	valid
21.3s	67 900×	1	valid
11.4s	64 133×	0	invalid
1.9s	5 663×	2	valid
1.4s	1 239×	5	exit
680.0ms	1 743×	1	invalid
516.0ms	378×	4	exit
168.0ms	627×	3	valid
2.0ms	19×	1	exit
0.0ms	1×	4	valid

Precisions

Click to see histograms. Total time spent on operations: 2.5min

ival-mult: 46.9s (31.3% of total)

ival-sub: 21.0s (14% of total)

ival-add: 20.6s (13.8% of total)

ival-div: 19.0s (12.7% of total)

ival-log: 10.0s (6.7% of total)

const: 7.0s (4.7% of total)

ival-sqrt: 5.6s (3.7% of total)

ival-sin: 3.7s (2.5% of total)

ival-cos: 3.5s (2.3% of total)

adjust: 3.2s (2.1% of total)

ival-exp: 2.6s (1.7% of total)

ival-true: 1.7s (1.1% of total)

ival-fabs: 1.2s (0.8% of total)

exact: 1.0s (0.7% of total)

ival-acos: 1.0s (0.7% of total)

ival-assert: 910.0ms (0.6% of total)

ival-hypot: 252.0ms (0.2% of total)

ival-cosh: 223.0ms (0.1% of total)

ival-tan: 199.0ms (0.1% of total)

ival-tanh: 129.0ms (0.1% of total)

ival-sinh: 127.0ms (0.1% of total)

Bogosity

soundness5.3min (15.9%)

Memory

368.3MiB live, 159 328.3MiB allocated

Rules

7 924 118×	`lower-fma.f32`
7 922 862×	`lower-fma.f64`
4 170 180×	`lower-*.f32`
4 166 962×	`lower-*.f64`
2 319 104×	`lower-/.f32`

Stop Event

1 395×	iter limit
935×	node limit
139×	fuel
130×	done
23×	saturated
4×	unsound

Compiler

Compiled 125 999 to 74 293 computations (41% saved)

rewrite3.8min (11.6%)

Memory

-301.0MiB live, 238 638.3MiB allocated

Rules

5 044 232×	`lower-fma.f32`
5 041 142×	`lower-fma.f64`
3 921 836×	`lower-*.f32`
3 915 030×	`lower-*.f64`
3 376 200×	`lower-/.f32`

Stop Event

1 907×	iter limit
902×	node limit
18×	unsound
16×	saturated

Counts

11 361 → 481 800

eval3.7min (11.2%)

Memory: 2 895.1MiB live, 245 148.2MiB allocated
Compiler: Compiled 21 054 421 to 1 903 128 computations (91% saved)

localize1.8min (5.5%)

Memory

-1 977.9MiB live, 112 680.1MiB allocated

Samples

1.1min	219 780×	0	valid
10.7s	11 037×	1	valid
4.0s	2 823×	2	valid
1.2s	3 099×	0	invalid
483.0ms	301×	3	valid
244.0ms	176×	5	exit
165.0ms	97×	1	exit
137.0ms	384×	0	exit
88.0ms	123×	2	exit
3.0ms	4×	4	valid

Compiler

Compiled 134 352 to 22 264 computations (83.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 57.8s

ival-mult: 25.3s (43.8% of total)

ival-div: 7.5s (13% of total)

ival-add: 6.9s (11.9% of total)

ival-sub: 4.4s (7.7% of total)

const: 2.9s (5% of total)

adjust: 1.9s (3.3% of total)

ival-log: 1.9s (3.3% of total)

ival-pow: 1.5s (2.5% of total)

ival-neg: 1.3s (2.3% of total)

ival-cos: 909.0ms (1.6% of total)

ival-sin: 701.0ms (1.2% of total)

ival-sqrt: 645.0ms (1.1% of total)

ival-exp: 436.0ms (0.8% of total)

ival-pow2: 259.0ms (0.4% of total)

exact: 236.0ms (0.4% of total)

ival-log1p: 211.0ms (0.4% of total)

ival-true: 192.0ms (0.3% of total)

ival-hypot: 148.0ms (0.3% of total)

ival-cosh: 110.0ms (0.2% of total)

ival-assert: 99.0ms (0.2% of total)

ival-fabs: 56.0ms (0.1% of total)

ival-tanh: 54.0ms (0.1% of total)

ival-expm1: 49.0ms (0.1% of total)

ival-tan: 45.0ms (0.1% of total)

ival-acos: 18.0ms (0% of total)

ival-sinh: 15.0ms (0% of total)

ival-asin: 10.0ms (0% of total)

ival-pi: 3.0ms (0% of total)

regimes1.6min (4.8%)

Memory

-9.4MiB live, 112 250.0MiB allocated

Counts

38 687 → 5 052

Calls

513 calls:

14.8s	x
12.2s	y
9.3s	z
5.6s	t
3.6s	a

Compiler

Compiled 38 950 to 58 513 computations (-50.2% saved)

prune1.4min (4.1%)

Memory: -3 713.1MiB live, 104 552.4MiB allocated
Counts: 910 219 → 13 926
Compiler: Compiled 425 401 to 298 587 computations (29.8% saved)

preprocess1.3min (3.9%)

Memory

299.1MiB live, 71 570.8MiB allocated

Algorithm

269×	egg-herbie

Rules

845 124×	`lower-fma.f64`
845 124×	`lower-fma.f32`
193 164×	`unsub-neg`
192 664×	`lower-*.f32`
191 630×	`lower-*.f64`

Stop Event

538×	iter limit
394×	saturated
144×	node limit

Compiler

Compiled 174 054 to 56 290 computations (67.7% saved)

series1.1min (3.4%)

Memory

449.6MiB live, 81 471.5MiB allocated

Counts

11 361 → 350 820

Calls

8889 calls:

Time	Variable		Point	Expression
357.0ms	z	@	0	((/ (* (- 1 (pow (* z y) 2)) x) (+ (* z y) 1)) (* (* (neg z) x) y) (* (neg z) x) (neg z) (* x (+ (* (* (/ (neg y) (+ (* y z) 1)) z) (* y z)) (pow (+ (* z y) 1) -1))) (* (/ (neg y) (+ (* y z) 1)) z) (/ (neg y) (+ (* y z) 1)) (neg y) (/ (* (- 1 (pow (* z y) 2)) x) (+ (* z y) 1)) (* (- 1 (pow (* z y) 2)) x) (* (* (* (neg y) y) z) x) (* (* (neg y) y) z) (/ (* (+ (* (* (* y z) z) (neg y)) 1) x) (+ (* z y) 1)) (* (+ (* (* (* y z) z) (neg y)) 1) x) (* (* y z) z) (* y z) (pow (+ (* z y) 1) -1) (+ (* (* (* y z) z) (neg y)) 1))
344.0ms	a	@	0	((+ (* y (log z)) (* (- t 1) (log a))) (/ (* x (exp (- (+ (* y (log z)) (* (- t 1) (log a))) b))) y) (* x (exp (- (+ (* y (log z)) (* (- t 1) (log a))) b))) (- (+ (* y (log z)) (* (- t 1) (log a))) b) (exp (- (+ (* y (log z)) (* (- t 1) (log a))) b)) (* y (log z)) (* (- t 1) (log a)))
201.0ms	t	@	inf	((+ x (* (- y z) (/ (- t x) (- a z)))) (* (- y z) (/ (- t x) (- a z))) (- y z) (/ (- t x) (- a z)) (- a z))
198.0ms	x	@	-inf	((- 1 (* x (+ 253/1000 (* x 3/25)))) (+ 253/1000 (* x 3/25)) (* x (+ 253/1000 (* x 3/25))) (* x 3/25))
194.0ms	y	@	0	((/ (+ 2 (* (* (* (sqrt 2) (- (sin x) (/ (sin y) 16))) (- (sin y) (/ (sin x) 16))) (- (cos x) (cos y)))) (/ (+ (* (* (* (cos y) (- 3 (sqrt 5))) 3) (- 1 (* (cos x) (+ (* (sqrt 5) 1/2) -1/2)))) (* 2 (* (- 1 (pow (* (cos x) (+ (* (sqrt 5) 1/2) -1/2)) 2)) 3))) (* 2 (- 1 (* (cos x) (+ (* (sqrt 5) 1/2) -1/2)))))) (/ (+ (* (* (* (cos y) (- 3 (sqrt 5))) 3) (- 1 (* (cos x) (+ (* (sqrt 5) 1/2) -1/2)))) (* 2 (* (- 1 (pow (* (cos x) (+ (* (sqrt 5) 1/2) -1/2)) 2)) 3))) (* 2 (- 1 (* (cos x) (+ (* (sqrt 5) 1/2) -1/2))))) (* 2 (* (- 1 (pow (* (cos x) (+ (* (sqrt 5) 1/2) -1/2)) 2)) 3)) (+ 2 (* (* (* (sqrt 2) (- (sin x) (/ (sin y) 16))) (- (sin y) (/ (sin x) 16))) (- (cos x) (cos y)))) (* 3 (+ (+ 1 (* (/ (- (sqrt 5) 1) 2) (cos x))) (* (/ (- 3 (sqrt 5)) 2) (cos y)))) (/ (- 3 (sqrt 5)) 2) (+ (+ 1 (* (/ (- (sqrt 5) 1) 2) (cos x))) (* (/ (- 3 (sqrt 5)) 2) (cos y))) (+ 1 (* (/ (- (sqrt 5) 1) 2) (cos x))) (+ (+ (* (- 3 (sqrt 5)) (+ (* (* -1/4 y) y) 1/2)) (* (+ (* (sqrt 5) 1/2) -1/2) (cos x))) 1) (* (* (* (sqrt 2) (- (sin x) (/ (sin y) 16))) (- (sin y) (/ (sin x) 16))) (- (cos x) (cos y))) (* (* (sqrt 2) (- (sin x) (/ (sin y) 16))) (- (sin y) (/ (sin x) 16))) (+ (+ (* (cos y) (* 1/2 (- 3 (sqrt 5)))) (* (cos x) (+ (* (sqrt 5) 1/2) -1/2))) 1) (* 1/2 (- 3 (sqrt 5))) (/ (+ 2 (* (* (* (sqrt 2) (- (sin x) (/ (sin y) 16))) (- (sin y) (/ (sin x) 16))) (- (cos x) (cos y)))) (* 3 (+ (+ (* (cos y) (* 1/2 (- 3 (sqrt 5)))) (* (cos x) (+ (* (sqrt 5) 1/2) -1/2))) 1))) (/ (* (- (pow (+ (* (cos x) (+ (* (sqrt 5) 1/2) -1/2)) 1) 2) (pow (* (cos y) (* 1/2 (- 3 (sqrt 5)))) 2)) 3) (- (+ (* (cos x) (+ (* (sqrt 5) 1/2) -1/2)) 1) (* (cos y) (* 1/2 (- 3 (sqrt 5)))))) (- (+ (* (cos x) (+ (* (sqrt 5) 1/2) -1/2)) 1) (* (cos y) (* 1/2 (- 3 (sqrt 5))))) (- (cos x) (cos y)) (- 3 (sqrt 5)) (pow (* (cos x) (+ (* (sqrt 5) 1/2) -1/2)) 2) (- 1 (* (cos x) (+ (* (sqrt 5) 1/2) -1/2))) (+ 2 (* (* (* (sqrt 2) (- (sin x) (/ (sin y) 16))) (- (sin y) (/ (sin x) 16))) (- (cos x) (cos y)))) (+ (* -1/16 (cos x)) 1/16) (* (+ (* -1/16 (cos x)) 1/16) (sqrt 2)) (+ (+ 1 (* (/ (- (sqrt 5) 1) 2) (cos x))) (* (/ (- 3 (sqrt 5)) 2) (cos y))) (* (sqrt 2) (- (sin x) (/ (sin y) 16))) (+ (* (cos y) (* 1/2 (- 3 (sqrt 5)))) (* (cos x) (+ (* (sqrt 5) 1/2) -1/2))) (* (- (pow (+ (* (cos x) (+ (* (sqrt 5) 1/2) -1/2)) 1) 2) (pow (* (cos y) (* 1/2 (- 3 (sqrt 5)))) 2)) 3))

explain44.9s (2.3%)

Memory

-1 895.1MiB live, 51 859.7MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`log.f64`	`#f`	sensitivity	1550	1
`/.f64`	`#f`	o/n	1219	0
`sqrt.f64`	`#f`	oflow-rescue	769	0
`/.f64`	`#f`	o/o	574	0
`-.f64`	`#f`	cancellation	574	14
`*.f64`	`#f`	*no**	501	0
`+.f64`	`#f`	nan-rescue	443	0
`-.f64`	`#f`	nan-rescue	433	0
`cos.f64`	`#f`	sensitivity	386	0
`/.f64`	`#f`	n/o	335	0
`+.f64`	`#f`	cancellation	325	1
`/.f64`	`#f`	u/n	252	0
`sin.f64`	`#f`	sensitivity	219	0
`*.f64`	`#f`	*nu**	184	0
`/.f64`	`#f`	n/u	170	0
`cos.f64`	`#f`	oflow-rescue	131	0
`tan.f64`	`(tan.f64 (/.f64 x (*.f64 y #s(literal 2 binary64))))`	sensitivity	93	1
`/.f64`	`#f`	u/u	92	0
`log.f64`	`#f`	oflow-rescue	90	0
`log.f64`	`#f`	uflow-rescue	56	0
`sqrt.f64`	`#f`	uflow-rescue	44	0
`*.f64`	`#f`	*ou**	37	0
`exp.f64`	`#f`	sensitivity	31	4
`sin.f64`	`(sin.f64 (/.f64 x (*.f64 y #s(literal 2 binary64))))`	oflow-rescue	28	0
↳	`(/.f64 x (*.f64 y #s(literal 2 binary64)))`	overflow	28
`tan.f64`	`(tan.f64 (/.f64 x (*.f64 y #s(literal 2 binary64))))`	oflow-rescue	28	0
↳	`(/.f64 x (*.f64 y #s(literal 2 binary64)))`	overflow	28
`*.f64`	`(.f64 (-.f64 (.f64 k y2) (.f64 j y3)) (-.f64 (.f64 y4 y1) (*.f64 y5 y0)))`	*uo**	1	0
↳	`(*.f64 j y3)`	underflow	22
↳	`(-.f64 (.f64 k y2) (.f64 j y3))`	underflow	2
↳	`(*.f64 k y2)`	underflow	24
↳	`(*.f64 y4 y1)`	overflow	29
↳	`(-.f64 (.f64 y4 y1) (.f64 y5 y0))`	overflow	57
↳	`(*.f64 y5 y0)`	overflow	34

Confusion

	Predicted +	Predicted -
+	6005	187
-	1689	60983

Precision

0.7804782947751495

Recall

0.9697997416020672

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	6005	5	182
-	1689	17	60966

Precision?

0.7789009849663038

Recall?

0.9706072351421189

Freqs

test

number	freq
0	61170
1	6921
2	695
3	63
4	11
5	3
6	1

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	138	1	0
-	1	1	128

Precision?

0.9858156028368794

Recall?

1.0

Samples

13.7s	130 530×	0	valid
2.4s	5 890×	1	valid
637.0ms	1 178×	2	valid
34.0ms	130×	3	valid

Compiler

Compiled 24 442 to 8 402 computations (65.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 9.4s

ival-mult: 3.1s (32.6% of total)

ival-div: 1.4s (15.2% of total)

ival-sub: 1.2s (12.4% of total)

ival-add: 1.0s (10.8% of total)

ival-log: 986.0ms (10.5% of total)

const: 355.0ms (3.8% of total)

ival-sin: 246.0ms (2.6% of total)

adjust: 242.0ms (2.6% of total)

ival-sqrt: 208.0ms (2.2% of total)

ival-exp: 203.0ms (2.2% of total)

ival-cos: 165.0ms (1.8% of total)

ival-true: 117.0ms (1.2% of total)

exact: 63.0ms (0.7% of total)

ival-assert: 56.0ms (0.6% of total)

ival-cosh: 17.0ms (0.2% of total)

ival-fabs: 16.0ms (0.2% of total)

ival-tan: 11.0ms (0.1% of total)

ival-hypot: 10.0ms (0.1% of total)

ival-sinh: 8.0ms (0.1% of total)

ival-tanh: 6.0ms (0.1% of total)

ival-acos: 4.0ms (0% of total)

bsearch33.7s (1.7%)

Memory

-560.8MiB live, 40 390.6MiB allocated

Algorithm

1 638×	binary-search
1 254×	left-value

Stop Event

1 600×	narrow-enough
37×	predicate-same
1×	predicate-failed

Samples

19.3s	134 737×	0	valid
772.0ms	3 376×	1	valid
226.0ms	2 184×	0	invalid
23.0ms	120×	2	valid
1.0ms	7×	3	valid

Compiler

Compiled 280 419 to 332 547 computations (-18.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 13.9s

ival-mult: 5.8s (42.1% of total)

ival-sub: 3.2s (22.9% of total)

ival-add: 1.5s (10.5% of total)

ival-div: 896.0ms (6.5% of total)

const: 714.0ms (5.1% of total)

ival-log: 684.0ms (4.9% of total)

ival-sin: 304.0ms (2.2% of total)

ival-cos: 276.0ms (2% of total)

ival-sqrt: 124.0ms (0.9% of total)

adjust: 117.0ms (0.8% of total)

ival-true: 105.0ms (0.8% of total)

ival-exp: 57.0ms (0.4% of total)

ival-assert: 55.0ms (0.4% of total)

exact: 46.0ms (0.3% of total)

ival-tanh: 13.0ms (0.1% of total)

ival-cosh: 8.0ms (0.1% of total)

ival-fabs: 2.0ms (0% of total)

analyze19.3s (1%)

Memory

-253.8MiB live, 23 523.1MiB allocated

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.8%	46.8%	53.1%	0.1%	0%	0%	0%	1
50.5%	50.1%	49.2%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.2%	68.2%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.3%	23%	0.1%	0%	4.6%	0%	6
79.8%	75.6%	19.1%	0.1%	0%	5.1%	0%	7
81.7%	77%	17.3%	0.1%	0%	5.6%	0%	8
84.3%	79.3%	14.7%	0.1%	0%	5.9%	0%	9
85.9%	80.5%	13.2%	0.1%	0%	6.2%	0%	10
88.5%	82.8%	10.8%	0.1%	0%	6.2%	0%	11
89.6%	83.6%	9.8%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 3 462 to 2 977 computations (14% saved)

start8.0ms (0%)

Memory: -24.3MiB live, 17.3MiB allocated

end2.0ms (0%)

Memory: 4.2MiB live, 4.0MiB allocated

simplify5.8min (17.6%)

sample5.7min (17.2%)

soundness5.3min (15.9%)

rewrite3.8min (11.6%)

eval3.7min (11.2%)

localize1.8min (5.5%)

regimes1.6min (4.8%)

prune1.4min (4.1%)

preprocess1.3min (3.9%)

series1.1min (3.4%)

explain44.9s (2.3%)

bsearch33.7s (1.7%)

analyze19.3s (1%)

start8.0ms (0%)

end2.0ms (0%)

Profiling