Metrics for Herbie run

Date:	Tuesday, August 6th, 2024
Commit:	2.2 on release
Hostname:	nightly with Racket 8.11.1
Seed:	2024219
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

simplify10.6min (25.8%)

Memory

1 354.2MiB live, 707 662.8MiB allocated

Algorithm

2 117×

egg-herbie

Rules

14 051 962×	`lower-fma.f32`
14 048 684×	`lower-fma.f64`
5 220 742×	`lower-*.f32`
5 213 122×	`lower-*.f64`
3 073 776×	`lower-+.f32`

Stop Event

2 758×	iter limit
1 231×	node limit
900×	saturated

Counts

350 400 → 342 371

rewrite6.9min (16.8%)

Memory

1 589.9MiB live, 501 640.3MiB allocated

Algorithm

924×	batch-egg-rewrite

Rules

4 995 142×	`lower-fma.f32`
4 991 898×	`lower-fma.f64`
3 919 066×	`lower-*.f32`
3 911 536×	`lower-*.f64`
3 316 358×	`lower-/.f32`

Stop Event

1 894×	iter limit
899×	node limit
18×	saturated
15×	unsound

Counts

11 363 → 478 680

sample5.6min (13.7%)

Memory

1 512.7MiB live, 390 392.5MiB allocated

Samples

3.4min	2 146 906×	0	valid
21.2s	67 590×	1	valid
9.9s	64 158×	0	invalid
1.6s	1 749×	1	invalid
1.6s	1 263×	5	exit
1.5s	5 767×	2	valid
323.0ms	601×	3	valid
234.0ms	408×	4	exit
2.0ms	21×	1	exit

Precisions

Click to see histograms. Total time spent on operations: 2.3min

ival-mult: 46.0s (33.3% of total)

ival-sub: 19.8s (14.3% of total)

ival-div: 17.2s (12.4% of total)

ival-add: 16.8s (12.2% of total)

ival-log: 8.6s (6.2% of total)

const: 6.1s (4.4% of total)

ival-sqrt: 5.5s (4% of total)

ival-sin: 4.4s (3.2% of total)

ival-cos: 3.5s (2.5% of total)

adjust: 3.1s (2.3% of total)

ival-exp: 2.3s (1.6% of total)

ival-true: 1.8s (1.3% of total)

exact: 1.0s (0.7% of total)

ival-assert: 881.0ms (0.6% of total)

ival-cosh: 260.0ms (0.2% of total)

ival-fabs: 259.0ms (0.2% of total)

ival-tan: 216.0ms (0.2% of total)

ival-acos: 198.0ms (0.1% of total)

ival-hypot: 178.0ms (0.1% of total)

ival-sinh: 153.0ms (0.1% of total)

ival-tanh: 86.0ms (0.1% of total)

Bogosity

soundness5.1min (12.4%)

Memory

-157.4MiB live, 167 902.9MiB allocated

Rules

7 666 534×	`lower-fma.f32`
7 665 314×	`lower-fma.f64`
4 054 124×	`lower-*.f32`
4 050 840×	`lower-*.f64`
2 237 014×	`lower-/.f32`

Stop Event

1 343×	iter limit
909×	node limit
145×	fuel
124×	done
20×	saturated
3×	unsound

Compiler

Compiled 166 540 to 75 623 computations (54.6% saved)

eval3.0min (7.3%)

Memory: 3 863.7MiB live, 238 907.7MiB allocated
Compiler: Compiled 24 356 051 to 1 635 321 computations (93.3% saved)

prune2.5min (6.1%)

Memory: -5 218.7MiB live, 227 236.8MiB allocated
Counts: 910 263 → 14 708
Compiler: Compiled 567 022 to 287 688 computations (49.3% saved)

localize1.9min (4.6%)

Memory

-1 128.2MiB live, 148 996.8MiB allocated

Samples

52.3s	217 423×	0	valid
10.2s	11 499×	1	valid
3.3s	3 154×	2	valid
1.1s	2 891×	0	invalid
497.0ms	337×	3	valid
464.0ms	266×	5	exit
220.0ms	507×	0	exit
174.0ms	289×	2	exit
145.0ms	165×	1	exit
29.0ms	1×	3	exit
9.0ms	11×	4	valid
5.0ms	1×	4	exit

Compiler

Compiled 141 225 to 22 694 computations (83.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 45.5s

ival-mult: 15.1s (33.2% of total)

ival-div: 8.3s (18.3% of total)

ival-add: 6.5s (14.4% of total)

ival-sub: 4.3s (9.3% of total)

const: 2.5s (5.4% of total)

adjust: 2.0s (4.3% of total)

ival-log: 1.6s (3.4% of total)

ival-cos: 1.3s (3% of total)

ival-sqrt: 683.0ms (1.5% of total)

ival-sin: 653.0ms (1.4% of total)

ival-pow: 593.0ms (1.3% of total)

ival-neg: 565.0ms (1.2% of total)

ival-exp: 543.0ms (1.2% of total)

exact: 218.0ms (0.5% of total)

ival-true: 207.0ms (0.5% of total)

ival-assert: 100.0ms (0.2% of total)

ival-tan: 74.0ms (0.2% of total)

ival-pow2: 72.0ms (0.2% of total)

ival-log1p: 64.0ms (0.1% of total)

ival-expm1: 34.0ms (0.1% of total)

ival-acos: 25.0ms (0.1% of total)

ival-cosh: 25.0ms (0.1% of total)

ival-sinh: 24.0ms (0.1% of total)

ival-fabs: 21.0ms (0% of total)

ival-hypot: 14.0ms (0% of total)

ival-tanh: 13.0ms (0% of total)

ival-e: 7.0ms (0% of total)

ival-asin: 4.0ms (0% of total)

ival-pi: 2.0ms (0% of total)

preprocess1.8min (4.4%)

Memory

-402.9MiB live, 89 658.9MiB allocated

Algorithm

269×	egg-herbie

Rules

845 124×	`lower-fma.f64`
845 124×	`lower-fma.f32`
193 164×	`unsub-neg`
192 664×	`lower-*.f32`
191 630×	`lower-*.f64`

Stop Event

538×	iter limit
394×	saturated
144×	node limit

Compiler

Compiled 176 800 to 46 500 computations (73.7% saved)

regimes1.6min (4%)

Memory

-1 095.8MiB live, 128 747.7MiB allocated

Counts

44 184 → 4 971

Calls

511 calls:

14.8s	x
14.4s	y
10.1s	z
5.9s	t
3.6s	a

Compiler

Compiled 79 216 to 59 233 computations (25.2% saved)

explain42.4s (1.7%)

Memory

-582.5MiB live, 56 406.4MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`log.f64`	`#f`	sensitivity	1586	1
`/.f64`	`#f`	o/n	1163	0
`sqrt.f64`	`#f`	oflow-rescue	741	0
`/.f64`	`#f`	o/o	572	0
`-.f64`	`#f`	cancellation	549	9
`*.f64`	`#f`	*no**	498	0
`-.f64`	`#f`	nan-rescue	472	0
`+.f64`	`#f`	nan-rescue	469	0
`cos.f64`	`#f`	sensitivity	341	0
`+.f64`	`#f`	cancellation	330	2
`/.f64`	`#f`	n/o	321	0
`/.f64`	`#f`	u/n	251	0
`sin.f64`	`#f`	sensitivity	222	0
`*.f64`	`#f`	*nu**	158	0
`cos.f64`	`#f`	oflow-rescue	140	0
`/.f64`	`#f`	n/u	108	0
`/.f64`	`#f`	u/u	88	0
`tan.f64`	`(tan.f64 (/.f64 x (*.f64 y #s(literal 2 binary64))))`	sensitivity	88	0
`log.f64`	`#f`	oflow-rescue	83	0
`log.f64`	`#f`	uflow-rescue	75	0
`sqrt.f64`	`#f`	uflow-rescue	49	0
`exp.f64`	`#f`	sensitivity	35	2
`tan.f64`	`(tan.f64 (/.f64 x (*.f64 y #s(literal 2 binary64))))`	oflow-rescue	35	0
↳	`(/.f64 x (*.f64 y #s(literal 2 binary64)))`	overflow	35
`sin.f64`	`(sin.f64 (/.f64 x (*.f64 y #s(literal 2 binary64))))`	oflow-rescue	35	0
↳	`(/.f64 x (*.f64 y #s(literal 2 binary64)))`	overflow	35
`*.f64`	`#f`	*ou**	35	0
`*.f64`	`(.f64 (-.f64 (.f64 k y2) (.f64 j y3)) (-.f64 (.f64 y4 y1) (*.f64 y5 y0)))`	*uo**	1	0
↳	`(*.f64 j y3)`	underflow	32
↳	`(-.f64 (.f64 k y2) (.f64 j y3))`	underflow	2
↳	`(*.f64 k y2)`	underflow	19
↳	`(*.f64 y4 y1)`	overflow	28
↳	`(-.f64 (.f64 y4 y1) (.f64 y5 y0))`	overflow	57
↳	`(*.f64 y5 y0)`	overflow	29

Confusion

	Predicted +	Predicted -
+	5886	184
-	1701	61093

Precision

0.7758007117437722

Recall

0.9696869851729819

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5886	1	183
-	1701	14	61079

Precision?

0.7744014732965009

Recall?

0.9698517298187809

Freqs

test

number	freq
0	61277
1	6820
2	699
3	47
4	19
5	2

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	135	0	1
-	2	0	131

Precision?

0.9854014598540146

Recall?

0.9926470588235294

Samples

12.4s	130 562×	0	valid
2.1s	5 850×	1	valid
622.0ms	1 218×	2	valid
26.0ms	94×	3	valid
1.0ms	2×	4	valid
0.0ms	2×	5	exit

Compiler

Compiled 29 004 to 10 844 computations (62.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 8.4s

ival-mult: 2.4s (28.1% of total)

ival-sub: 1.2s (13.8% of total)

ival-div: 965.0ms (11.4% of total)

ival-add: 892.0ms (10.6% of total)

ival-log: 806.0ms (9.6% of total)

const: 796.0ms (9.4% of total)

adjust: 311.0ms (3.7% of total)

ival-cos: 283.0ms (3.4% of total)

ival-sqrt: 217.0ms (2.6% of total)

ival-sin: 197.0ms (2.3% of total)

ival-true: 122.0ms (1.4% of total)

ival-exp: 96.0ms (1.1% of total)

ival-assert: 63.0ms (0.7% of total)

exact: 62.0ms (0.7% of total)

ival-tan: 24.0ms (0.3% of total)

ival-sinh: 16.0ms (0.2% of total)

ival-cosh: 10.0ms (0.1% of total)

ival-fabs: 10.0ms (0.1% of total)

ival-tanh: 8.0ms (0.1% of total)

ival-hypot: 8.0ms (0.1% of total)

ival-acos: 5.0ms (0.1% of total)

series35.1s (1.4%)

Memory

507.2MiB live, 43 884.5MiB allocated

Counts

11 363 → 350 400

Calls

36810 calls:

Time	Variable		Point	Expression
308.0ms	y	@	-inf	(* (log (* (/ y (* (* x (pow a (+ t -1))) (pow z y))) (exp b))) -1)
234.0ms	x	@	0	(- (* (* 2 (pow (* x x) 1/4)) (cos (- y (/ (* z t) 3)))) (/ a (* b 3)))
225.0ms	x	@	inf	(* (* (* (exp (* (* t t) 1/2)) (- (* x 1/2) y)) (sqrt z)) (sqrt 2))
214.0ms	x	@	-inf	(* (* (log (* x y)) (log (/ x y))) x)
212.0ms	y	@	-inf	(* x (log y))

bsearch28.4s (1.1%)

Memory

143.1MiB live, 37 114.9MiB allocated

Algorithm

1 583×	binary-search
1 229×	left-value

Stop Event

1 555×	narrow-enough
28×	predicate-same

Samples

16.1s	126 814×	0	valid
1.0s	3 152×	1	valid
295.0ms	2 717×	0	invalid
15.0ms	85×	2	valid
11.0ms	46×	1	invalid
2.0ms	13×	3	valid

Compiler

Compiled 449 352 to 302 994 computations (32.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 11.9s

ival-mult: 4.9s (41.3% of total)

ival-sub: 2.1s (17.8% of total)

ival-add: 1.6s (13.7% of total)

ival-div: 924.0ms (7.8% of total)

ival-log: 673.0ms (5.7% of total)

const: 622.0ms (5.2% of total)

ival-sin: 215.0ms (1.8% of total)

ival-cos: 201.0ms (1.7% of total)

ival-exp: 123.0ms (1% of total)

adjust: 111.0ms (0.9% of total)

ival-true: 100.0ms (0.8% of total)

ival-sqrt: 76.0ms (0.6% of total)

ival-assert: 52.0ms (0.4% of total)

ival-cosh: 50.0ms (0.4% of total)

exact: 42.0ms (0.4% of total)

ival-fabs: 21.0ms (0.2% of total)

ival-tanh: 8.0ms (0.1% of total)

ival-sinh: 3.0ms (0% of total)

analyze16.9s (0.7%)

Memory

-542.5MiB live, 25 129.3MiB allocated

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.8%	46.8%	53.1%	0.1%	0%	0%	0%	1
50.5%	50.1%	49.2%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.2%	68.2%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.3%	23%	0.1%	0%	4.6%	0%	6
79.8%	75.6%	19.1%	0.1%	0%	5.1%	0%	7
81.7%	77%	17.3%	0.1%	0%	5.6%	0%	8
84.3%	79.3%	14.7%	0.1%	0%	5.9%	0%	9
85.9%	80.5%	13.2%	0.1%	0%	6.2%	0%	10
88.5%	82.8%	10.8%	0.1%	0%	6.2%	0%	11
89.6%	83.6%	9.8%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 3 462 to 2 977 computations (14% saved)

end2.0ms (0%)

Memory: 5.0MiB live, 4.6MiB allocated

simplify10.6min (25.8%)

rewrite6.9min (16.8%)

sample5.6min (13.7%)

soundness5.1min (12.4%)

eval3.0min (7.3%)

prune2.5min (6.1%)

localize1.9min (4.6%)

preprocess1.8min (4.4%)

regimes1.6min (4%)

explain42.4s (1.7%)

series35.1s (1.4%)

bsearch28.4s (1.1%)

analyze16.9s (0.7%)

end2.0ms (0%)

Profiling