Metrics for Herbie run

Date:	Wednesday, August 14th, 2024
Commit:	1bdd7fa4 on zane-no-browser
Hostname:	nightly with Racket 8.11.1
Seed:	2024227
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.9min (35.6%)

Memory

251.4MiB live, 124 942.3MiB allocated

Samples

29.6s	41 529×	2	valid
24.9s	145 504×	0	invalid
21.0s	92 503×	1	valid
9.6s	4 759×	5	exit
8.2s	94 144×	0	valid
2.1s	2 984×	3	valid
590.0ms	2 253×	1	exit
364.0ms	4 059×	0	exit
30.0ms	14×	2	exit
9.0ms	8×	4	valid
7.0ms	4×	4	exit
1.0ms	2×	3	exit

Precisions

Click to see histograms. Total time spent on operations: 1.3min

ival-tan: 13.3s (16.7% of total)

ival-pow: 9.7s (12.1% of total)

ival-mult: 6.4s (8% of total)

adjust: 5.8s (7.3% of total)

const: 5.6s (7% of total)

ival-cos: 5.4s (6.8% of total)

ival-div: 4.2s (5.3% of total)

ival-log: 3.5s (4.4% of total)

ival-sub: 3.5s (4.4% of total)

ival-add: 3.1s (3.9% of total)

ival-sin: 3.1s (3.9% of total)

ival-fabs: 2.4s (3% of total)

ival-<=: 2.4s (3% of total)

ival-exp: 2.3s (2.9% of total)

ival-expm1: 1.8s (2.3% of total)

ival-log1p: 1.7s (2.1% of total)

ival-sqrt: 1.2s (1.5% of total)

ival-<: 949.0ms (1.2% of total)

ival-atan: 625.0ms (0.8% of total)

ival-and: 594.0ms (0.7% of total)

ival-fmin: 510.0ms (0.6% of total)

ival-neg: 481.0ms (0.6% of total)

exact: 332.0ms (0.4% of total)

ival-cbrt: 260.0ms (0.3% of total)

ival->: 257.0ms (0.3% of total)

ival-assert: 147.0ms (0.2% of total)

ival-true: 67.0ms (0.1% of total)

Bogosity

simplify55.5s (17%)

Memory

803.1MiB live, 57 164.1MiB allocated

Algorithm

244×	egg-herbie

Rules

2 066 700×	`lower-fma.f32`
2 066 130×	`lower-fma.f64`
779 912×	`lower-*.f32`
778 872×	`lower-*.f64`
469 572×	`lower-+.f32`

Stop Event

324×	iter limit
170×	node limit
74×	saturated

Counts

30 660 → 30 263

rewrite36.0s (11%)

Memory

308.1MiB live, 40 096.4MiB allocated

Rules

481 590×	`lower-fma.f32`
481 020×	`lower-fma.f64`
434 120×	`lower-*.f32`
433 088×	`lower-*.f64`
392 536×	`lower-/.f32`

Stop Event

222×	iter limit
108×	node limit

Counts

1 746 → 71 659

soundness30.4s (9.3%)

Memory

-20.7MiB live, 19 533.1MiB allocated

Rules

1 064 820×	`lower-fma.f32`
1 064 498×	`lower-fma.f64`
613 330×	`lower-*.f32`
612 710×	`lower-*.f64`
319 928×	`lower-+.f32`

Stop Event

203×	iter limit
132×	node limit
23×	fuel
5×	done
2×	saturated

Compiler

Compiled 12 502 to 6 089 computations (51.3% saved)

localize24.1s (7.4%)

Memory

-147.5MiB live, 28 473.5MiB allocated

Samples

7.3s	10 798×	1	valid
6.4s	5 425×	2	valid
2.9s	10 031×	0	valid
616.0ms	441×	3	valid
323.0ms	162×	1	invalid
268.0ms	676×	0	invalid
93.0ms	59×	0	exit
77.0ms	6×	2	invalid
56.0ms	18×	5	exit
54.0ms	30×	1	exit
3.0ms	2×	4	valid

Compiler

Compiled 25 316 to 3 487 computations (86.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 14.5s

ival-mult: 2.5s (17.5% of total)

adjust: 1.7s (11.9% of total)

ival-add: 1.6s (11.2% of total)

ival-div: 1.6s (10.9% of total)

ival-tan: 1.1s (7.7% of total)

ival-log: 922.0ms (6.4% of total)

const: 894.0ms (6.2% of total)

ival-cos: 884.0ms (6.1% of total)

ival-pow: 806.0ms (5.6% of total)

ival-sub: 612.0ms (4.2% of total)

ival-sin: 454.0ms (3.1% of total)

ival-exp: 427.0ms (2.9% of total)

ival-sqrt: 275.0ms (1.9% of total)

ival-log1p: 156.0ms (1.1% of total)

ival-pow2: 107.0ms (0.7% of total)

ival-expm1: 94.0ms (0.6% of total)

ival-neg: 83.0ms (0.6% of total)

ival-cbrt: 81.0ms (0.6% of total)

exact: 44.0ms (0.3% of total)

ival-true: 23.0ms (0.2% of total)

ival-atan2: 23.0ms (0.2% of total)

ival-atan: 20.0ms (0.1% of total)

ival-assert: 11.0ms (0.1% of total)

ival-copysign: 4.0ms (0% of total)

ival-fabs: 3.0ms (0% of total)

eval22.3s (6.8%)

Memory: 151.4MiB live, 28 935.9MiB allocated
Compiler: Compiled 3 788 042 to 282 504 computations (92.5% saved)

prune19.5s (6%)

Memory: -807.3MiB live, 27 842.6MiB allocated
Counts: 119 070 → 2 254
Compiler: Compiled 91 372 to 41 829 computations (54.2% saved)

explain6.3s (1.9%)

Memory

-272.6MiB live, 7 211.4MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	4076	20
`log.f64`	`#f`	sensitivity	762	0
`/.f64`	`#f`	u/u	447	0
`sqrt.f64`	`#f`	oflow-rescue	364	0
`+.f64`	`#f`	cancellation	337	0
`/.f64`	`#f`	u/n	118	0
`pow.f64`	`(pow.f64 (+.f64 x #s(literal 1 binary64)) (/.f64 #s(literal 1 binary64) n))`	sensitivity	61	0
`/.f64`	`(/.f64 (.f64 eps (-.f64 (exp.f64 (.f64 (+.f64 a b) eps)) #s(literal 1 binary64))) (.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))))`	n/u	20	0
↳	`(*.f64 b eps)`	underflow	144
↳	`(-.f64 (exp.f64 (*.f64 a eps)) #s(literal 1 binary64))`	underflow	163
↳	`(-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))`	underflow	144
↳	`(.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64)))`	underflow	238
↳	`(*.f64 a eps)`	underflow	163
`sqrt.f64`	`#f`	uflow-rescue	20	0
`-.f64`	`#f`	nan-rescue	13	0
`/.f64`	`(/.f64 (-.f64 #s(literal 1 binary64) (cos.f64 x)) (*.f64 x x))`	n/o	7	0
↳	`(*.f64 x x)`	overflow	69
`sin.f64`	`(sin.f64 (+.f64 x eps))`	sensitivity	3	0
`tan.f64`	`(tan.f64 (+.f64 x eps))`	sensitivity	3	0
`cos.f64`	`(cos.f64 (+.f64 x eps))`	sensitivity	3	1
`exp.f64`	`(exp.f64 (neg.f64 x))`	sensitivity	3	0
`/.f64`	`(/.f64 (-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64)) (-.f64 (exp.f64 x) #s(literal 1 binary64)))`	o/o	2	0
↳	`(exp.f64 (*.f64 #s(literal 2 binary64) x))`	overflow	2
↳	`(-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64))`	overflow	2
↳	`(exp.f64 x)`	overflow	2
↳	`(-.f64 (exp.f64 x) #s(literal 1 binary64))`	overflow	2
`/.f64`	`(/.f64 (+.f64 (neg.f64 b) (sqrt.f64 (-.f64 (.f64 b b) (.f64 #s(literal 4 binary64) (.f64 a c))))) (.f64 #s(literal 2 binary64) a))`	o/n	1	0
↳	`(*.f64 b b)`	overflow	77
↳	`(.f64 #s(literal 4 binary64) (.f64 a c))`	overflow	25
↳	`(+.f64 (neg.f64 b) (sqrt.f64 (-.f64 (.f64 b b) (.f64 #s(literal 4 binary64) (*.f64 a c)))))`	overflow	1
↳	`(*.f64 a c)`	overflow	25
↳	`(-.f64 (.f64 b b) (.f64 #s(literal 4 binary64) (*.f64 a c)))`	overflow	89

Confusion

	Predicted +	Predicted -
+	5154	7
-	133	1874

Precision

0.9748439568753546

Recall

0.998643673706646

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5154	4	3
-	133	17	1857

Precision?

0.9717407686510927

Recall?

0.9994187173028483

Freqs

test

number	freq
0	1881
1	4528
2	614
3	96
4	49

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	28	0	0
-	0	0	0

Precision?

1.0

Recall?

1.0

Samples

1.7s	2 612×	2	valid
1.3s	5 806×	1	valid
485.0ms	5 724×	0	valid
86.0ms	192×	3	valid
2.0ms	2×	4	valid

Compiler

Compiled 2 197 to 763 computations (65.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.9s

ival-tan: 729.0ms (25.3% of total)

adjust: 335.0ms (11.6% of total)

ival-log: 264.0ms (9.2% of total)

ival-cos: 248.0ms (8.6% of total)

ival-sub: 220.0ms (7.6% of total)

ival-div: 216.0ms (7.5% of total)

ival-add: 174.0ms (6% of total)

ival-exp: 155.0ms (5.4% of total)

ival-sin: 151.0ms (5.2% of total)

ival-mult: 89.0ms (3.1% of total)

ival-pow: 88.0ms (3.1% of total)

ival-sqrt: 61.0ms (2.1% of total)

ival-log1p: 55.0ms (1.9% of total)

ival-expm1: 23.0ms (0.8% of total)

ival-atan: 19.0ms (0.7% of total)

ival-cbrt: 15.0ms (0.5% of total)

ival-true: 12.0ms (0.4% of total)

ival-neg: 11.0ms (0.4% of total)

exact: 8.0ms (0.3% of total)

ival-assert: 6.0ms (0.2% of total)

regimes5.0s (1.5%)

Memory

190.0MiB live, 6 475.7MiB allocated

Counts

5 383 → 378

Calls

43 calls:

1.4s	x
395.0ms	eps
271.0ms	a
249.0ms	b
214.0ms	(-.f64 (exp.f64 x) #s(literal 1 binary64))

Compiler

Compiled 3 304 to 2 195 computations (33.6% saved)

preprocess4.5s (1.4%)

Memory

259.6MiB live, 5 507.2MiB allocated

Algorithm

28×	egg-herbie

Rules

27 478×	`lower-fma.f64`
27 478×	`lower-fma.f32`
10 768×	`div-sub`
10 444×	`sub-neg`
9 190×	`lower-*.f32`

Stop Event

56×	iter limit
50×	saturated
6×	node limit

Compiler

Compiled 12 927 to 4 217 computations (67.4% saved)

series3.6s (1.1%)

Memory

55.8MiB live, 4 273.3MiB allocated

Counts

1 746 → 30 660

Calls

4122 calls:

Time	Variable		Point	Expression
235.0ms	x	@	0	(- (pow (+ x 1) (/ 1 n)) (pow x (/ 1 n)))
102.0ms	x	@	0	(+ (* (pow (+ x 1) 2/9) (pow (+ x 1) 1/9)) (neg (cbrt x)))
72.0ms	n	@	0	(log (/ 1 (- (pow (+ x 1) (/ 1 n)) (pow x (/ 1 n)))))
67.0ms	n	@	-inf	(+ (* n (+ (* x -1/2) 1)) (* x 1/2))
66.0ms	N	@	0	(log N)

analyze1.9s (0.6%)

Memory

77.9MiB live, 2 221.1MiB allocated

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
7.4%	4.5%	56.6%	38.9%	0%	0%	0%	1
22.3%	13.6%	47.5%	38.9%	0%	0%	0%	2
40.2%	23.5%	34.9%	38.9%	0%	2.7%	0%	3
53.4%	31.1%	27.2%	38.9%	0%	2.8%	0%	4
63%	36.3%	21.3%	38.9%	0%	3.6%	0%	5
65.9%	37.5%	19.4%	38.9%	0%	4.2%	0%	6
70.4%	38.8%	16.3%	38.9%	0%	6%	0%	7
73.6%	40.2%	14.4%	38.9%	0%	6.5%	0%	8
76.3%	40.9%	12.7%	38.9%	0%	7.5%	0%	9
78.4%	41.4%	11.4%	38.9%	0%	8.3%	0%	10
81.1%	42.4%	9.9%	38.9%	0%	8.8%	0%	11
82.3%	42.7%	9.2%	38.9%	0%	9.3%	0%	12

Compiler

Compiled 483 to 337 computations (30.2% saved)

bsearch1.3s (0.4%)

Memory

-40.6MiB live, 1 340.0MiB allocated

Algorithm

82×	binary-search
50×	left-value

Stop Event

78×	narrow-enough
4×	predicate-same

Samples

389.0ms	392×	2	valid
293.0ms	3 276×	0	valid
113.0ms	742×	1	valid
55.0ms	757×	0	invalid
5.0ms	22×	3	valid
4.0ms	43×	0	exit

Compiler

Compiled 18 410 to 12 313 computations (33.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 662.0ms

adjust: 303.0ms (45.8% of total)

ival-pow: 81.0ms (12.2% of total)

ival-mult: 75.0ms (11.3% of total)

ival-div: 51.0ms (7.7% of total)

ival-sub: 47.0ms (7.1% of total)

ival-sqrt: 28.0ms (4.2% of total)

ival-cos: 20.0ms (3% of total)

ival-neg: 16.0ms (2.4% of total)

ival-add: 15.0ms (2.3% of total)

ival-cbrt: 9.0ms (1.4% of total)

ival-sin: 5.0ms (0.8% of total)

ival-true: 4.0ms (0.6% of total)

exact: 3.0ms (0.5% of total)

ival-assert: 2.0ms (0.3% of total)

ival-expm1: 2.0ms (0.3% of total)

ival-exp: 1.0ms (0.2% of total)

start1.0ms (0%)

Memory: 1.2MiB live, 1.1MiB allocated

end0.0ms (0%)

Memory: 0.4MiB live, 0.4MiB allocated

sample1.9min (35.6%)

simplify55.5s (17%)

rewrite36.0s (11%)

soundness30.4s (9.3%)

localize24.1s (7.4%)

eval22.3s (6.8%)

prune19.5s (6%)

explain6.3s (1.9%)

regimes5.0s (1.5%)

preprocess4.5s (1.4%)

series3.6s (1.1%)

analyze1.9s (0.6%)

bsearch1.3s (0.4%)

start1.0ms (0%)

end0.0ms (0%)

Profiling