Metrics for Herbie run

Date:	Friday, August 2nd, 2024
Commit:	e9cefc1a on HEAD
Hostname:	nightly with Racket 8.11.1
Seed:	2024215
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.8min (34.8%)

Memory

375.3MiB live, 128 805.9MiB allocated

Samples

27.4s	41 311×	2	valid
23.6s	146 957×	0	invalid
18.6s	92 170×	1	valid
9.4s	4 948×	5	exit
8.6s	94 785×	0	valid
1.8s	2 899×	3	valid
521.0ms	2 235×	1	exit
332.0ms	4 263×	0	exit
16.0ms	6×	4	exit
3.0ms	3×	4	valid
1.0ms	2×	3	exit
1.0ms	2×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 1.2min

ival-tan: 13.0s (17.5% of total)

ival-pow: 9.6s (12.8% of total)

ival-mult: 5.5s (7.4% of total)

const: 5.3s (7.2% of total)

adjust: 5.2s (7% of total)

ival-cos: 4.0s (5.4% of total)

ival-sub: 3.8s (5.1% of total)

ival-div: 3.7s (4.9% of total)

ival-log: 3.5s (4.7% of total)

ival-sin: 3.5s (4.6% of total)

ival-add: 2.9s (3.9% of total)

ival-fabs: 2.2s (2.9% of total)

ival-<=: 1.9s (2.6% of total)

ival-exp: 1.9s (2.6% of total)

ival-expm1: 1.9s (2.5% of total)

ival-log1p: 1.2s (1.6% of total)

ival-sqrt: 1.1s (1.5% of total)

ival-<: 1.0s (1.4% of total)

ival-atan: 605.0ms (0.8% of total)

ival->: 590.0ms (0.8% of total)

ival-and: 588.0ms (0.8% of total)

ival-fmin: 542.0ms (0.7% of total)

ival-neg: 362.0ms (0.5% of total)

exact: 330.0ms (0.4% of total)

ival-cbrt: 247.0ms (0.3% of total)

ival-assert: 148.0ms (0.2% of total)

ival-true: 66.0ms (0.1% of total)

Bogosity

simplify1.2min (21.9%)

Memory

527.7MiB live, 85 850.3MiB allocated

Algorithm

246×	egg-herbie

Rules

2 109 544×	`lower-fma.f32`
2 108 908×	`lower-fma.f64`
759 034×	`lower-*.f32`
757 962×	`lower-*.f64`
461 240×	`lower-+.f32`

Stop Event

327×	iter limit
167×	node limit
79×	saturated

Counts

19 668 → 19 416

rewrite39.0s (12.4%)

Memory

476.8MiB live, 48 378.0MiB allocated

Algorithm

109×	batch-egg-rewrite

Rules

517 168×	`lower-fma.f32`
516 572×	`lower-fma.f64`
439 444×	`lower-*.f32`
438 408×	`lower-*.f64`
384 398×	`lower-/.f32`

Stop Event

225×	iter limit
108×	node limit
1×	saturated

Counts

1 208 → 62 339

soundness29.7s (9.4%)

Memory

-303.1MiB live, 18 766.6MiB allocated

Rules

1 184 056×	`lower-fma.f32`
1 183 710×	`lower-fma.f64`
600 130×	`lower-*.f32`
599 556×	`lower-*.f64`
322 442×	`lower-/.f32`

Stop Event

205×	iter limit
134×	node limit
24×	fuel
4×	done
2×	saturated

Compiler

Compiled 9 008 to 4 728 computations (47.5% saved)

localize16.8s (5.3%)

Memory

-289.5MiB live, 20 811.1MiB allocated

Samples

3.8s	7 187×	1	valid
3.6s	3 881×	2	valid
3.4s	14 926×	0	valid
334.0ms	1 212×	0	invalid
192.0ms	184×	3	valid
171.0ms	505×	1	exit
15.0ms	9×	5	exit

Compiler

Compiled 21 280 to 2 900 computations (86.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 8.3s

ival-mult: 1.9s (22.7% of total)

ival-div: 1.2s (14.6% of total)

ival-add: 1.2s (13.9% of total)

adjust: 862.0ms (10.4% of total)

const: 560.0ms (6.7% of total)

ival-log: 422.0ms (5.1% of total)

ival-tan: 354.0ms (4.3% of total)

ival-cos: 339.0ms (4.1% of total)

ival-sub: 326.0ms (3.9% of total)

ival-pow: 210.0ms (2.5% of total)

ival-sin: 208.0ms (2.5% of total)

ival-sqrt: 147.0ms (1.8% of total)

ival-exp: 134.0ms (1.6% of total)

ival-log1p: 102.0ms (1.2% of total)

ival-expm1: 95.0ms (1.1% of total)

ival-neg: 63.0ms (0.8% of total)

ival-cbrt: 51.0ms (0.6% of total)

ival-pow2: 48.0ms (0.6% of total)

exact: 35.0ms (0.4% of total)

ival-cosh: 27.0ms (0.3% of total)

ival-true: 23.0ms (0.3% of total)

ival-atan2: 21.0ms (0.3% of total)

ival-atan: 15.0ms (0.2% of total)

ival-copysign: 13.0ms (0.2% of total)

ival-assert: 12.0ms (0.1% of total)

ival-fabs: 5.0ms (0.1% of total)

eval16.8s (5.3%)

Memory: 333.1MiB live, 23 313.3MiB allocated
Compiler: Compiled 3 226 231 to 234 124 computations (92.7% saved)

prune13.5s (4.3%)

Memory: 97.4MiB live, 23 768.7MiB allocated
Counts: 98 231 → 2 167
Compiler: Compiled 81 624 to 38 215 computations (53.2% saved)

explain6.1s (1.9%)

Memory

90.9MiB live, 7 064.3MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	4082	29
`log.f64`	`#f`	sensitivity	760	2
`/.f64`	`#f`	u/u	446	0
`sqrt.f64`	`#f`	oflow-rescue	368	0
`+.f64`	`#f`	cancellation	333	0
`/.f64`	`#f`	u/n	124	0
`pow.f64`	`(pow.f64 (+.f64 x #s(literal 1 binary64)) (/.f64 #s(literal 1 binary64) n))`	sensitivity	83	0
`/.f64`	`(/.f64 (.f64 eps (-.f64 (exp.f64 (.f64 (+.f64 a b) eps)) #s(literal 1 binary64))) (.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))))`	n/u	24	0
↳	`(*.f64 b eps)`	underflow	155
↳	`(-.f64 (exp.f64 (*.f64 a eps)) #s(literal 1 binary64))`	underflow	149
↳	`(-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))`	underflow	155
↳	`(.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64)))`	underflow	238
↳	`(*.f64 a eps)`	underflow	149
`-.f64`	`#f`	nan-rescue	20	0
`sqrt.f64`	`#f`	uflow-rescue	18	0
`/.f64`	`(/.f64 (-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64)) (-.f64 (exp.f64 x) #s(literal 1 binary64)))`	o/o	3	0
↳	`(exp.f64 (*.f64 #s(literal 2 binary64) x))`	overflow	4
↳	`(-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64))`	overflow	4
↳	`(exp.f64 x)`	overflow	3
↳	`(-.f64 (exp.f64 x) #s(literal 1 binary64))`	overflow	3
`sin.f64`	`(sin.f64 (+.f64 x eps))`	sensitivity	3	2
`tan.f64`	`(tan.f64 (+.f64 x eps))`	sensitivity	3	2
`cos.f64`	`(cos.f64 (+.f64 x eps))`	sensitivity	3	1
`/.f64`	`(/.f64 (-.f64 #s(literal 1 binary64) (cos.f64 x)) (*.f64 x x))`	n/o	2	0
↳	`(*.f64 x x)`	overflow	56
`exp.f64`	`(exp.f64 (neg.f64 x))`	sensitivity	1	1
`/.f64`	`(/.f64 (-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64)) (-.f64 (exp.f64 x) #s(literal 1 binary64)))`	o/n	1	0
↳	`(exp.f64 (*.f64 #s(literal 2 binary64) x))`	overflow	4
↳	`(-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64))`	overflow	4

Confusion

	Predicted +	Predicted -
+	5159	24
-	142	1843

Precision

0.973212601395963

Recall

0.9953694771367934

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5159	19	5
-	142	12	1831

Precision?

0.9711177794448612

Recall?

0.9990353077368319

Freqs

test

number	freq
0	1867
1	4526
2	623
3	106
4	46

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	28	0	0
-	0	0	0

Precision?

1.0

Recall?

1.0

Samples

1.8s	2 574×	2	valid
1.1s	5 752×	1	valid
543.0ms	5 812×	0	valid
185.0ms	198×	3	valid

Compiler

Compiled 2 522 to 980 computations (61.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.9s

ival-tan: 790.0ms (27.4% of total)

adjust: 381.0ms (13.2% of total)

ival-sin: 231.0ms (8% of total)

ival-log: 215.0ms (7.5% of total)

ival-cos: 204.0ms (7.1% of total)

ival-sub: 173.0ms (6% of total)

ival-pow: 158.0ms (5.5% of total)

ival-div: 150.0ms (5.2% of total)

ival-exp: 126.0ms (4.4% of total)

ival-mult: 126.0ms (4.4% of total)

ival-add: 84.0ms (2.9% of total)

ival-log1p: 75.0ms (2.6% of total)

ival-sqrt: 74.0ms (2.6% of total)

ival-expm1: 24.0ms (0.8% of total)

ival-atan: 19.0ms (0.7% of total)

ival-cbrt: 15.0ms (0.5% of total)

ival-true: 12.0ms (0.4% of total)

ival-neg: 11.0ms (0.4% of total)

exact: 8.0ms (0.3% of total)

ival-assert: 6.0ms (0.2% of total)

preprocess4.9s (1.6%)

Memory

-155.8MiB live, 5 688.3MiB allocated

Algorithm

28×	egg-herbie

Rules

27 478×	`lower-fma.f64`
27 478×	`lower-fma.f32`
10 768×	`div-sub`
10 444×	`sub-neg`
9 190×	`lower-*.f32`

Stop Event

56×	iter limit
50×	saturated
6×	node limit

Compiler

Compiled 9 868 to 3 664 computations (62.9% saved)

regimes4.2s (1.3%)

Memory

-82.7MiB live, 6 062.4MiB allocated

Counts

4 706 → 331

Calls

43 calls:

1.1s	x
441.0ms	eps
171.0ms	b
152.0ms	a
144.0ms	(-.f64 (sin.f64 (+.f64 x eps)) (sin.f64 x))

Compiler

Compiled 3 185 to 2 123 computations (33.3% saved)

series2.7s (0.9%)

Memory

-22.8MiB live, 3 176.7MiB allocated

Counts

1 208 → 19 668

Calls

3933 calls:

Time	Variable		Point	Expression
105.0ms	n	@	0	(/ 1 (/ n (log (/ (+ x 1) x))))
95.0ms	x	@	0	(pow x (/ 1 n))
91.0ms	x	@	inf	(+ (* (* x x) (+ (* (* x x) (+ (* x (* x -1/40320)) 1/720)) -1/24)) 1/2)
79.0ms	x	@	0	(* 1/3 (log x))
58.0ms	N	@	0	(pow (log (+ 1 N)) -2)

analyze1.8s (0.6%)

Memory

2.6MiB live, 2 187.0MiB allocated

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
7.4%	4.5%	56.6%	38.9%	0%	0%	0%	1
22.3%	13.6%	47.5%	38.9%	0%	0%	0%	2
40.2%	23.5%	34.9%	38.9%	0%	2.7%	0%	3
53.4%	31.1%	27.2%	38.9%	0%	2.8%	0%	4
63%	36.3%	21.3%	38.9%	0%	3.6%	0%	5
65.9%	37.5%	19.4%	38.9%	0%	4.2%	0%	6
70.4%	38.8%	16.3%	38.9%	0%	6%	0%	7
73.6%	40.2%	14.4%	38.9%	0%	6.5%	0%	8
76.3%	40.9%	12.7%	38.9%	0%	7.5%	0%	9
78.4%	41.4%	11.4%	38.9%	0%	8.3%	0%	10
81.1%	42.4%	9.9%	38.9%	0%	8.8%	0%	11
82.3%	42.7%	9.2%	38.9%	0%	9.3%	0%	12

Compiler

Compiled 483 to 337 computations (30.2% saved)

bsearch1.0s (0.3%)

Memory

-79.6MiB live, 1 208.2MiB allocated

Algorithm

76×	binary-search
31×	left-value

Stop Event

71×	narrow-enough
5×	predicate-same

Samples

316.0ms	3 800×	0	valid
154.0ms	971×	0	invalid
111.0ms	634×	1	valid
101.0ms	375×	2	valid
2.0ms	26×	0	exit
2.0ms	7×	3	valid
0.0ms	1×	1	exit

Compiler

Compiled 15 483 to 11 227 computations (27.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 446.0ms

ival-mult: 130.0ms (29.1% of total)

ival-pow: 76.0ms (17% of total)

ival-div: 51.0ms (11.4% of total)

ival-sub: 43.0ms (9.6% of total)

ival-sqrt: 36.0ms (8.1% of total)

ival-add: 30.0ms (6.7% of total)

adjust: 27.0ms (6.1% of total)

ival-neg: 22.0ms (4.9% of total)

ival-cos: 11.0ms (2.5% of total)

ival-sin: 4.0ms (0.9% of total)

ival-expm1: 4.0ms (0.9% of total)

ival-true: 4.0ms (0.9% of total)

exact: 3.0ms (0.7% of total)

ival-assert: 2.0ms (0.4% of total)

ival-exp: 1.0ms (0.2% of total)

ival-cbrt: 1.0ms (0.2% of total)

ival-log1p: 0.0ms (0% of total)

ival-log: 0.0ms (0% of total)

end0.0ms (0%)

Memory: 0.3MiB live, 0.3MiB allocated

sample1.8min (34.8%)

simplify1.2min (21.9%)

rewrite39.0s (12.4%)

soundness29.7s (9.4%)

localize16.8s (5.3%)

eval16.8s (5.3%)

prune13.5s (4.3%)

explain6.1s (1.9%)

preprocess4.9s (1.6%)

regimes4.2s (1.3%)

series2.7s (0.9%)

analyze1.8s (0.6%)

bsearch1.0s (0.3%)

end0.0ms (0%)

Profiling