Metrics for Herbie run

Date:	Wednesday, July 17th, 2024
Commit:	c34c16ee on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024199
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.8min (33.5%)

Memory

173.9MiB live, 132 566.5MiB allocated

Samples

28.3s	41 166×	2	valid
23.8s	145 800×	0	invalid
18.9s	91 758×	1	valid
8.5s	4 855×	5	exit
8.4s	94 880×	0	valid
2.3s	3 223×	3	valid
544.0ms	2 288×	1	exit
374.0ms	4 349×	0	exit
53.0ms	141×	4	valid
44.0ms	109×	2	exit
3.0ms	2×	4	exit

Precisions

Click to see histograms. Total time spent on operations: 1.3min

ival-tan: 12.9s (17.2% of total)

ival-pow: 8.7s (11.6% of total)

ival-mult: 6.3s (8.4% of total)

adjust: 4.9s (6.5% of total)

const: 4.8s (6.4% of total)

ival-cos: 4.5s (6% of total)

ival-div: 3.9s (5.2% of total)

ival-add: 3.9s (5.2% of total)

ival-sub: 3.8s (5% of total)

ival-log: 3.3s (4.4% of total)

ival-sin: 3.0s (4% of total)

ival-fabs: 2.1s (2.8% of total)

ival-<=: 2.0s (2.7% of total)

ival-exp: 2.0s (2.7% of total)

ival-expm1: 1.9s (2.5% of total)

ival-<: 1.5s (1.9% of total)

ival-sqrt: 1.2s (1.7% of total)

ival-log1p: 1.1s (1.5% of total)

ival-fmin: 688.0ms (0.9% of total)

ival-and: 611.0ms (0.8% of total)

exact: 436.0ms (0.6% of total)

ival-neg: 402.0ms (0.5% of total)

ival->: 363.0ms (0.5% of total)

ival-atan: 307.0ms (0.4% of total)

ival-cbrt: 273.0ms (0.4% of total)

ival-assert: 174.0ms (0.2% of total)

ival-true: 71.0ms (0.1% of total)

Bogosity

simplify1.2min (21.2%)

Memory

369.5MiB live, 87 277.7MiB allocated

Algorithm

240×	egg-herbie

Rules

2 040 040×	`accelerator-lowering-fma.f32`
2 040 040×	`accelerator-lowering-fma.f64`
742 022×	`-lowering-.f32`
742 022×	`-lowering-.f64`
460 448×	`+-lowering-+.f32`

Stop Event

212×	iter limit
162×	node limit
78×	saturated

Counts

24 012 → 24 012

rewrite42.7s (12.9%)

Memory

336.5MiB live, 53 978.5MiB allocated

Algorithm

106×	batch-egg-rewrite

Rules

513 522×	`accelerator-lowering-fma.f32`
513 522×	`accelerator-lowering-fma.f64`
427 260×	`-lowering-.f32`
427 260×	`-lowering-.f64`
395 566×	`/-lowering-/.f64`

Stop Event

110×	iter limit
105×	node limit
1×	saturated

Counts

1 425 → 71 722

soundness30.3s (9.2%)

Memory

228.9MiB live, 20 290.0MiB allocated

Rules

1 176 106×	`accelerator-lowering-fma.f32`
1 176 106×	`accelerator-lowering-fma.f64`
594 172×	`-lowering-.f32`
594 172×	`-lowering-.f64`
324 006×	`/-lowering-/.f64`

Stop Event

135×	iter limit
131×	node limit
23×	fuel
5×	done
2×	saturated

Compiler

Compiled 9 376 to 5 045 computations (46.2% saved)

eval19.2s (5.8%)

Memory: 333.0MiB live, 28 231.9MiB allocated
Compiler: Compiled 3 436 269 to 277 468 computations (91.9% saved)

localize17.2s (5.2%)

Memory

185.5MiB live, 22 863.2MiB allocated

Samples

4.3s	4 177×	2	valid
3.5s	7 046×	1	valid
3.1s	14 100×	0	valid
726.0ms	676×	3	valid
233.0ms	904×	0	invalid
135.0ms	119×	5	exit
57.0ms	39×	4	valid
19.0ms	75×	0	exit

Compiler

Compiled 17 878 to 2 818 computations (84.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 8.9s

ival-mult: 1.8s (20.3% of total)

ival-div: 1.3s (14.9% of total)

adjust: 1.1s (12.8% of total)

ival-add: 1.0s (11.5% of total)

const: 482.0ms (5.4% of total)

ival-cos: 456.0ms (5.1% of total)

ival-tan: 432.0ms (4.8% of total)

ival-log: 362.0ms (4.1% of total)

ival-sub: 355.0ms (4% of total)

ival-pow: 295.0ms (3.3% of total)

ival-sqrt: 211.0ms (2.4% of total)

ival-cbrt: 182.0ms (2% of total)

ival-neg: 149.0ms (1.7% of total)

ival-exp: 147.0ms (1.6% of total)

ival-log1p: 140.0ms (1.6% of total)

ival-sin: 131.0ms (1.5% of total)

ival-pow2: 65.0ms (0.7% of total)

exact: 50.0ms (0.6% of total)

ival-expm1: 42.0ms (0.5% of total)

ival-cosh: 30.0ms (0.3% of total)

ival-atan2: 25.0ms (0.3% of total)

ival-true: 24.0ms (0.3% of total)

ival-atan: 15.0ms (0.2% of total)

ival-assert: 11.0ms (0.1% of total)

ival-fabs: 4.0ms (0% of total)

prune16.6s (5%)

Memory: -710.8MiB live, 27 331.9MiB allocated
Counts: 113 446 → 2 267
Compiler: Compiled 84 233 to 40 611 computations (51.8% saved)

explain5.9s (1.8%)

Memory

188.3MiB live, 8 456.6MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	4171	34
`log.f64`	`#f`	sensitivity	762	0
`/.f64`	`#f`	u/u	447	0
`sqrt.f64`	`#f`	oflow-rescue	367	0
`+.f64`	`#f`	cancellation	346	0
`/.f64`	`#f`	u/n	88	0
`pow.f64`	`#f`	sensitivity	63	0
`/.f64`	`(/.f64 (.f64 eps (-.f64 (exp.f64 (.f64 (+.f64 a b) eps)) #s(literal 1 binary64))) (.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))))`	n/u	24	0
↳	`(*.f64 b eps)`	underflow	144
↳	`(-.f64 (exp.f64 (*.f64 a eps)) #s(literal 1 binary64))`	underflow	160
↳	`(-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))`	underflow	144
↳	`(.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64)))`	underflow	239
↳	`(*.f64 a eps)`	underflow	160
`sqrt.f64`	`#f`	uflow-rescue	20	0
`-.f64`	`#f`	nan-rescue	10	0
`/.f64`	`(/.f64 (-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64)) (-.f64 (exp.f64 x) #s(literal 1 binary64)))`	o/o	4	0
↳	`(exp.f64 (*.f64 #s(literal 2 binary64) x))`	overflow	4
↳	`(-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64))`	overflow	4
↳	`(exp.f64 x)`	overflow	4
↳	`(-.f64 (exp.f64 x) #s(literal 1 binary64))`	overflow	4
`cos.f64`	`(cos.f64 (+.f64 x eps))`	sensitivity	3	2
`sin.f64`	`(sin.f64 (+.f64 x eps))`	sensitivity	3	2
`tan.f64`	`(tan.f64 (+.f64 x eps))`	sensitivity	3	2
`/.f64`	`(/.f64 (-.f64 #s(literal 1 binary64) (cos.f64 x)) (*.f64 x x))`	n/o	2	0
↳	`(*.f64 x x)`	overflow	67
`exp.f64`	`(exp.f64 (neg.f64 x))`	sensitivity	1	0

Confusion

	Predicted +	Predicted -
+	5184	21
-	152	1811

Precision

0.9715142428785607

Recall

0.9959654178674352

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5184	19	2
-	152	15	1796

Precision?

0.968901303538175

Recall?

0.9996157540826128

Freqs

test

number	freq
0	1832
1	4553
2	638
3	95
4	50

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	28	0	0
-	0	0	0

Precision?

1.0

Recall?

1.0

Samples

1.6s	2 568×	2	valid
1.0s	5 696×	1	valid
541.0ms	5 834×	0	valid
119.0ms	224×	3	valid
6.0ms	14×	4	valid

Compiler

Compiled 2 522 to 980 computations (61.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.6s

ival-tan: 713.0ms (26.9% of total)

ival-cos: 256.0ms (9.7% of total)

ival-log: 229.0ms (8.7% of total)

adjust: 213.0ms (8% of total)

ival-sub: 206.0ms (7.8% of total)

ival-div: 165.0ms (6.2% of total)

ival-sin: 163.0ms (6.2% of total)

ival-exp: 156.0ms (5.9% of total)

ival-mult: 115.0ms (4.3% of total)

ival-pow: 105.0ms (4% of total)

ival-add: 94.0ms (3.6% of total)

ival-log1p: 62.0ms (2.3% of total)

ival-sqrt: 57.0ms (2.2% of total)

ival-expm1: 27.0ms (1% of total)

ival-neg: 20.0ms (0.8% of total)

ival-atan: 19.0ms (0.7% of total)

ival-cbrt: 15.0ms (0.6% of total)

exact: 13.0ms (0.5% of total)

ival-true: 13.0ms (0.5% of total)

ival-assert: 6.0ms (0.2% of total)

preprocess5.2s (1.6%)

Memory

174.6MiB live, 6 263.4MiB allocated

Algorithm

56×	egg-herbie

Rules

27 478×	`accelerator-lowering-fma.f32`
27 478×	`accelerator-lowering-fma.f64`
13 562×	`div-sub`
10 440×	`sub-neg`
9 190×	`-lowering-.f32`

Stop Event

49×	saturated
28×	iter limit
7×	node limit

Compiler

Compiled 10 136 to 3 832 computations (62.2% saved)

regimes5.0s (1.5%)

Memory

-227.3MiB live, 6 134.0MiB allocated

Counts

5 110 → 355

Calls

43 calls:

1.4s	x
327.0ms	b
313.0ms	eps
257.0ms	N
166.0ms	a

Compiler

Compiled 3 121 to 2 082 computations (33.3% saved)

series2.9s (0.9%)

Memory

-309.5MiB live, 3 908.4MiB allocated

Counts

1 425 → 24 012

Calls

4800 calls:

Time	Variable		Point	Expression
55.0ms	x	@	-inf	(pow x (/ 1 n))
54.0ms	b	@	0	(+ (* 1/2 (/ (* (+ b a) (+ b a)) (* b a))) (/ (* (+ b a) (* -1/2 (+ (* b (* b a)) (* b (* a a))))) (* b (* b (* a a)))))
50.0ms	c	@	-inf	(* (+ (* b b) (+ (* b b) (* a (* 4 c)))) (/ (/ 1/2 a) (- b (sqrt (+ (* a (* c -4)) (* b b))))))
46.0ms	eps	@	inf	(* eps (sin x))
44.0ms	n	@	0	(* n (log n))

bsearch2.6s (0.8%)

Memory

-168.1MiB live, 2 860.6MiB allocated

Algorithm

83×	binary-search
42×	left-value

Stop Event

73×	narrow-enough
10×	predicate-same

Samples

798.0ms	6 999×	0	valid
283.0ms	1 663×	1	valid
280.0ms	965×	2	valid
145.0ms	1 686×	0	invalid
35.0ms	103×	0	exit
29.0ms	82×	3	valid
6.0ms	19×	4	valid
0.0ms	1×	1	exit

Compiler

Compiled 16 634 to 11 989 computations (27.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.1s

ival-mult: 223.0ms (20% of total)

ival-pow: 172.0ms (15.4% of total)

ival-cos: 143.0ms (12.8% of total)

ival-div: 131.0ms (11.8% of total)

ival-sub: 103.0ms (9.2% of total)

adjust: 93.0ms (8.3% of total)

ival-sqrt: 83.0ms (7.5% of total)

ival-neg: 72.0ms (6.5% of total)

ival-add: 44.0ms (4% of total)

ival-cbrt: 15.0ms (1.3% of total)

ival-true: 9.0ms (0.8% of total)

exact: 7.0ms (0.6% of total)

ival-sin: 7.0ms (0.6% of total)

ival-assert: 5.0ms (0.4% of total)

ival-expm1: 5.0ms (0.4% of total)

ival-log1p: 1.0ms (0.1% of total)

ival-log: 1.0ms (0.1% of total)

ival-exp: 0.0ms (0% of total)

analyze1.8s (0.5%)

Memory

-49.4MiB live, 2 226.0MiB allocated

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
7.4%	4.5%	56.6%	38.9%	0%	0%	0%	1
22.3%	13.6%	47.5%	38.9%	0%	0%	0%	2
40.2%	23.5%	34.9%	38.9%	0%	2.7%	0%	3
53.4%	31.1%	27.2%	38.9%	0%	2.8%	0%	4
63%	36.3%	21.3%	38.9%	0%	3.6%	0%	5
65.9%	37.5%	19.4%	38.9%	0%	4.2%	0%	6
70.4%	38.8%	16.3%	38.9%	0%	6%	0%	7
73.6%	40.2%	14.4%	38.9%	0%	6.5%	0%	8
76.3%	40.9%	12.7%	38.9%	0%	7.5%	0%	9
78.4%	41.4%	11.4%	38.9%	0%	8.3%	0%	10
81.1%	42.4%	9.9%	38.9%	0%	8.8%	0%	11
82.3%	42.7%	9.2%	38.9%	0%	9.3%	0%	12

Compiler

Compiled 483 to 337 computations (30.2% saved)

end0.0ms (0%)

Memory: 0.3MiB live, 0.3MiB allocated

sample1.8min (33.5%)

simplify1.2min (21.2%)

rewrite42.7s (12.9%)

soundness30.3s (9.2%)

eval19.2s (5.8%)

localize17.2s (5.2%)

prune16.6s (5%)

explain5.9s (1.8%)

preprocess5.2s (1.6%)

regimes5.0s (1.5%)

series2.9s (0.9%)

bsearch2.6s (0.8%)

analyze1.8s (0.5%)

end0.0ms (0%)

Profiling