Metrics for Herbie run

Date:	Friday, July 12th, 2024
Commit:	0efbdb17 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024194
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.9min (32.7%)

Memory

169.0MiB live, 135 645.8MiB allocated

Samples

28.9s	43 494×	2	valid
23.7s	144 930×	0	invalid
20.9s	94 923×	1	valid
10.0s	6 124×	5	exit
7.8s	89 509×	0	valid
2.9s	3 237×	3	valid
295.0ms	4 217×	0	exit
165.0ms	1 058×	1	exit
72.0ms	63×	4	exit
6.0ms	5×	4	valid
4.0ms	1×	3	exit
2.0ms	2×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 1.3min

ival-tan: 12.6s (16% of total)

ival-pow: 9.5s (12.1% of total)

ival-mult: 6.1s (7.7% of total)

const: 5.3s (6.7% of total)

ival-sub: 4.7s (5.9% of total)

ival-cos: 4.5s (5.8% of total)

ival-add: 4.5s (5.7% of total)

adjust: 4.1s (5.3% of total)

ival-log: 4.1s (5.2% of total)

ival-sin: 3.7s (4.7% of total)

ival-div: 3.7s (4.7% of total)

ival-exp: 2.4s (3% of total)

ival-fabs: 2.3s (2.9% of total)

ival-<=: 2.0s (2.6% of total)

ival-expm1: 1.8s (2.3% of total)

ival-sqrt: 1.3s (1.6% of total)

ival-log1p: 1.2s (1.6% of total)

ival-<: 1.2s (1.5% of total)

ival-and: 614.0ms (0.8% of total)

ival-atan: 585.0ms (0.7% of total)

ival-fmin: 504.0ms (0.6% of total)

ival-neg: 474.0ms (0.6% of total)

ival->: 443.0ms (0.6% of total)

exact: 411.0ms (0.5% of total)

ival-cbrt: 307.0ms (0.4% of total)

ival-assert: 164.0ms (0.2% of total)

ival-true: 65.0ms (0.1% of total)

Bogosity

simplify1.3min (22%)

Memory

-313.0MiB live, 100 896.1MiB allocated

Algorithm

244×	egg-herbie

Rules

1 953 726×	`accelerator-lowering-fma.f32`
1 953 726×	`accelerator-lowering-fma.f64`
722 080×	`-lowering-.f32`
722 080×	`-lowering-.f64`
421 602×	`+-lowering-+.f32`

Stop Event

214×	iter limit
160×	node limit
86×	saturated

Counts

24 060 → 24 060

rewrite46.4s (13.3%)

Memory

199.1MiB live, 60 850.6MiB allocated

Algorithm

108×	batch-egg-rewrite

Rules

514 724×	`accelerator-lowering-fma.f32`
514 724×	`accelerator-lowering-fma.f64`
393 410×	`-lowering-.f32`
393 410×	`-lowering-.f64`
349 346×	`/-lowering-/.f64`

Stop Event

119×	iter limit
103×	node limit
3×	saturated
3×	unsound

Counts

1 454 → 81 289

soundness31.1s (8.9%)

Memory

-14.6MiB live, 21 733.6MiB allocated

Rules

1 210 702×	`accelerator-lowering-fma.f32`
1 210 702×	`accelerator-lowering-fma.f64`
624 640×	`-lowering-.f32`
624 640×	`-lowering-.f64`
338 244×	`/-lowering-/.f64`

Stop Event

150×	iter limit
141×	node limit
23×	fuel
5×	done
2×	saturated
1×	unsound

Compiler

Compiled 9 285 to 5 045 computations (45.7% saved)

eval22.0s (6.3%)

Memory: 882.8MiB live, 33 100.3MiB allocated
Compiler: Compiled 4 382 420 to 321 659 computations (92.7% saved)

prune18.0s (5.2%)

Memory: -220.3MiB live, 31 975.8MiB allocated
Counts: 128 332 → 2 241
Compiler: Compiled 90 352 to 42 480 computations (53% saved)

localize16.8s (4.8%)

Memory

-244.2MiB live, 23 072.2MiB allocated

Samples

3.6s	7 471×	1	valid
3.5s	14 363×	0	valid
3.5s	3 877×	2	valid
291.0ms	1 112×	0	invalid
281.0ms	237×	3	valid
146.0ms	443×	1	exit
42.0ms	72×	0	exit
39.0ms	58×	1	invalid
9.0ms	2×	5	exit
6.0ms	12×	2	exit
1.0ms	1×	4	valid

Compiler

Compiled 19 757 to 2 925 computations (85.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 8.8s

ival-mult: 2.0s (23.1% of total)

ival-add: 1.6s (18.3% of total)

ival-div: 998.0ms (11.3% of total)

adjust: 915.0ms (10.4% of total)

const: 462.0ms (5.2% of total)

ival-tan: 387.0ms (4.4% of total)

ival-cos: 364.0ms (4.1% of total)

ival-sub: 334.0ms (3.8% of total)

ival-pow: 315.0ms (3.6% of total)

ival-log: 281.0ms (3.2% of total)

ival-sqrt: 241.0ms (2.7% of total)

ival-sin: 169.0ms (1.9% of total)

ival-exp: 151.0ms (1.7% of total)

ival-log1p: 119.0ms (1.3% of total)

ival-neg: 84.0ms (1% of total)

ival-pow2: 59.0ms (0.7% of total)

ival-cbrt: 55.0ms (0.6% of total)

exact: 54.0ms (0.6% of total)

ival-cosh: 52.0ms (0.6% of total)

ival-atan2: 35.0ms (0.4% of total)

ival-expm1: 31.0ms (0.4% of total)

ival-true: 23.0ms (0.3% of total)

ival-atan: 21.0ms (0.2% of total)

ival-assert: 12.0ms (0.1% of total)

ival-fabs: 7.0ms (0.1% of total)

ival-copysign: 5.0ms (0.1% of total)

explain6.2s (1.8%)

Memory

-108.4MiB live, 7 880.8MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	4115	27
`log.f64`	`#f`	sensitivity	764	0
`/.f64`	`#f`	u/u	451	0
`sqrt.f64`	`#f`	oflow-rescue	382	0
`+.f64`	`#f`	cancellation	313	0
`/.f64`	`#f`	u/n	123	0
`pow.f64`	`(pow.f64 (+.f64 x #s(literal 1 binary64)) (/.f64 #s(literal 1 binary64) n))`	sensitivity	65	0
`sqrt.f64`	`#f`	uflow-rescue	24	0
`/.f64`	`(/.f64 (.f64 eps (-.f64 (exp.f64 (.f64 (+.f64 a b) eps)) #s(literal 1 binary64))) (.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))))`	n/u	20	0
↳	`(*.f64 b eps)`	underflow	140
↳	`(-.f64 (exp.f64 (*.f64 a eps)) #s(literal 1 binary64))`	underflow	160
↳	`(-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))`	underflow	140
↳	`(.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64)))`	underflow	239
↳	`(*.f64 a eps)`	underflow	160
`-.f64`	`#f`	nan-rescue	14	0
`/.f64`	`(/.f64 (-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64)) (-.f64 (exp.f64 x) #s(literal 1 binary64)))`	o/o	8	0
↳	`(exp.f64 (*.f64 #s(literal 2 binary64) x))`	overflow	8
↳	`(*.f64 #s(literal 2 binary64) x)`	overflow	1
↳	`(-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64))`	overflow	8
↳	`(exp.f64 x)`	overflow	8
↳	`(-.f64 (exp.f64 x) #s(literal 1 binary64))`	overflow	8
`/.f64`	`#f`	n/o	6	0
`sin.f64`	`(sin.f64 (+.f64 x eps))`	sensitivity	3	0
`tan.f64`	`(tan.f64 (+.f64 x eps))`	sensitivity	3	0
`cos.f64`	`(cos.f64 (+.f64 x eps))`	sensitivity	3	2
`exp.f64`	`#f`	sensitivity	2	2
`tan.f64`	`(tan.f64 (+.f64 x eps))`	cancellation	1	0
`sin.f64`	`(sin.f64 (+.f64 x eps))`	cancellation	1	0

Confusion

	Predicted +	Predicted -
+	5195	6
-	141	1826

Precision

0.973575712143928

Recall

0.9988463756969813

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5195	4	2
-	141	27	1799

Precision?

0.9686975964225825

Recall?

0.9996154585656605

Freqs

test

number	freq
0	1832
1	4575
2	613
3	95
4	53

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	28	0	0
-	0	0	0

Precision?

1.0

Recall?

1.0

Samples

1.5s	2 592×	2	valid
1.0s	5 988×	1	valid
469.0ms	5 538×	0	valid
142.0ms	216×	3	valid
2.0ms	2×	4	valid

Compiler

Compiled 2 522 to 980 computations (61.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.5s

ival-tan: 631.0ms (25.2% of total)

ival-cos: 189.0ms (7.5% of total)

ival-log: 187.0ms (7.5% of total)

ival-exp: 186.0ms (7.4% of total)

ival-sub: 161.0ms (6.4% of total)

adjust: 156.0ms (6.2% of total)

ival-sin: 155.0ms (6.2% of total)

ival-div: 150.0ms (6% of total)

ival-add: 128.0ms (5.1% of total)

ival-pow: 121.0ms (4.8% of total)

ival-neg: 93.0ms (3.7% of total)

ival-mult: 90.0ms (3.6% of total)

ival-sqrt: 86.0ms (3.4% of total)

ival-log1p: 75.0ms (3% of total)

ival-expm1: 30.0ms (1.2% of total)

ival-atan: 20.0ms (0.8% of total)

ival-cbrt: 15.0ms (0.6% of total)

exact: 13.0ms (0.5% of total)

ival-true: 13.0ms (0.5% of total)

ival-assert: 6.0ms (0.2% of total)

regimes5.5s (1.6%)

Memory

-114.5MiB live, 6 759.3MiB allocated

Counts

4 813 → 332

Calls

43 calls:

1.4s	x
505.0ms	eps
338.0ms	n
313.0ms	(/.f64 (-.f64 (neg.f64 b) (sqrt.f64 (-.f64 (.f64 b b) (.f64 #s(literal 4 binary64) (.f64 a c))))) (.f64 #s(literal 2 binary64) a))
296.0ms	(/.f64 #s(literal 1 binary64) n)

Compiler

Compiled 3 213 to 2 148 computations (33.1% saved)

preprocess5.2s (1.5%)

Memory

38.7MiB live, 6 595.9MiB allocated

Algorithm

56×	egg-herbie

Rules

27 478×	`accelerator-lowering-fma.f32`
27 478×	`accelerator-lowering-fma.f64`
13 562×	`div-sub`
10 440×	`sub-neg`
9 190×	`-lowering-.f32`

Stop Event

49×	saturated
28×	iter limit
7×	node limit

Compiler

Compiled 10 102 to 3 836 computations (62% saved)

series3.3s (0.9%)

Memory

170.3MiB live, 4 326.7MiB allocated

Counts

1 454 → 24 060

Calls

4836 calls:

Time	Variable		Point	Expression
201.0ms	b_2	@	-inf	(- (neg b_2) (sqrt (+ (* (exp (log b_2)) (exp (log b_2))) (- 0 (* a c)))))
92.0ms	c	@	-inf	(/ a (- b_2 (sqrt (- 0 (+ (* b_2 b_2) (+ (* a c) 0))))))
64.0ms	x	@	0	(/ (* (pow x 1/2) (cbrt x)) (pow x 1/2))
56.0ms	n	@	inf	(/ (log (/ (+ 1 x) x)) n)
52.0ms	b_2	@	0	(+ (neg b_2) (pow (* (+ (* b_2 b_2) (* a c)) (+ (* b_2 b_2) (* a c))) 1/4))

analyze1.9s (0.5%)

Memory

-251.9MiB live, 2 084.8MiB allocated

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
7.4%	4.5%	56.6%	38.9%	0%	0%	0%	1
22.3%	13.6%	47.5%	38.9%	0%	0%	0%	2
40.2%	23.5%	34.9%	38.9%	0%	2.7%	0%	3
53.4%	31.1%	27.2%	38.9%	0%	2.8%	0%	4
63%	36.3%	21.3%	38.9%	0%	3.6%	0%	5
65.9%	37.5%	19.4%	38.9%	0%	4.2%	0%	6
70.4%	38.8%	16.3%	38.9%	0%	6%	0%	7
73.6%	40.2%	14.4%	38.9%	0%	6.5%	0%	8
76.3%	40.9%	12.7%	38.9%	0%	7.5%	0%	9
78.4%	41.4%	11.4%	38.9%	0%	8.3%	0%	10
81.1%	42.4%	9.9%	38.9%	0%	8.8%	0%	11
82.3%	42.7%	9.2%	38.9%	0%	9.3%	0%	12

Compiler

Compiled 483 to 337 computations (30.2% saved)

bsearch1.6s (0.5%)

Memory

-79.0MiB live, 2 044.9MiB allocated

Algorithm

60×	binary-search
45×	left-value

Stop Event

57×	narrow-enough
3×	predicate-same

Samples

553.0ms	5 870×	0	valid
207.0ms	540×	2	valid
105.0ms	735×	1	valid
103.0ms	1 035×	0	invalid
6.0ms	65×	0	exit
2.0ms	7×	3	valid

Compiler

Compiled 10 721 to 7 924 computations (26.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 657.0ms

ival-pow: 162.0ms (24.6% of total)

ival-mult: 125.0ms (19% of total)

ival-sub: 79.0ms (12% of total)

ival-div: 77.0ms (11.7% of total)

ival-sqrt: 51.0ms (7.8% of total)

ival-cos: 39.0ms (5.9% of total)

ival-neg: 29.0ms (4.4% of total)

ival-add: 27.0ms (4.1% of total)

adjust: 23.0ms (3.5% of total)

ival-expm1: 15.0ms (2.3% of total)

ival-sin: 14.0ms (2.1% of total)

ival-true: 6.0ms (0.9% of total)

exact: 4.0ms (0.6% of total)

ival-exp: 3.0ms (0.5% of total)

ival-assert: 3.0ms (0.5% of total)

end0.0ms (0%)

Memory: 0.3MiB live, 0.3MiB allocated

sample1.9min (32.7%)

simplify1.3min (22%)

rewrite46.4s (13.3%)

soundness31.1s (8.9%)

eval22.0s (6.3%)

prune18.0s (5.2%)

localize16.8s (4.8%)

explain6.2s (1.8%)

regimes5.5s (1.6%)

preprocess5.2s (1.5%)

series3.3s (0.9%)

analyze1.9s (0.5%)

bsearch1.6s (0.5%)

end0.0ms (0%)

Profiling