Metrics for Herbie run

Date:	Tuesday, June 18th, 2024
Commit:	622245fd on fix-rival
Hostname:	nightly with Racket 8.11.1
Seed:	2024170
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample3.2s (51.1%)

Samples

1.2s	5 952×	2	valid
673.0ms	9 639×	1	valid
282.0ms	8 628×	0	valid
106.0ms	549×	3	valid

Precisions

Click to see histograms. Total time spent on operations: 1.5s

ival-add: 880.0ms (57.7% of total)

adjust: 272.0ms (17.8% of total)

ival-sub: 256.0ms (16.8% of total)

ival-mult: 78.0ms (5.1% of total)

ival-true: 17.0ms (1.1% of total)

ival-assert: 13.0ms (0.9% of total)

...in/eval/compile.rkt:76:19: 7.0ms (0.5% of total)

Bogosity

soundness921.0ms (14.5%)

Rules

4 138×	`fmm-def`
1 392×	`associate-+r+`
1 340×	`associate-+l+`
1 245×	`associate-+r-`
1 187×	`unsub-neg`

Stop Event

3×	node limit
3×	done
1×	saturated

Compiler

Compiled 189 to 71 computations (62.4% saved)

preprocess653.0ms (10.3%)

Algorithm

3×	egg-herbie

Rules

4 083×	`fmm-def`
1 392×	`associate-+r+`
1 340×	`associate-+l+`
1 244×	`associate-+r-`
1 187×	`unsub-neg`

Stop Event

2×	node limit
1×	saturated

Compiler

Compiled 252 to 192 computations (23.8% saved)

analyze551.0ms (8.7%)

Algorithm

3×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
0%	0%	99.9%	0.1%	0%	0%	0%	1
0%	0%	99.9%	0.1%	0%	0%	0%	2
0%	0%	99.9%	0.1%	0%	0%	0%	3
16.7%	16.7%	83.3%	0.1%	0%	0%	0%	4
20.8%	20.8%	79.1%	0.1%	0%	0%	0%	5
22.9%	22.9%	77%	0.1%	0%	0%	0%	6
24%	23.9%	76%	0.1%	0%	0%	0%	7
24%	23.9%	76%	0.1%	0%	0%	0%	8
24%	23.9%	76%	0.1%	0%	0%	0%	9
24.1%	24.1%	75.8%	0.1%	0%	0%	0%	10
24.1%	24.1%	75.8%	0.1%	0%	0%	0%	11
24.1%	24.1%	75.8%	0.1%	0%	0%	0%	12

Compiler

Compiled 31 to 23 computations (25.8% saved)

rewrite326.0ms (5.1%)

Algorithm

2×	batch-egg-rewrite

Rules

717×	`log1p-expm1-u`
717×	`expm1-log1p-u`
687×	`add-exp-log`
663×	`add-log-exp`
657×	`add-cube-cbrt`

Stop Event

2×	node limit

Counts

5 → 188

explain258.0ms (4.1%)

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	259	0

Confusion

	Predicted +	Predicted -
+	249	0
-	10	509

Precision

0.9613899613899614

Recall

1.0

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	249	0	0
-	10	0	509

Precision?

0.9613899613899614

Recall?

1.0

Freqs

test

number	freq
0	509
1	259

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	2	0	0
-	0	0	1

Precision?

1.0

Recall?

1.0

Samples

55.0ms	378×	2	valid
45.0ms	600×	1	valid
20.0ms	534×	0	valid
4.0ms	24×	3	valid

Compiler

Compiled 194 to 80 computations (58.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 71.0ms

ival-add: 32.0ms (45.2% of total)

adjust: 16.0ms (22.6% of total)

ival-sub: 13.0ms (18.3% of total)

ival-mult: 7.0ms (9.9% of total)

ival-assert: 1.0ms (1.4% of total)

ival-true: 1.0ms (1.4% of total)

...in/eval/compile.rkt:76:19: 0.0ms (0% of total)

simplify207.0ms (3.3%)

Algorithm

9×	egg-herbie

Rules

1 096×	`fmm-def`
1 010×	`fma-define`
879×	`distribute-lft-in`
807×	`distribute-rgt-in`
766×	`prod-exp`

Stop Event

7×	saturated
2×	node limit

Counts

248 → 261

eval46.0ms (0.7%)

Compiler: Compiled 3 361 to 822 computations (75.5% saved)

localize44.0ms (0.7%)

Samples

27.0ms

1 024×

valid

Compiler

Compiled 40 to 23 computations (42.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 9.0ms

ival-mult: 5.0ms (55.4% of total)

ival-add: 3.0ms (33.3% of total)

ival-true: 1.0ms (11.1% of total)

...in/eval/compile.rkt:76:19: 0.0ms (0% of total)

ival-assert: 0.0ms (0% of total)

prune39.0ms (0.6%)

Counts: 293 → 10
Compiler: Compiled 109 to 66 computations (39.4% saved)

regimes28.0ms (0.4%)

Counts

16 → 8

Calls

8 calls:

9.0ms	x
4.0ms	(+.f64 x #s(literal 1 binary64))
3.0ms	(-.f64 (*.f64 (+.f64 x #s(literal 1 binary64)) (+.f64 x #s(literal 1 binary64))) #s(literal 1 binary64))
3.0ms	(*.f64 (+.f64 x #s(literal 1 binary64)) (+.f64 x #s(literal 1 binary64)))
2.0ms	(-.f64 (+.f64 (+.f64 x y) z) (+.f64 x (+.f64 y z)))

Compiler

Compiled 86 to 50 computations (41.9% saved)

bsearch24.0ms (0.4%)

Algorithm

2×	binary-search

Stop Event

1×	narrow-enough
1×	narrow-enough

Samples

12.0ms

336×

valid

Compiler

Compiled 223 to 156 computations (30% saved)

Precisions

Click to see histograms. Total time spent on operations: 7.0ms

ival-mult: 3.0ms (45.2% of total)

ival-add: 2.0ms (30.1% of total)

ival-sub: 1.0ms (15.1% of total)

...in/eval/compile.rkt:76:19: 0.0ms (0% of total)

ival-true: 0.0ms (0% of total)

ival-assert: 0.0ms (0% of total)

series5.0ms (0.1%)

Counts

5 → 60

Calls

15 calls:

Time	Variable		Point	Expression
1.0ms	x	@	-inf	(* x (+ x 2))
1.0ms	x	@	inf	(* x 2)
0.0ms	x	@	inf	(* x (+ x 2))
0.0ms	x	@	-inf	(* x 2)
0.0ms	x	@	0	(* x 2)

Herbie run

sample3.2s (51.1%)

soundness921.0ms (14.5%)

preprocess653.0ms (10.3%)

analyze551.0ms (8.7%)

rewrite326.0ms (5.1%)

explain258.0ms (4.1%)

simplify207.0ms (3.3%)

eval46.0ms (0.7%)

localize44.0ms (0.7%)

prune39.0ms (0.6%)

regimes28.0ms (0.4%)

bsearch24.0ms (0.4%)

series5.0ms (0.1%)

end0.0ms (0%)

Profiling