Metrics for Herbie run

Date:	Wednesday, June 5th, 2024
Commit:	8a54fd57 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024157
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample4.8s (64.4%)

Results

2.0s	5951×	2	valid
1.1s	9617×	1	valid
461.0ms	8652×	0	valid
212.0ms	548×	3	valid

Precisions

Click to see histograms. Total time spent on operations: 1.9s

ival-add: 1.1s (55.8% of total)

adjust: 442.0ms (23.1% of total)

ival-sub: 237.0ms (12.4% of total)

ival-mult: 89.0ms (4.7% of total)

ival-true: 33.0ms (1.7% of total)

ival-assert: 24.0ms (1.3% of total)

const: 19.0ms (1% of total)

Bogosity

soundness805.0ms (10.9%)

Rules

4083×	`fmm-def`
1392×	`associate-+r+`
1340×	`associate-+l+`
1244×	`associate-+r-`
1187×	`unsub-neg`

Stop Event

1×	saturated
2×	node limit
3×	done

Compiler

Compiled 164 to 62 computations (62.2% saved)

preprocess646.0ms (8.7%)

Algorithm

3×	egg-herbie

Rules

4083×	`fmm-def`
1392×	`associate-+r+`
1340×	`associate-+l+`
1244×	`associate-+r-`
1187×	`unsub-neg`

Stop Event

1×	saturated
2×	node limit

Compiler

Compiled 240 to 190 computations (20.8% saved)

explain464.0ms (6.3%)

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	255	0

Confusion

	Predicted +	Predicted -
+	252	1
-	3	512

Precision

0.9882352941176471

Recall

0.9960474308300395

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	252	0	1
-	3	0	512

Precision?

0.9882352941176471

Recall?

0.9960474308300395

Freqs

test

number	freq
0	513
1	255

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	2	0	1
-	0	0	0

Precision?

1.0

Recall?

0.6666666666666666

Results

164.0ms	606×	1	valid
111.0ms	378×	2	valid
35.0ms	526×	0	valid
14.0ms	26×	3	valid

Compiler

Compiled 194 to 80 computations (58.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 165.0ms

ival-sub: 78.0ms (47.4% of total)

ival-add: 42.0ms (25.5% of total)

adjust: 34.0ms (20.7% of total)

ival-mult: 6.0ms (3.6% of total)

ival-assert: 2.0ms (1.2% of total)

ival-true: 2.0ms (1.2% of total)

const: 1.0ms (0.6% of total)

rewrite352.0ms (4.8%)

Algorithm

2×	batch-egg-rewrite

Rules

789×	`log1p-expm1-u`
624×	`expm1-log1p-u`
595×	`add-exp-log`
575×	`add-log-exp`
573×	`add-cube-cbrt`

Stop Event

2×	node limit

Counts

4 → 154

simplify178.0ms (2.4%)

Algorithm

9×	egg-herbie

Rules

874×	`fmm-def`
830×	`fma-define`
756×	`distribute-lft-in`
706×	`distribute-rgt-in`
624×	`associate-+l-`

Stop Event

7×	saturated
2×	node limit

Counts

202 → 215

localize67.0ms (0.9%)

Results

51.0ms

1024×

valid

Compiler

Compiled 29 to 22 computations (24.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 11.0ms

ival-mult: 6.0ms (55.9% of total)

ival-add: 2.0ms (18.6% of total)

ival-true: 1.0ms (9.3% of total)

const: 1.0ms (9.3% of total)

ival-assert: 1.0ms (9.3% of total)

prune40.0ms (0.5%)

Counts: 221 → 8
Compiler: Compiled 89 to 57 computations (36% saved)

bsearch27.0ms (0.4%)

Algorithm

2×	binary-search

Stop Event

1×	narrow-enough
1×	narrow-enough

Results

15.0ms

304×

valid

Compiler

Compiled 203 to 142 computations (30% saved)

Precisions

Click to see histograms. Total time spent on operations: 6.0ms

ival-add: 2.0ms (32.3% of total)

ival-mult: 2.0ms (32.3% of total)

ival-sub: 1.0ms (16.1% of total)

ival-true: 0.0ms (0% of total)

const: 0.0ms (0% of total)

ival-assert: 0.0ms (0% of total)

eval25.0ms (0.3%)

Compiler: Compiled 2548 to 672 computations (73.6% saved)

regimes21.0ms (0.3%)

Counts

11 → 7

Calls

8 calls:

7.0ms	x
4.0ms	(-.f64 (+.f64 (+.f64 x y) z) (+.f64 x (+.f64 y z)))
2.0ms	(+.f64 x #s(literal 1 binary64))
2.0ms	(-.f64 (*.f64 (+.f64 x #s(literal 1 binary64)) (+.f64 x #s(literal 1 binary64))) #s(literal 1 binary64))
2.0ms	(*.f64 (+.f64 x #s(literal 1 binary64)) (+.f64 x #s(literal 1 binary64)))

Compiler

Compiled 62 to 37 computations (40.3% saved)

series4.0ms (0.1%)

Counts

4 → 48

Calls

12 calls:

Time	Variable		Point	Expression
1.0ms	x	@	inf	(* x 2)
1.0ms	x	@	-inf	(* x (+ x 2))
1.0ms	x	@	inf	(* x (+ x 2))
0.0ms	x	@	0	(* x (+ x 2))
0.0ms	x	@	-inf	(* x 2)

analyze1.0ms (0%)

Algorithm

3×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
100%	99.9%	0%	0.1%	0%	0%	0%	1

Compiler

Compiled 31 to 23 computations (25.8% saved)

Herbie run

sample4.8s (64.4%)

soundness805.0ms (10.9%)

preprocess646.0ms (8.7%)

explain464.0ms (6.3%)

rewrite352.0ms (4.8%)

simplify178.0ms (2.4%)

localize67.0ms (0.9%)

prune40.0ms (0.5%)

bsearch27.0ms (0.4%)

eval25.0ms (0.3%)

regimes21.0ms (0.3%)

series4.0ms (0.1%)

analyze1.0ms (0%)

end0.0ms (0%)

Profiling