Metrics for Herbie run

Date:	Thursday, June 13th, 2024
Commit:	63d27371 on web-cleanup
Hostname:	nightly with Racket 8.11.1
Seed:	2024165
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample3.4s (48.2%)

Samples

1.4s	5 843×	2	valid
855.0ms	9 707×	1	valid
357.0ms	8 650×	0	valid
115.0ms	568×	3	valid

Precisions

Click to see histograms. Total time spent on operations: 1.7s

ival-add: 1.0s (61.3% of total)

adjust: 310.0ms (18.3% of total)

ival-sub: 221.0ms (13.1% of total)

ival-mult: 83.0ms (4.9% of total)

ival-true: 19.0ms (1.1% of total)

ival-assert: 13.0ms (0.8% of total)

...in/eval/compile.rkt:70:19: 8.0ms (0.5% of total)

Bogosity

soundness1.1s (15%)

Rules

4 211×	`fmm-def`
1 392×	`associate-+r+`
1 340×	`associate-+l+`
1 246×	`associate-+r-`
1 214×	`fma-define`

Stop Event

3×	node limit
3×	done
1×	saturated

Compiler

Compiled 303 to 108 computations (64.4% saved)

preprocess978.0ms (13.7%)

Algorithm

3×	egg-herbie

Rules

4 083×	`fmm-def`
1 392×	`associate-+r+`
1 340×	`associate-+l+`
1 244×	`associate-+r-`
1 187×	`unsub-neg`

Stop Event

2×	node limit
1×	saturated

Compiler

Compiled 266 to 200 computations (24.8% saved)

simplify485.0ms (6.8%)

Algorithm

9×	egg-herbie

Rules

1 417×	`distribute-lft-in`
1 320×	`distribute-rgt-in`
1 139×	`fmm-def`
1 044×	`fma-define`
742×	`times-frac`

Stop Event

6×	saturated
3×	node limit

Counts

541 → 490

rewrite380.0ms (5.3%)

Algorithm

2×	batch-egg-rewrite

Rules

1 349×	`log1p-expm1-u`
1 349×	`expm1-log1p-u`
634×	`log-prod`
594×	`fma-define`
574×	`prod-diff`

Stop Event

2×	node limit

Counts

9 → 433

explain319.0ms (4.5%)

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	253	1

Confusion

	Predicted +	Predicted -
+	248	2
-	5	513

Precision

0.9802371541501976

Recall

0.992

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	248	1	1
-	5	0	513

Precision?

0.9803149606299213

Recall?

0.996

Freqs

test

number	freq
0	515
1	253

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	2	0	1
-	0	0	0

Precision?

1.0

Recall?

0.6666666666666666

Samples

76.0ms	352×	2	valid
62.0ms	614×	1	valid
23.0ms	534×	0	valid
9.0ms	36×	3	valid

Compiler

Compiled 194 to 80 computations (58.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 89.0ms

ival-add: 44.0ms (49.4% of total)

adjust: 23.0ms (25.8% of total)

ival-sub: 13.0ms (14.6% of total)

ival-mult: 6.0ms (6.7% of total)

ival-assert: 1.0ms (1.1% of total)

...in/eval/compile.rkt:70:19: 1.0ms (1.1% of total)

ival-true: 1.0ms (1.1% of total)

prune228.0ms (3.2%)

Counts: 649 → 12
Compiler: Compiled 149 to 85 computations (43% saved)

localize96.0ms (1.3%)

Samples

49.0ms	899×	0	valid
19.0ms	125×	1	valid

Compiler

Compiled 71 to 31 computations (56.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 24.0ms

ival-mult: 8.0ms (32.9% of total)

ival-add: 6.0ms (24.6% of total)

ival-fma: 6.0ms (24.6% of total)

adjust: 2.0ms (8.2% of total)

...in/eval/compile.rkt:70:19: 1.0ms (4.1% of total)

ival-assert: 1.0ms (4.1% of total)

ival-true: 1.0ms (4.1% of total)

eval74.0ms (1%)

Compiler: Compiled 8 043 to 1 636 computations (79.7% saved)

regimes38.0ms (0.5%)

Counts

22 → 9

Calls

8 calls:

12.0ms	x
7.0ms	y
4.0ms	(+.f64 x #s(literal 1 binary64))
4.0ms	(*.f64 (+.f64 x #s(literal 1 binary64)) (+.f64 x #s(literal 1 binary64)))
4.0ms	(-.f64 (*.f64 (+.f64 x #s(literal 1 binary64)) (+.f64 x #s(literal 1 binary64))) #s(literal 1 binary64))

Compiler

Compiled 88 to 51 computations (42% saved)

bsearch24.0ms (0.3%)

Algorithm

2×	binary-search

Stop Event

1×	narrow-enough
1×	narrow-enough

Samples

13.0ms

320×

valid

Compiler

Compiled 213 to 149 computations (30% saved)

Precisions

Click to see histograms. Total time spent on operations: 6.0ms

ival-add: 2.0ms (35.1% of total)

ival-mult: 2.0ms (35.1% of total)

ival-sub: 1.0ms (17.6% of total)

ival-true: 0.0ms (0% of total)

...in/eval/compile.rkt:70:19: 0.0ms (0% of total)

ival-assert: 0.0ms (0% of total)

series8.0ms (0.1%)

Counts

9 → 108

Calls

27 calls:

Time	Variable		Point	Expression
1.0ms	x	@	inf	(* x (+ x 2))
1.0ms	x	@	-inf	(* x (+ x 2))
0.0ms	x	@	-inf	(+ (* (+ x 1) (+ x 1)) -1)
0.0ms	x	@	inf	(* x 2)
0.0ms	x	@	0	(* x (+ x 2))

analyze1.0ms (0%)

Algorithm

3×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
100%	99.9%	0%	0.1%	0%	0%	0%	1

Compiler

Compiled 31 to 23 computations (25.8% saved)

Herbie run

sample3.4s (48.2%)

soundness1.1s (15%)

preprocess978.0ms (13.7%)

simplify485.0ms (6.8%)

rewrite380.0ms (5.3%)

explain319.0ms (4.5%)

prune228.0ms (3.2%)

localize96.0ms (1.3%)

eval74.0ms (1%)

regimes38.0ms (0.5%)

bsearch24.0ms (0.3%)

series8.0ms (0.1%)

analyze1.0ms (0%)

end0.0ms (0%)

Profiling