Metrics for Herbie run

Date:	Saturday, May 25th, 2024
Commit:	445b0ec4 on explanations-trifurcate
Hostname:	nightly with Racket 8.11.1
Seed:	2024146
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample3.8s (59.2%)

Results

1.4s	5912×	2	valid
823.0ms	9652×	1	valid
312.0ms	8667×	0	valid
204.0ms	537×	3	valid

Precisions

Click to see histograms. Total time spent on operations: 1.3s

ival-add: 639.0ms (48.3% of total)

backward-pass: 323.0ms (24.4% of total)

ival-sub: 227.0ms (17.2% of total)

ival-mult: 101.0ms (7.6% of total)

const: 32.0ms (2.4% of total)

Bogosity

soundness906.0ms (14%)

Rules

4138×	`fma-neg`
1392×	`associate-+r+`
1340×	`associate-+l+`
1276×	`unsub-neg`
1245×	`associate-+r-`

Stop Event

1×	saturated
3×	node limit
3×	done

Compiler

Compiled 189 to 71 computations (62.4% saved)

preprocess656.0ms (10.1%)

Algorithm

3×	egg-herbie

Rules

4083×	`fma-neg`
1392×	`associate-+r+`
1340×	`associate-+l+`
1276×	`unsub-neg`
1244×	`associate-+r-`

Stop Event

1×	saturated
2×	node limit

Compiler

Compiled 252 to 192 computations (23.8% saved)

explain345.0ms (5.3%)

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	255	1

Confusion

	Predicted +	Predicted -
+	251	0
-	4	513

Precision

0.984313725490196

Recall

1.0

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	251	0	0
-	4	1	512

Precision?

0.98046875

Recall?

1.0

Freqs

test

number	freq
0	513
1	255

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	2	0	0
-	0	0	1

Precision?

1.0

Recall?

1.0

Results

88.0ms	352×	2	valid
82.0ms	630×	1	valid
24.0ms	526×	0	valid
8.0ms	28×	3	valid

Compiler

Compiled 198 to 74 computations (62.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 89.0ms

ival-add: 42.0ms (47% of total)

backward-pass: 25.0ms (28% of total)

ival-sub: 15.0ms (16.8% of total)

ival-mult: 6.0ms (6.7% of total)

const: 2.0ms (2.2% of total)

simplify281.0ms (4.3%)

Algorithm

9×	egg-herbie

Rules

1096×	`fma-neg`
1010×	`fma-define`
879×	`distribute-lft-in`
807×	`distribute-rgt-in`
766×	`prod-exp`

Stop Event

7×	saturated
2×	node limit

Counts

248 → 261

rewrite259.0ms (4%)

Algorithm

2×	batch-egg-rewrite

Rules

717×	`log1p-expm1-u`
717×	`expm1-log1p-u`
687×	`add-exp-log`
663×	`add-log-exp`
657×	`add-cube-cbrt`

Stop Event

2×	node limit

Counts

5 → 188

localize62.0ms (1%)

Results

43.0ms

1024×

valid

Compiler

Compiled 42 to 19 computations (54.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 13.0ms

ival-mult: 6.0ms (47.6% of total)

ival-fma: 4.0ms (31.8% of total)

ival-add: 2.0ms (15.9% of total)

const: 1.0ms (7.9% of total)

backward-pass: 0.0ms (0% of total)

prune35.0ms (0.5%)

Counts: 293 → 10
Compiler: Compiled 109 to 66 computations (39.4% saved)

eval34.0ms (0.5%)

Compiler: Compiled 3361 to 822 computations (75.5% saved)

bsearch33.0ms (0.5%)

Algorithm

2×	binary-search

Stop Event

1×	narrow-enough
1×	narrow-enough

Results

12.0ms

304×

valid

Compiler

Compiled 204 to 141 computations (30.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 6.0ms

ival-sub: 2.0ms (34.5% of total)

ival-add: 2.0ms (34.5% of total)

ival-mult: 2.0ms (34.5% of total)

const: 0.0ms (0% of total)

backward-pass: 0.0ms (0% of total)

regimes27.0ms (0.4%)

Counts

16 → 8

Calls

8 calls:

10.0ms	x
4.0ms	(+.f64 x #s(literal 1 binary64))
3.0ms	(-.f64 (*.f64 (+.f64 x #s(literal 1 binary64)) (+.f64 x #s(literal 1 binary64))) #s(literal 1 binary64))
3.0ms	(*.f64 (+.f64 x #s(literal 1 binary64)) (+.f64 x #s(literal 1 binary64)))
1.0ms	z

Compiler

Compiled 86 to 50 computations (41.9% saved)

series7.0ms (0.1%)

Counts

5 → 60

Calls

15 calls:

Time	Variable		Point	Expression
1.0ms	x	@	inf	(* x (+ x 2))
1.0ms	x	@	-inf	(* x (+ x 2))
1.0ms	x	@	inf	(* x 2)
0.0ms	x	@	0	(* x 2)
0.0ms	x	@	0	(* x (+ x 2))

analyze1.0ms (0%)

Algorithm

3×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
100%	99.9%	0%	0.1%	0%	0%	0%	1

Compiler

Compiled 33 to 20 computations (39.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 0.0ms

ival-sub: 0.0ms (0% of total)

ival-add: 0.0ms (0% of total)

ival-mult: 0.0ms (0% of total)

const: 0.0ms (0% of total)

backward-pass: 0.0ms (0% of total)

Herbie run

sample3.8s (59.2%)

soundness906.0ms (14%)

preprocess656.0ms (10.1%)

explain345.0ms (5.3%)

simplify281.0ms (4.3%)

rewrite259.0ms (4%)

localize62.0ms (1%)

prune35.0ms (0.5%)

eval34.0ms (0.5%)

bsearch33.0ms (0.5%)

regimes27.0ms (0.4%)

series7.0ms (0.1%)

analyze1.0ms (0%)

end0.0ms (0%)

Profiling