Metrics for Herbie run

Date:	Friday, April 5th, 2024
Commit:	9a443234 on explanations-eval-top3
Hostname:	nightly with Racket 8.11.1
Seed:	2024096
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize19.1s (23.6%)

Compiler: Compiled 5452 to 2876 computations (47.2% saved)
Precisions: Click to see histograms. Total time spent on operations: 13.4s
Operation ival-mult, time spent: 4.1s, 30.0% of total-time
Operation composed, time spent: 1.9s, 14.0% of total-time
Operation ival-pow, time spent: 1.4s, 11.0% of total-time
Operation ival-add, time spent: 1.3s, 10.0% of total-time
Operation ival-div, time spent: 1.2s, 9.0% of total-time
Operation ival-sqrt, time spent: 1.1s, 8.0% of total-time
Operation ival-sub, time spent: 761.0ms, 6.0% of total-time
Operation ival->=, time spent: 368.0ms, 3.0% of total-time
Operation ival-log, time spent: 362.0ms, 3.0% of total-time
Operation const, time spent: 288.0ms, 2.0% of total-time
Operation ival-exp, time spent: 223.0ms, 2.0% of total-time
Operation ival-if, time spent: 217.0ms, 2.0% of total-time
Operation ival-cbrt, time spent: 47.0ms, 0.0% of total-time
Operation ival-neg, time spent: 43.0ms, 0.0% of total-time
Operation ival-fabs, time spent: 32.0ms, 0.0% of total-time

sample16.3s (20.2%)

Results

11.0s	62902×	256	valid
1.1s	7277×	256	infinite
2.1s	4125×	2048	valid
502.0ms	1954×	256	invalid

Precisions

Click to see histograms. Total time spent on operations: 7.6s

Operation ival-mult, time spent: 2.3s, 30.0% of total-time

Operation ival-div, time spent: 1.9s, 25.0% of total-time

Operation ival-sqrt, time spent: 970.0ms, 13.0% of total-time

Operation ival-sub, time spent: 959.0ms, 13.0% of total-time

Operation ival-add, time spent: 256.0ms, 3.0% of total-time

Operation ival-neg, time spent: 255.0ms, 3.0% of total-time

Operation ival->=, time spent: 239.0ms, 3.0% of total-time

Operation const, time spent: 197.0ms, 3.0% of total-time

Operation ival-log, time spent: 152.0ms, 2.0% of total-time

Operation ival-exp, time spent: 124.0ms, 2.0% of total-time

Operation ival-if, time spent: 118.0ms, 2.0% of total-time

Operation ival-fabs, time spent: 113.0ms, 1.0% of total-time

Bogosity

eval14.4s (17.8%)

Compiler: Compiled 781106 to 518588 computations (33.6% saved)

preprocess5.7s (7%)

Algorithm

9×	egg-herbie

Rules

6570×	`fma-neg`
5642×	`fma-define`
3004×	`times-frac`
2940×	`div-sub`
2342×	`sub-neg`

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`sqrt.f64`	`#f`	oflow-rescue	290	0
`-.f64`	`#f`	cancellation	123	0
`+.f64`	`#f`	cancellation	108	1
`sqrt.f64`	`(sqrt.f64 (*.f64 x x))`	uflow-rescue	60	0
↳	`(*.f64 x x)`	underflow	60
`*.f64`	`(*.f64 (/.f64 x y) z)`	*no**	14	0
`-.f64`	`(-.f64 (/.f64 (+.f64 x 4) y) (*.f64 (/.f64 x y) z))`	nan-rescue	8	0
↳	`(/.f64 (+.f64 x 4) y)`	overflow	30
↳	`(/.f64 x y)`	overflow	30
↳	`(*.f64 (/.f64 x y) z)`	overflow	45
`*.f64`	`(*.f64 (/.f64 x y) z)`	*nu**	6	0
`log.f64`	`(log.f64 (-.f64 (/.f64 1 x) 1))`	oflow-rescue	1	0
↳	`(-.f64 (/.f64 1 x) 1)`	overflow	1
↳	`(/.f64 1 x)`	overflow	1

Confusion

	Predicted +	Predicted -
+	319	15
-	184	1786

Precision

0.6341948310139165

Recall

0.9550898203592815

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	319	0	15
-	184	0	1786

Precision?

0.6341948310139165

Recall?

0.9550898203592815

Stop Event

5×	saturated
4×	node limit

Compiler

Compiled 4112 to 2354 computations (42.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.8s

Operation ival-mult, time spent: 669.0ms, 38.0% of total-time

Operation ival-div, time spent: 341.0ms, 19.0% of total-time

Operation ival-sub, time spent: 293.0ms, 16.0% of total-time

Operation ival-sqrt, time spent: 224.0ms, 13.0% of total-time

Operation ival-add, time spent: 101.0ms, 6.0% of total-time

Operation const, time spent: 50.0ms, 3.0% of total-time

Operation ival->=, time spent: 27.0ms, 2.0% of total-time

Operation ival-neg, time spent: 26.0ms, 1.0% of total-time

Operation ival-log, time spent: 21.0ms, 1.0% of total-time

Operation ival-if, time spent: 18.0ms, 1.0% of total-time

Operation ival-fabs, time spent: 7.0ms, 0.0% of total-time

Operation ival-exp, time spent: 5.0ms, 0.0% of total-time

soundness5.6s (6.9%)

Rules

12954×	`fma-define`
12422×	`times-frac`
12018×	`fma-neg`
9728×	`distribute-lft-in`
9332×	`*-commutative`

Stop Event

2×	saturated
23×	node limit

Compiler

Compiled 3490 to 2127 computations (39.1% saved)

simplify5.4s (6.7%)

Algorithm

30×	egg-herbie

Rules

13144×	`fma-define`
11686×	`fma-neg`
11668×	`*-commutative`
11582×	`distribute-lft-in`
10680×	`times-frac`

Stop Event

9×	saturated
3×	fuel
21×	node limit
6×	done

Counts

7494 → 7468

Compiler

Compiled 1214 to 800 computations (34.1% saved)

prune5.4s (6.7%)

Counts: 17574 → 287
Compiler: Compiled 14068 to 9424 computations (33% saved)

rewrite4.2s (5.1%)

Algorithm

21×	batch-egg-rewrite

Rules

15829×	`log1p-expm1-u`
10123×	`expm1-log1p-u`
6580×	`prod-diff`
5450×	`associate-r`
4524×	`unpow-prod-down`

Stop Event

21×	node limit

Counts

126 → 4287

regimes1.9s (2.4%)

Counts

396 → 98

Calls

26 calls:

343.0ms	f
269.0ms	x
253.0ms	b
209.0ms	y
199.0ms	a

Compiler

Compiled 499 to 346 computations (30.7% saved)

bsearch1.4s (1.7%)

Algorithm

51×	binary-search

Stop Event

5×	predicate-same
46×	narrow-enough

Results

1.1s	5178×	256	valid
86.0ms	550×	256	infinite
32.0ms	178×	256	invalid

Compiler

Compiled 10330 to 7380 computations (28.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 681.0ms

Operation ival-mult, time spent: 363.0ms, 53.0% of total-time

Operation ival-div, time spent: 91.0ms, 13.0% of total-time

Operation ival-add, time spent: 75.0ms, 11.0% of total-time

Operation ival-sub, time spent: 55.0ms, 8.0% of total-time

Operation ival-sqrt, time spent: 29.0ms, 4.0% of total-time

Operation ival-neg, time spent: 20.0ms, 3.0% of total-time

Operation ival-fabs, time spent: 15.0ms, 2.0% of total-time

Operation const, time spent: 13.0ms, 2.0% of total-time

Operation ival-if, time spent: 10.0ms, 1.0% of total-time

Operation ival->=, time spent: 10.0ms, 1.0% of total-time

analyze791.0ms (1%)

Algorithm

9×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
22.2%	22.2%	77.7%	0.1%	0%	0%	0%	1
29.4%	27.8%	66.6%	0.1%	0%	5.6%	0%	2
50%	44.4%	44.4%	0.1%	0%	11.1%	0%	3
59.7%	51.3%	34.7%	0.1%	0%	13.9%	0%	4
67.2%	56.9%	27.7%	0.1%	0%	15.3%	0%	5
74.4%	62.4%	21.5%	0.1%	0%	16%	0%	6
78.9%	64.9%	17.3%	0.1%	0%	17.7%	0%	7
80.8%	66.3%	15.8%	0.1%	0%	17.9%	0%	8
85.9%	69.9%	11.5%	0.1%	0%	18.5%	0%	9
88%	70.7%	9.7%	0.1%	0%	19.6%	0%	10
90%	72.1%	8%	0.1%	0%	19.8%	0%	11
92.3%	73.5%	6.2%	0.1%	0%	20.3%	0%	12

Compiler

Compiled 161 to 110 computations (31.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 508.0ms

Operation ival-mult, time spent: 189.0ms, 37.0% of total-time

Operation ival-sub, time spent: 95.0ms, 19.0% of total-time

Operation ival->=, time spent: 68.0ms, 13.0% of total-time

Operation ival-sqrt, time spent: 46.0ms, 9.0% of total-time

Operation ival-div, time spent: 38.0ms, 7.0% of total-time

Operation ival-add, time spent: 22.0ms, 4.0% of total-time

Operation ival-if, time spent: 17.0ms, 3.0% of total-time

Operation ival-neg, time spent: 17.0ms, 3.0% of total-time

Operation const, time spent: 12.0ms, 2.0% of total-time

Operation ival-fabs, time spent: 4.0ms, 1.0% of total-time

Operation ival-exp, time spent: 0.0ms, 0.0% of total-time

Operation ival-log, time spent: 0.0ms, 0.0% of total-time

series757.0ms (0.9%)

Counts

126 → 3207

Calls

657 calls:

Time	Variable		Point	Expression
52.0ms	a	@	inf	(+ (neg b) (sqrt (- (* b b) (* 4 (* a c)))))
17.0ms	c	@	inf	(sqrt (+ (* c (* a -4)) (pow b 2)))
8.0ms	a	@	inf	(sqrt (+ (* c (* a -4)) (* b b)))
7.0ms	c	@	inf	(/ c (+ (neg b) (sqrt (- (* b b) (* 4 (* a c))))))
7.0ms	y	@	-inf	(/ (* x (neg z)) y)

Herbie run

localize19.1s (23.6%)

sample16.3s (20.2%)

eval14.4s (17.8%)

preprocess5.7s (7%)

soundness5.6s (6.9%)

simplify5.4s (6.7%)

prune5.4s (6.7%)

rewrite4.2s (5.1%)

regimes1.9s (2.4%)

bsearch1.4s (1.7%)

analyze791.0ms (1%)

series757.0ms (0.9%)

end1.0ms (0%)

Profiling