Metrics for Herbie run

Date:	Friday, April 12th, 2024
Commit:	ed895eeb on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024103
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample5.9min (18.7%)

Results

3.5min	2149731×	0	valid
11.3s	64492×	0	invalid
21.7s	62548×	1	valid
2.8s	7514×	2	valid
1.3s	1575×	5	exit
376.0ms	1394×	1	invalid
583.0ms	1070×	3	valid
48.0ms	185×	2	invalid
0.0ms	1×	4	valid

Precisions

Click to see histograms. Total time spent on operations: 2.5min

ival-mult: 51.6s (34.5% of total)

ival-add: 22.2s (14.9% of total)

ival-sub: 21.9s (14.7% of total)

ival-div: 19.8s (13.3% of total)

ival-log: 8.5s (5.7% of total)

ival-sqrt: 6.6s (4.4% of total)

ival-sin: 4.9s (3.3% of total)

backward-pass: 3.6s (2.4% of total)

ival-cos: 3.6s (2.4% of total)

const: 3.3s (2.2% of total)

ival-exp: 1.5s (1% of total)

ival-fabs: 404.0ms (0.3% of total)

ival-cosh: 379.0ms (0.3% of total)

ival-tan: 345.0ms (0.2% of total)

ival-acos: 323.0ms (0.2% of total)

ival-tanh: 192.0ms (0.1% of total)

ival-sinh: 153.0ms (0.1% of total)

Bogosity

simplify4.3min (13.5%)

Algorithm

1075×

egg-herbie

Rules

284274×	`fma-define`
237184×	`fma-neg`
206202×	`*-commutative`
198871×	`distribute-lft-in`
198479×	`associate-r`

Stop Event

268×	saturated
802×	node limit
5×	unsound

Counts

365936 → 312217

localize3.6min (11.4%)

Results

1.6min	202475×	0	valid
5.9s	7840×	0	invalid
24.5s	6645×	1	valid
25.3s	3235×	5	exit
7.3s	1621×	2	valid
354.0ms	417×	0	unsamplable
547.0ms	220×	3	valid
315.0ms	11×	4	valid

Compiler

Compiled 111090 to 48831 computations (56% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.9min

ival-mult: 31.3s (27% of total)

ival-pow: 14.7s (12.7% of total)

ival-div: 14.6s (12.6% of total)

ival-add: 14.2s (12.2% of total)

backward-pass: 9.0s (7.8% of total)

ival-sub: 7.2s (6.3% of total)

ival-sqrt: 4.9s (4.2% of total)

ival-log: 4.8s (4.2% of total)

ival-fma: 4.3s (3.7% of total)

const: 2.6s (2.2% of total)

ival-sin: 2.0s (1.7% of total)

ival-cos: 1.9s (1.6% of total)

ival-cbrt: 1.3s (1.1% of total)

ival-exp: 1.1s (0.9% of total)

ival-neg: 545.0ms (0.5% of total)

ival-log1p: 499.0ms (0.4% of total)

ival-hypot: 375.0ms (0.3% of total)

ival-tan: 255.0ms (0.2% of total)

ival-expm1: 232.0ms (0.2% of total)

ival-acos: 74.0ms (0.1% of total)

ival-fabs: 66.0ms (0.1% of total)

ival-cosh: 20.0ms (0% of total)

ival-tanh: 16.0ms (0% of total)

ival-sinh: 11.0ms (0% of total)

soundness3.5min (11.2%)

Rules

255329×	`fma-define`
229445×	`fma-neg`
197685×	`log1p-expm1-u`
144772×	`associate-r`
140981×	`expm1-log1p-u`

Stop Event

80×	saturated
751×	node limit
144×	fuel
3×	unsound
125×	done

Compiler

Compiled 154356 to 80105 computations (48.1% saved)

rewrite2.9min (9.2%)

Algorithm

806×	batch-egg-rewrite

Rules

560164×	`log1p-expm1-u`
408942×	`expm1-log1p-u`
159632×	`pow1`
149580×	`add-exp-log`
144449×	`add-log-exp`

Stop Event

805×	node limit
1×	unsound

Counts

5583 → 203455

regimes2.5min (7.9%)

Counts

35348 → 5565

Calls

492 calls:

23.3s	y
23.0s	z
20.9s	x
17.0s	t
10.4s	a

Compiler

Compiled 44536 to 35233 computations (20.9% saved)

eval2.3min (7.3%)

Compiler: Compiled 8898473 to 4692789 computations (47.3% saved)

prune1.9min (6.1%)

Counts: 391189 → 13014
Compiler: Compiled 436631 to 295903 computations (32.2% saved)

bsearch1.6min (5.1%)

Algorithm

3249×	binary-search
317×	left-value

Stop Event

53×	predicate-same
3196×	narrow-enough

Results

1.0min	388188×	0	valid
4.2s	9941×	1	valid
788.0ms	4643×	0	invalid
173.0ms	616×	2	valid
13.0ms	23×	3	valid

Compiler

Compiled 714735 to 537056 computations (24.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 41.1s

ival-mult: 18.0s (43.9% of total)

ival-sub: 8.6s (20.9% of total)

ival-add: 5.9s (14.4% of total)

ival-div: 3.5s (8.5% of total)

ival-log: 1.4s (3.4% of total)

ival-sqrt: 1.2s (2.8% of total)

backward-pass: 783.0ms (1.9% of total)

const: 600.0ms (1.5% of total)

ival-sin: 495.0ms (1.2% of total)

ival-cos: 432.0ms (1.1% of total)

ival-exp: 172.0ms (0.4% of total)

ival-tanh: 11.0ms (0% of total)

ival-cosh: 2.0ms (0% of total)

ival-fabs: 2.0ms (0% of total)

ival-sinh: 1.0ms (0% of total)

preprocess1.1min (3.6%)

Algorithm

269×	egg-herbie

Rules

137764×	`fma-neg`
117084×	`fma-define`
57352×	`unsub-neg`
50425×	`sub-neg`
47106×	`distribute-rgt-in`

Stop Event

153×	saturated
116×	node limit

Compiler

Compiled 160092 to 80998 computations (49.4% saved)

series50.3s (2.6%)

Counts

5583 → 162481

Calls

39930 calls:

Time	Variable		Point	Expression
387.0ms	z	@	inf	(* (pow z y) (/ (/ (pow a (+ t -1)) (exp b)) y))
333.0ms	x	@	0	(* x (log y))
247.0ms	t	@	0	(/ (* z (+ y (* y (* z (+ (* -1/2 y) 1/2))))) t)
228.0ms	y	@	inf	(/ (neg (log y)) y)
225.0ms	x	@	0	(* z (/ 1 x))

explain45.7s (2.4%)

Results

22.4s	130510×	0	valid
5.7s	5674×	1	valid
2.2s	1352×	2	valid
151.0ms	174×	3	valid
27.0ms	18×	5	exit

Compiler

Compiled 26361 to 12514 computations (52.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 18.6s

ival-mult: 6.1s (32.7% of total)

ival-add: 2.6s (14.3% of total)

ival-log: 2.5s (13.5% of total)

ival-sub: 2.5s (13.3% of total)

ival-div: 1.8s (9.5% of total)

backward-pass: 962.0ms (5.2% of total)

ival-sqrt: 642.0ms (3.5% of total)

const: 467.0ms (2.5% of total)

ival-sin: 369.0ms (2% of total)

ival-cos: 313.0ms (1.7% of total)

ival-tan: 154.0ms (0.8% of total)

ival-exp: 138.0ms (0.7% of total)

ival-fabs: 15.0ms (0.1% of total)

ival-cosh: 13.0ms (0.1% of total)

ival-acos: 12.0ms (0.1% of total)

ival-sinh: 10.0ms (0.1% of total)

ival-tanh: 8.0ms (0% of total)

analyze20.2s (1.1%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.3%	68.2%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.3%	22.9%	0.1%	0%	4.6%	0%	6
79.9%	75.7%	19%	0.1%	0%	5.1%	0%	7
81.8%	77.1%	17.2%	0.1%	0%	5.6%	0%	8
84.5%	79.4%	14.6%	0.1%	0%	5.9%	0%	9
86%	80.6%	13.1%	0.1%	0%	6.2%	0%	10
88.6%	83%	10.6%	0.1%	0%	6.2%	0%	11
89.7%	83.7%	9.6%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 8.8s

ival-mult: 3.6s (41.1% of total)

ival-add: 1.5s (17.3% of total)

ival-sub: 1.4s (16.1% of total)

ival-div: 1.1s (13% of total)

ival-log: 209.0ms (2.4% of total)

ival-sqrt: 205.0ms (2.3% of total)

ival-sin: 194.0ms (2.2% of total)

const: 147.0ms (1.7% of total)

ival-exp: 123.0ms (1.4% of total)

ival-cosh: 92.0ms (1% of total)

backward-pass: 52.0ms (0.6% of total)

ival-cos: 26.0ms (0.3% of total)

ival-acos: 22.0ms (0.3% of total)

ival-tan: 17.0ms (0.2% of total)

ival-tanh: 11.0ms (0.1% of total)

ival-sinh: 4.0ms (0% of total)

ival-fabs: 3.0ms (0% of total)

Herbie run

sample5.9min (18.7%)

simplify4.3min (13.5%)

localize3.6min (11.4%)

soundness3.5min (11.2%)

rewrite2.9min (9.2%)

regimes2.5min (7.9%)

eval2.3min (7.3%)

prune1.9min (6.1%)

bsearch1.6min (5.1%)

preprocess1.1min (3.6%)

series50.3s (2.6%)

explain45.7s (2.4%)

analyze20.2s (1.1%)

end72.0ms (0%)

Profiling