Metrics for Herbie run

Date:	Monday, March 25th, 2024
Commit:	f03d6b38 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024085
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample7.4min (20.7%)

Results

4.1min	1821651×	256	valid
50.3s	342601×	256	infinite
12.3s	63852×	256	invalid
13.1s	30413×	512	valid
8.4s	19180×	1024	valid
3.1s	5102×	2048	valid
2.0s	1573×	8192	exit
253.0ms	1121×	512	infinite
344.0ms	791×	1024	infinite
180.0ms	649×	1024	invalid
107.0ms	589×	512	invalid
5.0ms	5×	4096	valid

Precisions

Click to see histograms. Total time spent on operations: 2.7min

Operation ival-mult, time spent: 55.0s, 34.0% of total-time

Operation ival-sub, time spent: 24.0s, 15.0% of total-time

Operation ival-add, time spent: 23.0s, 14.0% of total-time

Operation ival-div, time spent: 22.1s, 14.0% of total-time

Operation ival-log, time spent: 12.6s, 8.0% of total-time

Operation ival-sqrt, time spent: 6.8s, 4.0% of total-time

Operation ival-sin, time spent: 5.0s, 3.0% of total-time

Operation const, time spent: 4.3s, 3.0% of total-time

Operation ival-cos, time spent: 4.1s, 3.0% of total-time

Operation ival-exp, time spent: 1.5s, 1.0% of total-time

Operation ival-tan, time spent: 286.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 285.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 277.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 247.0ms, 0.0% of total-time

Operation ival-acos, time spent: 219.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 104.0ms, 0.0% of total-time

Bogosity

localize4.4min (12.3%)

Results

1.7min	173499×	256	valid
16.4s	31442×	256	infinite
7.5s	8551×	256	invalid
16.8s	3839×	1024	valid
11.5s	2989×	512	valid
27.2s	2163×	8192	exit
12.9s	1543×	2048	valid
453.0ms	455×	256	unsamplable
559.0ms	273×	1024	infinite
167.0ms	118×	512	infinite
483.0ms	94×	512	invalid
193.0ms	51×	2048	infinite
182.0ms	7×	4096	valid

Compiler

Compiled 113720 to 49482 computations (56.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.4min

Operation ival-mult, time spent: 39.5s, 27.0% of total-time

Operation ival-pow, time spent: 19.7s, 14.0% of total-time

Operation ival-div, time spent: 18.6s, 13.0% of total-time

Operation ival-add, time spent: 16.6s, 11.0% of total-time

Operation composed, time spent: 11.7s, 8.0% of total-time

Operation ival-sub, time spent: 9.4s, 6.0% of total-time

Operation ival-cos, time spent: 6.6s, 5.0% of total-time

Operation ival-log, time spent: 5.9s, 4.0% of total-time

Operation ival-sqrt, time spent: 5.8s, 4.0% of total-time

Operation const, time spent: 3.5s, 2.0% of total-time

Operation ival-exp, time spent: 2.6s, 2.0% of total-time

Operation ival-sin, time spent: 1.8s, 1.0% of total-time

Operation ival-cbrt, time spent: 1.7s, 1.0% of total-time

Operation ival-neg, time spent: 841.0ms, 1.0% of total-time

Operation ival-tan, time spent: 422.0ms, 0.0% of total-time

Operation ival-acos, time spent: 136.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 90.0ms, 0.0% of total-time

Operation ival-e, time spent: 52.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 25.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 22.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 15.0ms, 0.0% of total-time

simplify4.2min (11.8%)

Algorithm

1089×

egg-herbie

Rules

298933×	`fma-define`
255576×	`fma-neg`
202996×	`*-commutative`
200094×	`distribute-lft-in`
200090×	`associate-r`

Stop Event

268×	saturated
816×	node limit
5×	unsound

Counts

373385 → 319240

soundness3.6min (9.9%)

Rules

260587×	`fma-define`
233695×	`fma-neg`
200990×	`log1p-expm1-u`
150143×	`associate-r`
149308×	`times-frac`

Stop Event

86×	saturated
762×	node limit
142×	fuel
6×	unsound
127×	done

Compiler

Compiled 160594 to 83582 computations (48% saved)

eval3.4min (9.5%)

Compiler: Compiled 9118606 to 4754275 computations (47.9% saved)

rewrite2.9min (8.1%)

Algorithm

820×	batch-egg-rewrite

Rules

570224×	`log1p-expm1-u`
427282×	`expm1-log1p-u`
160603×	`pow1`
151075×	`add-exp-log`
143707×	`add-log-exp`

Stop Event

817×	node limit
3×	unsound

Counts

5724 → 207438

regimes2.5min (6.9%)

Counts

37601 → 5858

Calls

493 calls:

23.2s	z
22.1s	y
21.9s	x
16.8s	t
10.7s	a

Compiler

Compiled 45617 to 36046 computations (21% saved)

preprocess2.2min (6.2%)

Algorithm

269×	egg-herbie

Rules

137764×	`fma-neg`
117084×	`fma-define`
57352×	`unsub-neg`
50425×	`sub-neg`
47106×	`distribute-rgt-in`

Stop Event

153×	saturated
116×	node limit

Results

24.0s	110096×	256	valid
4.5s	21818×	256	infinite
4.5s	2424×	1024	valid
2.0s	2148×	512	valid
1.4s	844×	2048	valid
417.0ms	200×	1024	infinite
161.0ms	158×	512	infinite
47.0ms	36×	2048	infinite
1.0ms	2×	8192	exit
1.0ms	2×	4096	valid

Compiler

Compiled 196333 to 98496 computations (49.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 19.4s

Operation ival-mult, time spent: 5.6s, 29.0% of total-time

Operation ival-sub, time spent: 3.2s, 16.0% of total-time

Operation ival-add, time spent: 3.0s, 16.0% of total-time

Operation ival-log, time spent: 2.5s, 13.0% of total-time

Operation ival-div, time spent: 2.1s, 11.0% of total-time

Operation ival-sqrt, time spent: 1.2s, 6.0% of total-time

Operation const, time spent: 590.0ms, 3.0% of total-time

Operation ival-sin, time spent: 462.0ms, 2.0% of total-time

Operation ival-cos, time spent: 326.0ms, 2.0% of total-time

Operation ival-exp, time spent: 210.0ms, 1.0% of total-time

Operation ival-tan, time spent: 168.0ms, 1.0% of total-time

Operation ival-sinh, time spent: 22.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 16.0ms, 0.0% of total-time

Operation ival-acos, time spent: 14.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 13.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 11.0ms, 0.0% of total-time

bsearch2.0min (5.6%)

Algorithm

3443×	binary-search
329×	left-value

Stop Event

60×	predicate-same
3382×	narrow-enough
1×	predicate-failed

Results

58.8s	333356×	256	valid
27.1s	86418×	256	infinite
2.6s	5802×	512	valid
566.0ms	5593×	256	invalid
1.0s	2395×	1024	valid
86.0ms	242×	2048	valid
13.0ms	51×	512	infinite
3.0ms	13×	1024	infinite

Compiler

Compiled 785919 to 586867 computations (25.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 46.5s

Operation ival-mult, time spent: 19.7s, 43.0% of total-time

Operation ival-sub, time spent: 10.8s, 23.0% of total-time

Operation ival-add, time spent: 6.8s, 15.0% of total-time

Operation ival-div, time spent: 4.0s, 9.0% of total-time

Operation ival-sqrt, time spent: 1.4s, 3.0% of total-time

Operation ival-log, time spent: 1.4s, 3.0% of total-time

Operation const, time spent: 795.0ms, 2.0% of total-time

Operation ival-sin, time spent: 602.0ms, 1.0% of total-time

Operation ival-cos, time spent: 570.0ms, 1.0% of total-time

Operation ival-exp, time spent: 244.0ms, 1.0% of total-time

Operation ival-tanh, time spent: 74.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 16.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 7.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 2.0ms, 0.0% of total-time

prune2.0min (5.5%)

Counts: 396208 → 13344
Compiler: Compiled 444512 to 302738 computations (31.9% saved)

series51.8s (2.4%)

Counts

5724 → 165947

Calls

40797 calls:

Time	Variable		Point	Expression
345.0ms	y	@	inf	(* t (* (* y (+ (* z (/ z t)) -1)) 4))
319.0ms	z	@	inf	(log (sqrt (exp (* 1/3 (acos (* (/ (/ x y) z) (* 1/18 (sqrt t))))))))
315.0ms	z	@	inf	(cbrt (* z (/ (cos y) x)))
301.0ms	x	@	-inf	(* x (- (log (neg x)) (log (neg y))))
291.0ms	y	@	0	(pow (* y (* 3 x)) 1/4)

analyze20.7s (1%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.3%	68.3%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.4%	22.9%	0.1%	0%	4.6%	0%	6
80%	75.7%	19%	0.1%	0%	5.1%	0%	7
81.8%	77.1%	17.1%	0.1%	0%	5.6%	0%	8
84.5%	79.4%	14.6%	0.1%	0%	5.9%	0%	9
86.1%	80.6%	13.1%	0.1%	0%	6.2%	0%	10
88.6%	83%	10.6%	0.1%	0%	6.2%	0%	11
89.7%	83.7%	9.6%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 9.5s

Operation ival-mult, time spent: 3.8s, 40.0% of total-time

Operation ival-add, time spent: 1.7s, 18.0% of total-time

Operation ival-sub, time spent: 1.4s, 15.0% of total-time

Operation ival-div, time spent: 1.3s, 14.0% of total-time

Operation ival-sin, time spent: 259.0ms, 3.0% of total-time

Operation const, time spent: 252.0ms, 3.0% of total-time

Operation ival-sqrt, time spent: 240.0ms, 3.0% of total-time

Operation ival-log, time spent: 239.0ms, 3.0% of total-time

Operation ival-exp, time spent: 116.0ms, 1.0% of total-time

Operation ival-tan, time spent: 101.0ms, 1.0% of total-time

Operation ival-cos, time spent: 38.0ms, 0.0% of total-time

Operation ival-acos, time spent: 24.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 15.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 8.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 8.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 4.0ms, 0.0% of total-time

Herbie run

sample7.4min (20.7%)

localize4.4min (12.3%)

simplify4.2min (11.8%)

soundness3.6min (9.9%)

eval3.4min (9.5%)

rewrite2.9min (8.1%)

regimes2.5min (6.9%)

preprocess2.2min (6.2%)

bsearch2.0min (5.6%)

prune2.0min (5.5%)

series51.8s (2.4%)

analyze20.7s (1%)

end1.0ms (0%)

Profiling