Metrics for Herbie run

Date:	Sunday, March 24th, 2024
Commit:	5a8b346c on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024084
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample7.3min (20.1%)

Results

4.1min	1825195×	256	valid
49.4s	339061×	256	infinite
12.4s	64854×	256	invalid
12.7s	30360×	512	valid
9.0s	19304×	1024	valid
3.1s	5066×	2048	valid
1.9s	1573×	8192	exit
277.0ms	1111×	512	infinite
430.0ms	764×	1024	infinite
229.0ms	701×	1024	invalid
104.0ms	538×	512	invalid
1.0ms	3×	4096	valid

Precisions

Click to see histograms. Total time spent on operations: 2.6min

Operation ival-mult, time spent: 52.7s, 34.0% of total-time

Operation ival-add, time spent: 24.6s, 16.0% of total-time

Operation ival-sub, time spent: 23.6s, 15.0% of total-time

Operation ival-div, time spent: 20.0s, 13.0% of total-time

Operation ival-log, time spent: 10.0s, 6.0% of total-time

Operation ival-sqrt, time spent: 6.9s, 4.0% of total-time

Operation ival-sin, time spent: 5.2s, 3.0% of total-time

Operation const, time spent: 4.2s, 3.0% of total-time

Operation ival-cos, time spent: 3.9s, 3.0% of total-time

Operation ival-exp, time spent: 1.5s, 1.0% of total-time

Operation ival-tan, time spent: 339.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 321.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 222.0ms, 0.0% of total-time

Operation ival-acos, time spent: 209.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 189.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 106.0ms, 0.0% of total-time

Bogosity

localize4.7min (12.8%)

Results

1.7min	177950×	256	valid
15.2s	28653×	256	infinite
6.3s	7067×	256	invalid
20.6s	3895×	1024	valid
12.2s	3327×	512	valid
35.6s	2591×	8192	exit
15.1s	1451×	2048	valid
874.0ms	317×	1024	infinite
384.0ms	303×	256	unsamplable
204.0ms	133×	512	infinite
645.0ms	91×	2048	infinite
32.0ms	6×	512	invalid
28.0ms	3×	1024	invalid
7.0ms	3×	4096	infinite
10.0ms	2×	4096	valid

Compiler

Compiled 117709 to 51815 computations (56% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.7min

Operation ival-mult, time spent: 42.5s, 26.0% of total-time

Operation ival-pow, time spent: 21.6s, 13.0% of total-time

Operation ival-div, time spent: 18.9s, 12.0% of total-time

Operation ival-add, time spent: 18.1s, 11.0% of total-time

Operation composed, time spent: 15.3s, 9.0% of total-time

Operation ival-sub, time spent: 11.0s, 7.0% of total-time

Operation ival-log, time spent: 9.5s, 6.0% of total-time

Operation ival-cos, time spent: 6.5s, 4.0% of total-time

Operation ival-sqrt, time spent: 6.2s, 4.0% of total-time

Operation ival-exp, time spent: 4.9s, 3.0% of total-time

Operation const, time spent: 3.6s, 2.0% of total-time

Operation ival-sin, time spent: 2.6s, 2.0% of total-time

Operation ival-cbrt, time spent: 1.2s, 1.0% of total-time

Operation ival-neg, time spent: 911.0ms, 1.0% of total-time

Operation ival-tan, time spent: 277.0ms, 0.0% of total-time

Operation ival-acos, time spent: 215.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 42.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 36.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 26.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 11.0ms, 0.0% of total-time

simplify4.4min (12%)

Algorithm

1097×

egg-herbie

Rules

300059×	`fma-define`
241453×	`fma-neg`
214033×	`*-commutative`
213947×	`associate-r`
205457×	`distribute-lft-in`

Stop Event

268×	saturated
823×	node limit
6×	unsound

Counts

386007 → 329117

eval3.5min (9.8%)

Compiler: Compiled 9602739 to 5061730 computations (47.3% saved)

soundness3.4min (9.4%)

Rules

250266×	`fma-define`
226250×	`fma-neg`
178384×	`log1p-expm1-u`
149205×	`associate-r`
143361×	`times-frac`

Stop Event

81×	saturated
730×	node limit
144×	fuel
4×	unsound
125×	done

Compiler

Compiled 153876 to 79625 computations (48.3% saved)

rewrite3.0min (8.4%)

Algorithm

828×	batch-egg-rewrite

Rules

579929×	`log1p-expm1-u`
422123×	`expm1-log1p-u`
162872×	`pow1`
153510×	`add-exp-log`
144750×	`add-log-exp`

Stop Event

826×	node limit
2×	unsound

Counts

5828 → 216709

regimes2.5min (6.8%)

Counts

36994 → 5659

Calls

495 calls:

23.4s	x
21.7s	z
21.4s	y
16.1s	t
10.3s	a

Compiler

Compiled 46116 to 36601 computations (20.6% saved)

preprocess2.2min (6.1%)

Algorithm

269×	egg-herbie

Rules

137764×	`fma-neg`
117084×	`fma-define`
57352×	`unsub-neg`
50425×	`sub-neg`
47106×	`distribute-rgt-in`

Stop Event

153×	saturated
116×	node limit

Results

23.9s	111036×	256	valid
4.6s	20808×	256	infinite
3.5s	2340×	1024	valid
1.8s	2150×	512	valid
2.0s	890×	2048	valid
376.0ms	254×	1024	infinite
135.0ms	184×	512	infinite
112.0ms	64×	2048	infinite
2.0ms	2×	8192	exit

Compiler

Compiled 190497 to 95018 computations (50.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 19.8s

Operation ival-mult, time spent: 5.8s, 29.0% of total-time

Operation ival-sub, time spent: 2.9s, 15.0% of total-time

Operation ival-div, time spent: 2.9s, 15.0% of total-time

Operation ival-add, time spent: 2.7s, 14.0% of total-time

Operation ival-log, time spent: 2.6s, 13.0% of total-time

Operation ival-sin, time spent: 847.0ms, 4.0% of total-time

Operation ival-sqrt, time spent: 631.0ms, 3.0% of total-time

Operation const, time spent: 581.0ms, 3.0% of total-time

Operation ival-cos, time spent: 535.0ms, 3.0% of total-time

Operation ival-exp, time spent: 182.0ms, 1.0% of total-time

Operation ival-tan, time spent: 35.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 16.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 14.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 13.0ms, 0.0% of total-time

Operation ival-acos, time spent: 11.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 10.0ms, 0.0% of total-time

prune2.0min (5.6%)

Counts: 407652 → 13411
Compiler: Compiled 455987 to 308268 computations (32.4% saved)

bsearch2.0min (5.6%)

Algorithm

3281×	binary-search
330×	left-value

Stop Event

39×	predicate-same
3242×	narrow-enough

Results

55.8s	309010×	256	valid
31.2s	88253×	256	infinite
1.0s	9299×	256	invalid
1.3s	4137×	512	valid
878.0ms	2137×	1024	valid
149.0ms	191×	512	infinite
75.0ms	162×	2048	valid
48.0ms	94×	1024	infinite

Compiler

Compiled 764739 to 574587 computations (24.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 48.0s

Operation ival-mult, time spent: 23.0s, 48.0% of total-time

Operation ival-sub, time spent: 9.7s, 20.0% of total-time

Operation ival-add, time spent: 6.2s, 13.0% of total-time

Operation ival-div, time spent: 4.1s, 8.0% of total-time

Operation ival-log, time spent: 1.7s, 3.0% of total-time

Operation ival-sqrt, time spent: 800.0ms, 2.0% of total-time

Operation const, time spent: 769.0ms, 2.0% of total-time

Operation ival-sin, time spent: 735.0ms, 2.0% of total-time

Operation ival-cos, time spent: 607.0ms, 1.0% of total-time

Operation ival-exp, time spent: 400.0ms, 1.0% of total-time

Operation ival-sinh, time spent: 11.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 9.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 8.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 4.0ms, 0.0% of total-time

series52.5s (2.4%)

Counts

5828 → 169298

Calls

41403 calls:

Time	Variable		Point	Expression
458.0ms	t	@	inf	(* (/ y x) (tanh (/ t y)))
429.0ms	x	@	-inf	(+ (log (sqrt x)) (log (/ (sqrt x) y)))
330.0ms	t	@	inf	(* y (+ 5 (+ (* 2 x) (/ (* x (+ t (* 2 z))) y))))
307.0ms	z	@	0	(+ (* (- t x) (/ (- y z) (- a z))) x)
284.0ms	y	@	0	(* (- x 1) (log y))

analyze21.9s (1%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.3%	68.3%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.4%	22.9%	0.1%	0%	4.6%	0%	6
80%	75.7%	19%	0.1%	0%	5.1%	0%	7
81.8%	77.1%	17.1%	0.1%	0%	5.6%	0%	8
84.5%	79.4%	14.6%	0.1%	0%	5.9%	0%	9
86.1%	80.6%	13.1%	0.1%	0%	6.2%	0%	10
88.6%	83%	10.6%	0.1%	0%	6.2%	0%	11
89.7%	83.7%	9.6%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 9.8s

Operation ival-mult, time spent: 3.6s, 36.0% of total-time

Operation ival-sub, time spent: 1.7s, 17.0% of total-time

Operation ival-add, time spent: 1.5s, 16.0% of total-time

Operation ival-div, time spent: 1.3s, 13.0% of total-time

Operation ival-sin, time spent: 419.0ms, 4.0% of total-time

Operation ival-log, time spent: 398.0ms, 4.0% of total-time

Operation ival-sqrt, time spent: 394.0ms, 4.0% of total-time

Operation const, time spent: 243.0ms, 2.0% of total-time

Operation ival-exp, time spent: 114.0ms, 1.0% of total-time

Operation ival-tan, time spent: 55.0ms, 1.0% of total-time

Operation ival-cos, time spent: 43.0ms, 0.0% of total-time

Operation ival-acos, time spent: 29.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 26.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 8.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 4.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 3.0ms, 0.0% of total-time

Herbie run

sample7.3min (20.1%)

localize4.7min (12.8%)

simplify4.4min (12%)

eval3.5min (9.8%)

soundness3.4min (9.4%)

rewrite3.0min (8.4%)

regimes2.5min (6.8%)

preprocess2.2min (6.1%)

prune2.0min (5.6%)

bsearch2.0min (5.6%)

series52.5s (2.4%)

analyze21.9s (1%)

end1.0ms (0%)

Profiling