Metrics for Herbie run

Date:	Sunday, March 17th, 2024
Commit:	614f1775 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024077
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample8.0min (20.7%)

Results

4.5min	1824893×	256	valid
51.8s	339375×	256	infinite
13.2s	64467×	256	invalid
14.6s	30498×	512	valid
9.0s	19185×	1024	valid
3.4s	5065×	2048	valid
1.9s	1625×	8192	exit
276.0ms	1117×	512	infinite
315.0ms	728×	1024	infinite
254.0ms	713×	1024	invalid
110.0ms	582×	512	invalid
3.0ms	3×	4096	valid

Precisions

Click to see histograms. Total time spent on operations: 2.8min

Operation ival-mult, time spent: 59.2s, 35.0% of total-time

Operation ival-add, time spent: 26.7s, 16.0% of total-time

Operation ival-sub, time spent: 26.2s, 16.0% of total-time

Operation ival-div, time spent: 21.4s, 13.0% of total-time

Operation ival-log, time spent: 10.8s, 6.0% of total-time

Operation ival-sqrt, time spent: 6.4s, 4.0% of total-time

Operation ival-sin, time spent: 5.8s, 3.0% of total-time

Operation const, time spent: 4.4s, 3.0% of total-time

Operation ival-cos, time spent: 3.9s, 2.0% of total-time

Operation ival-exp, time spent: 1.9s, 1.0% of total-time

Operation ival-tan, time spent: 370.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 257.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 253.0ms, 0.0% of total-time

Operation ival-acos, time spent: 237.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 200.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 111.0ms, 0.0% of total-time

Bogosity

localize5.0min (13%)

Results

1.7min	169409×	256	valid
18.5s	30817×	256	infinite
9.9s	9805×	256	invalid
18.8s	3791×	1024	valid
48.9s	2771×	8192	exit
8.9s	2687×	512	valid
14.9s	1197×	2048	valid
737.0ms	711×	256	unsamplable
1.1s	301×	1024	infinite
488.0ms	133×	512	infinite
163.0ms	48×	2048	infinite
100.0ms	13×	512	invalid
18.0ms	8×	4096	valid
12.0ms	4×	512	unsamplable
3.0ms	1×	4096	infinite

Compiler

Compiled 113516 to 49478 computations (56.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.9min

Operation ival-mult, time spent: 43.7s, 25.0% of total-time

Operation ival-pow, time spent: 24.6s, 14.0% of total-time

Operation ival-add, time spent: 19.2s, 11.0% of total-time

Operation ival-div, time spent: 19.2s, 11.0% of total-time

Operation composed, time spent: 16.7s, 9.0% of total-time

Operation ival-cos, time spent: 11.9s, 7.0% of total-time

Operation ival-log, time spent: 10.0s, 6.0% of total-time

Operation ival-sub, time spent: 9.9s, 6.0% of total-time

Operation ival-sqrt, time spent: 5.7s, 3.0% of total-time

Operation ival-sin, time spent: 5.0s, 3.0% of total-time

Operation const, time spent: 3.7s, 2.0% of total-time

Operation ival-exp, time spent: 3.5s, 2.0% of total-time

Operation ival-cbrt, time spent: 1.4s, 1.0% of total-time

Operation ival-neg, time spent: 877.0ms, 0.0% of total-time

Operation ival-acos, time spent: 325.0ms, 0.0% of total-time

Operation ival-tan, time spent: 270.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 40.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 33.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 19.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 18.0ms, 0.0% of total-time

simplify4.6min (11.8%)

Algorithm

1069×

egg-herbie

Rules

287258×	`fma-define`
234159×	`fma-neg`
210208×	`*-commutative`
206431×	`associate-r`
195876×	`distribute-lft-in`

Stop Event

268×	saturated
796×	node limit
143×	fuel
5×	unsound
126×	done

Counts

375007 → 318091

Compiler

Compiled 65016 to 39231 computations (39.7% saved)

soundness3.9min (10.1%)

Rules

249523×	`fma-define`
225249×	`fma-neg`
178442×	`log1p-expm1-u`
150594×	`associate-r`
150263×	`times-frac`

Stop Event

83×	saturated
749×	node limit
2×	unsound

Compiler

Compiled 99557 to 55930 computations (43.8% saved)

eval3.7min (9.5%)

Compiler: Compiled 9121670 to 4787342 computations (47.5% saved)

rewrite3.1min (8.1%)

Algorithm

800×	batch-egg-rewrite

Rules

548021×	`log1p-expm1-u`
403604×	`expm1-log1p-u`
161212×	`pow1`
152152×	`add-exp-log`
144681×	`add-log-exp`

Stop Event

799×	node limit
1×	unsound

Counts

5716 → 206880

regimes2.6min (6.8%)

Counts

36260 → 5424

Calls

485 calls:

24.7s	y
22.9s	z
22.7s	x
18.5s	t
11.9s	a

Compiler

Compiled 45609 to 36121 computations (20.8% saved)

preprocess2.5min (6.4%)

Algorithm

269×	egg-herbie

Rules

137764×	`fma-neg`
117084×	`fma-define`
57352×	`unsub-neg`
50425×	`sub-neg`
47106×	`distribute-rgt-in`

Stop Event

153×	saturated
116×	node limit

Results

26.9s	109448×	256	valid
5.3s	22352×	256	infinite
4.4s	2510×	1024	valid
2.1s	2084×	512	valid
1.7s	854×	2048	valid
1.1s	230×	1024	infinite
208.0ms	178×	512	infinite
77.0ms	68×	2048	infinite
3.0ms	4×	8192	exit

Compiler

Compiled 192821 to 95684 computations (50.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 23.4s

Operation ival-mult, time spent: 7.0s, 30.0% of total-time

Operation ival-add, time spent: 4.3s, 19.0% of total-time

Operation ival-sub, time spent: 3.6s, 16.0% of total-time

Operation ival-log, time spent: 3.3s, 14.0% of total-time

Operation ival-div, time spent: 2.5s, 11.0% of total-time

Operation ival-sqrt, time spent: 749.0ms, 3.0% of total-time

Operation ival-sin, time spent: 686.0ms, 3.0% of total-time

Operation const, time spent: 629.0ms, 3.0% of total-time

Operation ival-cos, time spent: 340.0ms, 1.0% of total-time

Operation ival-exp, time spent: 233.0ms, 1.0% of total-time

Operation ival-tan, time spent: 35.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 14.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 13.0ms, 0.0% of total-time

Operation ival-acos, time spent: 12.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 11.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 11.0ms, 0.0% of total-time

prune2.0min (5.2%)

Counts: 393446 → 13020
Compiler: Compiled 436719 to 294762 computations (32.5% saved)

bsearch2.0min (5.1%)

Algorithm

3099×	binary-search
344×	left-value

Stop Event

56×	predicate-same
3043×	narrow-enough

Results

54.0s	292086×	256	valid
30.0s	83197×	256	infinite
859.0ms	7249×	256	invalid
1.3s	3151×	512	valid
894.0ms	2007×	1024	valid
43.0ms	111×	512	infinite
41.0ms	91×	2048	valid
30.0ms	61×	1024	infinite
1.0ms	7×	512	invalid

Compiler

Compiled 738939 to 548610 computations (25.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 45.8s

Operation ival-mult, time spent: 20.6s, 45.0% of total-time

Operation ival-sub, time spent: 11.1s, 24.0% of total-time

Operation ival-add, time spent: 6.2s, 14.0% of total-time

Operation ival-div, time spent: 3.2s, 7.0% of total-time

Operation ival-log, time spent: 1.9s, 4.0% of total-time

Operation const, time spent: 736.0ms, 2.0% of total-time

Operation ival-sin, time spent: 687.0ms, 2.0% of total-time

Operation ival-cos, time spent: 667.0ms, 1.0% of total-time

Operation ival-sqrt, time spent: 495.0ms, 1.0% of total-time

Operation ival-exp, time spent: 235.0ms, 1.0% of total-time

Operation ival-tanh, time spent: 7.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 2.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 2.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 1.0ms, 0.0% of total-time

series53.7s (2.3%)

Counts

5716 → 168127

Calls

41238 calls:

Time	Variable		Point	Expression
434.0ms	a	@	inf	(log (* z (* (pow t (+ a -1/2)) (+ x y))))
294.0ms	z	@	-inf	(log (* (cbrt (pow (exp 1/3) (acos (* (/ (* 1/18 x) y) (/ (sqrt t) z))))) (cbrt (pow (exp 1/3) (acos (* (/ (* 1/18 x) y) (/ (sqrt t) z)))))))
257.0ms	z	@	inf	(cbrt (+ (* x y) (* (pow z 2) 2)))
240.0ms	x	@	-inf	(* (log (cbrt (/ x y))) 3)
216.0ms	y	@	-inf	(* (sin x) (/ (pow (cbrt y) 3) x))

analyze24.2s (1%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.3%	68.3%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.4%	22.9%	0.1%	0%	4.6%	0%	6
80%	75.7%	19%	0.1%	0%	5.1%	0%	7
81.8%	77.1%	17.1%	0.1%	0%	5.6%	0%	8
84.5%	79.4%	14.6%	0.1%	0%	5.9%	0%	9
86.1%	80.6%	13.1%	0.1%	0%	6.2%	0%	10
88.6%	83%	10.6%	0.1%	0%	6.2%	0%	11
89.7%	83.7%	9.6%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 10.5s

Operation ival-mult, time spent: 4.0s, 38.0% of total-time

Operation ival-sub, time spent: 1.9s, 18.0% of total-time

Operation ival-add, time spent: 1.7s, 16.0% of total-time

Operation ival-div, time spent: 1.5s, 14.0% of total-time

Operation ival-sqrt, time spent: 301.0ms, 3.0% of total-time

Operation ival-log, time spent: 301.0ms, 3.0% of total-time

Operation ival-sin, time spent: 281.0ms, 3.0% of total-time

Operation const, time spent: 266.0ms, 3.0% of total-time

Operation ival-exp, time spent: 173.0ms, 2.0% of total-time

Operation ival-tan, time spent: 55.0ms, 1.0% of total-time

Operation ival-cos, time spent: 51.0ms, 0.0% of total-time

Operation ival-acos, time spent: 28.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 21.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 9.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 6.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 4.0ms, 0.0% of total-time

Herbie run

sample8.0min (20.7%)

localize5.0min (13%)

simplify4.6min (11.8%)

soundness3.9min (10.1%)

eval3.7min (9.5%)

rewrite3.1min (8.1%)

regimes2.6min (6.8%)

preprocess2.5min (6.4%)

prune2.0min (5.2%)

bsearch2.0min (5.1%)

series53.7s (2.3%)

analyze24.2s (1%)

end335.0ms (0%)

Profiling