Metrics for Herbie run

Date:	Sunday, March 17th, 2024
Commit:	d4730769 on longer-taylor
Hostname:	nightly with Racket 8.11.1
Seed:	2024077
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample7.4min (20.5%)

Results

4.1min	1824893×	256	valid
48.9s	339375×	256	infinite
12.2s	64467×	256	invalid
14.8s	30498×	512	valid
8.3s	19185×	1024	valid
2.9s	5065×	2048	valid
2.5s	1625×	8192	exit
260.0ms	1117×	512	infinite
525.0ms	728×	1024	infinite
355.0ms	713×	1024	invalid
110.0ms	582×	512	invalid
2.0ms	3×	4096	valid

Precisions

Click to see histograms. Total time spent on operations: 2.6min

Operation ival-mult, time spent: 54.3s, 34.0% of total-time

Operation ival-sub, time spent: 25.6s, 16.0% of total-time

Operation ival-add, time spent: 22.9s, 14.0% of total-time

Operation ival-div, time spent: 20.6s, 13.0% of total-time

Operation ival-log, time spent: 11.8s, 7.0% of total-time

Operation ival-sqrt, time spent: 6.2s, 4.0% of total-time

Operation ival-sin, time spent: 4.7s, 3.0% of total-time

Operation ival-cos, time spent: 4.6s, 3.0% of total-time

Operation const, time spent: 4.2s, 3.0% of total-time

Operation ival-exp, time spent: 1.9s, 1.0% of total-time

Operation ival-tan, time spent: 588.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 280.0ms, 0.0% of total-time

Operation ival-acos, time spent: 277.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 236.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 212.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 150.0ms, 0.0% of total-time

Bogosity

localize4.8min (13.3%)

Results

1.7min	169409×	256	valid
17.2s	30817×	256	infinite
9.2s	9805×	256	invalid
18.5s	3791×	1024	valid
46.9s	2771×	8192	exit
9.2s	2687×	512	valid
13.5s	1197×	2048	valid
832.0ms	711×	256	unsamplable
1.4s	301×	1024	infinite
375.0ms	133×	512	infinite
158.0ms	48×	2048	infinite
174.0ms	13×	512	invalid
15.0ms	8×	4096	valid
15.0ms	4×	512	unsamplable
3.0ms	1×	4096	infinite

Compiler

Compiled 113516 to 49478 computations (56.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.8min

Operation ival-mult, time spent: 41.2s, 24.0% of total-time

Operation ival-pow, time spent: 24.5s, 14.0% of total-time

Operation ival-div, time spent: 20.3s, 12.0% of total-time

Operation ival-add, time spent: 19.2s, 11.0% of total-time

Operation composed, time spent: 14.8s, 9.0% of total-time

Operation ival-cos, time spent: 11.3s, 7.0% of total-time

Operation ival-sub, time spent: 9.5s, 6.0% of total-time

Operation ival-log, time spent: 8.9s, 5.0% of total-time

Operation ival-sqrt, time spent: 5.6s, 3.0% of total-time

Operation ival-sin, time spent: 4.4s, 3.0% of total-time

Operation const, time spent: 3.6s, 2.0% of total-time

Operation ival-exp, time spent: 3.5s, 2.0% of total-time

Operation ival-cbrt, time spent: 1.5s, 1.0% of total-time

Operation ival-neg, time spent: 665.0ms, 0.0% of total-time

Operation ival-tan, time spent: 232.0ms, 0.0% of total-time

Operation ival-acos, time spent: 149.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 37.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 28.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 16.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 15.0ms, 0.0% of total-time

simplify4.2min (11.8%)

Algorithm

1069×

egg-herbie

Rules

287258×	`fma-define`
234159×	`fma-neg`
210208×	`*-commutative`
206431×	`associate-r`
195876×	`distribute-lft-in`

Stop Event

268×	saturated
796×	node limit
143×	fuel
5×	unsound
126×	done

Counts

375007 → 318091

Compiler

Compiled 65016 to 39231 computations (39.7% saved)

soundness3.5min (9.8%)

Rules

249523×	`fma-define`
225249×	`fma-neg`
178442×	`log1p-expm1-u`
150594×	`associate-r`
150263×	`times-frac`

Stop Event

83×	saturated
749×	node limit
2×	unsound

Compiler

Compiled 99557 to 55930 computations (43.8% saved)

eval3.4min (9.3%)

Compiler: Compiled 9121670 to 4787342 computations (47.5% saved)

rewrite2.9min (8.2%)

Algorithm

800×	batch-egg-rewrite

Rules

548021×	`log1p-expm1-u`
403604×	`expm1-log1p-u`
161212×	`pow1`
152152×	`add-exp-log`
144681×	`add-log-exp`

Stop Event

799×	node limit
1×	unsound

Counts

5716 → 206880

regimes2.4min (6.8%)

Counts

36260 → 5424

Calls

485 calls:

22.9s	z
22.8s	y
20.5s	x
15.8s	t
13.6s	a

Compiler

Compiled 45609 to 36121 computations (20.8% saved)

preprocess2.3min (6.3%)

Algorithm

269×	egg-herbie

Rules

137764×	`fma-neg`
117084×	`fma-define`
57352×	`unsub-neg`
50425×	`sub-neg`
47106×	`distribute-rgt-in`

Stop Event

153×	saturated
116×	node limit

Results

24.4s	109448×	256	valid
5.6s	22352×	256	infinite
4.3s	2510×	1024	valid
1.7s	2084×	512	valid
1.9s	854×	2048	valid
479.0ms	230×	1024	infinite
254.0ms	178×	512	infinite
300.0ms	68×	2048	infinite
3.0ms	4×	8192	exit

Compiler

Compiled 192821 to 95684 computations (50.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 21.4s

Operation ival-mult, time spent: 7.2s, 34.0% of total-time

Operation ival-log, time spent: 3.4s, 16.0% of total-time

Operation ival-add, time spent: 3.0s, 14.0% of total-time

Operation ival-sub, time spent: 2.7s, 13.0% of total-time

Operation ival-div, time spent: 2.2s, 10.0% of total-time

Operation ival-sqrt, time spent: 950.0ms, 4.0% of total-time

Operation const, time spent: 661.0ms, 3.0% of total-time

Operation ival-cos, time spent: 504.0ms, 2.0% of total-time

Operation ival-sin, time spent: 487.0ms, 2.0% of total-time

Operation ival-exp, time spent: 165.0ms, 1.0% of total-time

Operation ival-tan, time spent: 36.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 14.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 12.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 12.0ms, 0.0% of total-time

Operation ival-acos, time spent: 12.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 11.0ms, 0.0% of total-time

prune1.9min (5.4%)

Counts: 393446 → 13020
Compiler: Compiled 436719 to 294762 computations (32.5% saved)

bsearch1.9min (5.3%)

Algorithm

3099×	binary-search
344×	left-value

Stop Event

56×	predicate-same
3043×	narrow-enough

Results

52.9s	292086×	256	valid
29.7s	83197×	256	infinite
999.0ms	7249×	256	invalid
1.4s	3151×	512	valid
758.0ms	2007×	1024	valid
145.0ms	111×	512	infinite
40.0ms	91×	2048	valid
28.0ms	61×	1024	infinite
2.0ms	7×	512	invalid

Compiler

Compiled 738939 to 548610 computations (25.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 45.2s

Operation ival-mult, time spent: 20.4s, 45.0% of total-time

Operation ival-sub, time spent: 9.7s, 21.0% of total-time

Operation ival-add, time spent: 6.7s, 15.0% of total-time

Operation ival-div, time spent: 3.6s, 8.0% of total-time

Operation ival-log, time spent: 1.7s, 4.0% of total-time

Operation const, time spent: 762.0ms, 2.0% of total-time

Operation ival-sin, time spent: 662.0ms, 1.0% of total-time

Operation ival-exp, time spent: 612.0ms, 1.0% of total-time

Operation ival-sqrt, time spent: 541.0ms, 1.0% of total-time

Operation ival-cos, time spent: 441.0ms, 1.0% of total-time

Operation ival-tanh, time spent: 7.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 2.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 2.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 1.0ms, 0.0% of total-time

series50.5s (2.3%)

Counts

5716 → 168127

Calls

41238 calls:

Time	Variable		Point	Expression
481.0ms	y	@	inf	(+ (* (- t x) (/ (- y z) (- a z))) x)
268.0ms	z	@	-inf	(log (* (cbrt (pow (exp 1/3) (acos (* (/ (* 1/18 x) y) (/ (sqrt t) z))))) (cbrt (pow (exp 1/3) (acos (* (/ (* 1/18 x) y) (/ (sqrt t) z)))))))
261.0ms	x	@	inf	(* 3 (log (cbrt x)))
227.0ms	a	@	inf	(pow (exp a) (- (log (+ 1 (neg z))) b))
220.0ms	x	@	-inf	(* (log (cbrt (/ x y))) 3)

analyze22.5s (1%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.3%	68.3%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.4%	22.9%	0.1%	0%	4.6%	0%	6
80%	75.7%	19%	0.1%	0%	5.1%	0%	7
81.8%	77.1%	17.1%	0.1%	0%	5.6%	0%	8
84.5%	79.4%	14.6%	0.1%	0%	5.9%	0%	9
86.1%	80.6%	13.1%	0.1%	0%	6.2%	0%	10
88.6%	83%	10.6%	0.1%	0%	6.2%	0%	11
89.7%	83.7%	9.6%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 11.3s

Operation ival-mult, time spent: 3.9s, 34.0% of total-time

Operation ival-sub, time spent: 2.0s, 18.0% of total-time

Operation ival-add, time spent: 1.6s, 14.0% of total-time

Operation ival-div, time spent: 1.4s, 13.0% of total-time

Operation ival-sin, time spent: 715.0ms, 6.0% of total-time

Operation ival-tan, time spent: 587.0ms, 5.0% of total-time

Operation ival-sqrt, time spent: 369.0ms, 3.0% of total-time

Operation ival-log, time spent: 253.0ms, 2.0% of total-time

Operation const, time spent: 242.0ms, 2.0% of total-time

Operation ival-exp, time spent: 125.0ms, 1.0% of total-time

Operation ival-cosh, time spent: 63.0ms, 1.0% of total-time

Operation ival-cos, time spent: 47.0ms, 0.0% of total-time

Operation ival-acos, time spent: 22.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 9.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 4.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 3.0ms, 0.0% of total-time

Herbie run

sample7.4min (20.5%)

localize4.8min (13.3%)

simplify4.2min (11.8%)

soundness3.5min (9.8%)

eval3.4min (9.3%)

rewrite2.9min (8.2%)

regimes2.4min (6.8%)

preprocess2.3min (6.3%)

prune1.9min (5.4%)

bsearch1.9min (5.3%)

series50.5s (2.3%)

analyze22.5s (1%)

end199.0ms (0%)

Profiling