Metrics for Herbie run

Date:	Wednesday, March 20th, 2024
Commit:	0f421560 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024080
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample3.2min (29.3%)

Results

1.1min	373291×	256	valid
12.9s	71876×	256	infinite
6.0s	10719×	1024	valid
1.2min	7804×	8192	exit
3.0s	7241×	512	valid
1.1s	5622×	256	unsamplable
3.6s	4481×	512	infinite
1.2s	1844×	2048	valid
631.0ms	1122×	4096	valid
73.0ms	565×	256	invalid
87.0ms	83×	1024	infinite

Precisions

Click to see histograms. Total time spent on operations: 2.0min

Operation ival-sin, time spent: 46.5s, 38.0% of total-time

Operation ival-mult, time spent: 20.0s, 16.0% of total-time

Operation ival-add, time spent: 11.6s, 10.0% of total-time

Operation ival-sub, time spent: 8.9s, 7.0% of total-time

Operation ival-div, time spent: 8.3s, 7.0% of total-time

Operation ival-pow, time spent: 5.6s, 5.0% of total-time

Operation ival-log, time spent: 3.4s, 3.0% of total-time

Operation ival-sqrt, time spent: 3.1s, 3.0% of total-time

Operation ival-exp, time spent: 2.9s, 2.0% of total-time

Operation ival-asin, time spent: 2.3s, 2.0% of total-time

Operation const, time spent: 2.0s, 2.0% of total-time

Operation ival-cos, time spent: 1.7s, 1.0% of total-time

Operation ival-atan2, time spent: 1.2s, 1.0% of total-time

Operation ival->, time spent: 917.0ms, 1.0% of total-time

Operation ival-pi, time spent: 732.0ms, 1.0% of total-time

Operation ival-asinh, time spent: 544.0ms, 0.0% of total-time

Operation ival-<=, time spent: 423.0ms, 0.0% of total-time

Operation ival-neg, time spent: 368.0ms, 0.0% of total-time

Operation ival-acosh, time spent: 367.0ms, 0.0% of total-time

Operation ival-atanh, time spent: 258.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 237.0ms, 0.0% of total-time

Operation ival->=, time spent: 155.0ms, 0.0% of total-time

Operation ival-and, time spent: 102.0ms, 0.0% of total-time

Bogosity

localize2.7min (24.4%)

Results

37.5s	30470×	256	valid
4.1s	5543×	256	infinite
7.4s	4704×	256	invalid
25.2s	2234×	1024	valid
8.5s	1382×	512	valid
22.9s	1072×	2048	valid
11.9s	862×	8192	exit
7.3s	226×	2048	infinite
521.0ms	125×	512	infinite
800.0ms	118×	4096	valid
54.0ms	61×	256	unsamplable
487.0ms	51×	1024	infinite

Compiler

Compiled 52279 to 31025 computations (40.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.9min

Operation ival-mult, time spent: 21.4s, 18.0% of total-time

Operation ival-pow, time spent: 15.1s, 13.0% of total-time

Operation composed, time spent: 14.5s, 12.0% of total-time

Operation ival-add, time spent: 13.3s, 11.0% of total-time

Operation ival-div, time spent: 10.2s, 9.0% of total-time

Operation ival-asin, time spent: 9.6s, 8.0% of total-time

Operation ival-log, time spent: 8.9s, 8.0% of total-time

Operation ival-sub, time spent: 8.0s, 7.0% of total-time

Operation ival-sqrt, time spent: 3.6s, 3.0% of total-time

Operation ival-exp, time spent: 3.0s, 3.0% of total-time

Operation const, time spent: 2.8s, 2.0% of total-time

Operation ival-acos, time spent: 1.8s, 2.0% of total-time

Operation ival-sin, time spent: 1.5s, 1.0% of total-time

Operation ival-cos, time spent: 1.0s, 1.0% of total-time

Operation ival-atan2, time spent: 677.0ms, 1.0% of total-time

Operation ival-neg, time spent: 327.0ms, 0.0% of total-time

Operation ival-cbrt, time spent: 279.0ms, 0.0% of total-time

Operation ival-copysign, time spent: 170.0ms, 0.0% of total-time

Operation ival-pi, time spent: 83.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 79.0ms, 0.0% of total-time

eval1.2min (10.6%)

Compiler: Compiled 3022414 to 1975871 computations (34.6% saved)

simplify48.6s (7.3%)

Algorithm

223×	egg-herbie

Rules

60173×	`fma-define`
50347×	`distribute-lft-in`
46959×	`fma-neg`
45564×	`associate-r`
45165×	`distribute-rgt-in`

Stop Event

57×	saturated
161×	node limit
37×	fuel
5×	unsound
20×	done

Counts

66176 → 61739

Compiler

Compiled 12843 to 8234 computations (35.9% saved)

soundness45.8s (6.9%)

Rules

59691×	`fma-define`
45953×	`fma-neg`
45645×	`log1p-expm1-u`
41242×	`associate-r`
38057×	`distribute-lft-in`

Stop Event

19×	saturated
179×	node limit
7×	unsound

Compiler

Compiled 40241 to 24592 computations (38.9% saved)

preprocess40.0s (6%)

Algorithm

57×	egg-herbie

Rules

20546×	`fma-neg`
20224×	`fma-define`
10466×	`unsub-neg`
9196×	`sub-neg`
8861×	`distribute-lft-in`

Stop Event

32×	saturated
25×	node limit

Results

7.3s	21668×	256	valid
2.1s	4554×	256	infinite
5.4s	1360×	1024	valid
1.9s	1064×	512	valid
198.0ms	274×	512	infinite
602.0ms	160×	2048	valid
61.0ms	84×	4096	valid
14.0ms	16×	1024	infinite
10.0ms	4×	8192	exit

Compiler

Compiled 50401 to 27430 computations (45.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 12.1s

Operation ival-mult, time spent: 2.5s, 20.0% of total-time

Operation ival-add, time spent: 2.4s, 20.0% of total-time

Operation ival-sub, time spent: 2.3s, 19.0% of total-time

Operation ival-div, time spent: 1.8s, 15.0% of total-time

Operation ival-log, time spent: 563.0ms, 5.0% of total-time

Operation const, time spent: 459.0ms, 4.0% of total-time

Operation ival-exp, time spent: 408.0ms, 3.0% of total-time

Operation ival-sqrt, time spent: 345.0ms, 3.0% of total-time

Operation ival-pow, time spent: 344.0ms, 3.0% of total-time

Operation ival-sin, time spent: 275.0ms, 2.0% of total-time

Operation ival-asin, time spent: 232.0ms, 2.0% of total-time

Operation composed, time spent: 219.0ms, 2.0% of total-time

Operation ival-cos, time spent: 97.0ms, 1.0% of total-time

Operation ival-atan2, time spent: 76.0ms, 1.0% of total-time

Operation ival-neg, time spent: 43.0ms, 0.0% of total-time

Operation ival-pi, time spent: 32.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 24.0ms, 0.0% of total-time

Operation ival-copysign, time spent: 13.0ms, 0.0% of total-time

rewrite34.8s (5.3%)

Algorithm

166×	batch-egg-rewrite

Rules

112033×	`log1p-expm1-u`
85947×	`expm1-log1p-u`
35947×	`pow1`
33387×	`add-exp-log`
31205×	`add-log-exp`

Stop Event

159×	node limit
7×	unsound

Counts

1322 → 40641

prune22.3s (3.4%)

Counts: 90395 → 2928
Compiler: Compiled 141160 to 100022 computations (29.1% saved)

regimes15.2s (2.3%)

Counts

7402 → 851

Calls

132 calls:

2.2s	y.re
1.4s	x.im
1.3s	y.im
1.2s	x.re
1.1s	x

Compiler

Compiled 6317 to 4288 computations (32.1% saved)

bsearch14.3s (2.2%)

Algorithm

406×	binary-search
48×	left-value

Stop Event

14×	predicate-same
392×	narrow-enough

Results

6.5s	37196×	256	valid
2.1s	6453×	256	infinite
1.2s	1710×	512	infinite
293.0ms	553×	1024	valid
286.0ms	527×	512	valid
184.0ms	299×	2048	valid
113.0ms	97×	1024	infinite
29.0ms	61×	4096	valid

Compiler

Compiled 94183 to 65391 computations (30.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 6.5s

Operation ival-mult, time spent: 2.7s, 41.0% of total-time

Operation ival-add, time spent: 783.0ms, 12.0% of total-time

Operation ival-div, time spent: 524.0ms, 8.0% of total-time

Operation ival-log, time spent: 480.0ms, 7.0% of total-time

Operation ival-sin, time spent: 334.0ms, 5.0% of total-time

Operation ival-exp, time spent: 322.0ms, 5.0% of total-time

Operation ival-sqrt, time spent: 316.0ms, 5.0% of total-time

Operation ival-sub, time spent: 287.0ms, 4.0% of total-time

Operation ival-atan2, time spent: 282.0ms, 4.0% of total-time

Operation ival-cos, time spent: 222.0ms, 3.0% of total-time

Operation const, time spent: 105.0ms, 2.0% of total-time

Operation ival-asin, time spent: 65.0ms, 1.0% of total-time

Operation ival-fabs, time spent: 27.0ms, 0.0% of total-time

Operation ival-copysign, time spent: 26.0ms, 0.0% of total-time

Operation ival-neg, time spent: 13.0ms, 0.0% of total-time

Operation ival-pi, time spent: 7.0ms, 0.0% of total-time

series11.4s (1.7%)

Counts

1322 → 25535

Calls

6630 calls:

Time	Variable		Point	Expression
250.0ms	wj	@	0	(* wj (- (+ 1 (+ (* 1/2 x) (* wj (- (* -1 x) (+ 1 (+ x (* 1/2 x))))))) (* -2 x)))
200.0ms	x.im	@	-inf	(sin (+ (* y.im (log (sqrt (+ (* x.re x.re) (* x.im x.im))))) (* (atan2 x.im x.re) y.re)))
195.0ms	x.re	@	0	(/ (+ (* x.re y.re) (* x.im y.im)) (+ (* y.re y.re) (* y.im y.im)))
152.0ms	d3	@	0	(- (+ d2 d4) d3)
146.0ms	x.re	@	inf	(/ (+ x.im (/ (* x.re y.re) y.im)) y.im)

analyze4.5s (0.7%)

Algorithm

58×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	86.3%	13.7%	0%	0%	0%	0
55.6%	48%	38.3%	13.7%	0%	0%	0%	1
64.1%	54.2%	30.4%	13.7%	0%	1.7%	0%	2
72%	59%	23%	13.7%	0%	4.3%	0%	3
77.8%	62.3%	17.8%	13.7%	0%	6.2%	0%	4
83.7%	67%	13%	13.7%	0%	6.3%	0%	5
85.9%	68.4%	11.2%	13.7%	0%	6.6%	0%	6
88.3%	70.3%	9.3%	13.7%	0%	6.6%	0%	7
90%	71.6%	8%	13.7%	0%	6.8%	0%	8
91.2%	72.5%	7%	13.7%	0%	6.8%	0%	9
92.6%	73.6%	5.9%	13.7%	0%	6.8%	0%	10
94%	74.7%	4.8%	13.7%	0%	6.8%	0%	11
94.5%	75.1%	4.4%	13.7%	0%	6.9%	0%	12

Compiler

Compiled 1558 to 1007 computations (35.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.9s

Operation ival-mult, time spent: 1.0s, 34.0% of total-time

Operation ival-add, time spent: 415.0ms, 14.0% of total-time

Operation ival-log, time spent: 316.0ms, 11.0% of total-time

Operation ival-sub, time spent: 240.0ms, 8.0% of total-time

Operation ival-sqrt, time spent: 186.0ms, 6.0% of total-time

Operation ival-atan2, time spent: 183.0ms, 6.0% of total-time

Operation ival-div, time spent: 124.0ms, 4.0% of total-time

Operation ival-sin, time spent: 99.0ms, 3.0% of total-time

Operation ival-pow, time spent: 85.0ms, 3.0% of total-time

Operation ival->, time spent: 68.0ms, 2.0% of total-time

Operation ival-exp, time spent: 63.0ms, 2.0% of total-time

Operation const, time spent: 60.0ms, 2.0% of total-time

Operation ival-pi, time spent: 46.0ms, 2.0% of total-time

Operation ival-cos, time spent: 25.0ms, 1.0% of total-time

Operation ival-<=, time spent: 11.0ms, 0.0% of total-time

Operation ival-neg, time spent: 7.0ms, 0.0% of total-time

Operation ival-and, time spent: 2.0ms, 0.0% of total-time

Operation ival-asin, time spent: 1.0ms, 0.0% of total-time

Operation ival-atanh, time spent: 1.0ms, 0.0% of total-time

Operation ival-asinh, time spent: 0.0ms, 0.0% of total-time

Operation ival->=, time spent: 0.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 0.0ms, 0.0% of total-time

Operation ival-acosh, time spent: 0.0ms, 0.0% of total-time

Herbie run

sample3.2min (29.3%)

localize2.7min (24.4%)

eval1.2min (10.6%)

simplify48.6s (7.3%)

soundness45.8s (6.9%)

preprocess40.0s (6%)

rewrite34.8s (5.3%)

prune22.3s (3.4%)

regimes15.2s (2.3%)

bsearch14.3s (2.2%)

series11.4s (1.7%)

analyze4.5s (0.7%)

end23.0ms (0%)

Profiling