Metrics for Herbie run

Date:	Monday, March 25th, 2024
Commit:	f03d6b38 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024085
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample7.8min (30.1%)

Results

1.1min	298450×	256	valid
36.6s	46068×	512	valid
4.6s	27943×	256	invalid
5.9s	27653×	256	infinite
6.5s	26562×	256	unsamplable
20.3s	25302×	1024	valid
2.6min	16575×	8192	exit
30.0s	11081×	2048	valid
52.3s	7331×	4096	valid
5.3s	5821×	512	infinite
1.3s	1663×	1024	invalid
1.1s	1167×	2048	invalid
20.6s	1157×	8192	valid
630.0ms	1132×	512	invalid
477.0ms	887×	256	precondition
3.0s	661×	2048	infinite
1.4s	523×	1024	infinite
2.5s	371×	4096	infinite
8.0ms	9×	512	unsamplable
3.0ms	2×	1024	unsamplable

Precisions

Click to see histograms. Total time spent on operations: 6.0min

Operation ival-pow, time spent: 2.6min, 42.0% of total-time

Operation ival-sin, time spent: 43.3s, 12.0% of total-time

Operation ival-mult, time spent: 40.9s, 11.0% of total-time

Operation ival-cos, time spent: 33.5s, 9.0% of total-time

Operation ival-div, time spent: 29.8s, 8.0% of total-time

Operation ival-exp, time spent: 11.9s, 3.0% of total-time

Operation ival-log, time spent: 10.0s, 3.0% of total-time

Operation ival-add, time spent: 9.2s, 3.0% of total-time

Operation ival-sub, time spent: 8.2s, 2.0% of total-time

Operation ival-sqrt, time spent: 4.7s, 1.0% of total-time

Operation ival-neg, time spent: 3.6s, 1.0% of total-time

Operation const, time spent: 3.6s, 1.0% of total-time

Operation ival-<, time spent: 2.3s, 1.0% of total-time

Operation ival-atan2, time spent: 2.1s, 1.0% of total-time

Operation ival-pi, time spent: 1.2s, 0.0% of total-time

Operation ival-acos, time spent: 1.1s, 0.0% of total-time

Operation ival-atan, time spent: 1.1s, 0.0% of total-time

Operation ival-tan, time spent: 651.0ms, 0.0% of total-time

Operation ival-and, time spent: 503.0ms, 0.0% of total-time

Operation ival-<=, time spent: 357.0ms, 0.0% of total-time

Operation ival-asin, time spent: 289.0ms, 0.0% of total-time

Operation ival-cbrt, time spent: 234.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 178.0ms, 0.0% of total-time

Operation ival-==, time spent: 2.0ms, 0.0% of total-time

Operation ival-or, time spent: 0.0ms, 0.0% of total-time

Bogosity

localize7.6min (29.3%)

Results

49.2s	27844×	256	valid
45.2s	3991×	512	valid
8.7s	3802×	256	invalid
16.5s	2839×	1024	valid
5.2s	2552×	256	infinite
3.2min	2514×	8192	exit
31.9s	2450×	2048	valid
27.1s	472×	4096	valid
3.6s	344×	512	infinite
923.0ms	151×	512	invalid
2.9s	143×	2048	infinite
88.0ms	102×	256	unsamplable
2.1s	97×	1024	infinite
2.3s	37×	4096	infinite
7.1s	21×	8192	valid
40.0ms	7×	1024	invalid
11.0ms	1×	2048	invalid

Compiler

Compiled 85439 to 47718 computations (44.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 6.3min

Operation ival-sin, time spent: 1.3min, 21.0% of total-time

Operation ival-mult, time spent: 1.1min, 17.0% of total-time

Operation ival-pow, time spent: 1.0min, 16.0% of total-time

Operation ival-cos, time spent: 58.0s, 15.0% of total-time

Operation ival-div, time spent: 28.1s, 7.0% of total-time

Operation composed, time spent: 27.1s, 7.0% of total-time

Operation ival-log, time spent: 14.4s, 4.0% of total-time

Operation ival-exp, time spent: 12.4s, 3.0% of total-time

Operation ival-add, time spent: 8.6s, 2.0% of total-time

Operation ival-sub, time spent: 5.4s, 1.0% of total-time

Operation ival-sqrt, time spent: 5.4s, 1.0% of total-time

Operation const, time spent: 5.0s, 1.0% of total-time

Operation ival-cbrt, time spent: 2.5s, 1.0% of total-time

Operation ival-atan2, time spent: 2.0s, 1.0% of total-time

Operation ival-atan, time spent: 1.3s, 0.0% of total-time

Operation ival-neg, time spent: 640.0ms, 0.0% of total-time

Operation ival-tan, time spent: 608.0ms, 0.0% of total-time

Operation ival-acos, time spent: 293.0ms, 0.0% of total-time

Operation ival-pi, time spent: 230.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 117.0ms, 0.0% of total-time

Operation ival-asin, time spent: 76.0ms, 0.0% of total-time

eval2.4min (9.4%)

Compiler: Compiled 6721844 to 4018040 computations (40.2% saved)

preprocess2.1min (8.1%)

Algorithm

51×	egg-herbie

Rules

31500×	`fma-define`
18832×	`fma-neg`
12964×	`div-sub`
11458×	`unsub-neg`
11133×	`sub-neg`

Stop Event

21×	saturated
30×	node limit

Results

10.1s	17074×	256	valid
11.0s	3230×	512	valid
5.7s	1744×	1024	valid
1.7s	1600×	256	infinite
14.8s	1166×	2048	valid
31.2s	590×	4096	valid
2.1s	450×	512	infinite
1.3s	120×	2048	infinite
12.8s	82×	8192	valid
421.0ms	30×	1024	infinite
1.0s	26×	4096	infinite

Compiler

Compiled 78534 to 47604 computations (39.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.4min

Operation ival-sin, time spent: 21.9s, 27.0% of total-time

Operation ival-cos, time spent: 16.0s, 20.0% of total-time

Operation ival-mult, time spent: 14.4s, 18.0% of total-time

Operation ival-div, time spent: 11.9s, 15.0% of total-time

Operation ival-pow, time spent: 10.2s, 12.0% of total-time

Operation ival-add, time spent: 2.1s, 3.0% of total-time

Operation ival-sub, time spent: 1.6s, 2.0% of total-time

Operation const, time spent: 1.1s, 1.0% of total-time

Operation ival-sqrt, time spent: 879.0ms, 1.0% of total-time

Operation ival-log, time spent: 636.0ms, 1.0% of total-time

Operation ival-tan, time spent: 265.0ms, 0.0% of total-time

Operation ival-exp, time spent: 252.0ms, 0.0% of total-time

Operation ival-cbrt, time spent: 237.0ms, 0.0% of total-time

Operation ival-atan, time spent: 206.0ms, 0.0% of total-time

Operation ival-atan2, time spent: 162.0ms, 0.0% of total-time

Operation ival-neg, time spent: 150.0ms, 0.0% of total-time

Operation ival-pi, time spent: 95.0ms, 0.0% of total-time

Operation ival-acos, time spent: 61.0ms, 0.0% of total-time

Operation ival-asin, time spent: 31.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 17.0ms, 0.0% of total-time

simplify1.2min (4.6%)

Algorithm

227×	egg-herbie

Rules

73582×	`fma-define`
57707×	`distribute-lft-in`
53881×	`*-commutative`
52843×	`associate-r`
48586×	`distribute-rgt-in`

Stop Event

50×	saturated
176×	node limit
1×	unsound

Counts

84894 → 74281

soundness1.0min (4%)

Rules

80672×	`fma-define`
58533×	`log1p-expm1-u`
49145×	`associate-r`
46260×	`fma-neg`
46185×	`expm1-log1p-u`

Stop Event

14×	saturated
40×	fuel
221×	node limit
2×	unsound
9×	done

Compiler

Compiled 62614 to 36704 computations (41.4% saved)

prune54.8s (3.5%)

Counts: 162643 → 6833
Compiler: Compiled 457463 to 320254 computations (30% saved)

regimes54.5s (3.5%)

Counts

18303 → 899

Calls

138 calls:

4.9s	lambda2
4.5s	phi1
4.2s	phi2
4.1s	lambda1
2.5s	(-.f64 lambda1 lambda2)

Compiler

Compiled 11784 to 8719 computations (26% saved)

rewrite38.2s (2.5%)

Algorithm

178×	batch-egg-rewrite

Rules

116316×	`log1p-expm1-u`
86364×	`expm1-log1p-u`
44823×	`pow1`
41795×	`add-exp-log`
39915×	`add-log-exp`

Stop Event

174×	node limit
4×	unsound

Counts

1636 → 46774

analyze35.6s (2.3%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
14.8%	11.8%	67.6%	20.6%	0%	0%	0%	1
22.6%	17.7%	60.4%	21%	0%	0.9%	0%	2
32.7%	24.7%	50.8%	21.2%	0%	3.3%	0%	3
39.8%	29.8%	45%	21.2%	0%	4%	0%	4
45.4%	33.8%	40.6%	21.2%	0%	4.5%	0%	5
48.4%	35.7%	38%	21.2%	0%	5.1%	0%	6
51.8%	37.8%	35.2%	21.2%	0%	5.7%	0.1%	7
53.5%	38.9%	33.8%	21.3%	0%	6%	0.1%	8
56.4%	40.6%	31.4%	21.3%	0%	6.6%	0.2%	9
57.7%	41.4%	30.3%	21.3%	0%	6.8%	0.2%	10
59.8%	42.7%	28.7%	21.3%	0%	7.1%	0.3%	11
61.3%	43.5%	27.5%	21.3%	0%	7.5%	0.3%	12

Compiler

Compiled 1919 to 1343 computations (30% saved)

Precisions

Click to see histograms. Total time spent on operations: 24.7s

Operation ival-mult, time spent: 7.4s, 30.0% of total-time

Operation ival-sin, time spent: 3.4s, 14.0% of total-time

Operation ival-pow, time spent: 3.2s, 13.0% of total-time

Operation ival-div, time spent: 3.0s, 12.0% of total-time

Operation ival-cos, time spent: 2.8s, 11.0% of total-time

Operation ival-add, time spent: 1.1s, 4.0% of total-time

Operation ival-sub, time spent: 1.0s, 4.0% of total-time

Operation ival-neg, time spent: 598.0ms, 2.0% of total-time

Operation ival-sqrt, time spent: 523.0ms, 2.0% of total-time

Operation const, time spent: 448.0ms, 2.0% of total-time

Operation ival-<, time spent: 397.0ms, 2.0% of total-time

Operation ival-atan2, time spent: 148.0ms, 1.0% of total-time

Operation ival-pi, time spent: 101.0ms, 0.0% of total-time

Operation ival-exp, time spent: 77.0ms, 0.0% of total-time

Operation ival-tan, time spent: 76.0ms, 0.0% of total-time

Operation ival-and, time spent: 65.0ms, 0.0% of total-time

Operation ival-log, time spent: 59.0ms, 0.0% of total-time

Operation ival-atan, time spent: 57.0ms, 0.0% of total-time

Operation ival-acos, time spent: 43.0ms, 0.0% of total-time

Operation ival-asin, time spent: 43.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 37.0ms, 0.0% of total-time

Operation ival-cbrt, time spent: 21.0ms, 0.0% of total-time

Operation ival-<=, time spent: 4.0ms, 0.0% of total-time

Operation ival-or, time spent: 0.0ms, 0.0% of total-time

Operation ival-==, time spent: 0.0ms, 0.0% of total-time

bsearch26.9s (1.7%)

Algorithm

349×	binary-search
64×	left-value

Stop Event

18×	predicate-same
331×	narrow-enough

Results

8.7s	29945×	256	valid
7.7s	7195×	512	valid
1.2s	1548×	2048	valid
947.0ms	1276×	256	infinite
1.1s	1157×	1024	valid
1.5s	1137×	4096	valid
209.0ms	1069×	256	invalid
661.0ms	590×	512	infinite
2.0ms	35×	256	unsamplable
1.0ms	2×	512	invalid

Compiler

Compiled 118047 to 88954 computations (24.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 16.8s

Operation ival-mult, time spent: 3.1s, 19.0% of total-time

Operation ival-sin, time spent: 2.9s, 17.0% of total-time

Operation ival-div, time spent: 2.5s, 15.0% of total-time

Operation ival-cos, time spent: 2.4s, 14.0% of total-time

Operation ival-pow, time spent: 1.8s, 11.0% of total-time

Operation ival-sub, time spent: 1.0s, 6.0% of total-time

Operation ival-add, time spent: 697.0ms, 4.0% of total-time

Operation ival-sqrt, time spent: 605.0ms, 4.0% of total-time

Operation ival-atan2, time spent: 470.0ms, 3.0% of total-time

Operation ival-atan, time spent: 423.0ms, 3.0% of total-time

Operation const, time spent: 238.0ms, 1.0% of total-time

Operation ival-acos, time spent: 179.0ms, 1.0% of total-time

Operation ival-neg, time spent: 116.0ms, 1.0% of total-time

Operation ival-pi, time spent: 109.0ms, 1.0% of total-time

Operation ival-log, time spent: 85.0ms, 1.0% of total-time

Operation ival-exp, time spent: 77.0ms, 0.0% of total-time

Operation ival-asin, time spent: 42.0ms, 0.0% of total-time

Operation ival-tan, time spent: 22.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 3.0ms, 0.0% of total-time

series16.0s (1%)

Counts

1636 → 38120

Calls

9444 calls:

Time	Variable		Point	Expression
165.0ms	R	@	0	(cbrt (* R (sqrt (+ (* (* (+ lambda1 lambda2) (cos (* 1/2 phi1))) (* (+ lambda1 lambda2) (cos (* 1/2 phi1)))) (* (- phi1 phi2) (- phi1 phi2))))))
152.0ms	c	@	-inf	(/ (* c (+ (* -3/2 (/ a b)) (* -9/8 (/ (* (pow a 2) c) (pow b 3))))) (* 3 a))
145.0ms	a	@	0	(/ (sqrt (* (* b (* (pow a 2) (neg b))) (* (* 8 (* (* a (pow b 2)) (/ (neg a) (pow (* x-scale y-scale) 2)))) (+ (/ (+ (pow (* a (sin (* angle (/ (PI) 180)))) 2) (pow (* b (cos (* angle (/ (PI) 180)))) 2)) (pow x-scale 2)) (+ (/ (+ (pow (* a (cos (* angle (/ (PI) 180)))) 2) (pow (* b (sin (* angle (/ (PI) 180)))) 2)) (pow y-scale 2)) (sqrt (+ (* (- (/ (+ (pow (* a (sin (* angle (/ (PI) 180)))) 2) (pow (* b (cos (* angle (/ (PI) 180)))) 2)) (pow x-scale 2)) (/ (+ (pow (* a (cos (* angle (/ (PI) 180)))) 2) (pow (* b (sin (* angle (/ (PI) 180)))) 2)) (pow y-scale 2))) (- (/ (+ (pow (* a (sin (* angle (/ (PI) 180)))) 2) (pow (* b (cos (* angle (/ (PI) 180)))) 2)) (pow x-scale 2)) (/ (+ (pow (* a (cos (* angle (/ (PI) 180)))) 2) (pow (* b (sin (* angle (/ (PI) 180)))) 2)) (pow y-scale 2)))) (* (* (* 2 (- (pow b 2) (pow a 2))) (/ (* (sin (* angle (/ (PI) 180))) (cos (* angle (/ (PI) 180)))) (* x-scale y-scale))) (* (* 2 (- (pow b 2) (pow a 2))) (/ (* (sin (* angle (/ (PI) 180))) (cos (* angle (/ (PI) 180)))) (* x-scale y-scale))))))))))) (* (* a (pow b 2)) (/ (neg a) (pow (* x-scale y-scale) 2))))
131.0ms	t	@	-inf	(cbrt (cos t))
90.0ms	theta	@	-inf	(* (sin theta) (* (sin delta) (cos phi1)))

end0.0ms (0%)

Precisions: Click to see histograms. Total time spent on operations: 8.0s
Operation ival-pow, time spent: 4.7s, 59.0% of total-time
Operation ival-div, time spent: 3.3s, 41.0% of total-time

sample7.8min (30.1%)

localize7.6min (29.3%)

eval2.4min (9.4%)

preprocess2.1min (8.1%)

simplify1.2min (4.6%)

soundness1.0min (4%)

prune54.8s (3.5%)

regimes54.5s (3.5%)

rewrite38.2s (2.5%)

analyze35.6s (2.3%)

bsearch26.9s (1.7%)

series16.0s (1%)

end0.0ms (0%)

Profiling