Metrics for Herbie run

Date:	Wednesday, May 22nd, 2024
Commit:	a80fb046 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024143
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample9.5min (26.6%)

Results

2.2min	22432×	5	exit
2.2min	129524×	1	valid
1.5min	269302×	0	valid
47.9s	8017×	3	valid
37.2s	19366×	2	valid
21.9s	41086×	0	unsamplable
14.8s	1380×	4	valid
8.3s	18947×	0	invalid
5.9s	10967×	1	invalid
2.5s	1774×	2	invalid
241.0ms	3×	5	valid
186.0ms	920×	0	precondition
63.0ms	46×	1	unsamplable
28.0ms	20×	3	invalid

Precisions

Click to see histograms. Total time spent on operations: 7.0min

ival-pow: 2.2min (31.5% of total)

ival-mult: 1.0min (14.5% of total)

ival-sin: 34.6s (8.3% of total)

ival-div: 32.5s (7.7% of total)

ival-cos: 31.5s (7.5% of total)

backward-pass: 29.4s (7% of total)

ival-sub: 19.9s (4.7% of total)

ival-add: 19.6s (4.7% of total)

ival-sqrt: 11.8s (2.8% of total)

ival-exp: 10.6s (2.5% of total)

ival-log: 9.5s (2.3% of total)

ival-neg: 6.4s (1.5% of total)

ival-<: 6.2s (1.5% of total)

ival-atan2: 2.7s (0.6% of total)

...c/correct-round.rkt:121:19: 2.6s (0.6% of total)

const: 1.8s (0.4% of total)

ival-pi: 1.5s (0.4% of total)

ival-and: 1.2s (0.3% of total)

ival-tan: 1.2s (0.3% of total)

ival-atan: 914.0ms (0.2% of total)

ival-cbrt: 726.0ms (0.2% of total)

ival-acos: 708.0ms (0.2% of total)

ival-<=: 483.0ms (0.1% of total)

ival-fabs: 414.0ms (0.1% of total)

ival-asin: 284.0ms (0.1% of total)

ival-==: 5.0ms (0% of total)

ival-or: 0.0ms (0% of total)

Bogosity

simplify7.2min (20%)

Algorithm

442×	egg-herbie

Rules

181385×	`fma-define`
113875×	`fma-neg`
100208×	`distribute-lft-in`
92948×	`*-commutative`
89157×	`times-frac`

Stop Event

117×	saturated
324×	node limit
1×	unsound

Counts

139463 → 114781

soundness3.5min (9.7%)

Rules

83439×	`fma-define`
63264×	`log1p-expm1-u`
49335×	`fma-neg`
48793×	`expm1-log1p-u`
47764×	`distribute-lft-in`

Stop Event

15×	saturated
42×	fuel
246×	node limit
3×	unsound
7×	done

Compiler

Compiled 68505 to 19795 computations (71.1% saved)

localize3.4min (9.4%)

Results

54.2s	11835×	1	valid
32.5s	29401×	0	valid
25.8s	1729×	5	exit
17.4s	2404×	2	valid
9.0s	545×	3	valid
8.5s	4083×	0	invalid
2.7s	372×	1	invalid
966.0ms	46×	4	valid
71.0ms	17×	2	invalid

Compiler

Compiled 89910 to 7232 computations (92% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.4min

ival-mult: 17.0s (20.3% of total)

ival-pow: 13.2s (15.7% of total)

ival-sin: 9.9s (11.8% of total)

backward-pass: 8.7s (10.4% of total)

ival-div: 8.4s (10% of total)

ival-cos: 6.8s (8.2% of total)

ival-add: 3.5s (4.2% of total)

ival-sqrt: 2.7s (3.2% of total)

ival-sub: 2.3s (2.7% of total)

...c/correct-round.rkt:121:19: 1.9s (2.3% of total)

ival-log: 1.3s (1.6% of total)

ival-exp: 1.2s (1.4% of total)

ival-hypot: 1.2s (1.4% of total)

ival-fma: 1.2s (1.4% of total)

ival-atan2: 742.0ms (0.9% of total)

ival-cbrt: 544.0ms (0.6% of total)

ival-neg: 525.0ms (0.6% of total)

ival-acos: 455.0ms (0.5% of total)

ival-atan: 385.0ms (0.5% of total)

const: 361.0ms (0.4% of total)

ival-log1p: 321.0ms (0.4% of total)

ival-expm1: 294.0ms (0.4% of total)

ival-pi: 261.0ms (0.3% of total)

ival-tan: 210.0ms (0.3% of total)

ival-fabs: 189.0ms (0.2% of total)

ival-asin: 184.0ms (0.2% of total)

prune2.2min (6.2%)

Counts: 185141 → 7841
Compiler: Compiled 544531 to 268511 computations (50.7% saved)

rewrite1.9min (5.4%)

Algorithm

195×	batch-egg-rewrite

Rules

119194×	`log1p-expm1-u`
89049×	`expm1-log1p-u`
48779×	`pow1`
45777×	`add-exp-log`
44939×	`add-log-exp`

Stop Event

192×	node limit
3×	unsound

Counts

2873 → 75715

eval1.8min (5.1%)

Compiler: Compiled 8312009 to 818977 computations (90.1% saved)

regimes1.6min (4.4%)

Counts

25157 → 938

Calls

142 calls:

7.3s	phi1
5.8s	lambda1
5.7s	phi2
4.5s	lambda2
3.9s	(-.f64 lambda1 lambda2)

Compiler

Compiled 13152 to 8601 computations (34.6% saved)

series1.5min (4.3%)

Counts

2873 → 64490

Calls

16620 calls:

Time	Variable		Point	Expression
1.2s	F	@	0	(sqrt (* F (* (+ A (- C (sqrt (+ (* B B) (* (- A C) (- A C)))))) (* 2 (+ (* C (* A -4)) (pow B 2))))))
1.2s	x-scale	@	-inf	(log (/ (atan (* -1/2 (* y-scale (* (/ 2 x-scale) (/ (pow (sqrt (+ (* (* a (sin (* 1/180 (* angle (PI))))) (* a (sin (* 1/180 (* angle (PI)))))) (* (* (cos (* 1/180 (* angle (PI)))) b) (* (cos (* 1/180 (* angle (PI)))) b)))) 2) (* (cos (* 1/180 (* angle (PI)))) (* (sin (* 1/180 (* angle (PI)))) (- (pow b 2) (pow a 2))))))))) (PI)))
1.2s	angle	@	0	(atan (/ (- (- (/ (+ (pow (* a (cos (* (/ angle 180) (PI)))) 2) (pow (* b (sin (* (/ angle 180) (PI)))) 2)) (pow y-scale 2)) (/ (+ (pow (* a (sin (* (/ angle 180) (PI)))) 2) (pow (* (cos (* (/ angle 180) (PI))) b) 2)) (pow x-scale 2))) (sqrt (+ (* (- (/ (+ (pow (* a (sin (* (/ angle 180) (PI)))) 2) (pow (* (cos (* (/ angle 180) (PI))) b) 2)) (pow x-scale 2)) (/ (+ (pow (* a (cos (* (/ angle 180) (PI)))) 2) (pow (* b (sin (* (/ angle 180) (PI)))) 2)) (pow y-scale 2))) (- (/ (+ (pow (* a (sin (* (/ angle 180) (PI)))) 2) (pow (* (cos (* (/ angle 180) (PI))) b) 2)) (pow x-scale 2)) (/ (+ (pow (* a (cos (* (/ angle 180) (PI)))) 2) (pow (* b (sin (* (/ angle 180) (PI)))) 2)) (pow y-scale 2)))) (* (* (cos (* (/ angle 180) (PI))) (/ (* 2 (* (sin (* (/ angle 180) (PI))) (- (pow b 2) (pow a 2)))) (* y-scale x-scale))) (* (cos (* (/ angle 180) (PI))) (/ (* 2 (* (sin (* (/ angle 180) (PI))) (- (pow b 2) (pow a 2)))) (* y-scale x-scale))))))) (* (cos (* (/ angle 180) (PI))) (/ (* 2 (* (sin (* (/ angle 180) (PI))) (- (pow b 2) (pow a 2)))) (* y-scale x-scale)))))
1.1s	angle	@	-inf	(* (log (sqrt (+ (* (* a (sin (* (PI) (* angle 1/180)))) (* a (sin (* (PI) (* angle 1/180))))) (* (* b (cos (* (PI) (* angle 1/180)))) (* b (cos (* (PI) (* angle 1/180)))))))) 6)
977.0ms	C	@	-inf	(* 180 (/ (atan (+ (* -1 (/ (+ A (* -1 A)) B)) (* -1/2 (/ B C)))) (PI)))

analyze59.0s (2.7%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
14.8%	11.8%	67.6%	20.6%	0%	0%	0%	1
22.6%	17.7%	60.4%	21%	0%	0.9%	0%	2
32.7%	24.7%	50.8%	21.2%	0%	3.3%	0%	3
39.8%	29.8%	45%	21.2%	0%	4%	0%	4
45.4%	33.8%	40.6%	21.2%	0%	4.5%	0%	5
48.4%	35.7%	38%	21.2%	0%	5.1%	0%	6
51.8%	37.8%	35.2%	21.2%	0%	5.7%	0.1%	7
53.5%	38.9%	33.8%	21.3%	0%	6%	0.1%	8
56.4%	40.6%	31.4%	21.3%	0%	6.6%	0.2%	9
57.7%	41.4%	30.3%	21.3%	0%	6.8%	0.2%	10
59.8%	42.7%	28.7%	21.3%	0%	7.1%	0.3%	11
61.3%	43.5%	27.5%	21.3%	0%	7.5%	0.3%	12

Compiler

Compiled 1919 to 947 computations (50.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 36.7s

ival-mult: 10.9s (29.6% of total)

ival-pow: 7.2s (19.5% of total)

ival-cos: 3.8s (10.5% of total)

ival-sin: 3.5s (9.5% of total)

ival-div: 3.1s (8.5% of total)

ival-sub: 2.0s (5.3% of total)

ival-add: 1.7s (4.5% of total)

ival-sqrt: 1.1s (3.1% of total)

ival-<: 776.0ms (2.1% of total)

ival-neg: 506.0ms (1.4% of total)

...c/correct-round.rkt:121:19: 495.0ms (1.3% of total)

ival-atan2: 320.0ms (0.9% of total)

const: 201.0ms (0.5% of total)

ival-exp: 164.0ms (0.4% of total)

ival-and: 164.0ms (0.4% of total)

ival-pi: 149.0ms (0.4% of total)

ival-fabs: 136.0ms (0.4% of total)

ival-tan: 113.0ms (0.3% of total)

ival-atan: 110.0ms (0.3% of total)

ival-log: 102.0ms (0.3% of total)

ival-acos: 83.0ms (0.2% of total)

ival-asin: 81.0ms (0.2% of total)

ival-cbrt: 41.0ms (0.1% of total)

backward-pass: 36.0ms (0.1% of total)

ival-<=: 7.0ms (0% of total)

ival-==: 1.0ms (0% of total)

ival-or: 0.0ms (0% of total)

bsearch55.8s (2.6%)

Algorithm

380×	binary-search
45×	left-value

Stop Event

3×	predicate-same
377×	narrow-enough

Results

25.3s	16904×	1	valid
11.9s	27767×	0	valid
2.9s	1903×	2	valid
2.8s	1074×	3	valid
371.0ms	1466×	0	invalid

Compiler

Compiled 126685 to 86964 computations (31.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 35.4s

ival-cos: 7.9s (22.4% of total)

ival-mult: 7.6s (21.4% of total)

ival-sin: 5.8s (16.3% of total)

ival-pow: 2.9s (8.3% of total)

ival-div: 2.6s (7.4% of total)

backward-pass: 2.3s (6.5% of total)

ival-sub: 1.9s (5.4% of total)

ival-add: 1.1s (3.2% of total)

ival-sqrt: 1.1s (3.1% of total)

ival-acos: 476.0ms (1.3% of total)

ival-atan2: 412.0ms (1.2% of total)

ival-atan: 226.0ms (0.6% of total)

ival-neg: 204.0ms (0.6% of total)

ival-exp: 185.0ms (0.5% of total)

const: 158.0ms (0.4% of total)

ival-tan: 141.0ms (0.4% of total)

ival-pi: 140.0ms (0.4% of total)

ival-log: 105.0ms (0.3% of total)

ival-asin: 73.0ms (0.2% of total)

ival-fabs: 40.0ms (0.1% of total)

explain41.4s (1.9%)

Results

12.9s	8374×	1	valid
6.0s	15236×	0	valid
5.7s	1860×	2	valid
3.2s	564×	3	valid
778.0ms	78×	4	valid

Compiler

Compiled 19842 to 2382 computations (88% saved)

Precisions

Click to see histograms. Total time spent on operations: 17.0s

ival-sin: 2.9s (17.1% of total)

ival-mult: 2.7s (15.6% of total)

ival-cos: 2.4s (14% of total)

ival-pow: 1.9s (11.1% of total)

ival-div: 1.6s (9.4% of total)

backward-pass: 1.5s (8.8% of total)

ival-sub: 978.0ms (5.8% of total)

ival-add: 681.0ms (4% of total)

ival-log: 454.0ms (2.7% of total)

ival-sqrt: 452.0ms (2.7% of total)

ival-atan: 348.0ms (2.1% of total)

ival-exp: 323.0ms (1.9% of total)

ival-neg: 208.0ms (1.2% of total)

ival-acos: 133.0ms (0.8% of total)

ival-tan: 95.0ms (0.6% of total)

const: 94.0ms (0.6% of total)

ival-atan2: 91.0ms (0.5% of total)

ival-pi: 86.0ms (0.5% of total)

ival-fabs: 63.0ms (0.4% of total)

ival-cbrt: 43.0ms (0.3% of total)

ival-asin: 17.0ms (0.1% of total)

preprocess37.4s (1.7%)

Algorithm

51×	egg-herbie

Rules

31500×	`fma-define`
18832×	`fma-neg`
12964×	`div-sub`
11458×	`unsub-neg`
11133×	`sub-neg`

Stop Event

21×	saturated
30×	node limit

Compiler

Compiled 50752 to 19858 computations (60.9% saved)

end0.0ms (0%)

Precisions: Click to see histograms. Total time spent on operations: 6.8s
ival-sub: 6.8s (100% of total)

sample9.5min (26.6%)

simplify7.2min (20%)

soundness3.5min (9.7%)

localize3.4min (9.4%)

prune2.2min (6.2%)

rewrite1.9min (5.4%)

eval1.8min (5.1%)

regimes1.6min (4.4%)

series1.5min (4.3%)

analyze59.0s (2.7%)

bsearch55.8s (2.6%)

explain41.4s (1.9%)

preprocess37.4s (1.7%)

end0.0ms (0%)

Profiling