Metrics for Herbie run

Date:	Wednesday, May 8th, 2024
Commit:	66dd3019 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024129
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample6.0min (34.2%)

Results

2.0min	26057×	5	exit
1.2min	130073×	1	valid
44.9s	270462×	0	valid
27.1s	7973×	3	valid
19.9s	19422×	2	valid
13.7s	49575×	0	unsamplable
8.5s	1378×	4	valid
3.7s	19319×	0	invalid
3.1s	11460×	1	invalid
1.6s	1764×	2	invalid
172.0ms	933×	0	precondition
126.0ms	20×	3	invalid
83.0ms	4×	5	valid
38.0ms	51×	1	unsamplable

Precisions

Click to see histograms. Total time spent on operations: 4.7min

ival-pow: 2.0min (42.3% of total)

ival-mult: 30.2s (10.7% of total)

ival-sin: 25.2s (8.9% of total)

ival-cos: 22.9s (8.1% of total)

ival-div: 19.5s (6.9% of total)

backward-pass: 10.8s (3.8% of total)

ival-sub: 10.0s (3.5% of total)

ival-add: 10.0s (3.5% of total)

ival-exp: 7.2s (2.5% of total)

ival-log: 7.0s (2.5% of total)

ival-sqrt: 5.9s (2.1% of total)

ival-neg: 3.9s (1.4% of total)

ival-<: 2.7s (1% of total)

...c/correct-round.rkt:119:19: 2.2s (0.8% of total)

ival-pi: 1.2s (0.4% of total)

const: 1.0s (0.4% of total)

ival-atan2: 796.0ms (0.3% of total)

ival-tan: 710.0ms (0.3% of total)

ival-and: 477.0ms (0.2% of total)

ival-atan: 446.0ms (0.2% of total)

ival-acos: 413.0ms (0.1% of total)

ival-cbrt: 352.0ms (0.1% of total)

ival-<=: 238.0ms (0.1% of total)

ival-asin: 191.0ms (0.1% of total)

ival-fabs: 156.0ms (0.1% of total)

ival-==: 2.0ms (0% of total)

ival-or: 0.0ms (0% of total)

Bogosity

simplify2.8min (15.8%)

Algorithm

444×	egg-herbie

Rules

182309×	`fma-define`
118418×	`fma-neg`
102391×	`distribute-lft-in`
93741×	`times-frac`
89477×	`distribute-rgt-in`

Stop Event

126×	saturated
317×	node limit
1×	unsound

Counts

144419 → 120929

soundness1.8min (10.1%)

Rules

81710×	`fma-define`
65812×	`log1p-expm1-u`
50167×	`expm1-log1p-u`
47564×	`distribute-lft-in`
45420×	`fma-neg`

Stop Event

15×	saturated
43×	fuel
241×	node limit
3×	unsound
8×	done

Compiler

Compiled 62536 to 18829 computations (69.9% saved)

localize1.7min (9.4%)

Results

24.4s	2090×	5	exit
22.4s	13144×	1	valid
13.0s	26850×	0	valid
8.6s	2774×	2	valid
4.5s	490×	3	valid
3.3s	4625×	0	invalid
1.0s	59×	4	valid
717.0ms	388×	1	invalid
8.0ms	11×	0	unsamplable
6.0ms	1×	2	invalid

Compiler

Compiled 92331 to 7375 computations (92% saved)

Precisions

Click to see histograms. Total time spent on operations: 54.9s

ival-sin: 9.6s (17.6% of total)

ival-mult: 8.9s (16.3% of total)

ival-pow: 7.7s (14.1% of total)

ival-cos: 7.1s (13% of total)

backward-pass: 4.5s (8.2% of total)

ival-div: 4.2s (7.6% of total)

ival-add: 2.2s (4.1% of total)

ival-sqrt: 1.3s (2.4% of total)

ival-sub: 1.2s (2.2% of total)

...c/correct-round.rkt:119:19: 1.2s (2.2% of total)

ival-exp: 1.1s (2.1% of total)

ival-log: 959.0ms (1.7% of total)

ival-fma: 830.0ms (1.5% of total)

ival-hypot: 614.0ms (1.1% of total)

ival-log1p: 585.0ms (1.1% of total)

ival-cbrt: 509.0ms (0.9% of total)

ival-neg: 467.0ms (0.9% of total)

ival-atan2: 348.0ms (0.6% of total)

ival-tan: 310.0ms (0.6% of total)

const: 216.0ms (0.4% of total)

ival-expm1: 204.0ms (0.4% of total)

ival-atan: 199.0ms (0.4% of total)

ival-acos: 130.0ms (0.2% of total)

ival-pi: 122.0ms (0.2% of total)

ival-fabs: 84.0ms (0.2% of total)

ival-e: 58.0ms (0.1% of total)

ival-asin: 12.0ms (0% of total)

regimes59.8s (5.7%)

Counts

23015 → 816

Calls

143 calls:

4.4s	phi1
3.8s	lambda1
3.8s	phi2
3.2s	lambda2
2.9s	(-.f64 lambda1 lambda2)

Compiler

Compiled 13160 to 8465 computations (35.7% saved)

rewrite53.1s (5.1%)

Algorithm

196×	batch-egg-rewrite

Rules

120814×	`log1p-expm1-u`
89731×	`expm1-log1p-u`
53315×	`pow1`
49863×	`add-exp-log`
46860×	`add-log-exp`

Stop Event

192×	node limit
4×	unsound

Counts

2953 → 77057

prune50.8s (4.8%)

Counts: 189733 → 7729
Compiler: Compiled 553701 to 263505 computations (52.4% saved)

eval40.9s (3.9%)

Compiler: Compiled 9234179 to 849573 computations (90.8% saved)

series38.9s (3.7%)

Counts

2953 → 68055

Calls

17469 calls:

Time	Variable		Point	Expression
419.0ms	b	@	-inf	(* (/ (- (- (/ (+ (pow (* a (cos (* angle (/ (PI) 180)))) 2) (pow (* b (sin (* angle (/ (PI) 180)))) 2)) (pow y-scale 2)) (/ (+ (pow (* a (sin (* angle (/ (PI) 180)))) 2) (pow (* (cos (* angle (/ (PI) 180))) b) 2)) (pow x-scale 2))) (sqrt (+ (* (- (/ (+ (pow (* a (sin (* angle (/ (PI) 180)))) 2) (pow (* (cos (* angle (/ (PI) 180))) b) 2)) (pow x-scale 2)) (/ (+ (pow (* a (cos (* angle (/ (PI) 180)))) 2) (pow (* b (sin (* angle (/ (PI) 180)))) 2)) (pow y-scale 2))) (- (/ (+ (pow (* a (sin (* angle (/ (PI) 180)))) 2) (pow (* (cos (* angle (/ (PI) 180))) b) 2)) (pow x-scale 2)) (/ (+ (pow (* a (cos (* angle (/ (PI) 180)))) 2) (pow (* b (sin (* angle (/ (PI) 180)))) 2)) (pow y-scale 2)))) (* (/ (* 2 (* (* (sin (* angle (/ (PI) 180))) (- (pow b 2) (pow a 2))) (cos (* angle (/ (PI) 180))))) (* y-scale x-scale)) (/ (* 2 (* (* (sin (* angle (/ (PI) 180))) (- (pow b 2) (pow a 2))) (cos (* angle (/ (PI) 180))))) (* y-scale x-scale)))))) (sin (* angle (/ (PI) 180)))) (/ y-scale (* (* 2 (- (pow b 2) (pow a 2))) (/ (cos (* angle (/ (PI) 180))) x-scale))))
394.0ms	b	@	0	(* c (+ (* -1 (/ a (pow b 3))) (* c (+ (* -2 (/ (pow a 2) (pow b 5))) (* -1/4 (* c (/ (* (/ (pow a 4) (pow b 6)) 20) (* b a))))))))
344.0ms	x-scale	@	0	(* -4 (exp (- (* (log (* a b)) 2) (* (log (* x-scale y-scale)) 2))))
309.0ms	A	@	0	(neg (* (sqrt (+ A (- C (sqrt (+ (* B B) (* (- A C) (- A C))))))) (sqrt (* 2 (* (+ (* -4 (* A C)) (pow B 2)) F)))))
306.0ms	x-scale	@	0	(* (/ (- (- (/ (+ (pow (* a (cos (* angle (/ (PI) 180)))) 2) (pow (* b (sin (* angle (/ (PI) 180)))) 2)) (pow y-scale 2)) (/ (+ (pow (* a (sin (* angle (/ (PI) 180)))) 2) (pow (* (cos (* angle (/ (PI) 180))) b) 2)) (pow x-scale 2))) (sqrt (+ (* (- (/ (+ (pow (* a (sin (* angle (/ (PI) 180)))) 2) (pow (* (cos (* angle (/ (PI) 180))) b) 2)) (pow x-scale 2)) (/ (+ (pow (* a (cos (* angle (/ (PI) 180)))) 2) (pow (* b (sin (* angle (/ (PI) 180)))) 2)) (pow y-scale 2))) (- (/ (+ (pow (* a (sin (* angle (/ (PI) 180)))) 2) (pow (* (cos (* angle (/ (PI) 180))) b) 2)) (pow x-scale 2)) (/ (+ (pow (* a (cos (* angle (/ (PI) 180)))) 2) (pow (* b (sin (* angle (/ (PI) 180)))) 2)) (pow y-scale 2)))) (* (/ (* 2 (* (* (sin (* angle (/ (PI) 180))) (- (pow b 2) (pow a 2))) (cos (* angle (/ (PI) 180))))) (* y-scale x-scale)) (/ (* 2 (* (* (sin (* angle (/ (PI) 180))) (- (pow b 2) (pow a 2))) (cos (* angle (/ (PI) 180))))) (* y-scale x-scale)))))) (sin (* angle (/ (PI) 180)))) (/ y-scale (* (* 2 (- (pow b 2) (pow a 2))) (/ (cos (* angle (/ (PI) 180))) x-scale))))

analyze24.8s (2.4%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
14.8%	11.8%	67.6%	20.6%	0%	0%	0%	1
22.6%	17.7%	60.4%	21%	0%	0.9%	0%	2
32.7%	24.7%	50.8%	21.2%	0%	3.3%	0%	3
39.8%	29.8%	45%	21.2%	0%	4%	0%	4
45.4%	33.8%	40.6%	21.2%	0%	4.5%	0%	5
48.4%	35.7%	38%	21.2%	0%	5.1%	0%	6
51.8%	37.8%	35.2%	21.2%	0%	5.7%	0.1%	7
53.5%	38.9%	33.8%	21.3%	0%	6%	0.1%	8
56.4%	40.6%	31.4%	21.3%	0%	6.6%	0.2%	9
57.7%	41.4%	30.3%	21.3%	0%	6.8%	0.2%	10
59.8%	42.7%	28.7%	21.3%	0%	7.1%	0.3%	11
61.3%	43.5%	27.5%	21.3%	0%	7.5%	0.3%	12

Compiler

Compiled 1919 to 947 computations (50.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 15.7s

ival-mult: 5.2s (33.2% of total)

ival-pow: 2.2s (13.7% of total)

ival-sin: 1.5s (9.7% of total)

ival-div: 1.3s (8.6% of total)

ival-cos: 1.3s (8.6% of total)

ival-add: 997.0ms (6.3% of total)

ival-sub: 797.0ms (5.1% of total)

ival-sqrt: 561.0ms (3.6% of total)

...c/correct-round.rkt:119:19: 333.0ms (2.1% of total)

ival-neg: 298.0ms (1.9% of total)

ival-<: 276.0ms (1.8% of total)

ival-exp: 158.0ms (1% of total)

ival-atan2: 133.0ms (0.8% of total)

const: 92.0ms (0.6% of total)

ival-pi: 68.0ms (0.4% of total)

ival-atan: 64.0ms (0.4% of total)

ival-tan: 53.0ms (0.3% of total)

ival-and: 53.0ms (0.3% of total)

ival-log: 49.0ms (0.3% of total)

ival-fabs: 45.0ms (0.3% of total)

ival-acos: 37.0ms (0.2% of total)

ival-asin: 37.0ms (0.2% of total)

backward-pass: 31.0ms (0.2% of total)

ival-cbrt: 20.0ms (0.1% of total)

ival-<=: 19.0ms (0.1% of total)

ival-==: 1.0ms (0% of total)

ival-or: 0.0ms (0% of total)

explain20.4s (1.9%)

Results

5.9s	8450×	1	valid
3.6s	1978×	2	valid
3.3s	15548×	0	valid
1.8s	552×	3	valid
673.0ms	96×	4	valid

Compiler

Compiled 20263 to 2450 computations (87.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 10.9s

ival-sin: 2.4s (22.4% of total)

ival-mult: 1.9s (17.6% of total)

ival-cos: 1.6s (14.9% of total)

ival-pow: 770.0ms (7.1% of total)

ival-div: 747.0ms (6.9% of total)

ival-sub: 743.0ms (6.8% of total)

backward-pass: 625.0ms (5.7% of total)

ival-add: 387.0ms (3.6% of total)

ival-sqrt: 343.0ms (3.1% of total)

ival-log: 335.0ms (3.1% of total)

ival-exp: 318.0ms (2.9% of total)

ival-tan: 273.0ms (2.5% of total)

ival-neg: 122.0ms (1.1% of total)

const: 60.0ms (0.6% of total)

ival-atan2: 57.0ms (0.5% of total)

ival-pi: 40.0ms (0.4% of total)

ival-atan: 30.0ms (0.3% of total)

ival-cbrt: 24.0ms (0.2% of total)

ival-acos: 23.0ms (0.2% of total)

ival-fabs: 13.0ms (0.1% of total)

ival-asin: 9.0ms (0.1% of total)

bsearch17.3s (1.6%)

Algorithm

279×	binary-search
54×	left-value

Stop Event

4×	predicate-same
275×	narrow-enough

Results

8.3s	11494×	1	valid
3.5s	20913×	0	valid
1.2s	559×	3	valid
1.0s	1362×	2	valid
140.0ms	774×	0	invalid
38.0ms	8×	4	valid
2.0ms	43×	0	unsamplable

Compiler

Compiled 86696 to 59620 computations (31.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 11.6s

ival-cos: 2.8s (24.1% of total)

ival-sin: 2.7s (23.6% of total)

ival-mult: 1.6s (13.8% of total)

ival-sub: 745.0ms (6.4% of total)

ival-pow: 741.0ms (6.4% of total)

ival-div: 614.0ms (5.3% of total)

backward-pass: 555.0ms (4.8% of total)

ival-add: 449.0ms (3.9% of total)

ival-sqrt: 411.0ms (3.5% of total)

ival-atan2: 272.0ms (2.3% of total)

ival-log: 209.0ms (1.8% of total)

ival-acos: 108.0ms (0.9% of total)

ival-atan: 86.0ms (0.7% of total)

ival-exp: 77.0ms (0.7% of total)

ival-pi: 60.0ms (0.5% of total)

const: 57.0ms (0.5% of total)

ival-neg: 53.0ms (0.5% of total)

ival-tan: 30.0ms (0.3% of total)

ival-asin: 12.0ms (0.1% of total)

ival-fabs: 7.0ms (0.1% of total)

preprocess14.6s (1.4%)

Algorithm

52×	egg-herbie

Rules

32328×	`fma-define`
19274×	`fma-neg`
13234×	`div-sub`
11584×	`unsub-neg`
11427×	`sub-neg`

Stop Event

22×	saturated
30×	node limit

Compiler

Compiled 50204 to 20612 computations (58.9% saved)

Herbie run

sample6.0min (34.2%)

simplify2.8min (15.8%)

soundness1.8min (10.1%)

localize1.7min (9.4%)

regimes59.8s (5.7%)

rewrite53.1s (5.1%)

prune50.8s (4.8%)

eval40.9s (3.9%)

series38.9s (3.7%)

analyze24.8s (2.4%)

explain20.4s (1.9%)

bsearch17.3s (1.6%)

preprocess14.6s (1.4%)

end1.0ms (0%)

Profiling