Metrics for Herbie run

Date:	Wednesday, May 29th, 2024
Commit:	36a413b6 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024150
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample5.5min (31.3%)

Results

1.9min	26035×	5	exit
1.2min	130009×	1	valid
42.1s	270568×	0	valid
22.9s	8196×	3	valid
16.4s	19133×	2	valid
13.6s	49583×	0	unsamplable
8.3s	1404×	4	valid
3.7s	18912×	0	invalid
2.7s	11072×	1	invalid
1.0s	1649×	2	invalid
122.0ms	2×	5	valid
110.0ms	909×	0	precondition
54.0ms	74×	1	unsamplable
11.0ms	18×	3	invalid

Precisions

Click to see histograms. Total time spent on operations: 4.3min

ival-pow: 1.8min (41.9% of total)

ival-mult: 25.4s (9.8% of total)

ival-sin: 23.1s (8.9% of total)

ival-cos: 20.6s (8% of total)

ival-div: 16.9s (6.5% of total)

backward-pass: 16.5s (6.4% of total)

ival-add: 8.5s (3.3% of total)

ival-sub: 8.0s (3.1% of total)

ival-log: 6.0s (2.3% of total)

ival-exp: 5.4s (2.1% of total)

ival-sqrt: 5.2s (2% of total)

ival-neg: 3.9s (1.5% of total)

ival-<: 2.9s (1.1% of total)

...c/correct-round.rkt:121:19: 2.2s (0.8% of total)

const: 1.0s (0.4% of total)

ival-pi: 960.0ms (0.4% of total)

ival-atan2: 741.0ms (0.3% of total)

ival-tan: 678.0ms (0.3% of total)

ival-atan: 448.0ms (0.2% of total)

ival-and: 434.0ms (0.2% of total)

ival-acos: 348.0ms (0.1% of total)

ival-cbrt: 304.0ms (0.1% of total)

ival-<=: 272.0ms (0.1% of total)

ival-asin: 268.0ms (0.1% of total)

ival-fabs: 186.0ms (0.1% of total)

ival-==: 2.0ms (0% of total)

ival-or: 0.0ms (0% of total)

Bogosity

simplify2.9min (16.4%)

Algorithm

448×	egg-herbie

Rules

174057×	`fma-define`
116855×	`fmm-def`
107075×	`distribute-lft-in`
92253×	`distribute-rgt-in`
90933×	`times-frac`

Stop Event

123×	saturated
324×	node limit
1×	unsound

Counts

147785 → 123098

soundness1.9min (10.5%)

Rules

86375×	`fma-define`
70620×	`log1p-expm1-u`
53464×	`expm1-log1p-u`
52692×	`distribute-lft-in`
48076×	`fmm-def`

Stop Event

15×	saturated
265×	node limit
46×	fuel
3×	unsound
6×	done

Compiler

Compiled 64892 to 19281 computations (70.3% saved)

localize1.8min (10.4%)

Results

31.4s	2715×	5	exit
29.9s	15531×	1	valid
12.0s	24650×	0	valid
8.8s	3154×	2	valid
3.1s	560×	3	valid
2.9s	3707×	0	invalid
741.0ms	83×	4	valid
427.0ms	159×	1	invalid
82.0ms	10×	5	valid
38.0ms	119×	0	unsamplable

Compiler

Compiled 106204 to 8033 computations (92.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.0min

ival-mult: 10.2s (16.7% of total)

ival-sin: 8.9s (14.5% of total)

ival-cos: 7.9s (12.9% of total)

ival-pow: 7.5s (12.2% of total)

backward-pass: 6.0s (9.9% of total)

ival-div: 4.7s (7.7% of total)

ival-log: 2.8s (4.6% of total)

ival-add: 2.5s (4.1% of total)

ival-exp: 2.3s (3.7% of total)

ival-sqrt: 2.0s (3.2% of total)

...c/correct-round.rkt:121:19: 1.8s (3% of total)

ival-sub: 1.6s (2.6% of total)

ival-cbrt: 789.0ms (1.3% of total)

ival-atan2: 672.0ms (1.1% of total)

ival-neg: 425.0ms (0.7% of total)

ival-atan: 282.0ms (0.5% of total)

const: 216.0ms (0.4% of total)

ival-tan: 175.0ms (0.3% of total)

ival-acos: 173.0ms (0.3% of total)

ival-pi: 96.0ms (0.2% of total)

ival-fabs: 96.0ms (0.2% of total)

ival-asin: 31.0ms (0.1% of total)

ival-e: 8.0ms (0% of total)

regimes58.3s (5.5%)

Counts

25212 → 911

Calls

155 calls:

3.9s	phi2
3.3s	phi1
3.2s	lambda1
2.7s	(-.f64 lambda1 lambda2)
2.6s	a

Compiler

Compiled 13508 to 8835 computations (34.6% saved)

rewrite56.1s (5.3%)

Algorithm

198×	batch-egg-rewrite

Rules

121271×	`log1p-expm1-u`
90277×	`expm1-log1p-u`
54799×	`pow1`
51777×	`add-exp-log`
47712×	`add-log-exp`

Stop Event

195×	node limit
3×	unsound

Counts

3013 → 79029

prune55.8s (5.3%)

Counts: 194231 → 8631
Compiler: Compiled 614095 to 298262 computations (51.4% saved)

eval41.5s (3.9%)

Compiler: Compiled 9279631 to 874415 computations (90.6% saved)

series37.7s (3.6%)

Counts

3013 → 68756

Calls

17685 calls:

Time	Variable		Point	Expression
416.0ms	t	@	inf	(log (+ 1 (cos (atan (* eh (/ (tan t) ew))))))
368.0ms	lambda2	@	inf	(+ (* (cos phi1) (* (cos phi2) (cos (- lambda1 lambda2)))) (* (sin phi1) (sin phi2)))
328.0ms	y-scale	@	0	(sqrt (+ (pow (- (/ (/ (+ (pow (* a (sin (* (/ angle 180) (PI)))) 2) (pow (* b (cos (* (/ angle 180) (PI)))) 2)) x-scale) x-scale) (/ (/ (+ (pow (* a (cos (* (/ angle 180) (PI)))) 2) (pow (* b (sin (* (/ angle 180) (PI)))) 2)) y-scale) y-scale)) 2) (pow (/ (/ (* (* (* 2 (- (pow b 2) (pow a 2))) (sin (* (/ angle 180) (PI)))) (cos (* (/ angle 180) (PI)))) x-scale) y-scale) 2)))
299.0ms	b	@	0	(* -1/2 (/ c b))
298.0ms	phi2	@	-inf	(log (* (atan2 (sqrt (+ (* (sin (* (- phi1 phi2) 1/2)) (sin (* (- phi1 phi2) 1/2))) (* (* (sqrt (* (cos phi1) (cos phi2))) (sin (* -1/2 lambda2))) (* (sqrt (* (cos phi1) (cos phi2))) (sin (* -1/2 lambda2)))))) (sqrt (- 1 (+ (* (pow (sin (* (- lambda1 lambda2) 1/2)) 2) (* (cos phi1) (cos phi2))) (pow (sin (* (- phi1 phi2) 1/2)) 2))))) (* 2 R)))

analyze25.7s (2.4%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
14.8%	11.8%	67.6%	20.6%	0%	0%	0%	1
22.6%	17.7%	60.4%	21%	0%	0.9%	0%	2
32.7%	24.7%	50.8%	21.2%	0%	3.3%	0%	3
39.8%	29.8%	45%	21.2%	0%	4%	0%	4
45.4%	33.8%	40.6%	21.2%	0%	4.5%	0%	5
48.4%	35.7%	38%	21.2%	0%	5.1%	0%	6
51.8%	37.8%	35.2%	21.2%	0%	5.7%	0.1%	7
53.5%	38.9%	33.8%	21.3%	0%	6%	0.1%	8
56.4%	40.6%	31.4%	21.3%	0%	6.6%	0.2%	9
57.7%	41.4%	30.3%	21.3%	0%	6.8%	0.2%	10
59.8%	42.7%	28.7%	21.3%	0%	7.1%	0.3%	11
61.3%	43.5%	27.5%	21.3%	0%	7.5%	0.3%	12

Compiler

Compiled 1919 to 947 computations (50.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 17.4s

ival-mult: 5.1s (29.3% of total)

ival-pow: 2.8s (15.9% of total)

ival-cos: 2.1s (12.2% of total)

ival-sin: 1.4s (8.3% of total)

ival-sub: 1.3s (7.3% of total)

ival-div: 1.1s (6.5% of total)

ival-add: 988.0ms (5.7% of total)

ival-sqrt: 617.0ms (3.5% of total)

ival-neg: 502.0ms (2.9% of total)

ival-<: 323.0ms (1.9% of total)

...c/correct-round.rkt:121:19: 279.0ms (1.6% of total)

ival-atan2: 180.0ms (1% of total)

ival-exp: 95.0ms (0.5% of total)

const: 92.0ms (0.5% of total)

ival-atan: 88.0ms (0.5% of total)

ival-pi: 71.0ms (0.4% of total)

ival-and: 55.0ms (0.3% of total)

ival-tan: 53.0ms (0.3% of total)

ival-asin: 49.0ms (0.3% of total)

ival-log: 48.0ms (0.3% of total)

ival-acos: 38.0ms (0.2% of total)

ival-fabs: 31.0ms (0.2% of total)

backward-pass: 24.0ms (0.1% of total)

ival-cbrt: 21.0ms (0.1% of total)

ival-<=: 3.0ms (0% of total)

ival-==: 1.0ms (0% of total)

ival-or: 0.0ms (0% of total)

bsearch21.1s (2%)

Algorithm

318×	binary-search
85×	left-value

Stop Event

6×	predicate-same
312×	narrow-enough

Results

7.0s	10090×	1	valid
5.4s	26283×	0	valid
1.5s	1797×	2	valid
1.5s	1049×	3	valid
1.1s	966×	5	exit
291.0ms	1054×	0	invalid
59.0ms	13×	4	valid
1.0ms	22×	0	unsamplable

Compiler

Compiled 94250 to 64591 computations (31.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 13.8s

ival-cos: 2.8s (20.1% of total)

ival-sin: 2.3s (16.8% of total)

ival-mult: 2.1s (14.9% of total)

ival-pow: 1.6s (11.5% of total)

backward-pass: 1.2s (8.5% of total)

ival-div: 886.0ms (6.4% of total)

ival-sub: 653.0ms (4.7% of total)

ival-add: 619.0ms (4.5% of total)

ival-sqrt: 556.0ms (4% of total)

ival-log: 254.0ms (1.8% of total)

ival-atan2: 171.0ms (1.2% of total)

ival-acos: 154.0ms (1.1% of total)

ival-atan: 116.0ms (0.8% of total)

ival-tan: 105.0ms (0.8% of total)

ival-exp: 101.0ms (0.7% of total)

ival-neg: 99.0ms (0.7% of total)

const: 71.0ms (0.5% of total)

ival-pi: 45.0ms (0.3% of total)

ival-fabs: 40.0ms (0.3% of total)

ival-asin: 25.0ms (0.2% of total)

explain20.9s (2%)

Results

6.0s	8396×	1	valid
2.7s	15702×	0	valid
2.7s	636×	3	valid
2.7s	1802×	2	valid
955.0ms	88×	4	valid

Compiler

Compiled 20263 to 2450 computations (87.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 10.9s

ival-sin: 2.4s (22% of total)

ival-mult: 1.7s (15.9% of total)

ival-cos: 1.5s (14% of total)

backward-pass: 1.3s (11.7% of total)

ival-div: 1.1s (9.9% of total)

ival-pow: 746.0ms (6.8% of total)

ival-sub: 461.0ms (4.2% of total)

ival-log: 385.0ms (3.5% of total)

ival-add: 351.0ms (3.2% of total)

ival-sqrt: 268.0ms (2.5% of total)

ival-exp: 229.0ms (2.1% of total)

ival-neg: 146.0ms (1.3% of total)

ival-atan2: 82.0ms (0.8% of total)

const: 56.0ms (0.5% of total)

ival-tan: 48.0ms (0.4% of total)

ival-pi: 41.0ms (0.4% of total)

ival-atan: 31.0ms (0.3% of total)

ival-acos: 21.0ms (0.2% of total)

ival-cbrt: 20.0ms (0.2% of total)

ival-fabs: 13.0ms (0.1% of total)

ival-asin: 8.0ms (0.1% of total)

preprocess15.2s (1.4%)

Algorithm

52×	egg-herbie

Rules

32339×	`fma-define`
19274×	`fmm-def`
13261×	`div-sub`
11418×	`sub-neg`
10337×	`distribute-lft-in`

Stop Event

22×	saturated
30×	node limit

Compiler

Compiled 56834 to 21268 computations (62.6% saved)

Herbie run

sample5.5min (31.3%)

simplify2.9min (16.4%)

soundness1.9min (10.5%)

localize1.8min (10.4%)

regimes58.3s (5.5%)

rewrite56.1s (5.3%)

prune55.8s (5.3%)

eval41.5s (3.9%)

series37.7s (3.6%)

analyze25.7s (2.4%)

bsearch21.1s (2%)

explain20.9s (2%)

preprocess15.2s (1.4%)

end0.0ms (0%)

Profiling