Metrics for Herbie run

Date:	Friday, March 29th, 2024
Commit:	a282c103 on cleanup
Hostname:	nightly with Racket 8.11.1
Seed:	2024089
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize8.5min (33.2%)

Results

53.9s	33239×	256	valid
42.0s	4598×	1024	valid
11.4s	3175×	256	invalid
4.2min	2865×	8192	exit
16.4s	2810×	512	valid
30.3s	2154×	2048	valid
30.5s	589×	4096	valid
801.0ms	111×	1024	invalid
38.0ms	106×	256	unsamplable
195.0ms	62×	512	invalid
9.9s	29×	8192	valid
12.0ms	2×	2048	invalid

Compiler

Compiled 90432 to 50163 computations (44.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 7.2min

ival-sin: 1.7min (23.9% of total)

ival-cos: 1.6min (22.7% of total)

ival-mult: 1.1min (15.8% of total)

ival-pow: 1.1min (15.8% of total)

ival-div: 31.9s (7.4% of total)

composed: 16.3s (3.8% of total)

ival-add: 8.9s (2.1% of total)

ival-log: 8.5s (2% of total)

ival-exp: 6.7s (1.5% of total)

ival-sub: 5.1s (1.2% of total)

ival-sqrt: 5.1s (1.2% of total)

const: 4.5s (1% of total)

ival-cbrt: 2.1s (0.5% of total)

ival-atan2: 2.0s (0.5% of total)

ival-atan: 1.1s (0.3% of total)

ival-acos: 750.0ms (0.2% of total)

ival-neg: 747.0ms (0.2% of total)

ival-tan: 304.0ms (0.1% of total)

ival-fabs: 153.0ms (0% of total)

ival-pi: 127.0ms (0% of total)

ival-asin: 64.0ms (0% of total)

sample6.2min (24%)

Results

49.6s	289892×	0	valid
1.2min	119187×	1	valid
13.1s	49384×	0	unsamplable
4.2s	27516×	0	invalid
59.8s	25809×	5	exit
27.8s	11133×	2	valid
59.0s	7801×	3	valid
3.1s	3836×	1	invalid
23.5s	1290×	4	valid
81.0ms	914×	0	precondition
1.0s	834×	2	invalid
41.0ms	47×	1	unsamplable
30.0ms	9×	5	valid
3.0ms	2×	2	unsamplable

Precisions

Click to see histograms. Total time spent on operations: 4.6min

ival-sin: 47.5s (17.2% of total)

ival-mult: 37.6s (13.6% of total)

ival-cos: 34.8s (12.6% of total)

ival-pow: 34.7s (12.6% of total)

ival-div: 29.4s (10.7% of total)

backward-pass: 28.2s (10.2% of total)

ival-exp: 18.3s (6.6% of total)

ival-add: 11.8s (4.3% of total)

ival-sub: 9.2s (3.3% of total)

ival-log: 4.3s (1.5% of total)

ival-<: 4.2s (1.5% of total)

ival-sqrt: 4.2s (1.5% of total)

ival-neg: 3.9s (1.4% of total)

const: 3.5s (1.3% of total)

ival-atan2: 721.0ms (0.3% of total)

ival-pi: 718.0ms (0.3% of total)

ival-and: 624.0ms (0.2% of total)

ival-tan: 623.0ms (0.2% of total)

ival-acos: 472.0ms (0.2% of total)

ival-atan: 410.0ms (0.1% of total)

ival-<=: 323.0ms (0.1% of total)

ival-cbrt: 310.0ms (0.1% of total)

ival-asin: 220.0ms (0.1% of total)

ival-fabs: 180.0ms (0.1% of total)

ival-==: 2.0ms (0% of total)

ival-or: 0.0ms (0% of total)

Bogosity

eval2.7min (10.5%)

Compiler: Compiled 7291831 to 4292887 computations (41.1% saved)

explain1.9min (7.4%)

Results

10.7s	19056×	256	valid
14.1s	3230×	1024	valid
5.7s	2142×	512	valid
15.5s	1438×	2048	valid
31.5s	648×	4096	valid
20.3s	110×	8192	valid

Compiler

Compiled 20263 to 11933 computations (41.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.5min

ival-sin: 23.5s (26% of total)

ival-cos: 18.7s (20.6% of total)

ival-mult: 16.4s (18.1% of total)

ival-div: 12.4s (13.7% of total)

ival-pow: 11.5s (12.7% of total)

ival-add: 2.4s (2.7% of total)

ival-sub: 1.8s (1.9% of total)

ival-sqrt: 980.0ms (1.1% of total)

const: 893.0ms (1% of total)

ival-log: 690.0ms (0.8% of total)

ival-exp: 305.0ms (0.3% of total)

ival-atan2: 235.0ms (0.3% of total)

ival-atan: 182.0ms (0.2% of total)

ival-neg: 148.0ms (0.2% of total)

ival-tan: 139.0ms (0.2% of total)

ival-acos: 78.0ms (0.1% of total)

ival-cbrt: 76.0ms (0.1% of total)

ival-pi: 52.0ms (0.1% of total)

ival-asin: 16.0ms (0% of total)

ival-fabs: 14.0ms (0% of total)

simplify1.3min (5%)

Algorithm

237×	egg-herbie

Rules

74704×	`fma-define`
62717×	`associate-r`
57132×	`distribute-lft-in`
54984×	`*-commutative`
52532×	`distribute-rgt-in`

Stop Event

51×	saturated
184×	node limit
2×	unsound

Counts

90655 → 78597

soundness1.1min (4.1%)

Rules

75227×	`fma-define`
54815×	`log1p-expm1-u`
51013×	`associate-r`
47847×	`fma-neg`
45078×	`distribute-lft-in`

Stop Event

16×	saturated
39×	fuel
216×	node limit
3×	unsound
10×	done

Compiler

Compiled 65311 to 37898 computations (42% saved)

regimes59.0s (3.8%)

Counts

19682 → 858

Calls

149 calls:

5.2s	phi2
5.0s	phi1
4.6s	lambda1
4.4s	lambda2
3.0s	(-.f64 lambda1 lambda2)

Compiler

Compiled 11582 to 8530 computations (26.4% saved)

prune57.9s (3.8%)

Counts: 171968 → 6752
Compiler: Compiled 437464 to 303344 computations (30.7% saved)

rewrite38.9s (2.5%)

Algorithm

188×	batch-egg-rewrite

Rules

119066×	`log1p-expm1-u`
88913×	`expm1-log1p-u`
47064×	`pow1`
43467×	`add-exp-log`
41976×	`add-log-exp`

Stop Event

185×	node limit
3×	unsound

Counts

1749 → 50265

analyze31.5s (2%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
14.8%	11.8%	67.6%	20.6%	0%	0%	0%	1
22.6%	17.7%	60.4%	21%	0%	0.9%	0%	2
32.7%	24.7%	50.8%	21.2%	0%	3.3%	0%	3
39.8%	29.8%	45%	21.2%	0%	4%	0%	4
45.4%	33.8%	40.6%	21.2%	0%	4.5%	0%	5
48.4%	35.7%	38%	21.2%	0%	5.1%	0%	6
51.8%	37.8%	35.2%	21.2%	0%	5.7%	0.1%	7
53.5%	38.9%	33.8%	21.3%	0%	6%	0.1%	8
56.4%	40.6%	31.4%	21.3%	0%	6.6%	0.2%	9
57.7%	41.4%	30.3%	21.3%	0%	6.8%	0.2%	10
59.8%	42.7%	28.7%	21.3%	0%	7.1%	0.3%	11
61.3%	43.5%	27.5%	21.3%	0%	7.5%	0.3%	12

Compiler

Compiled 1919 to 1338 computations (30.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 21.6s

ival-mult: 7.0s (32.4% of total)

ival-div: 3.0s (13.9% of total)

ival-pow: 3.0s (13.8% of total)

ival-sin: 2.4s (10.9% of total)

ival-cos: 2.3s (10.8% of total)

ival-add: 969.0ms (4.5% of total)

ival-sub: 783.0ms (3.6% of total)

ival-sqrt: 624.0ms (2.9% of total)

const: 323.0ms (1.5% of total)

ival-<: 269.0ms (1.2% of total)

ival-neg: 264.0ms (1.2% of total)

ival-atan2: 160.0ms (0.7% of total)

ival-exp: 76.0ms (0.4% of total)

ival-pi: 69.0ms (0.3% of total)

ival-fabs: 63.0ms (0.3% of total)

ival-tan: 58.0ms (0.3% of total)

ival-log: 57.0ms (0.3% of total)

ival-atan: 54.0ms (0.3% of total)

ival-and: 52.0ms (0.2% of total)

ival-acos: 46.0ms (0.2% of total)

ival-asin: 35.0ms (0.2% of total)

ival-cbrt: 23.0ms (0.1% of total)

ival-<=: 3.0ms (0% of total)

ival-or: 0.0ms (0% of total)

ival-==: 0.0ms (0% of total)

bsearch19.7s (1.3%)

Algorithm

329×	binary-search
53×	left-value

Stop Event

6×	predicate-same
323×	narrow-enough

Results

5.2s	29602×	0	valid
7.0s	8974×	1	valid
192.0ms	1741×	0	invalid
1.0s	1480×	2	valid
1.1s	792×	3	valid
1.3s	492×	5	exit

Compiler

Compiled 109707 to 82652 computations (24.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 13.0s

ival-sin: 2.3s (17.4% of total)

ival-mult: 1.8s (13.7% of total)

backward-pass: 1.5s (11.8% of total)

ival-cos: 1.3s (10.3% of total)

ival-div: 1.2s (9.5% of total)

ival-pow: 1.0s (7.7% of total)

ival-sub: 855.0ms (6.6% of total)

ival-add: 576.0ms (4.4% of total)

ival-neg: 528.0ms (4.1% of total)

ival-atan: 496.0ms (3.8% of total)

ival-exp: 409.0ms (3.1% of total)

ival-sqrt: 383.0ms (2.9% of total)

ival-atan2: 173.0ms (1.3% of total)

const: 166.0ms (1.3% of total)

ival-acos: 80.0ms (0.6% of total)

ival-pi: 75.0ms (0.6% of total)

ival-log: 56.0ms (0.4% of total)

ival-asin: 44.0ms (0.3% of total)

ival-cbrt: 7.0ms (0.1% of total)

preprocess19.0s (1.2%)

Algorithm

52×	egg-herbie

Rules

32328×	`fma-define`
19274×	`fma-neg`
13234×	`div-sub`
11584×	`unsub-neg`
11427×	`sub-neg`

Stop Event

22×	saturated
30×	node limit

Compiler

Compiled 57690 to 35342 computations (38.7% saved)

series16.9s (1.1%)

Counts

1749 → 40390

Calls

9852 calls:

Time	Variable		Point	Expression
343.0ms	x	@	0	(- (log 2) (log x))
155.0ms	C	@	0	(log (* B (sqrt (* 2 (* F (* -1/2 (/ (pow B 2) C)))))))
134.0ms	b	@	-inf	(* (pow (* a b) 5) (* a b))
130.0ms	angle	@	0	(/ (+ (pow (* a (cos (/ (* angle (PI)) 180))) 2) (pow (* b (sin (/ (* angle (PI)) 180))) 2)) (pow y-scale 2))
116.0ms	t	@	inf	(/ (/ (* (pow (/ 1 (+ 1 (exp (neg s)))) c_p) (pow (+ 1 (/ 1 (- -1 (exp (neg s))))) c_n)) (pow (+ 1 (/ 1 (- -1 (exp (neg t))))) c_n)) (pow (/ 1 (+ 1 (exp (neg t)))) c_p))

end0.0ms (0%)

Precisions: Click to see histograms. Total time spent on operations: 6.4s
ival-pow: 4.2s (65.8% of total)
ival-cos: 2.2s (34.2% of total)

localize8.5min (33.2%)

sample6.2min (24%)

eval2.7min (10.5%)

explain1.9min (7.4%)

simplify1.3min (5%)

soundness1.1min (4.1%)

regimes59.0s (3.8%)

prune57.9s (3.8%)

rewrite38.9s (2.5%)

analyze31.5s (2%)

bsearch19.7s (1.3%)

preprocess19.0s (1.2%)

series16.9s (1.1%)

end0.0ms (0%)

Profiling