Metrics for Herbie run

Date:	Monday, August 28th, 2023
Commit:	5f639494 on main
Hostname:	nightly with Racket 8.6
Seed:	2023240
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample7.5min (32.6%)

Results

2.6min	16828×	body	8192	exit
1.2min	64713×	body	1024	valid
56.7s	8261×	body	4096	valid
52.1s	269467×	body	256	valid
32.1s	13269×	body	2048	valid
28.2s	1571×	body	8192	valid
17.1s	32491×	body	512	valid
7.2s	4171×	body	1024	infinite
5.7s	27636×	body	256	unsamplable
5.4s	27268×	body	256	infinite
3.7s	560×	body	4096	infinite
3.5s	20894×	body	256	invalid
3.2s	832×	body	2048	infinite
2.0s	2096×	body	512	infinite
1.9s	5436×	body	2048	invalid
1.4s	3960×	body	1024	invalid
620.0ms	2119×	body	512	invalid
283.0ms	20×	body	8192	infinite
76.0ms	866×	body	256	precondition
4.0ms	3×	body	1024	unsamplable
4.0ms	6×	body	512	unsamplable
3.0ms	11×	body	4096	invalid
2.0ms	1×	body	2048	unsamplable

Bogosity

localize7.4min (32.3%)

Results

Compiler

Compiled 89995 to 42880 computations (52.4% saved)

eval2.0min (8.6%)

Compiler: Compiled 6764414 to 3608853 computations (46.6% saved)

soundness1.4min (6.2%)

Rules

331530×	`fma-def`
200952×	`associate-r`
183004×	`log-prod`
159540×	`associate-l`
156190×	`fma-neg`

Stop Event

4×	unsound
13×	saturated
446×	node limit

Compiler

Compiled 52475 to 29531 computations (43.7% saved)

regimes1.3min (5.7%)

Counts

17652 → 893

Calls

137 calls:

6.8s	phi1
6.0s	phi2
5.2s	lambda1
4.3s	lambda2
3.4s	b

Compiler

Compiled 401828 to 189347 computations (52.9% saved)

simplify52.1s (3.8%)

Algorithm

283×	egg-herbie

Rules

212502×	`fma-def`
126294×	`associate-r`
101276×	`associate-l`
97872×	`times-frac`
93766×	`fma-neg`

Stop Event

65×	saturated
5×	done
43×	fuel
218×	node limit

Counts

81731 → 65837

Compiler

Compiled 16741 to 10747 computations (35.8% saved)

prune47.2s (3.4%)

Counts: 140911 → 6590
Compiler: Compiled 678406 to 450434 computations (33.6% saved)

analyze34.9s (2.5%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
19.6%	15.5%	63.8%	20.6%	0%	0%	0%	1
27.1%	21.4%	57.6%	21%	0%	0%	0%	2
36.8%	28.5%	48.9%	21.2%	0%	1.4%	0%	3
42.3%	32.2%	43.9%	21.2%	0%	2.8%	0%	4
47.2%	35.4%	39.6%	21.2%	0%	3.8%	0%	5
50.2%	37.2%	36.9%	21.2%	0%	4.6%	0%	6
53.6%	39.3%	34%	21.2%	0%	5.4%	0.1%	7
55.3%	40.3%	32.5%	21.3%	0%	5.8%	0.1%	8
58.3%	42%	30.1%	21.3%	0%	6.4%	0.2%	9
59.6%	42.8%	29%	21.3%	0%	6.7%	0.2%	10
61.9%	44.2%	27.2%	21.3%	0%	7.1%	0.3%	11
63.3%	45%	26%	21.3%	0%	7.4%	0.3%	12

Compiler

Compiled 1919 to 1338 computations (30.3% saved)

rewrite21.5s (1.6%)

Algorithm

184×	batch-egg-rewrite

Rules

129152×	`pow1`
122352×	`add-exp-log`
122260×	`log1p-expm1-u`
122220×	`expm1-log1p-u`
117210×	`add-log-exp`

Stop Event

3×	unsound
181×	node limit

Counts

1746 → 43215

bsearch21.4s (1.6%)

Algorithm

333×	binary-search
82×	left-value

Stop Event

327×	narrow-enough
6×	predicate-same

Results

8.8s	7621×	body	1024	valid
5.3s	26294×	body	256	valid
2.2s	1875×	body	2048	valid
1.8s	2659×	body	512	valid
1.0s	621×	body	4096	valid
472.0ms	105×	body	1024	infinite
341.0ms	2023×	body	256	invalid
227.0ms	37×	body	4096	infinite
166.0ms	45×	body	2048	infinite
155.0ms	674×	body	256	infinite
72.0ms	180×	body	512	infinite
16.0ms	1×	body	8192	valid
2.0ms	7×	body	512	invalid
1.0ms	3×	body	1024	invalid
1.0ms	15×	body	256	unsamplable

Compiler

Compiled 106504 to 76506 computations (28.2% saved)

preprocess12.7s (0.9%)

Algorithm

51×	egg-herbie

Rules

66624×	`fma-def`
26490×	`fma-neg`
25742×	`div-sub`
23584×	`sub-neg`
22428×	`distribute-lft-neg-in`

Stop Event

10×	saturated
41×	node limit

Compiler

Compiled 37716 to 19524 computations (48.2% saved)

series12.1s (0.9%)

Counts

1746 → 38465

Calls

10170 calls:

Time	Variable		Point	Expression
226.0ms	a	@	0	(/.f64 (.f64 (pow.f64 (.f64 c a) 4) 405/64) (*.f64 a (pow.f64 b 7)))
101.0ms	lambda2	@	0	(expm1.f64 (+.f64 (log.f64 (.f64 (cos.f64 (.f64 1/2 phi2)) R)) (log.f64 lambda2)))
91.0ms	phi1	@	inf	(expm1.f64 (+.f64 (.f64 -1 (log.f64 (/.f64 1 lambda2))) (log.f64 (.f64 R (cos.f64 (*.f64 1/2 (+.f64 phi1 phi2)))))))
82.0ms	a	@	inf	(log.f64 (+.f64 (exp.f64 a) (exp.f64 b)))
77.0ms	g	@	0	(.f64 (.f64 (cbrt.f64 (cbrt.f64 (/.f64 (neg.f64 g) a))) (cbrt.f64 (cbrt.f64 (/.f64 (neg.f64 g) a)))) (cbrt.f64 (cbrt.f64 (/.f64 (neg.f64 g) a))))

Results

Herbie run

sample7.5min (32.6%)

localize7.4min (32.3%)

eval2.0min (8.6%)

soundness1.4min (6.2%)

regimes1.3min (5.7%)

simplify52.1s (3.8%)

prune47.2s (3.4%)

analyze34.9s (2.5%)

rewrite21.5s (1.6%)

bsearch21.4s (1.6%)

preprocess12.7s (0.9%)

series12.1s (0.9%)

end48.0ms (0%)

Profiling