Metrics for Herbie run

Date:	Wednesday, August 30th, 2023
Commit:	5f639494 on main
Hostname:	nightly with Racket 8.6
Seed:	2023242
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize8.7min (37.1%)

Results

Compiler

Compiled 89261 to 42763 computations (52.1% saved)

sample7.5min (31.9%)

Results

2.7min	16937×	body	8192	exit
1.1min	65051×	body	1024	valid
57.4s	8319×	body	4096	valid
51.4s	269119×	body	256	valid
32.5s	13396×	body	2048	valid
28.1s	1568×	body	8192	valid
17.5s	32454×	body	512	valid
7.0s	4142×	body	1024	infinite
6.0s	27328×	body	256	infinite
5.9s	28372×	body	256	unsamplable
3.8s	574×	body	4096	infinite
3.6s	21663×	body	256	invalid
3.2s	784×	body	2048	infinite
2.0s	5282×	body	2048	invalid
2.0s	1996×	body	512	infinite
1.5s	3688×	body	1024	invalid
649.0ms	2246×	body	512	invalid
339.0ms	24×	body	8192	infinite
84.0ms	914×	body	256	precondition
5.0ms	7×	body	512	unsamplable
2.0ms	2×	body	1024	unsamplable
1.0ms	5×	body	4096	invalid

Bogosity

eval1.7min (7.1%)

Compiler: Compiled 6213967 to 3333982 computations (46.3% saved)

soundness1.3min (5.6%)

Rules

308110×	`fma-def`
164390×	`associate-r`
144428×	`log-prod`
140038×	`fma-neg`
139730×	`associate-l`

Stop Event

4×	unsound
14×	saturated
412×	node limit

Compiler

Compiled 49847 to 28576 computations (42.7% saved)

regimes1.2min (4.9%)

Counts

15636 → 820

Calls

137 calls:

5.3s	phi1
4.8s	phi2
4.0s	lambda1
3.9s	lambda2
3.5s	b

Compiler

Compiled 379192 to 185778 computations (51% saved)

simplify49.4s (3.5%)

Algorithm

279×	egg-herbie

Rules

200792×	`fma-def`
115410×	`associate-r`
100868×	`associate-l`
97086×	`fma-neg`
94758×	`times-frac`

Stop Event

65×	saturated
5×	done
43×	fuel
214×	node limit

Counts

80784 → 64233

Results

Compiler

Compiled 14985 to 9803 computations (34.6% saved)

prune42.5s (3%)

Counts: 134378 → 6420
Compiler: Compiled 673443 to 447097 computations (33.6% saved)

analyze33.3s (2.4%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
19.6%	15.5%	63.8%	20.6%	0%	0%	0%	1
27.1%	21.4%	57.6%	21%	0%	0%	0%	2
36.8%	28.5%	48.9%	21.2%	0%	1.4%	0%	3
42.3%	32.2%	43.9%	21.2%	0%	2.8%	0%	4
47.2%	35.4%	39.6%	21.2%	0%	3.8%	0%	5
50.2%	37.2%	36.9%	21.2%	0%	4.6%	0%	6
53.6%	39.3%	34%	21.2%	0%	5.4%	0.1%	7
55.3%	40.3%	32.5%	21.3%	0%	5.8%	0.1%	8
58.3%	42%	30.1%	21.3%	0%	6.4%	0.2%	9
59.6%	42.8%	29%	21.3%	0%	6.7%	0.2%	10
61.9%	44.2%	27.2%	21.3%	0%	7.1%	0.3%	11
63.3%	45%	26%	21.3%	0%	7.4%	0.3%	12

Compiler

Compiled 1919 to 1338 computations (30.3% saved)

rewrite20.8s (1.5%)

Algorithm

180×	batch-egg-rewrite

Rules

130406×	`pow1`
123534×	`add-exp-log`
123458×	`log1p-expm1-u`
123428×	`expm1-log1p-u`
115276×	`add-log-exp`

Stop Event

3×	unsound
177×	node limit

Counts

1773 → 41893

bsearch19.3s (1.4%)

Algorithm

341×	binary-search
40×	left-value

Stop Event

333×	narrow-enough
8×	predicate-same

Results

8.2s	7612×	body	1024	valid
4.9s	26949×	body	256	valid
1.9s	1917×	body	2048	valid
1.9s	2996×	body	512	valid
1.2s	1315×	body	4096	valid
283.0ms	1815×	body	256	invalid
76.0ms	548×	body	256	infinite
60.0ms	59×	body	1024	invalid
54.0ms	57×	body	1024	infinite
18.0ms	46×	body	512	infinite
9.0ms	15×	body	2048	invalid
8.0ms	20×	body	512	invalid

Compiler

Compiled 101279 to 74305 computations (26.6% saved)

preprocess12.9s (0.9%)

Algorithm

51×	egg-herbie

Rules

66624×	`fma-def`
26490×	`fma-neg`
25742×	`div-sub`
23584×	`sub-neg`
22428×	`distribute-lft-neg-in`

Stop Event

10×	saturated
41×	node limit

Compiler

Compiled 34214 to 18484 computations (46% saved)

series12.0s (0.9%)

Counts

1773 → 39663

Calls

10521 calls:

Time	Variable		Point	Expression
164.0ms	eh	@	0	(.f64 (cos.f64 t) (.f64 eh (sin.f64 (atan.f64 (/.f64 (/.f64 eh (tan.f64 t)) ew)))))
126.0ms	a	@	inf	(-.f64 (exp.f64 (log1p.f64 (/.f64 1/3 a))) 1)
103.0ms	phi1	@	inf	(log1p.f64 (-.f64 (.f64 (cos.f64 (.f64 phi2 1/2)) (cos.f64 (.f64 phi1 1/2))) (.f64 (sin.f64 (.f64 phi2 1/2)) (sin.f64 (.f64 phi1 1/2)))))
87.0ms	b	@	0	(exp.f64 (log1p.f64 (fma.f64 b 1/2 (log.f64 2))))
67.0ms	phi2	@	-inf	(log1p.f64 (cos.f64 (*.f64 (+.f64 phi1 phi2) 1/2)))

Herbie run

localize8.7min (37.1%)

sample7.5min (31.9%)

eval1.7min (7.1%)

soundness1.3min (5.6%)

regimes1.2min (4.9%)

simplify49.4s (3.5%)

prune42.5s (3%)

analyze33.3s (2.4%)

rewrite20.8s (1.5%)

bsearch19.3s (1.4%)

preprocess12.9s (0.9%)

series12.0s (0.9%)

end19.0ms (0%)

Profiling