Metrics for Herbie run

Date:	Saturday, October 14th, 2023
Commit:	3cdd5168 on hamming-cleanup
Hostname:	nightly with Racket 8.6
Seed:	2023287
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample9.6min (33.6%)

Results

2.7min	16222×	body	8192	exit
1.6min	64535×	body	1024	valid
1.4min	8109×	body	4096	valid
1.3min	269230×	body	256	valid
45.9s	13394×	body	2048	valid
36.6s	1529×	body	8192	valid
24.6s	32234×	body	512	valid
10.4s	4023×	body	1024	infinite
8.4s	27512×	body	256	infinite
6.3s	25802×	body	256	unsamplable
6.1s	845×	body	2048	infinite
6.0s	582×	body	4096	infinite
5.3s	21024×	body	256	invalid
3.2s	2235×	body	512	infinite
3.0s	5307×	body	2048	invalid
2.1s	3750×	body	1024	invalid
849.0ms	2102×	body	512	invalid
404.0ms	21×	body	8192	infinite
154.0ms	907×	body	256	precondition
9.0ms	6×	body	1024	unsamplable
7.0ms	19×	body	4096	invalid
6.0ms	8×	body	512	unsamplable

Bogosity

localize7.6min (26.5%)

Results

Compiler

Compiled 77784 to 37018 computations (52.4% saved)

eval2.4min (8.3%)

Results

Compiler

Compiled 4923897 to 2634567 computations (46.5% saved)

soundness1.9min (6.6%)

Rules

317174×	`fma-def`
213984×	`associate-r`
189626×	`log-prod`
167022×	`associate-l`
148684×	`fma-neg`

Stop Event

5×	unsound
7×	saturated
435×	node limit

Compiler

Compiled 44248 to 24592 computations (44.4% saved)

preprocess1.6min (5.6%)

Algorithm

51×	egg-herbie

Rules

66624×	`fma-def`
26490×	`fma-neg`
25742×	`div-sub`
23584×	`sub-neg`
22428×	`distribute-lft-neg-in`

Stop Event

10×	saturated
41×	node limit

Compiler

Compiled 40078 to 21061 computations (47.4% saved)

regimes1.5min (5.2%)

Counts

14491 → 835

Calls

131 calls:

7.1s	phi2
6.8s	lambda2
6.5s	lambda1
6.4s	phi1
5.8s	b

Compiler

Compiled 272925 to 119366 computations (56.3% saved)

simplify59.9s (3.5%)

Algorithm

220×	egg-herbie

Rules

131114×	`fma-def`
102454×	`associate-r`
91204×	`log-prod`
88220×	`associate-l`
76022×	`*-commutative`

Stop Event

1×	unsound
47×	saturated
7×	done
40×	fuel
172×	node limit

Counts

76792 → 58943

Compiler

Compiled 13461 to 8625 computations (35.9% saved)

prune59.3s (3.5%)

Counts: 119743 → 6105
Compiler: Compiled 615495 to 416173 computations (32.4% saved)

analyze54.4s (3.2%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
19.6%	15.5%	63.8%	20.6%	0%	0%	0%	1
27.1%	21.4%	57.6%	21%	0%	0%	0%	2
36.8%	28.5%	48.9%	21.2%	0%	1.4%	0%	3
42.3%	32.2%	43.9%	21.2%	0%	2.8%	0%	4
47.2%	35.4%	39.6%	21.2%	0%	3.8%	0%	5
50.2%	37.2%	36.9%	21.2%	0%	4.6%	0%	6
53.6%	39.3%	34%	21.2%	0%	5.4%	0.1%	7
55.3%	40.3%	32.5%	21.3%	0%	5.8%	0.1%	8
58.3%	42%	30.1%	21.3%	0%	6.4%	0.2%	9
59.6%	42.8%	29%	21.3%	0%	6.7%	0.2%	10
61.9%	44.2%	27.2%	21.3%	0%	7.1%	0.3%	11
63.3%	45%	26%	21.3%	0%	7.4%	0.3%	12

Compiler

Compiled 1919 to 1338 computations (30.3% saved)

rewrite28.6s (1.7%)

Algorithm

173×	batch-egg-rewrite

Rules

120890×	`pow1`
114502×	`add-exp-log`
114440×	`log1p-expm1-u`
114402×	`expm1-log1p-u`
109342×	`add-log-exp`

Stop Event

4×	unsound
169×	node limit

Counts

1648 → 40866

bsearch27.1s (1.6%)

Algorithm

331×	binary-search
58×	left-value

Stop Event

313×	narrow-enough
18×	predicate-same

Results

9.6s	5828×	body	1024	valid
6.9s	27053×	body	256	valid
2.1s	2165×	body	512	valid
1.8s	1278×	body	2048	valid
1.7s	738×	body	4096	valid
1.5s	3491×	body	256	invalid
965.0ms	399×	body	1024	invalid
444.0ms	180×	body	2048	invalid
246.0ms	19×	body	4096	infinite
190.0ms	687×	body	256	infinite
182.0ms	25×	body	2048	infinite
175.0ms	114×	body	1024	infinite
163.0ms	154×	body	512	invalid
50.0ms	75×	body	512	infinite
23.0ms	1×	body	8192	valid
16.0ms	1×	body	8192	infinite
2.0ms	26×	body	256	unsamplable

Compiler

Compiled 79298 to 57203 computations (27.9% saved)

series15.5s (0.9%)

Counts

1648 → 35926

Calls

9294 calls:

Time	Variable		Point	Expression
175.0ms	lambda1	@	inf	(-.f64 (exp.f64 (log1p.f64 (fma.f64 (cos.f64 (-.f64 lambda1 lambda2)) (cos.f64 phi2) (cos.f64 phi1)))) 1)
162.0ms	phi2	@	-inf	(log.f64 (+.f64 1 (expm1.f64 (.f64 (cos.f64 (-.f64 lambda1 lambda2)) (.f64 (cos.f64 phi1) (cos.f64 phi2))))))
144.0ms	a	@	inf	(log.f64 (+.f64 1 (+.f64 b (+.f64 (exp.f64 a) (.f64 1/2 (.f64 b b))))))
135.0ms	lambda2	@	inf	(-.f64 (exp.f64 (log1p.f64 (fma.f64 (cos.f64 (-.f64 lambda1 lambda2)) (cos.f64 phi2) (cos.f64 phi1)))) 1)
125.0ms	lambda1	@	-inf	(-.f64 (exp.f64 (log1p.f64 (fma.f64 (cos.f64 (-.f64 lambda1 lambda2)) (cos.f64 phi2) (cos.f64 phi1)))) 1)

Herbie run

sample9.6min (33.6%)

localize7.6min (26.5%)

eval2.4min (8.3%)

soundness1.9min (6.6%)

preprocess1.6min (5.6%)

regimes1.5min (5.2%)

simplify59.9s (3.5%)

prune59.3s (3.5%)

analyze54.4s (3.2%)

rewrite28.6s (1.7%)

bsearch27.1s (1.6%)

series15.5s (0.9%)

end21.0ms (0%)

Profiling