Metrics for Herbie run

Date:	Thursday, August 17th, 2023
Commit:	1987babf on main
Hostname:	nightly with Racket 8.6
Seed:	2023229
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize8.9min (36.8%)

Results

Compiler

Compiled 89215 to 42015 computations (52.9% saved)

sample7.5min (31.2%)

Results

2.6min	17025×	body	8192	exit
1.2min	65094×	body	1024	valid
57.5s	8200×	body	4096	valid
51.8s	269417×	body	256	valid
32.5s	13528×	body	2048	valid
28.1s	1587×	body	8192	valid
17.0s	32036×	body	512	valid
7.1s	4101×	body	1024	infinite
6.0s	28210×	body	256	unsamplable
5.6s	27344×	body	256	infinite
4.4s	619×	body	4096	infinite
3.4s	21364×	body	256	invalid
3.4s	782×	body	2048	infinite
2.0s	2017×	body	512	infinite
2.0s	5354×	body	2048	invalid
1.4s	3834×	body	1024	invalid
598.0ms	2132×	body	512	invalid
328.0ms	21×	body	8192	infinite
88.0ms	939×	body	256	precondition
4.0ms	1×	body	2048	unsamplable
4.0ms	3×	body	1024	unsamplable
4.0ms	5×	body	512	unsamplable
2.0ms	9×	body	4096	invalid

Bogosity

eval1.7min (7%)

Results

Compiler

Compiled 6811256 to 3686908 computations (45.9% saved)

soundness1.4min (5.8%)

Rules

316854×	`fma-def`
184040×	`associate-r`
154184×	`fma-neg`
151140×	`log-prod`
143988×	`times-frac`

Stop Event

4×	unsound
14×	saturated
432×	node limit

Compiler

Compiled 53698 to 30374 computations (43.4% saved)

regimes1.3min (5.2%)

Counts

16249 → 834

Calls

137 calls:

7.0s	phi1
5.2s	lambda1
5.1s	phi2
5.0s	lambda2
3.8s	b

Compiler

Compiled 375236 to 177751 computations (52.6% saved)

simplify52.7s (3.7%)

Algorithm

276×	egg-herbie

Rules

200940×	`fma-def`
121056×	`associate-r`
100722×	`associate-l`
97554×	`fma-neg`
92986×	`*-commutative`

Stop Event

65×	saturated
5×	done
43×	fuel
211×	node limit

Counts

82945 → 67572

Compiler

Compiled 15791 to 10239 computations (35.2% saved)

prune44.0s (3%)

Counts: 135397 → 6766
Compiler: Compiled 716685 to 480622 computations (32.9% saved)

analyze34.2s (2.4%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
19.6%	15.5%	63.8%	20.6%	0%	0%	0%	1
27.1%	21.4%	57.6%	21%	0%	0%	0%	2
36.8%	28.5%	48.9%	21.2%	0%	1.4%	0%	3
42.3%	32.2%	43.9%	21.2%	0%	2.8%	0%	4
47.2%	35.4%	39.6%	21.2%	0%	3.8%	0%	5
50.2%	37.2%	36.9%	21.2%	0%	4.6%	0%	6
53.6%	39.3%	34%	21.2%	0%	5.4%	0.1%	7
55.3%	40.3%	32.5%	21.3%	0%	5.8%	0.1%	8
58.3%	42%	30.1%	21.3%	0%	6.4%	0.2%	9
59.6%	42.8%	29%	21.3%	0%	6.7%	0.2%	10
61.9%	44.2%	27.2%	21.3%	0%	7.1%	0.3%	11
63.3%	45%	26%	21.3%	0%	7.4%	0.3%	12

Compiler

Compiled 1919 to 1338 computations (30.3% saved)

bsearch23.8s (1.6%)

Algorithm

342×	binary-search
44×	left-value

Stop Event

330×	narrow-enough
12×	predicate-same

Results

11.1s	8991×	body	1024	valid
5.2s	25733×	body	256	valid
2.4s	1842×	body	2048	valid
2.3s	3099×	body	512	valid
631.0ms	3642×	body	256	invalid
569.0ms	634×	body	4096	valid
241.0ms	1186×	body	256	infinite
187.0ms	313×	body	1024	invalid
143.0ms	178×	body	2048	invalid
52.0ms	141×	body	512	infinite
43.0ms	70×	body	1024	infinite
39.0ms	113×	body	512	invalid
2.0ms	25×	body	256	unsamplable

Compiler

Compiled 116126 to 85045 computations (26.8% saved)

rewrite21.1s (1.5%)

Algorithm

177×	batch-egg-rewrite

Rules

127402×	`pow1`
120686×	`add-exp-log`
120530×	`log1p-expm1-u`
120500×	`expm1-log1p-u`
115362×	`add-log-exp`

Stop Event

3×	unsound
174×	node limit

Counts

1797 → 43039

series14.5s (1%)

Counts

1797 → 39855

Calls

10383 calls:

Time	Variable		Point	Expression
259.0ms	lambda1	@	-inf	(log.f64 (acos.f64 (fma.f64 phi1 (sin.f64 phi2) (.f64 (cos.f64 phi1) (.f64 (cos.f64 phi2) (cos.f64 (-.f64 lambda1 lambda2)))))))
215.0ms	angle	@	0	(/.f64 (.f64 x-scale x-scale) (pow.f64 (.f64 (-.f64 (.f64 b b) (.f64 a a)) (sin.f64 (.f64 angle (.f64 1/180 (PI.f64))))) 2))
117.0ms	phi1	@	-inf	(log.f64 (+.f64 1 (expm1.f64 (.f64 (acos.f64 (fma.f64 (cos.f64 (-.f64 lambda1 lambda2)) (.f64 (cos.f64 phi1) (cos.f64 phi2)) (*.f64 (sin.f64 phi1) (sin.f64 phi2)))) R))))
85.0ms	theta	@	inf	(log.f64 (pow.f64 (exp.f64 (sin.f64 theta)) (pow.f64 (cbrt.f64 (*.f64 (sin.f64 delta) (cos.f64 phi1))) 3)))
84.0ms	c	@	0	(-.f64 (exp.f64 (log1p.f64 (/.f64 -1/2 (/.f64 a (*.f64 (/.f64 c b) a))))) 1)

preprocess12.2s (0.8%)

Algorithm

51×	egg-herbie

Rules

66624×	`fma-def`
26490×	`fma-neg`
25742×	`div-sub`
23584×	`sub-neg`
22428×	`distribute-lft-neg-in`

Stop Event

10×	saturated
41×	node limit

Compiler

Compiled 35628 to 18642 computations (47.7% saved)

Herbie run

localize8.9min (36.8%)

sample7.5min (31.2%)

eval1.7min (7%)

soundness1.4min (5.8%)

regimes1.3min (5.2%)

simplify52.7s (3.7%)

prune44.0s (3%)

analyze34.2s (2.4%)

bsearch23.8s (1.6%)

rewrite21.1s (1.5%)

series14.5s (1%)

preprocess12.2s (0.8%)

end37.0ms (0%)

Profiling