Metrics for Herbie run

Date:	Friday, October 20th, 2023
Commit:	21d611eb on main
Hostname:	nightly with Racket 8.6
Seed:	2023293
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize7.5min (31.6%)

Results

Compiler

Compiled 82795 to 40031 computations (51.7% saved)

sample7.5min (31.6%)

Results

2.6min	16717×	body	8192	exit
1.1min	64208×	body	1024	valid
57.2s	8132×	body	4096	valid
50.9s	269329×	body	256	valid
31.9s	13425×	body	2048	valid
29.1s	1606×	body	8192	valid
16.8s	32696×	body	512	valid
6.8s	4244×	body	1024	infinite
5.8s	27432×	body	256	unsamplable
5.4s	27282×	body	256	infinite
3.9s	586×	body	4096	infinite
3.7s	21263×	body	256	invalid
3.4s	837×	body	2048	infinite
1.9s	2100×	body	512	infinite
1.8s	5247×	body	2048	invalid
1.3s	3669×	body	1024	invalid
587.0ms	2189×	body	512	invalid
476.0ms	30×	body	8192	infinite
114.0ms	886×	body	256	precondition
10.0ms	15×	body	512	unsamplable
9.0ms	1×	body	4096	unsamplable
6.0ms	5×	body	1024	unsamplable
2.0ms	8×	body	4096	invalid

Bogosity

eval1.7min (7.2%)

Compiler: Compiled 5882113 to 3246541 computations (44.8% saved)

soundness1.5min (6.2%)

Rules

332240×	`fma-def`
192558×	`associate-r`
189000×	`log-prod`
154132×	`*-commutative`
147316×	`associate-l`

Stop Event

4×	unsound
8×	saturated
456×	node limit

Compiler

Compiled 49476 to 27609 computations (44.2% saved)

regimes1.4min (5.8%)

Counts

18121 → 887

Calls

137 calls:

8.6s	phi1
7.5s	phi2
5.8s	lambda1
5.6s	lambda2
4.2s	b

Compiler

Compiled 449878 to 230461 computations (48.8% saved)

preprocess1.1min (4.8%)

Algorithm

51×	egg-herbie

Rules

66624×	`fma-def`
26490×	`fma-neg`
25742×	`div-sub`
23584×	`sub-neg`
22428×	`distribute-lft-neg-in`

Stop Event

10×	saturated
41×	node limit

Compiler

Compiled 48016 to 25933 computations (46% saved)

simplify47.1s (3.3%)

Algorithm

223×	egg-herbie

Rules

146396×	`fma-def`
99632×	`associate-r`
90886×	`log-prod`
86990×	`associate-l`
81284×	`*-commutative`

Stop Event

48×	saturated
8×	done
40×	fuel
175×	node limit

Counts

74189 → 58467

Compiler

Compiled 17538 to 11429 computations (34.8% saved)

prune42.3s (3%)

Counts: 122081 → 6359
Compiler: Compiled 711636 to 477651 computations (32.9% saved)

analyze33.9s (2.4%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
19.6%	15.5%	63.8%	20.6%	0%	0%	0%	1
27.1%	21.4%	57.6%	21%	0%	0%	0%	2
36.8%	28.5%	48.9%	21.2%	0%	1.4%	0%	3
42.3%	32.2%	43.9%	21.2%	0%	2.8%	0%	4
47.2%	35.4%	39.6%	21.2%	0%	3.8%	0%	5
50.2%	37.2%	36.9%	21.2%	0%	4.6%	0%	6
53.6%	39.3%	34%	21.2%	0%	5.4%	0.1%	7
55.3%	40.3%	32.5%	21.3%	0%	5.8%	0.1%	8
58.3%	42%	30.1%	21.3%	0%	6.4%	0.2%	9
59.6%	42.8%	29%	21.3%	0%	6.7%	0.2%	10
61.9%	44.2%	27.2%	21.3%	0%	7.1%	0.3%	11
63.3%	45%	26%	21.3%	0%	7.4%	0.3%	12

Compiler

Compiled 1919 to 1338 computations (30.3% saved)

bsearch26.3s (1.9%)

Algorithm

379×	binary-search
45×	left-value

Stop Event

372×	narrow-enough
7×	predicate-same

Results

12.9s	10681×	body	1024	valid
5.0s	26330×	body	256	valid
2.6s	4047×	body	512	valid
2.0s	1694×	body	2048	valid
1.4s	1030×	body	4096	valid
396.0ms	604×	body	1024	infinite
293.0ms	2029×	body	256	invalid
226.0ms	62×	body	2048	infinite
202.0ms	32×	body	4096	infinite
202.0ms	975×	body	256	infinite
63.0ms	160×	body	512	infinite
18.0ms	33×	body	1024	invalid
13.0ms	37×	body	512	invalid
12.0ms	1×	body	8192	infinite
6.0ms	9×	body	2048	invalid

Compiler

Compiled 129360 to 94002 computations (27.3% saved)

rewrite20.9s (1.5%)

Algorithm

175×	batch-egg-rewrite

Rules

130528×	`pow1`
123470×	`add-exp-log`
123412×	`log1p-expm1-u`
123382×	`expm1-log1p-u`
113506×	`add-log-exp`

Stop Event

3×	unsound
172×	node limit

Counts

1620 → 38407

series11.0s (0.8%)

Counts

1620 → 35782

Calls

9561 calls:

Time	Variable		Point	Expression
317.0ms	phi2	@	-inf	(log1p.f64 (*.f64 (sin.f64 phi1) (cos.f64 phi2)))
125.0ms	lambda2	@	inf	(log.f64 (acos.f64 (fma.f64 (sin.f64 phi1) (sin.f64 phi2) (.f64 (cos.f64 phi1) (.f64 (cos.f64 phi2) (fma.f64 (cos.f64 lambda2) (cos.f64 lambda1) (*.f64 (sin.f64 lambda1) (sin.f64 lambda2))))))))
112.0ms	a	@	0	(-.f64 (exp.f64 (log1p.f64 (*.f64 3 a))) 1)
66.0ms	F	@	0	(sqrt.f64 (.f64 F (.f64 (*.f64 (cbrt.f64 (-.f64 A (hypot.f64 A B))) (cbrt.f64 (-.f64 A (hypot.f64 A B)))) (cbrt.f64 (-.f64 A (hypot.f64 A B))))))
63.0ms	g	@	0	(log.f64 (cbrt.f64 (exp.f64 (cos.f64 (fma.f64 1/3 (acos.f64 (/.f64 g h)) (*.f64 2/3 (PI.f64)))))))

Herbie run

localize7.5min (31.6%)

sample7.5min (31.6%)

eval1.7min (7.2%)

soundness1.5min (6.2%)

regimes1.4min (5.8%)

preprocess1.1min (4.8%)

simplify47.1s (3.3%)

prune42.3s (3%)

analyze33.9s (2.4%)

bsearch26.3s (1.9%)

rewrite20.9s (1.5%)

series11.0s (0.8%)

end25.0ms (0%)

Profiling