Metrics for Herbie run

Date:	Tuesday, November 14th, 2023
Commit:	fed13c1a on cleanup-reprs
Hostname:	nightly with Racket 8.6
Seed:	2023318
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize7.8min (31.8%)

Results

Compiler

Compiled 83505 to 45203 computations (45.9% saved)

sample7.5min (30.5%)

Results

2.6min	16727×	body	8192	exit
1.1min	65644×	body	1024	valid
56.5s	8052×	body	4096	valid
51.0s	268536×	body	256	valid
32.9s	13620×	body	2048	valid
30.3s	1620×	body	8192	valid
17.6s	32163×	body	512	valid
7.0s	4241×	body	1024	infinite
5.9s	27261×	body	256	infinite
5.8s	27735×	body	256	unsamplable
4.1s	612×	body	4096	infinite
3.6s	21392×	body	256	invalid
3.4s	830×	body	2048	infinite
2.2s	5386×	body	2048	invalid
2.0s	2081×	body	512	infinite
1.5s	3794×	body	1024	invalid
695.0ms	2192×	body	512	invalid
359.0ms	26×	body	8192	infinite
83.0ms	883×	body	256	precondition
13.0ms	7×	body	1024	unsamplable
4.0ms	6×	body	512	unsamplable
3.0ms	14×	body	4096	invalid

Bogosity

eval2.0min (8.1%)

Compiler: Compiled 6029254 to 3576610 computations (40.7% saved)

regimes1.6min (6.5%)

Counts

19706 → 789

Calls

137 calls:

8.2s	phi2
7.5s	lambda1
7.1s	phi1
6.2s	lambda2
4.4s	(-.f64 lambda1 lambda2)

Results

Compiler

Compiled 504168 to 272794 computations (45.9% saved)

soundness1.5min (6.1%)

Rules

261480×	`fma-def`
176566×	`associate-r`
153744×	`log-prod`
136340×	`associate-l`
121264×	`times-frac`

Stop Event

6×	saturated
9×	unsound
393×	node limit

Compiler

Compiled 47327 to 28293 computations (40.2% saved)

preprocess1.1min (4.5%)

Algorithm

51×	egg-herbie

Rules

76366×	`fma-def`
27180×	`div-sub`
26822×	`fma-neg`
24892×	`sub-neg`
22370×	`distribute-lft-in`

Stop Event

8×	saturated
43×	node limit

Compiler

Compiled 39546 to 21315 computations (46.1% saved)

simplify48.9s (3.3%)

Algorithm

217×	egg-herbie

Rules

138476×	`fma-def`
98110×	`associate-r`
86058×	`associate-l`
83676×	`log-prod`
75750×	`times-frac`

Stop Event

1×	unsound
47×	saturated
9×	done
38×	fuel
169×	node limit

Counts

79926 → 63833

Compiler

Compiled 12898 to 8561 computations (33.6% saved)

prune47.2s (3.2%)

Counts: 135561 → 6535
Compiler: Compiled 690220 to 484541 computations (29.8% saved)

analyze34.8s (2.4%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
19.6%	15.5%	63.8%	20.6%	0%	0%	0%	1
27.1%	21.4%	57.6%	21%	0%	0%	0%	2
36.8%	28.5%	48.9%	21.2%	0%	1.4%	0%	3
42.3%	32.2%	43.9%	21.2%	0%	2.8%	0%	4
47.2%	35.4%	39.6%	21.2%	0%	3.8%	0%	5
50.2%	37.2%	36.9%	21.2%	0%	4.6%	0%	6
53.6%	39.3%	34%	21.2%	0%	5.4%	0.1%	7
55.3%	40.3%	32.5%	21.3%	0%	5.8%	0.1%	8
58.3%	42%	30.1%	21.3%	0%	6.4%	0.2%	9
59.6%	42.8%	29%	21.3%	0%	6.7%	0.2%	10
61.9%	44.2%	27.2%	21.3%	0%	7.1%	0.3%	11
63.3%	45%	26%	21.3%	0%	7.4%	0.3%	12

Compiler

Compiled 1919 to 1338 computations (30.3% saved)

rewrite24.7s (1.7%)

Algorithm

170×	batch-egg-rewrite

Rules

91809×	`log1p-expm1-u`
71465×	`expm1-log1p-u`
52772×	`expm1-udef`
51648×	`prod-diff`
50010×	`log-prod`

Stop Event

4×	unsound
166×	node limit

Counts

1556 → 47151

bsearch19.0s (1.3%)

Algorithm

261×	binary-search
88×	left-value

Stop Event

252×	narrow-enough
9×	predicate-same

Results

9.0s	8180×	body	1024	valid
3.8s	19288×	body	256	valid
1.8s	3090×	body	512	valid
1.2s	1096×	body	2048	valid
789.0ms	834×	body	4096	valid
725.0ms	4315×	body	256	invalid
267.0ms	508×	body	1024	invalid
261.0ms	310×	body	2048	invalid
164.0ms	285×	body	512	invalid
164.0ms	378×	body	256	infinite
43.0ms	62×	body	1024	infinite
13.0ms	32×	body	512	infinite

Compiler

Compiled 71555 to 53174 computations (25.7% saved)

series9.2s (0.6%)

Counts

1556 → 32775

Calls

8868 calls:

Time	Variable		Point	Expression
96.0ms	c	@	0	(log.f64 (+.f64 1 (expm1.f64 (.f64 -1/2 (/.f64 (.f64 c (/.f64 a b)) a)))))
84.0ms	F	@	-inf	(log.f64 (pow.f64 (exp.f64 F) (fma.f64 B B (.f64 A (.f64 C -4)))))
77.0ms	x-scale	@	-inf	(/.f64 (.f64 (pow.f64 a 2) (pow.f64 b 2)) (.f64 (pow.f64 x-scale 2) (pow.f64 y-scale 2)))
75.0ms	lambda2	@	inf	(-.f64 (exp.f64 (log1p.f64 (acos.f64 (fma.f64 (sin.f64 phi1) (sin.f64 phi2) (.f64 (.f64 (cos.f64 phi1) (cos.f64 phi2)) (cos.f64 lambda2)))))) 1)
63.0ms	delta	@	0	(pow.f64 (cbrt.f64 (+.f64 (cos.f64 delta) (.f64 (sin.f64 phi1) (fma.f64 (cos.f64 delta) (sin.f64 phi1) (.f64 (cos.f64 phi1) (*.f64 (sin.f64 delta) (cos.f64 theta))))))) 3)

Herbie run

localize7.8min (31.8%)

sample7.5min (30.5%)

eval2.0min (8.1%)

regimes1.6min (6.5%)

soundness1.5min (6.1%)

preprocess1.1min (4.5%)

simplify48.9s (3.3%)

prune47.2s (3.2%)

analyze34.8s (2.4%)

rewrite24.7s (1.7%)

bsearch19.0s (1.3%)

series9.2s (0.6%)

end18.0ms (0%)

Profiling