Metrics for Herbie run

Date:	Thursday, September 14th, 2023
Commit:	4716b437 on main
Hostname:	nightly with Racket 8.6
Seed:	2023257
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample7.7min (33.2%)

Results

2.6min	16729×	body	8192	exit
1.2min	64783×	body	1024	valid
1.0min	8452×	body	4096	valid
53.3s	269614×	body	256	valid
33.3s	13244×	body	2048	valid
27.5s	1515×	body	8192	valid
17.4s	32017×	body	512	valid
7.1s	4082×	body	1024	infinite
6.1s	28111×	body	256	unsamplable
5.6s	27255×	body	256	infinite
4.1s	626×	body	4096	infinite
3.9s	21061×	body	256	invalid
3.4s	864×	body	2048	infinite
2.1s	2152×	body	512	infinite
2.1s	5266×	body	2048	invalid
1.6s	3751×	body	1024	invalid
749.0ms	2197×	body	512	invalid
214.0ms	15×	body	8192	infinite
79.0ms	906×	body	256	precondition
6.0ms	5×	body	1024	unsamplable
5.0ms	8×	body	512	unsamplable
2.0ms	6×	body	4096	invalid

Bogosity

localize7.3min (31.4%)

Results

Compiler

Compiled 97175 to 46877 computations (51.8% saved)

eval2.1min (8.9%)

Compiler: Compiled 6607929 to 3465492 computations (47.6% saved)

soundness1.4min (6.1%)

Rules

326594×	`fma-def`
171274×	`associate-r`
166782×	`log-prod`
157434×	`associate-l`
154586×	`times-frac`

Stop Event

4×	unsound
13×	saturated
427×	node limit

Compiler

Compiled 52754 to 30997 computations (41.2% saved)

regimes1.2min (5.3%)

Counts

16469 → 923

Calls

137 calls:

4.3s	phi2
4.2s	b
4.2s	phi1
3.8s	a
3.8s	lambda1

Compiler

Compiled 375530 to 188063 computations (49.9% saved)

simplify51.9s (3.7%)

Algorithm

275×	egg-herbie

Rules

205372×	`fma-def`
110872×	`associate-r`
100388×	`associate-l`
96382×	`times-frac`
96272×	`log-prod`

Stop Event

65×	saturated
5×	done
43×	fuel
210×	node limit

Counts

78263 → 61322

Compiler

Compiled 17057 to 11148 computations (34.6% saved)

prune48.3s (3.5%)

Counts: 139298 → 7090
Compiler: Compiled 767469 to 515241 computations (32.9% saved)

analyze35.3s (2.5%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
19.6%	15.5%	63.8%	20.6%	0%	0%	0%	1
27.1%	21.4%	57.6%	21%	0%	0%	0%	2
36.8%	28.5%	48.9%	21.2%	0%	1.4%	0%	3
42.3%	32.2%	43.9%	21.2%	0%	2.8%	0%	4
47.2%	35.4%	39.6%	21.2%	0%	3.8%	0%	5
50.2%	37.2%	36.9%	21.2%	0%	4.6%	0%	6
53.6%	39.3%	34%	21.2%	0%	5.4%	0.1%	7
55.3%	40.3%	32.5%	21.3%	0%	5.8%	0.1%	8
58.3%	42%	30.1%	21.3%	0%	6.4%	0.2%	9
59.6%	42.8%	29%	21.3%	0%	6.7%	0.2%	10
61.9%	44.2%	27.2%	21.3%	0%	7.1%	0.3%	11
63.3%	45%	26%	21.3%	0%	7.4%	0.3%	12

Compiler

Compiled 1919 to 1338 computations (30.3% saved)

bsearch27.1s (1.9%)

Algorithm

391×	binary-search
68×	left-value

Stop Event

382×	narrow-enough
9×	predicate-same

Results

7.2s	6828×	body	1024	valid
6.1s	29466×	body	256	valid
5.9s	4702×	body	4096	valid
3.3s	3247×	body	2048	valid
1.8s	2736×	body	512	valid
522.0ms	86×	body	4096	infinite
466.0ms	131×	body	2048	infinite
289.0ms	259×	body	1024	infinite
246.0ms	944×	body	256	infinite
237.0ms	1653×	body	256	invalid
82.0ms	209×	body	512	infinite

Compiler

Compiled 108263 to 80881 computations (25.3% saved)

rewrite21.0s (1.5%)

Algorithm

176×	batch-egg-rewrite

Rules

128274×	`pow1`
121660×	`add-exp-log`
121554×	`log1p-expm1-u`
121518×	`expm1-log1p-u`
117966×	`add-log-exp`

Stop Event

3×	unsound
173×	node limit

Counts

1709 → 41561

preprocess14.9s (1.1%)

Algorithm

51×	egg-herbie

Rules

66624×	`fma-def`
26490×	`fma-neg`
25742×	`div-sub`
23584×	`sub-neg`
22428×	`distribute-lft-neg-in`

Stop Event

10×	saturated
41×	node limit

Compiler

Compiled 39440 to 20972 computations (46.8% saved)

series12.2s (0.9%)

Counts

1709 → 36651

Calls

9684 calls:

Time	Variable		Point	Expression
343.0ms	b	@	inf	(log1p.f64 (pow.f64 (+.f64 (exp.f64 b) 1) -1/2))
182.0ms	h	@	inf	(log.f64 (pow.f64 (pow.f64 (exp.f64 (cos.f64 (fma.f64 (acos.f64 (/.f64 g h)) 1/3 (*.f64 2/3 (PI.f64))))) 1/6) 2))
161.0ms	lambda1	@	-inf	(-.f64 1 (+.f64 (pow.f64 (sin.f64 (/.f64 (-.f64 phi1 phi2) 2)) 2) (.f64 (.f64 (*.f64 (cos.f64 phi1) (cos.f64 phi2)) (sin.f64 (/.f64 (-.f64 lambda1 lambda2) 2))) (sin.f64 (/.f64 (-.f64 lambda1 lambda2) 2)))))
71.0ms	h	@	inf	(log.f64 (cbrt.f64 (exp.f64 (cbrt.f64 (exp.f64 (cos.f64 (fma.f64 (acos.f64 (/.f64 g h)) 1/3 (*.f64 2/3 (PI.f64)))))))))
61.0ms	g	@	0	(pow.f64 (pow.f64 (exp.f64 (cos.f64 (fma.f64 (acos.f64 (/.f64 g h)) 1/3 (*.f64 2/3 (PI.f64))))) 1/6) 2)

Herbie run

sample7.7min (33.2%)

localize7.3min (31.4%)

eval2.1min (8.9%)

soundness1.4min (6.1%)

regimes1.2min (5.3%)

simplify51.9s (3.7%)

prune48.3s (3.5%)

analyze35.3s (2.5%)

bsearch27.1s (1.9%)

rewrite21.0s (1.5%)

preprocess14.9s (1.1%)

series12.2s (0.9%)

end21.0ms (0%)

Profiling