Metrics for Herbie run

Date:	Saturday, August 26th, 2023
Commit:	5f639494 on main
Hostname:	nightly with Racket 8.6
Seed:	2023238
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.3min (31.2%)

Results

29.2s	33364×	body	2048	valid
24.9s	62536×	body	1024	valid
11.0s	86876×	body	256	valid
8.0s	32777×	body	512	valid
1.6s	13221×	body	256	infinite
1.1s	1207×	body	1024	invalid
1.1s	2058×	body	4096	valid
987.0ms	5228×	body	256	invalid
827.0ms	7350×	body	256	unsamplable
261.0ms	576×	body	512	invalid
183.0ms	146×	body	1024	infinite
182.0ms	425×	body	1024	unsamplable
160.0ms	291×	body	2048	unsamplable
86.0ms	182×	body	512	infinite
65.0ms	263×	body	512	unsamplable
8.0ms	8×	body	2048	infinite
3.0ms	4×	body	2048	invalid

Bogosity

soundness39.3s (15.3%)

Rules

180902×	`fma-def`
94652×	`log-prod`
90034×	`fma-neg`
88476×	`associate-r`
73342×	`associate-l`

Stop Event

9×	saturated
240×	node limit

Compiler

Compiled 24263 to 14259 computations (41.2% saved)

localize35.7s (13.9%)

Compiler: Compiled 14168 to 6962 computations (50.9% saved)

eval28.3s (11%)

Compiler: Compiled 1499081 to 842301 computations (43.8% saved)

simplify18.7s (7.3%)

Algorithm

153×	egg-herbie

Rules

105072×	`fma-def`
55154×	`associate-r`
51986×	`fma-neg`
47818×	`times-frac`
47490×	`associate-l`

Stop Event

4×	done
47×	saturated
24×	fuel
106×	node limit

Counts

34740 → 33999

Compiler

Compiled 4653 to 3147 computations (32.4% saved)

prune13.2s (5.2%)

Counts: 59147 → 2174
Compiler: Compiled 115712 to 78513 computations (32.1% saved)

regimes11.8s (4.6%)

Counts

4504 → 399

Calls

43 calls:

2.7s	x
2.3s	eps
1.1s	a
875.0ms	c
743.0ms	b

Compiler

Compiled 54829 to 29824 computations (45.6% saved)

rewrite11.3s (4.4%)

Algorithm

97×	batch-egg-rewrite

Rules

59012×	`pow1`
55942×	`add-exp-log`
55934×	`log1p-expm1-u`
55886×	`expm1-log1p-u`
52420×	`add-log-exp`

Stop Event

97×	node limit

Counts

734 → 23349

preprocess6.6s (2.6%)

Algorithm

28×	egg-herbie

Rules

42740×	`fma-def`
13078×	`fma-neg`
9294×	`associate-/r*`
9220×	`div-sub`
9054×	`distribute-rgt-in`

Stop Event

13×	saturated
15×	node limit

Compiler

Compiled 10726 to 6423 computations (40.1% saved)

bsearch5.6s (2.2%)

Algorithm

154×	binary-search
43×	left-value

Stop Event

152×	narrow-enough
2×	predicate-same

Results

2.5s	13043×	body	256	valid
1.4s	2585×	body	1024	valid
528.0ms	1290×	body	512	valid
333.0ms	565×	body	2048	valid
268.0ms	1720×	body	256	invalid
214.0ms	976×	body	256	infinite
42.0ms	49×	body	1024	infinite
13.0ms	26×	body	512	infinite
4.0ms	10×	body	4096	valid
3.0ms	18×	body	256	unsamplable
2.0ms	4×	body	512	unsamplable
2.0ms	5×	body	1024	unsamplable

Compiler

Compiled 31262 to 22331 computations (28.6% saved)

series3.2s (1.3%)

Counts

734 → 11363

Calls

3414 calls:

Time	Variable		Point	Expression
116.0ms	x	@	0	(/.f64 (-.f64 (.f64 (.f64 x x) (+.f64 (*.f64 -1/3 x) -1/2)) x) (log1p.f64 x))
85.0ms	eps	@	-inf	(log1p.f64 (-.f64 (cos.f64 (+.f64 x eps)) (cos.f64 x)))
64.0ms	x	@	-inf	(log.f64 (sin.f64 (*.f64 1/2 (+.f64 eps (+.f64 x x)))))
61.0ms	x	@	0	(pow.f64 x (/.f64 1 n))
56.0ms	x	@	inf	(log.f64 (tan.f64 (+.f64 x eps)))

analyze3.0s (1.2%)

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	90.9%	9.1%	0%	0%	0%	0
27.4%	24.9%	66%	9.1%	0%	0%	0%	1
39%	34.7%	54.4%	9.1%	0%	1.8%	0%	2
51%	44.1%	42.4%	9.1%	0%	4.5%	0%	3
58.9%	50.1%	35%	9.1%	0%	5.8%	0%	4
65.5%	55%	29%	9.1%	0%	6.9%	0%	5
67.8%	56.6%	26.9%	9.1%	0%	7.5%	0%	6
70.2%	57.8%	24.6%	9.1%	0%	8.4%	0.1%	7
72.2%	59.3%	22.8%	9.1%	0%	8.7%	0.1%	8
73.5%	60%	21.6%	9.1%	0%	9.1%	0.3%	9
74.7%	60.5%	20.4%	9.1%	0%	9.7%	0.3%	10
76.2%	61.5%	19.2%	9.1%	0%	9.9%	0.4%	11
76.9%	61.8%	18.5%	9.1%	0%	10.2%	0.4%	12

Compiler

Compiled 375 to 278 computations (25.9% saved)

Herbie run

sample1.3min (31.2%)

soundness39.3s (15.3%)

localize35.7s (13.9%)

eval28.3s (11%)

simplify18.7s (7.3%)

prune13.2s (5.2%)

regimes11.8s (4.6%)

rewrite11.3s (4.4%)

preprocess6.6s (2.6%)

bsearch5.6s (2.2%)

series3.2s (1.3%)

analyze3.0s (1.2%)

end3.0ms (0%)

Profiling