Metrics for Herbie run

Date:	Tuesday, October 10th, 2023
Commit:	c00e4401 on platforms
Hostname:	nightly with Racket 8.6
Seed:	2023283
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample2.0min (32%)

Results

41.6s	33124×	body	2048	valid
36.7s	62519×	body	1024	valid
16.6s	86899×	body	256	valid
12.1s	33276×	body	512	valid
2.2s	12972×	body	256	infinite
1.9s	1138×	body	1024	invalid
1.7s	2040×	body	4096	valid
1.2s	7369×	body	256	unsamplable
862.0ms	5096×	body	256	invalid
448.0ms	605×	body	512	invalid
378.0ms	334×	body	2048	unsamplable
327.0ms	481×	body	1024	unsamplable
286.0ms	149×	body	1024	infinite
156.0ms	244×	body	512	unsamplable
138.0ms	186×	body	512	infinite
11.0ms	5×	body	2048	invalid
5.0ms	3×	body	2048	infinite

Bogosity

soundness54.8s (14.9%)

Rules

169872×	`fma-def`
112254×	`fma-neg`
87402×	`log-prod`
86522×	`associate-r`
70976×	`times-frac`

Stop Event

2×	saturated
228×	node limit

Compiler

Compiled 19705 to 12002 computations (39.1% saved)

localize47.8s (13%)

Compiler: Compiled 13072 to 6176 computations (52.8% saved)

eval37.2s (10.1%)

Compiler: Compiled 1226417 to 675953 computations (44.9% saved)

simplify26.5s (7.2%)

Algorithm

129×	egg-herbie

Rules

79484×	`fma-def`
61722×	`fma-neg`
50884×	`associate-r`
50038×	`log-prod`
45974×	`times-frac`

Stop Event

1×	unsound
5×	done
28×	saturated
23×	fuel
100×	node limit

Counts

35329 → 35154

Compiler

Compiled 4482 to 3002 computations (33% saved)

regimes18.9s (5.1%)

Counts

4573 → 400

Calls

43 calls:

5.1s	x
3.6s	eps
2.8s	c
1.0s	b
939.0ms	a

Compiler

Compiled 51880 to 27978 computations (46.1% saved)

rewrite18.5s (5%)

Algorithm

101×	batch-egg-rewrite

Rules

61886×	`pow1`
58616×	`add-exp-log`
58556×	`log1p-expm1-u`
58518×	`expm1-log1p-u`
55008×	`add-log-exp`

Stop Event

101×	node limit

Counts

731 → 24813

prune17.2s (4.7%)

Counts: 52875 → 2128
Compiler: Compiled 108838 to 73687 computations (32.3% saved)

bsearch8.7s (2.4%)

Algorithm

149×	binary-search
52×	left-value

Stop Event

145×	narrow-enough
4×	predicate-same

Results

3.2s	4368×	body	1024	valid
2.7s	13274×	body	256	valid
933.0ms	942×	body	2048	valid
530.0ms	1398×	body	512	valid
215.0ms	1543×	body	256	invalid
190.0ms	574×	body	256	infinite
118.0ms	108×	body	1024	infinite
67.0ms	260×	body	256	unsamplable
58.0ms	87×	body	512	infinite
29.0ms	1×	body	4096	valid
7.0ms	17×	body	1024	unsamplable
4.0ms	5×	body	2048	unsamplable
1.0ms	1×	body	512	unsamplable

Compiler

Compiled 34387 to 25144 computations (26.9% saved)

preprocess8.5s (2.3%)

Algorithm

28×	egg-herbie

Rules

42740×	`fma-def`
13078×	`fma-neg`
9294×	`associate-/r*`
9220×	`div-sub`
9054×	`distribute-rgt-in`

Stop Event

13×	saturated
15×	node limit

Compiler

Compiled 10317 to 6030 computations (41.6% saved)

series6.6s (1.8%)

Counts

731 → 10516

Calls

3420 calls:

Time	Variable		Point	Expression
449.0ms	x	@	inf	(-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x))
195.0ms	eps	@	inf	(/.f64 eps (/.f64 (expm1.f64 (*.f64 a eps)) (pow.f64 (exp.f64 eps) a)))
161.0ms	x	@	-inf	(-.f64 1 (pow.f64 x (/.f64 1 n)))
112.0ms	eps	@	inf	(log.f64 (sqrt.f64 (exp.f64 (+.f64 (tan.f64 (+.f64 eps x)) (tan.f64 x)))))
112.0ms	eps	@	-inf	(log.f64 (+.f64 1 (expm1.f64 (*.f64 (tan.f64 x) (tan.f64 eps)))))

analyze5.2s (1.4%)

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	90.9%	9.1%	0%	0%	0%	0
27.4%	24.9%	66%	9.1%	0%	0%	0%	1
39%	34.7%	54.4%	9.1%	0%	1.8%	0%	2
51%	44.1%	42.4%	9.1%	0%	4.5%	0%	3
58.9%	50.1%	35%	9.1%	0%	5.8%	0%	4
65.5%	55%	29%	9.1%	0%	6.9%	0%	5
67.8%	56.6%	26.9%	9.1%	0%	7.5%	0%	6
70.2%	57.8%	24.6%	9.1%	0%	8.4%	0.1%	7
72.2%	59.3%	22.8%	9.1%	0%	8.7%	0.1%	8
73.5%	60%	21.6%	9.1%	0%	9.1%	0.3%	9
74.7%	60.5%	20.4%	9.1%	0%	9.7%	0.3%	10
76.2%	61.5%	19.2%	9.1%	0%	9.9%	0.4%	11
76.9%	61.8%	18.5%	9.1%	0%	10.2%	0.4%	12

Compiler

Compiled 375 to 278 computations (25.9% saved)

Herbie run

sample2.0min (32%)

soundness54.8s (14.9%)

localize47.8s (13%)

eval37.2s (10.1%)

simplify26.5s (7.2%)

regimes18.9s (5.1%)

rewrite18.5s (5%)

prune17.2s (4.7%)

bsearch8.7s (2.4%)

preprocess8.5s (2.3%)

series6.6s (1.8%)

analyze5.2s (1.4%)

end6.0ms (0%)

Profiling