Metrics for Herbie run

Date:	Saturday, December 9th, 2023
Commit:	665878db on main
Hostname:	nightly with Racket 8.6
Seed:	2023343
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.6min (31.8%)

Results

34.9s	38076×	body	2048	valid
22.9s	58369×	body	1024	valid
13.8s	94460×	body	256	valid
10.9s	62553×	body	256	precondition
7.9s	33358×	body	512	valid
1.6s	2297×	body	4096	valid
1.0s	1251×	body	1024	invalid
824.0ms	4255×	body	256	infinite
702.0ms	5223×	body	256	invalid
432.0ms	3903×	body	256	unsamplable
266.0ms	624×	body	512	invalid
142.0ms	157×	body	1024	infinite
89.0ms	192×	body	512	infinite
5.0ms	4×	body	2048	invalid
3.0ms	2×	body	8192	valid
1.0ms	2×	body	2048	infinite

Bogosity

soundness44.4s (14.7%)

Rules

144784×	`fma-def`
79284×	`fma-neg`
72038×	`associate-r`
65682×	`times-frac`
57504×	`log-prod`

Stop Event

3×	saturated
224×	node limit

Compiler

Compiled 20518 to 12879 computations (37.2% saved)

localize38.8s (12.9%)

Compiler: Compiled 14145 to 7823 computations (44.7% saved)

eval34.1s (11.3%)

Compiler: Compiled 1495139 to 913960 computations (38.9% saved)

simplify19.5s (6.5%)

Algorithm

122×	egg-herbie

Rules

77822×	`fma-def`
40206×	`associate-r`
40150×	`fma-neg`
39202×	`distribute-lft-in`
37960×	`times-frac`

Stop Event

6×	done
1×	unsound
28×	saturated
22×	fuel
93×	node limit

Counts

36577 → 36067

Compiler

Compiled 4673 to 3265 computations (30.1% saved)

regimes16.4s (5.4%)

Counts

4943 → 421

Calls

43 calls:

3.8s	x
3.3s	eps
1.4s	c
1.1s	a
936.0ms	(/.f64 1 n)

Compiler

Compiled 55625 to 32588 computations (41.4% saved)

prune15.4s (5.1%)

Counts: 58264 → 2252
Compiler: Compiled 113870 to 80462 computations (29.3% saved)

rewrite13.6s (4.5%)

Algorithm

94×	batch-egg-rewrite

Rules

52341×	`log1p-expm1-u`
45098×	`prod-diff`
41378×	`expm1-log1p-u`
31560×	`expm1-udef`
27370×	`log1p-udef`

Stop Event

94×	node limit

Counts

727 → 26010

preprocess10.7s (3.5%)

Algorithm

28×	egg-herbie

Rules

34252×	`fma-def`
11926×	`fma-neg`
11896×	`div-sub`
9418×	`sub-neg`
8164×	`distribute-lft-neg-in`

Stop Event

13×	saturated
15×	node limit

Compiler

Compiled 13056 to 8064 computations (38.2% saved)

bsearch6.1s (2%)

Algorithm

163×	binary-search
54×	left-value

Stop Event

161×	narrow-enough
2×	predicate-same

Results

2.0s	13658×	body	256	valid
1.6s	3606×	body	1024	valid
764.0ms	1072×	body	2048	valid
705.0ms	2089×	body	512	valid
259.0ms	1785×	body	256	invalid
149.0ms	710×	body	256	infinite
61.0ms	64×	body	1024	infinite
32.0ms	195×	body	256	unsamplable
2.0ms	1×	body	4096	valid

Compiler

Compiled 34694 to 25974 computations (25.1% saved)

series4.5s (1.5%)

Counts

727 → 10567

Calls

3318 calls:

Time	Variable		Point	Expression
385.0ms	x	@	inf	(-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x))
79.0ms	c	@	inf	(.f64 a (/.f64 2 (+.f64 b (hypot.f64 b (sqrt.f64 (.f64 c (*.f64 a -4)))))))
78.0ms	a	@	inf	(cbrt.f64 (pow.f64 (pow.f64 (expm1.f64 (*.f64 a x)) 5/6) 3))
73.0ms	n	@	inf	(/.f64 (-.f64 (log1p.f64 x) (log.f64 x)) n)
65.0ms	c	@	0	(+.f64 (neg.f64 b) (pow.f64 (cbrt.f64 (sqrt.f64 (fma.f64 b b (.f64 (.f64 -4 c) a)))) 3))

analyze2.3s (0.8%)

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	83%	17%	0%	0%	0%	0
25.8%	21.4%	61.5%	17%	0%	0%	0%	1
37.6%	29.9%	49.5%	17%	0%	3.6%	0%	2
50%	39.2%	39.3%	17%	0%	4.5%	0%	3
57.1%	44.5%	33.5%	17.2%	0%	4.9%	0%	4
63.5%	49%	28.2%	17.2%	0%	5.6%	0%	5
65.6%	50.2%	26.3%	17.5%	0%	5.9%	0%	6
68.5%	51.5%	23.7%	17.9%	0%	6.7%	0.1%	7
70.8%	53%	21.9%	18.1%	0%	6.9%	0.1%	8
72.4%	53.7%	20.5%	18.2%	0%	7.3%	0.3%	9
73.8%	54.1%	19.2%	18.4%	0%	7.9%	0.3%	10
75.5%	55.1%	17.9%	18.5%	0%	8.1%	0.4%	11
76.4%	55.4%	17.2%	18.6%	0%	8.5%	0.4%	12

Compiler

Compiled 408 to 294 computations (27.9% saved)

Herbie run

sample1.6min (31.8%)

soundness44.4s (14.7%)

localize38.8s (12.9%)

eval34.1s (11.3%)

simplify19.5s (6.5%)

regimes16.4s (5.4%)

prune15.4s (5.1%)

rewrite13.6s (4.5%)

preprocess10.7s (3.5%)

bsearch6.1s (2%)

series4.5s (1.5%)

analyze2.3s (0.8%)

end4.0ms (0%)

Profiling