Metrics for Herbie run

Date:	Tuesday, November 14th, 2023
Commit:	71362506 on hamming-cleanup
Hostname:	nightly with Racket 8.6
Seed:	2023318
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample23.7min (21.8%)

Results

8.9min	3438926×	body	256	valid
3.9min	47025×	body	8192	exit
2.8min	277867×	body	1024	valid
1.7min	102110×	body	2048	valid
1.3min	515554×	body	256	infinite
1.0min	14471×	body	4096	valid
57.9s	348378×	body	256	precondition
51.5s	150464×	body	512	valid
45.1s	258563×	body	256	invalid
29.4s	2362×	body	8192	valid
14.9s	20457×	body	1024	infinite
8.6s	46345×	body	256	unsamplable
7.6s	16231×	body	1024	invalid
6.7s	1249×	body	4096	infinite
5.2s	1627×	body	2048	infinite
5.2s	11099×	body	512	infinite
2.6s	8791×	body	512	invalid
2.0s	5400×	body	2048	invalid
491.0ms	26×	body	8192	infinite
10.0ms	7×	body	1024	unsamplable
4.0ms	6×	body	512	unsamplable
3.0ms	14×	body	4096	invalid
3.0ms	1×	body	8192	invalid

Bogosity

localize20.5min (19%)

Results

Compiler

Compiled 449511 to 198076 computations (55.9% saved)

soundness13.8min (12.7%)

Rules

2437278×	`fma-def`
1388282×	`associate-r`
1248054×	`times-frac`
1174134×	`log-prod`
1078160×	`fma-neg`

Stop Event

35×	unsound
126×	saturated
3488×	node limit

Compiler

Compiled 322409 to 183295 computations (43.1% saved)

eval10.2min (9.4%)

Compiler: Compiled 35014153 to 17469054 computations (50.1% saved)

regimes9.0min (8.3%)

Counts

86733 → 9427

Calls

1179 calls:

52.6s	x
48.9s	y
41.7s	z
36.8s	t
32.6s	a

Results

Compiler

Compiled 1491167 to 803877 computations (46.1% saved)

series7.5min (6.9%)

Counts

13394 → 306567

Calls

81758 calls:

Time	Variable		Point	Expression
3.7min	x	@	inf	(-.f64 (pow.f64 (cbrt.f64 (+.f64 1 x)) 3/2) (pow.f64 (cbrt.f64 x) 3/2))
2.5min	x	@	inf	(pow.f64 (-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x)) 3)
1.1s	lo	@	inf	(sqrt.f64 (pow.f64 (+.f64 (/.f64 hi lo) -1) -2))
477.0ms	x	@	0	(pow.f64 x 1/6)
462.0ms	x	@	-inf	(pow.f64 (cbrt.f64 (/.f64 1 (-.f64 (pow.f64 (+.f64 x eps) 5) (pow.f64 x 5)))) 3)

Results

simplify7.0min (6.5%)

Algorithm

2254×

egg-herbie

Rules

1305244×	`fma-def`
875374×	`log-prod`
856346×	`associate-r`
776476×	`times-frac`
737490×	`associate-l`

Stop Event

22×	unsound
545×	saturated
141×	done
403×	fuel
1687×	node limit

Counts

764836 → 606595

Compiler

Compiled 126366 to 79371 computations (37.2% saved)

prune4.6min (4.2%)

Counts: 936930 → 35089
Compiler: Compiled 2617541 to 1765477 computations (32.6% saved)

rewrite4.2min (3.8%)

Algorithm

1710×

batch-egg-rewrite

Rules

978905×	`log1p-expm1-u`
766756×	`expm1-log1p-u`
574460×	`expm1-udef`
561782×	`prod-diff`
555492×	`log-prod`

Stop Event

14×	unsound
1696×	node limit

Counts

13394 → 458269

preprocess3.8min (3.5%)

Algorithm

549×	egg-herbie

Rules

720868×	`fma-def`
266668×	`fma-neg`
215556×	`sub-neg`
202998×	`div-sub`
199368×	`unsub-neg`

Stop Event

213×	saturated
336×	node limit

Compiler

Compiled 340371 to 173972 computations (48.9% saved)

bsearch2.4min (2.2%)

Algorithm

4860×	binary-search
530×	left-value

Stop Event

4722×	narrow-enough
138×	predicate-same

Results

1.2min	440839×	body	256	valid
27.8s	106442×	body	256	infinite
15.2s	22796×	body	1024	valid
4.7s	12369×	body	512	valid
3.0s	3793×	body	2048	valid
2.5s	4214×	body	1024	infinite
2.5s	16809×	body	256	invalid
1.9s	2046×	body	4096	valid
635.0ms	1570×	body	512	infinite
514.0ms	401×	body	8192	valid
323.0ms	555×	body	1024	invalid
208.0ms	195×	body	2048	infinite
85.0ms	70×	body	2048	invalid
64.0ms	263×	body	512	invalid
40.0ms	7×	body	4096	infinite
8.0ms	59×	body	256	unsamplable

Compiler

Compiled 1165136 to 860956 computations (26.1% saved)

analyze1.8min (1.6%)

Algorithm

553×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	85.3%	14.7%	0%	0%	0%	0
39.6%	33.8%	51.5%	14.7%	0%	0%	0%	1
45.6%	38.6%	46.1%	14.7%	0%	0.5%	0%	2
55.6%	46.1%	36.8%	15.3%	0%	1.8%	0%	3
61.6%	50.8%	31.6%	15.3%	0%	2.3%	0%	4
67.5%	55.2%	26.6%	15.5%	0%	2.7%	0%	5
71.3%	57.9%	23.4%	15.6%	0%	3.1%	0%	6
75.3%	60.5%	19.9%	15.7%	0%	4%	0%	7
77.1%	61.6%	18.3%	15.7%	0%	4.3%	0%	8
79.7%	63.3%	16.1%	15.7%	0%	4.7%	0.1%	9
81.3%	64.2%	14.8%	15.8%	0%	5.2%	0.1%	10
83.6%	65.7%	12.9%	15.8%	0%	5.5%	0.1%	11
84.7%	66.3%	12%	15.8%	0%	5.8%	0.1%	12

Compiler

Compiled 13609 to 8801 computations (35.3% saved)

Herbie run

sample23.7min (21.8%)

localize20.5min (19%)

soundness13.8min (12.7%)

eval10.2min (9.4%)

regimes9.0min (8.3%)

series7.5min (6.9%)

simplify7.0min (6.5%)

prune4.6min (4.2%)

rewrite4.2min (3.8%)

preprocess3.8min (3.5%)

bsearch2.4min (2.2%)

analyze1.8min (1.6%)

end112.0ms (0%)

Profiling