Metrics for Herbie run

Date:	Tuesday, December 5th, 2023
Commit:	6cf4bbde on zane-regimes
Hostname:	nightly with Racket 8.6
Seed:	2023339
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.4min (30.4%)

Results

29.2s	34749×	body	2048	valid
22.4s	58418×	body	1024	valid
12.6s	94278×	body	256	valid
7.6s	33555×	body	512	valid
7.1s	42617×	body	256	precondition
1.1s	2066×	body	4096	valid
1.0s	4200×	body	256	infinite
942.0ms	1223×	body	1024	invalid
554.0ms	5051×	body	256	invalid
493.0ms	4010×	body	256	unsamplable
301.0ms	606×	body	512	invalid
145.0ms	160×	body	1024	infinite
78.0ms	171×	body	512	infinite
10.0ms	8×	body	2048	invalid
1.0ms	2×	body	2048	infinite

Bogosity

soundness39.0s (14.1%)

Rules

135982×	`fma-def`
67574×	`fma-neg`
60746×	`associate-r`
58902×	`times-frac`
56732×	`log-prod`

Stop Event

3×	saturated
193×	node limit

Compiler

Compiled 21061 to 13610 computations (35.4% saved)

localize35.2s (12.7%)

Compiler: Compiled 12098 to 6896 computations (43% saved)

eval32.8s (11.9%)

Compiler: Compiled 1322662 to 852872 computations (35.5% saved)

simplify18.4s (6.7%)

Algorithm

113×	egg-herbie

Rules

68582×	`fma-def`
41460×	`associate-r`
40040×	`associate-l`
36718×	`log-prod`
35378×	`fma-neg`

Stop Event

1×	unsound
6×	done
27×	saturated
21×	fuel
85×	node limit

Counts

34136 → 32178

Compiler

Compiled 4132 to 2856 computations (30.9% saved)

regimes16.6s (6%)

Counts

4969 → 353

Calls

42 calls:

3.4s	eps
3.3s	x
2.0s	b
1.4s	a
920.0ms	c

Compiler

Compiled 59772 to 34545 computations (42.2% saved)

prune16.1s (5.8%)

Counts: 54824 → 2239
Compiler: Compiled 123604 to 85992 computations (30.4% saved)

rewrite12.8s (4.6%)

Algorithm

86×	batch-egg-rewrite

Rules

42855×	`log1p-expm1-u`
36071×	`expm1-log1p-u`
35180×	`prod-diff`
31250×	`expm1-udef`
25862×	`log-prod`

Stop Event

86×	node limit

Counts

649 → 24888

preprocess9.7s (3.5%)

Algorithm

27×	egg-herbie

Rules

33026×	`fma-def`
11878×	`fma-neg`
11256×	`div-sub`
9110×	`sub-neg`
7920×	`distribute-lft-neg-in`

Stop Event

13×	saturated
14×	node limit

Compiler

Compiled 10850 to 6458 computations (40.5% saved)

series5.3s (1.9%)

Counts

649 → 9248

Calls

2946 calls:

Time	Variable		Point	Expression
280.0ms	x	@	inf	(-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x))
115.0ms	eps	@	-inf	(log.f64 (sin.f64 (*.f64 1/2 (fma.f64 2 x eps))))
105.0ms	b	@	0	(/.f64 (+.f64 b (pow.f64 (pow.f64 (.f64 (.f64 a -4) c) 1/4) 2)) a)
103.0ms	c	@	0	(exp.f64 (.f64 1/4 (+.f64 (log.f64 c) (log.f64 (.f64 -4 a)))))
101.0ms	x	@	inf	(-.f64 (sqrt.f64 (+.f64 1 x)) (sqrt.f64 x))

bsearch4.3s (1.6%)

Algorithm

124×	binary-search
48×	left-value

Stop Event

122×	narrow-enough
2×	predicate-same

Results

1.6s	10717×	body	256	valid
1.1s	2596×	body	1024	valid
473.0ms	1374×	body	512	valid
350.0ms	596×	body	2048	valid
237.0ms	1834×	body	256	invalid
164.0ms	834×	body	256	infinite
27.0ms	35×	body	1024	infinite
18.0ms	40×	body	512	infinite
7.0ms	43×	body	256	unsamplable

Compiler

Compiled 27154 to 19963 computations (26.5% saved)

analyze2.0s (0.7%)

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	82.9%	17.1%	0%	0%	0%	0
24.4%	20.2%	62.6%	17.1%	0%	0%	0%	1
36.2%	28.7%	50.6%	17.1%	0%	3.6%	0%	2
48.8%	38%	39.9%	17.6%	0%	4.5%	0%	3
56%	43.3%	33.9%	17.9%	0%	4.9%	0%	4
63%	47.8%	28.1%	18.5%	0%	5.6%	0%	5
65.2%	49%	26.2%	18.9%	0%	5.9%	0%	6
68%	50.3%	23.7%	19.1%	0%	6.7%	0.1%	7
70.3%	51.8%	21.8%	19.4%	0%	6.9%	0.1%	8
72%	52.5%	20.4%	19.5%	0%	7.3%	0.3%	9
73.4%	52.9%	19.2%	19.7%	0%	7.9%	0.3%	10
75.2%	53.9%	17.8%	19.8%	0%	8.1%	0.4%	11
76%	54.2%	17.1%	19.8%	0%	8.5%	0.4%	12

Compiler

Compiled 409 to 297 computations (27.4% saved)

Herbie run

sample1.4min (30.4%)

soundness39.0s (14.1%)

localize35.2s (12.7%)

eval32.8s (11.9%)

simplify18.4s (6.7%)

regimes16.6s (6%)

prune16.1s (5.8%)

rewrite12.8s (4.6%)

preprocess9.7s (3.5%)

series5.3s (1.9%)

bsearch4.3s (1.6%)

analyze2.0s (0.7%)

end3.0ms (0%)

Profiling