Metrics for Herbie run

Date:	Friday, October 20th, 2023
Commit:	21d611eb on main
Hostname:	nightly with Racket 8.6
Seed:	2023293
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

series2.5min (37%)

Counts

726 → 10566

Calls

3410 calls:

Time	Variable		Point	Expression
2.4min	x	@	inf	(pow.f64 (pow.f64 (-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x)) 3) 1/3)
280.0ms	x	@	inf	(-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x))
91.0ms	x	@	inf	(pow.f64 (sqrt.f64 (-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x))) 2)
69.0ms	N	@	-inf	(pow.f64 (pow.f64 (atan2.f64 1 (+.f64 1 (fma.f64 N N N))) 2) 1/4)
68.0ms	a	@	inf	(log.f64 (expm1.f64 (*.f64 a x)))

Results

sample1.3min (19%)

Results

27.2s	33246×	body	2048	valid
24.2s	63022×	body	1024	valid
10.3s	86765×	body	256	valid
7.6s	32777×	body	512	valid
1.4s	13060×	body	256	infinite
1.3s	1977×	body	4096	valid
813.0ms	1131×	body	1024	invalid
807.0ms	7413×	body	256	unsamplable
498.0ms	5058×	body	256	invalid
327.0ms	169×	body	512	infinite
221.0ms	592×	body	512	invalid
173.0ms	481×	body	1024	unsamplable
146.0ms	281×	body	2048	unsamplable
123.0ms	147×	body	1024	infinite
48.0ms	205×	body	512	unsamplable
6.0ms	3×	body	8192	valid
3.0ms	3×	body	2048	invalid
2.0ms	2×	body	2048	infinite

Bogosity

soundness40.6s (10.2%)

Rules

171382×	`fma-def`
85660×	`fma-neg`
84444×	`associate-r`
81628×	`times-frac`
81132×	`log-prod`

Stop Event

1×	saturated
219×	node limit

Compiler

Compiled 19769 to 11785 computations (40.4% saved)

localize32.6s (8.2%)

Compiler: Compiled 13436 to 6808 computations (49.3% saved)

rewrite23.8s (6%)

Algorithm

92×	batch-egg-rewrite

Rules

60700×	`pow1`
57370×	`add-exp-log`
57354×	`log1p-expm1-u`
57320×	`expm1-log1p-u`
52194×	`add-log-exp`

Stop Event

92×	node limit

Counts

726 → 22433

eval23.0s (5.8%)

Compiler: Compiled 1147230 to 652997 computations (43.1% saved)

simplify15.6s (3.9%)

Algorithm

119×	egg-herbie

Rules

73720×	`fma-def`
48628×	`associate-r`
45678×	`associate-l`
45270×	`fma-neg`
43970×	`times-frac`

Stop Event

5×	done
27×	saturated
22×	fuel
92×	node limit

Counts

32999 → 32708

Compiler

Compiled 3972 to 2695 computations (32.2% saved)

prune11.8s (3%)

Counts: 48476 → 2135
Compiler: Compiled 113322 to 78515 computations (30.7% saved)

regimes11.7s (2.9%)

Counts

3895 → 362

Calls

42 calls:

2.9s	x
1.6s	eps
1.6s	a
881.0ms	c
800.0ms	(/.f64 1 n)

Compiler

Compiled 43945 to 24541 computations (44.2% saved)

preprocess8.9s (2.2%)

Algorithm

28×	egg-herbie

Rules

42740×	`fma-def`
13078×	`fma-neg`
9294×	`associate-/r*`
9220×	`div-sub`
9054×	`distribute-rgt-in`

Stop Event

13×	saturated
15×	node limit

Compiler

Compiled 10928 to 6276 computations (42.6% saved)

bsearch4.7s (1.2%)

Algorithm

147×	binary-search
30×	left-value

Stop Event

145×	narrow-enough
2×	predicate-same

Results

1.8s	13297×	body	256	valid
1.2s	2915×	body	1024	valid
479.0ms	1398×	body	512	valid
359.0ms	1214×	body	256	infinite
274.0ms	464×	body	2048	valid
113.0ms	1204×	body	256	invalid
74.0ms	96×	body	512	infinite
69.0ms	82×	body	1024	infinite
31.0ms	8×	body	1024	unsamplable
10.0ms	48×	body	256	unsamplable
3.0ms	6×	body	4096	valid
2.0ms	4×	body	2048	unsamplable
0.0ms	1×	body	512	unsamplable

Compiler

Compiled 28414 to 20950 computations (26.3% saved)

analyze2.4s (0.6%)

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	90.9%	9.1%	0%	0%	0%	0
27.4%	24.9%	66%	9.1%	0%	0%	0%	1
39%	34.7%	54.4%	9.1%	0%	1.8%	0%	2
51%	44.1%	42.4%	9.1%	0%	4.5%	0%	3
58.9%	50.1%	35%	9.1%	0%	5.8%	0%	4
65.5%	55%	29%	9.1%	0%	6.9%	0%	5
67.8%	56.6%	26.9%	9.1%	0%	7.5%	0%	6
70.2%	57.8%	24.6%	9.1%	0%	8.4%	0.1%	7
72.2%	59.3%	22.8%	9.1%	0%	8.7%	0.1%	8
73.5%	60%	21.6%	9.1%	0%	9.1%	0.3%	9
74.7%	60.5%	20.4%	9.1%	0%	9.7%	0.3%	10
76.2%	61.5%	19.2%	9.1%	0%	9.9%	0.4%	11
76.9%	61.8%	18.5%	9.1%	0%	10.2%	0.4%	12

Compiler

Compiled 375 to 278 computations (25.9% saved)

Herbie run

series2.5min (37%)

sample1.3min (19%)

soundness40.6s (10.2%)

localize32.6s (8.2%)

rewrite23.8s (6%)

eval23.0s (5.8%)

simplify15.6s (3.9%)

prune11.8s (3%)

regimes11.7s (2.9%)

preprocess8.9s (2.2%)

bsearch4.7s (1.2%)

analyze2.4s (0.6%)

end3.0ms (0%)

Profiling