Metrics for Herbie run

Date:	Friday, January 19th, 2024
Commit:	4a418bc7 on main
Hostname:	nightly with Racket 8.6
Seed:	2024019
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.8min (33.9%)

Results

34.7s	32945×	body	2048	valid
24.2s	54234×	body	1024	valid
17.1s	96653×	body	256	valid
15.8s	63634×	body	256	precondition
12.7s	40925×	body	512	valid
1.4s	1848×	body	4096	valid
1.0s	1097×	body	1024	invalid
991.0ms	4239×	body	256	infinite
685.0ms	5255×	body	256	invalid
476.0ms	3915×	body	256	unsamplable
225.0ms	562×	body	512	invalid
154.0ms	132×	body	1024	infinite
125.0ms	192×	body	512	infinite

Bogosity

localize43.5s (13.4%)

Compiler: Compiled 14086 to 7794 computations (44.7% saved)

soundness39.9s (12.2%)

Rules

122616×	`fma-def`
78408×	`times-frac`
68442×	`fma-neg`
67478×	`associate-r`
55990×	`log-prod`

Stop Event

2×	saturated
184×	node limit

Compiler

Compiled 17392 to 11891 computations (31.6% saved)

eval34.8s (10.7%)

Compiler: Compiled 1414895 to 885741 computations (37.4% saved)

simplify22.9s (7%)

Algorithm

124×	egg-herbie

Rules

71928×	`fma-def`
46422×	`times-frac`
45440×	`associate-r`
44698×	`fma-neg`
42658×	`associate-l`

Stop Event

1×	unsound
4×	done
28×	saturated
24×	fuel
95×	node limit

Counts

38811 → 37374

Compiler

Compiled 3403 to 2391 computations (29.7% saved)

rewrite20.7s (6.4%)

Algorithm

96×	batch-egg-rewrite

Rules

55988×	`log1p-expm1-u`
42320×	`expm1-log1p-u`
36302×	`expm1-udef`
36242×	`prod-diff`
31224×	`log1p-udef`

Stop Event

96×	node limit

Counts

756 → 27756

prune16.5s (5.1%)

Counts: 58386 → 2361
Compiler: Compiled 119646 to 85363 computations (28.7% saved)

regimes12.3s (3.8%)

Counts

3773 → 329

Calls

43 calls:

3.4s	x
2.1s	eps
893.0ms	a
893.0ms	c
709.0ms	b

Compiler

Compiled 43392 to 26344 computations (39.3% saved)

preprocess11.7s (3.6%)

Algorithm

28×	egg-herbie

Rules

34252×	`fma-def`
12020×	`fma-neg`
11952×	`div-sub`
9422×	`sub-neg`
8120×	`distribute-lft-neg-in`

Stop Event

13×	saturated
15×	node limit

Compiler

Compiled 10616 to 6587 computations (38% saved)

bsearch5.3s (1.6%)

Algorithm

129×	binary-search
25×	left-value

Stop Event

128×	narrow-enough
1×	predicate-same

Results

1.9s	9460×	body	256	valid
1.1s	1784×	body	1024	valid
620.0ms	1847×	body	512	valid
488.0ms	771×	body	2048	valid
372.0ms	1419×	body	256	infinite
222.0ms	1436×	body	256	invalid
79.0ms	90×	body	1024	infinite
50.0ms	278×	body	256	unsamplable
26.0ms	45×	body	512	infinite
5.0ms	8×	body	4096	valid

Compiler

Compiled 21219 to 16047 computations (24.4% saved)

series5.1s (1.6%)

Counts

756 → 11055

Calls

3405 calls:

Time	Variable		Point	Expression
344.0ms	x	@	inf	(-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x))
116.0ms	N	@	inf	(*.f64 (pow.f64 (atan2.f64 1 (fma.f64 N (+.f64 1 N) 1)) 1/4) (sqrt.f64 (atan2.f64 1 (fma.f64 N (+.f64 1 N) 1))))
105.0ms	N	@	inf	(pow.f64 (pow.f64 (cbrt.f64 (atan2.f64 1 (fma.f64 N (+.f64 1 N) 1))) 4) 2/3)
82.0ms	eps	@	0	(pow.f64 (cbrt.f64 (-.f64 (tan.f64 (+.f64 x eps)) (tan.f64 x))) 3)
81.0ms	c	@	0	(-.f64 (exp.f64 (log1p.f64 (.f64 -1 (/.f64 (.f64 a (/.f64 c b)) a)))) 1)

analyze2.9s (0.9%)

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	83%	17%	0%	0%	0%	0
26.9%	22.3%	60.7%	17%	0%	0%	0%	1
40.4%	32.1%	47.3%	17%	0%	3.6%	0%	2
51.4%	40.3%	38.2%	17%	0%	4.5%	0%	3
58.2%	45.4%	32.6%	17.2%	0%	4.9%	0%	4
64.1%	49.5%	27.7%	17.2%	0%	5.6%	0%	5
66.1%	50.6%	25.9%	17.5%	0%	5.9%	0%	6
68.8%	51.8%	23.5%	17.9%	0%	6.7%	0.1%	7
71%	53.1%	21.7%	18.1%	0%	6.9%	0.1%	8
72.6%	53.8%	20.3%	18.2%	0%	7.3%	0.3%	9
74%	54.3%	19.1%	18.4%	0%	7.9%	0.3%	10
75.7%	55.2%	17.8%	18.5%	0%	8.1%	0.4%	11
76.5%	55.5%	17.1%	18.6%	0%	8.5%	0.4%	12

Compiler

Compiled 408 to 294 computations (27.9% saved)

Herbie run

sample1.8min (33.9%)

localize43.5s (13.4%)

soundness39.9s (12.2%)

eval34.8s (10.7%)

simplify22.9s (7%)

rewrite20.7s (6.4%)

prune16.5s (5.1%)

regimes12.3s (3.8%)

preprocess11.7s (3.6%)

bsearch5.3s (1.6%)

series5.1s (1.6%)

analyze2.9s (0.9%)

end5.0ms (0%)

Profiling