Metrics for Herbie run

Date:	Wednesday, July 19th, 2023
Commit:	687f458a on main
Hostname:	nightly with Racket 8.6
Seed:	2023200
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample22.3min (24.8%)

Results

8.4min	3332739×	body	256	valid
3.9min	47177×	body	8192	exit
2.8min	275528×	body	1024	valid
1.7min	97815×	body	2048	valid
1.3min	522617×	body	256	infinite
1.1min	14387×	body	4096	valid
52.0s	149074×	body	512	valid
44.6s	256343×	body	256	invalid
29.3s	2383×	body	8192	valid
14.4s	20019×	body	1024	infinite
9.4s	49927×	body	256	unsamplable
7.0s	15831×	body	1024	invalid
6.5s	1207×	body	4096	infinite
5.3s	1646×	body	2048	infinite
4.8s	11475×	body	512	infinite
2.7s	8876×	body	512	invalid
1.9s	5260×	body	2048	invalid
920.0ms	3037×	body	256	precondition
250.0ms	16×	body	8192	infinite
196.0ms	347×	body	2048	unsamplable
157.0ms	432×	body	1024	unsamplable
57.0ms	248×	body	512	unsamplable
6.0ms	11×	body	4096	invalid
5.0ms	2×	body	8192	invalid

Bogosity

localize18.7min (20.7%)

Results

Compiler

Compiled 385412 to 181896 computations (52.8% saved)

soundness11.5min (12.7%)

Rules

2700456×	`fma-def`
1615402×	`associate-r`
1355426×	`log-prod`
1315898×	`associate-l`
1248482×	`times-frac`

Stop Event

23×	unsound
220×	saturated
3539×	node limit

Compiler

Compiled 337754 to 196384 computations (41.9% saved)

eval8.4min (9.3%)

Compiler: Compiled 27483843 to 14969356 computations (45.5% saved)

regimes8.2min (9.1%)

Counts

87038 → 9715

Calls

1149 calls:

52.5s	x
43.8s	y
40.5s	z
33.0s	t
32.2s	a

Compiler

Compiled 1327618 to 705609 computations (46.9% saved)

simplify6.5min (7.2%)

Algorithm

2756×

egg-herbie

Rules

1863448×	`fma-def`
1061042×	`associate-r`
916604×	`log-prod`
914514×	`associate-l`
876620×	`fma-neg`

Stop Event

11×	unsound
813×	saturated
128×	done
404×	fuel
1932×	node limit

Counts

746397 → 586657

Compiler

Compiled 126359 to 79268 computations (37.3% saved)

prune4.2min (4.6%)

Counts: 876300 → 36196
Compiler: Compiled 2391053 to 1629526 computations (31.8% saved)

rewrite3.3min (3.7%)

Algorithm

1688×

batch-egg-rewrite

Rules

1117566×	`pow1`
1055774×	`add-exp-log`
1054714×	`log1p-expm1-u`
1054540×	`expm1-log1p-u`
1000374×	`add-log-exp`

Stop Event

9×	unsound
1679×	node limit

Counts

13690 → 422462

bsearch2.5min (2.8%)

Algorithm

5033×	binary-search
564×	left-value

Stop Event

4916×	narrow-enough
117×	predicate-same

Results

1.3min	456047×	body	256	valid
23.1s	101819×	body	256	infinite
20.2s	26620×	body	1024	valid
5.7s	15538×	body	512	valid
4.9s	32086×	body	256	invalid
3.2s	4347×	body	2048	valid
2.7s	5581×	body	1024	infinite
1.5s	1485×	body	4096	valid
940.0ms	2717×	body	512	infinite
389.0ms	726×	body	1024	invalid
164.0ms	253×	body	2048	invalid
128.0ms	129×	body	2048	infinite
112.0ms	395×	body	512	invalid
68.0ms	85×	body	8192	valid
47.0ms	32×	body	4096	infinite
8.0ms	78×	body	256	unsamplable

Compiler

Compiled 1186556 to 867463 computations (26.9% saved)

preprocess1.9min (2.2%)

Algorithm

536×	egg-herbie

Rules

704136×	`fma-def`
261454×	`fma-neg`
211808×	`sub-neg`
201670×	`div-sub`
191518×	`unsub-neg`

Stop Event

208×	saturated
328×	node limit

Compiler

Compiled 290151 to 151526 computations (47.8% saved)

analyze1.4min (1.5%)

Algorithm

540×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	86.8%	13.2%	0%	0%	0%	0
40.5%	35.1%	51.6%	13.2%	0%	0%	0%	1
46.5%	40.1%	46.1%	13.3%	0%	0.6%	0%	2
56.2%	47.7%	37.3%	13.3%	0%	1.8%	0%	3
62.2%	52.5%	31.9%	13.3%	0%	2.4%	0%	4
67.9%	57%	27%	13.3%	0%	2.7%	0%	5
71.6%	59.8%	23.7%	13.3%	0%	3.2%	0%	6
75.5%	62.4%	20.3%	13.3%	0%	4.1%	0%	7
77.3%	63.6%	18.7%	13.3%	0%	4.4%	0%	8
79.8%	65.3%	16.5%	13.3%	0%	4.9%	0.1%	9
81.4%	66.2%	15.1%	13.3%	0%	5.3%	0.1%	10
83.6%	67.7%	13.3%	13.3%	0%	5.7%	0.1%	11
84.7%	68.3%	12.3%	13.3%	0%	6%	0.1%	12

Compiler

Compiled 11868 to 8225 computations (30.7% saved)

series1.2min (1.4%)

Counts

13690 → 323399

Calls

83343 calls:

Time	Variable		Point	Expression
471.0ms	z	@	inf	(log.f64 (fma.f64 1/3 (acos.f64 (.f64 (/.f64 (sqrt.f64 t) z) (/.f64 (.f64 x 1/18) y))) 1))
346.0ms	z	@	0	(-.f64 (.f64 z z) (.f64 t a))
330.0ms	x	@	inf	(log.f64 (fma.f64 1/3 (acos.f64 (.f64 (/.f64 (sqrt.f64 t) z) (/.f64 (.f64 x 1/18) y))) 1))
303.0ms	D	@	-inf	(.f64 (.f64 (pow.f64 (/.f64 d h) (/.f64 1 2)) (pow.f64 (/.f64 d l) (/.f64 1 2))) (-.f64 1 (.f64 (.f64 (/.f64 1 2) (pow.f64 (/.f64 (.f64 M D) (.f64 2 d)) 2)) (/.f64 h l))))
295.0ms	c	@	0	(fma.f64 x (log.f64 y) (+.f64 a (fma.f64 (+.f64 b -1/2) (log.f64 c) z)))

Herbie run

sample22.3min (24.8%)

localize18.7min (20.7%)

soundness11.5min (12.7%)

eval8.4min (9.3%)

regimes8.2min (9.1%)

simplify6.5min (7.2%)

prune4.2min (4.6%)

rewrite3.3min (3.7%)

bsearch2.5min (2.8%)

preprocess1.9min (2.2%)

analyze1.4min (1.5%)

series1.2min (1.4%)

end115.0ms (0%)

Profiling