Metrics for Herbie run

Date:	Friday, October 20th, 2023
Commit:	21d611eb on main
Hostname:	nightly with Racket 8.6
Seed:	2023293
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample22.2min (23.2%)

Results

8.6min	3364092×	body	256	valid
3.9min	46624×	body	8192	exit
2.8min	274952×	body	1024	valid
1.6min	97803×	body	2048	valid
1.3min	524271×	body	256	infinite
1.0min	14309×	body	4096	valid
50.6s	149694×	body	512	valid
43.4s	257172×	body	256	invalid
29.8s	2399×	body	8192	valid
14.5s	20244×	body	1024	infinite
9.7s	49897×	body	256	unsamplable
7.0s	15910×	body	1024	invalid
6.9s	1272×	body	4096	infinite
5.4s	10961×	body	512	infinite
4.9s	1646×	body	2048	infinite
2.6s	8722×	body	512	invalid
1.9s	5259×	body	2048	invalid
1.2s	2905×	body	256	precondition
422.0ms	30×	body	8192	infinite
179.0ms	486×	body	1024	unsamplable
146.0ms	281×	body	2048	unsamplable
58.0ms	220×	body	512	unsamplable
9.0ms	1×	body	4096	unsamplable
3.0ms	1×	body	8192	invalid
2.0ms	8×	body	4096	invalid

Bogosity

localize18.0min (18.7%)

Results

Compiler

Compiled 443410 to 190881 computations (57% saved)

soundness12.5min (13%)

Rules

3062518×	`fma-def`
1736142×	`associate-r`
1528008×	`log-prod`
1430442×	`times-frac`
1417406×	`associate-l`

Stop Event

31×	unsound
125×	saturated
3923×	node limit

Compiler

Compiled 363356 to 207034 computations (43% saved)

regimes9.0min (9.3%)

Counts

91285 → 10189

Calls

1178 calls:

54.9s	x
45.2s	y
44.8s	z
38.2s	t
37.1s	a

Compiler

Compiled 1516550 to 812247 computations (46.4% saved)

eval8.6min (9%)

Compiler: Compiled 28725913 to 14907561 computations (48.1% saved)

simplify6.0min (6.2%)

Algorithm

2237×

egg-herbie

Rules

1342234×	`fma-def`
923428×	`associate-r`
912446×	`log-prod`
815106×	`associate-l`
745934×	`times-frac`

Stop Event

14×	unsound
535×	saturated
125×	done
411×	fuel
1688×	node limit

Counts

722392 → 564605

Compiler

Compiled 138654 to 85958 computations (38% saved)

prune4.2min (4.3%)

Counts: 858724 → 35207
Compiler: Compiled 2578507 to 1716072 computations (33.4% saved)

preprocess3.9min (4%)

Algorithm

540×	egg-herbie

Rules

717430×	`fma-def`
266840×	`fma-neg`
215172×	`sub-neg`
202918×	`div-sub`
198574×	`unsub-neg`

Stop Event

204×	saturated
336×	node limit

Compiler

Compiled 362495 to 183337 computations (49.4% saved)

series3.6min (3.8%)

Counts

13510 → 317248

Calls

82709 calls:

Time	Variable		Point	Expression
2.4min	x	@	inf	(pow.f64 (pow.f64 (-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x)) 3) 1/3)
353.0ms	x	@	0	(*.f64 x (log.f64 y))
294.0ms	w	@	-inf	(log1p.f32 (fma.f32 (pow.f32 (floor.f32 w) 2) (.f32 dX.u dX.u) (pow.f32 (.f32 dX.w (floor.f32 d)) 2)))
280.0ms	x	@	inf	(-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x))
279.0ms	U	@	0	(pow.f64 (.f64 U (.f64 n t)) 1/6)

Results

rewrite3.5min (3.7%)

Algorithm

1701×

batch-egg-rewrite

Rules

1138370×	`pow1`
1075566×	`add-exp-log`
1074562×	`log1p-expm1-u`
1074352×	`expm1-log1p-u`
1020296×	`add-log-exp`

Stop Event

11×	unsound
1690×	node limit

Counts

13510 → 405144

bsearch2.8min (3%)

Algorithm

5319×	binary-search
622×	left-value

Stop Event

5190×	narrow-enough
129×	predicate-same

Results

1.3min	475744×	body	256	valid
29.7s	113787×	body	256	infinite
24.0s	30208×	body	1024	valid
7.7s	17397×	body	512	valid
4.4s	30127×	body	256	invalid
3.3s	3620×	body	2048	valid
2.8s	5561×	body	1024	infinite
2.0s	1837×	body	4096	valid
924.0ms	2748×	body	512	infinite
590.0ms	460×	body	1024	invalid
371.0ms	342×	body	8192	valid
316.0ms	149×	body	2048	infinite
220.0ms	46×	body	4096	infinite
60.0ms	224×	body	512	invalid
31.0ms	8×	body	1024	unsamplable
12.0ms	1×	body	8192	infinite
12.0ms	61×	body	256	unsamplable
6.0ms	9×	body	2048	invalid
2.0ms	4×	body	2048	unsamplable
1.0ms	1×	body	8192	exit
0.0ms	1×	body	512	unsamplable

Compiler

Compiled 1275529 to 935118 computations (26.7% saved)

analyze1.8min (1.8%)

Algorithm

544×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	86%	14%	0%	0%	0%	0
40.4%	34.7%	51.3%	14%	0%	0%	0%	1
46.4%	39.6%	45.8%	14.1%	0%	0.6%	0%	2
56.1%	47.2%	37%	14.1%	0%	1.7%	0%	3
62.1%	51.9%	31.7%	14.1%	0%	2.3%	0%	4
67.8%	56.4%	26.8%	14.1%	0%	2.7%	0%	5
71.5%	59.1%	23.5%	14.1%	0%	3.2%	0%	6
75.4%	61.7%	20.1%	14.1%	0%	4%	0%	7
77.2%	62.9%	18.5%	14.1%	0%	4.4%	0%	8
79.8%	64.6%	16.4%	14.1%	0%	4.8%	0.1%	9
81.3%	65.5%	15%	14.1%	0%	5.3%	0.1%	10
83.6%	67%	13.2%	14.1%	0%	5.6%	0.1%	11
84.7%	67.6%	12.2%	14.1%	0%	5.9%	0.1%	12

Compiler

Compiled 13307 to 8604 computations (35.3% saved)

Herbie run

sample22.2min (23.2%)

localize18.0min (18.7%)

soundness12.5min (13%)

regimes9.0min (9.3%)

eval8.6min (9%)

simplify6.0min (6.2%)

prune4.2min (4.3%)

preprocess3.9min (4%)

series3.6min (3.8%)

rewrite3.5min (3.7%)

bsearch2.8min (3%)

analyze1.8min (1.8%)

end126.0ms (0%)

Profiling