Metrics for Herbie run

Date:	Thursday, September 28th, 2023
Commit:	4fc72252 on main
Hostname:	nightly with Racket 8.6
Seed:	2023271
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample22.4min (24%)

Results

8.5min	3365495×	body	256	valid
3.9min	46841×	body	8192	exit
2.8min	273992×	body	1024	valid
1.7min	98023×	body	2048	valid
1.3min	524947×	body	256	infinite
1.1min	14544×	body	4096	valid
52.5s	148161×	body	512	valid
42.9s	255979×	body	256	invalid
28.8s	2398×	body	8192	valid
14.9s	20149×	body	1024	infinite
9.3s	50173×	body	256	unsamplable
7.4s	15862×	body	1024	invalid
6.0s	1226×	body	4096	infinite
5.2s	11375×	body	512	infinite
4.8s	1578×	body	2048	infinite
2.5s	8592×	body	512	invalid
2.2s	5357×	body	2048	invalid
1.1s	2982×	body	256	precondition
282.0ms	21×	body	8192	infinite
241.0ms	483×	body	1024	unsamplable
147.0ms	256×	body	2048	unsamplable
84.0ms	225×	body	512	unsamplable
7.0ms	12×	body	4096	invalid

Bogosity

localize19.3min (20.7%)

Results

Compiler

Compiled 462287 to 190168 computations (58.9% saved)

soundness12.8min (13.7%)

Rules

2944384×	`fma-def`
1693668×	`associate-r`
1542536×	`log-prod`
1436488×	`fma-neg`
1414000×	`times-frac`

Stop Event

23×	unsound
121×	saturated
3858×	node limit

Compiler

Compiled 356249 to 202578 computations (43.1% saved)

regimes9.3min (10%)

Counts

89477 → 10216

Calls

1168 calls:

1.0min	x
50.8s	z
49.8s	y
37.2s	t
33.4s	a

Compiler

Compiled 1534570 to 823657 computations (46.3% saved)

eval8.4min (9%)

Compiler: Compiled 30353749 to 14749511 computations (51.4% saved)

simplify6.0min (6.5%)

Algorithm

2247×

egg-herbie

Rules

1304702×	`fma-def`
946262×	`associate-r`
928558×	`log-prod`
830590×	`associate-l`
781260×	`times-frac`

Stop Event

17×	unsound
536×	saturated
132×	done
404×	fuel
1694×	node limit

Counts

738092 → 573569

Compiler

Compiled 136085 to 84215 computations (38.1% saved)

prune4.2min (4.5%)

Counts: 869184 → 35813
Compiler: Compiled 2623030 to 1735924 computations (33.8% saved)

rewrite3.4min (3.6%)

Algorithm

1710×

batch-egg-rewrite

Rules

1136916×	`pow1`
1073990×	`add-exp-log`
1073022×	`log1p-expm1-u`
1072810×	`expm1-log1p-u`
1018762×	`add-log-exp`

Stop Event

12×	unsound
1698×	node limit

Counts

13593 → 415369

bsearch2.6min (2.8%)

Algorithm

5364×	binary-search
684×	left-value

Stop Event

5223×	narrow-enough
141×	predicate-same

Results

1.3min	471046×	body	256	valid
25.4s	116364×	body	256	infinite
18.8s	26700×	body	1024	valid
6.9s	17263×	body	512	valid
4.2s	4957×	body	2048	valid
3.7s	23658×	body	256	invalid
2.8s	6425×	body	1024	infinite
1.3s	1274×	body	4096	valid
1.2s	3853×	body	512	infinite
524.0ms	1066×	body	1024	invalid
280.0ms	281×	body	2048	invalid
265.0ms	873×	body	512	invalid
74.0ms	71×	body	2048	infinite
49.0ms	61×	body	8192	valid
20.0ms	180×	body	256	unsamplable
1.0ms	2×	body	4096	infinite
1.0ms	1×	body	8192	exit
1.0ms	1×	body	2048	unsamplable

Compiler

Compiled 1223683 to 902919 computations (26.2% saved)

preprocess2.1min (2.2%)

Algorithm

540×	egg-herbie

Rules

717430×	`fma-def`
266840×	`fma-neg`
215172×	`sub-neg`
202918×	`div-sub`
198574×	`unsub-neg`

Stop Event

204×	saturated
336×	node limit

Compiler

Compiled 314215 to 160062 computations (49.1% saved)

analyze1.7min (1.8%)

Algorithm

544×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	86%	14%	0%	0%	0%	0
40.4%	34.7%	51.3%	14%	0%	0%	0%	1
46.4%	39.6%	45.8%	14.1%	0%	0.6%	0%	2
56.1%	47.2%	37%	14.1%	0%	1.7%	0%	3
62.1%	51.9%	31.7%	14.1%	0%	2.3%	0%	4
67.8%	56.4%	26.8%	14.1%	0%	2.7%	0%	5
71.5%	59.1%	23.5%	14.1%	0%	3.2%	0%	6
75.4%	61.7%	20.1%	14.1%	0%	4%	0%	7
77.2%	62.9%	18.5%	14.1%	0%	4.4%	0%	8
79.8%	64.6%	16.4%	14.1%	0%	4.8%	0.1%	9
81.3%	65.5%	15%	14.1%	0%	5.3%	0.1%	10
83.6%	67%	13.2%	14.1%	0%	5.6%	0.1%	11
84.7%	67.6%	12.2%	14.1%	0%	5.9%	0.1%	12

Compiler

Compiled 13307 to 8604 computations (35.3% saved)

series1.2min (1.3%)

Counts

13593 → 322723

Calls

83463 calls:

Time	Variable		Point	Expression
403.0ms	dY.u	@	-inf	(pow.f32 (pow.f32 (fmax.f32 (pow.f32 (hypot.f32 (.f32 (floor.f32 d) dX.w) (hypot.f32 (.f32 (floor.f32 w) dX.u) (.f32 (floor.f32 h) dX.v))) 2) (pow.f32 (hypot.f32 (.f32 (floor.f32 d) dY.w) (hypot.f32 (.f32 (floor.f32 w) dY.u) (.f32 (floor.f32 h) dY.v))) 2)) 3/2) 1/3)
342.0ms	x	@	inf	(-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x))
288.0ms	base	@	-inf	(log.f64 (pow.f64 base (/.f64 1 (atan2.f64 im re))))
284.0ms	w	@	inf	(log1p.f32 (.f32 dX.u (.f32 dX.u (pow.f32 (floor.f32 w) 2))))
271.0ms	x.im	@	0	(exp.f64 (-.f64 (.f64 (log.f64 (hypot.f64 x.re x.im)) y.re) (.f64 (atan2.f64 x.im x.re) y.im)))

Herbie run

sample22.4min (24%)

localize19.3min (20.7%)

soundness12.8min (13.7%)

regimes9.3min (10%)

eval8.4min (9%)

simplify6.0min (6.5%)

prune4.2min (4.5%)

rewrite3.4min (3.6%)

bsearch2.6min (2.8%)

preprocess2.1min (2.2%)

analyze1.7min (1.8%)

series1.2min (1.3%)

end137.0ms (0%)

Profiling