Metrics for Herbie run

Date:	Friday, October 6th, 2023
Commit:	c7e70dc6 on main
Hostname:	nightly with Racket 8.6
Seed:	2023279
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample31.5min (25%)

Results

12.8min	3365468×	body	256	valid
4.3min	45807×	body	8192	exit
4.1min	273960×	body	1024	valid
2.3min	97990×	body	2048	valid
1.9min	523059×	body	256	infinite
1.5min	14445×	body	4096	valid
1.3min	150330×	body	512	valid
1.1min	256429×	body	256	invalid
41.2s	2409×	body	8192	valid
20.5s	20043×	body	1024	infinite
11.1s	48059×	body	256	unsamplable
10.9s	16251×	body	1024	invalid
8.5s	1249×	body	4096	infinite
6.8s	10982×	body	512	infinite
6.6s	1634×	body	2048	infinite
4.0s	8790×	body	512	invalid
2.9s	5406×	body	2048	invalid
2.1s	2986×	body	256	precondition
352.0ms	18×	body	8192	infinite
291.0ms	508×	body	1024	unsamplable
246.0ms	291×	body	2048	unsamplable
99.0ms	247×	body	512	unsamplable
7.0ms	9×	body	4096	invalid
7.0ms	2×	body	8192	invalid

Bogosity

localize23.6min (18.7%)

Results

Compiler

Compiled 444487 to 184512 computations (58.5% saved)

soundness16.0min (12.6%)

Rules

2799202×	`fma-def`
1705226×	`associate-r`
1497158×	`log-prod`
1383246×	`associate-l`
1345904×	`fma-neg`

Stop Event

39×	unsound
121×	saturated
3734×	node limit

Results

Compiler

Compiled 338897 to 188377 computations (44.4% saved)

regimes13.2min (10.4%)

Counts

87059 → 9909

Calls

1169 calls:

1.4min	x
1.2min	y
1.2min	z
47.2s	t
42.2s	a

Results

Compiler

Compiled 1374472 to 702411 computations (48.9% saved)

eval11.8min (9.4%)

Compiler: Compiled 29280039 to 14059617 computations (52% saved)

simplify8.1min (6.4%)

Algorithm

2209×

egg-herbie

Rules

1277300×	`fma-def`
945000×	`associate-r`
910734×	`log-prod`
830008×	`associate-l`
750424×	`times-frac`

Stop Event

18×	unsound
534×	saturated
142×	done
394×	fuel
1657×	node limit

Counts

718424 → 558354

Compiler

Compiled 133370 to 81438 computations (38.9% saved)

prune6.1min (4.9%)

Counts

841007 → 35067

Results

Compiler

Compiled 2575941 to 1707567 computations (33.7% saved)

rewrite4.6min (3.6%)

Algorithm

1673×

batch-egg-rewrite

Rules

1105162×	`pow1`
1043238×	`log1p-expm1-u`
1043060×	`expm1-log1p-u`
1042702×	`add-exp-log`
992368×	`add-log-exp`

Stop Event

11×	unsound
1662×	node limit

Counts

13336 → 403346

bsearch4.1min (3.2%)

Algorithm

5268×	binary-search
557×	left-value

Stop Event

5162×	narrow-enough
3×	predicate-failed
103×	predicate-same

Results

2.0min	462549×	body	256	valid
54.2s	124243×	body	256	infinite
25.7s	26743×	body	1024	valid
9.3s	16482×	body	512	valid
6.0s	27062×	body	256	invalid
4.0s	3862×	body	2048	valid
3.9s	4772×	body	1024	infinite
2.6s	1947×	body	4096	valid
1.5s	3010×	body	512	infinite
636.0ms	367×	body	8192	valid
450.0ms	716×	body	1024	invalid
316.0ms	128×	body	2048	infinite
257.0ms	41×	body	4096	infinite
180.0ms	312×	body	8192	exit
173.0ms	465×	body	512	invalid
49.0ms	326×	body	256	unsamplable
20.0ms	28×	body	2048	invalid

Compiler

Compiled 1287918 to 943069 computations (26.8% saved)

preprocess2.9min (2.3%)

Algorithm

540×	egg-herbie

Rules

717430×	`fma-def`
266840×	`fma-neg`
215172×	`sub-neg`
202918×	`div-sub`
198574×	`unsub-neg`

Stop Event

204×	saturated
336×	node limit

Compiler

Compiled 294253 to 150876 computations (48.7% saved)

analyze2.6min (2.1%)

Algorithm

544×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	86%	14%	0%	0%	0%	0
40.4%	34.7%	51.3%	14%	0%	0%	0%	1
46.4%	39.6%	45.8%	14.1%	0%	0.6%	0%	2
56.1%	47.2%	37%	14.1%	0%	1.7%	0%	3
62.1%	51.9%	31.7%	14.1%	0%	2.3%	0%	4
67.8%	56.4%	26.8%	14.1%	0%	2.7%	0%	5
71.5%	59.1%	23.5%	14.1%	0%	3.2%	0%	6
75.4%	61.7%	20.1%	14.1%	0%	4%	0%	7
77.2%	62.9%	18.5%	14.1%	0%	4.4%	0%	8
79.8%	64.6%	16.4%	14.1%	0%	4.8%	0.1%	9
81.3%	65.5%	15%	14.1%	0%	5.3%	0.1%	10
83.6%	67%	13.2%	14.1%	0%	5.6%	0.1%	11
84.7%	67.6%	12.2%	14.1%	0%	5.9%	0.1%	12

Compiler

Compiled 13307 to 8604 computations (35.3% saved)

series1.7min (1.4%)

Counts

13336 → 315078

Calls

81897 calls:

Time	Variable		Point	Expression
407.0ms	z	@	inf	(.f64 (.f64 x 18) (*.f64 y z))
383.0ms	x	@	-inf	(/.f64 (sin.f64 x) x)
350.0ms	sinTheta_O	@	inf	(.f32 (exp.f32 (-.f32 (.f32 cosTheta_i (/.f32 cosTheta_O v)) (fma.f32 sinTheta_i (/.f32 sinTheta_O v) (/.f32 1 v)))) (exp.f32 (+.f32 (log.f32 (/.f32 1/2 v)) 6931/10000)))
321.0ms	x	@	inf	(-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x))
315.0ms	a	@	inf	(/.f64 (-.f64 (neg.f64 b) (cbrt.f64 (pow.f64 (.f64 c (.f64 a -4)) 3/2))) (*.f64 a 2))

Herbie run

sample31.5min (25%)

localize23.6min (18.7%)

soundness16.0min (12.6%)

regimes13.2min (10.4%)

eval11.8min (9.4%)

simplify8.1min (6.4%)

prune6.1min (4.9%)

rewrite4.6min (3.6%)

bsearch4.1min (3.2%)

preprocess2.9min (2.3%)

analyze2.6min (2.1%)

series1.7min (1.4%)

end181.0ms (0%)

Profiling