Metrics for Herbie run

Date:	Friday, October 6th, 2023
Commit:	add13636 on main
Hostname:	nightly with Racket 8.6
Seed:	2023279
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample31.2min (24.6%)

Results

12.5min	3365501×	body	256	valid
4.3min	45871×	body	8192	exit
4.1min	273960×	body	1024	valid
2.3min	97990×	body	2048	valid
1.9min	523059×	body	256	infinite
1.5min	14445×	body	4096	valid
1.3min	150330×	body	512	valid
1.1min	256429×	body	256	invalid
40.3s	2411×	body	8192	valid
22.9s	20043×	body	1024	infinite
11.7s	16251×	body	1024	invalid
11.1s	48206×	body	256	unsamplable
9.1s	1249×	body	4096	infinite
8.2s	10982×	body	512	infinite
7.8s	1634×	body	2048	infinite
4.1s	8790×	body	512	invalid
3.3s	5406×	body	2048	invalid
1.1s	2986×	body	256	precondition
447.0ms	18×	body	8192	infinite
327.0ms	508×	body	1024	unsamplable
309.0ms	291×	body	2048	unsamplable
109.0ms	247×	body	512	unsamplable
7.0ms	9×	body	4096	invalid
5.0ms	2×	body	8192	invalid

Bogosity

localize23.1min (18.2%)

Results

Compiler

Compiled 442799 to 183546 computations (58.5% saved)

soundness16.0min (12.6%)

Rules

2794704×	`fma-def`
1705496×	`associate-r`
1496128×	`log-prod`
1382686×	`associate-l`
1347858×	`fma-neg`

Stop Event

39×	unsound
121×	saturated
3729×	node limit

Results

Compiler

Compiled 338166 to 188049 computations (44.4% saved)

regimes12.9min (10.1%)

Counts

86566 → 9907

Calls

1164 calls:

1.4min	x
1.1min	y
1.1min	z
47.1s	t
42.7s	a

Results

Compiler

Compiled 1341854 to 682007 computations (49.2% saved)

eval11.8min (9.3%)

Results

Compiler

Compiled 29279501 to 14059301 computations (52% saved)

simplify8.2min (6.4%)

Algorithm

2209×

egg-herbie

Rules

1277300×	`fma-def`
945000×	`associate-r`
910734×	`log-prod`
830008×	`associate-l`
750424×	`times-frac`

Stop Event

18×	unsound
534×	saturated
142×	done
394×	fuel
1657×	node limit

Counts

718424 → 558354

Compiler

Compiled 133370 to 81438 computations (38.9% saved)

prune6.0min (4.7%)

Counts: 841007 → 35067
Compiler: Compiled 2575581 to 1707343 computations (33.7% saved)

preprocess5.3min (4.2%)

Algorithm

540×	egg-herbie

Rules

717430×	`fma-def`
266840×	`fma-neg`
215172×	`sub-neg`
202918×	`div-sub`
198574×	`unsub-neg`

Stop Event

204×	saturated
336×	node limit

Results

Compiler

Compiled 336401 to 170439 computations (49.3% saved)

rewrite4.5min (3.6%)

Algorithm

1673×

batch-egg-rewrite

Rules

1105162×	`pow1`
1043238×	`log1p-expm1-u`
1043060×	`expm1-log1p-u`
1042702×	`add-exp-log`
992368×	`add-log-exp`

Stop Event

11×	unsound
1662×	node limit

Counts

13336 → 403346

bsearch3.9min (3.1%)

Algorithm

5268×	binary-search
557×	left-value

Stop Event

5162×	narrow-enough
3×	predicate-failed
103×	predicate-same

Results

1.9min	462549×	body	256	valid
50.9s	124243×	body	256	infinite
26.5s	26743×	body	1024	valid
8.7s	16482×	body	512	valid
5.7s	27062×	body	256	invalid
4.0s	4772×	body	1024	infinite
3.9s	3862×	body	2048	valid
2.5s	1947×	body	4096	valid
1.5s	3010×	body	512	infinite
591.0ms	716×	body	1024	invalid
558.0ms	367×	body	8192	valid
306.0ms	128×	body	2048	infinite
298.0ms	312×	body	8192	exit
283.0ms	465×	body	512	invalid
193.0ms	41×	body	4096	infinite
65.0ms	326×	body	256	unsamplable
19.0ms	28×	body	2048	invalid

Compiler

Compiled 1287918 to 943069 computations (26.8% saved)

analyze2.6min (2%)

Algorithm

544×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	86%	14%	0%	0%	0%	0
40.4%	34.7%	51.3%	14%	0%	0%	0%	1
46.4%	39.6%	45.8%	14.1%	0%	0.6%	0%	2
56.1%	47.2%	37%	14.1%	0%	1.7%	0%	3
62.1%	51.9%	31.7%	14.1%	0%	2.3%	0%	4
67.8%	56.4%	26.8%	14.1%	0%	2.7%	0%	5
71.5%	59.1%	23.5%	14.1%	0%	3.2%	0%	6
75.4%	61.7%	20.1%	14.1%	0%	4%	0%	7
77.2%	62.9%	18.5%	14.1%	0%	4.4%	0%	8
79.8%	64.6%	16.4%	14.1%	0%	4.8%	0.1%	9
81.3%	65.5%	15%	14.1%	0%	5.3%	0.1%	10
83.6%	67%	13.2%	14.1%	0%	5.6%	0.1%	11
84.7%	67.6%	12.2%	14.1%	0%	5.9%	0.1%	12

Compiler

Compiled 13307 to 8604 computations (35.3% saved)

series1.6min (1.3%)

Counts

13336 → 315078

Calls

81897 calls:

Time	Variable		Point	Expression
402.0ms	lambda2	@	-inf	(log.f64 (hypot.f64 (sin.f64 (.f64 (-.f64 phi1 phi2) 1/2)) (.f64 (sqrt.f64 (.f64 (cos.f64 phi1) (cos.f64 phi2))) (sin.f64 (.f64 (-.f64 lambda1 lambda2) 1/2)))))
355.0ms	x	@	0	(*.f64 x (log.f64 y))
302.0ms	x	@	inf	(-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x))
291.0ms	x	@	0	(log.f64 (+.f64 1 (expm1.f64 (*.f64 x 27061/100000))))
281.0ms	z	@	-inf	(cbrt.f64 (*.f64 y (sqrt.f64 z)))

Herbie run

sample31.2min (24.6%)

localize23.1min (18.2%)

soundness16.0min (12.6%)

regimes12.9min (10.1%)

eval11.8min (9.3%)

simplify8.2min (6.4%)

prune6.0min (4.7%)

preprocess5.3min (4.2%)

rewrite4.5min (3.6%)

bsearch3.9min (3.1%)

analyze2.6min (2%)

series1.6min (1.3%)

end311.0ms (0%)

Profiling