Metrics for Herbie run

Date:	Monday, October 2nd, 2023
Commit:	2a64fc33 on main
Hostname:	nightly with Racket 8.6
Seed:	2023275
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample30.9min (23.7%)

Results

12.2min	3363614×	body	256	valid
4.3min	46371×	body	8192	exit
4.0min	274061×	body	1024	valid
2.3min	97933×	body	2048	valid
1.9min	524998×	body	256	infinite
1.5min	14508×	body	4096	valid
1.3min	149514×	body	512	valid
1.1min	255850×	body	256	invalid
41.7s	2417×	body	8192	valid
20.8s	20388×	body	1024	infinite
11.2s	16063×	body	1024	invalid
11.2s	48416×	body	256	unsamplable
8.7s	1212×	body	4096	infinite
7.6s	11288×	body	512	infinite
7.2s	1609×	body	2048	infinite
3.8s	5381×	body	2048	invalid
3.8s	8928×	body	512	invalid
924.0ms	2933×	body	256	precondition
603.0ms	310×	body	2048	unsamplable
306.0ms	19×	body	8192	infinite
292.0ms	426×	body	1024	unsamplable
89.0ms	225×	body	512	unsamplable
7.0ms	10×	body	4096	invalid

Bogosity

localize24.0min (18.4%)

Results

Compiler

Compiled 439308 to 186936 computations (57.4% saved)

soundness16.6min (12.8%)

Rules

2979528×	`fma-def`
1781580×	`associate-r`
1527354×	`log-prod`
1436776×	`associate-l`
1395042×	`fma-neg`

Stop Event

24×	unsound
124×	saturated
3927×	node limit

Results

Compiler

Compiled 362439 to 206265 computations (43.1% saved)

regimes12.8min (9.8%)

Counts

86469 → 10003

Calls

1160 calls:

1.4min	x
1.2min	z
1.2min	y
50.9s	t
42.9s	a

Results

Compiler

Compiled 1301915 to 679645 computations (47.8% saved)

eval12.6min (9.7%)

Compiler: Compiled 27340704 to 14085099 computations (48.5% saved)

simplify8.5min (6.5%)

Algorithm

2256×

egg-herbie

Rules

1300508×	`fma-def`
981730×	`associate-r`
944934×	`log-prod`
856536×	`associate-l`
757482×	`times-frac`

Stop Event

19×	unsound
532×	saturated
120×	done
414×	fuel
1705×	node limit

Counts

744099 → 577005

Compiler

Compiled 131361 to 81393 computations (38% saved)

prune6.4min (4.9%)

Counts: 854750 → 35087
Compiler: Compiled 2485841 to 1660379 computations (33.2% saved)

rewrite4.7min (3.6%)

Algorithm

1722×

batch-egg-rewrite

Rules

1138758×	`pow1`
1074948×	`log1p-expm1-u`
1074730×	`expm1-log1p-u`
1074314×	`add-exp-log`
1022238×	`add-log-exp`

Stop Event

10×	unsound
1712×	node limit

Counts

13797 → 419053

series4.1min (3.2%)

Counts

13797 → 325046

Calls

83459 calls:

Time	Variable		Point	Expression
2.5min	x	@	inf	(pow.f64 (pow.f64 (-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x)) 3) 1/3)
377.0ms	x	@	inf	(-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x))
367.0ms	D	@	0	(.f64 (/.f64 c0 (.f64 2 w)) (/.f64 (+.f64 0 (.f64 M M)) (-.f64 (.f64 (/.f64 c0 (.f64 h w)) (pow.f64 (/.f64 d D) 2)) (sqrt.f64 (-.f64 (pow.f64 (.f64 (/.f64 c0 (.f64 h w)) (pow.f64 (/.f64 d D) 2)) 2) (.f64 M M))))))
340.0ms	a	@	0	(/.f64 a (+.f64 1 (*.f64 k k)))
324.0ms	t	@	0	(.f64 (.f64 (+.f64 (neg.f64 b) 1) (/.f64 (pow.f64 a t) a)) (/.f64 x y))

Results

bsearch3.9min (3%)

Algorithm

5145×	binary-search
651×	left-value

Stop Event

5023×	narrow-enough
1×	predicate-failed
121×	predicate-same

Results

1.9min	458811×	body	256	valid
45.6s	113171×	body	256	infinite
22.7s	25586×	body	1024	valid
9.7s	15813×	body	512	valid
6.1s	4873×	body	2048	valid
5.6s	24204×	body	256	invalid
4.7s	2320×	body	4096	valid
3.0s	4045×	body	1024	infinite
1.3s	2921×	body	512	infinite
880.0ms	1016×	body	1024	invalid
492.0ms	127×	body	2048	infinite
306.0ms	190×	body	8192	valid
303.0ms	331×	body	2048	invalid
248.0ms	15×	body	4096	infinite
221.0ms	555×	body	512	invalid
39.0ms	223×	body	256	unsamplable
1.0ms	2×	body	1024	unsamplable
1.0ms	4×	body	512	unsamplable

Compiler

Compiled 1225414 to 906185 computations (26.1% saved)

preprocess3.0min (2.3%)

Algorithm

540×	egg-herbie

Rules

717430×	`fma-def`
266840×	`fma-neg`
215172×	`sub-neg`
202918×	`div-sub`
198574×	`unsub-neg`

Stop Event

204×	saturated
336×	node limit

Compiler

Compiled 289401 to 150330 computations (48.1% saved)

analyze2.7min (2%)

Algorithm

544×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	86%	14%	0%	0%	0%	0
40.4%	34.7%	51.3%	14%	0%	0%	0%	1
46.4%	39.6%	45.8%	14.1%	0%	0.6%	0%	2
56.1%	47.2%	37%	14.1%	0%	1.7%	0%	3
62.1%	51.9%	31.7%	14.1%	0%	2.3%	0%	4
67.8%	56.4%	26.8%	14.1%	0%	2.7%	0%	5
71.5%	59.1%	23.5%	14.1%	0%	3.2%	0%	6
75.4%	61.7%	20.1%	14.1%	0%	4%	0%	7
77.2%	62.9%	18.5%	14.1%	0%	4.4%	0%	8
79.8%	64.6%	16.4%	14.1%	0%	4.8%	0.1%	9
81.3%	65.5%	15%	14.1%	0%	5.3%	0.1%	10
83.6%	67%	13.2%	14.1%	0%	5.6%	0.1%	11
84.7%	67.6%	12.2%	14.1%	0%	5.9%	0.1%	12

Compiler

Compiled 13307 to 8604 computations (35.3% saved)

Herbie run

sample30.9min (23.7%)

localize24.0min (18.4%)

soundness16.6min (12.8%)

regimes12.8min (9.8%)

eval12.6min (9.7%)

simplify8.5min (6.5%)

prune6.4min (4.9%)

rewrite4.7min (3.6%)

series4.1min (3.2%)

bsearch3.9min (3%)

preprocess3.0min (2.3%)

analyze2.7min (2%)

end164.0ms (0%)

Profiling