Metrics for Herbie run

Date:	Saturday, December 16th, 2023
Commit:	665878db on main
Hostname:	nightly with Racket 8.6
Seed:	2023350
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample21.8min (21.5%)

Results

9.3min	3466523×	body	256	valid
3.8min	39357×	body	8192	exit
1.9min	202215×	body	1024	valid
1.6min	99811×	body	2048	valid
1.4min	533323×	body	256	infinite
1.0min	14544×	body	4096	valid
42.4s	126258×	body	512	valid
32.7s	181408×	body	256	invalid
28.1s	2273×	body	8192	valid
11.0s	65863×	body	256	precondition
10.3s	8926×	body	1024	infinite
7.7s	38116×	body	256	unsamplable
6.2s	11681×	body	1024	invalid
5.8s	1223×	body	4096	infinite
4.7s	1639×	body	2048	infinite
3.3s	5052×	body	512	infinite
2.5s	6589×	body	512	invalid
1.3s	1275×	body	2048	invalid
317.0ms	23×	body	8192	infinite
5.0ms	4×	body	1024	unsamplable
3.0ms	1×	body	2048	unsamplable
3.0ms	4×	body	512	unsamplable

Bogosity

localize18.4min (18.1%)

Results

Compiler

Compiled 432905 to 194464 computations (55.1% saved)

soundness13.6min (13.4%)

Rules

2382188×	`fma-def`
1348626×	`associate-r`
1143638×	`times-frac`
1118182×	`log-prod`
1021732×	`associate-l`

Stop Event

20×	unsound
120×	saturated
3339×	node limit

Compiler

Compiled 308004 to 175078 computations (43.2% saved)

eval10.6min (10.5%)

Results

Compiler

Compiled 33215395 to 17399746 computations (47.6% saved)

regimes9.2min (9%)

Counts

85783 → 9260

Calls

1168 calls:

57.4s	x
48.1s	z
45.6s	y
34.2s	a
31.8s	t

Compiler

Compiled 1446994 to 795353 computations (45% saved)

simplify7.1min (7%)

Algorithm

2196×

egg-herbie

Rules

1303914×	`fma-def`
833672×	`log-prod`
823326×	`associate-r`
762392×	`times-frac`
701324×	`associate-l`

Stop Event

16×	unsound
532×	saturated
139×	done
395×	fuel
1648×	node limit

Counts

749333 → 590090

Compiler

Compiled 120294 to 76151 computations (36.7% saved)

prune4.6min (4.6%)

Counts: 920748 → 34787
Compiler: Compiled 2530140 to 1722870 computations (31.9% saved)

rewrite4.2min (4.1%)

Algorithm

1662×

batch-egg-rewrite

Rules

968918×	`log1p-expm1-u`
746224×	`expm1-log1p-u`
578816×	`expm1-udef`
578648×	`prod-diff`
534814×	`log1p-udef`

Stop Event

11×	unsound
1651×	node limit

Counts

13018 → 448335

series3.9min (3.9%)

Counts

13018 → 300998

Calls

80207 calls:

Time	Variable		Point	Expression
2.5min	x	@	inf	(pow.f64 (pow.f64 (-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x)) 3) 1/3)
334.0ms	x	@	0	(*.f64 x (log.f64 y))
332.0ms	x	@	inf	(-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x))
315.0ms	dX.v	@	inf	(log.f32 (fmax.f32 (pow.f32 (.f32 dX.v (floor.f32 h)) 2) (pow.f32 (hypot.f32 (.f32 (floor.f32 d) dY.w) (hypot.f32 (.f32 (floor.f32 w) dY.u) (.f32 (floor.f32 h) dY.v))) 2)))
307.0ms	w	@	inf	(pow.f32 (pow.f32 (fmax.f32 (pow.f32 (hypot.f32 (.f32 (floor.f32 w) dX.u) (.f32 (floor.f32 h) dX.v)) 2) (pow.f32 (*.f32 (floor.f32 w) dY.u) 2)) 3/2) 1/3)

Results

preprocess3.8min (3.8%)

Algorithm

540×	egg-herbie

Rules

721254×	`fma-def`
259182×	`fma-neg`
226530×	`sub-neg`
222024×	`div-sub`
211796×	`unsub-neg`

Stop Event

201×	saturated
339×	node limit

Compiler

Compiled 427591 to 234793 computations (45.1% saved)

bsearch2.4min (2.4%)

Algorithm

4830×	binary-search
510×	left-value

Stop Event

4714×	narrow-enough
116×	predicate-same

Results

1.3min	441183×	body	256	valid
32.5s	107014×	body	256	infinite
9.3s	14572×	body	1024	valid
4.3s	10755×	body	512	valid
3.7s	3841×	body	2048	valid
2.7s	18098×	body	256	invalid
814.0ms	1146×	body	1024	infinite
706.0ms	657×	body	4096	valid
425.0ms	124×	body	4096	infinite
313.0ms	580×	body	512	infinite
286.0ms	192×	body	2048	infinite
60.0ms	359×	body	256	unsamplable
48.0ms	58×	body	8192	valid
43.0ms	124×	body	1024	invalid
37.0ms	84×	body	512	invalid

Compiler

Compiled 1131041 to 841398 computations (25.6% saved)

analyze1.7min (1.7%)

Algorithm

544×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	85.5%	14.5%	0%	0%	0%	0
39.9%	34.1%	51.4%	14.5%	0%	0%	0%	1
45.9%	38.8%	45.8%	14.5%	0%	0.9%	0%	2
54.9%	45.3%	37.3%	14.5%	0%	2.9%	0%	3
61.5%	50.2%	31.4%	14.5%	0%	3.9%	0%	4
67.6%	54.8%	26.3%	14.5%	0%	4.3%	0%	5
71.4%	57.7%	23.1%	14.5%	0%	4.6%	0%	6
75.3%	60.3%	19.8%	14.6%	0%	5.1%	0.1%	7
77.2%	61.6%	18.2%	14.6%	0%	5.5%	0.1%	8
79.8%	63.4%	16.1%	14.6%	0%	5.8%	0.1%	9
81.3%	64.4%	14.8%	14.6%	0%	6%	0.1%	10
83.5%	66%	13%	14.6%	0%	6.2%	0.1%	11
84.6%	66.7%	12.1%	14.6%	0%	6.4%	0.1%	12

Compiler

Compiled 13340 to 8620 computations (35.4% saved)

Herbie run

sample21.8min (21.5%)

localize18.4min (18.1%)

soundness13.6min (13.4%)

eval10.6min (10.5%)

regimes9.2min (9%)

simplify7.1min (7%)

prune4.6min (4.6%)

rewrite4.2min (4.1%)

series3.9min (3.9%)

preprocess3.8min (3.8%)

bsearch2.4min (2.4%)

analyze1.7min (1.7%)

end108.0ms (0%)

Profiling