Metrics for Herbie run

Date:	Thursday, February 1st, 2024
Commit:	93f5a71d on minor-egg-herbie-cleanup
Hostname:	nightly with Racket 8.11.1
Seed:	2024032
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample24.1min (20.9%)

Results

10.7min	3474291×	256	valid
1.6min	535134×	256	infinite
38.9s	182497×	256	invalid
1.4min	166619×	1024	valid
1.4min	163577×	512	valid
25.9s	144945×	256	precondition
1.8min	90560×	2048	valid
4.2min	39480×	8192	exit
8.1s	38243×	256	unsamplable
54.7s	13079×	4096	valid
11.8s	12235×	512	infinite
7.5s	11213×	1024	invalid
3.1s	6618×	512	invalid
2.6s	2024×	1024	infinite
18.2s	1891×	8192	valid
4.2s	1330×	2048	infinite
1.4s	1172×	2048	invalid
5.0s	1017×	4096	infinite
10.0ms	6×	1024	unsamplable
3.0ms	4×	512	unsamplable
9.0ms	4×	8192	invalid
3.0ms	2×	4096	invalid
31.0ms	1×	8192	unsamplable

Bogosity

localize20.5min (17.8%)

Results

Compiler

Compiled 450888 to 200871 computations (55.4% saved)

soundness16.3min (14.1%)

Rules

2280691×	`fma-def`
1359168×	`associate-r`
1114163×	`times-frac`
1106633×	`log-prod`
1037796×	`associate-l`

Stop Event

125×	saturated
3445×	node limit
30×	unsound

Compiler

Compiled 326176 to 188972 computations (42.1% saved)

eval11.1min (9.6%)

Compiler: Compiled 35582422 to 17943566 computations (49.6% saved)

regimes9.0min (7.8%)

Counts

81436 → 9227

Calls

1184 calls:

55.8s	x
50.8s	y
45.1s	z
42.1s	a
36.4s	t

Compiler

Compiled 90868 to 68310 computations (24.8% saved)

simplify8.4min (7.3%)

Algorithm

2212×

egg-herbie

Rules

1230176×	`fma-def`
837534×	`log-prod`
807541×	`associate-r`
708815×	`times-frac`
685057×	`associate-l`

Stop Event

535×	saturated
325×	fuel
1658×	node limit
19×	unsound
211×	done

Counts

742523 → 590694

Compiler

Compiled 125763 to 78210 computations (37.8% saved)

preprocess6.2min (5.4%)

Algorithm

540×	egg-herbie

Rules

688760×	`fma-def`
250704×	`fma-neg`
220606×	`sub-neg`
215885×	`div-sub`
202671×	`unsub-neg`

Stop Event

201×	saturated
339×	node limit

Compiler

Compiled 485077 to 259728 computations (46.5% saved)

rewrite6.0min (5.2%)

Algorithm

1676×

batch-egg-rewrite

Rules

966313×	`log1p-expm1-u`
745797×	`expm1-log1p-u`
569847×	`expm1-udef`
526196×	`prod-diff`
522889×	`log-prod`

Stop Event

1664×	node limit
12×	unsound

Counts

12980 → 442768

prune4.5min (3.9%)

Counts: 939024 → 33592
Compiler: Compiled 1556427 to 1020559 computations (34.4% saved)

series4.2min (3.7%)

Counts

12980 → 299755

Calls

79745 calls:

Time	Variable		Point	Expression
2.4min	x	@	inf	(pow.f64 (pow.f64 (-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x)) 3) 1/3)
366.0ms	x	@	0	(log.f64 (/.f64 x (*.f64 y z)))
358.0ms	w	@	-inf	(/.f32 (.f32 (pow.f32 (.f32 dX.v (floor.f32 h)) 2) -1/2) (*.f32 dX.u (floor.f32 w)))
328.0ms	x	@	inf	(-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x))
327.0ms	u2	@	0	(pow.f32 (cbrt.f32 (*.f32 (PI.f32) u2)) 3)

Results

bsearch2.8min (2.4%)

Algorithm

540×	left-value
4707×	binary-search

Stop Event

116×	predicate-same
4589×	narrow-enough
2×	predicate-failed

Results

1.5min	432835×	256	valid
41.3s	112075×	256	infinite
4.1s	22208×	256	invalid
7.6s	12398×	512	valid
3.8s	6301×	1024	valid
2.0s	2231×	512	infinite
1.7s	2126×	2048	valid
998.0ms	1097×	4096	valid
232.0ms	417×	1024	invalid
385.0ms	355×	1024	infinite
123.0ms	292×	512	invalid
135.0ms	168×	2048	invalid
23.0ms	152×	256	unsamplable
286.0ms	137×	2048	infinite
366.0ms	86×	4096	infinite
8.0ms	7×	8192	valid

Compiler

Compiled 1093936 to 814644 computations (25.5% saved)

analyze2.2min (1.9%)

Algorithm

544×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	84.4%	15.6%	0%	0%	0%	0
39.8%	33.6%	50.8%	15.6%	0%	0%	0%	1
45.6%	38.2%	45.5%	15.6%	0%	0.7%	0%	2
54.7%	44.6%	37%	15.8%	0%	2.7%	0%	3
61.3%	49.4%	31.2%	15.8%	0%	3.6%	0%	4
67.4%	54%	26.1%	15.8%	0%	4%	0%	5
71.3%	56.8%	22.9%	15.9%	0%	4.4%	0%	6
75.2%	59.5%	19.6%	15.9%	0%	4.9%	0.1%	7
77.2%	60.8%	17.9%	15.9%	0%	5.2%	0.1%	8
79.8%	62.6%	15.8%	16%	0%	5.5%	0.1%	9
81.4%	63.6%	14.6%	16%	0%	5.8%	0.1%	10
83.6%	65.2%	12.8%	16%	0%	5.9%	0.1%	11
84.7%	65.8%	11.9%	16%	0%	6.1%	0.1%	12

Compiler

Compiled 13437 to 8705 computations (35.2% saved)

Herbie run

sample24.1min (20.9%)

localize20.5min (17.8%)

soundness16.3min (14.1%)

eval11.1min (9.6%)

regimes9.0min (7.8%)

simplify8.4min (7.3%)

preprocess6.2min (5.4%)

rewrite6.0min (5.2%)

prune4.5min (3.9%)

series4.2min (3.7%)

bsearch2.8min (2.4%)

analyze2.2min (1.9%)

end223.0ms (0%)

Profiling