Metrics for Herbie run

Date:	Saturday, January 20th, 2024
Commit:	d8d592a2 on error-explanations-2
Hostname:	nightly with Racket 8.6
Seed:	2024020
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample24.5min (21.2%)

Results

11.0min	3476963×	body	256	valid
4.2min	39522×	body	8192	exit
1.7min	87998×	body	2048	valid
1.6min	533418×	body	256	infinite
1.5min	169947×	body	512	valid
1.4min	162034×	body	1024	valid
1.0min	13015×	body	4096	valid
39.5s	181543×	body	256	invalid
21.6s	1862×	body	8192	valid
13.7s	66988×	body	256	precondition
11.2s	12272×	body	512	infinite
9.1s	40071×	body	256	unsamplable
8.3s	11426×	body	1024	invalid
5.2s	992×	body	4096	infinite
4.8s	1283×	body	2048	infinite
3.2s	2016×	body	1024	infinite
3.0s	6506×	body	512	invalid
1.7s	1166×	body	2048	invalid
34.0ms	1×	body	8192	unsamplable
9.0ms	6×	body	1024	unsamplable
3.0ms	4×	body	512	unsamplable
3.0ms	2×	body	4096	invalid
3.0ms	1×	body	8192	invalid

Bogosity

localize21.3min (18.4%)

Results

Compiler

Compiled 450247 to 197670 computations (56.1% saved)

soundness16.0min (13.8%)

Rules

2333023×	`fma-def`
1306527×	`associate-r`
1165054×	`times-frac`
1076528×	`log-prod`
1028696×	`associate-l`

Stop Event

33×	unsound
123×	saturated
3425×	node limit

Compiler

Compiled 314184 to 177327 computations (43.6% saved)

eval10.8min (9.3%)

Compiler: Compiled 40948692 to 17506972 computations (57.2% saved)

regimes9.3min (8%)

Counts

81374 → 9245

Calls

1172 calls:

59.8s	x
54.8s	y
50.3s	z
39.9s	t
39.6s	a

Compiler

Compiled 1307560 to 702439 computations (46.3% saved)

simplify8.0min (6.9%)

Algorithm

2201×

egg-herbie

Rules

1249298×	`fma-def`
817282×	`log-prod`
804412×	`associate-r`
723155×	`times-frac`
696235×	`associate-l`

Stop Event

21×	unsound
535×	saturated
131×	done
404×	fuel
1645×	node limit

Counts

751239 → 594304

Compiler

Compiled 122194 to 76203 computations (37.6% saved)

preprocess6.3min (5.4%)

Algorithm

540×	egg-herbie

Rules

688760×	`fma-def`
250704×	`fma-neg`
220606×	`sub-neg`
215885×	`div-sub`
202671×	`unsub-neg`

Stop Event

201×	saturated
339×	node limit

Compiler

Compiled 480741 to 257286 computations (46.5% saved)

rewrite5.9min (5.1%)

Algorithm

1666×

batch-egg-rewrite

Rules

957532×	`log1p-expm1-u`
729745×	`expm1-log1p-u`
568494×	`prod-diff`
551376×	`expm1-udef`
504331×	`log1p-udef`

Stop Event

11×	unsound
1655×	node limit

Counts

13119 → 449662

prune4.8min (4.1%)

Counts

941121 → 34536

Results

Compiler

Compiled 2541472 to 1713358 computations (32.6% saved)

series4.1min (3.6%)

Counts

13119 → 301577

Calls

79967 calls:

Time	Variable		Point	Expression
2.5min	x	@	inf	(pow.f64 (pow.f64 (-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x)) 3) 1/3)
663.0ms	x	@	0	(log.f64 (cbrt.f64 (pow.f64 (exp.f64 x) 27061/100000)))
405.0ms	x	@	inf	(-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x))
389.0ms	a	@	0	(pow.f64 (sqrt.f64 (cbrt.f64 (/.f64 (*.f64 a 2) g))) -2)
380.0ms	x	@	-inf	(fma.f64 (.f64 2 z) x (.f64 x t))

Results

bsearch2.6min (2.3%)

Algorithm

4753×	binary-search
577×	left-value

Stop Event

4647×	narrow-enough
2×	predicate-failed
104×	predicate-same

Results

1.5min	452984×	body	256	valid
32.3s	98907×	body	256	infinite
8.0s	15929×	body	512	valid
3.8s	7899×	body	1024	valid
3.3s	18553×	body	256	invalid
2.8s	3228×	body	2048	valid
2.3s	3120×	body	512	infinite
1.4s	1351×	body	4096	valid
156.0ms	202×	body	8192	exit
107.0ms	173×	body	1024	infinite
31.0ms	71×	body	1024	invalid
21.0ms	121×	body	256	unsamplable
19.0ms	60×	body	512	invalid
12.0ms	13×	body	8192	valid
10.0ms	12×	body	2048	infinite
3.0ms	4×	body	2048	invalid

Compiler

Compiled 1099994 to 816606 computations (25.8% saved)

analyze2.2min (1.9%)

Algorithm

544×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	85.5%	14.5%	0%	0%	0%	0
39.9%	34.2%	51.4%	14.5%	0%	0%	0%	1
46.1%	39%	45.6%	14.5%	0%	0.9%	0%	2
55%	45.4%	37.1%	14.5%	0%	2.9%	0%	3
61.6%	50.2%	31.3%	14.5%	0%	3.9%	0%	4
67.6%	54.9%	26.3%	14.5%	0%	4.3%	0%	5
71.5%	57.7%	23%	14.5%	0%	4.6%	0%	6
75.3%	60.4%	19.8%	14.6%	0%	5.1%	0.1%	7
77.3%	61.7%	18.1%	14.6%	0%	5.5%	0.1%	8
79.8%	63.5%	16%	14.6%	0%	5.8%	0.1%	9
81.4%	64.4%	14.8%	14.6%	0%	6%	0.1%	10
83.6%	66.1%	13%	14.6%	0%	6.2%	0.1%	11
84.7%	66.7%	12.1%	14.6%	0%	6.4%	0.1%	12

Compiler

Compiled 13340 to 8644 computations (35.2% saved)

Herbie run

sample24.5min (21.2%)

localize21.3min (18.4%)

soundness16.0min (13.8%)

eval10.8min (9.3%)

regimes9.3min (8%)

simplify8.0min (6.9%)

preprocess6.3min (5.4%)

rewrite5.9min (5.1%)

prune4.8min (4.1%)

series4.1min (3.6%)

bsearch2.6min (2.3%)

analyze2.2min (1.9%)

end288.0ms (0%)

Profiling