Metrics for Herbie run

Date:	Wednesday, January 10th, 2024
Commit:	3465769b on main
Hostname:	nightly with Racket 8.6
Seed:	2024010
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample23.3min (23.1%)

Results

10.4min	3476609×	body	256	valid
4.0min	39079×	body	8192	exit
1.6min	87510×	body	2048	valid
1.5min	534173×	body	256	infinite
1.4min	170394×	body	512	valid
1.3min	161402×	body	1024	valid
57.9s	12991×	body	4096	valid
35.9s	182067×	body	256	invalid
20.6s	1888×	body	8192	valid
14.4s	65386×	body	256	precondition
11.8s	12474×	body	512	infinite
8.2s	37747×	body	256	unsamplable
7.6s	11426×	body	1024	invalid
5.1s	1018×	body	4096	infinite
4.1s	1286×	body	2048	infinite
2.6s	6627×	body	512	invalid
2.4s	2033×	body	1024	infinite
1.3s	1191×	body	2048	invalid
8.0ms	10×	body	512	unsamplable
6.0ms	4×	body	1024	unsamplable
5.0ms	2×	body	8192	invalid
1.0ms	1×	body	4096	invalid

Bogosity

localize19.0min (18.9%)

Results

Compiler

Compiled 441482 to 200785 computations (54.5% saved)

soundness13.4min (13.3%)

Rules

2387382×	`fma-def`
1335268×	`associate-r`
1165676×	`times-frac`
1136552×	`log-prod`
1034196×	`fma-neg`

Stop Event

34×	unsound
116×	saturated
3364×	node limit

Compiler

Compiled 309551 to 177520 computations (42.7% saved)

eval10.2min (10.1%)

Compiler: Compiled 32061527 to 17221509 computations (46.3% saved)

regimes9.2min (9.1%)

Counts

87601 → 9116

Calls

1179 calls:

54.2s	x
46.5s	y
43.0s	z
33.2s	t
33.1s	a

Results

Compiler

Compiled 1507110 to 817932 computations (45.7% saved)

simplify6.9min (6.9%)

Algorithm

2219×

egg-herbie

Rules

1284150×	`fma-def`
860942×	`log-prod`
830336×	`associate-r`
738498×	`times-frac`
711932×	`associate-l`

Stop Event

19×	unsound
536×	saturated
122×	done
414×	fuel
1664×	node limit

Counts

752735 → 595481

Compiler

Compiled 122090 to 75694 computations (38% saved)

prune4.6min (4.6%)

Counts: 930478 → 35471
Compiler: Compiled 2598124 to 1775054 computations (31.7% saved)

rewrite4.2min (4.1%)

Algorithm

1683×

batch-egg-rewrite

Rules

984371×	`log1p-expm1-u`
751268×	`expm1-log1p-u`
581076×	`expm1-udef`
552932×	`prod-diff`
537472×	`log1p-udef`

Stop Event

11×	unsound
1672×	node limit

Counts

13133 → 448809

preprocess3.8min (3.8%)

Algorithm

540×	egg-herbie

Rules

721254×	`fma-def`
259182×	`fma-neg`
226530×	`sub-neg`
222024×	`div-sub`
211796×	`unsub-neg`

Stop Event

201×	saturated
339×	node limit

Compiler

Compiled 438263 to 237800 computations (45.7% saved)

bsearch2.4min (2.4%)

Algorithm

4572×	binary-search
593×	left-value

Stop Event

4463×	narrow-enough
109×	predicate-same

Results

1.4min	424367×	body	256	valid
29.8s	101733×	body	256	infinite
9.8s	17656×	body	512	valid
3.9s	7914×	body	1024	valid
3.8s	20265×	body	256	invalid
2.7s	3405×	body	2048	valid
1.2s	1307×	body	4096	valid
1.1s	1530×	body	512	infinite
335.0ms	1264×	body	512	invalid
278.0ms	304×	body	1024	invalid
166.0ms	176×	body	8192	valid
64.0ms	77×	body	2048	invalid
62.0ms	104×	body	1024	infinite
46.0ms	8×	body	4096	infinite
37.0ms	96×	body	256	unsamplable
6.0ms	8×	body	2048	infinite
1.0ms	1×	body	8192	exit

Compiler

Compiled 1118301 to 826131 computations (26.1% saved)

analyze2.1min (2%)

Algorithm

544×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	85.5%	14.5%	0%	0%	0%	0
39.9%	34.2%	51.4%	14.5%	0%	0%	0%	1
46.1%	39%	45.6%	14.5%	0%	0.9%	0%	2
55%	45.4%	37.1%	14.5%	0%	2.9%	0%	3
61.6%	50.2%	31.3%	14.5%	0%	3.9%	0%	4
67.6%	54.9%	26.3%	14.5%	0%	4.3%	0%	5
71.5%	57.7%	23%	14.5%	0%	4.6%	0%	6
75.3%	60.4%	19.8%	14.6%	0%	5.1%	0.1%	7
77.3%	61.7%	18.1%	14.6%	0%	5.5%	0.1%	8
79.8%	63.5%	16%	14.6%	0%	5.8%	0.1%	9
81.4%	64.4%	14.8%	14.6%	0%	6%	0.1%	10
83.6%	66.1%	13%	14.6%	0%	6.2%	0.1%	11
84.7%	66.7%	12.1%	14.6%	0%	6.4%	0.1%	12

Compiler

Compiled 13340 to 8644 computations (35.2% saved)

series1.6min (1.6%)

Counts

13133 → 303926

Calls

80661 calls:

Time	Variable		Point	Expression
4.8s	x	@	0	(-.f64 (log.f64 (sqrt.f64 x)) (log.f64 (/.f64 y (sqrt.f64 x))))
3.6s	x	@	0	(*.f64 x (-.f64 (log.f64 (sqrt.f64 x)) (log.f64 (/.f64 y (sqrt.f64 x)))))
622.0ms	x	@	-inf	(-.f64 (log.f64 (sqrt.f64 x)) (log.f64 (/.f64 y (sqrt.f64 x))))
335.0ms	x	@	0	(log.f64 (+.f64 1 (expm1.f64 (*.f64 x 564193179035109/500000000000000))))
308.0ms	l	@	0	(pow.f64 (*.f64 V (/.f64 l A)) 1/4)

Herbie run

sample23.3min (23.1%)

localize19.0min (18.9%)

soundness13.4min (13.3%)

eval10.2min (10.1%)

regimes9.2min (9.1%)

simplify6.9min (6.9%)

prune4.6min (4.6%)

rewrite4.2min (4.1%)

preprocess3.8min (3.8%)

bsearch2.4min (2.4%)

analyze2.1min (2%)

series1.6min (1.6%)

end106.0ms (0%)

Profiling