Metrics for Herbie run

Date:	Friday, August 18th, 2023
Commit:	5f639494 on main
Hostname:	nightly with Racket 8.6
Seed:	2023230
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample22.3min (24.7%)

Results

8.4min	3326450×	body	256	valid
3.9min	47085×	body	8192	exit
2.8min	275196×	body	1024	valid
1.7min	98444×	body	2048	valid
1.3min	528354×	body	256	infinite
1.0min	14545×	body	4096	valid
50.9s	149229×	body	512	valid
43.6s	256633×	body	256	invalid
29.3s	2394×	body	8192	valid
14.3s	20219×	body	1024	infinite
8.9s	49633×	body	256	unsamplable
7.1s	15717×	body	1024	invalid
6.1s	1197×	body	4096	infinite
5.1s	1674×	body	2048	infinite
5.0s	11155×	body	512	infinite
2.4s	8747×	body	512	invalid
2.2s	5431×	body	2048	invalid
741.0ms	2962×	body	256	precondition
413.0ms	29×	body	8192	infinite
218.0ms	316×	body	2048	unsamplable
169.0ms	480×	body	1024	unsamplable
114.0ms	2×	body	8192	unsamplable
64.0ms	247×	body	512	unsamplable
4.0ms	12×	body	4096	invalid
2.0ms	1×	body	8192	invalid

Bogosity

localize18.7min (20.8%)

Results

Compiler

Compiled 383731 to 181408 computations (52.7% saved)

soundness11.6min (12.8%)

Rules

2742744×	`fma-def`
1610884×	`associate-r`
1379172×	`log-prod`
1269556×	`associate-l`
1248272×	`times-frac`

Stop Event

29×	unsound
219×	saturated
3576×	node limit

Compiler

Compiled 334480 to 193869 computations (42% saved)

regimes8.2min (9.2%)

Counts

87978 → 10053

Calls

1158 calls:

52.1s	x
45.8s	y
41.8s	z
35.0s	t
28.1s	a

Compiler

Compiled 1311391 to 692705 computations (47.2% saved)

eval8.2min (9.1%)

Results

Compiler

Compiled 27033298 to 14589260 computations (46% saved)

simplify6.4min (7.1%)

Algorithm

2760×

egg-herbie

Rules

1865812×	`fma-def`
1083792×	`associate-r`
936794×	`log-prod`
931002×	`associate-l`
882210×	`times-frac`

Stop Event

11×	unsound
815×	saturated
123×	done
410×	fuel
1934×	node limit

Counts

746168 → 588420

Compiler

Compiled 129774 to 80974 computations (37.6% saved)

prune4.2min (4.6%)

Counts: 878692 → 36612
Compiler: Compiled 2484091 to 1688481 computations (32% saved)

rewrite3.3min (3.6%)

Algorithm

1690×

batch-egg-rewrite

Rules

1123548×	`pow1`
1061224×	`add-exp-log`
1060132×	`log1p-expm1-u`
1059942×	`expm1-log1p-u`
1021198×	`add-log-exp`

Stop Event

12×	unsound
1678×	node limit

Counts

13763 → 419820

bsearch2.6min (2.9%)

Algorithm

5293×	binary-search
633×	left-value

Stop Event

5181×	narrow-enough
112×	predicate-same

Results

1.3min	468119×	body	256	valid
27.2s	120778×	body	256	infinite
19.7s	27317×	body	1024	valid
6.1s	15605×	body	512	valid
3.2s	4256×	body	2048	valid
2.7s	6195×	body	1024	infinite
2.6s	19550×	body	256	invalid
1.3s	1602×	body	4096	valid
812.0ms	2681×	body	512	infinite
212.0ms	263×	body	8192	valid
109.0ms	333×	body	1024	invalid
84.0ms	71×	body	2048	infinite
54.0ms	9×	body	4096	infinite
22.0ms	91×	body	512	invalid
12.0ms	90×	body	256	unsamplable
1.0ms	1×	body	8192	exit
0.0ms	1×	body	512	unsamplable

Compiler

Compiled 1226613 to 906100 computations (26.1% saved)

preprocess2.1min (2.3%)

Algorithm

536×	egg-herbie

Rules

704136×	`fma-def`
261454×	`fma-neg`
211808×	`sub-neg`
201670×	`div-sub`
191518×	`unsub-neg`

Stop Event

208×	saturated
328×	node limit

Compiler

Compiled 297393 to 154914 computations (47.9% saved)

analyze1.4min (1.5%)

Algorithm

540×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	86.8%	13.2%	0%	0%	0%	0
40.5%	35.1%	51.6%	13.2%	0%	0%	0%	1
46.5%	40.1%	46.1%	13.3%	0%	0.6%	0%	2
56.2%	47.7%	37.3%	13.3%	0%	1.8%	0%	3
62.2%	52.5%	31.9%	13.3%	0%	2.4%	0%	4
67.9%	57%	27%	13.3%	0%	2.7%	0%	5
71.6%	59.8%	23.7%	13.3%	0%	3.2%	0%	6
75.5%	62.4%	20.3%	13.3%	0%	4.1%	0%	7
77.3%	63.6%	18.7%	13.3%	0%	4.4%	0%	8
79.8%	65.3%	16.5%	13.3%	0%	4.9%	0.1%	9
81.4%	66.2%	15.1%	13.3%	0%	5.3%	0.1%	10
83.6%	67.7%	13.3%	13.3%	0%	5.7%	0.1%	11
84.7%	68.3%	12.3%	13.3%	0%	6%	0.1%	12

Compiler

Compiled 11868 to 8225 computations (30.7% saved)

series1.3min (1.4%)

Counts

13763 → 325812

Calls

83913 calls:

Time	Variable		Point	Expression
416.0ms	phi1	@	inf	(log.f64 (/.f64 (exp.f64 (cos.f64 delta)) (exp.f64 (.f64 (sin.f64 phi1) (fma.f64 (sin.f64 delta) (.f64 (cos.f64 phi1) (cos.f64 theta)) (*.f64 (cos.f64 delta) (sin.f64 phi1)))))))
362.0ms	x	@	0	(*.f64 (pow.f64 2 1/4) x)
308.0ms	y	@	-inf	(log.f64 (/.f64 y x))
295.0ms	N	@	-inf	(pow.f64 (atan2.f64 1 (+.f64 1 (fma.f64 N N N))) 1/4)
279.0ms	c	@	0	(fma.f64 x (log.f64 y) (+.f64 a (fma.f64 (+.f64 b -1/2) (log.f64 c) z)))

Herbie run

sample22.3min (24.7%)

localize18.7min (20.8%)

soundness11.6min (12.8%)

regimes8.2min (9.2%)

eval8.2min (9.1%)

simplify6.4min (7.1%)

prune4.2min (4.6%)

rewrite3.3min (3.6%)

bsearch2.6min (2.9%)

preprocess2.1min (2.3%)

analyze1.4min (1.5%)

series1.3min (1.4%)

end159.0ms (0%)

Profiling