Metrics for Herbie run

Date:	Saturday, August 26th, 2023
Commit:	5f639494 on main
Hostname:	nightly with Racket 8.6
Seed:	2023238
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample22.4min (24.3%)

Results

8.5min	3328177×	body	256	valid
3.9min	47463×	body	8192	exit
2.8min	274301×	body	1024	valid
1.6min	98270×	body	2048	valid
1.4min	528220×	body	256	infinite
1.0min	14458×	body	4096	valid
52.1s	149046×	body	512	valid
46.9s	256982×	body	256	invalid
27.7s	2301×	body	8192	valid
15.0s	20341×	body	1024	infinite
9.0s	49895×	body	256	unsamplable
7.9s	16348×	body	1024	invalid
6.2s	1228×	body	4096	infinite
5.4s	1654×	body	2048	infinite
4.7s	10915×	body	512	infinite
2.6s	8727×	body	512	invalid
2.0s	5431×	body	2048	invalid
762.0ms	3063×	body	256	precondition
360.0ms	24×	body	8192	infinite
191.0ms	432×	body	1024	unsamplable
164.0ms	292×	body	2048	unsamplable
70.0ms	271×	body	512	unsamplable
5.0ms	7×	body	4096	invalid
5.0ms	2×	body	8192	invalid

Bogosity

localize20.1min (21.8%)

Results

Compiler

Compiled 398223 to 189509 computations (52.4% saved)

soundness11.5min (12.4%)

Rules

2764602×	`fma-def`
1592052×	`associate-r`
1416302×	`log-prod`
1279294×	`associate-l`
1275690×	`times-frac`

Stop Event

19×	unsound
214×	saturated
3601×	node limit

Compiler

Compiled 343187 to 197978 computations (42.3% saved)

eval8.8min (9.6%)

Compiler: Compiled 28290867 to 15374500 computations (45.7% saved)

regimes8.3min (9%)

Counts

89824 → 10093

Calls

1147 calls:

57.8s	x
44.7s	y
38.3s	z
32.5s	a
29.9s	t

Compiler

Compiled 1403768 to 731115 computations (47.9% saved)

simplify6.5min (7%)

Algorithm

2757×

egg-herbie

Rules

1863884×	`fma-def`
1061752×	`associate-r`
912318×	`associate-l`
902912×	`log-prod`
887910×	`times-frac`

Stop Event

13×	unsound
813×	saturated
132×	done
400×	fuel
1931×	node limit

Counts

736223 → 584034

Compiler

Compiled 132644 to 82555 computations (37.8% saved)

prune4.1min (4.5%)

Counts

890280 → 36254

Results

Compiler

Compiled 2506620 to 1694446 computations (32.4% saved)

rewrite3.3min (3.6%)

Algorithm

1689×

batch-egg-rewrite

Rules

1114896×	`pow1`
1054228×	`add-exp-log`
1053218×	`log1p-expm1-u`
1052994×	`expm1-log1p-u`
1012956×	`add-log-exp`

Stop Event

8×	unsound
1681×	node limit

Counts

13666 → 413011

bsearch2.7min (2.9%)

Algorithm

5287×	binary-search
598×	left-value

Stop Event

5147×	narrow-enough
140×	predicate-same

Results

1.3min	468914×	body	256	valid
30.1s	117560×	body	256	infinite
17.8s	23810×	body	1024	valid
7.1s	15736×	body	512	valid
3.7s	24706×	body	256	invalid
3.2s	3601×	body	2048	valid
2.3s	4407×	body	1024	infinite
1.6s	1186×	body	4096	valid
780.0ms	2081×	body	512	infinite
453.0ms	166×	body	2048	infinite
439.0ms	63×	body	4096	infinite
296.0ms	204×	body	8192	valid
123.0ms	355×	body	1024	invalid
49.0ms	167×	body	512	invalid
15.0ms	19×	body	2048	invalid
3.0ms	25×	body	256	unsamplable
2.0ms	4×	body	512	unsamplable
2.0ms	5×	body	1024	unsamplable
1.0ms	1×	body	8192	exit

Compiler

Compiled 1245414 to 911267 computations (26.8% saved)

preprocess2.0min (2.2%)

Algorithm

536×	egg-herbie

Rules

704136×	`fma-def`
261454×	`fma-neg`
211808×	`sub-neg`
201670×	`div-sub`
191518×	`unsub-neg`

Stop Event

208×	saturated
328×	node limit

Compiler

Compiled 301375 to 155900 computations (48.3% saved)

analyze1.4min (1.5%)

Algorithm

540×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	86.8%	13.2%	0%	0%	0%	0
40.5%	35.1%	51.6%	13.2%	0%	0%	0%	1
46.5%	40.1%	46.1%	13.3%	0%	0.6%	0%	2
56.2%	47.7%	37.3%	13.3%	0%	1.8%	0%	3
62.2%	52.5%	31.9%	13.3%	0%	2.4%	0%	4
67.9%	57%	27%	13.3%	0%	2.7%	0%	5
71.6%	59.8%	23.7%	13.3%	0%	3.2%	0%	6
75.5%	62.4%	20.3%	13.3%	0%	4.1%	0%	7
77.3%	63.6%	18.7%	13.3%	0%	4.4%	0%	8
79.8%	65.3%	16.5%	13.3%	0%	4.9%	0.1%	9
81.4%	66.2%	15.1%	13.3%	0%	5.3%	0.1%	10
83.6%	67.7%	13.3%	13.3%	0%	5.7%	0.1%	11
84.7%	68.3%	12.3%	13.3%	0%	6%	0.1%	12

Compiler

Compiled 11868 to 8225 computations (30.7% saved)

series1.2min (1.3%)

Counts

13666 → 322676

Calls

83163 calls:

Time	Variable		Point	Expression
398.0ms	a	@	inf	(log.f64 (.f64 (pow.f64 t (-.f64 a 1/2)) (.f64 (+.f64 y x) z)))
320.0ms	y	@	-inf	(-.f64 (.f64 y y) (.f64 x x))
171.0ms	x	@	0	(*.f64 x (log.f64 y))
168.0ms	M	@	0	(log.f64 (.f64 (pow.f64 (/.f64 D d) 2) (/.f64 M (/.f64 (/.f64 l w0) (.f64 M h)))))
161.0ms	z	@	-inf	(+.f64 x (*.f64 (-.f64 y z) (/.f64 (-.f64 t x) (-.f64 a z))))

Herbie run

sample22.4min (24.3%)

localize20.1min (21.8%)

soundness11.5min (12.4%)

eval8.8min (9.6%)

regimes8.3min (9%)

simplify6.5min (7%)

prune4.1min (4.5%)

rewrite3.3min (3.6%)

bsearch2.7min (2.9%)

preprocess2.0min (2.2%)

analyze1.4min (1.5%)

series1.2min (1.3%)

end124.0ms (0%)

Profiling