Metrics for Herbie run

Date:	Thursday, July 27th, 2023
Commit:	7791686b on docs-link-fix
Hostname:	nightly with Racket 8.6
Seed:	2023208
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample22.3min (24.4%)

Results

8.4min	3324896×	body	256	valid
3.9min	47631×	body	8192	exit
2.8min	274531×	body	1024	valid
1.7min	98777×	body	2048	valid
1.3min	531217×	body	256	infinite
1.0min	14235×	body	4096	valid
51.2s	147986×	body	512	valid
43.4s	256915×	body	256	invalid
28.1s	2388×	body	8192	valid
15.0s	20769×	body	1024	infinite
9.6s	51337×	body	256	unsamplable
7.8s	16115×	body	1024	invalid
7.1s	1245×	body	4096	infinite
5.3s	1627×	body	2048	infinite
5.2s	11216×	body	512	infinite
2.6s	8788×	body	512	invalid
2.0s	5405×	body	2048	invalid
946.0ms	3048×	body	256	precondition
425.0ms	491×	body	1024	unsamplable
357.0ms	26×	body	8192	infinite
148.0ms	284×	body	2048	unsamplable
57.0ms	223×	body	512	unsamplable
4.0ms	12×	body	4096	invalid
2.0ms	1×	body	8192	invalid

Bogosity

localize18.9min (20.7%)

Results

Compiler

Compiled 386653 to 183519 computations (52.5% saved)

soundness12.0min (13.1%)

Rules

2799658×	`fma-def`
1616970×	`associate-r`
1383394×	`log-prod`
1271290×	`associate-l`
1235624×	`fma-neg`

Stop Event

24×	unsound
222×	saturated
3600×	node limit

Compiler

Compiled 338357 to 195777 computations (42.1% saved)

regimes8.6min (9.4%)

Counts

88642 → 10156

Calls

1158 calls:

58.0s	x
47.5s	y
40.2s	z
39.1s	t
29.5s	a

Compiler

Compiled 1373635 to 701936 computations (48.9% saved)

eval8.4min (9.2%)

Results

Compiler

Compiled 27687160 to 15056963 computations (45.6% saved)

simplify6.4min (7%)

Algorithm

2738×

egg-herbie

Rules

1854370×	`fma-def`
1018206×	`associate-r`
910752×	`log-prod`
871200×	`associate-l`
866982×	`fma-neg`

Stop Event

13×	unsound
814×	saturated
124×	done
409×	fuel
1911×	node limit

Counts

726012 → 573002

Compiler

Compiled 133707 to 83126 computations (37.8% saved)

prune4.2min (4.5%)

Counts: 873633 → 36037
Compiler: Compiled 2437378 to 1656046 computations (32.1% saved)

rewrite3.3min (3.6%)

Algorithm

1669×

batch-egg-rewrite

Rules

1108734×	`pow1`
1047272×	`add-exp-log`
1046164×	`log1p-expm1-u`
1045990×	`expm1-log1p-u`
996604×	`add-log-exp`

Stop Event

8×	unsound
1661×	node limit

Counts

13468 → 407784

bsearch2.6min (2.9%)

Algorithm

5295×	binary-search
668×	left-value

Stop Event

5185×	narrow-enough
110×	predicate-same

Results

1.4min	478328×	body	256	valid
26.5s	116099×	body	256	infinite
17.5s	25809×	body	1024	valid
6.8s	17137×	body	512	valid
3.3s	21625×	body	256	invalid
3.2s	6086×	body	1024	infinite
2.8s	3944×	body	2048	valid
1.1s	1039×	body	4096	valid
895.0ms	2733×	body	512	infinite
420.0ms	335×	body	8192	valid
332.0ms	288×	body	2048	infinite
300.0ms	760×	body	1024	invalid
156.0ms	401×	body	512	invalid
155.0ms	41×	body	4096	infinite
41.0ms	60×	body	2048	invalid
35.0ms	230×	body	256	unsamplable
13.0ms	1×	body	8192	infinite
2.0ms	2×	body	8192	exit
1.0ms	4×	body	1024	unsamplable

Compiler

Compiled 1262494 to 924157 computations (26.8% saved)

preprocess2.0min (2.2%)

Algorithm

536×	egg-herbie

Rules

704136×	`fma-def`
261454×	`fma-neg`
211808×	`sub-neg`
201670×	`div-sub`
191518×	`unsub-neg`

Stop Event

208×	saturated
328×	node limit

Compiler

Compiled 306989 to 157492 computations (48.7% saved)

analyze1.4min (1.6%)

Algorithm

540×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	86.8%	13.2%	0%	0%	0%	0
40.5%	35.1%	51.6%	13.2%	0%	0%	0%	1
46.5%	40.1%	46.1%	13.3%	0%	0.6%	0%	2
56.2%	47.7%	37.3%	13.3%	0%	1.8%	0%	3
62.2%	52.5%	31.9%	13.3%	0%	2.4%	0%	4
67.9%	57%	27%	13.3%	0%	2.7%	0%	5
71.6%	59.8%	23.7%	13.3%	0%	3.2%	0%	6
75.5%	62.4%	20.3%	13.3%	0%	4.1%	0%	7
77.3%	63.6%	18.7%	13.3%	0%	4.4%	0%	8
79.8%	65.3%	16.5%	13.3%	0%	4.9%	0.1%	9
81.4%	66.2%	15.1%	13.3%	0%	5.3%	0.1%	10
83.6%	67.7%	13.3%	13.3%	0%	5.7%	0.1%	11
84.7%	68.3%	12.3%	13.3%	0%	6%	0.1%	12

Compiler

Compiled 11868 to 8225 computations (30.7% saved)

series1.2min (1.4%)

Counts

13468 → 317692

Calls

82494 calls:

Time	Variable		Point	Expression
366.0ms	t	@	inf	(.f64 (.f64 y z) (-.f64 (tanh.f64 (/.f64 t y)) (/.f64 (expm1.f64 (*.f64 (/.f64 x y) 2)) (+.f64 1 (pow.f64 (exp.f64 2) (/.f64 x y))))))
344.0ms	x	@	0	(-.f64 (/.f64 (+.f64 1 (.f64 x (.f64 x -707281/11664))) (+.f64 1 (*.f64 x -841/108))) 1)
310.0ms	w0	@	0	(.f64 w0 (sqrt.f64 (+.f64 1 (.f64 (/.f64 (.f64 D h) (.f64 (/.f64 l D) (*.f64 (/.f64 d M) (/.f64 d M)))) -1/4))))
292.0ms	x	@	inf	(fma.f64 x (/.f64 x (.f64 y y)) (/.f64 z (.f64 t (/.f64 t z))))
286.0ms	y	@	inf	(.f64 y (exp.f64 (.f64 -2 (*.f64 a b))))

Herbie run

sample22.3min (24.4%)

localize18.9min (20.7%)

soundness12.0min (13.1%)

regimes8.6min (9.4%)

eval8.4min (9.2%)

simplify6.4min (7%)

prune4.2min (4.5%)

rewrite3.3min (3.6%)

bsearch2.6min (2.9%)

preprocess2.0min (2.2%)

analyze1.4min (1.6%)

series1.2min (1.4%)

end218.0ms (0%)

Profiling