Metrics for Herbie run

Date:	Wednesday, November 15th, 2023
Commit:	2a8b6e90 on cleanup-reprs
Hostname:	nightly with Racket 8.6
Seed:	2023319
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.7min (20.6%)

Results

29.6s	155445×	body	256	valid
18.3s	29313×	body	1024	valid
11.4s	67115×	body	256	invalid
8.8s	7946×	body	8192	exit
7.1s	39059×	body	256	infinite
6.0s	10104×	body	2048	valid
5.9s	13949×	body	512	valid
3.4s	5815×	body	1024	invalid
2.3s	640×	body	4096	infinite
2.2s	2053×	body	4096	valid
1.5s	8286×	body	256	unsamplable
1.5s	663×	body	2048	infinite
1.2s	3045×	body	512	invalid
1.1s	2412×	body	1024	infinite
928.0ms	813×	body	8192	valid
526.0ms	1485×	body	512	infinite
3.0ms	4×	body	2048	invalid

Bogosity

localize1.4min (16.3%)

Compiler: Compiled 37330 to 19866 computations (46.8% saved)

soundness1.2min (14.5%)

Rules

194836×	`fma-def`
141016×	`associate-r`
138856×	`times-frac`
120296×	`log-prod`
116984×	`associate-l`

Stop Event

5×	unsound
4×	saturated
339×	node limit

Compiler

Compiled 32966 to 20142 computations (38.9% saved)

regimes55.8s (11.2%)

Counts

9366 → 832

Calls

152 calls:

5.7s	l
2.8s	NaChar
2.5s	F
2.3s	t
2.0s	EAccept

Compiler

Compiled 140113 to 80904 computations (42.3% saved)

eval54.9s (11%)

Compiler: Compiled 2665725 to 1702822 computations (36.1% saved)

simplify36.5s (7.3%)

Algorithm

148×	egg-herbie

Rules

95462×	`fma-def`
74188×	`associate-r`
74016×	`times-frac`
63564×	`associate-l`
54662×	`*-commutative`

Stop Event

3×	done
31×	saturated
28×	fuel
117×	node limit

Counts

64784 → 49747

Compiler

Compiled 14141 to 9386 computations (33.6% saved)

prune24.3s (4.9%)

Counts: 80899 → 3090
Compiler: Compiled 226638 to 165003 computations (27.2% saved)

rewrite19.3s (3.9%)

Algorithm

117×	batch-egg-rewrite

Rules

57673×	`log1p-expm1-u`
42804×	`expm1-udef`
41693×	`expm1-log1p-u`
40746×	`log1p-udef`
29740×	`prod-diff`

Stop Event

1×	unsound
116×	node limit

Counts

1262 → 35629

bsearch16.9s (3.4%)

Algorithm

393×	binary-search
103×	left-value

Stop Event

389×	narrow-enough
4×	predicate-same

Results

6.4s	29576×	body	256	valid
3.7s	4977×	body	1024	valid
1.8s	7570×	body	256	infinite
1.6s	7127×	body	256	invalid
1.0s	2491×	body	512	valid
478.0ms	831×	body	1024	infinite
241.0ms	116×	body	4096	infinite
189.0ms	425×	body	512	infinite
175.0ms	131×	body	4096	valid
168.0ms	253×	body	2048	valid
106.0ms	84×	body	2048	infinite
35.0ms	106×	body	1024	invalid
22.0ms	101×	body	512	invalid
20.0ms	26×	body	8192	valid

Compiler

Compiled 116457 to 88441 computations (24.1% saved)

preprocess15.5s (3.1%)

Algorithm

31×	egg-herbie

Rules

40752×	`fma-def`
16580×	`fma-neg`
15360×	`div-sub`
14408×	`distribute-lft-neg-in`
13246×	`associate-/l*`

Stop Event

4×	saturated
27×	node limit

Compiler

Compiled 39676 to 23045 computations (41.9% saved)

analyze9.9s (2%)

Algorithm

31×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	98.2%	1.8%	0%	0%	0%	0
23%	22.6%	75.6%	1.8%	0%	0%	0%	1
24.2%	23.3%	73.2%	1.8%	0%	1.6%	0%	2
30.2%	28.2%	65.2%	1.8%	0%	4.8%	0%	3
34%	31.2%	60.6%	1.8%	0%	6.4%	0%	4
36.2%	33.2%	58.5%	1.8%	0%	6.4%	0%	5
40.4%	37%	54.5%	1.8%	0%	6.6%	0%	6
45.4%	41.1%	49.4%	1.8%	0%	7.3%	0.4%	7
47.7%	42.6%	46.7%	1.8%	0%	8.6%	0.4%	8
50.6%	44.9%	43.9%	1.8%	0%	8.9%	0.5%	9
51.7%	45.7%	42.7%	1.8%	0%	9.3%	0.5%	10
53.4%	46.8%	40.9%	1.8%	0%	9.9%	0.6%	11
55.1%	48%	39.1%	1.8%	0%	10.5%	0.6%	12

Compiler

Compiled 845 to 604 computations (28.5% saved)

series9.8s (2%)

Counts

1262 → 29155

Calls

8631 calls:

Time	Variable		Point	Expression
278.0ms	Omc	@	-inf	(log1p.f64 (asin.f64 (sqrt.f64 (-.f64 1 (pow.f64 (/.f64 Om Omc) 2)))))
236.0ms	v	@	-inf	(.f64 (PI.f64) (.f64 t (sqrt.f64 (.f64 2 (-.f64 1 (.f64 (*.f64 3 v) v))))))
233.0ms	k	@	0	(log.f64 (pow.f64 (exp.f64 (pow.f64 k 4)) (pow.f64 l -2)))
151.0ms	M	@	0	(log.f64 (*.f64 -1/4 (/.f64 (pow.f64 M 2) (/.f64 l h))))
132.0ms	k	@	-inf	(pow.f64 (.f64 2 (.f64 (/.f64 (PI.f64) k) n)) 3/2)

Herbie run

sample1.7min (20.6%)

localize1.4min (16.3%)

soundness1.2min (14.5%)

regimes55.8s (11.2%)

eval54.9s (11%)

simplify36.5s (7.3%)

prune24.3s (4.9%)

rewrite19.3s (3.9%)

bsearch16.9s (3.4%)

preprocess15.5s (3.1%)

analyze9.9s (2%)

series9.8s (2%)

end16.0ms (0%)

Profiling