Metrics for Herbie run

Date:	Wednesday, November 29th, 2023
Commit:	1dabe179 on main
Hostname:	nightly with Racket 8.6
Seed:	2023333
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.4min (17.1%)

Results

35.3s	180011×	body	256	valid
11.0s	66460×	body	256	invalid
8.0s	42079×	body	256	infinite
6.1s	12356×	body	1024	valid
5.9s	10012×	body	2048	valid
3.3s	5868×	body	1024	invalid
3.0s	685×	body	4096	infinite
2.5s	6566×	body	512	valid
2.0s	2039×	body	4096	valid
1.4s	3048×	body	512	invalid
1.1s	650×	body	2048	infinite
702.0ms	763×	body	8192	valid
239.0ms	490×	body	1024	infinite
92.0ms	285×	body	512	infinite
42.0ms	201×	body	256	unsamplable
9.0ms	14×	body	8192	exit
2.0ms	3×	body	2048	invalid

Bogosity

soundness1.3min (16%)

Rules

179328×	`fma-def`
128226×	`associate-r`
123314×	`times-frac`
111056×	`log-prod`
91822×	`associate-l`

Stop Event

4×	unsound
4×	saturated
328×	node limit

Compiler

Compiled 35428 to 21501 computations (39.3% saved)

localize1.2min (15.1%)

Compiler: Compiled 36111 to 18271 computations (49.4% saved)

eval1.0min (13%)

Compiler: Compiled 2819720 to 1785329 computations (36.7% saved)

regimes54.0s (11.4%)

Counts

9728 → 764

Calls

152 calls:

5.3s	l
3.9s	t
3.2s	F
1.6s	h
1.6s	d

Compiler

Compiled 152421 to 88398 computations (42% saved)

simplify37.0s (7.8%)

Algorithm

151×	egg-herbie

Rules

97358×	`fma-def`
68222×	`associate-r`
66556×	`times-frac`
57828×	`log-prod`
57590×	`*-commutative`

Stop Event

3×	done
31×	saturated
28×	fuel
120×	node limit

Counts

63742 → 51225

Compiler

Compiled 13105 to 8681 computations (33.8% saved)

prune26.8s (5.7%)

Counts: 84447 → 2968
Compiler: Compiled 218969 to 156909 computations (28.3% saved)

rewrite20.2s (4.3%)

Algorithm

120×	batch-egg-rewrite

Rules

62572×	`log1p-expm1-u`
45115×	`expm1-log1p-u`
41798×	`expm1-udef`
37638×	`log-prod`
37240×	`log1p-udef`

Stop Event

2×	unsound
118×	node limit

Counts

1213 → 35692

preprocess14.6s (3.1%)

Algorithm

31×	egg-herbie

Rules

40752×	`fma-def`
16580×	`fma-neg`
15360×	`div-sub`
14408×	`distribute-lft-neg-in`
13246×	`associate-/l*`

Stop Event

4×	saturated
27×	node limit

Compiler

Compiled 38470 to 22199 computations (42.3% saved)

bsearch13.0s (2.8%)

Algorithm

376×	binary-search
74×	left-value

Stop Event

368×	narrow-enough
8×	predicate-same

Results

8.2s	36654×	body	256	valid
1.6s	7443×	body	256	infinite
1.0s	5827×	body	256	invalid
465.0ms	1131×	body	1024	valid
380.0ms	548×	body	2048	valid
150.0ms	499×	body	512	valid
44.0ms	125×	body	1024	invalid
38.0ms	67×	body	4096	valid
35.0ms	153×	body	512	invalid
28.0ms	51×	body	1024	infinite
9.0ms	14×	body	2048	infinite
8.0ms	25×	body	512	infinite

Compiler

Compiled 118674 to 89986 computations (24.2% saved)

series9.6s (2%)

Counts

1213 → 28050

Calls

8307 calls:

Time	Variable		Point	Expression
330.0ms	v	@	inf	(/.f64 (-.f64 1 (.f64 5 (.f64 v v))) (-.f64 (*.f64 v v) 1))
121.0ms	U	@	-inf	(pow.f64 (.f64 2 (.f64 n (*.f64 U t))) 1/4)
117.0ms	l	@	-inf	(log.f64 (.f64 -1/4 (/.f64 (.f64 (pow.f64 M 2) h) l)))
113.0ms	v	@	inf	(log.f64 (+.f64 1 (expm1.f64 (*.f64 5 (pow.f64 v 2)))))
95.0ms	U*	@	0	(sqrt.f64 (.f64 U (-.f64 t (fma.f64 2 (/.f64 (pow.f64 l 2) Om) (.f64 n (.f64 (-.f64 U U) (pow.f64 (/.f64 l Om) 2)))))))

analyze9.1s (1.9%)

Algorithm

31×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	98.2%	1.8%	0%	0%	0%	0
23%	22.6%	75.6%	1.8%	0%	0%	0%	1
24.2%	23.3%	73.2%	1.8%	0%	1.6%	0%	2
29.6%	27.4%	65.2%	1.8%	0%	5.6%	0%	3
33.6%	30.4%	60.2%	1.8%	0%	7.3%	0.4%	4
35.9%	32.4%	57.9%	1.8%	0%	7.3%	0.6%	5
40.2%	36.2%	53.8%	1.8%	0%	7.5%	0.7%	6
45.3%	40.3%	48.7%	1.8%	0%	8.1%	1.1%	7
47.6%	41.8%	45.9%	1.8%	0%	9.4%	1.2%	8
50.6%	44.1%	43.1%	1.8%	0%	9.7%	1.2%	9
51.7%	44.9%	41.9%	1.8%	0%	10.1%	1.3%	10
53.4%	46%	40.1%	1.8%	0%	10.7%	1.3%	11
55.2%	47.2%	38.3%	1.8%	0%	11.3%	1.4%	12

Compiler

Compiled 845 to 604 computations (28.5% saved)

Herbie run

sample1.4min (17.1%)

soundness1.3min (16%)

localize1.2min (15.1%)

eval1.0min (13%)

regimes54.0s (11.4%)

simplify37.0s (7.8%)

prune26.8s (5.7%)

rewrite20.2s (4.3%)

preprocess14.6s (3.1%)

bsearch13.0s (2.8%)

series9.6s (2%)

analyze9.1s (1.9%)

end14.0ms (0%)

Profiling