Metrics for Herbie run

Date:	Sunday, January 21st, 2024
Commit:	4a418bc7 on main
Hostname:	nightly with Racket 8.6
Seed:	2024021
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.7min (19%)

Results

46.6s	180253×	body	256	valid
15.7s	66920×	body	256	invalid
10.0s	42407×	body	256	infinite
7.5s	10872×	body	1024	valid
6.9s	9288×	body	2048	valid
4.0s	5620×	body	1024	invalid
3.6s	8385×	body	512	valid
2.3s	646×	body	4096	infinite
2.3s	1938×	body	4096	valid
1.6s	646×	body	2048	infinite
1.3s	2993×	body	512	invalid
1.1s	734×	body	8192	valid
237.0ms	382×	body	1024	infinite
159.0ms	385×	body	512	infinite
54.0ms	178×	body	256	unsamplable
7.0ms	8×	body	8192	exit

Bogosity

soundness1.5min (16.2%)

Rules

179942×	`fma-def`
163132×	`times-frac`
132248×	`associate-r`
104884×	`log-prod`
104174×	`associate-l`

Stop Event

6×	unsound
3×	saturated
337×	node limit

Compiler

Compiled 32804 to 19103 computations (41.8% saved)

localize1.4min (15.2%)

Compiler: Compiled 35938 to 18178 computations (49.4% saved)

eval1.0min (11.2%)

Compiler: Compiled 2728970 to 1697133 computations (37.8% saved)

regimes1.0min (11.1%)

Counts

9971 → 731

Calls

152 calls:

5.1s	l
3.4s	t
2.3s	F
2.0s	(sin.f64 ky)
1.8s	Vef

Compiler

Compiled 148585 to 79311 computations (46.6% saved)

simplify42.9s (7.9%)

Algorithm

147×	egg-herbie

Rules

94824×	`fma-def`
78070×	`times-frac`
64180×	`associate-r`
56666×	`*-commutative`
52450×	`associate-l`

Stop Event

3×	done
32×	saturated
28×	fuel
115×	node limit

Counts

65338 → 51991

Compiler

Compiled 11188 to 7430 computations (33.6% saved)

rewrite26.1s (4.8%)

Algorithm

116×	batch-egg-rewrite

Rules

53280×	`log1p-expm1-u`
38620×	`expm1-udef`
36744×	`expm1-log1p-u`
35004×	`prod-diff`
32822×	`log1p-udef`

Stop Event

4×	unsound
112×	node limit

Counts

1237 → 36759

prune25.3s (4.6%)

Counts: 83219 → 3000
Compiler: Compiled 213184 to 151551 computations (28.9% saved)

preprocess16.1s (2.9%)

Algorithm

31×	egg-herbie

Rules

40752×	`fma-def`
16598×	`fma-neg`
15324×	`div-sub`
14446×	`distribute-lft-neg-in`
13254×	`associate-/l*`

Stop Event

4×	saturated
27×	node limit

Compiler

Compiled 48378 to 29941 computations (38.1% saved)

bsearch16.0s (2.9%)

Algorithm

334×	binary-search
82×	left-value

Stop Event

328×	narrow-enough
6×	predicate-same

Results

9.6s	32212×	body	256	valid
2.3s	7604×	body	256	invalid
1.7s	6606×	body	256	infinite
485.0ms	1227×	body	1024	valid
266.0ms	238×	body	4096	valid
167.0ms	560×	body	512	valid
165.0ms	273×	body	2048	valid
81.0ms	205×	body	1024	invalid
80.0ms	79×	body	8192	valid
21.0ms	17×	body	4096	infinite
20.0ms	69×	body	512	invalid
13.0ms	19×	body	2048	infinite
11.0ms	29×	body	512	infinite
10.0ms	20×	body	1024	infinite
2.0ms	2×	body	8192	exit

Compiler

Compiled 100267 to 76090 computations (24.1% saved)

analyze11.6s (2.1%)

Algorithm

31×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	98.2%	1.8%	0%	0%	0%	0
23%	22.6%	75.6%	1.8%	0%	0%	0%	1
24.2%	23.3%	73.2%	1.8%	0%	1.6%	0%	2
29.6%	27.4%	65.2%	1.8%	0%	5.6%	0%	3
33.6%	30.4%	60.2%	1.8%	0%	7.3%	0.4%	4
35.9%	32.4%	57.9%	1.8%	0%	7.3%	0.6%	5
40.2%	36.2%	53.8%	1.8%	0%	7.5%	0.7%	6
45.3%	40.3%	48.7%	1.8%	0%	8.1%	1.1%	7
47.6%	41.8%	45.9%	1.8%	0%	9.4%	1.2%	8
50.6%	44.1%	43.1%	1.8%	0%	9.7%	1.2%	9
51.8%	44.9%	41.8%	1.8%	0%	10.1%	1.3%	10
53.5%	46.1%	40.1%	1.8%	0%	10.7%	1.3%	11
55.2%	47.2%	38.3%	1.8%	0%	11.3%	1.4%	12

Compiler

Compiled 845 to 607 computations (28.2% saved)

series10.7s (2%)

Counts

1237 → 28579

Calls

8535 calls:

Time	Variable		Point	Expression
171.0ms	t	@	-inf	(pow.f64 (asin.f64 (sqrt.f64 (/.f64 (-.f64 1 (pow.f64 (/.f64 Om Omc) 2)) (fma.f64 2 (pow.f64 (/.f64 t l) 2) 1)))) 1/6)
157.0ms	m	@	0	(*.f64 m (log.f64 k))
151.0ms	l	@	0	(sqrt.f64 (/.f64 (-.f64 1 (pow.f64 (/.f64 Om Omc) 2)) (+.f64 1 (.f64 2 (.f64 (*.f64 (/.f64 (sqrt.f64 t) l) t) (/.f64 (sqrt.f64 t) l))))))
131.0ms	Ec	@	-inf	(/.f64 (+.f64 mu (+.f64 EDonor (-.f64 Vef Ec))) KbT)
127.0ms	l	@	inf	(/.f64 2 (/.f64 (*.f64 (pow.f64 k 4) t) (pow.f64 l 2)))

Herbie run

sample1.7min (19%)

soundness1.5min (16.2%)

localize1.4min (15.2%)

eval1.0min (11.2%)

regimes1.0min (11.1%)

simplify42.9s (7.9%)

rewrite26.1s (4.8%)

prune25.3s (4.6%)

preprocess16.1s (2.9%)

bsearch16.0s (2.9%)

analyze11.6s (2.1%)

series10.7s (2%)

end21.0ms (0%)

Profiling