Metrics for Herbie run

Date:	Friday, July 14th, 2023
Commit:	132e0c53 on result-filters
Hostname:	nightly with Racket 8.6
Seed:	2023195
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.7min (22%)

Results

29.8s	155199×	body	256	valid
17.6s	29316×	body	1024	valid
11.1s	67036×	body	256	invalid
7.9s	7847×	body	8192	exit
7.1s	39337×	body	256	infinite
6.1s	10326×	body	2048	valid
5.4s	13813×	body	512	valid
3.1s	5708×	body	1024	invalid
2.5s	644×	body	4096	infinite
2.3s	1990×	body	4096	valid
1.6s	8014×	body	256	unsamplable
1.2s	609×	body	2048	infinite
1.1s	2456×	body	1024	infinite
992.0ms	3160×	body	512	invalid
696.0ms	803×	body	8192	valid
466.0ms	1443×	body	512	infinite

Bogosity

soundness1.3min (17.8%)

Rules

263168×	`fma-def`
200160×	`associate-r`
162934×	`associate-l`
156668×	`times-frac`
138294×	`*-commutative`

Stop Event

5×	unsound
6×	saturated
417×	node limit

Compiler

Compiled 42788 to 24269 computations (43.3% saved)

localize1.1min (15.1%)

Compiler: Compiled 36401 to 16140 computations (55.7% saved)

regimes53.7s (11.9%)

Counts

10637 → 909

Calls

152 calls:

5.2s	l
2.3s	t
2.3s	(sin.f64 ky)
1.9s	F
1.7s	d

Compiler

Compiled 167520 to 82391 computations (50.8% saved)

eval41.4s (9.2%)

Compiler: Compiled 2395826 to 1325375 computations (44.7% saved)

simplify31.9s (7.1%)

Algorithm

177×	egg-herbie

Rules

118614×	`fma-def`
84134×	`associate-r`
73418×	`times-frac`
72714×	`associate-l`
67572×	`*-commutative`

Stop Event

3×	done
37×	saturated
28×	fuel
140×	node limit

Counts

58301 → 44398

Compiler

Compiled 14205 to 9108 computations (35.9% saved)

prune19.6s (4.3%)

Counts: 66107 → 3118
Compiler: Compiled 220146 to 148160 computations (32.7% saved)

bsearch17.4s (3.8%)

Algorithm

415×	binary-search
131×	left-value

Stop Event

411×	narrow-enough
4×	predicate-same

Results

6.8s	34243×	body	256	valid
3.1s	4659×	body	1024	valid
1.7s	8708×	body	256	infinite
1.7s	9028×	body	256	invalid
1.2s	2241×	body	512	valid
428.0ms	711×	body	4096	valid
350.0ms	280×	body	8192	valid
302.0ms	672×	body	1024	infinite
258.0ms	575×	body	2048	valid
204.0ms	450×	body	512	infinite
192.0ms	305×	body	1024	invalid
27.0ms	122×	body	512	invalid
2.0ms	4×	body	2048	infinite
1.0ms	1×	body	4096	infinite

Compiler

Compiled 127580 to 93508 computations (26.7% saved)

rewrite13.9s (3.1%)

Algorithm

115×	batch-egg-rewrite

Rules

83990×	`pow1`
79368×	`add-exp-log`
79276×	`log1p-expm1-u`
79266×	`expm1-log1p-u`
76044×	`add-log-exp`

Stop Event

2×	unsound
113×	node limit

Counts

1251 → 26706

analyze9.6s (2.1%)

Algorithm

31×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	98.2%	1.8%	0%	0%	0%	0
23%	22.6%	75.6%	1.8%	0%	0%	0%	1
24.2%	23.3%	73.2%	1.8%	0%	1.6%	0%	2
30.2%	28.2%	65.2%	1.8%	0%	4.8%	0%	3
34%	31.2%	60.6%	1.8%	0%	6.4%	0%	4
36.2%	33.2%	58.5%	1.8%	0%	6.4%	0%	5
40.4%	37%	54.5%	1.8%	0%	6.6%	0%	6
45.4%	41.1%	49.4%	1.8%	0%	7.3%	0.4%	7
47.7%	42.6%	46.7%	1.8%	0%	8.6%	0.4%	8
50.6%	44.9%	43.9%	1.8%	0%	8.9%	0.5%	9
51.7%	45.7%	42.7%	1.8%	0%	9.3%	0.5%	10
53.4%	46.8%	40.9%	1.8%	0%	9.9%	0.6%	11
55.1%	48%	39.1%	1.8%	0%	10.5%	0.6%	12

Compiler

Compiled 845 to 604 computations (28.5% saved)

series7.8s (1.7%)

Counts

1251 → 31564

Calls

8715 calls:

Time	Variable		Point	Expression
159.0ms	l	@	-inf	(.f64 (/.f64 (/.f64 (/.f64 2 k) k) t) (.f64 (cbrt.f64 (pow.f64 (/.f64 l (sin.f64 k)) 3)) (/.f64 l (tan.f64 k))))
106.0ms	a	@	0	(*.f64 a (/.f64 (pow.f64 k m) (fma.f64 k (+.f64 k 10) 1)))
73.0ms	th	@	inf	(/.f64 (cos.f64 th) (pow.f64 2 1/4))
69.0ms	A	@	0	(pow.f64 (/.f64 A (*.f64 V l)) 1/4)
68.0ms	f	@	0	(*.f64 (/.f64 1 (/.f64 (PI.f64) 4)) (-.f64 (log.f64 (/.f64 (/.f64 2 (PI.f64)) 1/2)) (log.f64 f)))

end6.0s (1.3%)

Compiler: Compiled 28008 to 14576 computations (48% saved)

preprocess2.4s (0.5%)

Algorithm

62×	egg-herbie

Rules

28786×	`fma-def`
14268×	`fma-neg`
13542×	`associate-*r/`
12824×	`associate-r`
12316×	`distribute-lft-in`

Stop Event

7×	unsound
30×	saturated
25×	node limit

Compiler

Compiled 904 to 666 computations (26.3% saved)

sample1.7min (22%)

soundness1.3min (17.8%)

localize1.1min (15.1%)

regimes53.7s (11.9%)

eval41.4s (9.2%)

simplify31.9s (7.1%)

prune19.6s (4.3%)

bsearch17.4s (3.8%)

rewrite13.9s (3.1%)

analyze9.6s (2.1%)

series7.8s (1.7%)

end6.0s (1.3%)

preprocess2.4s (0.5%)

Profiling