Metrics for Herbie run

Date:	Thursday, July 27th, 2023
Commit:	7791686b on docs-link-fix
Hostname:	nightly with Racket 8.6
Seed:	2023208
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize8.2min (35.1%)

Results

Compiler

Compiled 90873 to 43993 computations (51.6% saved)

sample7.6min (32.5%)

Results

2.6min	17056×	body	8192	exit
1.2min	64775×	body	1024	valid
56.7s	8082×	body	4096	valid
52.2s	269369×	body	256	valid
32.6s	13682×	body	2048	valid
27.4s	1562×	body	8192	valid
17.2s	32007×	body	512	valid
7.4s	4345×	body	1024	infinite
5.9s	27942×	body	256	unsamplable
5.5s	27347×	body	256	infinite
4.6s	584×	body	4096	infinite
3.8s	21415×	body	256	invalid
3.5s	794×	body	2048	infinite
2.2s	2119×	body	512	infinite
2.0s	5398×	body	2048	invalid
1.6s	3723×	body	1024	invalid
696.0ms	2112×	body	512	invalid
357.0ms	26×	body	8192	infinite
95.0ms	997×	body	256	precondition
8.0ms	6×	body	1024	unsamplable
6.0ms	9×	body	512	unsamplable
3.0ms	11×	body	4096	invalid

Bogosity

eval1.9min (8.2%)

Results

Compiler

Compiled 6660541 to 3523072 computations (47.1% saved)

soundness1.3min (5.7%)

Rules

329344×	`fma-def`
197302×	`associate-r`
173200×	`log-prod`
155990×	`associate-l`
143034×	`times-frac`

Stop Event

3×	unsound
15×	saturated
407×	node limit

Compiler

Compiled 45845 to 26294 computations (42.6% saved)

regimes1.1min (4.8%)

Counts

16113 → 780

Calls

137 calls:

6.3s	phi1
5.4s	phi2
4.7s	lambda2
4.6s	lambda1
3.8s	b

Compiler

Compiled 370101 to 164765 computations (55.5% saved)

simplify52.0s (3.7%)

Algorithm

277×	egg-herbie

Rules

204722×	`fma-def`
117824×	`associate-r`
100070×	`associate-l`
91606×	`times-frac`
87504×	`fma-neg`

Stop Event

2×	unsound
65×	saturated
6×	done
42×	fuel
210×	node limit

Counts

77902 → 62505

Compiler

Compiled 14300 to 9230 computations (35.5% saved)

prune44.4s (3.2%)

Counts: 143265 → 6662
Compiler: Compiled 688254 to 460054 computations (33.2% saved)

analyze34.9s (2.5%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
19.6%	15.5%	63.8%	20.6%	0%	0%	0%	1
27.1%	21.4%	57.6%	21%	0%	0%	0%	2
36.8%	28.5%	48.9%	21.2%	0%	1.4%	0%	3
42.3%	32.2%	43.9%	21.2%	0%	2.8%	0%	4
47.2%	35.4%	39.6%	21.2%	0%	3.8%	0%	5
50.2%	37.2%	36.9%	21.2%	0%	4.6%	0%	6
53.6%	39.3%	34%	21.2%	0%	5.4%	0.1%	7
55.3%	40.3%	32.5%	21.3%	0%	5.8%	0.1%	8
58.3%	42%	30.1%	21.3%	0%	6.4%	0.2%	9
59.6%	42.8%	29%	21.3%	0%	6.7%	0.2%	10
61.9%	44.2%	27.2%	21.3%	0%	7.1%	0.3%	11
63.3%	45%	26%	21.3%	0%	7.4%	0.3%	12

Compiler

Compiled 1919 to 1338 computations (30.3% saved)

rewrite21.3s (1.5%)

Algorithm

178×	batch-egg-rewrite

Rules

122078×	`pow1`
115740×	`add-exp-log`
115640×	`log1p-expm1-u`
115604×	`expm1-log1p-u`
107422×	`add-log-exp`

Stop Event

3×	unsound
175×	node limit

Counts

1684 → 40770

bsearch17.2s (1.2%)

Algorithm

286×	binary-search
57×	left-value

Stop Event

281×	narrow-enough
5×	predicate-same

Results

7.7s	7218×	body	1024	valid
4.4s	23375×	body	256	valid
1.4s	2447×	body	512	valid
1.3s	1421×	body	2048	valid
520.0ms	476×	body	4096	valid
361.0ms	1887×	body	256	invalid
255.0ms	1053×	body	256	infinite
153.0ms	248×	body	1024	infinite
114.0ms	19×	body	4096	infinite
71.0ms	115×	body	1024	invalid
70.0ms	20×	body	2048	infinite
54.0ms	137×	body	512	infinite
41.0ms	60×	body	2048	invalid
31.0ms	85×	body	512	invalid
13.0ms	1×	body	8192	infinite
12.0ms	1×	body	8192	valid

Compiler

Compiled 89443 to 63811 computations (28.7% saved)

preprocess11.7s (0.8%)

Algorithm

51×	egg-herbie

Rules

66624×	`fma-def`
26490×	`fma-neg`
25742×	`div-sub`
23584×	`sub-neg`
22428×	`distribute-lft-neg-in`

Stop Event

10×	saturated
41×	node limit

Compiler

Compiled 33028 to 17066 computations (48.3% saved)

series11.2s (0.8%)

Counts

1684 → 37081

Calls

9645 calls:

Time	Variable		Point	Expression
275.0ms	phi1	@	-inf	(log.f64 (+.f64 1 (expm1.f64 (.f64 (sin.f64 delta) (.f64 (cos.f64 phi1) (sin.f64 theta))))))
148.0ms	phi1	@	inf	(log.f64 (+.f64 1 (expm1.f64 (.f64 (sin.f64 delta) (.f64 (cos.f64 phi1) (sin.f64 theta))))))
102.0ms	a	@	-inf	(pow.f64 (*.f64 c a) 4)
69.0ms	phi1	@	-inf	(log1p.f64 (-.f64 (.f64 (cos.f64 (.f64 phi2 1/2)) (cos.f64 (.f64 phi1 1/2))) (.f64 (sin.f64 (.f64 phi2 1/2)) (sin.f64 (.f64 phi1 1/2)))))
62.0ms	b	@	0	(/.f64 (pow.f64 c 3) (/.f64 (pow.f64 b 5) (*.f64 a a)))

Herbie run

localize8.2min (35.1%)

sample7.6min (32.5%)

eval1.9min (8.2%)

soundness1.3min (5.7%)

regimes1.1min (4.8%)

simplify52.0s (3.7%)

prune44.4s (3.2%)

analyze34.9s (2.5%)

rewrite21.3s (1.5%)

bsearch17.2s (1.2%)

preprocess11.7s (0.8%)

series11.2s (0.8%)

end38.0ms (0%)

Profiling