Metrics for Herbie run

Date:	Saturday, December 30th, 2023
Commit:	665878db on main
Hostname:	nightly with Racket 8.6
Seed:	2023364
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize7.6min (31.6%)

Results

Compiler

Compiled 85691 to 46320 computations (45.9% saved)

sample7.2min (30%)

Results

2.6min	16896×	body	8192	exit
59.8s	296149×	body	256	valid
56.3s	8245×	body	4096	valid
47.6s	42855×	body	1024	valid
30.9s	13303×	body	2048	valid
27.9s	1560×	body	8192	valid
16.0s	27698×	body	512	valid
7.2s	4107×	body	1024	infinite
6.1s	27933×	body	256	unsamplable
5.4s	27114×	body	256	infinite
4.5s	27679×	body	256	invalid
3.8s	604×	body	4096	infinite
3.1s	802×	body	2048	infinite
2.2s	2209×	body	512	infinite
1.6s	1193×	body	2048	invalid
1.2s	1672×	body	1024	invalid
655.0ms	1247×	body	512	invalid
352.0ms	25×	body	8192	infinite
102.0ms	946×	body	256	precondition
34.0ms	1×	body	8192	unsamplable
15.0ms	11×	body	1024	unsamplable
9.0ms	1×	body	4096	unsamplable
7.0ms	10×	body	512	unsamplable

Bogosity

eval2.0min (8.5%)

Compiler: Compiled 6440077 to 3871562 computations (39.9% saved)

regimes1.5min (6.2%)

Counts

17875 → 819

Calls

137 calls:

6.9s	phi2
6.6s	phi1
5.7s	lambda1
5.4s	lambda2
4.4s	(-.f64 lambda1 lambda2)

Compiler

Compiled 490451 to 263077 computations (46.4% saved)

soundness1.5min (6.1%)

Rules

260878×	`fma-def`
169812×	`associate-r`
132892×	`log-prod`
121626×	`times-frac`
119900×	`associate-l`

Stop Event

4×	saturated
12×	unsound
395×	node limit

Compiler

Compiled 49502 to 29817 computations (39.8% saved)

preprocess1.1min (4.6%)

Algorithm

51×	egg-herbie

Rules

76366×	`fma-def`
27180×	`div-sub`
26822×	`fma-neg`
24892×	`sub-neg`
22370×	`distribute-lft-in`

Stop Event

8×	saturated
43×	node limit

Compiler

Compiled 70456 to 44013 computations (37.5% saved)

simplify49.5s (3.4%)

Algorithm

220×	egg-herbie

Rules

142332×	`fma-def`
93678×	`associate-r`
79272×	`associate-l`
76382×	`*-commutative`
76320×	`log-prod`

Stop Event

3×	unsound
48×	saturated
6×	done
42×	fuel
169×	node limit

Counts

81302 → 66336

Compiler

Compiled 14955 to 10168 computations (32% saved)

prune48.6s (3.4%)

Counts: 140301 → 6181
Compiler: Compiled 654914 to 462068 computations (29.4% saved)

analyze36.3s (2.5%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
14.8%	11.8%	67.6%	20.6%	0%	0%	0%	1
22.6%	17.7%	60.4%	21%	0%	0.9%	0%	2
32.7%	24.7%	50.8%	21.2%	0%	3.3%	0%	3
39.8%	29.8%	45%	21.2%	0%	4%	0%	4
45.4%	33.8%	40.6%	21.2%	0%	4.5%	0%	5
48.4%	35.7%	38%	21.2%	0%	5.1%	0%	6
51.8%	37.8%	35.2%	21.2%	0%	5.7%	0.1%	7
53.5%	38.9%	33.8%	21.3%	0%	6%	0.1%	8
56.4%	40.6%	31.4%	21.3%	0%	6.6%	0.2%	9
57.7%	41.4%	30.3%	21.3%	0%	6.8%	0.2%	10
59.8%	42.7%	28.7%	21.3%	0%	7.1%	0.3%	11
61.3%	43.5%	27.5%	21.3%	0%	7.5%	0.3%	12

Compiler

Compiled 1919 to 1338 computations (30.3% saved)

rewrite25.6s (1.8%)

Algorithm

172×	batch-egg-rewrite

Rules

94674×	`log1p-expm1-u`
73225×	`expm1-log1p-u`
54862×	`expm1-udef`
52850×	`log1p-udef`
46576×	`log-prod`

Stop Event

3×	unsound
169×	node limit

Counts

1604 → 48209

bsearch17.2s (1.2%)

Algorithm

323×	binary-search
57×	left-value

Stop Event

317×	narrow-enough
6×	predicate-same

Results

6.2s	27976×	body	256	valid
3.1s	3580×	body	1024	valid
2.4s	2695×	body	2048	valid
1.9s	1755×	body	4096	valid
1.2s	2033×	body	512	valid
785.0ms	3919×	body	256	invalid
293.0ms	373×	body	1024	invalid
228.0ms	295×	body	2048	invalid
127.0ms	287×	body	512	invalid
97.0ms	541×	body	256	infinite
30.0ms	50×	body	1024	infinite
24.0ms	58×	body	512	infinite

Compiler

Compiled 86510 to 65587 computations (24.2% saved)

series11.8s (0.8%)

Counts

1604 → 33093

Calls

9225 calls:

Time	Variable		Point	Expression
122.0ms	lambda1	@	-inf	(-.f64 (exp.f64 (log1p.f64 (acos.f64 (fma.f64 (cos.f64 phi1) (.f64 (cos.f64 phi2) (cos.f64 (-.f64 lambda2 lambda1))) (.f64 (sin.f64 phi1) (sin.f64 phi2)))))) 1)
89.0ms	phi1	@	-inf	(expm1.f64 (log1p.f64 (.f64 R (hypot.f64 (.f64 (cos.f64 (*.f64 (+.f64 phi1 phi2) 1/2)) (-.f64 lambda1 lambda2)) (-.f64 phi1 phi2)))))
83.0ms	a	@	0	(pow.f64 (exp.f64 1/6) (-.f64 (neg.f64 (log.f64 a)) (log.f64 (/.f64 -1 g))))
81.0ms	c	@	0	(-.f64 (exp.f64 (log1p.f64 (/.f64 (.f64 c (.f64 a -3/2)) (.f64 (.f64 a 3) b)))) 1)
73.0ms	lambda1	@	-inf	(-.f64 (exp.f64 (log1p.f64 (*.f64 (sin.f64 lambda2) (sin.f64 lambda1)))) 1)

Results

Herbie run

localize7.6min (31.6%)

sample7.2min (30%)

eval2.0min (8.5%)

regimes1.5min (6.2%)

soundness1.5min (6.1%)

preprocess1.1min (4.6%)

simplify49.5s (3.4%)

prune48.6s (3.4%)

analyze36.3s (2.5%)

rewrite25.6s (1.8%)

bsearch17.2s (1.2%)

series11.8s (0.8%)

end19.0ms (0%)

Profiling