Metrics for Herbie run

Date:	Wednesday, November 29th, 2023
Commit:	1dabe179 on main
Hostname:	nightly with Racket 8.6
Seed:	2023333
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize7.4min (30.8%)

Results

Compiler

Compiled 85683 to 46558 computations (45.7% saved)

sample7.2min (30%)

Results

2.6min	17173×	body	8192	exit
59.2s	296825×	body	256	valid
56.1s	8194×	body	4096	valid
48.6s	42816×	body	1024	valid
31.1s	13342×	body	2048	valid
27.3s	1579×	body	8192	valid
15.4s	27420×	body	512	valid
7.1s	4128×	body	1024	infinite
6.1s	27876×	body	256	unsamplable
5.2s	26712×	body	256	infinite
4.6s	27619×	body	256	invalid
3.9s	590×	body	4096	infinite
3.4s	867×	body	2048	infinite
2.2s	2211×	body	512	infinite
1.3s	1194×	body	2048	invalid
1.3s	1704×	body	1024	invalid
625.0ms	1149×	body	512	invalid
301.0ms	22×	body	8192	infinite
85.0ms	872×	body	256	precondition
8.0ms	6×	body	1024	unsamplable
6.0ms	9×	body	512	unsamplable

Bogosity

eval2.1min (8.8%)

Compiler: Compiled 6586044 to 3933876 computations (40.3% saved)

regimes1.6min (6.6%)

Counts

19228 → 744

Calls

138 calls:

7.6s	phi2
7.3s	phi1
6.1s	lambda1
5.7s	lambda2
4.0s	(-.f64 lambda1 lambda2)

Results

Compiler

Compiled 541940 to 296080 computations (45.4% saved)

soundness1.4min (6%)

Rules

286820×	`fma-def`
175922×	`associate-r`
127400×	`log-prod`
124792×	`associate-l`
120464×	`*-commutative`

Stop Event

8×	unsound
5×	saturated
404×	node limit

Compiler

Compiled 52431 to 31853 computations (39.2% saved)

preprocess1.1min (4.6%)

Algorithm

51×	egg-herbie

Rules

76366×	`fma-def`
27180×	`div-sub`
26822×	`fma-neg`
24892×	`sub-neg`
22370×	`distribute-lft-in`

Stop Event

8×	saturated
43×	node limit

Compiler

Compiled 46104 to 26205 computations (43.2% saved)

prune53.1s (3.7%)

Counts: 146223 → 6520
Compiler: Compiled 695140 to 488321 computations (29.8% saved)

simplify49.8s (3.5%)

Algorithm

224×	egg-herbie

Rules

152762×	`fma-def`
102120×	`associate-r`
83252×	`associate-l`
80458×	`times-frac`
79454×	`*-commutative`

Stop Event

2×	unsound
48×	saturated
6×	done
42×	fuel
174×	node limit

Counts

78824 → 66777

Compiler

Compiled 15172 to 10235 computations (32.5% saved)

analyze35.0s (2.4%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
14.8%	11.8%	67.6%	20.6%	0%	0%	0%	1
22.6%	17.7%	60.4%	21%	0%	0.9%	0%	2
32.7%	24.7%	50.8%	21.2%	0%	3.3%	0%	3
39.8%	29.8%	45%	21.2%	0%	4%	0%	4
45.4%	33.8%	40.6%	21.2%	0%	4.5%	0%	5
48.4%	35.7%	38%	21.2%	0%	5.1%	0%	6
51.8%	37.8%	35.2%	21.2%	0%	5.7%	0.1%	7
53.5%	38.9%	33.8%	21.3%	0%	6%	0.1%	8
56.4%	40.6%	31.4%	21.3%	0%	6.6%	0.2%	9
57.7%	41.4%	30.3%	21.3%	0%	6.8%	0.2%	10
59.8%	42.7%	28.7%	21.3%	0%	7.1%	0.3%	11
61.3%	43.5%	27.5%	21.3%	0%	7.5%	0.3%	12

Compiler

Compiled 1919 to 1338 computations (30.3% saved)

rewrite25.9s (1.8%)

Algorithm

176×	batch-egg-rewrite

Rules

98387×	`log1p-expm1-u`
76994×	`expm1-log1p-u`
60294×	`expm1-udef`
53568×	`log1p-udef`
49336×	`log-prod`

Stop Event

4×	unsound
172×	node limit

Counts

1578 → 46023

series14.3s (1%)

Counts

1578 → 32801

Calls

9123 calls:

Time	Variable		Point	Expression
302.0ms	F	@	0	(sqrt.f64 (.f64 (.f64 2 (.f64 (-.f64 (pow.f64 B 2) (.f64 (*.f64 4 A) C)) F)) (+.f64 A (hypot.f64 B A))))
272.0ms	F	@	0	(/.f64 (neg.f64 (sqrt.f64 (.f64 (.f64 2 (.f64 (-.f64 (pow.f64 B 2) (.f64 (.f64 4 A) C)) F)) (+.f64 A (hypot.f64 B A))))) (-.f64 (pow.f64 B 2) (.f64 (*.f64 4 A) C)))
260.0ms	B	@	0	(/.f64 (neg.f64 (sqrt.f64 (.f64 (.f64 2 (.f64 (-.f64 (pow.f64 B 2) (.f64 (.f64 4 A) C)) F)) (+.f64 A (hypot.f64 B A))))) (-.f64 (pow.f64 B 2) (.f64 (*.f64 4 A) C)))
162.0ms	x-scale	@	inf	(log.f64 (pow.f64 (exp.f64 (pow.f64 (.f64 x-scale y-scale) 2)) (pow.f64 (.f64 a b) -2)))
125.0ms	phi1	@	inf	(log.f64 (+.f64 1 (expm1.f64 (fma.f64 (cos.f64 lambda2) (cos.f64 phi2) (cos.f64 phi1)))))

bsearch13.8s (1%)

Algorithm

244×	binary-search
71×	left-value

Stop Event

234×	narrow-enough
10×	predicate-same

Results

4.7s	22322×	body	256	valid
4.3s	4052×	body	1024	valid
1.4s	2259×	body	512	valid
1.3s	963×	body	2048	valid
633.0ms	553×	body	4096	valid
290.0ms	1838×	body	256	invalid
64.0ms	320×	body	256	infinite
56.0ms	101×	body	1024	invalid
53.0ms	63×	body	1024	infinite
48.0ms	70×	body	2048	invalid
22.0ms	44×	body	512	infinite
17.0ms	45×	body	512	invalid

Compiler

Compiled 86578 to 64058 computations (26% saved)

Herbie run

localize7.4min (30.8%)

sample7.2min (30%)

eval2.1min (8.8%)

regimes1.6min (6.6%)

soundness1.4min (6%)

preprocess1.1min (4.6%)

prune53.1s (3.7%)

simplify49.8s (3.5%)

analyze35.0s (2.4%)

rewrite25.9s (1.8%)

series14.3s (1%)

bsearch13.8s (1%)

end25.0ms (0%)

Profiling