Metrics for Herbie run

Date:	Saturday, November 18th, 2023
Commit:	fb1f2946 on main
Hostname:	nightly with Racket 8.6
Seed:	2023322
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize8.2min (32.9%)

Results

Compiler

Compiled 82383 to 43946 computations (46.7% saved)

sample7.6min (30.2%)

Results

2.6min	16903×	body	8192	exit
1.2min	64673×	body	1024	valid
57.1s	8190×	body	4096	valid
52.5s	269614×	body	256	valid
31.8s	13298×	body	2048	valid
28.3s	1596×	body	8192	valid
18.2s	32369×	body	512	valid
7.3s	4088×	body	1024	infinite
5.8s	27447×	body	256	unsamplable
5.8s	27058×	body	256	infinite
3.8s	529×	body	4096	infinite
3.7s	21328×	body	256	invalid
3.5s	819×	body	2048	infinite
2.5s	5359×	body	2048	invalid
2.1s	2248×	body	512	infinite
1.6s	3815×	body	1024	invalid
607.0ms	2245×	body	512	invalid
344.0ms	20×	body	8192	infinite
115.0ms	905×	body	256	precondition
2.0ms	3×	body	512	unsamplable
2.0ms	8×	body	4096	invalid

Bogosity

eval2.2min (8.8%)

Compiler: Compiled 6418357 to 3738765 computations (41.7% saved)

regimes1.5min (6%)

Counts

18254 → 744

Calls

137 calls:

8.4s	phi1
7.6s	lambda1
6.3s	phi2
6.2s	lambda2
4.1s	(-.f64 lambda1 lambda2)

Results

Compiler

Compiled 460274 to 242252 computations (47.4% saved)

soundness1.4min (5.5%)

Rules

232528×	`fma-def`
166844×	`associate-r`
131420×	`associate-l`
123028×	`times-frac`
118396×	`log-prod`

Stop Event

5×	saturated
8×	unsound
372×	node limit

Compiler

Compiled 42686 to 24954 computations (41.5% saved)

preprocess1.1min (4.3%)

Algorithm

51×	egg-herbie

Rules

76366×	`fma-def`
27180×	`div-sub`
26822×	`fma-neg`
24892×	`sub-neg`
22370×	`distribute-lft-in`

Stop Event

8×	saturated
43×	node limit

Compiler

Compiled 38192 to 20341 computations (46.7% saved)

simplify50.2s (3.3%)

Algorithm

213×	egg-herbie

Rules

129812×	`fma-def`
96456×	`associate-r`
82730×	`associate-l`
77600×	`times-frac`
75656×	`log-prod`

Stop Event

2×	unsound
47×	saturated
8×	done
39×	fuel
164×	node limit

Counts

79425 → 63903

Compiler

Compiled 11906 to 7796 computations (34.5% saved)

prune50.1s (3.3%)

Counts: 145440 → 6371
Compiler: Compiled 655666 to 460044 computations (29.8% saved)

analyze34.3s (2.3%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
19.6%	15.5%	63.8%	20.6%	0%	0%	0%	1
27.1%	21.4%	57.6%	21%	0%	0%	0%	2
36.8%	28.5%	48.9%	21.2%	0%	1.4%	0%	3
42.3%	32.2%	43.9%	21.2%	0%	2.8%	0%	4
47.2%	35.4%	39.6%	21.2%	0%	3.8%	0%	5
50.2%	37.2%	36.9%	21.2%	0%	4.6%	0%	6
53.6%	39.3%	34%	21.2%	0%	5.4%	0.1%	7
55.3%	40.3%	32.5%	21.3%	0%	5.8%	0.1%	8
58.3%	42%	30.1%	21.3%	0%	6.4%	0.2%	9
59.6%	42.8%	29%	21.3%	0%	6.7%	0.2%	10
61.9%	44.2%	27.2%	21.3%	0%	7.1%	0.3%	11
63.3%	45%	26%	21.3%	0%	7.4%	0.3%	12

Compiler

Compiled 1919 to 1338 computations (30.3% saved)

rewrite24.5s (1.6%)

Algorithm

166×	batch-egg-rewrite

Rules

96219×	`log1p-expm1-u`
71073×	`expm1-log1p-u`
57366×	`expm1-udef`
53906×	`log1p-udef`
49558×	`prod-diff`

Stop Event

3×	unsound
163×	node limit

Counts

1563 → 45898

bsearch17.6s (1.2%)

Algorithm

270×	binary-search
48×	left-value

Stop Event

265×	narrow-enough
5×	predicate-same

Results

7.7s	7344×	body	1024	valid
4.2s	20695×	body	256	valid
1.7s	2803×	body	512	valid
1.4s	1117×	body	2048	valid
998.0ms	398×	body	4096	valid
377.0ms	58×	body	2048	infinite
307.0ms	1861×	body	256	invalid
135.0ms	17×	body	4096	infinite
105.0ms	91×	body	1024	infinite
85.0ms	386×	body	256	infinite
28.0ms	67×	body	512	infinite
4.0ms	8×	body	1024	invalid
3.0ms	5×	body	2048	invalid
3.0ms	9×	body	512	invalid

Compiler

Compiled 74380 to 54405 computations (26.9% saved)

series9.1s (0.6%)

Counts

1563 → 33527

Calls

9090 calls:

Time	Variable		Point	Expression
90.0ms	g	@	0	(/.f64 (cbrt.f64 (*.f64 g 1/2)) (cbrt.f64 a))
77.0ms	a	@	0	(pow.f64 (*.f64 a c) 3/2)
65.0ms	g	@	-inf	(*.f64 (cbrt.f64 (/.f64 1 a)) (cbrt.f64 g))
60.0ms	a	@	0	(exp.f64 (.f64 1/4 (+.f64 (log.f64 (.f64 4 a)) (*.f64 -1 (log.f64 (/.f64 -1 c))))))
59.0ms	a	@	-inf	(log.f64 (*.f64 1/2 (/.f64 (-.f64 (sqrt.f64 (-.f64 (pow.f64 g 2) (pow.f64 h 2))) g) a)))

Herbie run

localize8.2min (32.9%)

sample7.6min (30.2%)

eval2.2min (8.8%)

regimes1.5min (6%)

soundness1.4min (5.5%)

preprocess1.1min (4.3%)

simplify50.2s (3.3%)

prune50.1s (3.3%)

analyze34.3s (2.3%)

rewrite24.5s (1.6%)

bsearch17.6s (1.2%)

series9.1s (0.6%)

end14.0ms (0%)

Profiling