Metrics for Herbie run

Date:	Monday, August 28th, 2023
Commit:	5f639494 on main
Hostname:	nightly with Racket 8.6
Seed:	2023240
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.4min (32.4%)

Results

29.7s	33211×	body	2048	valid
26.1s	62551×	body	1024	valid
11.2s	86220×	body	256	valid
8.4s	33663×	body	512	valid
1.5s	13100×	body	256	infinite
1.4s	2080×	body	4096	valid
998.0ms	1156×	body	1024	invalid
735.0ms	7623×	body	256	unsamplable
509.0ms	5174×	body	256	invalid
275.0ms	580×	body	512	invalid
190.0ms	490×	body	1024	unsamplable
162.0ms	315×	body	2048	unsamplable
123.0ms	139×	body	1024	infinite
95.0ms	200×	body	512	infinite
51.0ms	222×	body	512	unsamplable
33.0ms	8×	body	2048	invalid
4.0ms	2×	body	8192	valid
0.0ms	2×	body	2048	infinite

Bogosity

localize37.0s (14.6%)

Compiler: Compiled 14187 to 7532 computations (46.9% saved)

soundness34.2s (13.5%)

Rules

151992×	`fma-def`
77322×	`times-frac`
76128×	`associate-r`
74368×	`fma-neg`
72850×	`log-prod`

Stop Event

8×	saturated
214×	node limit

Compiler

Compiled 20427 to 12549 computations (38.6% saved)

eval26.9s (10.6%)

Compiler: Compiled 1350893 to 798694 computations (40.9% saved)

simplify19.1s (7.5%)

Algorithm

155×	egg-herbie

Rules

93690×	`fma-def`
56838×	`associate-r`
55718×	`fma-neg`
54776×	`times-frac`
52436×	`associate-l`

Stop Event

3×	done
47×	saturated
25×	fuel
108×	node limit

Counts

36501 → 36308

Compiler

Compiled 3891 to 2645 computations (32% saved)

prune13.0s (5.1%)

Counts: 55261 → 2407
Compiler: Compiled 120205 to 82367 computations (31.5% saved)

regimes11.7s (4.6%)

Counts

4452 → 339

Calls

43 calls:

2.7s	x
2.3s	eps
1.2s	a
961.0ms	c
577.0ms	b_2

Compiler

Compiled 51099 to 27553 computations (46.1% saved)

rewrite10.9s (4.3%)

Algorithm

99×	batch-egg-rewrite

Rules

62204×	`pow1`
59184×	`add-exp-log`
59178×	`log1p-expm1-u`
59142×	`expm1-log1p-u`
55670×	`add-log-exp`

Stop Event

99×	node limit

Counts

776 → 24755

preprocess6.6s (2.6%)

Algorithm

28×	egg-herbie

Rules

42740×	`fma-def`
13078×	`fma-neg`
9294×	`associate-/r*`
9220×	`div-sub`
9054×	`distribute-rgt-in`

Stop Event

13×	saturated
15×	node limit

Compiler

Compiled 9278 to 5679 computations (38.8% saved)

bsearch4.7s (1.8%)

Algorithm

128×	binary-search
25×	left-value

Stop Event

126×	narrow-enough
2×	predicate-same

Results

2.5s	12342×	body	256	valid
828.0ms	2339×	body	1024	valid
406.0ms	636×	body	2048	valid
355.0ms	1220×	body	512	valid
108.0ms	1189×	body	256	invalid
32.0ms	181×	body	256	infinite
14.0ms	22×	body	1024	infinite
10.0ms	54×	body	256	unsamplable
4.0ms	12×	body	512	infinite
3.0ms	7×	body	1024	unsamplable

Compiler

Compiled 27920 to 20000 computations (28.4% saved)

series4.6s (1.8%)

Counts

776 → 11718

Calls

3510 calls:

Time	Variable		Point	Expression
511.0ms	x	@	inf	(-.f64 (sqrt.f64 (cbrt.f64 (pow.f64 (+.f64 x 1) 2))) (cbrt.f64 x))
123.0ms	eps	@	0	(pow.f64 (cbrt.f64 (-.f64 (tan.f64 (+.f64 x eps)) (tan.f64 x))) 3)
90.0ms	x	@	inf	(log.f64 (cbrt.f64 (tan.f64 (+.f64 x eps))))
78.0ms	eps	@	inf	(cbrt.f64 (-.f64 (tan.f64 (+.f64 x eps)) (tan.f64 x)))
72.0ms	eps	@	0	(cbrt.f64 (-.f64 (tan.f64 (+.f64 x eps)) (tan.f64 x)))

analyze2.7s (1.1%)

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	90.9%	9.1%	0%	0%	0%	0
27.4%	24.9%	66%	9.1%	0%	0%	0%	1
39%	34.7%	54.4%	9.1%	0%	1.8%	0%	2
51%	44.1%	42.4%	9.1%	0%	4.5%	0%	3
58.9%	50.1%	35%	9.1%	0%	5.8%	0%	4
65.5%	55%	29%	9.1%	0%	6.9%	0%	5
67.8%	56.6%	26.9%	9.1%	0%	7.5%	0%	6
70.2%	57.8%	24.6%	9.1%	0%	8.4%	0.1%	7
72.2%	59.3%	22.8%	9.1%	0%	8.7%	0.1%	8
73.5%	60%	21.6%	9.1%	0%	9.1%	0.3%	9
74.7%	60.5%	20.4%	9.1%	0%	9.7%	0.3%	10
76.2%	61.5%	19.2%	9.1%	0%	9.9%	0.4%	11
76.9%	61.8%	18.5%	9.1%	0%	10.2%	0.4%	12

Compiler

Compiled 375 to 278 computations (25.9% saved)

Herbie run

sample1.4min (32.4%)

localize37.0s (14.6%)

soundness34.2s (13.5%)

eval26.9s (10.6%)

simplify19.1s (7.5%)

prune13.0s (5.1%)

regimes11.7s (4.6%)

rewrite10.9s (4.3%)

preprocess6.6s (2.6%)

bsearch4.7s (1.8%)

series4.6s (1.8%)

analyze2.7s (1.1%)

end2.0ms (0%)

Profiling