Metrics for Herbie run

Date:	Wednesday, September 13th, 2023
Commit:	4716b437 on main
Hostname:	nightly with Racket 8.6
Seed:	2023256
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.4min (31.9%)

Results

30.5s	33140×	body	2048	valid
26.9s	62712×	body	1024	valid
11.6s	86802×	body	256	valid
7.9s	33120×	body	512	valid
1.6s	13031×	body	256	infinite
1.2s	2054×	body	4096	valid
973.0ms	7536×	body	256	unsamplable
931.0ms	1184×	body	1024	invalid
537.0ms	5014×	body	256	invalid
369.0ms	191×	body	512	infinite
218.0ms	595×	body	512	invalid
213.0ms	297×	body	2048	unsamplable
178.0ms	447×	body	1024	unsamplable
120.0ms	114×	body	1024	infinite
53.0ms	226×	body	512	unsamplable
6.0ms	3×	body	8192	valid
3.0ms	4×	body	2048	invalid
0.0ms	1×	body	2048	infinite

Bogosity

soundness36.9s (14.1%)

Rules

161984×	`fma-def`
107052×	`fma-neg`
90226×	`log-prod`
76286×	`associate-r`
72842×	`times-frac`

Stop Event

7×	saturated
214×	node limit

Compiler

Compiled 21201 to 13076 computations (38.3% saved)

localize33.8s (12.9%)

Compiler: Compiled 13672 to 6684 computations (51.1% saved)

eval27.8s (10.6%)

Compiler: Compiled 1336674 to 789270 computations (41% saved)

simplify20.2s (7.7%)

Algorithm

154×	egg-herbie

Rules

95948×	`fma-def`
56484×	`fma-neg`
54662×	`times-frac`
53904×	`associate-r`
50958×	`associate-l`

Stop Event

3×	done
47×	saturated
25×	fuel
107×	node limit

Counts

34659 → 34710

Compiler

Compiled 5051 to 3498 computations (30.7% saved)

regimes17.9s (6.8%)

Counts

4919 → 412

Calls

43 calls:

4.5s	x
2.5s	eps
2.3s	(/.f64 1 n)
1.4s	c
1.3s	a

Compiler

Compiled 59307 to 33530 computations (43.5% saved)

prune12.9s (4.9%)

Counts: 54219 → 2303
Compiler: Compiled 118248 to 80503 computations (31.9% saved)

rewrite11.0s (4.2%)

Algorithm

98×	batch-egg-rewrite

Rules

58934×	`pow1`
55890×	`add-exp-log`
55876×	`log1p-expm1-u`
55842×	`expm1-log1p-u`
54240×	`log-prod`

Stop Event

98×	node limit

Counts

721 → 23362

preprocess6.8s (2.6%)

Algorithm

28×	egg-herbie

Rules

42740×	`fma-def`
13078×	`fma-neg`
9294×	`associate-/r*`
9220×	`div-sub`
9054×	`distribute-rgt-in`

Stop Event

13×	saturated
15×	node limit

Compiler

Compiled 11366 to 7141 computations (37.2% saved)

bsearch4.8s (1.8%)

Algorithm

136×	binary-search
77×	left-value

Stop Event

135×	narrow-enough
1×	predicate-same

Results

1.8s	11874×	body	256	valid
1.4s	3548×	body	1024	valid
609.0ms	914×	body	2048	valid
374.0ms	1393×	body	512	valid
191.0ms	1525×	body	256	invalid
94.0ms	304×	body	256	infinite
14.0ms	76×	body	256	unsamplable
6.0ms	7×	body	1024	infinite
5.0ms	10×	body	2048	unsamplable
5.0ms	15×	body	1024	unsamplable
2.0ms	5×	body	512	infinite
1.0ms	3×	body	4096	valid
0.0ms	2×	body	512	unsamplable

Compiler

Compiled 29900 to 21744 computations (27.3% saved)

series3.6s (1.4%)

Counts

721 → 11269

Calls

3471 calls:

Time	Variable		Point	Expression
122.0ms	eps	@	0	(pow.f64 (cbrt.f64 (-.f64 (tan.f64 (+.f64 x eps)) (tan.f64 x))) 3)
103.0ms	eps	@	0	(pow.f64 (/.f64 1 (cbrt.f64 (/.f64 1 (-.f64 (tan.f64 (+.f64 x eps)) (tan.f64 x))))) 3)
72.0ms	x	@	0	(pow.f64 x -1/2)
70.0ms	N	@	-inf	(pow.f64 (pow.f64 (cbrt.f64 (atan2.f64 1 (+.f64 1 (fma.f64 N N N)))) 2) 3/2)
69.0ms	c	@	-inf	(pow.f64 (*.f64 c (neg.f64 a)) 3/2)

analyze2.6s (1%)

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	90.9%	9.1%	0%	0%	0%	0
27.4%	24.9%	66%	9.1%	0%	0%	0%	1
39%	34.7%	54.4%	9.1%	0%	1.8%	0%	2
51%	44.1%	42.4%	9.1%	0%	4.5%	0%	3
58.9%	50.1%	35%	9.1%	0%	5.8%	0%	4
65.5%	55%	29%	9.1%	0%	6.9%	0%	5
67.8%	56.6%	26.9%	9.1%	0%	7.5%	0%	6
70.2%	57.8%	24.6%	9.1%	0%	8.4%	0.1%	7
72.2%	59.3%	22.8%	9.1%	0%	8.7%	0.1%	8
73.5%	60%	21.6%	9.1%	0%	9.1%	0.3%	9
74.7%	60.5%	20.4%	9.1%	0%	9.7%	0.3%	10
76.2%	61.5%	19.2%	9.1%	0%	9.9%	0.4%	11
76.9%	61.8%	18.5%	9.1%	0%	10.2%	0.4%	12

Compiler

Compiled 375 to 278 computations (25.9% saved)

Herbie run

sample1.4min (31.9%)

soundness36.9s (14.1%)

localize33.8s (12.9%)

eval27.8s (10.6%)

simplify20.2s (7.7%)

regimes17.9s (6.8%)

prune12.9s (4.9%)

rewrite11.0s (4.2%)

preprocess6.8s (2.6%)

bsearch4.8s (1.8%)

series3.6s (1.4%)

analyze2.6s (1%)

end4.0ms (0%)

Profiling