Metrics for Herbie run

Date:	Friday, August 18th, 2023
Commit:	5f639494 on main
Hostname:	nightly with Racket 8.6
Seed:	2023230
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.4min (33%)

Results

31.0s	33293×	body	2048	valid
26.3s	62622×	body	1024	valid
11.0s	86169×	body	256	valid
8.4s	33257×	body	512	valid
1.7s	13336×	body	256	infinite
1.2s	2159×	body	4096	valid
1.2s	1154×	body	1024	invalid
875.0ms	7552×	body	256	unsamplable
650.0ms	5126×	body	256	invalid
233.0ms	577×	body	512	invalid
218.0ms	316×	body	2048	unsamplable
165.0ms	477×	body	1024	unsamplable
162.0ms	150×	body	1024	infinite
85.0ms	175×	body	512	infinite
55.0ms	235×	body	512	unsamplable
4.0ms	2×	body	8192	valid
2.0ms	5×	body	2048	infinite
2.0ms	2×	body	2048	invalid

Bogosity

soundness36.9s (14.6%)

Rules

148706×	`fma-def`
90924×	`log-prod`
86808×	`fma-neg`
80526×	`associate-r`
65204×	`associate-l`

Stop Event

8×	saturated
221×	node limit

Compiler

Compiled 22099 to 13832 computations (37.4% saved)

localize34.7s (13.7%)

Compiler: Compiled 13091 to 6505 computations (50.3% saved)

eval24.0s (9.5%)

Compiler: Compiled 1265861 to 716102 computations (43.4% saved)

simplify17.9s (7.1%)

Algorithm

154×	egg-herbie

Rules

95546×	`fma-def`
56678×	`associate-r`
56354×	`fma-neg`
53206×	`log-prod`
50152×	`associate-l`

Stop Event

3×	done
47×	saturated
25×	fuel
107×	node limit

Counts

36173 → 34580

Compiler

Compiled 4505 to 3089 computations (31.4% saved)

regimes14.4s (5.7%)

Counts

5024 → 395

Calls

43 calls:

3.6s	eps
3.1s	x
1.1s	b
784.0ms	a
769.0ms	c

Compiler

Compiled 58098 to 32842 computations (43.5% saved)

prune13.7s (5.4%)

Counts: 53368 → 2305
Compiler: Compiled 121713 to 84418 computations (30.6% saved)

rewrite10.7s (4.2%)

Algorithm

98×	batch-egg-rewrite

Rules

64400×	`pow1`
60876×	`add-exp-log`
60816×	`log1p-expm1-u`
60784×	`expm1-log1p-u`
57228×	`add-log-exp`

Stop Event

98×	node limit

Counts

754 → 24461

preprocess6.3s (2.5%)

Algorithm

28×	egg-herbie

Rules

42740×	`fma-def`
13078×	`fma-neg`
9294×	`associate-/r*`
9220×	`div-sub`
9054×	`distribute-rgt-in`

Stop Event

13×	saturated
15×	node limit

Compiler

Compiled 10438 to 6443 computations (38.3% saved)

bsearch4.3s (1.7%)

Algorithm

147×	binary-search
51×	left-value

Stop Event

145×	narrow-enough
2×	predicate-same

Results

2.0s	14987×	body	256	valid
987.0ms	2774×	body	1024	valid
398.0ms	647×	body	2048	valid
311.0ms	1254×	body	512	valid
191.0ms	2017×	body	256	invalid
31.0ms	168×	body	256	infinite
4.0ms	10×	body	4096	valid
1.0ms	5×	body	256	unsamplable
0.0ms	1×	body	512	unsamplable

Compiler

Compiled 33077 to 24185 computations (26.9% saved)

series4.2s (1.7%)

Counts

754 → 11684

Calls

3477 calls:

Time	Variable		Point	Expression
295.0ms	N	@	-inf	(pow.f64 (atan2.f64 1 (+.f64 1 (fma.f64 N N N))) 1/4)
111.0ms	N	@	inf	(pow.f64 (pow.f64 (cbrt.f64 (atan2.f64 1 (+.f64 1 (fma.f64 N N N)))) 2) 3/2)
86.0ms	eps	@	-inf	(log.f64 (+.f64 1 (expm1.f64 (sin.f64 (*.f64 1/2 (+.f64 x (+.f64 x eps)))))))
81.0ms	a	@	0	(pow.f64 (exp.f64 1/4) (.f64 2 (-.f64 (log.f64 (.f64 a 4)) (log.f64 (/.f64 -1 c)))))
72.0ms	eps	@	-inf	(log.f64 (-.f64 (sin.f64 (+.f64 x eps)) (sin.f64 x)))

analyze2.8s (1.1%)

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	90.9%	9.1%	0%	0%	0%	0
27.4%	24.9%	66%	9.1%	0%	0%	0%	1
39%	34.7%	54.4%	9.1%	0%	1.8%	0%	2
51%	44.1%	42.4%	9.1%	0%	4.5%	0%	3
58.9%	50.1%	35%	9.1%	0%	5.8%	0%	4
65.5%	55%	29%	9.1%	0%	6.9%	0%	5
67.8%	56.6%	26.9%	9.1%	0%	7.5%	0%	6
70.2%	57.8%	24.6%	9.1%	0%	8.4%	0.1%	7
72.2%	59.3%	22.8%	9.1%	0%	8.7%	0.1%	8
73.5%	60%	21.6%	9.1%	0%	9.1%	0.3%	9
74.7%	60.5%	20.4%	9.1%	0%	9.7%	0.3%	10
76.2%	61.5%	19.2%	9.1%	0%	9.9%	0.4%	11
76.9%	61.8%	18.5%	9.1%	0%	10.2%	0.4%	12

Compiler

Compiled 375 to 278 computations (25.9% saved)

Herbie run

sample1.4min (33%)

soundness36.9s (14.6%)

localize34.7s (13.7%)

eval24.0s (9.5%)

simplify17.9s (7.1%)

regimes14.4s (5.7%)

prune13.7s (5.4%)

rewrite10.7s (4.2%)

preprocess6.3s (2.5%)

bsearch4.3s (1.7%)

series4.2s (1.7%)

analyze2.8s (1.1%)

end5.0ms (0%)

Profiling