Metrics for Herbie run

Date:	Saturday, November 18th, 2023
Commit:	fb1f2946 on main
Hostname:	nightly with Racket 8.6
Seed:	2023322
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.6min (31.9%)

Results

36.9s	39511×	body	2048	valid
28.8s	70668×	body	1024	valid
13.9s	95342×	body	256	valid
9.0s	36846×	body	512	valid
1.6s	2182×	body	4096	valid
1.4s	11048×	body	256	infinite
940.0ms	1226×	body	1024	invalid
677.0ms	5046×	body	256	invalid
461.0ms	2976×	body	256	precondition
458.0ms	4020×	body	256	unsamplable
245.0ms	619×	body	512	invalid
110.0ms	129×	body	1024	infinite
96.0ms	206×	body	512	infinite
4.0ms	4×	body	2048	infinite
3.0ms	3×	body	2048	invalid

Bogosity

soundness41.6s (14%)

Rules

149038×	`fma-def`
85356×	`fma-neg`
63726×	`times-frac`
58496×	`associate-r`
55628×	`log-prod`

Stop Event

3×	saturated
212×	node limit

Compiler

Compiled 21583 to 13909 computations (35.6% saved)

localize39.5s (13.2%)

Compiler: Compiled 13764 to 7634 computations (44.5% saved)

eval32.9s (11%)

Compiler: Compiled 1391822 to 864661 computations (37.9% saved)

simplify19.6s (6.6%)

Algorithm

129×	egg-herbie

Rules

76848×	`fma-def`
48356×	`times-frac`
47804×	`fma-neg`
41606×	`associate-r`
39976×	`unswap-sqr`

Stop Event

8×	done
31×	saturated
23×	fuel
98×	node limit

Counts

37816 → 36728

Compiler

Compiled 4593 to 3197 computations (30.4% saved)

prune16.0s (5.3%)

Counts: 57194 → 2647
Compiler: Compiled 141819 to 99089 computations (30.1% saved)

regimes15.9s (5.3%)

Counts

4961 → 402

Calls

43 calls:

4.5s	x
1.9s	eps
1.5s	a
1.2s	b
1.1s	c

Compiler

Compiled 56653 to 32184 computations (43.2% saved)

rewrite13.9s (4.7%)

Algorithm

98×	batch-egg-rewrite

Rules

55589×	`log1p-expm1-u`
43555×	`expm1-log1p-u`
42212×	`prod-diff`
32094×	`expm1-udef`
28830×	`log-prod`

Stop Event

98×	node limit

Counts

727 → 27724

preprocess11.2s (3.7%)

Algorithm

31×	egg-herbie

Rules

35660×	`fma-def`
12306×	`div-sub`
12068×	`fma-neg`
9698×	`sub-neg`
8284×	`distribute-lft-neg-in`

Stop Event

16×	saturated
15×	node limit

Compiler

Compiled 12373 to 7512 computations (39.3% saved)

bsearch6.0s (2%)

Algorithm

161×	binary-search
41×	left-value

Stop Event

159×	narrow-enough
2×	predicate-same

Results

1.9s	3833×	body	1024	valid
1.7s	11473×	body	256	valid
715.0ms	2109×	body	512	valid
528.0ms	838×	body	2048	valid
297.0ms	1706×	body	256	invalid
258.0ms	1128×	body	256	infinite
63.0ms	62×	body	1024	infinite
51.0ms	92×	body	512	infinite
49.0ms	301×	body	256	unsamplable
1.0ms	1×	body	4096	valid

Compiler

Compiled 30911 to 23166 computations (25.1% saved)

series3.9s (1.3%)

Counts

727 → 10092

Calls

2985 calls:

Time	Variable		Point	Expression
283.0ms	x	@	inf	(-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x))
125.0ms	n	@	0	(/.f64 (*.f64 3 (log.f64 (cbrt.f64 (/.f64 (+.f64 x 1) x)))) n)
111.0ms	x	@	0	(-.f64 (exp.f64 (log1p.f64 (*.f64 1/720 (pow.f64 x 4)))) 1)
85.0ms	x	@	-inf	(pow.f64 (pow.f64 (+.f64 (tan.f64 x) (tan.f64 (+.f64 x eps))) 3) 1/3)
82.0ms	N	@	0	(*.f64 (cbrt.f64 (atan2.f64 1 (fma.f64 N (+.f64 1 N) 1))) (cbrt.f64 (cbrt.f64 (atan2.f64 1 (fma.f64 N (+.f64 1 N) 1)))))

analyze2.6s (0.9%)

Algorithm

31×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	90.2%	9.8%	0%	0%	0%	0
25%	22.5%	67.7%	9.8%	0%	0%	0%	1
37.2%	33%	55.6%	9.8%	0%	1.6%	0%	2
50.2%	42.9%	42.5%	9.8%	0%	4.8%	0%	3
58.1%	48.7%	35.1%	9.8%	0%	6.4%	0%	4
65.3%	53.9%	28.7%	9.8%	0%	7.7%	0%	5
67.8%	55.4%	26.3%	10%	0%	8.3%	0%	6
70.8%	56.8%	23.4%	10.5%	0%	9.2%	0.1%	7
72.9%	58.2%	21.6%	10.6%	0%	9.4%	0.1%	8
74.3%	58.9%	20.4%	10.7%	0%	9.8%	0.2%	9
75.6%	59.3%	19.2%	10.9%	0%	10.4%	0.3%	10
77%	60.2%	18%	10.9%	0%	10.5%	0.3%	11
77.7%	60.5%	17.3%	11%	0%	10.9%	0.3%	12

Compiler

Compiled 421 to 309 computations (26.6% saved)

Herbie run

sample1.6min (31.9%)

soundness41.6s (14%)

localize39.5s (13.2%)

eval32.9s (11%)

simplify19.6s (6.6%)

prune16.0s (5.3%)

regimes15.9s (5.3%)

rewrite13.9s (4.7%)

preprocess11.2s (3.7%)

bsearch6.0s (2%)

series3.9s (1.3%)

analyze2.6s (0.9%)

end3.0ms (0%)

Profiling