Metrics for Herbie run

Date:	Thursday, July 27th, 2023
Commit:	7791686b on docs-link-fix
Hostname:	nightly with Racket 8.6
Seed:	2023208
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.4min (33.2%)

Results

31.1s	33593×	body	2048	valid
25.7s	62157×	body	1024	valid
11.8s	86950×	body	256	valid
8.1s	32932×	body	512	valid
1.7s	13135×	body	256	infinite
1.4s	2069×	body	4096	valid
1.1s	1189×	body	1024	invalid
741.0ms	7275×	body	256	unsamplable
566.0ms	5293×	body	256	invalid
417.0ms	485×	body	1024	unsamplable
219.0ms	549×	body	512	invalid
158.0ms	143×	body	1024	infinite
148.0ms	284×	body	2048	unsamplable
86.0ms	184×	body	512	infinite
51.0ms	214×	body	512	unsamplable
6.0ms	3×	body	8192	valid
4.0ms	4×	body	2048	invalid
3.0ms	2×	body	2048	infinite

Bogosity

localize35.4s (14%)

Compiler: Compiled 13549 to 6749 computations (50.2% saved)

soundness33.6s (13.3%)

Rules

166518×	`fma-def`
101496×	`fma-neg`
83312×	`log-prod`
81720×	`associate-r`
63688×	`times-frac`

Stop Event

8×	saturated
222×	node limit

Compiler

Compiled 19121 to 12136 computations (36.5% saved)

eval26.6s (10.5%)

Compiler: Compiled 1414478 to 789072 computations (44.2% saved)

simplify19.0s (7.5%)

Algorithm

154×	egg-herbie

Rules

101246×	`fma-def`
66062×	`fma-neg`
55732×	`associate-r`
50506×	`times-frac`
45866×	`associate-l`

Stop Event

4×	done
47×	saturated
24×	fuel
107×	node limit

Counts

35409 → 35043

Compiler

Compiled 4475 to 3077 computations (31.2% saved)

prune14.1s (5.6%)

Counts: 58777 → 2271
Compiler: Compiled 110327 to 75693 computations (31.4% saved)

regimes12.1s (4.8%)

Counts

4227 → 389

Calls

43 calls:

2.7s	x
2.1s	eps
1.1s	a
922.0ms	c
687.0ms	b

Compiler

Compiled 45887 to 26790 computations (41.6% saved)

rewrite11.3s (4.5%)

Algorithm

98×	batch-egg-rewrite

Rules

62186×	`pow1`
58916×	`add-exp-log`
58886×	`log1p-expm1-u`
58848×	`expm1-log1p-u`
55334×	`add-log-exp`

Stop Event

98×	node limit

Counts

746 → 24617

preprocess5.8s (2.3%)

Algorithm

28×	egg-herbie

Rules

42740×	`fma-def`
13078×	`fma-neg`
9294×	`associate-/r*`
9220×	`div-sub`
9054×	`distribute-rgt-in`

Stop Event

13×	saturated
15×	node limit

Compiler

Compiled 10404 to 6461 computations (37.9% saved)

bsearch4.3s (1.7%)

Algorithm

123×	binary-search
71×	left-value

Stop Event

122×	narrow-enough
1×	predicate-same

Results

2.1s	11687×	body	256	valid
774.0ms	2227×	body	1024	valid
400.0ms	717×	body	2048	valid
383.0ms	1430×	body	512	valid
255.0ms	1269×	body	256	invalid
67.0ms	329×	body	256	infinite
43.0ms	7×	body	1024	infinite
9.0ms	24×	body	256	unsamplable
8.0ms	17×	body	512	infinite
7.0ms	18×	body	4096	valid
1.0ms	4×	body	1024	unsamplable

Compiler

Compiled 25290 to 18351 computations (27.4% saved)

series3.9s (1.5%)

Counts

746 → 10764

Calls

3423 calls:

Time	Variable		Point	Expression
246.0ms	x	@	inf	(pow.f64 (+.f64 x (.f64 (.f64 x x) 1/2)) 2)
153.0ms	x	@	0	(pow.f64 x (/.f64 1 n))
118.0ms	x	@	-inf	(pow.f64 x (/.f64 1 n))
91.0ms	eps	@	0	(pow.f64 (cbrt.f64 (-.f64 (tan.f64 (+.f64 x eps)) (tan.f64 x))) 3)
82.0ms	x	@	inf	(-.f64 (log.f64 (.f64 (exp.f64 (.f64 (cos.f64 x) (sin.f64 eps))) (exp.f64 (*.f64 (sin.f64 x) (cos.f64 eps))))) (sin.f64 x))

analyze3.0s (1.2%)

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	90.9%	9.1%	0%	0%	0%	0
27.4%	24.9%	66%	9.1%	0%	0%	0%	1
39%	34.7%	54.4%	9.1%	0%	1.8%	0%	2
51%	44.1%	42.4%	9.1%	0%	4.5%	0%	3
58.9%	50.1%	35%	9.1%	0%	5.8%	0%	4
65.5%	55%	29%	9.1%	0%	6.9%	0%	5
67.8%	56.6%	26.9%	9.1%	0%	7.5%	0%	6
70.2%	57.8%	24.6%	9.1%	0%	8.4%	0.1%	7
72.2%	59.3%	22.8%	9.1%	0%	8.7%	0.1%	8
73.5%	60%	21.6%	9.1%	0%	9.1%	0.3%	9
74.7%	60.5%	20.4%	9.1%	0%	9.7%	0.3%	10
76.2%	61.5%	19.2%	9.1%	0%	9.9%	0.4%	11
76.9%	61.8%	18.5%	9.1%	0%	10.2%	0.4%	12

Compiler

Compiled 375 to 278 computations (25.9% saved)

Herbie run

sample1.4min (33.2%)

localize35.4s (14%)

soundness33.6s (13.3%)

eval26.6s (10.5%)

simplify19.0s (7.5%)

prune14.1s (5.6%)

regimes12.1s (4.8%)

rewrite11.3s (4.5%)

preprocess5.8s (2.3%)

bsearch4.3s (1.7%)

series3.9s (1.5%)

analyze3.0s (1.2%)

end3.0ms (0%)

Profiling