Metrics for Herbie run

Date:	Thursday, July 20th, 2023
Commit:	48201210 on js-report-page
Hostname:	nightly with Racket 8.6
Seed:	2023201
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.3min (31.9%)

Results

29.2s	33274×	body	2048	valid
24.7s	62280×	body	1024	valid
11.3s	86785×	body	256	valid
8.0s	33295×	body	512	valid
1.6s	13126×	body	256	infinite
1.1s	2045×	body	4096	valid
967.0ms	1141×	body	1024	invalid
781.0ms	7312×	body	256	unsamplable
577.0ms	5189×	body	256	invalid
472.0ms	578×	body	512	invalid
200.0ms	248×	body	2048	unsamplable
170.0ms	172×	body	1024	infinite
169.0ms	432×	body	1024	unsamplable
99.0ms	232×	body	512	unsamplable
94.0ms	182×	body	512	infinite
13.0ms	6×	body	2048	invalid
7.0ms	3×	body	8192	valid
2.0ms	6×	body	2048	infinite

Bogosity

localize34.1s (13.6%)

Compiler: Compiled 13866 to 6594 computations (52.4% saved)

soundness33.2s (13.3%)

Rules

163564×	`fma-def`
83988×	`fma-neg`
76672×	`log-prod`
75250×	`associate-r`
68922×	`times-frac`

Stop Event

8×	saturated
200×	node limit

Compiler

Compiled 20796 to 12026 computations (42.2% saved)

eval25.7s (10.3%)

Compiler: Compiled 1377240 to 742680 computations (46.1% saved)

simplify18.9s (7.6%)

Algorithm

155×	egg-herbie

Rules

101418×	`fma-def`
61308×	`associate-r`
55452×	`associate-l`
53520×	`times-frac`
51184×	`fma-neg`

Stop Event

6×	done
47×	saturated
22×	fuel
108×	node limit

Counts

36048 → 34981

Compiler

Compiled 4583 to 3070 computations (33% saved)

regimes14.4s (5.7%)

Counts

4986 → 399

Calls

43 calls:

3.9s	x
3.6s	eps
829.0ms	a
758.0ms	(/.f64 1 n)
745.0ms	c

Compiler

Compiled 57666 to 31735 computations (45% saved)

prune13.4s (5.3%)

Counts: 57190 → 2301
Compiler: Compiled 116027 to 78622 computations (32.2% saved)

rewrite12.0s (4.8%)

Algorithm

99×	batch-egg-rewrite

Rules

58682×	`pow1`
55646×	`add-exp-log`
55614×	`log1p-expm1-u`
55562×	`expm1-log1p-u`
52102×	`add-log-exp`

Stop Event

99×	node limit

Counts

742 → 24757

preprocess6.3s (2.5%)

Algorithm

28×	egg-herbie

Rules

42740×	`fma-def`
13078×	`fma-neg`
9294×	`associate-/r*`
9220×	`div-sub`
9054×	`distribute-rgt-in`

Stop Event

13×	saturated
15×	node limit

Compiler

Compiled 10576 to 6345 computations (40% saved)

bsearch5.8s (2.3%)

Algorithm

164×	binary-search
43×	left-value

Stop Event

159×	narrow-enough
5×	predicate-same

Results

2.2s	14266×	body	256	valid
1.5s	4188×	body	1024	valid
688.0ms	1046×	body	2048	valid
662.0ms	2252×	body	512	valid
161.0ms	1635×	body	256	invalid
96.0ms	524×	body	256	infinite
33.0ms	64×	body	512	infinite
27.0ms	161×	body	256	unsamplable
7.0ms	10×	body	1024	infinite
1.0ms	3×	body	1024	unsamplable
1.0ms	2×	body	4096	valid

Compiler

Compiled 35697 to 25980 computations (27.2% saved)

series4.1s (1.7%)

Counts

742 → 11263

Calls

3345 calls:

Time	Variable		Point	Expression
309.0ms	x	@	0	(-.f64 (exp.f64 (log1p.f64 (*.f64 -5/12 (pow.f64 x 3)))) 1)
119.0ms	eps	@	0	(pow.f64 (cbrt.f64 (-.f64 (tan.f64 (+.f64 x eps)) (tan.f64 x))) 3)
114.0ms	N	@	inf	(pow.f64 (pow.f64 (cbrt.f64 (atan2.f64 1 (+.f64 1 (fma.f64 N N N)))) 2) 3/2)
85.0ms	eps	@	-inf	(log1p.f64 (cos.f64 (+.f64 x eps)))
82.0ms	eps	@	-inf	(log.f64 (*.f64 (exp.f64 (neg.f64 (tan.f64 x))) (exp.f64 (tan.f64 (+.f64 x eps)))))

analyze2.6s (1%)

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	90.9%	9.1%	0%	0%	0%	0
27.4%	24.9%	66%	9.1%	0%	0%	0%	1
39%	34.7%	54.4%	9.1%	0%	1.8%	0%	2
51%	44.1%	42.4%	9.1%	0%	4.5%	0%	3
58.9%	50.1%	35%	9.1%	0%	5.8%	0%	4
65.5%	55%	29%	9.1%	0%	6.9%	0%	5
67.8%	56.6%	26.9%	9.1%	0%	7.5%	0%	6
70.2%	57.8%	24.6%	9.1%	0%	8.4%	0.1%	7
72.2%	59.3%	22.8%	9.1%	0%	8.7%	0.1%	8
73.5%	60%	21.6%	9.1%	0%	9.1%	0.3%	9
74.7%	60.5%	20.4%	9.1%	0%	9.7%	0.3%	10
76.2%	61.5%	19.2%	9.1%	0%	9.9%	0.4%	11
76.9%	61.8%	18.5%	9.1%	0%	10.2%	0.4%	12

Compiler

Compiled 375 to 278 computations (25.9% saved)

Herbie run

sample1.3min (31.9%)

localize34.1s (13.6%)

soundness33.2s (13.3%)

eval25.7s (10.3%)

simplify18.9s (7.6%)

regimes14.4s (5.7%)

prune13.4s (5.3%)

rewrite12.0s (4.8%)

preprocess6.3s (2.5%)

bsearch5.8s (2.3%)

series4.1s (1.7%)

analyze2.6s (1%)

end4.0ms (0%)

Profiling