Metrics for Herbie run

Date:	Saturday, December 30th, 2023
Commit:	665878db on main
Hostname:	nightly with Racket 8.6
Seed:	2023364
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample50.8s (27.7%)

Results

16.3s	115133×	body	256	valid
12.3s	12796×	body	8192	exit
10.4s	24047×	body	1024	valid
5.0s	5893×	body	2048	valid
3.7s	15078×	body	512	valid
871.0ms	2204×	body	1024	invalid
811.0ms	4967×	body	256	infinite
693.0ms	5000×	body	256	invalid
267.0ms	1121×	body	512	invalid
147.0ms	1198×	body	256	unsamplable
3.0ms	1×	body	8192	invalid
1.0ms	1×	body	4096	invalid
1.0ms	2×	body	1024	infinite

Bogosity

soundness26.9s (14.7%)

Rules

50004×	`fma-def`
36367×	`log1p-expm1-u`
35632×	`associate-r`
27386×	`log-prod`
27278×	`expm1-log1p-u`

Stop Event

4×	unsound
5×	saturated
100×	node limit

Compiler

Compiled 7593 to 3669 computations (51.7% saved)

localize23.8s (13%)

Compiler: Compiled 7677 to 3525 computations (54.1% saved)

eval19.4s (10.5%)

Compiler: Compiled 910346 to 538630 computations (40.8% saved)

simplify13.5s (7.4%)

Algorithm

79×	egg-herbie

Rules

42636×	`fma-def`
29596×	`log-prod`
27890×	`associate-r`
25148×	`fma-neg`
23682×	`times-frac`

Stop Event

6×	unsound
4×	done
20×	saturated
16×	fuel
53×	node limit

Counts

26089 → 19297

Compiler

Compiled 1553 to 1045 computations (32.7% saved)

regimes10.6s (5.8%)

Counts

3189 → 142

Calls

53 calls:

1.6s	a
1.3s	b
1.0s	x
828.0ms	r
665.0ms	(tan.f64 a)

Compiler

Compiled 37653 to 17621 computations (53.2% saved)

analyze9.8s (5.3%)

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
22.1%	16.3%	57.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.1%	0.2%	6
71%	51.1%	20.8%	26.3%	0%	1.6%	0.2%	7
72%	51.6%	20.1%	26.3%	0%	1.8%	0.2%	8
74.2%	53%	18.4%	26.3%	0%	2%	0.2%	9
75.7%	53.9%	17.3%	26.3%	0%	2.2%	0.3%	10
76.4%	54.3%	16.8%	26.3%	0%	2.3%	0.3%	11
77.1%	54.8%	16.3%	26.3%	0%	2.4%	0.3%	12

Compiler

Compiled 295 to 210 computations (28.8% saved)

prune9.6s (5.3%)

Counts: 34603 → 1597
Compiler: Compiled 88724 to 60654 computations (31.6% saved)

rewrite9.3s (5%)

Algorithm

59×	batch-egg-rewrite

Rules

32118×	`log1p-expm1-u`
24692×	`expm1-log1p-u`
23780×	`prod-diff`
19634×	`expm1-udef`
18120×	`log-prod`

Stop Event

59×	node limit

Counts

452 → 17951

preprocess5.5s (3%)

Algorithm

20×	egg-herbie

Rules

23976×	`fma-def`
6946×	`fma-neg`
6348×	`distribute-lft-neg-in`
5222×	`div-sub`
4908×	`distribute-rgt-neg-in`

Stop Event

12×	saturated
8×	node limit

Compiler

Compiled 7918 to 4760 computations (39.9% saved)

series3.3s (1.8%)

Counts

452 → 8138

Calls

2160 calls:

Time	Variable		Point	Expression
167.0ms	lo	@	0	(exp.f64 (neg.f64 (log1p.f64 (/.f64 (neg.f64 hi) lo))))
89.0ms	a	@	-inf	(pow.f64 (pow.f64 (-.f64 (tan.f64 (+.f64 y z)) (-.f64 (tan.f64 a) x)) 3) 1/3)
87.0ms	a	@	-inf	(pow.f64 (pow.f64 (-.f64 a b) 1/4) 2)
75.0ms	y	@	inf	(log.f64 (+.f64 (tan.f64 (+.f64 y z)) x))
70.0ms	r	@	-inf	(log.f64 (*.f64 r (/.f64 (sin.f64 b) (cos.f64 a))))

bsearch1.0s (0.5%)

Algorithm

27×	binary-search
7×	left-value

Stop Event

27×	narrow-enough

Results

408.0ms	2207×	body	256	valid
361.0ms	697×	body	1024	valid
134.0ms	326×	body	512	valid
34.0ms	57×	body	2048	valid
11.0ms	89×	body	256	infinite

Compiler

Compiled 4930 to 3577 computations (27.4% saved)

Herbie run

sample50.8s (27.7%)

soundness26.9s (14.7%)

localize23.8s (13%)

eval19.4s (10.5%)

simplify13.5s (7.4%)

regimes10.6s (5.8%)

analyze9.8s (5.3%)

prune9.6s (5.3%)

rewrite9.3s (5%)

preprocess5.5s (3%)

series3.3s (1.8%)

bsearch1.0s (0.5%)

end1.0ms (0%)

Profiling