Metrics for Herbie run

Date:	Saturday, December 9th, 2023
Commit:	665878db on main
Hostname:	nightly with Racket 8.6
Seed:	2023343
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample52.3s (28.7%)

Results

16.8s	114914×	body	256	valid
13.4s	13104×	body	8192	exit
10.4s	24421×	body	1024	valid
4.7s	5838×	body	2048	valid
4.0s	14966×	body	512	valid
867.0ms	2441×	body	1024	invalid
798.0ms	4979×	body	256	infinite
676.0ms	4957×	body	256	invalid
269.0ms	1257×	body	512	invalid
164.0ms	1299×	body	256	unsamplable
3.0ms	4×	body	2048	invalid
3.0ms	1×	body	8192	invalid
1.0ms	1×	body	4096	invalid
1.0ms	2×	body	1024	infinite

Bogosity

localize28.1s (15.4%)

Compiler: Compiled 7968 to 3801 computations (52.3% saved)

soundness23.1s (12.6%)

Rules

56426×	`fma-def`
35086×	`log1p-expm1-u`
30500×	`associate-r`
28592×	`prod-diff`
28054×	`log-prod`

Stop Event

6×	saturated
3×	unsound
99×	node limit

Compiler

Compiled 10007 to 4898 computations (51.1% saved)

eval15.8s (8.7%)

Compiler: Compiled 831512 to 464842 computations (44.1% saved)

regimes13.9s (7.6%)

Counts

3308 → 153

Calls

53 calls:

2.2s	a
1.6s	x
1.0s	b
1.0s	r
839.0ms	(tan.f64 a)

Compiler

Compiled 39679 to 17146 computations (56.8% saved)

simplify12.3s (6.8%)

Algorithm

77×	egg-herbie

Rules

42678×	`fma-def`
27222×	`log-prod`
24836×	`associate-r`
24488×	`fma-neg`
23294×	`associate-l`

Stop Event

4×	done
6×	unsound
20×	saturated
16×	fuel
51×	node limit

Counts

26271 → 19761

Compiler

Compiled 1801 to 1124 computations (37.6% saved)

analyze9.6s (5.3%)

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
22.1%	16.3%	57.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.1%	0.2%	6
71%	51.1%	20.8%	26.3%	0%	1.6%	0.2%	7
72%	51.6%	20.1%	26.3%	0%	1.8%	0.2%	8
74.2%	53%	18.4%	26.3%	0%	2%	0.2%	9
75.7%	53.9%	17.3%	26.3%	0%	2.2%	0.3%	10
76.4%	54.3%	16.8%	26.3%	0%	2.3%	0.3%	11
77.1%	54.8%	16.3%	26.3%	0%	2.4%	0.3%	12

Compiler

Compiled 295 to 210 computations (28.8% saved)

prune9.1s (5%)

Counts: 34396 → 1608
Compiler: Compiled 91548 to 60831 computations (33.6% saved)

rewrite8.2s (4.5%)

Algorithm

57×	batch-egg-rewrite

Rules

29154×	`log1p-expm1-u`
23003×	`expm1-log1p-u`
19594×	`prod-diff`
17946×	`expm1-udef`
17410×	`log-prod`

Stop Event

57×	node limit

Counts

445 → 17987

preprocess4.6s (2.5%)

Algorithm

20×	egg-herbie

Rules

23976×	`fma-def`
6946×	`fma-neg`
6348×	`distribute-lft-neg-in`
5222×	`div-sub`
4908×	`distribute-rgt-neg-in`

Stop Event

12×	saturated
8×	node limit

Compiler

Compiled 8350 to 4670 computations (44.1% saved)

series3.8s (2.1%)

Counts

445 → 8284

Calls

2169 calls:

Time	Variable		Point	Expression
1.0s	hi	@	-inf	(pow.f64 (/.f64 -1 (+.f64 -1 (/.f64 hi lo))) 3)
141.0ms	x	@	inf	(log.f64 (/.f64 (sinh.f64 x) x))
88.0ms	b	@	-inf	(/.f64 (-.f64 (cos.f64 b) (*.f64 a (sin.f64 b))) (sin.f64 b))
83.0ms	y	@	inf	(-.f64 (tan.f64 (+.f64 y z)) a)
67.0ms	b	@	0	(/.f64 (sin.f64 b) (cos.f64 (+.f64 b a)))

bsearch1.5s (0.8%)

Algorithm

27×	binary-search
21×	left-value

Stop Event

26×	narrow-enough
1×	predicate-same

Results

652.0ms	838×	body	1024	valid
310.0ms	2169×	body	256	valid
284.0ms	146×	body	2048	valid
116.0ms	416×	body	512	valid
9.0ms	63×	body	256	infinite

Compiler

Compiled 5933 to 4263 computations (28.1% saved)

Herbie run

sample52.3s (28.7%)

localize28.1s (15.4%)

soundness23.1s (12.6%)

eval15.8s (8.7%)

regimes13.9s (7.6%)

simplify12.3s (6.8%)

analyze9.6s (5.3%)

prune9.1s (5%)

rewrite8.2s (4.5%)

preprocess4.6s (2.5%)

series3.8s (2.1%)

bsearch1.5s (0.8%)

end1.0ms (0%)

Profiling