Metrics for Herbie run

Date:	Friday, October 20th, 2023
Commit:	21d611eb on main
Hostname:	nightly with Racket 8.6
Seed:	2023293
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample48.7s (30%)

Results

13.2s	109530×	body	256	valid
12.3s	29794×	body	1024	valid
11.2s	12592×	body	8192	exit
4.6s	5754×	body	2048	valid
4.1s	15054×	body	512	valid
1.3s	3941×	body	1024	invalid
766.0ms	4694×	body	256	infinite
375.0ms	1901×	body	512	invalid
273.0ms	2426×	body	256	invalid
146.0ms	1252×	body	256	unsamplable
56.0ms	146×	body	1024	infinite
39.0ms	148×	body	512	infinite
3.0ms	1×	body	8192	invalid
2.0ms	3×	body	2048	invalid

Bogosity

localize25.0s (15.4%)

Compiler: Compiled 8430 to 3606 computations (57.2% saved)

soundness18.5s (11.4%)

Rules

78924×	`fma-def`
50488×	`log-prod`
41346×	`pow1`
41054×	`associate-r`
38992×	`add-exp-log`

Stop Event

4×	unsound
4×	saturated
115×	node limit

Compiler

Compiled 10398 to 6321 computations (39.2% saved)

eval15.6s (9.6%)

Compiler: Compiled 794687 to 383951 computations (51.7% saved)

simplify11.1s (6.8%)

Algorithm

87×	egg-herbie

Rules

51054×	`fma-def`
36444×	`log-prod`
32922×	`associate-r`
28448×	`distribute-lft-in`
27530×	`distribute-rgt-in`

Stop Event

5×	done
4×	unsound
20×	saturated
15×	fuel
63×	node limit

Counts

23761 → 18759

Compiler

Compiled 1668 to 1118 computations (33% saved)

regimes10.9s (6.7%)

Counts

3163 → 146

Calls

53 calls:

1.8s	a
1.6s	r
1.4s	b
882.0ms	x
469.0ms	z

Compiler

Compiled 37920 to 16535 computations (56.4% saved)

analyze9.0s (5.6%)

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
22.1%	16.3%	57.5%	26.3%	0%	0%	0%	1
47.5%	35%	38.7%	26.3%	0%	0%	0%	2
56%	41.2%	32.5%	26.3%	0%	0%	0%	3
65.3%	48.1%	25.6%	26.3%	0%	0%	0%	4
68.7%	50%	22.8%	26.3%	0%	0.9%	0%	5
70.3%	50.9%	21.5%	26.3%	0%	1.1%	0.2%	6
74.5%	53.6%	18.3%	26.3%	0%	1.6%	0.2%	7
75.5%	54.1%	17.6%	26.3%	0%	1.8%	0.2%	8
77.7%	55.5%	15.9%	26.3%	0%	2%	0.2%	9
79.1%	56.4%	14.9%	26.3%	0%	2.2%	0.3%	10
79.8%	56.8%	14.3%	26.3%	0%	2.3%	0.3%	11
80.5%	57.2%	13.8%	26.3%	0%	2.4%	0.3%	12

Compiler

Compiled 295 to 210 computations (28.8% saved)

prune8.4s (5.2%)

Counts: 33449 → 1587
Compiler: Compiled 83538 to 54078 computations (35.3% saved)

rewrite6.7s (4.1%)

Algorithm

67×	batch-egg-rewrite

Rules

52950×	`pow1`
49690×	`add-exp-log`
49612×	`log1p-expm1-u`
49608×	`expm1-log1p-u`
47696×	`add-log-exp`

Stop Event

67×	node limit

Counts

454 → 15650

preprocess4.5s (2.8%)

Algorithm

20×	egg-herbie

Rules

18794×	`fma-def`
9552×	`fma-neg`
5312×	`distribute-lft-neg-in`
4910×	`sub-neg`
4300×	`distribute-rgt-in`

Stop Event

12×	saturated
8×	node limit

Compiler

Compiled 4648 to 2450 computations (47.3% saved)

series2.7s (1.6%)

Counts

454 → 8111

Calls

2232 calls:

Time	Variable		Point	Expression
83.0ms	y	@	inf	(exp.f64 (log1p.f64 (/.f64 1 (tan.f64 (+.f64 y z)))))
79.0ms	y	@	inf	(log1p.f64 (+.f64 (tan.f64 (+.f64 y z)) (-.f64 x (tan.f64 a))))
73.0ms	x	@	0	(*.f64 (pow.f64 2 1/4) x)
69.0ms	x	@	-inf	(log.f64 (/.f64 x (sinh.f64 x)))
68.0ms	x	@	-inf	(log.f64 (/.f64 (sinh.f64 x) x))

bsearch1.4s (0.9%)

Algorithm

38×	binary-search

Stop Event

37×	narrow-enough
1×	predicate-same

Results

642.0ms	1266×	body	1024	valid
454.0ms	2750×	body	256	valid
167.0ms	540×	body	512	valid
55.0ms	68×	body	2048	valid
13.0ms	96×	body	256	infinite

Compiler

Compiled 7583 to 5482 computations (27.7% saved)

Herbie run

sample48.7s (30%)

localize25.0s (15.4%)

soundness18.5s (11.4%)

eval15.6s (9.6%)

simplify11.1s (6.8%)

regimes10.9s (6.7%)

analyze9.0s (5.6%)

prune8.4s (5.2%)

rewrite6.7s (4.1%)

preprocess4.5s (2.8%)

series2.7s (1.6%)

bsearch1.4s (0.9%)

end1.0ms (0%)

Profiling