Metrics for Herbie run

Date:	Saturday, January 20th, 2024
Commit:	d8d592a2 on error-explanations-2
Hostname:	nightly with Racket 8.6
Seed:	2024020
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample53.8s (25.8%)

Results

16.4s	116251×	body	256	valid
13.5s	12836×	body	8192	exit
9.5s	23468×	body	512	valid
6.4s	15789×	body	1024	valid
4.6s	4702×	body	2048	valid
1.1s	2279×	body	1024	invalid
704.0ms	4910×	body	256	infinite
647.0ms	4831×	body	256	invalid
259.0ms	1206×	body	512	invalid
165.0ms	1228×	body	256	unsamplable
3.0ms	2×	body	4096	invalid
3.0ms	1×	body	8192	invalid

Bogosity

localize28.9s (13.8%)

Compiler: Compiled 7984 to 3763 computations (52.9% saved)

soundness28.7s (13.8%)

Rules

59080×	`fma-def`
30004×	`log1p-expm1-u`
26930×	`times-frac`
26476×	`associate-r`
26418×	`log-prod`

Stop Event

6×	saturated
2×	unsound
92×	node limit

Compiler

Compiled 7333 to 4029 computations (45.1% saved)

eval20.0s (9.6%)

Compiler: Compiled 993267 to 547822 computations (44.8% saved)

simplify16.6s (7.9%)

Algorithm

87×	egg-herbie

Rules

51570×	`fma-def`
36112×	`log-prod`
29640×	`associate-r`
26980×	`associate-l`
26860×	`sqr-pow`

Stop Event

5×	unsound
3×	done
20×	saturated
17×	fuel
62×	node limit

Counts

27625 → 21578

Compiler

Compiled 1317 to 886 computations (32.7% saved)

rewrite13.9s (6.7%)

Algorithm

67×	batch-egg-rewrite

Rules

35097×	`log1p-expm1-u`
28260×	`expm1-log1p-u`
22026×	`log-prod`
21680×	`prod-diff`
21678×	`expm1-udef`

Stop Event

1×	unsound
66×	node limit

Counts

490 → 19182

analyze12.9s (6.2%)

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
22.1%	16.3%	57.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.1%	0.2%	6
71%	51.1%	20.8%	26.3%	0%	1.6%	0.2%	7
72%	51.6%	20.1%	26.3%	0%	1.8%	0.2%	8
74.2%	53%	18.4%	26.3%	0%	2%	0.2%	9
75.7%	53.9%	17.3%	26.3%	0%	2.2%	0.3%	10
76.4%	54.3%	16.8%	26.3%	0%	2.3%	0.3%	11
77.2%	54.8%	16.2%	26.3%	0%	2.4%	0.3%	12

Compiler

Compiled 295 to 210 computations (28.8% saved)

prune10.7s (5.1%)

Counts: 40398 → 1733
Compiler: Compiled 91075 to 61618 computations (32.3% saved)

regimes9.7s (4.7%)

Counts

2909 → 128

Calls

55 calls:

1.5s	a
1.3s	x
919.0ms	b
752.0ms	r
471.0ms	z

Compiler

Compiled 34381 to 16396 computations (52.3% saved)

preprocess7.4s (3.6%)

Algorithm

20×	egg-herbie

Rules

23976×	`fma-def`
6950×	`fma-neg`
6346×	`distribute-lft-neg-in`
5212×	`div-sub`
4916×	`distribute-rgt-neg-in`

Stop Event

12×	saturated
8×	node limit

Compiler

Compiled 10237 to 5814 computations (43.2% saved)

series4.5s (2.2%)

Counts

490 → 8443

Calls

2268 calls:

Time	Variable		Point	Expression
314.0ms	w	@	-inf	(pow.f64 (pow.f64 l (sqrt.f64 (exp.f64 w))) (sqrt.f64 (exp.f64 w)))
247.0ms	s	@	0	(/.f64 1 (pow.f64 (*.f64 x s) 2))
189.0ms	x	@	0	(*.f64 (pow.f64 2 1/4) x)
132.0ms	b	@	-inf	(*.f64 (sqrt.f64 (+.f64 b a)) (cbrt.f64 (pow.f64 (-.f64 a b) 3/2)))
86.0ms	x	@	inf	(log.f64 (sqrt.f64 (exp.f64 (fmod.f64 (exp.f64 x) (sqrt.f64 (cos.f64 x))))))

bsearch1.5s (0.7%)

Algorithm

27×	binary-search
4×	left-value

Stop Event

27×	narrow-enough

Results

713.0ms	1235×	body	512	valid
695.0ms	2152×	body	256	valid
16.0ms	85×	body	256	infinite

Compiler

Compiled 4618 to 3306 computations (28.4% saved)

Herbie run

sample53.8s (25.8%)

localize28.9s (13.8%)

soundness28.7s (13.8%)

eval20.0s (9.6%)

simplify16.6s (7.9%)

rewrite13.9s (6.7%)

analyze12.9s (6.2%)

prune10.7s (5.1%)

regimes9.7s (4.7%)

preprocess7.4s (3.6%)

series4.5s (2.2%)

bsearch1.5s (0.7%)

end1.0ms (0%)

Profiling