Metrics for Herbie run

Date:	Tuesday, November 14th, 2023
Commit:	71362506 on hamming-cleanup
Hostname:	nightly with Racket 8.6
Seed:	2023318
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

soundness6.6min (18.4%)

Rules

1166472×	`fma-def`
645708×	`associate-r`
583818×	`times-frac`
541820×	`fma-neg`
528094×	`log-prod`

Stop Event

4×	unsound
81×	saturated
1517×	node limit

Compiler

Compiled 101446 to 55936 computations (44.9% saved)

sample5.9min (16.5%)

Results

3.8min	1790844×	body	256	valid
47.8s	334358×	body	256	infinite
25.1s	144617×	body	256	invalid
23.2s	45307×	body	1024	valid
11.3s	32268×	body	512	valid
6.5s	9598×	body	2048	valid
1.9s	4945×	body	1024	infinite
1.6s	1616×	body	8192	exit
857.0ms	3216×	body	512	infinite
446.0ms	328×	body	4096	valid
274.0ms	1243×	body	1024	invalid
193.0ms	905×	body	512	invalid
0.0ms	1×	body	2048	invalid

Bogosity

regimes5.0min (14%)

Counts

33618 → 5537

Calls

493 calls:

48.2s	y
43.4s	x
40.9s	z
33.6s	t
24.9s	a

Compiler

Compiled 391862 to 224078 computations (42.8% saved)

simplify3.2min (8.9%)

Algorithm

1077×

egg-herbie

Rules

590570×	`fma-def`
440232×	`log-prod`
401936×	`associate-r`
357748×	`times-frac`
344180×	`associate-l`

Stop Event

77×	done
4×	unsound
270×	saturated
192×	fuel
803×	node limit

Counts

361658 → 267786

Compiler

Compiled 63137 to 38501 computations (39% saved)

localize3.1min (8.6%)

Compiler: Compiled 110039 to 49110 computations (55.4% saved)

eval2.8min (7.8%)

Compiler: Compiled 7806167 to 4225472 computations (45.9% saved)

series2.6min (7.2%)

Counts

5573 → 148631

Calls

39315 calls:

Time	Variable		Point	Expression
2.1min	x	@	inf	(-.f64 (pow.f64 (cbrt.f64 (+.f64 1 x)) 3/2) (pow.f64 (cbrt.f64 x) 3/2))
306.0ms	x	@	0	(pow.f64 x 1/6)
301.0ms	x	@	0	(-.f64 (exp.f64 (log1p.f64 (*.f64 x 27061/100000))) 1)
265.0ms	z	@	inf	(/.f64 (neg.f64 (/.f64 (/.f64 x t) (cbrt.f64 z))) (pow.f64 (cbrt.f64 z) 2))
242.0ms	y	@	inf	(pow.f64 (pow.f64 (.f64 1/3 (acos.f64 (.f64 1/18 (*.f64 (/.f64 x z) (/.f64 (sqrt.f64 t) y))))) 1/6) 3)

rewrite2.0min (5.5%)

Algorithm

808×	batch-egg-rewrite

Rules

477481×	`log1p-expm1-u`
371623×	`expm1-log1p-u`
283362×	`expm1-udef`
281826×	`prod-diff`
278410×	`log-prod`

Stop Event

1×	unsound
807×	node limit

Counts

5573 → 213027

prune1.7min (4.7%)

Counts: 341483 → 12911
Compiler: Compiled 688713 to 483968 computations (29.7% saved)

bsearch1.4min (4%)

Algorithm

3313×	binary-search
224×	left-value

Stop Event

3245×	narrow-enough
68×	predicate-same

Results

50.9s	316428×	body	256	valid
23.3s	86417×	body	256	infinite
1.7s	3391×	body	1024	valid
1.3s	4017×	body	512	valid
633.0ms	5344×	body	256	invalid
172.0ms	142×	body	1024	infinite
85.0ms	189×	body	2048	valid
31.0ms	120×	body	512	infinite
2.0ms	12×	body	512	invalid

Compiler

Compiled 763646 to 567444 computations (25.7% saved)

preprocess1.3min (3.6%)

Algorithm

269×	egg-herbie

Rules

379496×	`fma-def`
124020×	`fma-neg`
116236×	`sub-neg`
103518×	`unsub-neg`
98712×	`div-sub`

Stop Event

123×	saturated
146×	node limit

Compiler

Compiled 151518 to 73064 computations (51.8% saved)

analyze15.1s (0.7%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
49.9%	49.7%	49.9%	0.1%	0%	0.2%	0%	2
57.9%	57.4%	41.7%	0.1%	0%	0.7%	0%	3
64%	63.2%	35.5%	0.1%	0%	1.2%	0%	4
69.8%	68.7%	29.8%	0.1%	0%	1.4%	0%	5
74.4%	72.7%	25.1%	0.1%	0%	2.1%	0%	6
78.5%	76%	20.8%	0.1%	0%	3%	0%	7
80.3%	77.4%	19%	0.1%	0%	3.5%	0%	8
83.1%	79.6%	16.2%	0.1%	0%	4.1%	0%	9
84.8%	80.8%	14.4%	0.1%	0%	4.7%	0%	10
87.7%	83.1%	11.7%	0.1%	0%	5.1%	0%	11
88.9%	83.8%	10.5%	0.1%	0%	5.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Herbie run

soundness6.6min (18.4%)

sample5.9min (16.5%)

regimes5.0min (14%)

simplify3.2min (8.9%)

localize3.1min (8.6%)

eval2.8min (7.8%)

series2.6min (7.2%)

rewrite2.0min (5.5%)

prune1.7min (4.7%)

bsearch1.4min (4%)

preprocess1.3min (3.6%)

analyze15.1s (0.7%)

end51.0ms (0%)

Profiling