Metrics for Herbie run

Date:	Wednesday, January 10th, 2024
Commit:	3465769b on main
Hostname:	nightly with Racket 8.6
Seed:	2024010
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

soundness6.2min (18.5%)

Rules

1123096×	`fma-def`
618416×	`associate-r`
537472×	`fma-neg`
534488×	`times-frac`
519922×	`log-prod`

Stop Event

75×	saturated
10×	unsound
1448×	node limit

Compiler

Compiled 105430 to 58402 computations (44.6% saved)

sample6.1min (18.2%)

Results

4.5min	1822091×	body	256	valid
54.3s	342459×	body	256	infinite
13.8s	30351×	body	512	valid
12.9s	64381×	body	256	invalid
8.0s	19042×	body	1024	valid
2.5s	5059×	body	2048	valid
1.7s	1584×	body	8192	exit
256.0ms	741×	body	1024	infinite
254.0ms	1116×	body	512	infinite
191.0ms	663×	body	1024	invalid
114.0ms	577×	body	512	invalid
3.0ms	5×	body	4096	valid

Bogosity

regimes4.8min (14.2%)

Counts

32205 → 5362

Calls

490 calls:

45.6s	y
44.3s	x
42.5s	z
30.9s	t
24.5s	a

Compiler

Compiled 357492 to 196463 computations (45% saved)

localize3.3min (9.7%)

Compiler: Compiled 107862 to 47516 computations (55.9% saved)

simplify3.1min (9.2%)

Algorithm

1072×

egg-herbie

Rules

585440×	`fma-def`
449676×	`log-prod`
402850×	`associate-r`
350710×	`times-frac`
347052×	`associate-l`

Stop Event

69×	done
5×	unsound
268×	saturated
200×	fuel
799×	node limit

Counts

353779 → 262589

Compiler

Compiled 61909 to 37144 computations (40% saved)

eval2.7min (8.2%)

Compiler: Compiled 7761719 to 4188376 computations (46% saved)

rewrite2.0min (5.9%)

Algorithm

803×	batch-egg-rewrite

Rules

495693×	`log1p-expm1-u`
375965×	`expm1-log1p-u`
291468×	`expm1-udef`
279538×	`prod-diff`
270022×	`log1p-udef`

Stop Event

1×	unsound
802×	node limit

Counts

5429 → 205285

prune1.7min (5%)

Counts: 338461 → 13385
Compiler: Compiled 727352 to 511881 computations (29.6% saved)

bsearch1.5min (4.4%)

Algorithm

3069×	binary-search
319×	left-value

Stop Event

3014×	narrow-enough
55×	predicate-same

Results

52.5s	293839×	body	256	valid
23.5s	80815×	body	256	infinite
2.7s	4073×	body	512	valid
1.2s	6402×	body	256	invalid
903.0ms	2168×	body	1024	valid
286.0ms	1131×	body	512	invalid
67.0ms	187×	body	2048	valid
10.0ms	42×	body	1024	infinite
3.0ms	12×	body	512	infinite
1.0ms	3×	body	1024	invalid

Compiler

Compiled 709451 to 531540 computations (25.1% saved)

preprocess1.4min (4.1%)

Algorithm

269×	egg-herbie

Rules

366494×	`fma-def`
126856×	`fma-neg`
120926×	`sub-neg`
110364×	`unsub-neg`
108576×	`div-sub`

Stop Event

123×	saturated
146×	node limit

Compiler

Compiled 176638 to 88017 computations (50.2% saved)

series39.9s (2%)

Counts

5429 → 148494

Calls

38796 calls:

Time	Variable		Point	Expression
4.8s	x	@	0	(-.f64 (log.f64 (sqrt.f64 x)) (log.f64 (/.f64 y (sqrt.f64 x))))
3.6s	x	@	0	(*.f64 x (-.f64 (log.f64 (sqrt.f64 x)) (log.f64 (/.f64 y (sqrt.f64 x)))))
622.0ms	x	@	-inf	(-.f64 (log.f64 (sqrt.f64 x)) (log.f64 (/.f64 y (sqrt.f64 x))))
241.0ms	b	@	inf	(.f64 (.f64 (pow.f64 a (+.f64 t -1)) (/.f64 (pow.f64 z y) (exp.f64 b))) (/.f64 x y))
197.0ms	z	@	0	(log.f64 (.f64 (.f64 y z) (pow.f64 t (+.f64 a -1/2))))

analyze16.2s (0.8%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.3%	68.3%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.4%	22.9%	0.1%	0%	4.6%	0%	6
80%	75.7%	19%	0.1%	0%	5.1%	0%	7
81.8%	77.1%	17.1%	0.1%	0%	5.6%	0%	8
84.5%	79.4%	14.6%	0.1%	0%	5.9%	0%	9
86.1%	80.6%	13.1%	0.1%	0%	6.2%	0%	10
88.6%	83%	10.6%	0.1%	0%	6.2%	0%	11
89.7%	83.7%	9.6%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Herbie run

soundness6.2min (18.5%)

sample6.1min (18.2%)

regimes4.8min (14.2%)

localize3.3min (9.7%)

simplify3.1min (9.2%)

eval2.7min (8.2%)

rewrite2.0min (5.9%)

prune1.7min (5%)

bsearch1.5min (4.4%)

preprocess1.4min (4.1%)

series39.9s (2%)

analyze16.2s (0.8%)

end50.0ms (0%)

Profiling