Metrics for Herbie run

Date:	Thursday, February 8th, 2024
Commit:	b35bd1f1 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024039
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

soundness7.5min (19%)

Rules

905922×	`fma-define`
774622×	`fma-neg`
610192×	`associate-r`
530240×	`log-prod`
512210×	`associate-l`

Stop Event

92×	saturated
1424×	node limit
7×	unsound

Compiler

Compiled 95723 to 52858 computations (44.8% saved)

sample6.3min (15.8%)

Results

4.6min	1822418×	256	valid
56.2s	342082×	256	infinite
13.6s	64287×	256	invalid
12.7s	30371×	512	valid
9.2s	19162×	1024	valid
3.0s	5025×	2048	valid
1.9s	1613×	8192	exit
418.0ms	1087×	512	infinite
481.0ms	713×	1024	infinite
188.0ms	671×	1024	invalid
111.0ms	597×	512	invalid
3.0ms	6×	4096	valid

Bogosity

regimes5.2min (13.1%)

Counts

33071 → 5775

Calls

491 calls:

47.3s	y
46.2s	x
46.1s	z
33.6s	t
28.8s	a

Compiler

Compiled 44973 to 35528 computations (21% saved)

simplify3.9min (9.9%)

Algorithm

1067×

egg-herbie

Rules

506260×	`fma-define`
503408×	`log-prod`
473148×	`fma-neg`
399806×	`associate-r`
362752×	`associate-l`

Stop Event

269×	saturated
794×	node limit
140×	fuel
4×	unsound
129×	done

Counts

356365 → 269455

Compiler

Compiled 66182 to 39736 computations (40% saved)

localize3.7min (9.3%)

Compiler: Compiled 108882 to 47874 computations (56% saved)

eval3.1min (7.8%)

Compiler: Compiled 8105359 to 4312898 computations (46.8% saved)

rewrite2.9min (7.3%)

Algorithm

798×	batch-egg-rewrite

Rules

579648×	`log1p-expm1-u`
424250×	`expm1-log1p-u`
262210×	`log-prod`
256288×	`prod-diff`
214592×	`unpow-prod-down`

Stop Event

796×	node limit
2×	unsound

Counts

5523 → 207596

preprocess2.2min (5.4%)

Algorithm

269×	egg-herbie

Rules

290792×	`fma-neg`
230854×	`fma-define`
121722×	`unsub-neg`
104422×	`sub-neg`
98742×	`distribute-lft-in`

Stop Event

140×	saturated
129×	node limit

Results

Compiler

Compiled 198887 to 98202 computations (50.6% saved)

bsearch1.8min (4.6%)

Algorithm

3474×	binary-search
290×	left-value

Stop Event

59×	predicate-same
3415×	narrow-enough

Results

1.1min	333980×	256	valid
30.1s	87178×	256	infinite
1.1s	7552×	256	invalid
1.6s	5297×	512	valid
1.9s	3967×	1024	valid
194.0ms	374×	2048	valid
31.0ms	82×	512	infinite
39.0ms	82×	1024	infinite
17.0ms	58×	512	invalid
5.0ms	15×	1024	invalid

Compiler

Compiled 793544 to 593085 computations (25.3% saved)

prune1.7min (4.2%)

Counts: 349079 → 12726
Compiler: Compiled 423323 to 287890 computations (32% saved)

series1.1min (2.8%)

Counts

5523 → 148769

Calls

38721 calls:

Time	Variable		Point	Expression
304.0ms	y	@	-inf	(*.f64 x (log.f64 y))
303.0ms	t	@	-inf	(fma.f64 z t (*.f64 x y))
300.0ms	x	@	inf	(log1p.f64 (-.f64 (sqrt.f64 (+.f64 x 1)) (sqrt.f64 x)))
275.0ms	y	@	inf	(-.f64 1 (.f64 (.f64 (*.f64 x y) y) x))
267.0ms	y	@	inf	(cbrt.f64 (*.f64 x (log.f64 y)))

analyze17.5s (0.7%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.3%	68.3%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.4%	22.9%	0.1%	0%	4.6%	0%	6
80%	75.7%	19%	0.1%	0%	5.1%	0%	7
81.8%	77.1%	17.1%	0.1%	0%	5.6%	0%	8
84.5%	79.4%	14.6%	0.1%	0%	5.9%	0%	9
86.1%	80.6%	13.1%	0.1%	0%	6.2%	0%	10
88.6%	83%	10.6%	0.1%	0%	6.2%	0%	11
89.7%	83.7%	9.6%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Herbie run

soundness7.5min (19%)

sample6.3min (15.8%)

regimes5.2min (13.1%)

simplify3.9min (9.9%)

localize3.7min (9.3%)

eval3.1min (7.8%)

rewrite2.9min (7.3%)

preprocess2.2min (5.4%)

bsearch1.8min (4.6%)

prune1.7min (4.2%)

series1.1min (2.8%)

analyze17.5s (0.7%)

end251.0ms (0%)

Profiling