Metrics for Herbie run

Date:	Friday, January 19th, 2024
Commit:	4a418bc7 on main
Hostname:	nightly with Racket 8.6
Seed:	2024019
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

soundness7.8min (20%)

Rules

1161616×	`fma-def`
622126×	`associate-r`
574136×	`times-frac`
532716×	`log-prod`
526466×	`fma-neg`

Stop Event

81×	saturated
6×	unsound
1520×	node limit

Compiler

Compiled 106093 to 58157 computations (45.2% saved)

sample6.6min (16.9%)

Results

4.8min	1823481×	body	256	valid
59.2s	341010×	body	256	infinite
15.0s	64642×	body	256	invalid
14.9s	30221×	body	512	valid
9.5s	19099×	body	1024	valid
3.4s	5202×	body	2048	valid
1.8s	1536×	body	8192	exit
327.0ms	600×	body	512	invalid
302.0ms	754×	body	1024	infinite
269.0ms	1093×	body	512	infinite
190.0ms	655×	body	1024	invalid
6.0ms	4×	body	4096	valid

Bogosity

regimes5.6min (14.2%)

Counts

34196 → 5778

Calls

491 calls:

52.3s	y
47.4s	z
46.9s	x
38.5s	t
27.6s	a

Compiler

Compiled 387798 to 215512 computations (44.4% saved)

simplify3.7min (9.4%)

Algorithm

1073×

egg-herbie

Rules

600330×	`fma-def`
444726×	`log-prod`
394228×	`associate-r`
380122×	`times-frac`
341706×	`associate-l`

Stop Event

80×	done
7×	unsound
268×	saturated
189×	fuel
798×	node limit

Counts

362191 → 265473

Compiler

Compiled 66542 to 40287 computations (39.5% saved)

localize3.4min (8.8%)

Compiler: Compiled 109642 to 47998 computations (56.2% saved)

eval3.1min (7.9%)

Compiler: Compiled 8086288 to 4339864 computations (46.3% saved)

rewrite2.8min (7.2%)

Algorithm

804×	batch-egg-rewrite

Rules

479137×	`log1p-expm1-u`
366136×	`expm1-log1p-u`
285670×	`prod-diff`
284030×	`expm1-udef`
268132×	`log-prod`

Stop Event

1×	unsound
803×	node limit

Counts

5513 → 212248

bsearch1.9min (4.8%)

Algorithm

3476×	binary-search
272×	left-value

Stop Event

3428×	narrow-enough
48×	predicate-same

Results

1.1min	328358×	body	256	valid
33.1s	91259×	body	256	infinite
1.6s	6357×	body	256	invalid
1.4s	3893×	body	512	valid
1.4s	2854×	body	1024	valid
194.0ms	243×	body	2048	valid
15.0ms	42×	body	512	infinite
2.0ms	7×	body	1024	infinite

Compiler

Compiled 805228 to 604331 computations (24.9% saved)

prune1.7min (4.4%)

Counts: 346851 → 12980
Compiler: Compiled 675421 to 469755 computations (30.5% saved)

preprocess1.6min (4%)

Algorithm

269×	egg-herbie

Rules

366494×	`fma-def`
126628×	`fma-neg`
120808×	`sub-neg`
110422×	`unsub-neg`
108590×	`div-sub`

Stop Event

123×	saturated
146×	node limit

Compiler

Compiled 192576 to 94791 computations (50.8% saved)

series35.8s (1.5%)

Counts

5513 → 149943

Calls

39201 calls:

Time	Variable		Expression
301.0ms	x	@	(-.f64 (exp.f64 (log1p.f64 (*.f64 x 27061/100000))) 1)
252.0ms	x	@	(*.f64 x (log.f64 y))
178.0ms	y	@	(+.f64 (log1p.f64 (neg.f64 x)) (log.f64 (/.f64 -1 y)))
175.0ms	x	@	(+.f64 (+.f64 x (.f64 y z)) (fma.f64 (pow.f64 (cbrt.f64 (.f64 a (.f64 z b))) 2) (cbrt.f64 (.f64 a (.f64 z b))) (.f64 a t)))
165.0ms	z	@	(-.f64 (exp.f64 (log1p.f64 (.f64 (.f64 2 (sqrt.f64 x)) (cos.f64 (.f64 t (.f64 1/3 z)))))) 1)

analyze16.8s (0.7%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.3%	68.3%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.4%	22.9%	0.1%	0%	4.6%	0%	6
80%	75.7%	19%	0.1%	0%	5.1%	0%	7
81.8%	77.1%	17.1%	0.1%	0%	5.6%	0%	8
84.5%	79.4%	14.6%	0.1%	0%	5.9%	0%	9
86.1%	80.6%	13.1%	0.1%	0%	6.2%	0%	10
88.6%	83%	10.6%	0.1%	0%	6.2%	0%	11
89.7%	83.7%	9.6%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Herbie run

soundness7.8min (20%)

sample6.6min (16.9%)

regimes5.6min (14.2%)

simplify3.7min (9.4%)

localize3.4min (8.8%)

eval3.1min (7.9%)

rewrite2.8min (7.2%)

bsearch1.9min (4.8%)

prune1.7min (4.4%)

preprocess1.6min (4%)

series35.8s (1.5%)

analyze16.8s (0.7%)

end119.0ms (0%)

Profiling