Metrics for Herbie run

Date:	Friday, February 9th, 2024
Commit:	0d0ea017 on zane-regimes-2
Hostname:	nightly with Racket 8.11.1
Seed:	2024040
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

soundness7.6min (19.1%)

Rules

1152214×	`fma-def`
638882×	`associate-r`
569676×	`times-frac`
541478×	`log-prod`
511006×	`fma-neg`

Stop Event

91×	saturated
1534×	node limit
7×	unsound

Compiler

Compiled 106440 to 59794 computations (43.8% saved)

sample6.5min (16.3%)

Results

4.7min	1823871×	body	256	valid
58.5s	341032×	body	256	infinite
15.7s	30100×	body	512	valid
13.3s	64322×	body	256	invalid
8.6s	19067×	body	1024	valid
2.3s	4992×	body	2048	valid
2.1s	1627×	body	8192	exit
267.0ms	1055×	body	512	infinite
266.0ms	739×	body	1024	infinite
189.0ms	700×	body	1024	invalid
124.0ms	575×	body	512	invalid
4.0ms	8×	body	4096	valid

Bogosity

regimes6.1min (15.3%)

Counts

34574 → 5873

Calls

493 calls:

59.3s	y
56.7s	z
53.0s	x
40.4s	t
28.6s	a

Compiler

Compiled 400815 to 230795 computations (42.4% saved)

simplify3.8min (9.5%)

Algorithm

1081×

egg-herbie

Rules

599802×	`fma-def`
468982×	`log-prod`
396718×	`associate-r`
364606×	`times-frac`
350334×	`associate-l`

Stop Event

268×	saturated
807×	node limit
197×	fuel
6×	unsound
72×	done

Counts

359103 → 267803

Compiler

Compiled 66300 to 40616 computations (38.7% saved)

localize3.4min (8.7%)

Compiler: Compiled 108918 to 47984 computations (55.9% saved)

rewrite2.9min (7.4%)

Algorithm

812×	batch-egg-rewrite

Rules

495849×	`log1p-expm1-u`
376454×	`expm1-log1p-u`
300904×	`expm1-udef`
289848×	`prod-diff`
272238×	`log1p-udef`

Stop Event

810×	node limit
2×	unsound

Counts

5596 → 212294

eval2.9min (7.3%)

Compiler: Compiled 7854227 to 4234460 computations (46.1% saved)

bsearch2.0min (5%)

Algorithm

3524×	binary-search
267×	left-value

Stop Event

52×	predicate-same
3472×	narrow-enough

Results

1.1min	331811×	body	256	valid
34.3s	93306×	body	256	infinite
2.1s	3444×	body	512	valid
1.6s	10697×	body	256	invalid
1.4s	2301×	body	1024	valid
52.0ms	112×	body	1024	infinite
44.0ms	118×	body	2048	valid
37.0ms	124×	body	512	infinite
14.0ms	88×	body	512	invalid

Compiler

Compiled 778926 to 587494 computations (24.6% saved)

prune1.9min (4.7%)

Counts: 340515 → 13309
Compiler: Compiled 695418 to 489570 computations (29.6% saved)

preprocess1.7min (4.3%)

Algorithm

269×	egg-herbie

Rules

366494×	`fma-def`
126628×	`fma-neg`
120808×	`sub-neg`
110422×	`unsub-neg`
108590×	`div-sub`

Stop Event

123×	saturated
146×	node limit

Compiler

Compiled 189672 to 96731 computations (49% saved)

series40.2s (1.7%)

Counts

5596 → 146809

Calls

38913 calls:

Time	Variable		Point	Expression
346.0ms	a	@	0	(+.f64 x (fma.f64 -1 (/.f64 (*.f64 z (-.f64 a x)) (-.f64 (+.f64 1 t) z)) (/.f64 y (/.f64 (-.f64 (+.f64 1 t) z) (-.f64 a x)))))
306.0ms	y	@	-inf	(/.f64 (*.f64 b y) t)
260.0ms	y	@	inf	(pow.f64 (/.f64 x y) x)
228.0ms	a	@	0	(*.f64 (/.f64 (-.f64 y z) (neg.f64 z)) a)
220.0ms	y	@	-inf	(log1p.f64 (-.f64 (/.f64 x y) (+.f64 1 (/.f64 1 y))))

analyze18.7s (0.8%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.3%	68.3%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.4%	22.9%	0.1%	0%	4.6%	0%	6
80%	75.7%	19%	0.1%	0%	5.1%	0%	7
81.8%	77.1%	17.1%	0.1%	0%	5.6%	0%	8
84.5%	79.4%	14.6%	0.1%	0%	5.9%	0%	9
86.1%	80.6%	13.1%	0.1%	0%	6.2%	0%	10
88.6%	83%	10.6%	0.1%	0%	6.2%	0%	11
89.7%	83.7%	9.6%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Herbie run

soundness7.6min (19.1%)

sample6.5min (16.3%)

regimes6.1min (15.3%)

simplify3.8min (9.5%)

localize3.4min (8.7%)

rewrite2.9min (7.4%)

eval2.9min (7.3%)

bsearch2.0min (5%)

prune1.9min (4.7%)

preprocess1.7min (4.3%)

series40.2s (1.7%)

analyze18.7s (0.8%)

end255.0ms (0%)

Profiling