Metrics for Herbie run

Date:	Wednesday, January 24th, 2024
Commit:	34547557 on faster-timeline-start
Hostname:	nightly with Racket 8.6
Seed:	2024024
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

soundness7.5min (19.4%)

Rules

1125918×	`fma-def`
602736×	`associate-r`
559134×	`times-frac`
485270×	`fma-neg`
483400×	`log-prod`

Stop Event

77×	saturated
6×	unsound
1459×	node limit

Compiler

Compiled 99494 to 54824 computations (44.9% saved)

sample6.6min (17%)

Results

4.8min	1823281×	256	valid
57.8s	341172×	256	infinite
15.0s	65854×	256	invalid
15.7s	30401×	512	valid
9.2s	19249×	1024	valid
2.9s	4866×	2048	valid
2.2s	1604×	8192	exit
286.0ms	1095×	512	infinite
325.0ms	795×	1024	infinite
189.0ms	654×	1024	invalid
171.0ms	560×	512	invalid
18.0ms	5×	4096	valid

Bogosity

regimes4.9min (12.8%)

Counts

31062 → 5200

Calls

490 calls:

46.4s	y
44.6s	x
42.4s	z
31.3s	t
29.1s	a

Compiler

Compiled 347905 to 195353 computations (43.8% saved)

simplify3.8min (9.7%)

Algorithm

1077×

egg-herbie

Rules

586442×	`fma-def`
436336×	`log-prod`
415014×	`associate-r`
363636×	`associate-l`
355468×	`times-frac`

Stop Event

5×	unsound
74×	done
268×	saturated
195×	fuel
804×	node limit

Counts

366448 → 273810

Compiler

Compiled 58399 to 36059 computations (38.3% saved)

localize3.5min (9.1%)

Compiler: Compiled 110884 to 48357 computations (56.4% saved)

eval3.3min (8.6%)

Compiler: Compiled 8654969 to 4642562 computations (46.4% saved)

rewrite2.9min (7.5%)

Algorithm

808×	batch-egg-rewrite

Rules

495220×	`log1p-expm1-u`
370122×	`expm1-log1p-u`
304528×	`expm1-udef`
280582×	`log1p-udef`
278916×	`prod-diff`

Stop Event

2×	unsound
806×	node limit

Counts

5636 → 214269

preprocess2.0min (5.2%)

Algorithm

269×	egg-herbie

Rules

366494×	`fma-def`
126628×	`fma-neg`
120808×	`sub-neg`
110422×	`unsub-neg`
108590×	`div-sub`

Stop Event

123×	saturated
146×	node limit

Compiler

Compiled 179859 to 90460 computations (49.7% saved)

prune1.8min (4.6%)

Counts: 354024 → 13015
Compiler: Compiled 682785 to 477759 computations (30% saved)

bsearch1.5min (3.8%)

Algorithm

3056×	binary-search
238×	left-value

Stop Event

3002×	narrow-enough
54×	predicate-same

Results

52.5s	295401×	256	valid
23.9s	79669×	256	infinite
2.2s	4663×	512	valid
461.0ms	4525×	256	invalid
1.1s	2225×	1024	valid
75.0ms	134×	2048	valid
11.0ms	38×	512	infinite
4.0ms	14×	1024	infinite

Compiler

Compiled 681888 to 513653 computations (24.7% saved)

series38.7s (1.7%)

Counts

5636 → 152179

Calls

39792 calls:

Time	Variable		Point	Expression
269.0ms	x	@	-inf	(*.f64 (/.f64 6 (fma.f64 4 (sqrt.f64 x) (+.f64 x 1))) (+.f64 x -1))
257.0ms	x	@	0	(.f64 x (exp.f64 (neg.f64 (.f64 y t))))
227.0ms	x	@	0	(-.f64 (exp.f64 (log1p.f64 (*.f64 x 4481/100000))) 1)
187.0ms	y	@	inf	(/.f64 (/.f64 2 y) z)
186.0ms	t	@	0	(-.f64 (*.f64 (log.f64 a) (-.f64 t 1)) b)

analyze16.8s (0.7%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.3%	68.3%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.4%	22.9%	0.1%	0%	4.6%	0%	6
80%	75.7%	19%	0.1%	0%	5.1%	0%	7
81.8%	77.1%	17.1%	0.1%	0%	5.6%	0%	8
84.5%	79.4%	14.6%	0.1%	0%	5.9%	0%	9
86.1%	80.6%	13.1%	0.1%	0%	6.2%	0%	10
88.6%	83%	10.6%	0.1%	0%	6.2%	0%	11
89.7%	83.7%	9.6%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Herbie run

soundness7.5min (19.4%)

sample6.6min (17%)

regimes4.9min (12.8%)

simplify3.8min (9.7%)

localize3.5min (9.1%)

eval3.3min (8.6%)

rewrite2.9min (7.5%)

preprocess2.0min (5.2%)

prune1.8min (4.6%)

bsearch1.5min (3.8%)

series38.7s (1.7%)

analyze16.8s (0.7%)

end110.0ms (0%)

Profiling