Metrics for Herbie run

Date:	Saturday, January 20th, 2024
Commit:	056c35ed on error-explanations-2
Hostname:	nightly with Racket 8.6
Seed:	2024020
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

soundness7.7min (19.5%)

Rules

1181470×	`fma-def`
628126×	`associate-r`
563866×	`times-frac`
532128×	`log-prod`
503816×	`fma-neg`

Stop Event

80×	saturated
9×	unsound
1517×	node limit

Compiler

Compiled 109147 to 60780 computations (44.3% saved)

sample6.7min (17.1%)

Results

4.9min	1822191×	body	256	valid
1.0min	342078×	body	256	infinite
16.2s	30540×	body	512	valid
15.1s	63603×	body	256	invalid
9.5s	19097×	body	1024	valid
3.1s	5137×	body	2048	valid
1.7s	1585×	body	8192	exit
427.0ms	1094×	body	512	infinite
325.0ms	726×	body	1024	infinite
259.0ms	697×	body	1024	invalid
115.0ms	567×	body	512	invalid
0.0ms	1×	body	4096	valid

Bogosity

regimes5.3min (13.6%)

Counts

35340 → 5641

Calls

493 calls:

52.3s	y
52.1s	x
49.0s	z
33.4s	t
30.0s	a

Compiler

Compiled 401161 to 224343 computations (44.1% saved)

localize3.7min (9.4%)

Compiler: Compiled 107511 to 47237 computations (56.1% saved)

simplify3.6min (9.2%)

Algorithm

1064×

egg-herbie

Rules

596622×	`fma-def`
440372×	`log-prod`
400642×	`associate-r`
347170×	`associate-l`
338622×	`times-frac`

Stop Event

4×	unsound
70×	done
268×	saturated
199×	fuel
792×	node limit

Counts

353627 → 265746

Compiler

Compiled 63645 to 38864 computations (38.9% saved)

eval3.0min (7.5%)

Compiler: Compiled 8092748 to 4360055 computations (46.1% saved)

rewrite2.8min (7.1%)

Algorithm

795×	batch-egg-rewrite

Rules

487070×	`log1p-expm1-u`
367104×	`expm1-log1p-u`
307212×	`prod-diff`
282794×	`expm1-udef`
257926×	`log1p-udef`

Stop Event

1×	unsound
794×	node limit

Counts

5428 → 208555

preprocess2.1min (5.2%)

Algorithm

269×	egg-herbie

Rules

366494×	`fma-def`
126628×	`fma-neg`
120808×	`sub-neg`
110422×	`unsub-neg`
108590×	`div-sub`

Stop Event

123×	saturated
146×	node limit

Compiler

Compiled 190477 to 96316 computations (49.4% saved)

prune1.8min (4.7%)

Counts: 347443 → 13190
Compiler: Compiled 689803 to 483061 computations (30% saved)

bsearch1.7min (4.4%)

Algorithm

3330×	binary-search
283×	left-value

Stop Event

3272×	narrow-enough
58×	predicate-same

Results

1.1min	323861×	body	256	valid
24.8s	81571×	body	256	infinite
2.0s	4955×	body	512	valid
1.8s	3301×	body	1024	valid
1.2s	7497×	body	256	invalid
129.0ms	244×	body	2048	valid
53.0ms	88×	body	1024	infinite
35.0ms	108×	body	512	infinite
8.0ms	19×	body	512	invalid

Compiler

Compiled 738506 to 553417 computations (25.1% saved)

series37.5s (1.6%)

Counts

5428 → 145072

Calls

38205 calls:

Time	Variable		Point	Expression
377.0ms	x	@	0	(log.f64 (cbrt.f64 (pow.f64 (exp.f64 x) 27061/100000)))
268.0ms	x	@	0	(*.f64 x (log.f64 y))
266.0ms	t	@	0	(*.f64 z (log.f64 t))
265.0ms	x	@	-inf	(log.f64 (/.f64 (exp.f64 x) (pow.f64 y (+.f64 y 1/2))))
235.0ms	x	@	0	(log.f64 (+.f64 1 (expm1.f64 (*.f64 x 27061/100000))))

analyze17.5s (0.7%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.3%	68.3%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.4%	22.9%	0.1%	0%	4.6%	0%	6
80%	75.7%	19%	0.1%	0%	5.1%	0%	7
81.8%	77.1%	17.1%	0.1%	0%	5.6%	0%	8
84.5%	79.4%	14.6%	0.1%	0%	5.9%	0%	9
86.1%	80.6%	13.1%	0.1%	0%	6.2%	0%	10
88.6%	83%	10.6%	0.1%	0%	6.2%	0%	11
89.7%	83.7%	9.6%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Herbie run

soundness7.7min (19.5%)

sample6.7min (17.1%)

regimes5.3min (13.6%)

localize3.7min (9.4%)

simplify3.6min (9.2%)

eval3.0min (7.5%)

rewrite2.8min (7.1%)

preprocess2.1min (5.2%)

prune1.8min (4.7%)

bsearch1.7min (4.4%)

series37.5s (1.6%)

analyze17.5s (0.7%)

end110.0ms (0%)

Profiling