Metrics for Herbie run

Date:	Friday, October 20th, 2023
Commit:	21d611eb on main
Hostname:	nightly with Racket 8.6
Seed:	2023293
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample5.8min (18.5%)

Results

3.8min	1789852×	body	256	valid
47.4s	334909×	body	256	infinite
24.2s	144375×	body	256	invalid
23.5s	45753×	body	1024	valid
10.6s	32111×	body	512	valid
6.6s	9887×	body	2048	valid
1.9s	4828×	body	1024	infinite
1.5s	1573×	body	8192	exit
978.0ms	3186×	body	512	infinite
730.0ms	338×	body	4096	valid
287.0ms	1252×	body	1024	invalid
187.0ms	930×	body	512	invalid
0.0ms	2×	body	2048	invalid

Bogosity

soundness5.5min (17.4%)

Rules

1356162×	`fma-def`
750588×	`associate-r`
701834×	`log-prod`
670352×	`fma-neg`
609120×	`associate-l`

Stop Event

8×	unsound
84×	saturated
1641×	node limit

Compiler

Compiled 117488 to 65726 computations (44.1% saved)

regimes5.0min (15.9%)

Counts

36160 → 5891

Calls

496 calls:

45.4s	x
44.5s	y
44.0s	z
34.8s	t
28.0s	a

Compiler

Compiled 427390 to 238061 computations (44.3% saved)

localize3.1min (9.8%)

Compiler: Compiled 113446 to 47231 computations (58.4% saved)

simplify2.7min (8.5%)

Algorithm

1081×

egg-herbie

Rules

605276×	`fma-def`
481996×	`log-prod`
426454×	`associate-r`
384612×	`associate-l`
379056×	`fma-neg`

Stop Event

5×	unsound
68×	done
268×	saturated
201×	fuel
808×	node limit

Counts

357882 → 262629

Compiler

Compiled 67639 to 41048 computations (39.3% saved)

eval2.5min (7.9%)

Compiler: Compiled 7697909 to 3805448 computations (50.6% saved)

rewrite1.6min (5.1%)

Algorithm

812×	batch-egg-rewrite

Rules

509544×	`pow1`
480142×	`add-exp-log`
479848×	`log1p-expm1-u`
479806×	`expm1-log1p-u`
450064×	`add-log-exp`

Stop Event

1×	unsound
811×	node limit

Counts

5733 → 204888

prune1.6min (5.1%)

Counts: 333944 → 13185
Compiler: Compiled 685006 to 471591 computations (31.2% saved)

bsearch1.6min (5%)

Algorithm

3424×	binary-search
341×	left-value

Stop Event

3365×	narrow-enough
59×	predicate-same

Results

53.5s	327245×	body	256	valid
23.0s	84775×	body	256	infinite
4.3s	6208×	body	1024	valid
2.0s	5786×	body	512	valid
1.4s	12260×	body	256	invalid
812.0ms	1592×	body	1024	infinite
364.0ms	1101×	body	512	infinite
113.0ms	269×	body	2048	valid
2.0ms	11×	body	512	invalid
2.0ms	6×	body	1024	invalid

Compiler

Compiled 772037 to 576566 computations (25.3% saved)

preprocess1.4min (4.3%)

Algorithm

269×	egg-herbie

Rules

379496×	`fma-def`
124614×	`fma-neg`
117016×	`sub-neg`
102806×	`unsub-neg`
98826×	`div-sub`

Stop Event

123×	saturated
146×	node limit

Compiler

Compiled 160050 to 77978 computations (51.3% saved)

series28.0s (1.5%)

Counts

5733 → 152994

Calls

39663 calls:

Time	Variable		Point	Expression
353.0ms	x	@	0	(*.f64 x (log.f64 y))
260.0ms	x	@	inf	(*.f64 (sqrt.f64 x) y)
168.0ms	x	@	0	(-.f64 (exp.f64 (log1p.f64 (*.f64 x 27061/100000))) 1)
122.0ms	z	@	inf	(/.f64 y (/.f64 (fma.f64 z (-.f64 b y) y) x))
120.0ms	a	@	0	(.f64 (.f64 (pow.f64 a (+.f64 t -1)) (/.f64 (pow.f64 z y) (exp.f64 b))) (/.f64 x y))

analyze16.6s (0.9%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
49.9%	49.7%	49.9%	0.1%	0%	0.2%	0%	2
57.9%	57.4%	41.7%	0.1%	0%	0.7%	0%	3
64%	63.2%	35.5%	0.1%	0%	1.2%	0%	4
69.8%	68.7%	29.8%	0.1%	0%	1.4%	0%	5
74.4%	72.7%	25.1%	0.1%	0%	2.1%	0%	6
78.5%	76%	20.8%	0.1%	0%	3%	0%	7
80.3%	77.4%	19%	0.1%	0%	3.5%	0%	8
83.1%	79.6%	16.2%	0.1%	0%	4.1%	0%	9
84.8%	80.8%	14.4%	0.1%	0%	4.7%	0%	10
87.7%	83.1%	11.7%	0.1%	0%	5.1%	0%	11
88.9%	83.8%	10.5%	0.1%	0%	5.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Herbie run

sample5.8min (18.5%)

soundness5.5min (17.4%)

regimes5.0min (15.9%)

localize3.1min (9.8%)

simplify2.7min (8.5%)

eval2.5min (7.9%)

rewrite1.6min (5.1%)

prune1.6min (5.1%)

bsearch1.6min (5%)

preprocess1.4min (4.3%)

series28.0s (1.5%)

analyze16.6s (0.9%)

end54.0ms (0%)

Profiling