Metrics for Herbie run

Date:	Saturday, April 6th, 2024
Commit:	91c240bf on egg-serialize
Hostname:	nightly with Racket 8.11.1
Seed:	2024097
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

eval7.2min (18.4%)

Compiler: Compiled 21422893 to 9626836 computations (55.1% saved)

sample7.2min (18.3%)

Results

3.8min	1807770×	0	valid
47.5s	341602×	0	infinite
10.4s	64266×	0	invalid
24.8s	60859×	1	valid
3.2s	7391×	2	valid
889.0ms	2576×	1	infinite
2.1s	1592×	5	exit
344.0ms	1575×	1	invalid
216.0ms	511×	3	valid
46.0ms	152×	2	infinite
1.0ms	3×	4	valid

Precisions

Click to see histograms. Total time spent on operations: 2.5min

ival-mult: 52.2s (35% of total)

ival-sub: 22.4s (15% of total)

ival-add: 22.0s (14.8% of total)

ival-div: 19.0s (12.8% of total)

ival-log: 8.6s (5.8% of total)

ival-sqrt: 5.9s (3.9% of total)

backward-pass: 4.9s (3.3% of total)

ival-sin: 4.2s (2.8% of total)

const: 3.5s (2.4% of total)

ival-cos: 3.0s (2% of total)

ival-exp: 1.6s (1.1% of total)

ival-cosh: 407.0ms (0.3% of total)

ival-fabs: 394.0ms (0.3% of total)

ival-tan: 328.0ms (0.2% of total)

ival-acos: 211.0ms (0.1% of total)

ival-sinh: 161.0ms (0.1% of total)

ival-tanh: 107.0ms (0.1% of total)

Bogosity

localize4.5min (11.4%)

Results

1.5min	177681×	256	valid
15.7s	32673×	256	infinite
4.7s	6046×	256	invalid
22.5s	4791×	1024	valid
48.2s	2832×	8192	exit
6.2s	2661×	512	valid
20.7s	2025×	2048	valid
1.1s	427×	1024	infinite
228.0ms	383×	256	unsamplable
194.0ms	166×	512	infinite
252.0ms	73×	2048	infinite
503.0ms	46×	4096	valid
369.0ms	46×	1024	invalid
117.0ms	23×	512	invalid
88.0ms	7×	2048	invalid
12.0ms	4×	8192	valid
13.0ms	4×	4096	infinite

Compiler

Compiled 121107 to 50450 computations (58.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.7min

ival-mult: 41.0s (25% of total)

ival-pow: 29.0s (17.7% of total)

ival-div: 17.7s (10.8% of total)

ival-add: 16.8s (10.2% of total)

ival-log: 10.7s (6.5% of total)

composed: 9.4s (5.7% of total)

ival-sub: 9.2s (5.6% of total)

ival-cos: 8.9s (5.4% of total)

ival-exp: 6.1s (3.7% of total)

ival-sqrt: 4.6s (2.8% of total)

const: 3.0s (1.9% of total)

ival-sin: 2.7s (1.7% of total)

ival-tan: 2.0s (1.2% of total)

ival-cbrt: 2.0s (1.2% of total)

ival-neg: 425.0ms (0.3% of total)

ival-acos: 175.0ms (0.1% of total)

ival-sinh: 78.0ms (0% of total)

ival-tanh: 51.0ms (0% of total)

ival-cosh: 47.0ms (0% of total)

ival-fabs: 10.0ms (0% of total)

rewrite3.4min (8.7%)

Algorithm

852×	batch-egg-rewrite

Rules

589808×	`log1p-expm1-u`
436292×	`expm1-log1p-u`
168473×	`pow1`
162528×	`add-exp-log`
155619×	`add-log-exp`

Stop Event

851×	node limit
1×	unsound

Counts

5868 → 288176

simplify3.3min (8.5%)

Algorithm

1121×

egg-herbie

Rules

312224×	`fma-define`
251507×	`*-commutative`
235285×	`fma-neg`
229240×	`distribute-lft-in`
212403×	`times-frac`

Stop Event

270×	saturated
847×	node limit
4×	unsound

Counts

453809 → 353652

soundness3.3min (8.4%)

Rules

247057×	`fma-define`
244158×	`log1p-expm1-u`
203316×	`fma-neg`
168809×	`expm1-log1p-u`
140894×	`associate-r`

Stop Event

75×	saturated
803×	node limit
159×	fuel
110×	done

Compiler

Compiled 162722 to 85516 computations (47.4% saved)

regimes2.6min (6.6%)

Counts

40915 → 5982

Calls

494 calls:

26.5s	y
24.7s	x
22.6s	z
15.2s	t
10.3s	a

Compiler

Compiled 45447 to 35907 computations (21% saved)

prune2.4min (6.1%)

Counts: 934243 → 14559
Compiler: Compiled 519391 to 344469 computations (33.7% saved)

bsearch1.9min (4.9%)

Algorithm

3449×	binary-search
377×	left-value

Stop Event

54×	predicate-same
3395×	narrow-enough

Results

52.2s	332657×	0	valid
26.4s	85491×	0	infinite
4.3s	10913×	1	valid
380.0ms	4173×	0	invalid
449.0ms	1057×	2	valid
106.0ms	349×	1	infinite
9.0ms	34×	2	infinite
12.0ms	27×	3	valid

Compiler

Compiled 761909 to 570348 computations (25.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 44.2s

ival-mult: 18.8s (42.5% of total)

ival-sub: 9.1s (20.6% of total)

ival-add: 6.4s (14.5% of total)

ival-div: 4.0s (9% of total)

ival-log: 1.8s (4.1% of total)

backward-pass: 922.0ms (2.1% of total)

ival-sqrt: 819.0ms (1.9% of total)

ival-sin: 690.0ms (1.6% of total)

const: 647.0ms (1.5% of total)

ival-cos: 573.0ms (1.3% of total)

ival-exp: 363.0ms (0.8% of total)

ival-sinh: 33.0ms (0.1% of total)

ival-tanh: 12.0ms (0% of total)

ival-cosh: 9.0ms (0% of total)

ival-fabs: 3.0ms (0% of total)

preprocess1.4min (3.5%)

Algorithm

269×	egg-herbie

Rules

137764×	`fma-neg`
117084×	`fma-define`
57352×	`unsub-neg`
50425×	`sub-neg`
47106×	`distribute-rgt-in`

Stop Event

153×	saturated
116×	node limit

Compiler

Compiled 169900 to 85998 computations (49.4% saved)

explain50.6s (2.1%)

Results

22.3s	110602×	256	valid
4.8s	21108×	256	infinite
4.1s	2838×	1024	valid
1.2s	1670×	512	valid
2.0s	1042×	2048	valid
426.0ms	264×	1024	infinite
179.0ms	144×	512	infinite
57.0ms	56×	2048	infinite
4.0ms	4×	4096	valid

Compiler

Compiled 26361 to 12514 computations (52.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 18.7s

ival-mult: 6.7s (35.6% of total)

ival-sub: 2.7s (14.4% of total)

ival-add: 2.3s (12.5% of total)

ival-div: 2.3s (12.3% of total)

ival-log: 2.2s (11.6% of total)

ival-sqrt: 585.0ms (3.1% of total)

ival-cos: 582.0ms (3.1% of total)

const: 482.0ms (2.6% of total)

ival-sin: 399.0ms (2.1% of total)

ival-exp: 209.0ms (1.1% of total)

ival-fabs: 183.0ms (1% of total)

ival-tan: 43.0ms (0.2% of total)

ival-cosh: 13.0ms (0.1% of total)

ival-sinh: 12.0ms (0.1% of total)

ival-acos: 11.0ms (0.1% of total)

ival-tanh: 9.0ms (0% of total)

series48.8s (2.1%)

Counts

5868 → 165633

Calls

40899 calls:

Time	Variable		Point	Expression
293.0ms	x	@	0	(* x (log y))
251.0ms	z	@	inf	(* (* z (* z 480125098611044764748221188321/100000000000000000000000000000000)) (/ y (+ (+ (* z (* 692910599291889/10000000000000000 z)) (* z 307332350656623/625000000000000)) -11167812716741/40000000000000)))
240.0ms	x	@	inf	(cbrt (* x (log y)))
239.0ms	b	@	inf	(* (pow z y) (/ (pow a (+ t -1)) (* y (exp b))))
184.0ms	z	@	inf	(* (/ (neg z) (- (+ 1 t) z)) a)

analyze20.5s (0.9%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.2%	68.2%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.3%	23%	0.1%	0%	4.6%	0%	6
79.8%	75.6%	19.1%	0.1%	0%	5.1%	0%	7
81.7%	77%	17.2%	0.1%	0%	5.6%	0%	8
84.4%	79.3%	14.7%	0.1%	0%	5.9%	0%	9
86%	80.5%	13.1%	0.1%	0%	6.2%	0%	10
88.5%	82.9%	10.7%	0.1%	0%	6.2%	0%	11
89.6%	83.7%	9.7%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 9.0s

ival-mult: 3.2s (35.5% of total)

ival-add: 1.9s (20.8% of total)

ival-div: 1.5s (16.2% of total)

ival-sub: 1.4s (15.4% of total)

ival-sqrt: 316.0ms (3.5% of total)

ival-log: 246.0ms (2.7% of total)

const: 173.0ms (1.9% of total)

ival-exp: 118.0ms (1.3% of total)

ival-sin: 101.0ms (1.1% of total)

ival-cos: 33.0ms (0.4% of total)

ival-cosh: 32.0ms (0.4% of total)

ival-tan: 30.0ms (0.3% of total)

ival-acos: 22.0ms (0.2% of total)

ival-tanh: 9.0ms (0.1% of total)

ival-sinh: 4.0ms (0% of total)

ival-fabs: 3.0ms (0% of total)

Herbie run

eval7.2min (18.4%)

sample7.2min (18.3%)

localize4.5min (11.4%)

rewrite3.4min (8.7%)

simplify3.3min (8.5%)

soundness3.3min (8.4%)

regimes2.6min (6.6%)

prune2.4min (6.1%)

bsearch1.9min (4.9%)

preprocess1.4min (3.5%)

explain50.6s (2.1%)

series48.8s (2.1%)

analyze20.5s (0.9%)

end2.0ms (0%)

Profiling