Metrics for Herbie run

Date:	Tuesday, April 9th, 2024
Commit:	ec545773 on artem-tuning-cleanup-128start-5ampl
Hostname:	nightly with Racket 8.11.1
Seed:	2024100
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample5.9min (18%)

Results

3.4min	2151132×	0	valid
11.4s	64127×	0	invalid
23.4s	63836×	1	valid
2.3s	5474×	2	valid
1.6s	1664×	5	exit
750.0ms	1606×	1	invalid
123.0ms	421×	3	valid
0.0ms	1×	4	valid

Precisions

Click to see histograms. Total time spent on operations: 2.5min

ival-mult: 49.9s (33.5% of total)

ival-sub: 23.5s (15.8% of total)

ival-add: 23.1s (15.5% of total)

ival-div: 18.2s (12.3% of total)

ival-log: 8.3s (5.6% of total)

ival-sqrt: 5.7s (3.9% of total)

ival-sin: 4.8s (3.2% of total)

backward-pass: 4.7s (3.2% of total)

const: 3.5s (2.3% of total)

ival-cos: 3.2s (2.2% of total)

ival-exp: 1.8s (1.2% of total)

ival-tan: 525.0ms (0.4% of total)

ival-cosh: 474.0ms (0.3% of total)

ival-fabs: 422.0ms (0.3% of total)

ival-acos: 257.0ms (0.2% of total)

ival-tanh: 169.0ms (0.1% of total)

ival-sinh: 153.0ms (0.1% of total)

Bogosity

simplify4.4min (13.5%)

Algorithm

1097×

egg-herbie

Rules

293308×	`fma-define`
251538×	`fma-neg`
212066×	`*-commutative`
210278×	`times-frac`
210206×	`associate-r`

Stop Event

268×	saturated
824×	node limit
5×	unsound

Counts

381373 → 321765

localize3.9min (12%)

Results

1.7min	206889×	0	valid
32.1s	7868×	1	valid
6.2s	7195×	0	invalid
29.7s	2656×	5	exit
7.1s	1559×	2	valid
158.0ms	305×	0	unsamplable
997.0ms	253×	3	valid
469.0ms	88×	1	invalid
7.0ms	3×	4	valid

Compiler

Compiled 116650 to 51461 computations (55.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.2min

ival-mult: 32.3s (24.7% of total)

ival-pow: 19.1s (14.6% of total)

ival-div: 17.8s (13.6% of total)

ival-add: 12.2s (9.3% of total)

backward-pass: 10.7s (8.1% of total)

ival-sub: 10.1s (7.7% of total)

ival-fma: 5.3s (4.1% of total)

ival-log: 5.0s (3.8% of total)

ival-sqrt: 4.6s (3.5% of total)

ival-cos: 3.8s (2.9% of total)

const: 3.0s (2.3% of total)

ival-sin: 1.8s (1.3% of total)

ival-cbrt: 1.3s (1% of total)

ival-exp: 1.1s (0.8% of total)

ival-expm1: 924.0ms (0.7% of total)

ival-neg: 917.0ms (0.7% of total)

ival-log1p: 386.0ms (0.3% of total)

ival-hypot: 284.0ms (0.2% of total)

ival-tan: 163.0ms (0.1% of total)

ival-acos: 93.0ms (0.1% of total)

ival-cosh: 93.0ms (0.1% of total)

ival-sinh: 87.0ms (0.1% of total)

ival-fabs: 32.0ms (0% of total)

ival-tanh: 30.0ms (0% of total)

soundness3.7min (11.5%)

Rules

254239×	`fma-define`
234067×	`fma-neg`
183548×	`log1p-expm1-u`
154688×	`associate-r`
146379×	`times-frac`

Stop Event

84×	saturated
754×	node limit
146×	fuel
3×	unsound
123×	done

Compiler

Compiled 159496 to 83806 computations (47.5% saved)

rewrite3.0min (9.2%)

Algorithm

828×	batch-egg-rewrite

Rules

588192×	`log1p-expm1-u`
431218×	`expm1-log1p-u`
158824×	`pow1`
152003×	`add-exp-log`
146498×	`add-log-exp`

Stop Event

827×	node limit
1×	unsound

Counts

5835 → 212112

eval2.5min (7.5%)

Compiler: Compiled 9244510 to 4911614 computations (46.9% saved)

regimes2.4min (7.5%)

Counts

36088 → 5526

Calls

493 calls:

23.2s	x
22.4s	z
21.9s	y
16.0s	t
10.2s	a

Compiler

Compiled 44943 to 35515 computations (21% saved)

prune2.0min (6.1%)

Counts: 401827 → 13436
Compiler: Compiled 448940 to 305961 computations (31.8% saved)

bsearch1.7min (5.1%)

Algorithm

3170×	binary-search
318×	left-value

Stop Event

58×	predicate-same
3112×	narrow-enough

Results

1.1min	389581×	0	valid
4.7s	8817×	1	valid
265.0ms	3301×	0	invalid
151.0ms	384×	2	valid
9.0ms	18×	3	valid

Compiler

Compiled 738413 to 554898 computations (24.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 44.8s

ival-mult: 20.1s (44.9% of total)

ival-sub: 9.1s (20.3% of total)

ival-add: 6.0s (13.5% of total)

ival-div: 3.9s (8.7% of total)

ival-log: 1.6s (3.6% of total)

ival-sqrt: 856.0ms (1.9% of total)

ival-cos: 768.0ms (1.7% of total)

backward-pass: 766.0ms (1.7% of total)

ival-sin: 764.0ms (1.7% of total)

const: 632.0ms (1.4% of total)

ival-exp: 244.0ms (0.5% of total)

ival-sinh: 25.0ms (0.1% of total)

ival-tanh: 18.0ms (0% of total)

ival-cosh: 3.0ms (0% of total)

ival-fabs: 3.0ms (0% of total)

preprocess1.1min (3.5%)

Algorithm

269×	egg-herbie

Rules

137764×	`fma-neg`
117084×	`fma-define`
57352×	`unsub-neg`
50425×	`sub-neg`
47106×	`distribute-rgt-in`

Stop Event

153×	saturated
116×	node limit

Compiler

Compiled 162932 to 84768 computations (48% saved)

series51.6s (2.6%)

Counts

5835 → 169261

Calls

41838 calls:

Time	Variable		Point	Expression
507.0ms	y	@	inf	(- x (/ (* y (- (exp z) 1)) t))
337.0ms	y	@	-inf	(* (/ (- y z) (+ t (- 1 z))) (+ -1 (/ a x)))
315.0ms	x	@	0	(* x (log y))
301.0ms	y	@	inf	(exp (+ (* (* c (+ a (- 5/6 (/ 2/3 t)))) 2) (log y)))
268.0ms	x	@	0	(* z (- (- (+ 1 (/ x z)) y) (/ (* a (+ t -1)) z)))

explain44.6s (2.3%)

Results

22.6s	130708×	0	valid
4.8s	5842×	1	valid
2.0s	1078×	2	valid
58.0ms	88×	3	valid
21.0ms	12×	5	exit

Compiler

Compiled 26361 to 12514 computations (52.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 18.4s

ival-mult: 6.1s (33% of total)

ival-sub: 2.6s (14.3% of total)

ival-add: 2.5s (13.4% of total)

ival-div: 2.4s (13.1% of total)

ival-log: 1.6s (9% of total)

backward-pass: 978.0ms (5.3% of total)

ival-sqrt: 744.0ms (4% of total)

const: 513.0ms (2.8% of total)

ival-cos: 326.0ms (1.8% of total)

ival-sin: 307.0ms (1.7% of total)

ival-exp: 177.0ms (1% of total)

ival-tan: 76.0ms (0.4% of total)

ival-cosh: 14.0ms (0.1% of total)

ival-fabs: 14.0ms (0.1% of total)

ival-acos: 10.0ms (0.1% of total)

ival-sinh: 9.0ms (0% of total)

ival-tanh: 8.0ms (0% of total)

analyze21.7s (1.1%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.3%	68.3%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.4%	22.9%	0.1%	0%	4.6%	0%	6
80%	75.7%	19%	0.1%	0%	5.1%	0%	7
81.8%	77.1%	17.1%	0.1%	0%	5.6%	0%	8
84.5%	79.4%	14.6%	0.1%	0%	5.9%	0%	9
86.1%	80.6%	13.1%	0.1%	0%	6.2%	0%	10
88.6%	83%	10.6%	0.1%	0%	6.2%	0%	11
89.7%	83.7%	9.6%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 10.2s

ival-mult: 3.8s (37.6% of total)

ival-sub: 2.3s (22.4% of total)

ival-add: 1.6s (16.1% of total)

ival-div: 1.3s (13.2% of total)

ival-log: 298.0ms (2.9% of total)

ival-sqrt: 232.0ms (2.3% of total)

const: 156.0ms (1.5% of total)

ival-sin: 138.0ms (1.4% of total)

ival-exp: 109.0ms (1.1% of total)

backward-pass: 42.0ms (0.4% of total)

ival-cosh: 28.0ms (0.3% of total)

ival-cos: 27.0ms (0.3% of total)

ival-acos: 21.0ms (0.2% of total)

ival-tan: 20.0ms (0.2% of total)

ival-sinh: 9.0ms (0.1% of total)

ival-tanh: 8.0ms (0.1% of total)

ival-fabs: 4.0ms (0% of total)

Herbie run

sample5.9min (18%)

simplify4.4min (13.5%)

localize3.9min (12%)

soundness3.7min (11.5%)

rewrite3.0min (9.2%)

eval2.5min (7.5%)

regimes2.4min (7.5%)

prune2.0min (6.1%)

bsearch1.7min (5.1%)

preprocess1.1min (3.5%)

series51.6s (2.6%)

explain44.6s (2.3%)

analyze21.7s (1.1%)

end1.0ms (0%)

Profiling