Metrics for Herbie run

Date:	Friday, March 29th, 2024
Commit:	a282c103 on cleanup
Hostname:	nightly with Racket 8.11.1
Seed:	2024089
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample6.0min (17.9%)

Results

3.5min	2149586×	0	valid
11.5s	64947×	0	invalid
24.4s	63219×	1	valid
3.2s	7540×	2	valid
1.4s	1701×	5	exit
474.0ms	1641×	1	invalid
185.0ms	517×	3	valid
1.0ms	2×	4	valid

Precisions

Click to see histograms. Total time spent on operations: 2.5min

ival-mult: 48.2s (32.3% of total)

ival-sub: 23.6s (15.8% of total)

ival-add: 22.3s (14.9% of total)

ival-div: 19.1s (12.8% of total)

ival-log: 8.9s (6% of total)

ival-sqrt: 6.3s (4.2% of total)

backward-pass: 5.1s (3.4% of total)

ival-sin: 4.6s (3.1% of total)

const: 3.6s (2.4% of total)

ival-cos: 3.5s (2.4% of total)

ival-exp: 2.4s (1.6% of total)

ival-tan: 454.0ms (0.3% of total)

ival-fabs: 377.0ms (0.3% of total)

ival-cosh: 309.0ms (0.2% of total)

ival-acos: 192.0ms (0.1% of total)

ival-sinh: 189.0ms (0.1% of total)

ival-tanh: 102.0ms (0.1% of total)

Bogosity

simplify4.3min (12.7%)

Algorithm

1088×

egg-herbie

Rules

292093×	`fma-define`
243004×	`fma-neg`
214750×	`associate-r`
205078×	`*-commutative`
203111×	`distribute-lft-in`

Stop Event

268×	saturated
815×	node limit
5×	unsound

Counts

372407 → 317151

localize4.0min (11.8%)

Results

1.7min	203093×	256	valid
7.7s	8733×	256	invalid
25.9s	5039×	1024	valid
7.3s	2655×	512	valid
22.3s	2378×	8192	exit
18.9s	1950×	2048	valid
604.0ms	367×	256	unsamplable
297.0ms	38×	4096	valid
8.0ms	2×	1024	unsamplable
2.0ms	1×	512	unsamplable

Compiler

Compiled 114138 to 50059 computations (56.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.4min

ival-mult: 39.4s (27.3% of total)

ival-div: 18.8s (13% of total)

ival-pow: 16.9s (11.7% of total)

ival-add: 16.4s (11.3% of total)

composed: 12.9s (8.9% of total)

ival-sub: 9.2s (6.4% of total)

ival-log: 7.8s (5.4% of total)

ival-sqrt: 6.2s (4.3% of total)

ival-cos: 4.5s (3.1% of total)

ival-exp: 3.8s (2.6% of total)

ival-sin: 3.3s (2.3% of total)

const: 3.0s (2% of total)

ival-cbrt: 1.1s (0.8% of total)

ival-neg: 691.0ms (0.5% of total)

ival-tan: 409.0ms (0.3% of total)

ival-cosh: 77.0ms (0.1% of total)

ival-sinh: 30.0ms (0% of total)

ival-fabs: 29.0ms (0% of total)

ival-acos: 27.0ms (0% of total)

ival-tanh: 14.0ms (0% of total)

ival-e: 7.0ms (0% of total)

soundness3.5min (10.6%)

Rules

247800×	`fma-define`
219644×	`fma-neg`
187563×	`log1p-expm1-u`
152780×	`associate-r`
139025×	`distribute-lft-in`

Stop Event

82×	saturated
735×	node limit
150×	fuel
4×	unsound
119×	done

Compiler

Compiled 144804 to 76205 computations (47.4% saved)

eval3.5min (10.5%)

Compiler: Compiled 9186383 to 4821156 computations (47.5% saved)

rewrite3.0min (9%)

Algorithm

819×	batch-egg-rewrite

Rules

569580×	`log1p-expm1-u`
419666×	`expm1-log1p-u`
162754×	`pow1`
151314×	`add-exp-log`
145040×	`add-log-exp`

Stop Event

816×	node limit
3×	unsound

Counts

5754 → 205556

regimes2.3min (6.9%)

Counts

33935 → 5507

Calls

491 calls:

22.4s	x
21.6s	y
20.4s	z
14.2s	t
10.9s	a

Compiler

Compiled 45254 to 35774 computations (20.9% saved)

prune2.0min (5.8%)

Counts: 396977 → 13308
Compiler: Compiled 439876 to 297876 computations (32.3% saved)

bsearch1.6min (4.9%)

Algorithm

3192×	binary-search
305×	left-value

Stop Event

45×	predicate-same
3147×	narrow-enough

Results

1.1min	380357×	0	valid
4.0s	9717×	1	valid
642.0ms	6147×	0	invalid
179.0ms	896×	1	invalid
287.0ms	805×	2	valid
7.0ms	17×	3	valid

Compiler

Compiled 716315 to 538697 computations (24.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 41.7s

ival-mult: 18.3s (43.9% of total)

ival-sub: 9.6s (23.1% of total)

ival-add: 5.5s (13.3% of total)

ival-div: 3.0s (7.1% of total)

ival-log: 2.0s (4.9% of total)

backward-pass: 761.0ms (1.8% of total)

ival-sqrt: 725.0ms (1.7% of total)

const: 654.0ms (1.6% of total)

ival-sin: 440.0ms (1.1% of total)

ival-cos: 400.0ms (1% of total)

ival-exp: 200.0ms (0.5% of total)

ival-tanh: 16.0ms (0% of total)

ival-tan: 4.0ms (0% of total)

ival-cosh: 4.0ms (0% of total)

ival-sinh: 2.0ms (0% of total)

ival-fabs: 1.0ms (0% of total)

preprocess1.4min (4%)

Algorithm

269×	egg-herbie

Rules

137764×	`fma-neg`
117084×	`fma-define`
57352×	`unsub-neg`
50425×	`sub-neg`
47106×	`distribute-rgt-in`

Stop Event

153×	saturated
116×	node limit

Compiler

Compiled 156988 to 80698 computations (48.6% saved)

series49.5s (2.5%)

Counts

5754 → 166851

Calls

41028 calls:

Time	Variable		Point	Expression
316.0ms	y	@	inf	(* x (log y))
249.0ms	x	@	-inf	(log (/ y x))
238.0ms	y	@	inf	(* (* y 27) (sqrt x))
231.0ms	y	@	-inf	(log (/ (cbrt x) y))
216.0ms	x	@	0	(log (/ x y))

explain45.7s (2.3%)

Results

22.2s	131692×	256	valid
4.8s	3132×	1024	valid
1.2s	1800×	512	valid
2.0s	1100×	2048	valid
4.0ms	4×	4096	valid

Compiler

Compiled 26361 to 12514 computations (52.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 18.2s

ival-mult: 6.1s (33.7% of total)

ival-sub: 2.8s (15.3% of total)

ival-log: 2.4s (13.2% of total)

ival-div: 2.2s (11.8% of total)

ival-add: 2.1s (11.3% of total)

ival-sqrt: 704.0ms (3.9% of total)

ival-sin: 603.0ms (3.3% of total)

const: 487.0ms (2.7% of total)

ival-cos: 443.0ms (2.4% of total)

ival-tan: 201.0ms (1.1% of total)

ival-exp: 161.0ms (0.9% of total)

ival-acos: 16.0ms (0.1% of total)

ival-fabs: 13.0ms (0.1% of total)

ival-cosh: 12.0ms (0.1% of total)

ival-sinh: 11.0ms (0.1% of total)

ival-tanh: 10.0ms (0.1% of total)

analyze21.8s (1.1%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.2%	68.2%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.3%	23%	0.1%	0%	4.6%	0%	6
79.8%	75.6%	19.1%	0.1%	0%	5.1%	0%	7
81.7%	77%	17.2%	0.1%	0%	5.6%	0%	8
84.4%	79.3%	14.7%	0.1%	0%	5.9%	0%	9
86%	80.5%	13.1%	0.1%	0%	6.2%	0%	10
88.5%	82.9%	10.7%	0.1%	0%	6.2%	0%	11
89.6%	83.7%	9.7%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 9.5s

ival-mult: 3.2s (34% of total)

ival-div: 1.9s (19.8% of total)

ival-add: 1.8s (19% of total)

ival-sub: 1.6s (16.4% of total)

ival-sqrt: 264.0ms (2.8% of total)

ival-log: 225.0ms (2.4% of total)

const: 183.0ms (1.9% of total)

ival-exp: 110.0ms (1.2% of total)

ival-cos: 93.0ms (1% of total)

ival-sin: 91.0ms (1% of total)

ival-tan: 22.0ms (0.2% of total)

ival-acos: 21.0ms (0.2% of total)

ival-cosh: 16.0ms (0.2% of total)

ival-tanh: 8.0ms (0.1% of total)

ival-sinh: 4.0ms (0% of total)

ival-fabs: 3.0ms (0% of total)

Herbie run

sample6.0min (17.9%)

simplify4.3min (12.7%)

localize4.0min (11.8%)

soundness3.5min (10.6%)

eval3.5min (10.5%)

rewrite3.0min (9%)

regimes2.3min (6.9%)

prune2.0min (5.8%)

bsearch1.6min (4.9%)

preprocess1.4min (4%)

series49.5s (2.5%)

explain45.7s (2.3%)

analyze21.8s (1.1%)

end1.0ms (0%)

Profiling