Metrics for Herbie run

Date:	Wednesday, March 27th, 2024
Commit:	79027280 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024087
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample7.3min (20.4%)

Results

3.9min	1807372×	0	valid
49.8s	342006×	0	infinite
11.1s	64594×	0	invalid
25.6s	60662×	1	valid
3.6s	7536×	2	valid
1.4s	2616×	1	infinite
2.1s	1700×	5	exit
461.0ms	1621×	1	invalid
159.0ms	504×	3	valid
47.0ms	167×	2	infinite
1.0ms	1×	4	valid

Precisions

Click to see histograms. Total time spent on operations: 2.5min

ival-mult: 52.9s (34.6% of total)

ival-sub: 22.1s (14.4% of total)

ival-add: 21.9s (14.3% of total)

ival-div: 19.0s (12.4% of total)

ival-log: 9.0s (5.9% of total)

ival-sqrt: 6.7s (4.4% of total)

backward-pass: 5.9s (3.9% of total)

ival-sin: 5.1s (3.4% of total)

const: 3.8s (2.5% of total)

ival-cos: 3.2s (2.1% of total)

ival-exp: 1.6s (1.1% of total)

ival-cosh: 546.0ms (0.4% of total)

ival-tan: 386.0ms (0.3% of total)

ival-acos: 248.0ms (0.2% of total)

ival-fabs: 219.0ms (0.1% of total)

ival-sinh: 173.0ms (0.1% of total)

ival-tanh: 106.0ms (0.1% of total)

Bogosity

localize4.5min (12.7%)

Results

1.5min	171492×	256	valid
14.4s	30626×	256	infinite
6.4s	7821×	256	invalid
21.6s	4654×	1024	valid
43.6s	3462×	8192	exit
6.7s	2474×	512	valid
16.8s	1988×	2048	valid
674.0ms	313×	1024	infinite
225.0ms	311×	256	unsamplable
149.0ms	107×	512	infinite
687.0ms	105×	4096	valid
218.0ms	58×	2048	infinite
109.0ms	23×	1024	unsamplable
91.0ms	20×	1024	invalid
88.0ms	11×	2048	invalid
31.0ms	11×	512	invalid
18.0ms	11×	512	unsamplable
3.0ms	1×	4096	infinite

Compiler

Compiled 113619 to 48994 computations (56.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.6min

ival-mult: 39.0s (24.6% of total)

ival-pow: 23.5s (14.9% of total)

ival-div: 18.5s (11.7% of total)

ival-add: 18.1s (11.5% of total)

composed: 13.7s (8.6% of total)

ival-cos: 9.9s (6.3% of total)

ival-log: 9.0s (5.7% of total)

ival-sub: 7.8s (4.9% of total)

ival-sqrt: 6.2s (3.9% of total)

ival-sin: 3.5s (2.2% of total)

const: 3.1s (2% of total)

ival-exp: 2.9s (1.8% of total)

ival-cbrt: 1.7s (1.1% of total)

ival-neg: 626.0ms (0.4% of total)

ival-tan: 261.0ms (0.2% of total)

ival-acos: 200.0ms (0.1% of total)

ival-fabs: 95.0ms (0.1% of total)

ival-sinh: 50.0ms (0% of total)

ival-cosh: 35.0ms (0% of total)

ival-tanh: 12.0ms (0% of total)

ival-e: 3.0ms (0% of total)

simplify4.3min (12%)

Algorithm

1087×

egg-herbie

Rules

288504×	`fma-define`
256291×	`fma-neg`
209318×	`*-commutative`
207412×	`associate-r`
200646×	`distribute-lft-in`

Stop Event

269×	saturated
812×	node limit
6×	unsound

Counts

380155 → 319121

soundness3.6min (10.2%)

Rules

252749×	`fma-define`
235422×	`fma-neg`
182393×	`log1p-expm1-u`
150587×	`associate-r`
140024×	`times-frac`

Stop Event

82×	saturated
755×	node limit
144×	fuel
3×	unsound
125×	done

Compiler

Compiled 157045 to 81186 computations (48.3% saved)

eval3.4min (9.4%)

Compiler: Compiled 8992467 to 4703203 computations (47.7% saved)

rewrite3.0min (8.3%)

Algorithm

818×	batch-egg-rewrite

Rules

573692×	`log1p-expm1-u`
422681×	`expm1-log1p-u`
158255×	`pow1`
151863×	`add-exp-log`
146259×	`add-log-exp`

Stop Event

816×	node limit
2×	unsound

Counts

5718 → 209600

regimes2.5min (6.9%)

Counts

35997 → 5492

Calls

490 calls:

22.4s	z
21.9s	y
21.0s	x
15.3s	t
10.7s	a

Compiler

Compiled 44621 to 35368 computations (20.7% saved)

prune2.0min (5.5%)

Counts: 391715 → 13110
Compiler: Compiled 445894 to 300985 computations (32.5% saved)

bsearch1.8min (5.1%)

Algorithm

3183×	binary-search
314×	left-value

Stop Event

56×	predicate-same
3127×	narrow-enough

Results

49.9s	305495×	0	valid
26.4s	81520×	0	infinite
3.8s	8141×	1	valid
336.0ms	3590×	0	invalid
606.0ms	889×	2	valid
124.0ms	211×	1	infinite
10.0ms	24×	3	valid
2.0ms	8×	2	infinite

Compiler

Compiled 755486 to 562722 computations (25.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 43.4s

ival-mult: 19.1s (44% of total)

ival-sub: 9.4s (21.6% of total)

ival-add: 6.8s (15.7% of total)

ival-div: 3.9s (8.9% of total)

ival-log: 1.1s (2.6% of total)

backward-pass: 790.0ms (1.8% of total)

ival-sqrt: 738.0ms (1.7% of total)

const: 656.0ms (1.5% of total)

ival-sin: 464.0ms (1.1% of total)

ival-cos: 326.0ms (0.8% of total)

ival-exp: 147.0ms (0.3% of total)

ival-tanh: 20.0ms (0% of total)

ival-cosh: 2.0ms (0% of total)

ival-fabs: 1.0ms (0% of total)

ival-sinh: 1.0ms (0% of total)

preprocess1.3min (3.6%)

Algorithm

269×	egg-herbie

Rules

137764×	`fma-neg`
117084×	`fma-define`
57352×	`unsub-neg`
50425×	`sub-neg`
47106×	`distribute-rgt-in`

Stop Event

153×	saturated
116×	node limit

Compiler

Compiled 165352 to 82080 computations (50.4% saved)

series53.5s (2.5%)

Counts

5718 → 170555

Calls

41664 calls:

Time	Variable		Point	Expression
372.0ms	x	@	0	(* x (- (log (/ x (sqrt y))) (log (sqrt y))))
339.0ms	y	@	inf	(* x (log y))
321.0ms	x	@	0	(* x (* (log (cbrt (/ x y))) 3))
298.0ms	y	@	0	(log (pow (exp (acos (/ (* (sqrt t) x) (* (* z 18) y)))) 1/6))
291.0ms	y	@	0	(* (cbrt (* y x)) (cbrt (sqrt (* y x))))

explain51.1s (2.4%)

Results

21.7s	110090×	256	valid
4.8s	21722×	256	infinite
4.1s	2726×	1024	valid
1.2s	1618×	512	valid
2.0s	1118×	2048	valid
276.0ms	254×	1024	infinite
93.0ms	136×	512	infinite
50.0ms	58×	2048	infinite
3.0ms	4×	8192	exit
5.0ms	2×	4096	valid

Compiler

Compiled 26361 to 12514 computations (52.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 18.5s

ival-mult: 5.7s (30.7% of total)

ival-log: 3.0s (16% of total)

ival-add: 2.9s (15.4% of total)

ival-sub: 2.8s (15.2% of total)

ival-div: 2.0s (10.5% of total)

ival-sqrt: 740.0ms (4% of total)

const: 523.0ms (2.8% of total)

ival-cos: 392.0ms (2.1% of total)

ival-sin: 331.0ms (1.8% of total)

ival-exp: 166.0ms (0.9% of total)

ival-tan: 46.0ms (0.2% of total)

ival-cosh: 17.0ms (0.1% of total)

ival-tanh: 13.0ms (0.1% of total)

ival-fabs: 13.0ms (0.1% of total)

ival-acos: 12.0ms (0.1% of total)

ival-sinh: 11.0ms (0.1% of total)

analyze20.5s (1%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.2%	68.2%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.3%	23%	0.1%	0%	4.6%	0%	6
79.8%	75.6%	19.1%	0.1%	0%	5.1%	0%	7
81.7%	77%	17.2%	0.1%	0%	5.6%	0%	8
84.4%	79.3%	14.7%	0.1%	0%	5.9%	0%	9
86%	80.5%	13.1%	0.1%	0%	6.2%	0%	10
88.5%	82.9%	10.7%	0.1%	0%	6.2%	0%	11
89.6%	83.7%	9.7%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 9.5s

ival-mult: 4.0s (41.6% of total)

ival-sub: 1.7s (17.4% of total)

ival-add: 1.5s (15.8% of total)

ival-div: 1.2s (12.8% of total)

ival-sqrt: 337.0ms (3.5% of total)

ival-log: 219.0ms (2.3% of total)

const: 182.0ms (1.9% of total)

ival-sin: 164.0ms (1.7% of total)

ival-exp: 156.0ms (1.6% of total)

ival-cosh: 38.0ms (0.4% of total)

ival-cos: 31.0ms (0.3% of total)

ival-acos: 22.0ms (0.2% of total)

ival-tan: 21.0ms (0.2% of total)

ival-tanh: 13.0ms (0.1% of total)

ival-sinh: 4.0ms (0% of total)

ival-fabs: 3.0ms (0% of total)

Herbie run

sample7.3min (20.4%)

localize4.5min (12.7%)

simplify4.3min (12%)

soundness3.6min (10.2%)

eval3.4min (9.4%)

rewrite3.0min (8.3%)

regimes2.5min (6.9%)

prune2.0min (5.5%)

bsearch1.8min (5.1%)

preprocess1.3min (3.6%)

series53.5s (2.5%)

explain51.1s (2.4%)

analyze20.5s (1%)

end1.0ms (0%)

Profiling