Metrics for Herbie run

Date:	Wednesday, April 17th, 2024
Commit:	6204de5a on fpcore-fixes
Hostname:	nightly with Racket 8.11.1
Seed:	2024108
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample21.8min (22.9%)

Results

8.0min	3881231×	0	valid
3.0min	462549×	1	valid
30.5s	180163×	0	invalid
24.5s	143489×	0	precondition
1.5min	111844×	2	valid
2.0min	63381×	5	exit
15.9s	61989×	0	unsamplable
58.5s	17268×	3	valid
7.4s	15044×	1	invalid
16.9s	1876×	4	valid
862.0ms	1337×	2	invalid
44.0ms	52×	1	unsamplable
16.0ms	10×	5	valid
2.0ms	1×	3	unsamplable

Precisions

Click to see histograms. Total time spent on operations: 13.3min

ival-mult: 2.7min (20.1% of total)

ival-sin: 1.5min (11.1% of total)

ival-div: 1.4min (10.4% of total)

ival-pow: 1.3min (10% of total)

ival-add: 59.6s (7.5% of total)

ival-sub: 54.0s (6.8% of total)

ival-cos: 49.9s (6.2% of total)

backward-pass: 49.9s (6.2% of total)

ival-exp: 29.9s (3.7% of total)

ival-log: 26.6s (3.3% of total)

ival-sqrt: 21.6s (2.7% of total)

ival-<=: 20.5s (2.6% of total)

ival-tan: 18.6s (2.3% of total)

const: 12.8s (1.6% of total)

ival-neg: 7.5s (0.9% of total)

ival-fabs: 6.7s (0.8% of total)

ival-<: 5.2s (0.7% of total)

ival-pi: 3.8s (0.5% of total)

ival-and: 3.3s (0.4% of total)

ival-asin: 1.9s (0.2% of total)

ival-atan: 1.9s (0.2% of total)

ival-atan2: 1.7s (0.2% of total)

ival-acos: 1.6s (0.2% of total)

ival->: 1.6s (0.2% of total)

ival-fmod: 1.1s (0.1% of total)

ival-sinh: 885.0ms (0.1% of total)

ival-floor: 875.0ms (0.1% of total)

ival-fmax: 740.0ms (0.1% of total)

ival-fmin: 700.0ms (0.1% of total)

ival-==: 674.0ms (0.1% of total)

ival-cbrt: 657.0ms (0.1% of total)

ival->=: 473.0ms (0.1% of total)

ival-fma: 412.0ms (0.1% of total)

ival-if: 402.0ms (0.1% of total)

ival-hypot: 373.0ms (0% of total)

ival-cosh: 302.0ms (0% of total)

ival-log2: 302.0ms (0% of total)

ival-acosh: 301.0ms (0% of total)

ival-asinh: 231.0ms (0% of total)

ival-atanh: 149.0ms (0% of total)

ival-tanh: 90.0ms (0% of total)

ival-or: 52.0ms (0% of total)

Bogosity

localize18.1min (19%)

Results

4.6min	371143×	0	valid
3.3min	40963×	1	valid
43.4s	26056×	0	invalid
1.6min	14136×	2	valid
3.4min	11690×	5	exit
55.9s	1937×	3	valid
1.1s	1421×	0	unsamplable
10.4s	146×	4	valid
2.2s	105×	1	invalid
62.0ms	41×	1	unsamplable
16.0ms	1×	5	valid

Compiler

Compiled 464870 to 210027 computations (54.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 12.4min

ival-mult: 2.5min (20.5% of total)

ival-pow: 2.0min (16.1% of total)

ival-div: 1.2min (9.9% of total)

ival-sin: 1.2min (9.4% of total)

backward-pass: 1.1min (9% of total)

ival-cos: 48.9s (6.6% of total)

ival-add: 44.5s (6% of total)

ival-sub: 32.1s (4.3% of total)

ival-fma: 24.6s (3.3% of total)

ival-sqrt: 17.2s (2.3% of total)

ival-log: 15.3s (2.1% of total)

const: 12.8s (1.7% of total)

ival-tan: 10.3s (1.4% of total)

ival-exp: 10.3s (1.4% of total)

ival-log1p: 9.1s (1.2% of total)

ival-asin: 6.7s (0.9% of total)

ival-hypot: 6.2s (0.8% of total)

ival-expm1: 5.6s (0.7% of total)

ival-cbrt: 5.0s (0.7% of total)

ival-atan: 2.5s (0.3% of total)

ival-neg: 2.2s (0.3% of total)

ival-acos: 2.2s (0.3% of total)

ival-fmax: 1.1s (0.1% of total)

ival-atan2: 957.0ms (0.1% of total)

ival-fabs: 491.0ms (0.1% of total)

ival-sinh: 388.0ms (0.1% of total)

ival-if: 357.0ms (0% of total)

ival-pi: 342.0ms (0% of total)

ival->=: 209.0ms (0% of total)

ival->: 133.0ms (0% of total)

ival-log2: 132.0ms (0% of total)

ival-floor: 106.0ms (0% of total)

ival-fmod: 100.0ms (0% of total)

ival-copysign: 98.0ms (0% of total)

ival-tanh: 70.0ms (0% of total)

ival-cosh: 52.0ms (0% of total)

ival-<: 35.0ms (0% of total)

ival-e: 34.0ms (0% of total)

simplify10.2min (10.7%)

Algorithm

2246×

egg-herbie

Rules

687502×	`fma-define`
504315×	`*-commutative`
487361×	`associate-r`
485943×	`fma-neg`
484663×	`distribute-lft-in`

Stop Event

541×	saturated
1681×	node limit
24×	unsound

Counts

804183 → 710514

eval8.4min (8.8%)

Compiler: Compiled 39595713 to 19633098 computations (50.4% saved)

soundness8.2min (8.6%)

Rules

616324×	`fma-define`
456755×	`fma-neg`
436258×	`log1p-expm1-u`
395108×	`associate-r`
353955×	`times-frac`

Stop Event

158×	saturated
328×	fuel
1759×	node limit
20×	unsound
212×	done

Compiler

Compiled 421335 to 235131 computations (44.2% saved)

rewrite6.2min (6.5%)

Algorithm

1706×

batch-egg-rewrite

Rules

1116296×	`log1p-expm1-u`
822783×	`expm1-log1p-u`
367039×	`pow1`
352252×	`add-exp-log`
339989×	`add-log-exp`

Stop Event

1693×	node limit
13×	unsound

Counts

13923 → 453356

prune5.0min (5.3%)

Counts: 1070797 → 35962
Compiler: Compiled 1657914 to 1110112 computations (33% saved)

regimes4.9min (5.1%)

Counts

90604 → 9267

Calls

1196 calls:

27.5s	x
24.3s	y
22.3s	z
18.4s	t
17.6s	a

Compiler

Compiled 89648 to 67714 computations (24.5% saved)

explain3.6min (3.7%)

Results

59.1s	232378×	0	valid
47.1s	33964×	1	valid
23.1s	9500×	2	valid
27.1s	1306×	3	valid
728.0ms	198×	5	exit
7.7s	158×	4	valid

Compiler

Compiled 97157 to 47036 computations (51.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.3min

ival-mult: 29.1s (21.4% of total)

ival-sin: 19.4s (14.3% of total)

ival-div: 16.5s (12.1% of total)

ival-cos: 14.5s (10.7% of total)

ival-pow: 12.8s (9.4% of total)

backward-pass: 9.9s (7.3% of total)

ival-add: 9.7s (7.1% of total)

ival-sub: 8.0s (5.9% of total)

ival-log: 3.9s (2.9% of total)

ival-sqrt: 3.2s (2.3% of total)

const: 2.2s (1.6% of total)

ival-tan: 2.2s (1.6% of total)

ival-exp: 1.7s (1.2% of total)

ival-neg: 918.0ms (0.7% of total)

ival-atan: 722.0ms (0.5% of total)

ival-asin: 142.0ms (0.1% of total)

ival-atan2: 123.0ms (0.1% of total)

ival-pi: 117.0ms (0.1% of total)

ival-acos: 94.0ms (0.1% of total)

ival-fabs: 87.0ms (0.1% of total)

ival-hypot: 81.0ms (0.1% of total)

ival-cbrt: 59.0ms (0% of total)

ival-sinh: 51.0ms (0% of total)

ival-floor: 49.0ms (0% of total)

ival-fmod: 38.0ms (0% of total)

ival-if: 31.0ms (0% of total)

ival-fmax: 23.0ms (0% of total)

ival-fma: 22.0ms (0% of total)

ival-log2: 22.0ms (0% of total)

ival-log1p: 19.0ms (0% of total)

ival->=: 19.0ms (0% of total)

ival-cosh: 13.0ms (0% of total)

ival-copysign: 13.0ms (0% of total)

ival-tanh: 7.0ms (0% of total)

ival->: 5.0ms (0% of total)

ival-<: 4.0ms (0% of total)

bsearch2.5min (2.7%)

Algorithm

4640×	binary-search
590×	left-value

Stop Event

118×	predicate-same
4522×	narrow-enough

Results

1.5min	529002×	0	valid
17.2s	32039×	1	valid
2.6s	16558×	0	invalid
2.2s	3836×	2	valid
384.0ms	545×	3	valid
18.0ms	137×	0	unsamplable
29.0ms	109×	1	invalid
25.0ms	61×	2	invalid
27.0ms	34×	4	valid

Compiler

Compiled 1091369 to 811131 computations (25.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.3min

ival-mult: 26.1s (34.4% of total)

ival-sub: 10.0s (13.1% of total)

ival-add: 9.2s (12.1% of total)

ival-div: 8.9s (11.7% of total)

ival-pow: 5.0s (6.6% of total)

ival-sin: 4.0s (5.3% of total)

ival-cos: 3.1s (4% of total)

backward-pass: 2.0s (2.6% of total)

ival-log: 1.8s (2.4% of total)

ival-sqrt: 1.6s (2.1% of total)

ival-exp: 1.3s (1.8% of total)

const: 1.1s (1.5% of total)

ival-tan: 485.0ms (0.6% of total)

ival-neg: 466.0ms (0.6% of total)

ival-atan2: 289.0ms (0.4% of total)

ival-atan: 121.0ms (0.2% of total)

ival-pi: 116.0ms (0.2% of total)

ival-acos: 108.0ms (0.1% of total)

ival-fabs: 47.0ms (0.1% of total)

ival-asin: 39.0ms (0.1% of total)

ival-cbrt: 33.0ms (0% of total)

ival-copysign: 19.0ms (0% of total)

ival-hypot: 12.0ms (0% of total)

ival-sinh: 11.0ms (0% of total)

ival-tanh: 10.0ms (0% of total)

ival-if: 7.0ms (0% of total)

ival-cosh: 6.0ms (0% of total)

ival->=: 5.0ms (0% of total)

preprocess2.3min (2.4%)

Algorithm

542×	egg-herbie

Rules

254384×	`fma-define`
252110×	`fma-neg`
118944×	`unsub-neg`
101039×	`sub-neg`
94642×	`distribute-lft-in`

Stop Event

294×	saturated
248×	node limit

Compiler

Compiled 368066 to 202366 computations (45% saved)

series2.2min (2.3%)

Counts

13923 → 350827

Calls

85662 calls:

Time	Variable		Point	Expression
493.0ms	x	@	0	(- (log (neg x)) (log (neg y)))
448.0ms	t	@	inf	(* y (tanh (/ t y)))
437.0ms	c	@	-inf	(exp (* (- (log (* a 4)) (log (/ -1 c))) 1/2))
383.0ms	i	@	-inf	(* (/ i (pow (+ alpha (* 2 i)) 2)) (/ (pow (+ alpha i) 2) (+ (pow (+ alpha (* 2 i)) 2) -1)))
274.0ms	t	@	inf	(- (/ (* x y) z) t)

analyze1.9min (2%)

Algorithm

545×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	84.4%	15.6%	0%	0%	0%	0
39.4%	33.3%	51.2%	15.6%	0%	0%	0%	1
45.1%	37.7%	46%	15.6%	0%	0.7%	0%	2
54.3%	44.3%	37.3%	15.7%	0%	2.7%	0%	3
61%	49.2%	31.4%	15.8%	0%	3.6%	0%	4
67.2%	53.9%	26.3%	15.8%	0%	4%	0%	5
71.1%	56.7%	23%	15.8%	0%	4.3%	0%	6
75.1%	59.5%	19.7%	15.9%	0%	4.8%	0.1%	7
77.1%	60.8%	18.1%	15.9%	0%	5.2%	0.1%	8
79.7%	62.6%	15.9%	15.9%	0%	5.5%	0.1%	9
81.2%	63.5%	14.7%	16%	0%	5.7%	0.1%	10
83.5%	65.2%	12.9%	16%	0%	5.8%	0.1%	11
84.6%	65.8%	12%	16%	0%	6.1%	0.1%	12

Compiler

Compiled 13446 to 8689 computations (35.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.1min

ival-mult: 19.1s (28.8% of total)

ival-div: 8.4s (12.7% of total)

ival-pow: 6.1s (9.2% of total)

ival-add: 5.8s (8.8% of total)

ival-sub: 5.2s (7.7% of total)

ival-<=: 3.7s (5.6% of total)

ival-sin: 2.8s (4.2% of total)

ival-sqrt: 2.6s (3.9% of total)

ival-cos: 2.2s (3.2% of total)

ival-fabs: 2.1s (3.1% of total)

const: 1.2s (1.7% of total)

ival-exp: 907.0ms (1.4% of total)

ival-floor: 844.0ms (1.3% of total)

ival-tan: 729.0ms (1.1% of total)

ival-log: 690.0ms (1% of total)

ival-and: 662.0ms (1% of total)

ival-neg: 490.0ms (0.7% of total)

ival-if: 488.0ms (0.7% of total)

ival-fmax: 401.0ms (0.6% of total)

ival-<: 365.0ms (0.5% of total)

ival-==: 301.0ms (0.5% of total)

ival-atan2: 214.0ms (0.3% of total)

ival-log2: 187.0ms (0.3% of total)

ival-atan: 180.0ms (0.3% of total)

backward-pass: 167.0ms (0.3% of total)

ival-pi: 150.0ms (0.2% of total)

ival->: 130.0ms (0.2% of total)

ival->=: 120.0ms (0.2% of total)

ival-acos: 112.0ms (0.2% of total)

ival-asin: 94.0ms (0.1% of total)

ival-fmod: 50.0ms (0.1% of total)

ival-sinh: 39.0ms (0.1% of total)

ival-or: 22.0ms (0% of total)

ival-cbrt: 19.0ms (0% of total)

ival-cosh: 16.0ms (0% of total)

ival-tanh: 8.0ms (0% of total)

ival-fmin: 6.0ms (0% of total)

ival-atanh: 1.0ms (0% of total)

ival-asinh: 0.0ms (0% of total)

ival-hypot: 0.0ms (0% of total)

ival-fma: 0.0ms (0% of total)

ival-acosh: 0.0ms (0% of total)

end3.0ms (0%)

Precisions: Click to see histograms. Total time spent on operations: 1.3s
ival-sin: 1.3s (100% of total)

sample21.8min (22.9%)

localize18.1min (19%)

simplify10.2min (10.7%)

eval8.4min (8.8%)

soundness8.2min (8.6%)

rewrite6.2min (6.5%)

prune5.0min (5.3%)

regimes4.9min (5.1%)

explain3.6min (3.7%)

bsearch2.5min (2.7%)

preprocess2.3min (2.4%)

series2.2min (2.3%)

analyze1.9min (2%)

end3.0ms (0%)

Profiling