Metrics for Herbie run

Date:	Tuesday, July 9th, 2024
Commit:	1f32aa37 on Regimes-Speedup-Crit-Sub
Hostname:	nightly with Racket 8.11.1
Seed:	2024191
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample2.1min (39.8%)

Memory

742.2MiB live, 135 358.0MiB allocated

Samples

32.5s	43 478×	2	valid
27.4s	146 962×	0	invalid
21.4s	95 042×	1	valid
10.3s	6 145×	5	exit
8.4s	89 270×	0	valid
3.0s	3 375×	3	valid
317.0ms	4 273×	0	exit
149.0ms	1 057×	1	exit
54.0ms	73×	4	exit
5.0ms	3×	4	valid
5.0ms	1×	3	exit
4.0ms	5×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 1.4min

ival-tan: 16.0s (18.6% of total)

ival-pow: 10.3s (12% of total)

ival-mult: 6.4s (7.4% of total)

const: 5.9s (6.8% of total)

ival-div: 5.3s (6.2% of total)

ival-add: 4.5s (5.2% of total)

ival-sub: 4.5s (5.2% of total)

ival-cos: 4.4s (5.1% of total)

adjust: 3.9s (4.6% of total)

ival-sin: 3.9s (4.5% of total)

ival-log: 3.6s (4.2% of total)

ival-exp: 2.8s (3.2% of total)

ival-<=: 2.7s (3.1% of total)

ival-fabs: 2.6s (3% of total)

ival-expm1: 2.3s (2.7% of total)

ival-log1p: 1.2s (1.4% of total)

ival-<: 1.1s (1.3% of total)

ival-sqrt: 1.1s (1.2% of total)

ival-and: 637.0ms (0.7% of total)

ival-neg: 584.0ms (0.7% of total)

ival-fmin: 499.0ms (0.6% of total)

ival->: 451.0ms (0.5% of total)

ival-atan: 447.0ms (0.5% of total)

exact: 436.0ms (0.5% of total)

ival-cbrt: 428.0ms (0.5% of total)

ival-assert: 175.0ms (0.2% of total)

ival-true: 71.0ms (0.1% of total)

Bogosity

simplify48.8s (15.6%)

Memory

-979.1MiB live, 45 135.2MiB allocated

Algorithm

247×	egg-herbie

Rules

82 573×	`fma-define`
70 797×	`fmm-def`
49 790×	`distribute-lft-in`
47 602×	`times-frac`
44 261×	`distribute-rgt-in`

Stop Event

171×	node limit
75×	saturated
1×	unsound

Counts

58 897 → 60 236

soundness28.7s (9.2%)

Memory

55.6MiB live, 23 781.0MiB allocated

Rules

34 162×	`log1p-expm1-u`
30 161×	`fma-define`
28 273×	`expm1-log1p-u`
26 219×	`fmm-def`
18 278×	`times-frac`

Stop Event

107×	node limit
22×	fuel
9×	saturated
6×	done

Compiler

Compiled 21 352 to 6 240 computations (70.8% saved)

rewrite27.5s (8.8%)

Memory

-760.6MiB live, 22 132.7MiB allocated

Algorithm

109×	batch-egg-rewrite

Rules

66 870×	`log1p-expm1-u`
53 712×	`expm1-log1p-u`
22 498×	`pow1`
22 283×	`add-exp-log`
21 809×	`add-log-exp`

Stop Event

109×	node limit

Counts

1 250 → 40 427

localize20.7s (6.6%)

Memory

551.9MiB live, 22 955.3MiB allocated

Samples

5.3s	7 751×	1	valid
4.4s	4 416×	2	valid
3.2s	13 458×	0	valid
634.0ms	1 681×	0	invalid
624.0ms	349×	3	valid
109.0ms	446×	1	exit
47.0ms	41×	5	exit
5.0ms	6×	3	invalid
4.0ms	7×	2	invalid
2.0ms	5×	1	invalid

Compiler

Compiled 19 081 to 2 716 computations (85.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 11.0s

ival-mult: 1.6s (14.2% of total)

ival-div: 1.6s (14.2% of total)

ival-add: 1.0s (9.1% of total)

ival-pow: 837.0ms (7.6% of total)

ival-log: 810.0ms (7.3% of total)

const: 704.0ms (6.4% of total)

ival-tan: 652.0ms (5.9% of total)

ival-sub: 610.0ms (5.5% of total)

adjust: 603.0ms (5.5% of total)

ival-pow2: 506.0ms (4.6% of total)

ival-log1p: 360.0ms (3.3% of total)

ival-sqrt: 324.0ms (2.9% of total)

ival-exp: 286.0ms (2.6% of total)

ival-sin: 273.0ms (2.5% of total)

ival-cos: 189.0ms (1.7% of total)

ival-cosh: 158.0ms (1.4% of total)

ival-neg: 130.0ms (1.2% of total)

ival-cbrt: 108.0ms (1% of total)

ival-hypot: 102.0ms (0.9% of total)

exact: 61.0ms (0.6% of total)

ival-expm1: 61.0ms (0.6% of total)

ival-atan2: 29.0ms (0.3% of total)

ival-atan: 28.0ms (0.3% of total)

ival-true: 25.0ms (0.2% of total)

ival-assert: 13.0ms (0.1% of total)

ival-e: 10.0ms (0.1% of total)

ival-fabs: 3.0ms (0% of total)

prune19.5s (6.3%)

Memory: -296.2MiB live, 27 275.5MiB allocated
Counts: 85 244 → 2 034
Compiler: Compiled 65 947 to 36 772 computations (44.2% saved)

eval16.3s (5.2%)

Memory: 699.1MiB live, 21 496.4MiB allocated
Compiler: Compiled 2 267 821 to 318 289 computations (86% saved)

explain6.6s (2.1%)

Memory

335.4MiB live, 7 553.9MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	4161	29
`log.f64`	`#f`	sensitivity	759	3
`/.f64`	`#f`	u/u	441	0
`sqrt.f64`	`#f`	oflow-rescue	430	0
`+.f64`	`#f`	cancellation	347	1
`/.f64`	`#f`	u/n	113	0
`pow.f64`	`(pow.f64 (+.f64 x #s(literal 1 binary64)) (/.f64 #s(literal 1 binary64) n))`	sensitivity	73	1
`sqrt.f64`	`#f`	uflow-rescue	40	0
`/.f64`	`(/.f64 (.f64 eps (-.f64 (exp.f64 (.f64 (+.f64 a b) eps)) #s(literal 1 binary64))) (.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))))`	n/u	27	0
↳	`(*.f64 b eps)`	underflow	146
↳	`(-.f64 (exp.f64 (*.f64 a eps)) #s(literal 1 binary64))`	underflow	140
↳	`(-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))`	underflow	146
↳	`(.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64)))`	underflow	239
↳	`(*.f64 a eps)`	underflow	140
`-.f64`	`#f`	nan-rescue	19	0
`/.f64`	`(/.f64 (-.f64 #s(literal 1 binary64) (cos.f64 x)) (*.f64 x x))`	n/o	4	0
↳	`(*.f64 x x)`	overflow	71
`cos.f64`	`(cos.f64 (+.f64 x eps))`	sensitivity	1	0
`exp.f64`	`(exp.f64 (neg.f64 x))`	sensitivity	1	0
`/.f64`	`(/.f64 (-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64)) (-.f64 (exp.f64 x) #s(literal 1 binary64)))`	o/o	1	0
↳	`(exp.f64 (*.f64 #s(literal 2 binary64) x))`	overflow	1
↳	`(-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64))`	overflow	1
↳	`(exp.f64 x)`	overflow	1
↳	`(-.f64 (exp.f64 x) #s(literal 1 binary64))`	overflow	1

Confusion

	Predicted +	Predicted -
+	5221	12
-	156	1779

Precision

0.9709875395201786

Recall

0.9977068603095739

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5221	11	1
-	156	24	1755

Precision?

0.9667405764966741

Recall?

0.9998089050257978

Freqs

test

number	freq
0	1791
1	4554
2	669
3	91
4	63

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	28	0	0
-	0	0	0

Precision?

1.0

Recall?

1.0

Samples

1.6s	5 982×	1	valid
1.5s	2 652×	2	valid
575.0ms	5 488×	0	valid
318.0ms	214×	3	valid

Compiler

Compiled 2 522 to 980 computations (61.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.9s

ival-tan: 729.0ms (25% of total)

ival-div: 330.0ms (11.3% of total)

ival-cos: 316.0ms (10.8% of total)

ival-log: 242.0ms (8.3% of total)

ival-sin: 180.0ms (6.2% of total)

ival-add: 170.0ms (5.8% of total)

adjust: 158.0ms (5.4% of total)

ival-sub: 148.0ms (5.1% of total)

ival-log1p: 132.0ms (4.5% of total)

ival-exp: 124.0ms (4.2% of total)

ival-mult: 100.0ms (3.4% of total)

ival-pow: 87.0ms (3% of total)

ival-sqrt: 84.0ms (2.9% of total)

ival-expm1: 24.0ms (0.8% of total)

ival-cbrt: 23.0ms (0.8% of total)

ival-atan: 21.0ms (0.7% of total)

ival-neg: 19.0ms (0.7% of total)

exact: 13.0ms (0.4% of total)

ival-true: 13.0ms (0.4% of total)

ival-assert: 6.0ms (0.2% of total)

preprocess5.7s (1.8%)

Memory

15.3MiB live, 6 167.0MiB allocated

Algorithm

28×	egg-herbie

Rules

8 308×	`fmm-def`
6 663×	`fma-define`
4 254×	`div-sub`
2 652×	`sub-neg`
2 620×	`times-frac`

Stop Event

23×	saturated
5×	node limit

Compiler

Compiled 10 000 to 3 898 computations (61% saved)

series5.5s (1.8%)

Memory

170.6MiB live, 6 232.9MiB allocated

Counts

1 250 → 18 470

Calls

5055 calls:

Time	Variable		Point	Expression
158.0ms	x	@	inf	(log (tan x))
154.0ms	c	@	-inf	(* a c)
144.0ms	x	@	-inf	(* 2 (log (sqrt (exp (- (exp x) 1)))))
113.0ms	eps	@	-inf	(* (sin (* (+ x (- eps x)) 1/2)) (sin (* (+ eps (+ x x)) 1/2)))
76.0ms	x	@	inf	(pow (+ x 1) (/ 1 n))

regimes4.5s (1.4%)

Memory

-48.2MiB live, 5 859.2MiB allocated

Counts

3 825 → 310

Calls

43 calls:

971.0ms	x
385.0ms	a
252.0ms	(/.f64 #s(literal 1 binary64) n)
247.0ms	(-.f64 (cbrt.f64 (+.f64 x #s(literal 1 binary64))) (cbrt.f64 x))
239.0ms	b_2

Compiler

Compiled 2 780 to 1 852 computations (33.4% saved)

bsearch2.2s (0.7%)

Memory

32.6MiB live, 2 918.8MiB allocated

Algorithm

68×	binary-search
48×	left-value

Stop Event

65×	narrow-enough
3×	predicate-same

Samples

739.0ms	5 453×	0	valid
376.0ms	3 073×	1	valid
322.0ms	1 857×	0	invalid
138.0ms	482×	2	valid
3.0ms	30×	0	exit
0.0ms	1×	1	exit

Compiler

Compiled 14 179 to 10 519 computations (25.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.0s

ival-mult: 271.0ms (25.8% of total)

ival-sqrt: 259.0ms (24.7% of total)

ival-div: 132.0ms (12.6% of total)

ival-sub: 92.0ms (8.8% of total)

ival-add: 55.0ms (5.2% of total)

ival-neg: 54.0ms (5.1% of total)

ival-cbrt: 51.0ms (4.9% of total)

adjust: 50.0ms (4.8% of total)

ival-pow: 45.0ms (4.3% of total)

ival-cos: 14.0ms (1.3% of total)

exact: 8.0ms (0.8% of total)

ival-true: 8.0ms (0.8% of total)

ival-assert: 4.0ms (0.4% of total)

ival-sin: 4.0ms (0.4% of total)

ival-expm1: 2.0ms (0.2% of total)

ival-log1p: 0.0ms (0% of total)

ival-log: 0.0ms (0% of total)

analyze1.8s (0.6%)

Memory

98.2MiB live, 2 124.1MiB allocated

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
7.4%	4.5%	56.6%	38.9%	0%	0%	0%	1
22.3%	13.6%	47.5%	38.9%	0%	0%	0%	2
40.2%	23.5%	34.9%	38.9%	0%	2.7%	0%	3
53.4%	31.1%	27.2%	38.9%	0%	2.8%	0%	4
63%	36.3%	21.3%	38.9%	0%	3.6%	0%	5
65.9%	37.5%	19.4%	38.9%	0%	4.2%	0%	6
70.4%	38.8%	16.3%	38.9%	0%	6%	0%	7
73.6%	40.2%	14.4%	38.9%	0%	6.5%	0%	8
76.3%	40.9%	12.7%	38.9%	0%	7.5%	0%	9
78.4%	41.4%	11.4%	38.9%	0%	8.3%	0%	10
81.1%	42.4%	9.9%	38.9%	0%	8.8%	0%	11
82.3%	42.7%	9.2%	38.9%	0%	9.3%	0%	12

Compiler

Compiled 483 to 337 computations (30.2% saved)

end0.0ms (0%)

Memory: 0.3MiB live, 0.2MiB allocated

sample2.1min (39.8%)

simplify48.8s (15.6%)

soundness28.7s (9.2%)

rewrite27.5s (8.8%)

localize20.7s (6.6%)

prune19.5s (6.3%)

eval16.3s (5.2%)

explain6.6s (2.1%)

preprocess5.7s (1.8%)

series5.5s (1.8%)

regimes4.5s (1.4%)

bsearch2.2s (0.7%)

analyze1.8s (0.6%)

end0.0ms (0%)

Profiling