Metrics for Herbie run

Date:	Wednesday, November 13th, 2024
Commit:	b0f482cc on pavel-concrete-values
Hostname:	nightly with Racket 8.10
Seed:	2024318
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample2.0min (45%)

Memory

347.8MiB live, 104 982.3MiB allocated

Samples

30.2s	41 351×	2	valid
26.3s	145 649×	0	invalid
19.5s	92 392×	1	valid
10.0s	4 855×	5	exit
9.2s	94 427×	0	valid
1.9s	2 996×	3	valid
644.0ms	4 152×	0	exit
478.0ms	2 265×	1	exit
6.0ms	3×	4	exit
5.0ms	3×	3	exit
5.0ms	6×	2	exit
2.0ms	2×	4	valid

Precisions

Click to see histograms. Total time spent on operations: 1.3min

ival-tan: 13.6s (16.8% of total)

ival-pow: 10.0s (12.3% of total)

ival-mult: 7.4s (9.1% of total)

adjust: 5.3s (6.6% of total)

const: 5.1s (6.4% of total)

ival-sub: 4.4s (5.4% of total)

ival-div: 4.3s (5.4% of total)

ival-cos: 4.3s (5.4% of total)

ival-log: 3.6s (4.5% of total)

ival-sin: 3.6s (4.4% of total)

ival-add: 3.3s (4.1% of total)

ival-exp: 2.9s (3.6% of total)

ival-fabs: 2.5s (3.1% of total)

ival-<=: 2.1s (2.7% of total)

ival-expm1: 2.1s (2.5% of total)

ival-sqrt: 1.1s (1.4% of total)

ival-log1p: 1.1s (1.3% of total)

ival-<: 1.0s (1.2% of total)

ival-and: 612.0ms (0.8% of total)

ival-atan: 586.0ms (0.7% of total)

ival-fmin: 473.0ms (0.6% of total)

exact: 354.0ms (0.4% of total)

ival->: 345.0ms (0.4% of total)

ival-neg: 274.0ms (0.3% of total)

ival-cbrt: 256.0ms (0.3% of total)

ival-assert: 152.0ms (0.2% of total)

ival-true: 69.0ms (0.1% of total)

Bogosity

simplify35.2s (13.2%)

Memory

307.6MiB live, 26 910.0MiB allocated

Algorithm

244×	egg-herbie

Stop Event

321×	iter limit
188×	node limit
59×	saturated

Counts

8 078 → 7 991

soundness28.6s (10.8%)

Memory

151.7MiB live, 14 053.5MiB allocated

Stop Event

193×	iter limit
128×	node limit
22×	fuel
6×	done
2×	saturated

Compiler

Compiled 15 718 to 6 677 computations (57.5% saved)

rewrite23.3s (8.8%)

Memory

-239.0MiB live, 20 598.5MiB allocated

Stop Event

217×	iter limit
107×	node limit
3×	saturated

Counts

1 566 → 60 149

localize20.0s (7.5%)

Memory

-40.1MiB live, 18 837.1MiB allocated

Samples

6.5s	5 314×	2	valid
5.7s	9 807×	1	valid
3.3s	11 457×	0	valid
356.0ms	256×	3	valid
287.0ms	704×	0	invalid
43.0ms	38×	1	invalid
22.0ms	9×	5	exit
15.0ms	52×	0	exit
11.0ms	11×	2	invalid

Compiler

Compiled 21 529 to 3 205 computations (85.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 13.0s

ival-mult: 2.2s (16.6% of total)

ival-div: 1.8s (14% of total)

ival-tan: 1.6s (12% of total)

adjust: 1.5s (11.7% of total)

ival-add: 1.1s (8.5% of total)

ival-pow: 694.0ms (5.3% of total)

ival-sub: 651.0ms (5% of total)

const: 595.0ms (4.6% of total)

ival-log: 559.0ms (4.3% of total)

ival-cos: 462.0ms (3.5% of total)

ival-sin: 458.0ms (3.5% of total)

ival-exp: 371.0ms (2.8% of total)

ival-sqrt: 241.0ms (1.9% of total)

ival-log1p: 208.0ms (1.6% of total)

ival-neg: 157.0ms (1.2% of total)

ival-pow2: 136.0ms (1% of total)

ival-cosh: 97.0ms (0.7% of total)

ival-expm1: 60.0ms (0.5% of total)

ival-cbrt: 55.0ms (0.4% of total)

exact: 46.0ms (0.4% of total)

ival-true: 22.0ms (0.2% of total)

ival-atan2: 22.0ms (0.2% of total)

ival-assert: 12.0ms (0.1% of total)

ival-atan: 9.0ms (0.1% of total)

ival-fabs: 1.0ms (0% of total)

eval12.8s (4.8%)

Memory: 231.4MiB live, 14 107.2MiB allocated
Compiler: Compiled 2 622 530 to 269 943 computations (89.7% saved)

explain6.5s (2.5%)

Memory

-128.4MiB live, 6 114.3MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	4122	30
`log.f64`	`#f`	sensitivity	765	0
`/.f64`	`#f`	u/u	440	0
`sqrt.f64`	`#f`	oflow-rescue	402	0
`+.f64`	`#f`	cancellation	324	0
`/.f64`	`#f`	u/n	117	0
`pow.f64`	`#f`	sensitivity	65	0
`sqrt.f64`	`#f`	uflow-rescue	24	0
`/.f64`	`(/.f64 (.f64 eps (-.f64 (exp.f64 (.f64 (+.f64 a b) eps)) #s(literal 1 binary64))) (.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))))`	n/u	23	0
↳	`(*.f64 b eps)`	underflow	139
↳	`(-.f64 (exp.f64 (*.f64 a eps)) #s(literal 1 binary64))`	underflow	154
↳	`(-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))`	underflow	139
↳	`(.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64)))`	underflow	236
↳	`(*.f64 a eps)`	underflow	154
`-.f64`	`#f`	nan-rescue	9	0
`/.f64`	`(/.f64 (-.f64 #s(literal 1 binary64) (cos.f64 x)) (*.f64 x x))`	n/o	3	0
↳	`(*.f64 x x)`	overflow	69
`exp.f64`	`(exp.f64 (*.f64 #s(literal 2 binary64) x))`	sensitivity	2	0
`cos.f64`	`(cos.f64 (+.f64 x eps))`	sensitivity	1	0
`/.f64`	`(/.f64 (-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64)) (-.f64 (exp.f64 x) #s(literal 1 binary64)))`	o/o	1	0
↳	`(exp.f64 (*.f64 #s(literal 2 binary64) x))`	overflow	1
↳	`(-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64))`	overflow	1
↳	`(exp.f64 x)`	overflow	1
↳	`(-.f64 (exp.f64 x) #s(literal 1 binary64))`	overflow	1
`tan.f64`	`(tan.f64 (+.f64 x eps))`	sensitivity	1	0

Confusion

	Predicted +	Predicted -
+	5157	18
-	160	1833

Precision

0.9699078427684784

Recall

0.9965217391304347

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5157	13	5
-	160	17	1816

Precision?

0.9668973256031419

Recall?

0.9990338164251208

Freqs

test

number	freq
0	1851
1	4539
2	627
3	98
4	53

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	28	0	0
-	0	0	0

Precision?

1.0

Recall?

1.0

Samples

1.9s	2 648×	2	valid
1.4s	5 810×	1	valid
592.0ms	5 708×	0	valid
135.0ms	170×	3	valid

Compiler

Compiled 2 154 to 763 computations (64.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 3.2s

ival-tan: 818.0ms (25.3% of total)

ival-cos: 517.0ms (16% of total)

ival-sin: 259.0ms (8% of total)

adjust: 253.0ms (7.8% of total)

ival-add: 216.0ms (6.7% of total)

ival-log: 196.0ms (6.1% of total)

ival-exp: 185.0ms (5.7% of total)

ival-sub: 173.0ms (5.4% of total)

ival-div: 161.0ms (5% of total)

ival-mult: 93.0ms (2.9% of total)

ival-pow: 82.0ms (2.5% of total)

ival-log1p: 78.0ms (2.4% of total)

ival-sqrt: 62.0ms (1.9% of total)

ival-neg: 37.0ms (1.1% of total)

ival-expm1: 29.0ms (0.9% of total)

ival-atan: 26.0ms (0.8% of total)

ival-cbrt: 16.0ms (0.5% of total)

ival-true: 12.0ms (0.4% of total)

exact: 8.0ms (0.2% of total)

ival-assert: 6.0ms (0.2% of total)

series4.4s (1.7%)

Memory

-46.1MiB live, 4 554.7MiB allocated

Counts

1 566 → 8 078

Calls

498 calls:

Time	Variable		Point	Expression
282.0ms	x	@	0	((- (exp x) 1) (exp x))
115.0ms	n	@	0	((log (/ (+ 1 x) x)) (- (pow (+ x 1) (/ 1 n)) (pow x (/ 1 n))) (/ (log (/ (+ 1 x) x)) n) (/ (+ 1 x) x) (- (pow (+ x 1) (/ 1 n)) (pow x (/ 1 n))) (/ (- (log (+ 1 x)) (log x)) n) (- (log (+ 1 x)) (log x)) (/ 1 x) (- (pow (+ x 1) (/ 1 n)) (pow x (/ 1 n))) (/ (- (log (+ 1 x)) (log x)) n) (- (log (+ 1 x)) (log x)) (neg (log x)) (- (pow (+ x 1) (/ 1 n)) (pow x (/ 1 n))) (/ (pow x (pow n -1)) (* n x)) (pow x (pow n -1)) (pow n -1) (- (pow (+ x 1) (/ 1 n)) (pow x (/ 1 n))) (/ (- (log (+ 1 (* (neg x) x))) (log (* x (- 1 x)))) n) (- (log (+ 1 (* (neg x) x))) (log (* x (- 1 x)))) (log (+ 1 (* (neg x) x))) (log x) (* n x) (* x (- 1 x)))
99.0ms	n	@	inf	((log (/ (+ 1 x) x)) (- (pow (+ x 1) (/ 1 n)) (pow x (/ 1 n))) (/ (log (/ (+ 1 x) x)) n) (/ (+ 1 x) x) (- (pow (+ x 1) (/ 1 n)) (pow x (/ 1 n))) (/ (- (log (+ 1 x)) (log x)) n) (- (log (+ 1 x)) (log x)) (/ 1 x) (- (pow (+ x 1) (/ 1 n)) (pow x (/ 1 n))) (/ (- (log (+ 1 x)) (log x)) n) (- (log (+ 1 x)) (log x)) (neg (log x)) (- (pow (+ x 1) (/ 1 n)) (pow x (/ 1 n))) (/ (pow x (pow n -1)) (* n x)) (pow x (pow n -1)) (pow n -1) (- (pow (+ x 1) (/ 1 n)) (pow x (/ 1 n))) (/ (- (log (+ 1 (* (neg x) x))) (log (* x (- 1 x)))) n) (- (log (+ 1 (* (neg x) x))) (log (* x (- 1 x)))) (log (+ 1 (* (neg x) x))) (log x) (* n x) (* x (- 1 x)))
87.0ms	N	@	inf	((* (+ (* (/ (- 1/2 (/ (- 1/12 (/ 1/24 N)) N)) N) -1) -1) (neg N)) (+ (* (/ (- 1/2 (/ (- 1/12 (/ 1/24 N)) N)) N) -1) -1) (- (log (+ N 1)) (log N)) (/ 1 (/ N (- (/ (- -1/2 (/ (- (/ 1/4 N) 1/3) N)) N) -1))) (- (log (+ N 1)) (log N)) (/ 1 (/ N (- (/ (- -1/2 (/ (- (/ 1/4 N) 1/3) N)) N) -1))) (/ N (- (/ (- -1/2 (/ (- (/ 1/4 N) 1/3) N)) N) -1)) (+ 1/2 N) (/ (/ N (+ N 1)) 1) (neg (log (/ (/ N (+ N 1)) 1))) (log (/ (/ N (+ N 1)) 1)) (/ N (+ N 1)) (/ (- (pow (log (+ 1 N)) 4) (pow (log N) 4)) (* (+ (log N) (log (+ 1 N))) (+ (* (log N) (log N)) (pow (log (+ 1 N)) 2)))) (- (pow (log (+ 1 N)) 4) (pow (log N) 4)) (pow (log (+ 1 N)) 4) (log (+ 1 N)) (- (* (pow (log (+ 1 N)) 2) (+ (log N) (log (+ 1 N)))) (* (+ (log N) (log (+ 1 N))) (pow (log N) 2))) (- (+ (+ (/ 1/3 (pow N 3)) (/ 1 N)) (log N)) (/ 1/2 (* N N))) (/ (- (* (pow (log (+ 1 N)) 2) (+ (log N) (log (+ 1 N)))) (* (+ (log N) (log (+ 1 N))) (pow (log N) 2))) (pow (+ (log N) (log (+ 1 N))) 2)) (* (pow (log (+ 1 N)) 2) (+ (log N) (log (+ 1 N)))) (/ N (- (/ (- -1/2 (/ (- (/ 1/4 N) 1/3) N)) N) -1)) (/ 1/24 N) (/ (- 1/12 (/ 1/24 N)) N) (+ N 1) (pow (log N) 4) (pow (log (+ 1 N)) 2) (log (+ 1 N)) (pow (+ (log N) (log (+ 1 N))) 2) (pow (log N) 2))
75.0ms	a	@	-inf	((- (exp (* (+ a b) eps)) 1) (- (exp (* a eps)) 1) (- (exp (* b eps)) 1) (/ (* eps (- (exp (* (+ a b) eps)) 1)) (* (- (exp (* a eps)) 1) (- (exp (* b eps)) 1))))

regimes4.1s (1.5%)

Memory

-222.8MiB live, 3 953.3MiB allocated

Counts

3 402 → 313

Calls

43 calls:

1.1s	x
399.0ms	eps
226.0ms	(-.f64 (cbrt.f64 (+.f64 x #s(literal 1 binary64))) (cbrt.f64 x))
197.0ms	(+.f64 (-.f64 (/.f64 #s(literal 1 binary64) (+.f64 x #s(literal 1 binary64))) (/.f64 #s(literal 2 binary64) x)) (/.f64 #s(literal 1 binary64) (-.f64 x #s(literal 1 binary64))))
171.0ms	b

Compiler

Compiled 2 028 to 1 905 computations (6.1% saved)

prune4.0s (1.5%)

Memory: -163.6MiB live, 5 575.4MiB allocated
Counts: 69 179 → 1 791
Compiler: Compiled 100 788 to 50 621 computations (49.8% saved)

preprocess3.8s (1.4%)

Memory

629.2MiB live, 3 577.7MiB allocated

Algorithm

28×	egg-herbie

Stop Event

56×	iter limit
50×	saturated
6×	node limit

Compiler

Compiled 20 228 to 5 291 computations (73.8% saved)

analyze1.9s (0.7%)

Memory

-1.7MiB live, 1 911.6MiB allocated

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
7.4%	4.5%	56.6%	38.9%	0%	0%	0%	1
22.3%	13.6%	47.5%	38.9%	0%	0%	0%	2
40.2%	23.5%	34.9%	38.9%	0%	2.7%	0%	3
53.4%	31.1%	27.2%	38.9%	0%	2.8%	0%	4
63%	36.3%	21.3%	38.9%	0%	3.6%	0%	5
65.9%	37.5%	19.4%	38.9%	0%	4.2%	0%	6
70.4%	38.8%	16.3%	38.9%	0%	6%	0%	7
73.6%	40.2%	14.4%	38.9%	0%	6.5%	0%	8
76.3%	40.9%	12.7%	38.9%	0%	7.5%	0%	9
78.4%	41.4%	11.4%	38.9%	0%	8.3%	0%	10
81.1%	42.4%	9.9%	38.9%	0%	8.8%	0%	11
82.3%	42.7%	9.2%	38.9%	0%	9.3%	0%	12

Compiler

Compiled 483 to 337 computations (30.2% saved)

bsearch1.6s (0.6%)

Memory

24.9MiB live, 1 287.6MiB allocated

Algorithm

84×	binary-search
25×	left-value

Stop Event

82×	narrow-enough
2×	predicate-same

Samples

458.0ms	4 007×	0	valid
245.0ms	358×	2	valid
221.0ms	755×	1	valid
86.0ms	193×	0	exit
56.0ms	695×	0	invalid

Compiler

Compiled 31 188 to 23 328 computations (25.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 800.0ms

ival-pow: 252.0ms (31.5% of total)

ival-mult: 136.0ms (17% of total)

ival-div: 127.0ms (15.9% of total)

ival-sub: 103.0ms (12.9% of total)

ival-cbrt: 40.0ms (5% of total)

adjust: 36.0ms (4.5% of total)

ival-sqrt: 25.0ms (3.1% of total)

ival-add: 24.0ms (3% of total)

ival-neg: 20.0ms (2.5% of total)

ival-cos: 17.0ms (2.1% of total)

ival-sin: 5.0ms (0.6% of total)

ival-expm1: 4.0ms (0.5% of total)

ival-true: 4.0ms (0.5% of total)

exact: 4.0ms (0.5% of total)

ival-exp: 2.0ms (0.3% of total)

ival-assert: 2.0ms (0.3% of total)

start13.0ms (0%)

Memory: -37.7MiB live, 1.3MiB allocated

end0.0ms (0%)

Memory: 0.2MiB live, 0.2MiB allocated

sample2.0min (45%)

simplify35.2s (13.2%)

soundness28.6s (10.8%)

rewrite23.3s (8.8%)

localize20.0s (7.5%)

eval12.8s (4.8%)

explain6.5s (2.5%)

series4.4s (1.7%)

regimes4.1s (1.5%)

prune4.0s (1.5%)

preprocess3.8s (1.4%)

analyze1.9s (0.7%)

bsearch1.6s (0.6%)

start13.0ms (0%)

end0.0ms (0%)

Profiling