Metrics for Herbie run

Date:	Wednesday, November 27th, 2024
Commit:	38b68022 on bhargav-nobigfloat
Hostname:	nightly with Racket 8.10
Seed:	2024332
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample2.0min (43.5%)

Memory

483.3MiB live, 105 240.5MiB allocated

Samples

29.0s	41 621×	2	valid
26.8s	144 915×	0	invalid
19.8s	91 855×	1	valid
9.8s	4 764×	5	exit
9.1s	94 770×	0	valid
2.0s	2 919×	3	valid
597.0ms	2 274×	1	exit
460.0ms	4 171×	0	exit
30.0ms	2×	2	exit
26.0ms	9×	4	exit
3.0ms	3×	4	valid
2.0ms	3×	3	exit

Precisions

Click to see histograms. Total time spent on operations: 1.3min

ival-tan: 13.4s (16.7% of total)

ival-pow: 9.7s (12.1% of total)

ival-mult: 6.7s (8.4% of total)

const: 5.5s (6.9% of total)

adjust: 5.4s (6.8% of total)

ival-div: 4.4s (5.5% of total)

ival-cos: 4.4s (5.5% of total)

ival-sub: 3.9s (4.9% of total)

ival-add: 3.8s (4.7% of total)

ival-sin: 3.5s (4.4% of total)

ival-log: 3.2s (3.9% of total)

ival-expm1: 2.6s (3.2% of total)

ival-<=: 2.5s (3.1% of total)

ival-fabs: 2.4s (3% of total)

ival-exp: 2.2s (2.7% of total)

ival-sqrt: 1.4s (1.7% of total)

ival-log1p: 1.1s (1.3% of total)

ival-<: 768.0ms (1% of total)

ival-and: 671.0ms (0.8% of total)

ival-fmin: 570.0ms (0.7% of total)

ival-atan: 427.0ms (0.5% of total)

exact: 378.0ms (0.5% of total)

ival-cbrt: 369.0ms (0.5% of total)

ival-neg: 348.0ms (0.4% of total)

ival->: 291.0ms (0.4% of total)

ival-assert: 164.0ms (0.2% of total)

ival-true: 72.0ms (0.1% of total)

Bogosity

simplify36.5s (13.3%)

Memory

175.1MiB live, 29 200.3MiB allocated

Algorithm

248×	egg-herbie

Stop Event

328×	iter limit
171×	node limit
80×	saturated

Counts

8 658 → 8 562

soundness30.5s (11.1%)

Memory

-141.4MiB live, 16 239.5MiB allocated

Stop Event

206×	iter limit
138×	node limit
24×	fuel
4×	done
2×	saturated

Compiler

Compiled 17 690 to 7 663 computations (56.7% saved)

rewrite24.5s (8.9%)

Memory

124.6MiB live, 21 128.6MiB allocated

Stop Event

220×	iter limit
109×	node limit
3×	saturated

Counts

1 633 → 64 312

localize23.2s (8.4%)

Memory

219.0MiB live, 22 683.3MiB allocated

Samples

8.0s	5 985×	2	valid
6.9s	10 304×	1	valid
2.8s	10 500×	0	valid
1.0s	497×	3	valid
268.0ms	834×	0	invalid
36.0ms	35×	0	exit
31.0ms	5×	5	exit

Compiler

Compiled 51 659 to 7 157 computations (86.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 15.2s

ival-mult: 2.3s (15.1% of total)

ival-div: 2.2s (14.2% of total)

adjust: 2.1s (14% of total)

ival-tan: 1.7s (11.2% of total)

ival-add: 1.4s (8.9% of total)

ival-pow: 821.0ms (5.4% of total)

ival-sub: 746.0ms (4.9% of total)

ival-cos: 710.0ms (4.7% of total)

const: 653.0ms (4.3% of total)

ival-log: 610.0ms (4% of total)

ival-sin: 469.0ms (3.1% of total)

ival-exp: 329.0ms (2.2% of total)

ival-sqrt: 278.0ms (1.8% of total)

ival-log1p: 207.0ms (1.4% of total)

ival-neg: 146.0ms (1% of total)

ival-pow2: 133.0ms (0.9% of total)

ival-cosh: 91.0ms (0.6% of total)

ival-expm1: 90.0ms (0.6% of total)

ival-cbrt: 89.0ms (0.6% of total)

exact: 81.0ms (0.5% of total)

ival-hypot: 42.0ms (0.3% of total)

ival-true: 26.0ms (0.2% of total)

ival-atan: 21.0ms (0.1% of total)

ival-atan2: 15.0ms (0.1% of total)

ival-assert: 13.0ms (0.1% of total)

ival-sinh: 4.0ms (0% of total)

eval14.1s (5.1%)

Memory: 119.5MiB live, 15 867.5MiB allocated
Compiler: Compiled 2 940 629 to 294 043 computations (90% saved)

explain5.7s (2.1%)

Memory

-84.3MiB live, 6 141.4MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	5129	50
`log.f64`	`#f`	sensitivity	762	1
`+.f64`	`#f`	cancellation	699	1
`sqrt.f64`	`#f`	oflow-rescue	436	0
`/.f64`	`#f`	u/n	373	0
`/.f64`	`#f`	u/u	154	0
`pow.f64`	`(pow.f64 (+.f64 x #s(literal 1 binary64)) (/.f64 #s(literal 1 binary64) n))`	sensitivity	38	0
`sqrt.f64`	`#f`	uflow-rescue	36	0
`/.f64`	`(/.f64 (.f64 eps (-.f64 (exp.f64 (.f64 (+.f64 a b) eps)) #s(literal 1 binary64))) (.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))))`	n/u	27	0
↳	`(*.f64 b eps)`	underflow	151
↳	`(-.f64 (exp.f64 (*.f64 a eps)) #s(literal 1 binary64))`	underflow	148
↳	`(-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))`	underflow	153
↳	`(.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64)))`	underflow	235
↳	`(*.f64 a eps)`	underflow	146
`-.f64`	`#f`	nan-rescue	13	0
`/.f64`	`(/.f64 (-.f64 #s(literal 1 binary64) (cos.f64 x)) (*.f64 x x))`	n/o	3	0
↳	`(*.f64 x x)`	overflow	50
`cos.f64`	`(cos.f64 (+.f64 x eps))`	sensitivity	2	0
`sin.f64`	`(sin.f64 (+.f64 x eps))`	sensitivity	2	0
`tan.f64`	`(tan.f64 (+.f64 x eps))`	sensitivity	2	0
`/.f64`	`(/.f64 (+.f64 (neg.f64 b_2) (sqrt.f64 (-.f64 (.f64 b_2 b_2) (.f64 a c)))) a)`	o/n	1	0
↳	`(*.f64 b_2 b_2)`	overflow	100
↳	`(+.f64 (neg.f64 b_2) (sqrt.f64 (-.f64 (.f64 b_2 b_2) (.f64 a c))))`	overflow	1
↳	`(*.f64 a c)`	overflow	19
↳	`(-.f64 (.f64 b_2 b_2) (.f64 a c))`	overflow	111

Confusion

	Predicted +	Predicted -
+	4971	293
-	855	1049

Precision

0.853244078269825

Recall

0.944338905775076

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	4971	26	267
-	855	24	1025

Precision?

0.8504084411164057

Recall?

0.9492781155015197

Freqs

test

number	freq
0	1342
1	4622
2	778
3	205
4	221

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	28	0	0
-	0	0	0

Precision?

1.0

Recall?

1.0

Total Time

1119.35546875

Average Time

0.1561600821358817

Samples

1.0s	1 337×	2	valid
597.0ms	2 875×	1	valid
206.0ms	2 856×	0	valid
52.0ms	100×	3	valid

Compiler

Compiled 2 978 to 1 157 computations (61.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.5s

ival-tan: 578.0ms (38.5% of total)

ival-cos: 151.0ms (10.1% of total)

adjust: 127.0ms (8.5% of total)

ival-log: 87.0ms (5.8% of total)

ival-sub: 79.0ms (5.3% of total)

ival-div: 74.0ms (4.9% of total)

ival-sin: 71.0ms (4.7% of total)

ival-exp: 66.0ms (4.4% of total)

ival-log1p: 53.0ms (3.5% of total)

ival-add: 53.0ms (3.5% of total)

ival-mult: 43.0ms (2.9% of total)

ival-pow: 42.0ms (2.8% of total)

ival-sqrt: 29.0ms (1.9% of total)

ival-expm1: 12.0ms (0.8% of total)

ival-atan: 9.0ms (0.6% of total)

ival-cbrt: 8.0ms (0.5% of total)

ival-true: 6.0ms (0.4% of total)

ival-neg: 6.0ms (0.4% of total)

exact: 4.0ms (0.3% of total)

ival-assert: 3.0ms (0.2% of total)

prune5.3s (1.9%)

Memory: -472.5MiB live, 5 910.8MiB allocated
Counts: 73 907 → 1 795
Compiler: Compiled 101 014 to 50 258 computations (50.2% saved)

regimes4.6s (1.7%)

Memory

-39.1MiB live, 4 869.6MiB allocated

Counts

4 225 → 348

Calls

43 calls:

1.3s	x
278.0ms	eps
249.0ms	(/.f64 (+.f64 (neg.f64 b_2) (sqrt.f64 (-.f64 (.f64 b_2 b_2) (.f64 a c)))) a)
243.0ms	(/.f64 #s(literal 1 binary64) n)
210.0ms	b

Compiler

Compiled 2 236 to 2 071 computations (7.4% saved)

preprocess4.3s (1.6%)

Memory

119.8MiB live, 3 761.8MiB allocated

Algorithm

28×	egg-herbie

Stop Event

56×	iter limit
50×	saturated
6×	node limit

Compiler

Compiled 22 212 to 5 661 computations (74.5% saved)

series3.5s (1.3%)

Memory

148.0MiB live, 4 114.1MiB allocated

Counts

1 633 → 8 658

Calls

507 calls:

Time	Variable		Point	Expression
108.0ms	x	@	0	((- (cbrt (+ x 1)) (cbrt x)) (* (pow (cbrt x) -2) 1/3) (pow (cbrt x) -2) (cbrt x) (- (/ 1 (cbrt (exp (neg (log (+ 1 x)))))) (cbrt x)) (neg (cbrt x)) (- (cbrt (+ x 1)) (cbrt x)) (/ 1/3 (pow (cbrt x) 2)) (pow (cbrt x) 2) (* (/ -1 (cbrt x)) (/ -1 (cbrt x))) (* (* (/ -1 (cbrt x)) (/ -1 (cbrt x))) 1/3) (- (cbrt (+ x 1)) (cbrt x)) (/ -1 (cbrt x)) (- (cbrt (+ x 1)) (cbrt x)) (* (* (cbrt (pow x -1/2)) (cbrt (pow x -3/2))) 1/3) (* (cbrt (pow x -1/2)) (cbrt (pow x -3/2))) (cbrt (pow x -1/2)) (cbrt (pow x -3/2)))
65.0ms	x	@	inf	((- (sqrt (+ x 1)) (sqrt x)) (/ (+ (* (sqrt (/ 1 x)) -1/8) (* 1/2 (sqrt x))) x) (+ (* (sqrt (/ 1 x)) -1/8) (* 1/2 (sqrt x))) (sqrt (/ 1 x)) (- (sqrt (+ x 1)) (sqrt x)) (sqrt (+ x 1)) (sqrt x) (- (sqrt (+ x 1)) (sqrt x)) (sqrt (+ x 1)) (- (sqrt (+ x 1)) (sqrt x)) (* (sqrt (/ 1 x)) 1/2) (/ 1 x) (- (+ 1 x) x) (* (/ (- (+ 1 x) x) (+ (* (sqrt x) x) (pow (+ 1 x) 3/2))) (- (+ (+ 1 x) x) (sqrt (+ (* (sqrt x) (sqrt x)) (* x x))))) (/ (- (+ 1 x) x) (+ (* (sqrt x) x) (pow (+ 1 x) 3/2))) (+ 1 x) (+ (+ 1 x) x))
57.0ms	n	@	-inf	((pow (/ n (- (pow (log (+ 1 x)) 3) (pow (log x) 3))) -1) (* (pow (/ n (- (pow (log (+ 1 x)) 3) (pow (log x) 3))) -1) (pow (+ (* (log x) (+ (log x) (log (+ 1 x)))) (pow (log (+ 1 x)) 2)) -1)) (- (pow (+ x 1) (/ 1 n)) (pow x (/ 1 n))) (/ n (- (pow (log (+ 1 x)) 3) (pow (log x) 3))) (- (pow (+ x 1) (/ 1 n)) (pow x (/ 1 n))) (/ (- (log (+ 1 x)) (log x)) n) (- (log (+ 1 x)) (log x)) (/ 1 x) (+ (/ (- (/ (/ 1/3 n) x) (/ 1/2 n)) x) (/ 1 n)) (- (/ (/ 1/3 n) x) (/ 1/2 n)) (- (pow (+ x 1) (/ 1 n)) (pow x (/ 1 n))) (/ (- (log (+ 1 x)) (log x)) n) (+ (* (+ (* (/ (- (/ 1/2 n) 1/2) n) x) (/ 1 n)) x) 1) (- (exp (/ (log (+ 1 x)) n)) (pow x (/ 1 n))) (exp (/ (log (+ 1 x)) n)) (+ (* (/ (- (/ 1/2 n) 1/2) n) x) (/ 1 n)) (* (/ (pow n -1/2) x) (/ (pow n -1/2) (pow x (neg (pow n -1))))) (neg (pow n -1)) (- (pow (+ x 1) (/ 1 n)) (pow x (/ 1 n))) (/ (pow n -1/2) x) (- (pow (log (+ 1 x)) 3) (pow (log x) 3)) (pow (log x) 3) (/ 1/3 n) (/ (- (/ (/ 1/3 n) x) (/ 1/2 n)) x) (/ (pow n -1/2) (pow x (neg (pow n -1)))))
54.0ms	x	@	-inf	((- (cbrt (+ x 1)) (cbrt x)) (* (pow (cbrt x) -2) 1/3) (pow (cbrt x) -2) (cbrt x) (- (/ 1 (cbrt (exp (neg (log (+ 1 x)))))) (cbrt x)) (neg (cbrt x)) (- (cbrt (+ x 1)) (cbrt x)) (/ 1/3 (pow (cbrt x) 2)) (pow (cbrt x) 2) (* (/ -1 (cbrt x)) (/ -1 (cbrt x))) (* (* (/ -1 (cbrt x)) (/ -1 (cbrt x))) 1/3) (- (cbrt (+ x 1)) (cbrt x)) (/ -1 (cbrt x)) (- (cbrt (+ x 1)) (cbrt x)) (* (* (cbrt (pow x -1/2)) (cbrt (pow x -3/2))) 1/3) (* (cbrt (pow x -1/2)) (cbrt (pow x -3/2))) (cbrt (pow x -1/2)) (cbrt (pow x -3/2)))
52.0ms	N	@	-inf	((- (log (+ N 1)) (log N)) (/ (- (/ (- -1/2 (/ (- (/ 1/4 N) 1/3) N)) N) -1) N) (- (/ (- -1/2 (/ (- (/ 1/4 N) 1/3) N)) N) -1) (/ (- -1/2 (/ (- (/ 1/4 N) 1/3) N)) N) (- (log (+ N 1)) (log N)) (/ 1 N) (/ (* (- N 1) N) (+ (* N N) -1)) (neg (log (/ (* (- N 1) N) (+ (* N N) -1)))) (log (/ (* (- N 1) N) (+ (* N N) -1))) (* (- N 1) N) (+ (* (log (+ 1 N)) (/ (log (+ 1 N)) (+ (log N) (log (+ 1 N))))) (neg (/ (pow (log N) 2) (+ (log N) (log (+ 1 N)))))) (log (+ 1 N)) (/ (log (+ 1 N)) (+ (log N) (log (+ 1 N)))) (+ (log N) (log (+ 1 N))) (/ (- (* 1 (+ (log N) (log (+ 1 N)))) (* (/ (+ (log N) (log (+ 1 N))) (pow (log (+ 1 N)) 2)) (pow (log N) 2))) (* (/ (+ (log N) (log (+ 1 N))) (pow (log (+ 1 N)) 2)) (+ (log N) (log (+ 1 N))))) (- (* 1 (+ (log N) (log (+ 1 N)))) (* (/ (+ (log N) (log (+ 1 N))) (pow (log (+ 1 N)) 2)) (pow (log N) 2))) (* (/ (+ (log N) (log (+ 1 N))) (pow (log (+ 1 N)) 2)) (+ (log N) (log (+ 1 N)))) (* 1 (+ (log N) (log (+ 1 N)))) (/ (- (/ 1/4 N) 1/3) N) (- (/ 1/4 N) 1/3) (pow (log N) 2) (/ (pow (log N) 2) (+ (log N) (log (+ 1 N)))) (pow (log (+ 1 N)) 2) (/ (+ (log N) (log (+ 1 N))) (pow (log (+ 1 N)) 2)))

analyze1.7s (0.6%)

Memory

81.6MiB live, 2 083.8MiB allocated

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
7.4%	4.5%	56.6%	38.9%	0%	0%	0%	1
22.3%	13.6%	47.5%	38.9%	0%	0%	0%	2
40.2%	23.5%	34.9%	38.9%	0%	2.7%	0%	3
53.4%	31.1%	27.2%	38.9%	0%	2.8%	0%	4
63%	36.3%	21.3%	38.9%	0%	3.6%	0%	5
65.9%	37.5%	19.4%	38.9%	0%	4.2%	0%	6
70.4%	38.8%	16.3%	38.9%	0%	6%	0%	7
73.6%	40.2%	14.4%	38.9%	0%	6.5%	0%	8
76.3%	40.9%	12.7%	38.9%	0%	7.5%	0%	9
78.4%	41.4%	11.4%	38.9%	0%	8.3%	0%	10
81.1%	42.4%	9.9%	38.9%	0%	8.8%	0%	11
82.3%	42.7%	9.2%	38.9%	0%	9.3%	0%	12

Compiler

Compiled 483 to 337 computations (30.2% saved)

bsearch1.1s (0.4%)

Memory

-51.8MiB live, 976.5MiB allocated

Algorithm

75×	binary-search
43×	left-value

Stop Event

68×	narrow-enough
7×	predicate-same

Samples

385.0ms	3 635×	0	valid
119.0ms	500×	1	valid
94.0ms	333×	2	valid
50.0ms	532×	0	invalid
3.0ms	34×	0	exit
3.0ms	12×	3	valid

Compiler

Compiled 25 080 to 18 892 computations (24.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 474.0ms

ival-pow: 98.0ms (20.7% of total)

ival-div: 90.0ms (19% of total)

ival-mult: 90.0ms (19% of total)

adjust: 60.0ms (12.6% of total)

ival-sub: 35.0ms (7.4% of total)

ival-sqrt: 24.0ms (5.1% of total)

ival-add: 18.0ms (3.8% of total)

ival-cos: 16.0ms (3.4% of total)

ival-neg: 15.0ms (3.2% of total)

ival-sin: 6.0ms (1.3% of total)

ival-expm1: 5.0ms (1.1% of total)

ival-true: 4.0ms (0.8% of total)

ival-exp: 3.0ms (0.6% of total)

ival-cbrt: 3.0ms (0.6% of total)

exact: 3.0ms (0.6% of total)

ival-assert: 2.0ms (0.4% of total)

ival-log1p: 1.0ms (0.2% of total)

ival-log: 1.0ms (0.2% of total)

start1.0ms (0%)

Memory: 1.7MiB live, 1.7MiB allocated

end0.0ms (0%)

Memory: 0.4MiB live, 0.4MiB allocated

sample2.0min (43.5%)

simplify36.5s (13.3%)

soundness30.5s (11.1%)

rewrite24.5s (8.9%)

localize23.2s (8.4%)

eval14.1s (5.1%)

explain5.7s (2.1%)

prune5.3s (1.9%)

regimes4.6s (1.7%)

preprocess4.3s (1.6%)

series3.5s (1.3%)

analyze1.7s (0.6%)

bsearch1.1s (0.4%)

start1.0ms (0%)

end0.0ms (0%)

Profiling