Metrics for Herbie run

Date:	Tuesday, October 22nd, 2024
Commit:	5ca06d70 on bhargav-double-double
Hostname:	nightly with Racket 8.10
Seed:	2024296
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.2min (39.9%)

Memory

250.7MiB live, 38 407.4MiB allocated

Samples

21.8s	109 998×	0	valid
21.3s	43 272×	1	valid
8.6s	6 231×	5	exit
4.5s	11 850×	2	valid
1.1s	10 358×	1	exit
489.0ms	3 900×	0	invalid
413.0ms	1 379×	0	exit
0.0ms	1×	3	exit

Precisions

Click to see histograms. Total time spent on operations: 47.8s

const: 8.2s (17.2% of total)

ival-<=: 7.2s (15% of total)

ival-sin: 4.6s (9.5% of total)

ival-div: 4.5s (9.3% of total)

ival-exp: 3.9s (8.3% of total)

ival-pow: 3.5s (7.2% of total)

ival-cos: 2.3s (4.8% of total)

adjust: 2.2s (4.6% of total)

ival-tan: 1.9s (4% of total)

ival-mult: 1.8s (3.8% of total)

ival-sqrt: 1.3s (2.7% of total)

ival-log: 1.3s (2.6% of total)

ival-add: 1.2s (2.4% of total)

ival-fmod: 817.0ms (1.7% of total)

ival-sinh: 717.0ms (1.5% of total)

ival-sub: 704.0ms (1.5% of total)

ival-acos: 388.0ms (0.8% of total)

ival-pow2: 371.0ms (0.8% of total)

ival-hypot: 168.0ms (0.4% of total)

ival-neg: 153.0ms (0.3% of total)

ival-and: 127.0ms (0.3% of total)

ival-true: 100.0ms (0.2% of total)

ival-==: 85.0ms (0.2% of total)

exact: 82.0ms (0.2% of total)

ival-<: 79.0ms (0.2% of total)

ival-assert: 78.0ms (0.2% of total)

ival-atan: 65.0ms (0.1% of total)

ival-or: 42.0ms (0.1% of total)

ival->=: 29.0ms (0.1% of total)

ival->: 19.0ms (0% of total)

Bogosity

soundness27.0s (15.4%)

Memory

92.9MiB live, 5 738.2MiB allocated

Stop Event

110×	iter limit
58×	node limit
11×	fuel
5×	done
4×	unsound
3×	saturated

Compiler

Compiled 5 764 to 3 055 computations (47% saved)

simplify21.6s (12.3%)

Memory

-110.4MiB live, 11 171.0MiB allocated

Algorithm

132×	egg-herbie

Stop Event

170×	iter limit
72×	saturated
64×	node limit

Counts

3 286 → 3 220

rewrite17.9s (10.2%)

Memory

191.8MiB live, 9 630.5MiB allocated

Stop Event

126×	iter limit
51×	node limit
6×	unsound
4×	saturated

Counts

792 → 33 320

localize9.3s (5.3%)

Memory

39.5MiB live, 8 329.3MiB allocated

Samples

3.6s	9 920×	0	valid
3.0s	3 480×	1	valid
632.0ms	416×	2	valid
234.0ms	627×	0	invalid
231.0ms	181×	1	invalid
62.0ms	1×	5	exit
44.0ms	223×	0	exit

Compiler

Compiled 17 421 to 2 848 computations (83.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 6.1s

ival-pow: 2.3s (37.4% of total)

ival-mult: 750.0ms (12.3% of total)

adjust: 541.0ms (8.9% of total)

ival-tan: 437.0ms (7.2% of total)

ival-div: 417.0ms (6.9% of total)

ival-cos: 400.0ms (6.6% of total)

ival-sin: 249.0ms (4.1% of total)

ival-sqrt: 234.0ms (3.8% of total)

ival-add: 234.0ms (3.8% of total)

ival-sub: 168.0ms (2.8% of total)

ival-pow2: 110.0ms (1.8% of total)

ival-exp: 69.0ms (1.1% of total)

ival-neg: 68.0ms (1.1% of total)

const: 39.0ms (0.6% of total)

ival-log: 28.0ms (0.5% of total)

ival-hypot: 27.0ms (0.4% of total)

exact: 19.0ms (0.3% of total)

ival-true: 13.0ms (0.2% of total)

ival-assert: 7.0ms (0.1% of total)

regimes7.8s (4.4%)

Memory

14.2MiB live, 4 769.5MiB allocated

Counts

2 687 → 140

Calls

48 calls:

3.5s	(/.f64 (-.f64 x lo) (-.f64 hi lo))
506.0ms	a
374.0ms	b
352.0ms	(*.f64 r (/.f64 (sin.f64 b) (cos.f64 (+.f64 a b))))
325.0ms	r

Compiler

Compiled 1 370 to 1 557 computations (-13.6% saved)

eval5.6s (3.2%)

Memory: -37.7MiB live, 7 117.5MiB allocated
Compiler: Compiled 905 225 to 112 004 computations (87.6% saved)

series4.5s (2.6%)

Memory

154.7MiB live, 4 252.5MiB allocated

Counts

792 → 3 286

Calls

351 calls:

Time	Variable		Point	Expression
237.0ms	x	@	0	((* (sqrt (* x 2)) (sqrt x)) (sqrt (* x 2)) (* x 2) (sqrt x) (* (sqrt 2) x) (sqrt 2) (sqrt (* 2 (pow (sqrt x) 4))) (* 2 (pow (sqrt x) 4)) (pow (sqrt x) 4) (* (pow 4 1/8) (* (pow 4 1/8) x)) (pow 4 1/8) (* (pow 4 1/8) x) (* (pow (* 4 x) 1/4) (pow x 3/4)) (pow (* 4 x) 1/4) (* 4 x) (pow x 3/4))
234.0ms	b	@	-inf	((* r (/ (sin b) (- (* (cos b) (cos a)) (* (sin a) (sin b))))) (/ (sin b) (- (* (cos b) (cos a)) (* (sin a) (sin b)))) (sin b) (- (* (cos b) (cos a)) (* (sin a) (sin b))) (* r (/ (sin b) (cos (+ a b)))) (/ (sin b) (cos (+ a b))) (/ b (cos a)) (+ (* (* (* a a) b) 1/2) b) (exp (* (log (/ (cos a) b)) -1)) (* (log (/ (cos a) b)) -1) (* r (/ (sin b) (cos (+ a b)))) (/ (sin b) (cos (+ a b))) (* r (pow (pow (/ (cos (+ a b)) (sin b)) -1/2) 2)) (pow (pow (/ (cos (+ a b)) (sin b)) -1/2) 2) (pow (/ (cos (+ a b)) (sin b)) -1/2) (sqrt (/ (sin b) (cos (+ a b)))) (pow (pow (/ (cos (+ a b)) (sin b)) -1/8) 2) (* r (pow (pow (pow (/ (cos (+ a b)) (sin b)) -1/8) 2) 4)) (pow (pow (pow (/ (cos (+ a b)) (sin b)) -1/8) 2) 4) (pow (/ (cos (+ a b)) (sin b)) -1/8) (* (sin a) (sin b)) (* (* a a) b) (cos a) (cos (+ a b)) (/ (sin b) (cos (+ a b))))
222.0ms	x	@	-inf	((* (* (pow x 1/4) (sqrt (* (sqrt x) 2))) (sqrt x)) (* (pow x 1/4) (sqrt (* (sqrt x) 2))) (pow x 1/4) (sqrt (* (sqrt x) 2)) (* (pow 64 1/16) (* (pow 16 1/32) x)) (pow 64 1/16) (* (pow 16 1/32) x) (pow 16 1/32) (pow (pow 256 1/32) 2) (* (pow (pow 256 1/32) 2) x) (pow 256 1/32) (sqrt x))
181.0ms	x	@	inf	((sqrt (+ (* x x) (+ (* y y) (* z z)))) (+ (* (/ (+ (* y y) (* x x)) z) 1/2) z) (* (* (/ x z) x) 1/2) (* (/ x z) x) (sqrt (+ (* x x) (+ (* y y) (* z z)))) (+ (* (/ (+ (* y y) (* x x)) z) 1/2) z) (/ (+ (* y y) (* x x)) z) (/ x z))
174.0ms	z	@	-inf	((+ x (- (/ (+ (tan z) (tan y)) (+ (* (neg (tan z)) (tan y)) 1)) (tan a))) (- (/ (+ (tan z) (tan y)) (+ (* (neg (tan z)) (tan y)) 1)) (tan a)) (/ (+ (tan z) (tan y)) (+ (* (neg (tan z)) (tan y)) 1)) (+ (tan z) (tan y)) (- (tan (+ z y)) (- (tan a) x)) (tan (+ z y)) (+ z y) (- (tan a) x) (/ 1 (/ 1 (+ z y))) (+ x (- (tan (/ 1 (/ 1 (+ z y)))) (tan a))) (- (tan (/ 1 (/ 1 (+ z y)))) (tan a)) (tan (/ 1 (/ 1 (+ z y)))) (+ (* (neg (sin (+ z y))) (/ 1 (neg (cos (+ z y))))) (- x (tan a))) (/ 1 (neg (cos (+ z y)))) (neg (sin (+ z y))) (sin (+ z y)) (/ (- (pow (- (tan (+ z y)) (tan a)) 2) (* x x)) (- (tan (+ z y)) (+ (tan a) x))) (- (pow (- (tan (+ z y)) (tan a)) 2) (* x x)) (pow (- (tan (+ z y)) (tan a)) 2) (- (tan (+ z y)) (tan a)) (tan a) (cos (+ z y)))

analyze3.6s (2.1%)

Memory

-43.4MiB live, 4 142.3MiB allocated

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
28.8%	21.3%	52.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.2%	0%	6
71.1%	51.1%	20.8%	26.3%	0%	1.9%	0%	7
72.1%	51.6%	20%	26.3%	0%	2.1%	0%	8
74.4%	53%	18.2%	26.3%	0%	2.5%	0%	9
75.8%	53.9%	17.2%	26.3%	0%	2.6%	0%	10
76.6%	54.3%	16.6%	26.3%	0%	2.8%	0%	11
77.3%	54.8%	16.1%	26.3%	0%	2.9%	0%	12

Compiler

Compiled 279 to 216 computations (22.6% saved)

prune2.8s (1.6%)

Memory: -135.4MiB live, 4 071.7MiB allocated
Counts: 32 834 → 1 469
Compiler: Compiled 71 129 to 38 761 computations (45.5% saved)

explain2.5s (1.4%)

Memory

-190.7MiB live, 2 517.0MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`sqrt.f64`	`#f`	oflow-rescue	610	0
`-.f64`	`#f`	cancellation	505	0
`cos.f64`	`#f`	sensitivity	499	3
`sqrt.f64`	`#f`	uflow-rescue	322	0
`tan.f64`	`(tan.f64 (+.f64 y z))`	sensitivity	198	0
`pow.f64`	`(pow.f64 l (exp.f64 w))`	sensitivity	128	17
`*.f64`	`#f`	*nu**	37	0
`*.f64`	`#f`	*no**	36	0
`-.f64`	`(-.f64 (.f64 a a) (.f64 b b))`	nan-rescue	18	0
↳	`(*.f64 a a)`	overflow	116
↳	`(*.f64 b b)`	overflow	18
`*.f64`	`(.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (*.f64 x (pow.f64 s #s(literal 2 binary64))) x))`	*uo**	18	0
↳	`(pow.f64 c #s(literal 2 binary64))`	underflow	74
↳	`(.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)`	overflow	69
↳	`(*.f64 x (pow.f64 s #s(literal 2 binary64)))`	overflow	59
↳	`(pow.f64 s #s(literal 2 binary64))`	overflow	64
`*.f64`	`(.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (*.f64 x (pow.f64 s #s(literal 2 binary64))) x))`	*ou**	17	0
↳	`(pow.f64 c #s(literal 2 binary64))`	overflow	52
↳	`(.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)`	underflow	81
↳	`(*.f64 x (pow.f64 s #s(literal 2 binary64)))`	underflow	59
↳	`(pow.f64 s #s(literal 2 binary64))`	underflow	60
`/.f64`	`(/.f64 (cos.f64 (.f64 #s(literal 2 binary64) x)) (.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)))`	n/o	2	0
↳	`(.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)`	overflow	69
↳	`(pow.f64 c #s(literal 2 binary64))`	overflow	52
↳	`(.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (*.f64 x (pow.f64 s #s(literal 2 binary64))) x))`	overflow	74
↳	`(*.f64 x (pow.f64 s #s(literal 2 binary64)))`	overflow	59
↳	`(pow.f64 s #s(literal 2 binary64))`	overflow	64

Confusion

	Predicted +	Predicted -
+	1587	264
-	729	1516

Precision

0.6852331606217616

Recall

0.8573743922204214

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	1587	0	264
-	729	19	1497

Precision?

0.6796573875802998

Recall?

0.8573743922204214

Freqs

test

number	freq
0	1780
1	2244
2	70
3	2

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	14	0	1
-	0	0	1

Precision?

1.0

Recall?

0.9333333333333333

Samples

485.0ms	6 114×	0	valid
371.0ms	1 870×	1	valid
37.0ms	208×	2	valid

Compiler

Compiled 1 697 to 657 computations (61.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 561.0ms

ival-mult: 106.0ms (18.9% of total)

ival-tan: 83.0ms (14.8% of total)

ival-sin: 69.0ms (12.3% of total)

ival-sqrt: 60.0ms (10.7% of total)

ival-cos: 48.0ms (8.6% of total)

ival-add: 43.0ms (7.7% of total)

adjust: 41.0ms (7.3% of total)

ival-sub: 32.0ms (5.7% of total)

ival-pow2: 24.0ms (4.3% of total)

ival-div: 15.0ms (2.7% of total)

ival-pow: 9.0ms (1.6% of total)

ival-hypot: 9.0ms (1.6% of total)

ival-exp: 8.0ms (1.4% of total)

ival-true: 7.0ms (1.2% of total)

ival-assert: 4.0ms (0.7% of total)

ival-neg: 3.0ms (0.5% of total)

exact: 2.0ms (0.4% of total)

preprocess2.4s (1.3%)

Memory

-5.2MiB live, 1 832.3MiB allocated

Algorithm

16×	egg-herbie

Stop Event

31×	saturated
30×	iter limit
3×	node limit

Compiler

Compiled 6 936 to 2 960 computations (57.3% saved)

bsearch596.0ms (0.3%)

Memory

87.6MiB live, 570.1MiB allocated

Algorithm

39×	binary-search
7×	left-value

Stop Event

38×	narrow-enough
1×	predicate-same

Samples

152.0ms	837×	1	valid
147.0ms	2 187×	0	valid

Compiler

Compiled 9 353 to 7 833 computations (16.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 217.0ms

ival-tan: 42.0ms (19.4% of total)

ival-cos: 32.0ms (14.8% of total)

ival-sin: 22.0ms (10.1% of total)

ival-mult: 19.0ms (8.8% of total)

adjust: 18.0ms (8.3% of total)

ival-pow: 18.0ms (8.3% of total)

ival-exp: 17.0ms (7.8% of total)

ival-add: 17.0ms (7.8% of total)

ival-div: 9.0ms (4.1% of total)

ival-pow2: 6.0ms (2.8% of total)

ival-neg: 6.0ms (2.8% of total)

ival-sub: 3.0ms (1.4% of total)

ival-sqrt: 3.0ms (1.4% of total)

ival-true: 2.0ms (0.9% of total)

ival-assert: 1.0ms (0.5% of total)

exact: 0.0ms (0% of total)

start1.0ms (0%)

Memory: 1.0MiB live, 1.0MiB allocated

end0.0ms (0%)

Memory: 0.2MiB live, 0.1MiB allocated

sample1.2min (39.9%)

soundness27.0s (15.4%)

simplify21.6s (12.3%)

rewrite17.9s (10.2%)

localize9.3s (5.3%)

regimes7.8s (4.4%)

eval5.6s (3.2%)

series4.5s (2.6%)

analyze3.6s (2.1%)

prune2.8s (1.6%)

explain2.5s (1.4%)

preprocess2.4s (1.3%)

bsearch596.0ms (0.3%)

start1.0ms (0%)

end0.0ms (0%)

Profiling