Metrics for Herbie run

Date:	Sunday, November 3rd, 2024
Commit:	3e00ba3f on bhargav-double-double
Hostname:	nightly with Racket 8.10
Seed:	2024308
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample55.5s (35%)

Memory

233.1MiB live, 39 160.2MiB allocated

Samples

18.6s	43 407×	1	valid
11.8s	110 010×	0	valid
9.8s	6 224×	5	exit
4.6s	11 703×	2	valid
1.4s	10 235×	1	exit
482.0ms	3 912×	0	invalid
98.0ms	1 312×	0	exit

Precisions

Click to see histograms. Total time spent on operations: 38.8s

const: 5.0s (12.8% of total)

ival-mult: 4.4s (11.3% of total)

ival-pow: 4.3s (11.1% of total)

ival-tan: 4.1s (10.5% of total)

ival-exp: 4.0s (10.4% of total)

ival-cos: 2.9s (7.5% of total)

adjust: 2.8s (7.2% of total)

ival-log: 1.5s (3.8% of total)

ival-<=: 1.3s (3.3% of total)

ival-sqrt: 1.3s (3.3% of total)

ival-sub: 944.0ms (2.4% of total)

ival-fmod: 898.0ms (2.3% of total)

ival-sinh: 893.0ms (2.3% of total)

ival-div: 870.0ms (2.2% of total)

ival-add: 832.0ms (2.1% of total)

ival-sin: 635.0ms (1.6% of total)

ival-pow2: 610.0ms (1.6% of total)

ival-acos: 409.0ms (1.1% of total)

ival-neg: 222.0ms (0.6% of total)

ival-hypot: 163.0ms (0.4% of total)

ival-atan: 132.0ms (0.3% of total)

ival-==: 127.0ms (0.3% of total)

ival-and: 123.0ms (0.3% of total)

ival-true: 101.0ms (0.3% of total)

exact: 84.0ms (0.2% of total)

ival-assert: 80.0ms (0.2% of total)

ival-<: 71.0ms (0.2% of total)

ival-or: 42.0ms (0.1% of total)

ival->=: 24.0ms (0.1% of total)

ival->: 23.0ms (0.1% of total)

Bogosity

soundness22.9s (14.4%)

Memory

64.7MiB live, 7 468.0MiB allocated

Stop Event

132×	iter limit
72×	node limit
12×	fuel
6×	done
4×	saturated
4×	unsound

Compiler

Compiled 10 132 to 4 546 computations (55.1% saved)

simplify20.0s (12.6%)

Memory

-305.9MiB live, 13 683.9MiB allocated

Algorithm

148×	egg-herbie

Stop Event

191×	iter limit
77×	node limit
75×	saturated

Counts

3 497 → 3 439

rewrite12.9s (8.1%)

Memory

483.4MiB live, 10 981.3MiB allocated

Stop Event

141×	iter limit
58×	node limit
6×	unsound
4×	saturated

Counts

936 → 42 033

localize11.2s (7%)

Memory

223.3MiB live, 9 620.3MiB allocated

Samples

4.2s	4 712×	1	valid
3.8s	9 769×	0	valid
880.0ms	1 141×	2	valid
236.0ms	680×	0	invalid
132.0ms	122×	1	invalid
55.0ms	216×	0	exit

Compiler

Compiled 27 164 to 3 454 computations (87.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 6.0s

ival-mult: 1.6s (26.9% of total)

ival-div: 644.0ms (10.8% of total)

ival-tan: 523.0ms (8.8% of total)

adjust: 508.0ms (8.5% of total)

ival-cos: 494.0ms (8.3% of total)

ival-add: 413.0ms (6.9% of total)

ival-pow: 273.0ms (4.6% of total)

ival-sub: 229.0ms (3.8% of total)

ival-log: 224.0ms (3.8% of total)

ival-sqrt: 214.0ms (3.6% of total)

ival-sin: 197.0ms (3.3% of total)

ival-pow2: 151.0ms (2.5% of total)

const: 129.0ms (2.2% of total)

ival-sinh: 84.0ms (1.4% of total)

ival-neg: 63.0ms (1.1% of total)

ival-acos: 48.0ms (0.8% of total)

ival-asin: 43.0ms (0.7% of total)

ival-exp: 28.0ms (0.5% of total)

exact: 23.0ms (0.4% of total)

ival-hypot: 22.0ms (0.4% of total)

ival-cbrt: 18.0ms (0.3% of total)

ival-true: 14.0ms (0.2% of total)

ival-pi: 11.0ms (0.2% of total)

ival-assert: 8.0ms (0.1% of total)

regimes10.1s (6.4%)

Memory

-94.0MiB live, 9 725.5MiB allocated

Counts

4 878 → 189

Calls

52 calls:

2.5s	hi
860.0ms	a
844.0ms	x
577.0ms	r
560.0ms	b

Compiler

Compiled 1 926 to 2 189 computations (-13.7% saved)

eval9.0s (5.7%)

Memory: -105.2MiB live, 8 568.4MiB allocated
Compiler: Compiled 1 714 337 to 154 796 computations (91% saved)

series4.0s (2.5%)

Memory

47.2MiB live, 4 257.5MiB allocated

Counts

936 → 3 497

Calls

366 calls:

Time	Variable		Point	Expression
209.0ms	w	@	-inf	((exp (neg w)) (neg w) (pow l (exp w)) (exp w) (* (exp (neg w)) (pow l (exp w))))
198.0ms	lo	@	0	((- 1 (/ (+ (* (/ (- x hi) lo) hi) (- x hi)) lo)) (+ (* (/ (- x hi) lo) hi) (- x hi)) (/ (- x lo) (- hi lo)) (/ (+ (* (/ (- x hi) lo) hi) (- x hi)) lo) (/ (- x lo) (- hi lo)) (/ (- x lo) (- hi lo)) (/ (- x lo) hi) (- x lo) (+ (* (/ (- x lo) hi) lo) (- x lo)) (/ (- x lo) (- hi lo)) (/ (+ (* (/ (- x lo) hi) lo) (- x lo)) hi) (+ (* (/ (- x lo) hi) (+ (* lo (/ lo hi)) lo)) (- x lo)) (/ (- x lo) (- hi lo)) (/ (+ (* (/ (- x lo) hi) (+ (* lo (/ lo hi)) lo)) (- x lo)) hi) (+ (* lo (/ lo hi)) lo))
155.0ms	x	@	-inf	((* (sqrt (sqrt x)) (sqrt (* (sqrt x) (* x 2)))) (sqrt (sqrt x)) (sqrt x) (sqrt (* (sqrt x) (* x 2))) (* (sqrt (* x 2)) (sqrt x)) (sqrt (* x 2)) (* x 2) (* (pow x 3/4) (sqrt (* (sqrt x) 2))) (pow x 3/4) (sqrt (* (sqrt x) 2)) (* (sqrt x) 2) (pow (pow 256 1/32) 2) (* (pow (pow 256 1/32) 2) x) (pow 256 1/32) (* (sqrt x) (* x 2)))
148.0ms	x	@	0	((* (pow (* x 4) 1/4) (pow x 3/4)) (pow (* x 4) 1/4) (* x 4) (pow x 3/4) (* (sqrt 2) x) (sqrt 2) (* (* (* x 2) (sqrt x)) (sqrt x)) (sqrt (* (* (* x 2) (sqrt x)) (sqrt x))) (* (* x 2) (sqrt x)) (* x 2) (* (pow x 1/4) (sqrt (* (sqrt x) (* x 2)))) (pow x 1/4) (sqrt (* (sqrt x) (* x 2))) (* (sqrt x) (* x 2)) (* (pow 4 1/8) (* (pow 4 1/8) x)) (pow 4 1/8) (* (pow 4 1/8) x) (sqrt x))
106.0ms	a	@	inf	((/ (* r (sin b)) (+ (* (cos b) (cos a)) (* (neg (sin b)) (sin a)))) (* r (sin b)) (sin b) (+ (* (cos b) (cos a)) (* (neg (sin b)) (sin a))) (/ (* r (sin b)) (cos (+ a b))) (* (/ r (cos a)) b) (/ r (cos a)) (+ (* (* (* a a) r) 1/2) r) (/ (/ -1 r) (/ -1 (cos a))) (/ 1 (/ (/ -1 r) (/ -1 (cos a)))) (/ (* r (sin b)) (cos (+ a b))) (* (/ 1 (/ (/ -1 r) (/ -1 (cos a)))) b) (exp (* (log (/ (cos a) r)) -1)) (* (log (/ (cos a) r)) -1) (/ (* r (sin b)) (cos (+ a b))) (* (exp (* (log (/ (cos a) r)) -1)) b) (pow (pow (/ (cos (+ a b)) (* (sin b) r)) -1/2) 2) (/ (+ (* (neg b) (/ (sin a) r)) (/ (cos a) r)) b) (pow (/ (cos (+ a b)) (* (sin b) r)) -1/2) (/ (cos (+ a b)) (* (sin b) r)) (* (neg (sin b)) (sin a)) (* (* a a) r) (/ (cos a) r) (+ (* (neg b) (/ (sin a) r)) (/ (cos a) r)))

analyze3.7s (2.4%)

Memory

17.1MiB live, 3 780.1MiB allocated

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
28.8%	21.3%	52.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.2%	0%	6
71.1%	51.1%	20.8%	26.3%	0%	1.9%	0%	7
72.1%	51.6%	20%	26.3%	0%	2.1%	0%	8
74.4%	53%	18.2%	26.3%	0%	2.5%	0%	9
75.8%	53.9%	17.2%	26.3%	0%	2.6%	0%	10
76.6%	54.3%	16.6%	26.3%	0%	2.8%	0%	11
77.3%	54.8%	16.1%	26.3%	0%	2.9%	0%	12

Compiler

Compiled 279 to 216 computations (22.6% saved)

prune3.4s (2.1%)

Memory: 30.3MiB live, 4 579.6MiB allocated
Counts: 42 759 → 1 702
Compiler: Compiled 98 024 to 46 752 computations (52.3% saved)

preprocess2.8s (1.8%)

Memory

29.4MiB live, 2 299.7MiB allocated

Algorithm

18×	egg-herbie

Stop Event

35×	saturated
34×	iter limit
3×	node limit

Compiler

Compiled 12 557 to 4 822 computations (61.6% saved)

explain2.6s (1.7%)

Memory

-16.1MiB live, 3 166.9MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`sqrt.f64`	`#f`	oflow-rescue	632	0
`-.f64`	`#f`	cancellation	508	0
`cos.f64`	`#f`	sensitivity	485	0
`sqrt.f64`	`#f`	uflow-rescue	331	0
`acos.f64`	`(acos.f64 (-.f64 #s(literal 1 binary64) x))`	sensitivity	255	0
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	sensitivity	253	0
`tan.f64`	`(tan.f64 (+.f64 y z))`	sensitivity	186	0
`pow.f64`	`(pow.f64 l (exp.f64 w))`	sensitivity	114	23
`*.f64`	`#f`	*no**	40	0
`*.f64`	`#f`	*nu**	33	0
`*.f64`	`(.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (*.f64 x (pow.f64 s #s(literal 2 binary64))) x))`	*uo**	27	0
↳	`(pow.f64 c #s(literal 2 binary64))`	underflow	70
↳	`(.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)`	overflow	78
↳	`(*.f64 x (pow.f64 s #s(literal 2 binary64)))`	overflow	69
↳	`(pow.f64 s #s(literal 2 binary64))`	overflow	68
`-.f64`	`(-.f64 (.f64 a a) (.f64 b b))`	nan-rescue	23	0
↳	`(*.f64 a a)`	overflow	128
↳	`(*.f64 b b)`	overflow	23
`*.f64`	`(.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (*.f64 x (pow.f64 s #s(literal 2 binary64))) x))`	*ou**	16	0
↳	`(pow.f64 c #s(literal 2 binary64))`	overflow	55
↳	`(.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)`	underflow	67
↳	`(*.f64 x (pow.f64 s #s(literal 2 binary64)))`	underflow	61
↳	`(pow.f64 s #s(literal 2 binary64))`	underflow	59
`/.f64`	`(/.f64 (cos.f64 (.f64 #s(literal 2 binary64) x)) (.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)))`	n/o	1	0
↳	`(.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)`	overflow	78
↳	`(pow.f64 c #s(literal 2 binary64))`	overflow	55
↳	`(.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (*.f64 x (pow.f64 s #s(literal 2 binary64))) x))`	overflow	78
↳	`(*.f64 x (pow.f64 s #s(literal 2 binary64)))`	overflow	69
↳	`(pow.f64 s #s(literal 2 binary64))`	overflow	68

Confusion

	Predicted +	Predicted -
+	1999	278
-	815	1516

Precision

0.7103766879886283

Recall

0.8779095300834431

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	1999	0	278
-	815	23	1493

Precision?

0.7046175537539655

Recall?

0.8779095300834431

Freqs

test

number	freq
0	1794
1	2728
2	82
3	4

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	16	0	1
-	0	0	1

Precision?

1.0

Recall?

0.9411764705882353

Samples

511.0ms	6 241×	0	valid
442.0ms	2 430×	1	valid
209.0ms	562×	2	valid

Compiler

Compiled 1 782 to 700 computations (60.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 779.0ms

ival-mult: 175.0ms (22.5% of total)

ival-log: 83.0ms (10.7% of total)

ival-tan: 74.0ms (9.5% of total)

ival-cos: 63.0ms (8.1% of total)

adjust: 61.0ms (7.8% of total)

ival-sinh: 61.0ms (7.8% of total)

ival-sqrt: 40.0ms (5.1% of total)

ival-add: 38.0ms (4.9% of total)

ival-sub: 35.0ms (4.5% of total)

ival-sin: 35.0ms (4.5% of total)

ival-div: 27.0ms (3.5% of total)

ival-pow2: 22.0ms (2.8% of total)

ival-acos: 20.0ms (2.6% of total)

ival-exp: 9.0ms (1.2% of total)

ival-pow: 9.0ms (1.2% of total)

ival-hypot: 9.0ms (1.2% of total)

ival-true: 8.0ms (1% of total)

ival-assert: 4.0ms (0.5% of total)

exact: 2.0ms (0.3% of total)

ival-neg: 2.0ms (0.3% of total)

ival-atan: 0.0ms (0% of total)

bsearch557.0ms (0.4%)

Memory

-42.6MiB live, 487.1MiB allocated

Algorithm

40×	binary-search
11×	left-value

Stop Event

40×	narrow-enough

Samples

166.0ms	2 119×	0	valid
165.0ms	745×	1	valid
1.0ms	11×	0	exit

Compiler

Compiled 12 042 to 9 805 computations (18.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 254.0ms

ival-tan: 80.0ms (31.4% of total)

ival-pow: 24.0ms (9.4% of total)

ival-cos: 21.0ms (8.3% of total)

ival-add: 20.0ms (7.9% of total)

ival-mult: 19.0ms (7.5% of total)

ival-exp: 17.0ms (6.7% of total)

ival-pow2: 17.0ms (6.7% of total)

adjust: 16.0ms (6.3% of total)

ival-sin: 12.0ms (4.7% of total)

ival-div: 9.0ms (3.5% of total)

ival-neg: 8.0ms (3.1% of total)

ival-sub: 5.0ms (2% of total)

ival-sqrt: 2.0ms (0.8% of total)

ival-true: 2.0ms (0.8% of total)

ival-assert: 1.0ms (0.4% of total)

exact: 0.0ms (0% of total)

start1.0ms (0%)

Memory: 1.0MiB live, 1.0MiB allocated

end0.0ms (0%)

Memory: 0.2MiB live, 0.2MiB allocated

sample55.5s (35%)

soundness22.9s (14.4%)

simplify20.0s (12.6%)

rewrite12.9s (8.1%)

localize11.2s (7%)

regimes10.1s (6.4%)

eval9.0s (5.7%)

series4.0s (2.5%)

analyze3.7s (2.4%)

prune3.4s (2.1%)

preprocess2.8s (1.8%)

explain2.6s (1.7%)

bsearch557.0ms (0.4%)

start1.0ms (0%)

end0.0ms (0%)

Profiling