Metrics for Herbie run

Date:	Monday, October 21st, 2024
Commit:	15c1caf3 on main
Hostname:	nightly with Racket 8.10
Seed:	2024295
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample12.8s (23.9%)

Memory

282.8MiB live, 10 839.2MiB allocated

Samples

8.0s	70 230×	0	valid
777.0ms	4 063×	2	valid
256.0ms	1 937×	0	invalid
1.0ms	11×	1	valid

Precisions

Click to see histograms. Total time spent on operations: 6.4s

ival-mult: 2.0s (30.5% of total)

ival-div: 1.1s (17.3% of total)

ival-sub: 881.0ms (13.7% of total)

ival-neg: 711.0ms (11.1% of total)

ival-add: 415.0ms (6.5% of total)

ival-sqrt: 389.0ms (6.1% of total)

ival-fabs: 244.0ms (3.8% of total)

ival-log: 150.0ms (2.3% of total)

adjust: 120.0ms (1.9% of total)

ival->=: 115.0ms (1.8% of total)

ival-if: 100.0ms (1.6% of total)

ival-exp: 83.0ms (1.3% of total)

ival-true: 58.0ms (0.9% of total)

exact: 57.0ms (0.9% of total)

ival-assert: 30.0ms (0.5% of total)

Bogosity

simplify9.7s (18.1%)

Memory

241.7MiB live, 7 304.1MiB allocated

Algorithm

71×	egg-herbie

Stop Event

91×	iter limit
37×	node limit
36×	saturated

Counts

2 463 → 2 437

soundness7.0s (13.1%)

Memory

59.6MiB live, 3 174.3MiB allocated

Stop Event

42×	iter limit
28×	node limit
5×	done
4×	fuel
2×	saturated

Compiler

Compiled 7 036 to 2 927 computations (58.4% saved)

rewrite6.9s (12.9%)

Memory

45.5MiB live, 7 065.4MiB allocated

Stop Event

66×	iter limit
29×	node limit
2×	unsound
1×	saturated

Counts

332 → 16 731

localize5.1s (9.5%)

Memory

-220.8MiB live, 3 838.3MiB allocated

Samples

1.3s	891×	2	valid
1.2s	6 341×	0	valid
797.0ms	573×	1	valid
381.0ms	131×	3	valid

Compiler

Compiled 15 381 to 1 617 computations (89.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.2s

ival-mult: 710.0ms (32.1% of total)

ival-div: 300.0ms (13.6% of total)

ival-sub: 299.0ms (13.5% of total)

ival-sqrt: 290.0ms (13.1% of total)

adjust: 192.0ms (8.7% of total)

ival-add: 140.0ms (6.3% of total)

ival-if: 102.0ms (4.6% of total)

ival-neg: 88.0ms (4% of total)

ival-exp: 25.0ms (1.1% of total)

ival-log: 21.0ms (0.9% of total)

ival-fabs: 16.0ms (0.7% of total)

exact: 11.0ms (0.5% of total)

ival-true: 7.0ms (0.3% of total)

ival->=: 7.0ms (0.3% of total)

ival-assert: 3.0ms (0.1% of total)

eval4.4s (8.3%)

Memory: 34.3MiB live, 5 819.0MiB allocated
Compiler: Compiled 987 459 to 75 332 computations (92.4% saved)

preprocess1.6s (3.1%)

Memory

-75.1MiB live, 1 212.1MiB allocated

Algorithm

9×	egg-herbie

Stop Event

18×	iter limit
13×	saturated
5×	node limit

Compiler

Compiled 7 175 to 1 356 computations (81.1% saved)

explain1.6s (3%)

Memory

36.0MiB live, 1 818.9MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`sqrt.f64`	`#f`	oflow-rescue	274	0
`-.f64`	`#f`	cancellation	120	0
`+.f64`	`#f`	cancellation	109	1
`sqrt.f64`	`#f`	uflow-rescue	85	0
`/.f64`	`#f`	u/n	38	0
`/.f64`	`#f`	n/u	22	0
`-.f64`	`#f`	nan-rescue	18	0
`*.f64`	`(*.f64 (/.f64 x y) z)`	*no**	7	0
`*.f64`	`(*.f64 (/.f64 x y) z)`	*nu**	5	0

Confusion

	Predicted +	Predicted -
+	312	5
-	229	1758

Precision

0.5767097966728281

Recall

0.9842271293375394

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	312	0	5
-	229	1	1757

Precision?

0.5756457564575646

Recall?

0.9842271293375394

Freqs

test

number	freq
0	1763
1	407
2	131
3	3

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	4	0	0
-	0	0	5

Precision?

1.0

Recall?

1.0

Samples

249.0ms	3 694×	0	valid
168.0ms	570×	2	valid
155.0ms	286×	1	valid
23.0ms	58×	3	valid

Compiler

Compiled 1 575 to 388 computations (75.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 330.0ms

ival-mult: 74.0ms (22.5% of total)

ival-div: 63.0ms (19.1% of total)

ival-sub: 47.0ms (14.3% of total)

ival-sqrt: 35.0ms (10.6% of total)

adjust: 33.0ms (10% of total)

ival-add: 23.0ms (7% of total)

ival-neg: 11.0ms (3.3% of total)

ival-if: 9.0ms (2.7% of total)

ival-fabs: 8.0ms (2.4% of total)

ival-log: 7.0ms (2.1% of total)

ival-exp: 4.0ms (1.2% of total)

ival->=: 4.0ms (1.2% of total)

ival-true: 4.0ms (1.2% of total)

exact: 4.0ms (1.2% of total)

ival-assert: 2.0ms (0.6% of total)

prune1.6s (3%)

Memory: -49.3MiB live, 2 207.7MiB allocated
Counts: 20 016 → 274
Compiler: Compiled 19 898 to 10 129 computations (49.1% saved)

series806.0ms (1.5%)

Memory

44.8MiB live, 803.4MiB allocated

Counts

332 → 2 463

Calls

183 calls:

Time	Variable		Point	Expression
76.0ms	b	@	-inf	((/ (* 2 c) (- (neg b) (sqrt (- (* b b) (* (* 4 a) c))))) (- (* b b) (* (* 4 a) c)) (+ (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (>= b 0) (sqrt (- (* b b) (* (* 4 a) c))) (- (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (/ (+ (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (* 2 a)))
36.0ms	c	@	-inf	((if (>= b 0) (/ (* 2 c) (- (neg b) (sqrt (- (* b b) (* (* 4 a) c))))) (/ (+ (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (* 2 a))) (if (>= b 0) (/ (* -2 c) (+ (sqrt (+ (* (* a c) -4) (* b b))) b)) (* (/ (- (sqrt (+ (* (* a c) -4) (* b b))) b) a) 1/2)) (>= b 0) (/ (* -2 c) (+ (sqrt (+ (* (* a c) -4) (* b b))) b)) (if (>= b 0) (/ (* 2 c) (- (neg b) (sqrt (- (* b b) (* (* 4 a) c))))) (/ (+ (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (* 2 a))) (/ (* 2 c) (- (neg b) (sqrt (- (* b b) (* (* 4 a) c))))) (* 2 c) (if (>= b 0) (* (/ -2 (- (sqrt (+ (* (* -4 c) a) (* b b))) b)) c) (/ (+ (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (* 2 a))) (if (>= b 0) (* (/ c (- (sqrt (+ (* -4 (* c a)) (* b b))) b)) -2) (* (/ (- (sqrt (+ (* -4 (* c a)) (* b b))) b) a) 1/2)) (* (/ c (- (sqrt (+ (* -4 (* c a)) (* b b))) b)) -2) (+ (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (* (/ -2 (- (sqrt (+ (* (* -4 c) a) (* b b))) b)) c) (/ -2 (- (sqrt (+ (* (* -4 c) a) (* b b))) b)) (/ (- (* (sqrt (+ (* (* -4 c) a) (* b b))) a) (* a b)) (* a a)) (- (* (sqrt (+ (* (* -4 c) a) (* b b))) a) (* a b)) (if (>= b 0) (* (/ -2 (- (sqrt (+ (* (* -4 c) a) (* b b))) b)) c) (/ (+ (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (* 2 a))) (if (>= b 0) (* (/ c (- (sqrt (+ (* -4 (* c a)) (* b b))) b)) -2) (* (/ (- (* (sqrt (+ (* (* -4 c) a) (* b b))) a) (* a b)) (* a a)) 1/2)) (sqrt (+ (* (* a c) -4) (* b b))) (+ (sqrt (+ (* (* a c) -4) (* b b))) b) (- (sqrt (+ (* (* a c) -4) (* b b))) b) (/ (- (sqrt (+ (* (* a c) -4) (* b b))) b) a) (- (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (+ (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (/ (+ (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (* 2 a)) (/ c (- (sqrt (+ (* -4 (* c a)) (* b b))) b)) (sqrt (+ (* -4 (* c a)) (* b b))) (- (sqrt (+ (* -4 (* c a)) (* b b))) b) (/ (- (sqrt (+ (* -4 (* c a)) (* b b))) b) a) (sqrt (- (* b b) (* (* 4 a) c))) (sqrt (+ (* (* -4 c) a) (* b b))) (- (sqrt (+ (* (* -4 c) a) (* b b))) b))
34.0ms	f	@	-inf	((/ (+ n f) (- n f)) (+ (* (/ f n) (+ (* (/ 2 n) f) 2)) 1) (/ f n) (+ (* (/ 2 n) f) 2) (- (/ (neg n) (- f n)) (/ f (- f n))) (/ (neg n) (- f n)) (neg n) (- f n) (/ 2 n) (/ f (- f n)))
32.0ms	b	@	inf	((if (>= b 0) (/ (- (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (* 2 a)) (/ (* 2 c) (+ (neg b) (sqrt (- (* b b) (* (* 4 a) c)))))) (if (>= b 0) (* (/ (+ (sqrt (+ (* -4 (* c a)) (* b b))) b) a) -1/2) (/ (* 2 c) (- (sqrt (+ (* -4 (* c a)) (* b b))) b))) (>= b 0) (* (/ (+ (sqrt (+ (* -4 (* c a)) (* b b))) b) a) -1/2) (+ (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (if (>= b 0) (/ (- (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (* 2 a)) (/ (* 2 c) (+ (neg b) (sqrt (- (* b b) (* (* 4 a) c)))))) (/ (- (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (* 2 a)) (if (>= b 0) (* (/ 1/2 a) (- (neg b) (sqrt (- (* b b) (* (* 4 a) c))))) (/ (* 2 c) (- (sqrt (+ (* (* -4 c) a) (* b b))) b))) (* (/ 1/2 a) (- (neg b) (sqrt (- (* b b) (* (* 4 a) c))))) (/ 1/2 a) (* (+ (* (/ b c) -2) (* (/ a b) 2)) c) (/ (- (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (* 2 a)) (- (* b b) (* (* 4 a) c)) (+ (neg b) (/ (+ (* (* -4 c) a) (* b b)) (sqrt (+ (* (* -4 c) a) (* b b))))) (- (neg b) (/ (+ (* (* -4 c) a) (* b b)) (sqrt (+ (* (* -4 c) a) (* b b))))) (neg b) (sqrt (+ (* -4 (* c a)) (* b b))) (- (sqrt (+ (* -4 (* c a)) (* b b))) b) (+ (sqrt (+ (* -4 (* c a)) (* b b))) b) (/ (+ (sqrt (+ (* -4 (* c a)) (* b b))) b) a) (sqrt (- (* b b) (* (* 4 a) c))) (- (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (sqrt (+ (* (* -4 c) a) (* b b))) (- (sqrt (+ (* (* -4 c) a) (* b b))) b) (+ (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (sqrt (- (* b b) (* (* 4 a) c))) (- (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (/ (+ (* (* -4 c) a) (* b b)) (sqrt (+ (* (* -4 c) a) (* b b)))))
27.0ms	x	@	inf	((neg (log (- (/ 1 x) 1))) (log x) (neg (log (- (/ 1 x) 1))) (+ (log x) x) (neg (log (- (/ 1 x) 1))) (+ (* (+ (* 1/2 x) 1) x) (log x)) (+ (* 1/2 x) 1))

regimes774.0ms (1.4%)

Memory

-30.9MiB live, 1 154.7MiB allocated

Counts

422 → 88

Calls

26 calls:

171.0ms	b
107.0ms	x
52.0ms	a
43.0ms	c
33.0ms	(neg.f64 (-.f64 #s(literal 1 binary64) (*.f64 x x)))

Compiler

Compiled 998 to 832 computations (16.6% saved)

bsearch769.0ms (1.4%)

Memory

55.6MiB live, 686.4MiB allocated

Algorithm

37×	binary-search
2×	left-value

Stop Event

33×	narrow-enough
4×	predicate-same

Samples

401.0ms	2 992×	0	valid
38.0ms	366×	0	invalid
14.0ms	48×	2	valid

Compiler

Compiled 25 418 to 16 098 computations (36.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 300.0ms

ival-mult: 126.0ms (41.9% of total)

ival-div: 65.0ms (21.6% of total)

ival-add: 38.0ms (12.6% of total)

ival-sub: 24.0ms (8% of total)

ival-sqrt: 11.0ms (3.7% of total)

ival-neg: 8.0ms (2.7% of total)

ival-if: 7.0ms (2.3% of total)

ival-fabs: 6.0ms (2% of total)

ival->=: 5.0ms (1.7% of total)

ival-true: 3.0ms (1% of total)

exact: 3.0ms (1% of total)

ival-exp: 2.0ms (0.7% of total)

adjust: 1.0ms (0.3% of total)

ival-assert: 1.0ms (0.3% of total)

analyze468.0ms (0.9%)

Memory

35.2MiB live, 669.7MiB allocated

Algorithm

9×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
22.2%	22.2%	77.7%	0.1%	0%	0%	0%	1
29.4%	27.8%	66.6%	0.1%	0%	5.6%	0%	2
50%	44.4%	44.4%	0.1%	0%	11.1%	0%	3
59.7%	51.3%	34.7%	0.1%	0%	13.9%	0%	4
67.2%	56.9%	27.7%	0.1%	0%	15.3%	0%	5
74.4%	62.4%	21.5%	0.1%	0%	16%	0%	6
78.9%	64.9%	17.3%	0.1%	0%	17.7%	0%	7
80.8%	66.3%	15.8%	0.1%	0%	17.9%	0%	8
85.9%	69.9%	11.5%	0.1%	0%	18.5%	0%	9
88%	70.7%	9.7%	0.1%	0%	19.6%	0%	10
90%	72.1%	8%	0.1%	0%	19.8%	0%	11
92.3%	73.5%	6.2%	0.1%	0%	20.3%	0%	12

Compiler

Compiled 153 to 106 computations (30.7% saved)

start0.0ms (0%)

Memory: 0.6MiB live, 0.7MiB allocated

end0.0ms (0%)

Memory: 0.1MiB live, 0.1MiB allocated

sample12.8s (23.9%)

simplify9.7s (18.1%)

soundness7.0s (13.1%)

rewrite6.9s (12.9%)

localize5.1s (9.5%)

eval4.4s (8.3%)

preprocess1.6s (3.1%)

explain1.6s (3%)

prune1.6s (3%)

series806.0ms (1.5%)

regimes774.0ms (1.4%)

bsearch769.0ms (1.4%)

analyze468.0ms (0.9%)

start0.0ms (0%)

end0.0ms (0%)

Profiling