Metrics for Herbie run

Date:	Monday, October 14th, 2024
Commit:	01116aa6 on bhargav-log-space
Hostname:	nightly with Racket 8.10
Seed:	2024288
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample11.6min (64.6%)

Memory

27 078.0MiB live, 241 804.7MiB allocated

Samples

4.1min	287 695×	0	valid
2.1min	107 888×	1	valid
59.3s	3 057×	3	valid
50.1s	23 778×	2	valid
25.8s	14 391×	5	exit
7.3s	20 686×	0	invalid
5.0s	34 983×	0	exit
1.7s	11 209×	1	invalid
343.0ms	3 695×	1	exit
274.0ms	796×	2	invalid
247.0ms	29×	4	valid
16.0ms	6×	4	exit
3.0ms	1×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 7.2min

ival-mult: 1.5min (20.5% of total)

ival-pow2: 1.2min (16.6% of total)

ival-div: 46.0s (10.6% of total)

ival-sub: 42.1s (9.7% of total)

ival-cosu: 39.5s (9.1% of total)

ival-sqrt: 31.5s (7.3% of total)

ival-hypot: 22.7s (5.3% of total)

ival-pow: 21.2s (4.9% of total)

ival-sinu: 20.5s (4.7% of total)

ival-cos: 8.7s (2% of total)

adjust: 7.6s (1.8% of total)

ival-neg: 6.3s (1.5% of total)

ival-sin: 5.7s (1.3% of total)

ival-add: 4.6s (1.1% of total)

ival-exp: 4.3s (1% of total)

ival-<: 3.0s (0.7% of total)

ival-log: 3.0s (0.7% of total)

const: 1.2s (0.3% of total)

ival-atan2: 612.0ms (0.1% of total)

ival-tan: 494.0ms (0.1% of total)

exact: 398.0ms (0.1% of total)

ival-and: 363.0ms (0.1% of total)

ival-acos: 329.0ms (0.1% of total)

ival-true: 315.0ms (0.1% of total)

ival-atan: 291.0ms (0.1% of total)

ival-assert: 227.0ms (0.1% of total)

ival-cbrt: 216.0ms (0% of total)

ival-asin: 132.0ms (0% of total)

ival-fabs: 110.0ms (0% of total)

ival-<=: 108.0ms (0% of total)

ival-log1p: 107.0ms (0% of total)

ival-pi: 91.0ms (0% of total)

ival-==: 1.0ms (0% of total)

ival-or: 0.0ms (0% of total)

Bogosity

simplify1.6min (8.7%)

Memory

6 376.3MiB live, 24 925.3MiB allocated

Algorithm

245×	egg-herbie

Stop Event

326×	iter limit
157×	node limit
88×	saturated

Counts

36 840 → 36 522

analyze1.3min (7.3%)

Memory

3 175.1MiB live, 31 907.8MiB allocated

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
17.2%	13.7%	65.7%	20.6%	0%	0%	0%	1
25%	19.6%	58.5%	20.6%	0%	1.3%	0%	2
35.2%	26.6%	48.9%	20.6%	0%	3.8%	0%	3
42.3%	31.7%	43.1%	20.6%	0%	4.5%	0%	4
47.9%	35.6%	38.7%	20.6%	0%	5.1%	0%	5
51%	37.6%	36.1%	20.6%	0%	5.7%	0%	6
54.4%	39.7%	33.2%	20.6%	0%	6.5%	0%	7
56.2%	40.7%	31.8%	20.6%	0%	6.8%	0%	8
59%	42.5%	29.5%	20.6%	0%	7.4%	0%	9
60.3%	43.2%	28.4%	20.6%	0%	7.7%	0%	10
62.1%	44.3%	27%	20.6%	0%	8.1%	0%	11
63.6%	45.1%	25.8%	20.6%	0%	8.5%	0%	12

Compiler

Compiled 1 826 to 964 computations (47.2% saved)

rewrite59.1s (5.5%)

Memory

4 681.6MiB live, 24 908.5MiB allocated

Stop Event

221×	iter limit
107×	node limit
1×	saturated

Counts

1 695 → 69 522

eval54.4s (5.1%)

Memory: 8 383.6MiB live, 24 406.3MiB allocated
Compiler: Compiled 3 190 986 to 317 800 computations (90% saved)

localize26.7s (2.5%)

Memory

3 788.3MiB live, 9 999.4MiB allocated

Samples

11.9s	17 609×	0	valid
5.0s	7 421×	1	valid
1.3s	1 891×	2	valid
110.0ms	138×	5	exit
87.0ms	357×	0	invalid
56.0ms	62×	3	valid
53.0ms	102×	1	exit
10.0ms	68×	0	exit

Compiler

Compiled 50 780 to 6 691 computations (86.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 15.8s

ival-mult: 10.2s (64.3% of total)

ival-div: 1.3s (8.2% of total)

ival-add: 875.0ms (5.5% of total)

adjust: 750.0ms (4.7% of total)

ival-pow: 527.0ms (3.3% of total)

ival-exp: 414.0ms (2.6% of total)

ival-log: 371.0ms (2.3% of total)

ival-sub: 365.0ms (2.3% of total)

const: 337.0ms (2.1% of total)

ival-sqrt: 259.0ms (1.6% of total)

ival-neg: 130.0ms (0.8% of total)

exact: 74.0ms (0.5% of total)

ival-true: 48.0ms (0.3% of total)

ival-hypot: 44.0ms (0.3% of total)

ival-cbrt: 35.0ms (0.2% of total)

ival-sin: 26.0ms (0.2% of total)

ival-cos: 22.0ms (0.1% of total)

ival-log1p: 18.0ms (0.1% of total)

ival-pow2: 16.0ms (0.1% of total)

ival-assert: 16.0ms (0.1% of total)

ival-expm1: 12.0ms (0.1% of total)

ival-cosh: 9.0ms (0.1% of total)

ival-sinh: 5.0ms (0% of total)

ival-tanh: 2.0ms (0% of total)

soundness24.7s (2.3%)

Memory

378.3MiB live, 3 004.6MiB allocated

Stop Event

190×	iter limit
129×	node limit
22×	fuel
6×	done

Compiler

Compiled 12 918 to 6 986 computations (45.9% saved)

prune18.5s (1.7%)

Memory: 5 562.8MiB live, 11 201.6MiB allocated
Counts: 119 328 → 2 781
Compiler: Compiled 143 412 to 72 970 computations (49.1% saved)

regimes8.0s (0.7%)

Memory

2 879.6MiB live, 4 662.2MiB allocated

Counts

7 735 → 396

Calls

59 calls:

1.3s	b
1.2s	a
837.0ms	c
768.0ms	(/.f64 (+.f64 (neg.f64 b) (sqrt.f64 (-.f64 (.f64 b b) (.f64 (.f64 #s(literal 3 binary64) a) c)))) (.f64 #s(literal 3 binary64) a))
513.0ms	(*.f64 #s(literal 3 binary64) a)

Compiler

Compiled 3 837 to 3 825 computations (0.3% saved)

series5.8s (0.5%)

Memory

1 836.0MiB live, 3 315.7MiB allocated

Counts

1 695 → 36 840

Calls

606 calls:

Time	Variable		Point	Expression
94.0ms	a	@	-inf	((log (+ (exp a) (exp b))) (+ (/ b (+ (exp a) 1)) (log (+ 1 (exp a)))) (/ b (+ (exp a) 1)) (+ (exp a) 1) (log (+ (exp a) (exp b))) (log (+ 1 (exp a))) (exp a) (log (+ (exp a) (exp b))) (+ (exp a) (exp b)) (exp a) (exp b) (log (+ (exp a) (exp b))) (+ (exp a) (exp b)) (exp b) (log (/ 1 (+ (exp b) (exp a)))) (neg (log (/ 1 (+ (exp b) (exp a))))) (/ 1 (+ (exp b) (exp a))) (+ (exp b) (exp a)))
81.0ms	b	@	inf	((log (+ (exp a) (exp b))) (+ (exp a) (exp b)) (exp a) (exp b))
81.0ms	a	@	inf	((log (+ (exp a) (exp b))) (+ (exp a) (exp b)) (exp a) (exp b))
44.0ms	b	@	-inf	((/ 1 (/ (+ 1 (exp a)) b)) (log (+ (exp a) (exp b))) (+ (/ 1 (/ (+ 1 (exp a)) b)) (log (+ 1 (exp a)))) (/ (+ 1 (exp a)) b) (log (+ (exp a) (exp b))) (log (+ 1 (exp a))) (+ (* (+ (* 1/8 a) 1/2) a) (log 2)) (* (* a a) 1/8) (log (+ (exp a) (exp b))) (+ (/ b (+ (exp a) 1)) (log (+ 1 (exp a)))) (+ (* 1/2 b) (log 2)) (log 2) (log (+ (exp a) (exp b))) (+ (/ b (+ (exp a) 1)) (log (+ 1 (exp a)))) (+ (* (+ (* -1/4 b) 1/2) a) (+ (* 1/2 b) (log 2))) (+ (* -1/4 b) 1/2) (exp (- (log (+ 1 (exp a))) (log b))) (/ 1 (exp (- (log (+ 1 (exp a))) (log b)))) (log (+ (exp a) (exp b))) (+ (/ 1 (exp (- (log (+ 1 (exp a))) (log b)))) (log (+ 1 (exp a)))) (+ 1 (exp a)) (* a a) (- (log (+ 1 (exp a))) (log b)))
43.0ms	x	@	-inf	((/ (- (exp x) 1) (- (exp (* 2 x)) 1)) (log (/ (- (exp x) 1) (- (exp (* 2 x)) 1))) (neg (log (/ (- (exp x) 1) (- (exp (* 2 x)) 1)))) (- (neg (log (/ (- (exp x) 1) (- (exp (* 2 x)) 1)))) (* x y)) (- (log (+ 1 (exp x))) (* x y)) (* (neg y) x) (neg y) (- (log (+ 1 (exp x))) (* x y)) (log (+ 1 (exp x))) (+ 1 (exp x)) (* x y) (- (log (+ 1 (exp x))) (* x y)) (log (+ 1 (exp x))) (+ (* 1/2 x) (log 2)) (log 2) (- (log (+ 1 (exp x))) (* x y)) (log (+ 1 (exp x))) (exp x) (- (exp x) 1) (- (exp (* 2 x)) 1))

preprocess5.4s (0.5%)

Memory

1 553.2MiB live, 2 449.2MiB allocated

Algorithm

29×	egg-herbie

Stop Event

58×	iter limit
43×	saturated
15×	node limit

Compiler

Compiled 14 660 to 5 454 computations (62.8% saved)

explain5.0s (0.5%)

Memory

1 707.6MiB live, 2 590.4MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`+.f64`	`#f`	cancellation	1663	18
`-.f64`	`#f`	cancellation	727	1
`log.f64`	`#f`	sensitivity	568	1
`sqrt.f64`	`#f`	oflow-rescue	405	0
`exp.f64`	`#f`	sensitivity	169	16
`cbrt.f64`	`(cbrt.f64 (/.f64 g (*.f64 #s(literal 2 binary64) a)))`	oflow-rescue	32	0
↳	`(/.f64 g (*.f64 #s(literal 2 binary64) a))`	overflow	32
`cbrt.f64`	`(cbrt.f64 (/.f64 g (*.f64 #s(literal 2 binary64) a)))`	uflow-rescue	26	0
↳	`(/.f64 g (*.f64 #s(literal 2 binary64) a))`	underflow	26
`*.f64`	`#f`	*no**	23	0
`*.f64`	`#f`	*nu**	20	0
`-.f64`	`(-.f64 (log.f64 (+.f64 #s(literal 1 binary64) (exp.f64 x))) (*.f64 x y))`	oflow-right	14	0
`sqrt.f64`	`#f`	uflow-rescue	14	0
`/.f64`	`(/.f64 (.f64 a1 a2) (.f64 b1 b2))`	n/u	9	0
↳	`(*.f64 b1 b2)`	underflow	29
`/.f64`	`(/.f64 (.f64 a1 a2) (.f64 b1 b2))`	n/o	8	0
↳	`(*.f64 b1 b2)`	overflow	34
`/.f64`	`#f`	o/o	8	0
`/.f64`	`(/.f64 (.f64 a1 a2) (.f64 b1 b2))`	u/n	7	0
↳	`(*.f64 a1 a2)`	underflow	23
`/.f64`	`(/.f64 (.f64 a1 a2) (.f64 b1 b2))`	o/n	4	0
↳	`(*.f64 a1 a2)`	overflow	29
`/.f64`	`(/.f64 (.f64 a1 a2) (.f64 b1 b2))`	u/u	3	0
↳	`(*.f64 a1 a2)`	underflow	23
↳	`(*.f64 b1 b2)`	underflow	29
`log.f64`	`#f`	oflow-rescue	3	0
`log.f64`	`(log.f64 (+.f64 (exp.f64 a) (exp.f64 b)))`	uflow-rescue	2	0
↳	`(+.f64 (exp.f64 a) (exp.f64 b))`	underflow	2
↳	`(exp.f64 a)`	underflow	45
↳	`(exp.f64 b)`	underflow	66
`+.f64`	`(+.f64 (exp.f64 a) (exp.f64 b))`	nan-rescue	1	0
↳	`(exp.f64 a)`	overflow	2
↳	`(exp.f64 b)`	overflow	87
`+.f64`	`(+.f64 (exp.f64 x) (exp.f64 (neg.f64 x)))`	oflow-right	1	0

Confusion

	Predicted +	Predicted -
+	3356	36
-	220	3812

Precision

0.9384787472035794

Recall

0.9893867924528302

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	3356	21	15
-	220	18	3794

Precision?

0.9341632088520055

Recall?

0.9955778301886793

Freqs

test

number	freq
0	3848
1	3445
2	131

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	23	0	0
-	1	0	5

Precision?

0.9583333333333334

Recall?

1.0

Samples

696.0ms	10 232×	0	valid
624.0ms	3 708×	1	valid
343.0ms	917×	2	valid
2.0ms	8×	3	valid

Compiler

Compiled 11 737 to 4 984 computations (57.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.1s

ival-log: 181.0ms (16.2% of total)

ival-mult: 175.0ms (15.7% of total)

ival-exp: 172.0ms (15.4% of total)

ival-div: 131.0ms (11.7% of total)

adjust: 97.0ms (8.7% of total)

ival-sub: 91.0ms (8.1% of total)

ival-add: 90.0ms (8.1% of total)

ival-sqrt: 59.0ms (5.3% of total)

ival-neg: 35.0ms (3.1% of total)

ival-hypot: 19.0ms (1.7% of total)

ival-true: 15.0ms (1.3% of total)

ival-cos: 13.0ms (1.2% of total)

ival-sin: 12.0ms (1.1% of total)

exact: 10.0ms (0.9% of total)

ival-assert: 8.0ms (0.7% of total)

ival-log1p: 5.0ms (0.4% of total)

ival-cbrt: 3.0ms (0.3% of total)

ival-pow2: 0.0ms (0% of total)

ival-tan: 0.0ms (0% of total)

ival-sinu: 0.0ms (0% of total)

ival-cosu: 0.0ms (0% of total)

ival-pow: 0.0ms (0% of total)

ival-pi: 0.0ms (0% of total)

bsearch875.0ms (0.1%)

Memory

261.3MiB live, 338.1MiB allocated

Algorithm

76×	binary-search
71×	left-value

Stop Event

75×	narrow-enough
1×	predicate-same

Samples

293.0ms	4 104×	0	valid
64.0ms	307×	2	valid
59.0ms	389×	1	valid
39.0ms	438×	0	invalid
9.0ms	32×	3	valid
1.0ms	26×	0	exit

Compiler

Compiled 14 230 to 13 832 computations (2.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 306.0ms

ival-mult: 87.0ms (28.4% of total)

ival-div: 41.0ms (13.4% of total)

ival-sub: 34.0ms (11.1% of total)

ival-sqrt: 34.0ms (11.1% of total)

ival-add: 29.0ms (9.5% of total)

adjust: 19.0ms (6.2% of total)

ival-neg: 18.0ms (5.9% of total)

ival-exp: 13.0ms (4.2% of total)

ival-hypot: 9.0ms (2.9% of total)

ival-log: 6.0ms (2% of total)

ival-true: 5.0ms (1.6% of total)

exact: 5.0ms (1.6% of total)

ival-assert: 3.0ms (1% of total)

ival-log1p: 2.0ms (0.7% of total)

start3.0ms (0%)

Memory: 5.3MiB live, 5.2MiB allocated

end0.0ms (0%)

Memory: 0.3MiB live, 0.4MiB allocated

sample11.6min (64.6%)

simplify1.6min (8.7%)

analyze1.3min (7.3%)

rewrite59.1s (5.5%)

eval54.4s (5.1%)

localize26.7s (2.5%)

soundness24.7s (2.3%)

prune18.5s (1.7%)

regimes8.0s (0.7%)

series5.8s (0.5%)

preprocess5.4s (0.5%)

explain5.0s (0.5%)

bsearch875.0ms (0.1%)

start3.0ms (0%)

end0.0ms (0%)

Profiling