Metrics for Herbie run

Date:	Wednesday, November 27th, 2024
Commit:	a25f782f on bhargav-double-double
Hostname:	nightly with Racket 8.10
Seed:	2024332
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample5.9min (18.9%)

Memory

728.0MiB live, 339 514.7MiB allocated

Samples

3.4min	2 147 121×	0	valid
24.8s	67 565×	1	valid
11.2s	64 529×	0	invalid
1.6s	5 597×	2	valid
1.1s	1 342×	5	exit
598.0ms	1 737×	1	invalid
287.0ms	580×	3	valid
189.0ms	390×	4	exit
3.0ms	26×	1	exit
0.0ms	1×	4	valid

Precisions

Click to see histograms. Total time spent on operations: 2.6min

ival-mult: 49.9s (32.1% of total)

ival-sub: 23.8s (15.3% of total)

ival-add: 20.3s (13.1% of total)

ival-div: 19.4s (12.5% of total)

ival-log: 10.5s (6.8% of total)

const: 6.3s (4% of total)

ival-sqrt: 6.2s (4% of total)

ival-sin: 4.5s (2.9% of total)

ival-cos: 3.6s (2.3% of total)

adjust: 3.5s (2.3% of total)

ival-exp: 1.9s (1.2% of total)

ival-true: 1.7s (1.1% of total)

ival-assert: 1.1s (0.7% of total)

exact: 1.0s (0.7% of total)

ival-cosh: 678.0ms (0.4% of total)

ival-acos: 313.0ms (0.2% of total)

ival-tan: 253.0ms (0.2% of total)

ival-fabs: 224.0ms (0.1% of total)

ival-hypot: 185.0ms (0.1% of total)

ival-sinh: 164.0ms (0.1% of total)

ival-tanh: 135.0ms (0.1% of total)

Bogosity

simplify5.9min (18.9%)

Memory

3 372.5MiB live, 246 054.0MiB allocated

Algorithm

2 167×

egg-herbie

Stop Event

2 823×	iter limit
1 248×	node limit
943×	saturated

Counts

73 788 → 72 621

soundness5.2min (16.8%)

Memory

178.3MiB live, 150 764.8MiB allocated

Stop Event

1 512×	iter limit
1 022×	node limit
151×	fuel
118×	done
25×	saturated
3×	unsound

Compiler

Compiled 227 806 to 87 375 computations (61.6% saved)

rewrite4.1min (13%)

Memory

-123.2MiB live, 206 679.8MiB allocated

Stop Event

1 937×	iter limit
923×	node limit
22×	saturated
18×	unsound

Counts

11 565 → 496 257

eval2.0min (6.3%)

Memory: -737.2MiB live, 126 446.3MiB allocated
Compiler: Compiled 18 091 424 to 1 880 344 computations (89.6% saved)

localize1.8min (5.7%)

Memory

-1 197.2MiB live, 106 333.8MiB allocated

Samples

59.7s	223 292×	0	valid
11.3s	10 878×	1	valid
3.3s	2 766×	2	valid
1.7s	4 122×	0	invalid
505.0ms	411×	2	exit
435.0ms	150×	5	exit
434.0ms	1 000×	0	exit
287.0ms	210×	3	valid
193.0ms	106×	1	exit
8.0ms	6×	3	exit
4.0ms	3×	4	valid

Compiler

Compiled 305 172 to 48 478 computations (84.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 53.2s

ival-mult: 17.7s (33.3% of total)

ival-div: 10.0s (18.7% of total)

ival-add: 7.6s (14.3% of total)

ival-sub: 3.8s (7.1% of total)

const: 2.9s (5.5% of total)

adjust: 2.1s (3.9% of total)

ival-log: 2.0s (3.7% of total)

ival-pow: 1.6s (3% of total)

ival-cos: 1.4s (2.6% of total)

ival-neg: 1.0s (1.9% of total)

ival-sqrt: 739.0ms (1.4% of total)

ival-sin: 706.0ms (1.3% of total)

ival-exp: 514.0ms (1% of total)

ival-pow2: 225.0ms (0.4% of total)

exact: 222.0ms (0.4% of total)

ival-true: 204.0ms (0.4% of total)

ival-log1p: 142.0ms (0.3% of total)

ival-assert: 100.0ms (0.2% of total)

ival-tan: 80.0ms (0.2% of total)

ival-fabs: 70.0ms (0.1% of total)

ival-hypot: 51.0ms (0.1% of total)

ival-expm1: 41.0ms (0.1% of total)

ival-cosh: 22.0ms (0% of total)

ival-sinh: 16.0ms (0% of total)

ival-tanh: 14.0ms (0% of total)

ival-acos: 14.0ms (0% of total)

regimes1.5min (4.8%)

Memory

-1 120.7MiB live, 94 793.2MiB allocated

Counts

35 905 → 4 711

Calls

511 calls:

11.7s	x
11.0s	y
10.4s	z
6.4s	t
3.6s	a

Compiler

Compiled 38 355 to 58 020 computations (-51.3% saved)

explain1.2min (3.8%)

Memory

-1 188.1MiB live, 76 179.3MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`log.f64`	`#f`	sensitivity	1572	1
`/.f64`	`#f`	o/n	1184	0
`sqrt.f64`	`#f`	oflow-rescue	748	0
`/.f64`	`#f`	o/o	576	0
`-.f64`	`#f`	cancellation	558	7
`*.f64`	`#f`	*no**	523	0
`cos.f64`	`#f`	sensitivity	480	0
`+.f64`	`#f`	nan-rescue	450	0
`-.f64`	`#f`	nan-rescue	404	0
`+.f64`	`#f`	cancellation	327	1
`/.f64`	`#f`	n/o	320	0
`/.f64`	`#f`	u/n	303	0
`sin.f64`	`#f`	sensitivity	224	0
`/.f64`	`#f`	n/u	154	0
`tan.f64`	`(tan.f64 (/.f64 x (*.f64 y #s(literal 2 binary64))))`	sensitivity	134	0
`*.f64`	`#f`	*nu**	133	0
`log.f64`	`#f`	oflow-rescue	74	0
`log.f64`	`#f`	uflow-rescue	73	0
`sqrt.f64`	`#f`	uflow-rescue	59	0
`/.f64`	`#f`	u/u	56	0
`sin.f64`	`(sin.f64 (/.f64 x (*.f64 y #s(literal 2 binary64))))`	oflow-rescue	35	0
↳	`(/.f64 x (*.f64 y #s(literal 2 binary64)))`	overflow	35
`exp.f64`	`#f`	sensitivity	32	3
`*.f64`	`#f`	*ou**	2	0
`*.f64`	`(.f64 (-.f64 (.f64 t y2) (.f64 y y3)) (-.f64 (.f64 y4 c) (*.f64 y5 a)))`	*uo**	1	0
↳	`(*.f64 t y2)`	underflow	20
↳	`(*.f64 y y3)`	underflow	35
↳	`(-.f64 (.f64 t y2) (.f64 y y3))`	underflow	5
↳	`(*.f64 y4 c)`	overflow	35
↳	`(-.f64 (.f64 y4 c) (.f64 y5 a))`	overflow	55
↳	`(*.f64 y5 a)`	overflow	24

Confusion

	Predicted +	Predicted -
+	5994	207
-	1711	60952

Precision

0.7779364049318624

Recall

0.9666182873730044

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5994	3	204
-	1711	12	60940

Precision?

0.7768134715025907

Recall?

0.9671020803096275

Freqs

test

number	freq
0	61159
1	7061
2	590
3	39
4	12
5	2
6	1

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	137	0	0
-	1	0	131

Precision?

0.9927536231884058

Recall?

1.0

Samples

14.8s	130 662×	0	valid
1.8s	5 862×	1	valid
841.0ms	1 130×	2	valid
19.0ms	70×	3	valid
1.0ms	4×	5	exit

Compiler

Compiled 44 884 to 15 585 computations (65.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 10.4s

ival-mult: 2.6s (24.9% of total)

ival-add: 2.3s (22% of total)

ival-sub: 1.4s (13.7% of total)

ival-log: 1.0s (9.9% of total)

ival-div: 973.0ms (9.3% of total)

const: 455.0ms (4.4% of total)

adjust: 401.0ms (3.8% of total)

ival-cos: 259.0ms (2.5% of total)

ival-sqrt: 215.0ms (2.1% of total)

ival-sin: 179.0ms (1.7% of total)

ival-tanh: 170.0ms (1.6% of total)

ival-exp: 129.0ms (1.2% of total)

ival-true: 126.0ms (1.2% of total)

exact: 65.0ms (0.6% of total)

ival-assert: 59.0ms (0.6% of total)

ival-tan: 12.0ms (0.1% of total)

ival-cosh: 11.0ms (0.1% of total)

ival-fabs: 11.0ms (0.1% of total)

ival-sinh: 9.0ms (0.1% of total)

ival-hypot: 9.0ms (0.1% of total)

ival-acos: 4.0ms (0% of total)

preprocess1.2min (3.8%)

Memory

1 136.4MiB live, 54 904.0MiB allocated

Algorithm

269×	egg-herbie

Stop Event

538×	iter limit
394×	saturated
144×	node limit

Compiler

Compiled 348 620 to 65 762 computations (81.1% saved)

series52.9s (2.8%)

Memory

199.8MiB live, 54 973.7MiB allocated

Counts

11 565 → 73 788

Calls

9027 calls:

Time	Variable		Point	Expression
514.0ms	x	@	0	((- (* x (neg (log (/ y x)))) z) (* x (neg (log (/ y x)))) (neg (log (/ y x))) (log (/ y x)) (- (* x (log (/ x y))) z) (neg z) (- (* x (- (log (neg x)) (log (neg y)))) z) (* x (- (log (neg x)) (log (neg y)))) (- (log (neg x)) (log (neg y))) (log (neg x)) (* (+ (* (log (/ x y)) x) z) (* (+ (* (log (/ x y)) x) (neg z)) (pow (+ (* (log (/ x y)) x) z) -1))) (* (+ (* (log (/ x y)) x) (neg z)) (pow (+ (* (log (/ x y)) x) z) -1)) (+ (* (log (/ x y)) x) z) (log (/ x y)) (- (* x (/ (- (pow (log x) 3) (pow (log y) 3)) (+ (* (log y) (log (* y x))) (pow (log x) 2)))) z) (* x (/ (- (pow (log x) 3) (pow (log y) 3)) (+ (* (log y) (log (* y x))) (pow (log x) 2)))) (/ (- (pow (log x) 3) (pow (log y) 3)) (+ (* (log y) (log (* y x))) (pow (log x) 2))) (- (pow (log x) 3) (pow (log y) 3)) (log (neg y)) (neg x) (neg y) (log x) (log y) (log (* y x)))
480.0ms	x	@	inf	((+ (+ (+ (+ (+ (* x (log y)) z) t) a) (* (- b 1/2) (log c))) (* y i)) (+ (+ (+ (+ (* x (log y)) z) t) a) (* (- b 1/2) (log c))) (+ (* x (log y)) z) (+ (+ (+ (* x (log y)) z) t) a) (* x (log y)) (* (- b 1/2) (log c)))
336.0ms	t	@	inf	((- (/ (+ (* (* y x) 9) b) z) (* (* t a) 4)) (/ (+ (- (* (* x 9) y) (* (* (* z 4) t) a)) b) (* z c)) (+ (* (* (/ x (* c z)) 9) y) (+ (* (/ (* a t) c) -4) (/ b (* c z)))) (+ (* (* -4 a) (/ t c)) (/ (+ (* (* (/ x c) -9) y) (/ (neg b) c)) (neg z))) (/ (+ (- (* (* x 9) y) (* (* (* z 4) t) a)) b) (* z c)) (* (* -4 t) (/ a c)) (* -4 t) (/ a c) (/ (+ (- (* (* x 9) y) (* (* (* z 4) t) a)) b) (* z c)) (+ (- (* (* x 9) y) (* (* (* z 4) t) a)) b) (* (+ (* 9 x) (/ (+ (* -4 (* (* t z) a)) b) y)) y) (+ (* 9 x) (/ (+ (* -4 (* (* t z) a)) b) y)) (/ (+ (- (* (* x 9) y) (* (* (* z 4) t) a)) b) (* z c)) (/ (* (* (/ y c) 9) x) z) (* (* (/ y c) 9) x) (* (/ y c) 9) (* (neg x) (/ -1 z)) (/ (+ (- (* (* x 9) y) (* (* (* z 4) t) a)) b) (* z c)) (* (* (/ y c) 9) (* (neg x) (/ -1 z))) (/ (- (/ (+ (* (* y x) 9) b) z) (* (* t a) 4)) c) (/ (+ (* (* y x) 9) b) z) (+ (* (* y x) 9) b))
295.0ms	x	@	0	((/ (* (cosh x) (/ y x)) z) (* (cosh x) (/ y x)) (* (/ (+ (* (+ (* (+ (* 1/720 (* x x)) 1/24) (* x x)) 1/2) (* x x)) 1) x) y) (+ (* (+ (* (+ (* 1/720 (* x x)) 1/24) (* x x)) 1/2) (* x x)) 1) (/ (* (cosh x) (/ y x)) z) (* z x) (/ y (* z x)) (/ (* (cosh x) (/ y x)) z) (* (+ (* 1/2 x) (/ 1 x)) (/ y z)) (+ (* 1/2 x) (/ 1 x)) (/ 1 x) (/ (* (cosh x) (/ y x)) z) (* (cosh x) (/ y x)) (cosh x) (+ (* (* x x) 1/2) 1) (/ (+ (* (+ (* 1/24 (* x x)) 1/2) (* x x)) 1) x) (/ (* (cosh x) (/ y x)) z) (* (cosh x) (/ y x)) (* (/ (+ (* (+ (* 1/24 (* x x)) 1/2) (* x x)) 1) x) y) (/ (+ (* (+ (* (+ (* 1/720 (* x x)) 1/24) (* x x)) 1/2) (* x x)) 1) x) (/ y z) (* x x))
245.0ms	z	@	0	((+ (/ (* 60 (- x y)) (- z t)) (* a 120)) (/ (* 60 (- x y)) (- z t)) (* 60 (- x y)) (- x y) (* a 120))

prune41.9s (2.2%)

Memory: -1 202.1MiB live, 52 952.1MiB allocated
Counts: 522 689 → 13 400
Compiler: Compiled 808 820 to 449 559 computations (44.4% saved)

bsearch36.7s (2%)

Memory

-61.7MiB live, 33 103.1MiB allocated

Algorithm

1 522×	binary-search
1 110×	left-value

Stop Event

1 491×	narrow-enough
29×	predicate-same
2×	predicate-failed

Samples

19.1s	124 124×	0	valid
1.1s	3 282×	1	valid
246.0ms	3 280×	0	invalid
21.0ms	110×	2	valid
3.0ms	12×	1	invalid
1.0ms	4×	3	valid

Compiler

Compiled 924 774 to 664 455 computations (28.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 13.8s

ival-mult: 5.8s (42.3% of total)

ival-sub: 3.1s (22.1% of total)

ival-add: 1.7s (12.5% of total)

ival-div: 812.0ms (5.9% of total)

ival-log: 707.0ms (5.1% of total)

const: 517.0ms (3.7% of total)

ival-sin: 287.0ms (2.1% of total)

ival-cos: 279.0ms (2% of total)

ival-sqrt: 170.0ms (1.2% of total)

adjust: 124.0ms (0.9% of total)

ival-true: 97.0ms (0.7% of total)

ival-exp: 78.0ms (0.6% of total)

ival-assert: 51.0ms (0.4% of total)

exact: 46.0ms (0.3% of total)

ival-cosh: 10.0ms (0.1% of total)

ival-sinh: 7.0ms (0.1% of total)

ival-tanh: 4.0ms (0% of total)

analyze19.2s (1%)

Memory

58.7MiB live, 20 795.8MiB allocated

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.8%	46.8%	53.1%	0.1%	0%	0%	0%	1
50.5%	50.1%	49.2%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.2%	68.2%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.3%	23%	0.1%	0%	4.6%	0%	6
79.8%	75.6%	19.1%	0.1%	0%	5.1%	0%	7
81.7%	77%	17.3%	0.1%	0%	5.6%	0%	8
84.3%	79.3%	14.7%	0.1%	0%	5.9%	0%	9
85.9%	80.5%	13.2%	0.1%	0%	6.2%	0%	10
88.5%	82.8%	10.8%	0.1%	0%	6.2%	0%	11
89.6%	83.6%	9.8%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 3 462 to 2 977 computations (14% saved)

start33.0ms (0%)

Memory: -24.2MiB live, 15.1MiB allocated

end2.0ms (0%)

Memory: 3.7MiB live, 3.6MiB allocated

sample5.9min (18.9%)

simplify5.9min (18.9%)

soundness5.2min (16.8%)

rewrite4.1min (13%)

eval2.0min (6.3%)

localize1.8min (5.7%)

regimes1.5min (4.8%)

explain1.2min (3.8%)

preprocess1.2min (3.8%)

series52.9s (2.8%)

prune41.9s (2.2%)

bsearch36.7s (2%)

analyze19.2s (1%)

start33.0ms (0%)

end2.0ms (0%)

Profiling