Metrics for Herbie run

Date:	Friday, September 27th, 2024
Commit:	064660f8 on bhargav-log-space
Hostname:	nightly with Racket 8.10
Seed:	2024271
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample52.9s (31.2%)

Memory

644.2MiB live, 46 046.2MiB allocated

Samples

21.3s	43 528×	1	valid
8.8s	109 750×	0	valid
8.8s	6 347×	5	exit
4.3s	11 842×	2	valid
1.0s	10 244×	1	exit
405.0ms	3 963×	0	invalid
135.0ms	1 439×	0	exit
2.0ms	1×	3	exit

Precisions

Click to see histograms. Total time spent on operations: 36.8s

adjust: 8.6s (23.5% of total)

const: 4.0s (11% of total)

ival-exp: 3.8s (10.2% of total)

ival-pow: 3.6s (9.8% of total)

ival-tan: 2.5s (6.8% of total)

ival-cos: 2.2s (6.1% of total)

ival-mult: 1.7s (4.6% of total)

ival-log: 1.2s (3.3% of total)

ival-sqrt: 1.0s (2.8% of total)

ival-sin: 959.0ms (2.6% of total)

ival-sinh: 943.0ms (2.6% of total)

ival-<=: 916.0ms (2.5% of total)

ival-add: 903.0ms (2.5% of total)

ival-fmod: 755.0ms (2% of total)

ival-div: 739.0ms (2% of total)

ival-sub: 679.0ms (1.8% of total)

ival-pow2: 675.0ms (1.8% of total)

ival-acos: 418.0ms (1.1% of total)

ival-==: 178.0ms (0.5% of total)

ival-neg: 153.0ms (0.4% of total)

ival-hypot: 153.0ms (0.4% of total)

ival-and: 119.0ms (0.3% of total)

ival-true: 105.0ms (0.3% of total)

exact: 81.0ms (0.2% of total)

ival-assert: 76.0ms (0.2% of total)

ival-<: 71.0ms (0.2% of total)

ival-atan: 45.0ms (0.1% of total)

ival-or: 41.0ms (0.1% of total)

ival->=: 28.0ms (0.1% of total)

ival->: 25.0ms (0.1% of total)

Bogosity

simplify24.9s (14.7%)

Memory

289.5MiB live, 14 140.0MiB allocated

Algorithm

136×	egg-herbie

Stop Event

175×	iter limit
71×	node limit
70×	saturated

Counts

16 248 → 15 919

soundness24.9s (14.7%)

Memory

165.4MiB live, 9 806.4MiB allocated

Stop Event

128×	iter limit
66×	node limit
13×	fuel
5×	unsound
4×	saturated
3×	done

Compiler

Compiled 6 138 to 3 529 computations (42.5% saved)

eval20.6s (12.1%)

Memory: -59.3MiB live, 13 654.7MiB allocated
Compiler: Compiled 1 315 793 to 125 966 computations (90.4% saved)

rewrite10.0s (5.9%)

Memory

47.1MiB live, 10 174.7MiB allocated

Stop Event

132×	iter limit
51×	node limit
7×	unsound
5×	saturated

Counts

807 → 34 064

localize8.5s (5%)

Memory

-180.5MiB live, 8 660.2MiB allocated

Samples

3.2s	3 227×	1	valid
2.1s	10 574×	0	valid
413.0ms	348×	1	invalid
375.0ms	484×	2	valid
186.0ms	684×	0	invalid
42.0ms	42×	3	valid
2.0ms	1×	5	exit

Compiler

Compiled 17 340 to 2 716 computations (84.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 5.1s

ival-mult: 1.6s (31.8% of total)

adjust: 680.0ms (13.4% of total)

ival-div: 356.0ms (7% of total)

ival-add: 321.0ms (6.3% of total)

ival-sin: 313.0ms (6.2% of total)

ival-cos: 303.0ms (6% of total)

ival-tan: 287.0ms (5.7% of total)

ival-sqrt: 263.0ms (5.2% of total)

ival-pow: 253.0ms (5% of total)

ival-sub: 233.0ms (4.6% of total)

const: 101.0ms (2% of total)

ival-pow2: 99.0ms (2% of total)

ival-neg: 61.0ms (1.2% of total)

ival-log: 54.0ms (1.1% of total)

ival-hypot: 46.0ms (0.9% of total)

ival-exp: 45.0ms (0.9% of total)

exact: 17.0ms (0.3% of total)

ival-true: 13.0ms (0.3% of total)

ival-assert: 7.0ms (0.1% of total)

regimes8.2s (4.8%)

Memory

-92.9MiB live, 8 083.3MiB allocated

Counts

3 424 → 172

Calls

48 calls:

1.1s	a
738.0ms	x
570.0ms	(tan.f64 (+.f64 y z))
405.0ms	b
389.0ms	y

Compiler

Compiled 1 806 to 2 194 computations (-21.5% saved)

series4.9s (2.9%)

Memory

-117.5MiB live, 5 360.7MiB allocated

Counts

807 → 16 248

Calls

354 calls:

Time	Variable		Point	Expression
382.0ms	x	@	0	((* (pow x 7/8) (sqrt (* (pow x 1/4) 2))) (pow x 7/8) (sqrt (* (pow x 1/4) 2)) (* (pow x 1/4) 2) (* (sqrt 2) x) (sqrt 2) (* (sqrt (* x 2)) (sqrt x)) (sqrt (* x 2)) (* x 2) (sqrt x) (sqrt (* 2 (sqrt (pow x 4)))) (* 2 (sqrt (pow x 4))) (sqrt (pow x 4)) (pow x 4) (sqrt (* 2 (pow (sqrt x) 4))) (* 2 (pow (sqrt x) 4)) (pow (sqrt x) 4) (pow x 1/4))
202.0ms	a	@	-inf	((* r (/ (sin b) (+ (* (sin b) (neg (sin a))) (* (cos b) (cos a))))) (/ (* r (sin b)) (+ (* (sin b) (neg (sin a))) (* (cos b) (cos a)))) (* r (sin b)) (sin b) (* r (/ (sin b) (cos (+ a b)))) (/ (sin b) (cos (+ a b))) (/ b (cos a)) (+ (* (* (* a a) b) 1/2) b) (/ (sin b) (/ (cos (+ a b)) r)) (/ (cos (+ a b)) r) (cos (+ a b)) (exp (log (cos (+ a b)))) (* r (/ (sin b) (+ (* (sin b) (neg (sin a))) (* (cos b) (cos a))))) (/ (* r (sin b)) (exp (log (cos (+ a b))))) (* r (/ (sin b) (+ (* (sin b) (neg (sin a))) (* (cos b) (cos a))))) (/ (* r (sin b)) (+ (* (cos a) (cos b)) (* (sin a) (neg (sin b))))) (* r (sin b)) (+ (* (* r (+ (* 1/120 (* b b)) -1/6)) (* b b)) r) (+ (* (sin b) (neg (sin a))) (* (cos b) (cos a))) (* (cos b) (cos a)) (* (* a a) b) (cos a) (log (cos (+ a b))) (cos (+ a b)) (* r (+ (* 1/120 (* b b)) -1/6)) (* (sin a) (neg (sin b))))
148.0ms	r	@	inf	((/ (* r (sin b)) (+ (* (cos a) (cos b)) (* (sin a) (neg (sin b))))) (* r (/ (sin b) (+ (* (sin b) (neg (sin a))) (* (cos b) (cos a))))) (* r (sin b)) (sin b) (* r (/ (sin b) (cos (+ a b)))) (/ (sin b) (cos (+ a b))) (/ b (cos a)) (cos a) (/ (sin b) (/ (cos (+ a b)) r)) (/ (cos (+ a b)) r) (cos (+ a b)) (pow (pow (* (sin b) r) -1) -1) (* (pow (cos (+ a b)) -1) (pow (pow (* (sin b) r) -1) -1)) (pow (cos (+ a b)) -1) (/ 1 (cos a)) (exp (- (log (* (neg r) (sin b))) (log (neg (cos (+ a b)))))) (- (log (* (neg r) (sin b))) (log (neg (cos (+ a b))))) (log (* (neg r) (sin b))) (* (neg r) (sin b)) (* (sin a) (neg (sin b))) (+ (* (cos a) (cos b)) (* (sin a) (neg (sin b)))) (pow (* (sin b) r) -1) (log (neg (cos (+ a b)))))
134.0ms	x	@	0	((+ (* (+ (* (+ (* (tan y) (tan z)) -1) (sin a)) (* (cos a) (+ (tan y) (tan z)))) (/ 1 (* (+ (* (neg (tan z)) (tan y)) 1) (cos a)))) x) (+ (* (+ (* (tan y) (tan z)) -1) (sin a)) (* (cos a) (+ (tan y) (tan z)))) (+ (* (tan y) (tan z)) -1) (tan y) (/ 1 (/ 1 (- (tan (+ z y)) (- (tan a) x)))) (/ 1 (- (tan (+ z y)) (- (tan a) x))) (/ 1 x) (+ x (- (tan (+ y z)) (tan a))) (- (+ (/ (sin z) (cos z)) x) (/ (sin a) (cos a))) (- x (/ (sin a) (cos a))) (/ (sin a) (cos a)) (exp (log (- (tan (+ y z)) (- (tan a) x)))) (log (- (tan (+ y z)) (- (tan a) x))) (- (tan (+ y z)) (- (tan a) x)) (tan (+ y z)) (+ (* (neg (+ (tan z) (tan y))) (/ 1 (- (* (tan y) (tan z)) 1))) (- x (tan a))) (- (* (tan y) (tan z)) 1) (neg (+ (tan z) (tan y))) (+ (tan z) (tan y)) (/ 1 (* (+ (* (neg (tan z)) (tan y)) 1) (cos a))) (+ (* (neg (tan z)) (tan y)) 1) (* (tan y) (tan z)) (/ 1 (- (* (tan y) (tan z)) 1)))
106.0ms	a	@	inf	((/ (* r (sin b)) (+ (* (cos a) (cos b)) (* (sin a) (neg (sin b))))) (* r (/ (sin b) (+ (* (sin b) (neg (sin a))) (* (cos b) (cos a))))) (* r (sin b)) (sin b) (* r (/ (sin b) (cos (+ a b)))) (/ (sin b) (cos (+ a b))) (/ b (cos a)) (cos a) (/ (sin b) (/ (cos (+ a b)) r)) (/ (cos (+ a b)) r) (cos (+ a b)) (pow (pow (* (sin b) r) -1) -1) (* (pow (cos (+ a b)) -1) (pow (pow (* (sin b) r) -1) -1)) (pow (cos (+ a b)) -1) (/ 1 (cos a)) (exp (- (log (* (neg r) (sin b))) (log (neg (cos (+ a b)))))) (- (log (* (neg r) (sin b))) (log (neg (cos (+ a b))))) (log (* (neg r) (sin b))) (* (neg r) (sin b)) (* (sin a) (neg (sin b))) (+ (* (cos a) (cos b)) (* (sin a) (neg (sin b)))) (pow (* (sin b) r) -1) (log (neg (cos (+ a b)))))

prune4.4s (2.6%)

Memory: 35.1MiB live, 7 611.9MiB allocated
Counts: 58 990 → 1 541
Compiler: Compiled 51 056 to 31 867 computations (37.6% saved)

analyze3.8s (2.2%)

Memory

134.2MiB live, 4 557.9MiB allocated

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
28.8%	21.3%	52.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.2%	0%	6
71.1%	51.1%	20.8%	26.3%	0%	1.9%	0%	7
72.1%	51.6%	20%	26.3%	0%	2.1%	0%	8
74.4%	53%	18.2%	26.3%	0%	2.5%	0%	9
75.8%	53.9%	17.2%	26.3%	0%	2.6%	0%	10
76.6%	54.3%	16.6%	26.3%	0%	2.8%	0%	11
77.3%	54.8%	16.1%	26.3%	0%	2.9%	0%	12

Compiler

Compiled 279 to 216 computations (22.6% saved)

preprocess2.7s (1.6%)

Memory

57.7MiB live, 2 968.6MiB allocated

Algorithm

16×	egg-herbie

Stop Event

31×	saturated
30×	iter limit
3×	node limit

Compiler

Compiled 9 310 to 4 824 computations (48.2% saved)

explain2.4s (1.4%)

Memory

-54.2MiB live, 2 030.4MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`cos.f64`	`#f`	sensitivity	527	0
`-.f64`	`#f`	cancellation	509	2
`sqrt.f64`	`#f`	oflow-rescue	452	0
`/.f64`	`(/.f64 (-.f64 x lo) (-.f64 hi lo))`	n/o	255	0
↳	`(-.f64 hi lo)`	overflow	256
`sqrt.f64`	`#f`	uflow-rescue	215	0
`tan.f64`	`(tan.f64 (+.f64 y z))`	sensitivity	196	0
`+.f64`	`#f`	nan-rescue	165	0
`pow.f64`	`(pow.f64 l (exp.f64 w))`	sensitivity	133	8
`exp.f64`	`(exp.f64 (neg.f64 w))`	sensitivity	1	0
`/.f64`	`(/.f64 (-.f64 x lo) (-.f64 hi lo))`	o/o	1	0
↳	`(-.f64 x lo)`	overflow	1
↳	`(-.f64 hi lo)`	overflow	256
`cos.f64`	`(cos.f64 (*.f64 #s(literal 2 binary64) x))`	cancelation	1	0

Confusion

	Predicted +	Predicted -
+	1592	314
-	748	1442

Precision

0.6803418803418804

Recall

0.8352570828961176

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	1592	1	313
-	748	8	1434

Precision?

0.6781609195402298

Recall?

0.835781741867786

Freqs

test

number	freq
0	1756
1	2228
2	109
3	3

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	14	0	1
-	0	0	1

Precision?

1.0

Recall?

0.9333333333333333

Samples

1.0s	6 104×	0	valid
432.0ms	1 854×	1	valid
41.0ms	234×	2	valid

Compiler

Compiled 1 630 to 629 computations (61.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 599.0ms

ival-mult: 105.0ms (17.5% of total)

ival-tan: 103.0ms (17.2% of total)

ival-cos: 83.0ms (13.9% of total)

ival-sin: 51.0ms (8.5% of total)

ival-sqrt: 43.0ms (7.2% of total)

adjust: 40.0ms (6.7% of total)

ival-div: 38.0ms (6.3% of total)

ival-add: 36.0ms (6% of total)

ival-sub: 28.0ms (4.7% of total)

ival-pow2: 25.0ms (4.2% of total)

ival-hypot: 14.0ms (2.3% of total)

ival-pow: 9.0ms (1.5% of total)

ival-exp: 7.0ms (1.2% of total)

ival-true: 7.0ms (1.2% of total)

ival-assert: 4.0ms (0.7% of total)

ival-neg: 3.0ms (0.5% of total)

exact: 2.0ms (0.3% of total)

bsearch1.5s (0.9%)

Memory

79.9MiB live, 1 013.1MiB allocated

Algorithm

44×	binary-search
12×	left-value

Stop Event

44×	narrow-enough

Samples

547.0ms	1 850×	0	valid
414.0ms	1 382×	1	valid

Compiler

Compiled 7 886 to 8 133 computations (-3.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 349.0ms

ival-tan: 132.0ms (37.8% of total)

ival-cos: 43.0ms (12.3% of total)

ival-add: 38.0ms (10.9% of total)

ival-mult: 31.0ms (8.9% of total)

adjust: 29.0ms (8.3% of total)

ival-sin: 28.0ms (8% of total)

ival-div: 11.0ms (3.1% of total)

ival-sub: 9.0ms (2.6% of total)

ival-pow: 7.0ms (2% of total)

ival-pow2: 7.0ms (2% of total)

ival-exp: 6.0ms (1.7% of total)

ival-sqrt: 3.0ms (0.9% of total)

ival-true: 3.0ms (0.9% of total)

ival-neg: 2.0ms (0.6% of total)

ival-assert: 1.0ms (0.3% of total)

exact: 0.0ms (0% of total)

start1.0ms (0%)

Memory: 1.2MiB live, 1.2MiB allocated

end0.0ms (0%)

Memory: 0.3MiB live, 0.3MiB allocated

sample52.9s (31.2%)

simplify24.9s (14.7%)

soundness24.9s (14.7%)

eval20.6s (12.1%)

rewrite10.0s (5.9%)

localize8.5s (5%)

regimes8.2s (4.8%)

series4.9s (2.9%)

prune4.4s (2.6%)

analyze3.8s (2.2%)

preprocess2.7s (1.6%)

explain2.4s (1.4%)

bsearch1.5s (0.9%)

start1.0ms (0%)

end0.0ms (0%)

Profiling