Metrics for Herbie run

Date:	Sunday, December 8th, 2024
Commit:	393f01df on no-soundiness
Hostname:	nightly with Racket 8.10
Seed:	2024343
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default
Memory:	123 884.1 MB

sample43.6s (34.7%)

Memory

638.8MiB live, 44 953.8MiB allocated

Samples

10.1s	43 519×	1	valid
9.4s	109 906×	0	valid
8.8s	6 153×	5	exit
4.5s	11 695×	2	valid
1.1s	10 031×	1	exit
501.0ms	3 959×	0	invalid
133.0ms	1 401×	0	exit

Precisions

Click to see histograms. Total time spent on operations: 27.3s

ival-exp: 3.8s (14% of total)

ival-pow: 3.3s (12.2% of total)

ival-cos: 2.2s (8.1% of total)

const: 2.2s (8.1% of total)

adjust: 2.1s (7.8% of total)

ival-mult: 1.8s (6.4% of total)

ival-tan: 1.5s (5.5% of total)

ival-log: 1.4s (5.1% of total)

ival-<=: 1.2s (4.5% of total)

ival-sqrt: 1.0s (3.8% of total)

ival-sub: 982.0ms (3.6% of total)

ival-sinh: 891.0ms (3.3% of total)

ival-fmod: 840.0ms (3.1% of total)

ival-add: 725.0ms (2.7% of total)

ival-sin: 721.0ms (2.6% of total)

ival-div: 663.0ms (2.4% of total)

ival-acos: 440.0ms (1.6% of total)

ival-pow2: 403.0ms (1.5% of total)

ival-hypot: 183.0ms (0.7% of total)

ival-neg: 178.0ms (0.7% of total)

ival-and: 117.0ms (0.4% of total)

ival-true: 93.0ms (0.3% of total)

ival-==: 81.0ms (0.3% of total)

exact: 75.0ms (0.3% of total)

ival-assert: 69.0ms (0.3% of total)

ival-<: 64.0ms (0.2% of total)

ival-atan: 54.0ms (0.2% of total)

ival-or: 38.0ms (0.1% of total)

ival->=: 29.0ms (0.1% of total)

ival->: 24.0ms (0.1% of total)

Bogosity

simplify19.1s (15.2%)

Memory

-60.0MiB live, 17 985.3MiB allocated

Algorithm

160×	egg-herbie

Stop Event

206×	iter limit
112×	node limit
52×	saturated

Counts

3 622 → 3 562

derivations12.3s (9.8%)

Memory

181.6MiB live, 7 589.6MiB allocated

Stop Event

138×	iter limit
68×	node limit
13×	fuel
8×	unsound
7×	done
6×	saturated

Compiler

Compiled 3 650 to 972 computations (73.4% saved)

rewrite12.2s (9.7%)

Memory

358.2MiB live, 11 625.4MiB allocated

Stop Event

168×	iter limit
54×	node limit
14×	unsound
5×	saturated

Counts

982 → 25 719

localize10.9s (8.7%)

Memory

145.4MiB live, 12 002.1MiB allocated

Samples

5.0s	5 560×	1	valid
2.0s	10 009×	0	valid
1.6s	1 499×	2	valid
149.0ms	412×	1	exit
62.0ms	414×	0	invalid
16.0ms	26×	3	valid

Compiler

Compiled 12 082 to 1 806 computations (85.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 6.9s

ival-mult: 1.3s (18.7% of total)

ival-cos: 686.0ms (9.9% of total)

ival-div: 681.0ms (9.9% of total)

adjust: 677.0ms (9.8% of total)

ival-add: 530.0ms (7.7% of total)

ival-sin: 464.0ms (6.7% of total)

ival-pow: 422.0ms (6.1% of total)

ival-sub: 327.0ms (4.7% of total)

ival-tan: 263.0ms (3.8% of total)

ival-log: 261.0ms (3.8% of total)

ival-pow2: 224.0ms (3.2% of total)

const: 224.0ms (3.2% of total)

ival-sqrt: 202.0ms (2.9% of total)

ival-exp: 174.0ms (2.5% of total)

ival-sinh: 126.0ms (1.8% of total)

ival-cosh: 79.0ms (1.1% of total)

ival-acos: 60.0ms (0.9% of total)

ival-fmod: 54.0ms (0.8% of total)

ival-neg: 41.0ms (0.6% of total)

ival-asin: 30.0ms (0.4% of total)

ival-hypot: 25.0ms (0.4% of total)

exact: 17.0ms (0.2% of total)

ival-pi: 14.0ms (0.2% of total)

ival-true: 14.0ms (0.2% of total)

ival-assert: 7.0ms (0.1% of total)

ival-fabs: 4.0ms (0.1% of total)

ival-atan: 1.0ms (0% of total)

eval5.6s (4.5%)

Memory: -260.2MiB live, 6 939.1MiB allocated
Compiler: Compiled 1 254 161 to 120 688 computations (90.4% saved)

regimes5.0s (3.9%)

Memory

42.0MiB live, 5 326.9MiB allocated

Counts

2 959 → 163

Calls

53 calls:

743.0ms	x
404.0ms	a
361.0ms	z
262.0ms	b
260.0ms	r

Compiler

Compiled 1 667 to 1 885 computations (-13.1% saved)

analyze3.8s (3.1%)

Memory

88.4MiB live, 3 701.7MiB allocated

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
28.8%	21.3%	52.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.2%	0%	6
71.1%	51.1%	20.8%	26.3%	0%	1.9%	0%	7
72.1%	51.6%	20%	26.3%	0%	2.1%	0%	8
74.4%	53%	18.2%	26.3%	0%	2.5%	0%	9
75.8%	53.9%	17.2%	26.3%	0%	2.6%	0%	10
76.6%	54.3%	16.6%	26.3%	0%	2.8%	0%	11
77.3%	54.8%	16.1%	26.3%	0%	2.9%	0%	12

Compiler

Compiled 279 to 216 computations (22.6% saved)

series3.5s (2.8%)

Memory

-202.1MiB live, 3 170.9MiB allocated

Counts

982 → 3 622

Calls

390 calls:

Time	Variable		Point	Expression
655.0ms	x	@	0	((sqrt (* (* 2 x) x)) (* (* 2 x) x) (* 2 x))
325.0ms	x	@	0	((- (sin x) x) (neg x) (- (sin x) x) (* (- (* (* x x) 1/120) 1/6) (pow x 3)) (- (* (* x x) 1/120) 1/6) (* (* x x) 1/120) (- (sin x) x) (* (pow x 3) -1/6) (pow x 3) (/ (pow (- (sin x) x) 2) (- (sin x) x)) (pow (- (sin x) x) 2) (- (sin x) x) (sin x))
103.0ms	a	@	inf	((/ (* r (sin b)) (+ (* (cos b) (cos a)) (* (neg (sin a)) (sin b)))) (* r (sin b)) (sin b) (+ (* (cos b) (cos a)) (* (neg (sin a)) (sin b))) (/ (* r (sin b)) (cos (+ a b))) (* (/ r (cos a)) b) (/ r (cos a)) (cos a) (* (/ (sin b) (cos (+ a b))) r) (/ (sin b) (cos (+ a b))) (cos (+ a b)) (/ (* r (sin b)) (cos (+ a b))) (cos (+ a b)) (+ (* (* (+ (* (/ r (cos a)) 1/3) (* (/ r (pow (cos a) 3)) (pow (sin a) 2))) b) b) (/ (+ (* (/ b (cos a)) (* (sin a) r)) r) (cos a))) (+ (* (/ r (cos a)) 1/3) (* (/ r (pow (cos a) 3)) (pow (sin a) 2))) (/ (* r (sin b)) (cos (+ a b))) (* (+ (* (* (+ (* (/ r (cos a)) 1/3) (* (/ r (pow (cos a) 3)) (pow (sin a) 2))) b) b) (/ (+ (* (/ b (cos a)) (* (sin a) r)) r) (cos a))) b) (* (neg (sin a)) (sin b)) (+ (* (neg (sin b)) a) (cos b)) (* (/ r (pow (cos a) 3)) (pow (sin a) 2)) (+ (* (/ b (cos a)) (* (sin a) r)) r))
102.0ms	x	@	0	((/ (/ (cos (* -2 x)) (* (pow (* c s) 2) x)) x) (/ (cos (* -2 x)) (* (pow (* c s) 2) x)) (cos (* -2 x)) (* -2 x) (/ (+ (* -2 (* x x)) 1) (* (* (* x x) c) (* (* s c) s))) (* (* (* x x) c) (* (* s c) s)) (/ (cos (* 2 x)) (* (pow c 2) (* (* x (pow s 2)) x))) (+ (* -2 (* x x)) 1) (* (* x c) (* (* (* s s) x) c)) (/ (cos (* 2 x)) (* (* x c) (* (* (* s s) x) c))) (cos (* 2 x)) (* 2 x) (* (* (* (* s s) x) x) (* c c)) (/ (cos (* 2 x)) (* (* (* (* s s) x) x) (* c c))) (/ (cos (* 2 x)) (* (* (pow (* c s) 2) x) x)) (* (* (pow (* c s) 2) x) x) (* (pow (* c s) 2) x) (pow (* c s) 2) (* (* x x) c) (* (* s s) x) (* (* (* s s) x) c) (* (* (* s s) x) x))
53.0ms	x	@	0	((* (fmod (exp x) (sqrt (cos x))) (exp (neg x))) (fmod (exp x) (sqrt (cos x))) (exp x) (sqrt (cos x)) (* (fmod (exp x) (sqrt (cos x))) (exp (neg x))) (fmod (exp x) (sqrt (cos x))) (exp x) (/ (fmod (exp x) (sqrt (cos x))) (exp x)) (fabs (sinh (neg x))) (+ (* (fabs (fmod (exp x) (sqrt (cos x)))) (fabs (sinh (neg x)))) (* (cosh x) (fmod (exp x) (sqrt (cos x))))) (fabs (fmod (exp x) (sqrt (cos x)))) (fmod (exp x) (sqrt (cos x))) (- (* (cosh x) (fmod (exp x) (sqrt (cos x)))) (* (sinh (neg x)) (fmod (exp x) (sqrt (cos x))))) (- (/ (pow (* (cosh x) (exp (* (log (fmod (exp x) (sqrt (cos x)))) 1))) 2) (- (* (cosh x) (fmod (exp x) (sqrt (cos x)))) (* (sinh (neg x)) (fmod (exp x) (sqrt (cos x)))))) (/ (pow (* (sinh (neg x)) (fmod (exp x) (sqrt (cos x)))) 2) (- (* (cosh x) (fmod (exp x) (sqrt (cos x)))) (* (sinh (neg x)) (fmod (exp x) (sqrt (cos x))))))) (/ (pow (* (sinh (neg x)) (fmod (exp x) (sqrt (cos x)))) 2) (- (* (cosh x) (fmod (exp x) (sqrt (cos x)))) (* (sinh (neg x)) (fmod (exp x) (sqrt (cos x)))))) (/ (pow (* (cosh x) (exp (* (log (fmod (exp x) (sqrt (cos x)))) 1))) 2) (- (* (cosh x) (fmod (exp x) (sqrt (cos x)))) (* (sinh (neg x)) (fmod (exp x) (sqrt (cos x)))))) (+ (* (* x x) -1/4) 1) (* (cosh x) (fmod (exp x) (sqrt (cos x)))) (sqrt (cos x)) (log (fmod (exp x) (sqrt (cos x)))))

preprocess3.2s (2.6%)

Memory

159.3MiB live, 2 819.8MiB allocated

Algorithm

20×	egg-herbie

Stop Event

38×	iter limit
27×	saturated
15×	node limit

Compiler

Compiled 9 387 to 3 312 computations (64.7% saved)

prune2.9s (2.3%)

Memory: 125.1MiB live, 4 168.1MiB allocated
Counts: 31 868 → 1 563
Compiler: Compiled 91 515 to 45 255 computations (50.5% saved)

explain2.6s (2.1%)

Memory

-246.8MiB live, 2 836.3MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`sqrt.f64`	`#f`	oflow-rescue	578	0
`cos.f64`	`#f`	sensitivity	500	2
`-.f64`	`#f`	cancellation	349	0
`sqrt.f64`	`#f`	uflow-rescue	334	0
`/.f64`	`#f`	n/o	259	0
`acos.f64`	`(acos.f64 (-.f64 #s(literal 1 binary64) x))`	sensitivity	254	1
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	sensitivity	247	0
`tan.f64`	`(tan.f64 (+.f64 y z))`	sensitivity	196	0
`pow.f64`	`(pow.f64 l (exp.f64 w))`	sensitivity	104	10
`*.f64`	`#f`	*no**	38	0
`*.f64`	`#f`	*nu**	28	0
`-.f64`	`(-.f64 (.f64 a a) (.f64 b b))`	nan-rescue	19	0
↳	`(*.f64 a a)`	overflow	109
↳	`(*.f64 b b)`	overflow	19
`*.f64`	`#f`	*uo**	18	0
`*.f64`	`(.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (*.f64 x (pow.f64 s #s(literal 2 binary64))) x))`	*ou**	17	0
↳	`(pow.f64 c #s(literal 2 binary64))`	overflow	64
↳	`(.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)`	underflow	65
↳	`(*.f64 x (pow.f64 s #s(literal 2 binary64)))`	underflow	47
↳	`(pow.f64 s #s(literal 2 binary64))`	underflow	51
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	oflow-rescue	6	0
↳	`(sinh.f64 x)`	overflow	6
↳	`(/.f64 (sinh.f64 x) x)`	overflow	6
`exp.f64`	`(exp.f64 (neg.f64 w))`	sensitivity	2	0

Confusion

	Predicted +	Predicted -
+	2201	269
-	681	1969

Precision

0.7637057598889659

Recall

0.8910931174089068

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	2201	0	269
-	681	13	1956

Precision?

0.7602763385146805

Recall?

0.8910931174089068

Freqs

test

number	freq
0	2238
1	2819
2	59
3	4

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	17	0	1
-	0	0	2

Precision?

1.0

Recall?

0.9444444444444444

Samples

510.0ms	2 744×	1	valid
468.0ms	6 692×	0	valid
269.0ms	684×	2	valid
48.0ms	120×	1	exit

Compiler

Compiled 1 067 to 440 computations (58.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 821.0ms

ival-tan: 120.0ms (14.6% of total)

ival-log: 82.0ms (10% of total)

ival-cos: 76.0ms (9.3% of total)

ival-mult: 73.0ms (8.9% of total)

adjust: 70.0ms (8.5% of total)

ival-sinh: 47.0ms (5.7% of total)

ival-sqrt: 46.0ms (5.6% of total)

ival-sin: 44.0ms (5.4% of total)

ival-div: 43.0ms (5.2% of total)

ival-exp: 39.0ms (4.8% of total)

ival-sub: 34.0ms (4.1% of total)

ival-add: 34.0ms (4.1% of total)

ival-fmod: 34.0ms (4.1% of total)

ival-pow2: 23.0ms (2.8% of total)

ival-acos: 19.0ms (2.3% of total)

ival-pow: 8.0ms (1% of total)

ival-hypot: 8.0ms (1% of total)

ival-true: 8.0ms (1% of total)

ival-neg: 5.0ms (0.6% of total)

ival-assert: 4.0ms (0.5% of total)

ival-atan: 3.0ms (0.4% of total)

exact: 2.0ms (0.2% of total)

bsearch829.0ms (0.7%)

Memory

62.7MiB live, 763.8MiB allocated

Algorithm

37×	binary-search
12×	left-value

Stop Event

32×	narrow-enough
3×	predicate-same
2×	predicate-failed

Samples

264.0ms	2 073×	0	valid
264.0ms	1 207×	1	valid
24.0ms	202×	0	invalid
0.0ms	6×	0	exit

Compiler

Compiled 9 927 to 7 831 computations (21.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 370.0ms

ival-cos: 108.0ms (29.2% of total)

ival-sin: 81.0ms (21.9% of total)

ival-mult: 51.0ms (13.8% of total)

ival-div: 33.0ms (8.9% of total)

adjust: 22.0ms (5.9% of total)

ival-add: 19.0ms (5.1% of total)

ival-tan: 15.0ms (4.1% of total)

ival-pow2: 14.0ms (3.8% of total)

ival-exp: 9.0ms (2.4% of total)

ival-sqrt: 4.0ms (1.1% of total)

ival-fmod: 4.0ms (1.1% of total)

ival-pow: 3.0ms (0.8% of total)

ival-true: 2.0ms (0.5% of total)

ival-neg: 2.0ms (0.5% of total)

ival-assert: 1.0ms (0.3% of total)

ival-sub: 1.0ms (0.3% of total)

exact: 0.0ms (0% of total)

start1.0ms (0%)

Memory: 1.1MiB live, 1.0MiB allocated

end0.0ms (0%)

Memory: 0.2MiB live, 0.2MiB allocated

sample43.6s (34.7%)

simplify19.1s (15.2%)

derivations12.3s (9.8%)

rewrite12.2s (9.7%)

localize10.9s (8.7%)

eval5.6s (4.5%)

regimes5.0s (3.9%)

analyze3.8s (3.1%)

series3.5s (2.8%)

preprocess3.2s (2.6%)

prune2.9s (2.3%)

explain2.6s (2.1%)

bsearch829.0ms (0.7%)

start1.0ms (0%)

end0.0ms (0%)

Profiling