Metrics for Herbie run

Date:	Tuesday, November 26th, 2024
Commit:	d626cd43 on main
Hostname:	nightly with Racket 8.10
Seed:	2024331
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default
Memory:	122 736.3 MB

sample50.1s (36.4%)

Memory

479.6MiB live, 41 878.9MiB allocated

Samples

14.0s	43 355×	1	valid
9.3s	110 004×	0	valid
8.6s	6 281×	5	exit
4.7s	11 761×	2	valid
1.1s	10 151×	1	exit
426.0ms	3 873×	0	invalid
113.0ms	1 404×	0	exit

Precisions

Click to see histograms. Total time spent on operations: 31.1s

const: 5.0s (16.1% of total)

ival-exp: 3.7s (11.8% of total)

ival-pow: 3.3s (10.7% of total)

ival-cos: 2.3s (7.3% of total)

adjust: 2.0s (6.3% of total)

ival-mult: 1.9s (6.2% of total)

ival-tan: 1.7s (5.5% of total)

ival-log: 1.4s (4.5% of total)

ival-fmod: 1.2s (3.8% of total)

ival-sqrt: 1.1s (3.5% of total)

ival-sinh: 1.1s (3.5% of total)

ival-sub: 1.0s (3.2% of total)

ival-add: 836.0ms (2.7% of total)

ival-sin: 749.0ms (2.4% of total)

ival-pow2: 703.0ms (2.3% of total)

ival-div: 698.0ms (2.2% of total)

ival-<=: 544.0ms (1.8% of total)

ival-acos: 411.0ms (1.3% of total)

ival-<: 357.0ms (1.1% of total)

ival-hypot: 268.0ms (0.9% of total)

ival-neg: 197.0ms (0.6% of total)

ival-and: 119.0ms (0.4% of total)

ival-true: 105.0ms (0.3% of total)

ival-==: 96.0ms (0.3% of total)

exact: 81.0ms (0.3% of total)

ival-assert: 76.0ms (0.2% of total)

ival->=: 67.0ms (0.2% of total)

ival-atan: 45.0ms (0.1% of total)

ival-or: 42.0ms (0.1% of total)

ival->: 22.0ms (0.1% of total)

Bogosity

simplify21.9s (15.9%)

Memory

309.7MiB live, 17 643.2MiB allocated

Algorithm

162×	egg-herbie

Stop Event

210×	iter limit
112×	node limit
53×	saturated

Counts

3 865 → 3 798

soundness14.8s (10.8%)

Memory

137.4MiB live, 7 305.1MiB allocated

Stop Event

133×	iter limit
65×	node limit
13×	fuel
8×	unsound
7×	done
6×	saturated

Compiler

Compiled 7 273 to 3 609 computations (50.4% saved)

rewrite12.7s (9.2%)

Memory

34.9MiB live, 12 220.1MiB allocated

Stop Event

171×	iter limit
55×	node limit
14×	unsound
4×	saturated

Counts

995 → 27 181

localize11.6s (8.4%)

Memory

-221.5MiB live, 12 757.5MiB allocated

Samples

4.5s	5 159×	1	valid
2.6s	10 501×	0	valid
2.3s	1 694×	2	valid
103.0ms	518×	0	invalid
88.0ms	236×	1	exit
20.0ms	67×	0	exit
1.0ms	1×	5	exit

Compiler

Compiled 12 485 to 1 873 computations (85% saved)

Precisions

Click to see histograms. Total time spent on operations: 7.5s

ival-mult: 1.4s (18.8% of total)

ival-pow: 812.0ms (10.8% of total)

adjust: 799.0ms (10.6% of total)

ival-div: 700.0ms (9.3% of total)

ival-cos: 553.0ms (7.3% of total)

ival-add: 488.0ms (6.5% of total)

ival-sin: 373.0ms (5% of total)

ival-tan: 329.0ms (4.4% of total)

ival-sub: 327.0ms (4.3% of total)

const: 289.0ms (3.8% of total)

ival-log: 243.0ms (3.2% of total)

ival-pow2: 239.0ms (3.2% of total)

ival-sqrt: 183.0ms (2.4% of total)

ival-sinh: 164.0ms (2.2% of total)

ival-neg: 130.0ms (1.7% of total)

ival-fmod: 125.0ms (1.7% of total)

ival-exp: 124.0ms (1.6% of total)

ival-acos: 53.0ms (0.7% of total)

ival-pi: 51.0ms (0.7% of total)

ival-asin: 38.0ms (0.5% of total)

ival-hypot: 33.0ms (0.4% of total)

exact: 21.0ms (0.3% of total)

ival-true: 16.0ms (0.2% of total)

ival-assert: 8.0ms (0.1% of total)

ival-cosh: 6.0ms (0.1% of total)

ival-cbrt: 5.0ms (0.1% of total)

ival-atan: 1.0ms (0% of total)

eval6.2s (4.5%)

Memory: 147.9MiB live, 7 675.6MiB allocated
Compiler: Compiled 1 331 308 to 130 369 computations (90.2% saved)

regimes4.5s (3.3%)

Memory

25.7MiB live, 4 852.4MiB allocated

Counts

2 717 → 149

Calls

53 calls:

584.0ms	a
499.0ms	x
368.0ms	b
241.0ms	r
235.0ms	(tan.f64 a)

Compiler

Compiled 1 616 to 1 811 computations (-12.1% saved)

analyze3.9s (2.8%)

Memory

114.1MiB live, 4 205.6MiB allocated

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
28.8%	21.3%	52.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.2%	0%	6
71.1%	51.1%	20.8%	26.3%	0%	1.9%	0%	7
72.1%	51.6%	20%	26.3%	0%	2.1%	0%	8
74.4%	53%	18.2%	26.3%	0%	2.5%	0%	9
75.8%	53.9%	17.2%	26.3%	0%	2.6%	0%	10
76.6%	54.3%	16.6%	26.3%	0%	2.8%	0%	11
77.3%	54.8%	16.1%	26.3%	0%	2.9%	0%	12

Compiler

Compiled 279 to 216 computations (22.6% saved)

series3.3s (2.4%)

Memory

66.4MiB live, 3 422.7MiB allocated

Counts

995 → 3 865

Calls

396 calls:

Time	Variable		Point	Expression
375.0ms	x	@	inf	((* (/ (+ (sin x) (cos x)) (* (pow (* c s) 2) x)) (/ (- (cos x) (sin x)) x)) (/ (+ (sin x) (cos x)) (* (pow (* c s) 2) x)) (+ (sin x) (cos x)) (sin x) (/ (+ (* -2 (* x x)) 1) (* (* (* x x) c) (* (* s c) s))) (* (* (* x x) c) (* (* s c) s)) (/ (cos (* 2 x)) (* (pow c 2) (* (* x (pow s 2)) x))) (+ (* -2 (* x x)) 1) (* (* x c) (* (* (* s s) x) c)) (/ (cos (* 2 x)) (* (* x c) (* (* (* s s) x) c))) (cos (* 2 x)) (* 2 x) (/ (/ (/ (cos (* -2 x)) (* c c)) (* (* s x) x)) s) (/ (cos (* 2 x)) (* (pow c 2) (* (* x (pow s 2)) x))) (/ (/ (cos (* -2 x)) (* c c)) (* (* s x) x)) (/ (cos (* -2 x)) (* c c)) (/ (/ (cos (* -2 x)) x) (* (pow (* c s) 2) x)) (/ (cos (* -2 x)) x) (cos (* -2 x)) (* -2 x) (* (pow (* c s) 2) x) (pow (* c s) 2) (* (* x x) c) (* (* (* s s) x) c) (* (* s s) x))
123.0ms	l	@	0	((* (exp (neg w)) (pow (exp 2) (log (sqrt (pow l (exp w)))))) (exp (neg w)) (neg w) (pow (exp 2) (log (sqrt (pow l (exp w))))) (* (exp (neg w)) (pow l (exp w))) (+ (* (+ (* (log l) l) (neg l)) w) l) (* (- (* (log l) l) l) w) (* (* (- (log l) 1) w) l) (* (exp (neg w)) (pow l (exp w))) (exp (neg w)) (+ (* (- (* 1/2 w) 1) w) 1) (- (* 1/2 w) 1) (pow (sqrt (pow l (exp w))) 2) (* (exp (neg w)) (pow (sqrt (pow l (exp w))) 2)) (exp (log l)) (* (exp (neg w)) (pow l (exp w))) (pow l (exp w)) (sqrt (pow l (exp w))) (* (- (log l) 1) w) (+ (* 1/6 w) 1/2) (exp w) (pow l (exp w)) (exp w) (pow l (exp w)) (pow (exp (log l)) (exp w)) (pow l (exp w)))
120.0ms	w	@	inf	((* (exp (neg w)) (pow (exp 2) (log (sqrt (pow l (exp w)))))) (exp (neg w)) (neg w) (pow (exp 2) (log (sqrt (pow l (exp w))))) (* (exp (neg w)) (pow l (exp w))) (+ (* (+ (* (log l) l) (neg l)) w) l) (* (- (* (log l) l) l) w) (* (* (- (log l) 1) w) l) (* (exp (neg w)) (pow l (exp w))) (exp (neg w)) (+ (* (- (* 1/2 w) 1) w) 1) (- (* 1/2 w) 1) (pow (sqrt (pow l (exp w))) 2) (* (exp (neg w)) (pow (sqrt (pow l (exp w))) 2)) (exp (log l)) (* (exp (neg w)) (pow l (exp w))) (pow l (exp w)) (sqrt (pow l (exp w))) (* (- (log l) 1) w) (+ (* 1/6 w) 1/2) (exp w) (pow l (exp w)) (exp w) (pow l (exp w)) (pow (exp (log l)) (exp w)) (pow l (exp w)))
105.0ms	b	@	inf	((* r (/ (sin b) (+ (* (cos b) (cos a)) (* (neg (sin a)) (sin b))))) (/ (sin b) (+ (* (cos b) (cos a)) (* (neg (sin a)) (sin b)))) (sin b) (+ (* (cos b) (cos a)) (* (neg (sin a)) (sin b))) (* r (/ (sin b) (cos (+ a b)))) (* (/ r (cos a)) b) (* b r) (sin (+ (neg a) (/ (PI) 2))) (* r (/ (sin b) (cos (+ a b)))) (* (/ r (sin (+ (neg a) (/ (PI) 2)))) b) (/ r (sin (+ (neg a) (/ (PI) 2)))) (sin (+ (+ (/ (PI) 2) b) a)) (* r (/ (sin b) (sin (+ (+ (/ (PI) 2) b) a)))) (/ (sin b) (sin (+ (+ (/ (PI) 2) b) a))) (* (/ (sin b) (* (cos (+ a b)) (sin (- b (+ (/ (PI) 2) a))))) (sin (- b (+ (/ (PI) 2) a)))) (* r (* (/ (sin b) (* (cos (+ a b)) (sin (- b (+ (/ (PI) 2) a))))) (sin (- b (+ (/ (PI) 2) a))))) (/ (sin b) (* (cos (+ a b)) (sin (- b (+ (/ (PI) 2) a))))) (* (neg (sin a)) (sin b)) (+ (/ (PI) 2) b) (sin (- b (+ (/ (PI) 2) a))) (cos (+ a b)) (* (cos (+ a b)) (sin (- b (+ (/ (PI) 2) a)))))
77.0ms	w	@	-inf	((* (exp (neg w)) (pow (exp 2) (log (sqrt (pow l (exp w)))))) (exp (neg w)) (neg w) (pow (exp 2) (log (sqrt (pow l (exp w))))) (* (exp (neg w)) (pow l (exp w))) (+ (* (+ (* (log l) l) (neg l)) w) l) (* (- (* (log l) l) l) w) (* (* (- (log l) 1) w) l) (* (exp (neg w)) (pow l (exp w))) (exp (neg w)) (+ (* (- (* 1/2 w) 1) w) 1) (- (* 1/2 w) 1) (pow (sqrt (pow l (exp w))) 2) (* (exp (neg w)) (pow (sqrt (pow l (exp w))) 2)) (exp (log l)) (* (exp (neg w)) (pow l (exp w))) (pow l (exp w)) (sqrt (pow l (exp w))) (* (- (log l) 1) w) (+ (* 1/6 w) 1/2) (exp w) (pow l (exp w)) (exp w) (pow l (exp w)) (pow (exp (log l)) (exp w)) (pow l (exp w)))

prune2.9s (2.1%)

Memory: -125.7MiB live, 4 003.2MiB allocated
Counts: 34 033 → 1 567
Compiler: Compiled 97 481 to 46 881 computations (51.9% saved)

preprocess2.8s (2.1%)

Memory

256.5MiB live, 3 125.6MiB allocated

Algorithm

20×	egg-herbie

Stop Event

38×	iter limit
27×	saturated
15×	node limit

Compiler

Compiled 7 839 to 2 824 computations (64% saved)

explain2.6s (1.9%)

Memory

12.4MiB live, 3 291.2MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`sqrt.f64`	`#f`	oflow-rescue	548	0
`cos.f64`	`#f`	sensitivity	470	2
`-.f64`	`#f`	cancellation	335	0
`sqrt.f64`	`#f`	uflow-rescue	333	0
`/.f64`	`#f`	n/o	257	0
`acos.f64`	`(acos.f64 (-.f64 #s(literal 1 binary64) x))`	sensitivity	254	0
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	sensitivity	250	0
`tan.f64`	`(tan.f64 (+.f64 y z))`	sensitivity	200	0
`pow.f64`	`(pow.f64 l (exp.f64 w))`	sensitivity	129	17
`*.f64`	`#f`	*nu**	33	0
`*.f64`	`#f`	*no**	29	0
`-.f64`	`(-.f64 (.f64 a a) (.f64 b b))`	nan-rescue	21	0
↳	`(*.f64 a a)`	overflow	121
↳	`(*.f64 b b)`	overflow	21
`*.f64`	`(.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (*.f64 x (pow.f64 s #s(literal 2 binary64))) x))`	*ou**	19	0
↳	`(pow.f64 c #s(literal 2 binary64))`	overflow	62
↳	`(.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)`	underflow	73
↳	`(*.f64 x (pow.f64 s #s(literal 2 binary64)))`	underflow	61
↳	`(pow.f64 s #s(literal 2 binary64))`	underflow	67
`*.f64`	`#f`	*uo**	14	0
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	oflow-rescue	4	0
↳	`(sinh.f64 x)`	overflow	4
↳	`(/.f64 (sinh.f64 x) x)`	overflow	4
`/.f64`	`(/.f64 (-.f64 x lo) (-.f64 hi lo))`	o/o	1	0
↳	`(-.f64 x lo)`	overflow	1
↳	`(-.f64 hi lo)`	overflow	256
`cos.f64`	`(cos.f64 (*.f64 #s(literal 2 binary64) x))`	oflow-rescue	1	0
↳	`(*.f64 #s(literal 2 binary64) x)`	overflow	1

Confusion

	Predicted +	Predicted -
+	2144	256
-	684	2036

Precision

0.7581329561527581

Recall

0.8933333333333333

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	2144	0	256
-	684	19	2017

Precision?

0.7530734106076572

Recall?

0.8933333333333333

Freqs

test

number	freq
0	2292
1	2759
2	68
3	1

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	18	0	0
-	0	0	2

Precision?

1.0

Recall?

1.0

Samples

571.0ms	6 740×	0	valid
445.0ms	2 642×	1	valid
376.0ms	778×	2	valid
15.0ms	80×	1	exit

Compiler

Compiled 1 067 to 440 computations (58.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 944.0ms

ival-log: 134.0ms (14.2% of total)

ival-sqrt: 93.0ms (9.9% of total)

ival-mult: 79.0ms (8.4% of total)

ival-tan: 77.0ms (8.2% of total)

adjust: 71.0ms (7.5% of total)

ival-cos: 61.0ms (6.5% of total)

ival-div: 59.0ms (6.3% of total)

ival-fmod: 56.0ms (5.9% of total)

ival-exp: 46.0ms (4.9% of total)

ival-sub: 46.0ms (4.9% of total)

ival-sinh: 45.0ms (4.8% of total)

ival-add: 42.0ms (4.4% of total)

ival-sin: 33.0ms (3.5% of total)

ival-pow: 27.0ms (2.9% of total)

ival-pow2: 24.0ms (2.5% of total)

ival-acos: 19.0ms (2% of total)

ival-hypot: 9.0ms (1% of total)

ival-true: 9.0ms (1% of total)

ival-neg: 5.0ms (0.5% of total)

ival-assert: 4.0ms (0.4% of total)

ival-atan: 3.0ms (0.3% of total)

exact: 2.0ms (0.2% of total)

bsearch249.0ms (0.2%)

Memory

31.2MiB live, 353.4MiB allocated

Algorithm

22×	left-value
17×	binary-search

Stop Event

17×	narrow-enough

Samples

108.0ms	1 256×	0	valid
38.0ms	200×	1	valid
1.0ms	16×	0	exit

Compiler

Compiled 6 038 to 4 715 computations (21.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 92.0ms

ival-cos: 14.0ms (15.2% of total)

ival-tan: 13.0ms (14.2% of total)

ival-mult: 12.0ms (13.1% of total)

ival-pow2: 10.0ms (10.9% of total)

ival-exp: 8.0ms (8.7% of total)

ival-pow: 5.0ms (5.4% of total)

ival-add: 5.0ms (5.4% of total)

ival-fmod: 5.0ms (5.4% of total)

ival-div: 4.0ms (4.4% of total)

adjust: 4.0ms (4.4% of total)

ival-sqrt: 3.0ms (3.3% of total)

ival-sin: 3.0ms (3.3% of total)

ival-neg: 2.0ms (2.2% of total)

ival-assert: 1.0ms (1.1% of total)

ival-sub: 1.0ms (1.1% of total)

ival-true: 1.0ms (1.1% of total)

exact: 0.0ms (0% of total)

start1.0ms (0%)

Memory: 1.5MiB live, 1.5MiB allocated

end0.0ms (0%)

Memory: 0.3MiB live, 0.3MiB allocated

sample50.1s (36.4%)

simplify21.9s (15.9%)

soundness14.8s (10.8%)

rewrite12.7s (9.2%)

localize11.6s (8.4%)

eval6.2s (4.5%)

regimes4.5s (3.3%)

analyze3.9s (2.8%)

series3.3s (2.4%)

prune2.9s (2.1%)

preprocess2.8s (2.1%)

explain2.6s (1.9%)

bsearch249.0ms (0.2%)

start1.0ms (0%)

end0.0ms (0%)

Profiling