Metrics for Herbie run

Date:	Thursday, December 12th, 2024
Commit:	9dfb9e9c on fix-nondet
Hostname:	nightly with Racket 8.10
Seed:	2024347
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default
Memory:	237 908.5 MB

sample2.1min (48.6%)

Memory

372.0MiB live, 118 739.9MiB allocated

Samples

29.6s	43 705×	2	valid
25.7s	147 342×	0	invalid
23.3s	96 791×	1	valid
17.2s	7 122×	5	exit
7.8s	87 403×	0	valid
2.5s	3 265×	3	valid
701.0ms	4 249×	0	exit
5.0ms	4×	4	valid

Precisions

Click to see histograms. Total time spent on operations: 1.5min

ival-pow: 16.6s (18.3% of total)

ival-tan: 12.6s (13.9% of total)

adjust: 8.7s (9.6% of total)

ival-mult: 5.9s (6.5% of total)

const: 5.7s (6.3% of total)

ival-sub: 4.5s (5% of total)

ival-cos: 4.5s (4.9% of total)

ival-div: 4.2s (4.7% of total)

ival-add: 4.2s (4.6% of total)

ival-log: 4.1s (4.5% of total)

ival-sin: 3.2s (3.6% of total)

ival-exp: 2.4s (2.6% of total)

ival-fabs: 2.4s (2.6% of total)

ival-<=: 2.4s (2.6% of total)

ival-expm1: 2.2s (2.5% of total)

ival-log1p: 1.2s (1.4% of total)

ival-sqrt: 1.2s (1.3% of total)

ival-<: 998.0ms (1.1% of total)

ival-cbrt: 878.0ms (1% of total)

ival-and: 608.0ms (0.7% of total)

ival-fmin: 577.0ms (0.6% of total)

exact: 338.0ms (0.4% of total)

ival-atan: 336.0ms (0.4% of total)

ival-neg: 295.0ms (0.3% of total)

ival->: 293.0ms (0.3% of total)

ival-assert: 156.0ms (0.2% of total)

ival-true: 67.0ms (0.1% of total)

Bogosity

simplify34.4s (13.1%)

Memory

619.5MiB live, 29 362.2MiB allocated

Algorithm

248×	egg-herbie

Stop Event

330×	iter limit
218×	node limit
30×	saturated

Counts

8 299 → 8 207

localize24.1s (9.1%)

Memory

-9.2MiB live, 21 734.6MiB allocated

Samples

8.7s	6 332×	2	valid
7.8s	11 143×	1	valid
2.5s	9 332×	0	valid
576.0ms	411×	3	valid
311.0ms	878×	0	invalid
55.0ms	34×	5	exit
15.0ms	30×	0	exit

Compiler

Compiled 23 282 to 3 388 computations (85.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 16.1s

adjust: 3.2s (19.9% of total)

ival-mult: 2.7s (16.7% of total)

ival-div: 1.7s (10.5% of total)

ival-tan: 1.6s (9.9% of total)

ival-add: 1.1s (6.8% of total)

ival-pow: 974.0ms (6% of total)

ival-sub: 862.0ms (5.3% of total)

ival-cos: 725.0ms (4.5% of total)

ival-log: 577.0ms (3.6% of total)

const: 552.0ms (3.4% of total)

ival-sin: 439.0ms (2.7% of total)

ival-exp: 382.0ms (2.4% of total)

ival-sqrt: 322.0ms (2% of total)

ival-log1p: 227.0ms (1.4% of total)

ival-pow2: 157.0ms (1% of total)

ival-neg: 139.0ms (0.9% of total)

ival-expm1: 122.0ms (0.8% of total)

ival-cosh: 94.0ms (0.6% of total)

ival-cbrt: 72.0ms (0.4% of total)

ival-atan: 56.0ms (0.3% of total)

exact: 45.0ms (0.3% of total)

ival-hypot: 32.0ms (0.2% of total)

ival-true: 21.0ms (0.1% of total)

ival-atan2: 13.0ms (0.1% of total)

ival-assert: 11.0ms (0.1% of total)

ival-pi: 7.0ms (0% of total)

ival-fabs: 1.0ms (0% of total)

rewrite22.6s (8.6%)

Memory

123.6MiB live, 20 412.1MiB allocated

Stop Event

225×	iter limit
110×	node limit

Counts

1 682 → 48 849

derivations20.9s (7.9%)

Memory

114.8MiB live, 11 483.6MiB allocated

Stop Event

192×	iter limit
131×	node limit
25×	fuel
3×	done

Compiler

Compiled 7 614 to 1 790 computations (76.5% saved)

eval9.5s (3.6%)

Memory: 130.8MiB live, 11 218.6MiB allocated
Compiler: Compiled 2 162 642 to 233 277 computations (89.2% saved)

explain5.7s (2.2%)

Memory

-146.4MiB live, 5 894.9MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	4183	23
`log.f64`	`#f`	sensitivity	757	4
`/.f64`	`#f`	u/u	452	0
`sqrt.f64`	`#f`	oflow-rescue	398	0
`+.f64`	`#f`	cancellation	337	1
`/.f64`	`#f`	u/n	95	0
`pow.f64`	`#f`	sensitivity	59	0
`sqrt.f64`	`#f`	uflow-rescue	30	0
`-.f64`	`#f`	nan-rescue	25	0
`/.f64`	`(/.f64 (.f64 eps (-.f64 (exp.f64 (.f64 (+.f64 a b) eps)) #s(literal 1 binary64))) (.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))))`	n/u	20	0
↳	`(*.f64 b eps)`	underflow	155
↳	`(-.f64 (exp.f64 (*.f64 a eps)) #s(literal 1 binary64))`	underflow	139
↳	`(-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))`	underflow	155
↳	`(.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64)))`	underflow	238
↳	`(*.f64 a eps)`	underflow	139
`cos.f64`	`(cos.f64 (+.f64 x eps))`	sensitivity	3	0
`tan.f64`	`(tan.f64 (+.f64 x eps))`	sensitivity	3	0
`/.f64`	`(/.f64 (-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64)) (-.f64 (exp.f64 x) #s(literal 1 binary64)))`	o/o	2	0
↳	`(exp.f64 (*.f64 #s(literal 2 binary64) x))`	overflow	2
↳	`(-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64))`	overflow	2
↳	`(exp.f64 x)`	overflow	2
↳	`(-.f64 (exp.f64 x) #s(literal 1 binary64))`	overflow	2
`sin.f64`	`(sin.f64 (+.f64 x eps))`	sensitivity	2	0

Confusion

	Predicted +	Predicted -
+	5231	18
-	117	1802

Precision

0.9781226626776365

Recall

0.9965707753857878

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5231	12	6
-	117	14	1788

Precision?

0.9756233717901005

Recall?

0.9988569251285959

Freqs

test

number	freq
0	1820
1	4541
2	646
3	111
4	50

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	28	0	0
-	0	0	0

Precision?

1.0

Recall?

1.0

Samples

1.8s	2 772×	2	valid
1.2s	5 964×	1	valid
418.0ms	5 414×	0	valid
154.0ms	186×	3	valid

Compiler

Compiled 2 154 to 763 computations (64.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.9s

ival-tan: 702.0ms (24.6% of total)

adjust: 363.0ms (12.7% of total)

ival-sin: 218.0ms (7.6% of total)

ival-add: 198.0ms (6.9% of total)

ival-div: 197.0ms (6.9% of total)

ival-log: 193.0ms (6.8% of total)

ival-cos: 179.0ms (6.3% of total)

ival-exp: 175.0ms (6.1% of total)

ival-sub: 173.0ms (6.1% of total)

ival-pow: 146.0ms (5.1% of total)

ival-mult: 100.0ms (3.5% of total)

ival-sqrt: 60.0ms (2.1% of total)

ival-log1p: 57.0ms (2% of total)

ival-expm1: 23.0ms (0.8% of total)

ival-atan: 20.0ms (0.7% of total)

ival-cbrt: 15.0ms (0.5% of total)

ival-neg: 15.0ms (0.5% of total)

ival-true: 11.0ms (0.4% of total)

exact: 8.0ms (0.3% of total)

ival-assert: 6.0ms (0.2% of total)

preprocess4.6s (1.7%)

Memory

541.9MiB live, 4 182.7MiB allocated

Algorithm

28×	egg-herbie

Stop Event

56×	iter limit
33×	saturated
23×	node limit

Compiler

Compiled 17 898 to 5 157 computations (71.2% saved)

series3.9s (1.5%)

Memory

116.7MiB live, 4 017.4MiB allocated

Counts

1 682 → 8 299

Calls

510 calls:

Time	Variable		Point	Expression
133.0ms	x	@	-inf	((- (exp x) 1) (* (+ (* 1/2 x) 1) x) (* (* x x) 1/2) (* x x) (- (exp x) 1) (* (+ (* 1/2 x) 1) x) (+ (* 1/2 x) 1) (* 1/2 x) (- (exp x) 1) (+ (* (* x x) 1/2) x))
90.0ms	a	@	0	((/ (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) a) (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) (* -2 b_2) (/ (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) a) (* (/ c b_2) -1/2) (/ c b_2) (/ (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) a) (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) (neg b_2) (sqrt (- (* b_2 b_2) (* a c))) (* (+ (* (/ (* (/ c b_2) a) b_2) -1/2) 2) (neg b_2)) (/ (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) a) (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) (+ (* (/ (* (/ c b_2) a) b_2) -1/2) 2) (/ (+ (neg b_2) (pow (pow (+ (* c a) (* b_2 b_2)) 2) 1/4)) a) (+ (neg b_2) (pow (pow (+ (* c a) (* b_2 b_2)) 2) 1/4)) (pow (pow (+ (* c a) (* b_2 b_2)) 2) 1/4) (- (* b_2 b_2) (* a c)) (* (/ c b_2) a) (+ (* c a) (* b_2 b_2)))
72.0ms	b_2	@	0	((/ (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) a) (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) (* (+ (* (/ (* (/ c b_2) a) b_2) -1/2) 2) (neg b_2)) (+ (* 1/2 (* a (/ c b_2))) (* -2 b_2)) (/ (+ (neg b_2) (pow (pow (+ (* c a) (* b_2 b_2)) 2) 1/4)) a) (* 1/2 (/ c b_2)) (/ c b_2) (/ (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) a) (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) (* (* a (/ -1/2 b_2)) c) (* a (/ -1/2 b_2)) (/ (+ (* (sqrt (- (* b_2 b_2) (* a c))) a) (* a (neg b_2))) (* a a)) (+ (* (sqrt (- (* b_2 b_2) (* a c))) a) (* a (neg b_2))) (sqrt (- (* b_2 b_2) (* a c))) (- (* b_2 b_2) (* a c)) (* (+ (* (/ a (* b_2 b_2)) -1/2) (/ 2 c)) c) (/ (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) a) (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) (* (+ (* (/ (* (/ c b_2) a) b_2) -1/2) 2) (neg b_2)) (* a (/ c b_2)) (/ a (* b_2 b_2)))
70.0ms	b_2	@	-inf	((/ (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) a) (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) (* -2 b_2) (/ (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) a) (* (/ c b_2) -1/2) (/ c b_2) (/ (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) a) (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) (neg b_2) (sqrt (- (* b_2 b_2) (* a c))) (* (+ (* (/ (* (/ c b_2) a) b_2) -1/2) 2) (neg b_2)) (/ (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) a) (+ (neg b_2) (sqrt (- (* b_2 b_2) (* a c)))) (+ (* (/ (* (/ c b_2) a) b_2) -1/2) 2) (/ (+ (neg b_2) (pow (pow (+ (* c a) (* b_2 b_2)) 2) 1/4)) a) (+ (neg b_2) (pow (pow (+ (* c a) (* b_2 b_2)) 2) 1/4)) (pow (pow (+ (* c a) (* b_2 b_2)) 2) 1/4) (- (* b_2 b_2) (* a c)) (* (/ c b_2) a) (+ (* c a) (* b_2 b_2)))
56.0ms	eps	@	0	((+ 0 eps) (/ (+ (* 2 x) eps) -2) (* (* (sin (/ (+ 0 eps) 2)) 2) (cos (/ (+ (* 2 x) eps) -2))) (* (sin (/ (+ 0 eps) 2)) 2) (- (sin (+ x eps)) (sin x)) (sin eps) (- (sin (+ x eps)) (sin x)) (* (cos x) eps) (cos x) (- (sin (+ x eps)) (sin x)) (* (+ (* (* (sin x) eps) -1/2) (cos x)) eps) (+ (* (* (sin x) eps) -1/2) (cos x)) (* (sin x) eps) (- (sin (+ x eps)) (sin x)) (* (+ (* (+ (* (* (cos x) eps) -1/6) (* (sin x) -1/2)) eps) (cos x)) eps) (+ (* (+ (* (* (cos x) eps) -1/6) (* (sin x) -1/2)) eps) (cos x)) (+ (* (* (cos x) eps) -1/6) (* (sin x) -1/2)) (cos (/ (+ (* 2 x) eps) -2)) (sin (/ (+ 0 eps) 2)))

prune3.2s (1.2%)

Memory: -296.9MiB live, 4 383.0MiB allocated
Counts: 57 019 → 1 646
Compiler: Compiled 88 493 to 47 239 computations (46.6% saved)

regimes2.7s (1%)

Memory

47.0MiB live, 2 972.5MiB allocated

Counts

2 934 → 279

Calls

43 calls:

780.0ms	x
304.0ms	eps
164.0ms	b
124.0ms	(/.f64 #s(literal 1 binary64) n)
92.0ms	n

Compiler

Compiled 1 998 to 1 877 computations (6.1% saved)

analyze2.4s (0.9%)

Memory

66.0MiB live, 2 266.8MiB allocated

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
7.4%	4.5%	56.6%	38.9%	0%	0%	0%	1
22.3%	13.6%	47.5%	38.9%	0%	0%	0%	2
40.2%	23.5%	34.9%	38.9%	0%	2.7%	0%	3
53.4%	31.1%	27.2%	38.9%	0%	2.8%	0%	4
63%	36.3%	21.3%	38.9%	0%	3.6%	0%	5
65.9%	37.5%	19.4%	38.9%	0%	4.2%	0%	6
70.4%	38.8%	16.3%	38.9%	0%	6%	0%	7
73.6%	40.2%	14.4%	38.9%	0%	6.5%	0%	8
76.3%	40.9%	12.7%	38.9%	0%	7.5%	0%	9
78.4%	41.4%	11.4%	38.9%	0%	8.3%	0%	10
81.1%	42.4%	9.9%	38.9%	0%	8.8%	0%	11
82.3%	42.7%	9.2%	38.9%	0%	9.3%	0%	12

Compiler

Compiled 483 to 337 computations (30.2% saved)

bsearch1.6s (0.6%)

Memory

-84.1MiB live, 1 238.4MiB allocated

Algorithm

70×	binary-search
16×	left-value

Stop Event

69×	narrow-enough
1×	predicate-same

Samples

487.0ms	5 260×	0	valid
218.0ms	623×	2	valid
176.0ms	874×	1	valid
102.0ms	1 339×	0	invalid
11.0ms	129×	0	exit
7.0ms	27×	3	valid

Compiler

Compiled 32 789 to 23 332 computations (28.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 745.0ms

ival-pow: 177.0ms (23.8% of total)

ival-mult: 164.0ms (22% of total)

adjust: 84.0ms (11.3% of total)

ival-div: 75.0ms (10.1% of total)

ival-neg: 66.0ms (8.9% of total)

ival-sub: 57.0ms (7.7% of total)

ival-sqrt: 50.0ms (6.7% of total)

ival-add: 35.0ms (4.7% of total)

ival-cos: 15.0ms (2% of total)

ival-expm1: 5.0ms (0.7% of total)

ival-true: 5.0ms (0.7% of total)

exact: 5.0ms (0.7% of total)

ival-assert: 3.0ms (0.4% of total)

ival-exp: 2.0ms (0.3% of total)

ival-cbrt: 2.0ms (0.3% of total)

start1.0ms (0%)

Memory: 1.6MiB live, 1.6MiB allocated

end0.0ms (0%)

Memory: 0.3MiB live, 0.3MiB allocated

sample2.1min (48.6%)

simplify34.4s (13.1%)

localize24.1s (9.1%)

rewrite22.6s (8.6%)

derivations20.9s (7.9%)

eval9.5s (3.6%)

explain5.7s (2.2%)

preprocess4.6s (1.7%)

series3.9s (1.5%)

prune3.2s (1.2%)

regimes2.7s (1%)

analyze2.4s (0.9%)

bsearch1.6s (0.6%)

start1.0ms (0%)

end0.0ms (0%)

Profiling