Metrics for Herbie run

Date:	Tuesday, October 22nd, 2024
Commit:	5ca06d70 on bhargav-double-double
Hostname:	nightly with Racket 8.10
Seed:	2024296
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.9min (44.7%)

Memory

754.9MiB live, 102 017.0MiB allocated

Samples

28.3s	41 763×	2	valid
24.4s	144 676×	0	invalid
19.1s	91 773×	1	valid
9.0s	4 853×	5	exit
8.9s	94 628×	0	valid
2.0s	3 003×	3	valid
599.0ms	4 187×	0	exit
458.0ms	2 280×	1	exit
13.0ms	6×	2	exit
12.0ms	8×	4	exit
8.0ms	3×	3	exit
1.0ms	1×	4	valid

Precisions

Click to see histograms. Total time spent on operations: 1.3min

ival-tan: 13.8s (18.1% of total)

ival-pow: 9.2s (12.1% of total)

ival-mult: 6.1s (8% of total)

adjust: 5.3s (7% of total)

const: 5.0s (6.5% of total)

ival-cos: 4.1s (5.3% of total)

ival-sub: 3.8s (5% of total)

ival-div: 3.7s (4.8% of total)

ival-log: 3.6s (4.7% of total)

ival-sin: 3.3s (4.3% of total)

ival-add: 3.2s (4.2% of total)

ival-expm1: 2.5s (3.2% of total)

ival-fabs: 2.4s (3.1% of total)

ival-<=: 2.2s (2.9% of total)

ival-exp: 1.9s (2.5% of total)

ival-log1p: 1.2s (1.6% of total)

ival-sqrt: 1.2s (1.6% of total)

ival-<: 997.0ms (1.3% of total)

ival-and: 624.0ms (0.8% of total)

ival-fmin: 441.0ms (0.6% of total)

exact: 366.0ms (0.5% of total)

ival-neg: 355.0ms (0.5% of total)

ival-atan: 338.0ms (0.4% of total)

ival-cbrt: 317.0ms (0.4% of total)

ival->: 232.0ms (0.3% of total)

ival-assert: 159.0ms (0.2% of total)

ival-true: 75.0ms (0.1% of total)

Bogosity

simplify32.7s (12.8%)

Memory

1 163.6MiB live, 25 936.9MiB allocated

Algorithm

237×	egg-herbie

Stop Event

312×	iter limit
158×	node limit
82×	saturated

Counts

8 679 → 8 592

soundness27.0s (10.6%)

Memory

-202.8MiB live, 13 523.5MiB allocated

Stop Event

193×	iter limit
126×	node limit
22×	fuel
5×	done
2×	saturated

Compiler

Compiled 12 558 to 5 870 computations (53.3% saved)

localize22.2s (8.7%)

Memory

15.1MiB live, 19 104.5MiB allocated

Samples

7.4s	5 663×	2	valid
5.7s	9 948×	1	valid
3.0s	9 992×	0	valid
581.0ms	442×	3	valid
246.0ms	702×	0	invalid
76.0ms	114×	0	exit
37.0ms	19×	5	exit

Compiler

Compiled 47 249 to 6 703 computations (85.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 13.1s

ival-mult: 2.1s (15.8% of total)

ival-div: 1.8s (13.7% of total)

adjust: 1.6s (12.5% of total)

ival-tan: 1.4s (11% of total)

ival-add: 1.1s (8.1% of total)

ival-pow: 864.0ms (6.6% of total)

ival-sub: 693.0ms (5.3% of total)

const: 643.0ms (4.9% of total)

ival-log: 613.0ms (4.7% of total)

ival-cos: 560.0ms (4.3% of total)

ival-sin: 441.0ms (3.4% of total)

ival-sqrt: 319.0ms (2.4% of total)

ival-exp: 251.0ms (1.9% of total)

ival-log1p: 177.0ms (1.4% of total)

ival-pow2: 111.0ms (0.8% of total)

ival-neg: 95.0ms (0.7% of total)

ival-cosh: 89.0ms (0.7% of total)

ival-cbrt: 66.0ms (0.5% of total)

ival-expm1: 62.0ms (0.5% of total)

exact: 49.0ms (0.4% of total)

ival-hypot: 25.0ms (0.2% of total)

ival-true: 24.0ms (0.2% of total)

ival-assert: 12.0ms (0.1% of total)

ival-fabs: 1.0ms (0% of total)

rewrite21.7s (8.5%)

Memory

-361.6MiB live, 19 179.4MiB allocated

Stop Event

211×	iter limit
104×	node limit
3×	saturated

Counts

1 586 → 59 533

eval12.4s (4.9%)

Memory: 2.3MiB live, 14 616.0MiB allocated
Compiler: Compiled 2 731 020 to 277 061 computations (89.9% saved)

explain6.8s (2.7%)

Memory

-100.7MiB live, 7 325.8MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	5139	34
`log.f64`	`#f`	sensitivity	759	2
`+.f64`	`#f`	cancellation	650	0
`sqrt.f64`	`#f`	oflow-rescue	380	0
`/.f64`	`#f`	u/n	297	0
`/.f64`	`#f`	u/u	209	0
`pow.f64`	`(pow.f64 (+.f64 x #s(literal 1 binary64)) (/.f64 #s(literal 1 binary64) n))`	sensitivity	48	0
`sqrt.f64`	`#f`	uflow-rescue	34	0
`/.f64`	`(/.f64 (.f64 eps (-.f64 (exp.f64 (.f64 (+.f64 a b) eps)) #s(literal 1 binary64))) (.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))))`	n/u	25	0
↳	`(*.f64 b eps)`	underflow	152
↳	`(-.f64 (exp.f64 (*.f64 a eps)) #s(literal 1 binary64))`	underflow	144
↳	`(-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))`	underflow	152
↳	`(.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64)))`	underflow	232
↳	`(*.f64 a eps)`	underflow	144
`*.f64`	`(.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64)))`	*nu**	12	0
`-.f64`	`#f`	nan-rescue	10	0
`/.f64`	`(/.f64 (-.f64 #s(literal 1 binary64) (cos.f64 x)) (*.f64 x x))`	n/o	4	0
↳	`(*.f64 x x)`	overflow	73
`/.f64`	`(/.f64 (-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64)) (-.f64 (exp.f64 x) #s(literal 1 binary64)))`	o/o	3	0
↳	`(exp.f64 (*.f64 #s(literal 2 binary64) x))`	overflow	3
↳	`(*.f64 #s(literal 2 binary64) x)`	overflow	1
↳	`(-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64))`	overflow	3
↳	`(exp.f64 x)`	overflow	3
↳	`(-.f64 (exp.f64 x) #s(literal 1 binary64))`	overflow	3
`sin.f64`	`(sin.f64 (+.f64 x eps))`	sensitivity	3	1
`tan.f64`	`(tan.f64 (+.f64 x eps))`	sensitivity	3	2
`cos.f64`	`(cos.f64 (+.f64 x eps))`	sensitivity	3	2
`exp.f64`	`#f`	sensitivity	3	1

Confusion

	Predicted +	Predicted -
+	4936	43
-	766	1167

Precision

0.8656611715187653

Recall

0.9913637276561559

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	4936	16	27
-	766	23	1144

Precision?

0.8625674969517506

Recall?

0.9945772243422374

Freqs

test

number	freq
0	1210
1	4531
2	678
3	277
4	216

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	27	0	0
-	0	0	0

Precision?

1.0

Recall?

1.0

Samples

1.6s	2 546×	2	valid
1.0s	5 318×	1	valid
526.0ms	5 734×	0	valid
119.0ms	226×	3	valid

Compiler

Compiled 3 851 to 1 398 computations (63.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.7s

ival-tan: 641.0ms (24.1% of total)

adjust: 329.0ms (12.4% of total)

ival-cos: 245.0ms (9.2% of total)

ival-sub: 184.0ms (6.9% of total)

ival-log: 184.0ms (6.9% of total)

ival-pow: 174.0ms (6.6% of total)

ival-div: 164.0ms (6.2% of total)

ival-exp: 144.0ms (5.4% of total)

ival-add: 138.0ms (5.2% of total)

ival-sin: 135.0ms (5.1% of total)

ival-mult: 93.0ms (3.5% of total)

ival-sqrt: 58.0ms (2.2% of total)

ival-log1p: 55.0ms (2.1% of total)

ival-expm1: 49.0ms (1.8% of total)

ival-cbrt: 19.0ms (0.7% of total)

ival-neg: 17.0ms (0.6% of total)

ival-true: 13.0ms (0.5% of total)

exact: 8.0ms (0.3% of total)

ival-assert: 6.0ms (0.2% of total)

preprocess4.0s (1.6%)

Memory

-18.6MiB live, 3 349.0MiB allocated

Algorithm

27×	egg-herbie

Stop Event

54×	iter limit
48×	saturated
6×	node limit

Compiler

Compiled 16 069 to 4 999 computations (68.9% saved)

prune3.9s (1.6%)

Memory: -554.2MiB live, 5 679.7MiB allocated
Counts: 70 743 → 1 846
Compiler: Compiled 98 991 to 52 214 computations (47.3% saved)

series3.8s (1.5%)

Memory

-230.1MiB live, 3 594.0MiB allocated

Counts

1 586 → 8 679

Calls

489 calls:

Time	Variable		Point	Expression
108.0ms	eps	@	-inf	((+ (* (+ (* (+ (* (sin x) (pow (tan x) 2)) (sin x)) (/ eps (cos x))) (pow (tan x) 2)) eps) eps) (+ (* (sin x) (pow (tan x) 2)) (sin x)) (+ (* (+ (* (sin x) (pow (tan x) 2)) (sin x)) (/ eps (cos x))) (pow (tan x) 2)) (- (tan (+ x eps)) (tan x)) (- (tan (+ x eps)) (tan x)) (+ (* (+ (* (/ eps (cos x)) (+ (/ (pow (sin x) 3) (pow (cos x) 2)) (sin x))) (/ (pow (sin x) 2) (pow (cos x) 2))) eps) eps) (+ (* (/ eps (cos x)) (+ (/ (pow (sin x) 3) (pow (cos x) 2)) (sin x))) (/ (pow (sin x) 2) (pow (cos x) 2))) (* x eps) (- (tan (+ x eps)) (tan x)) (/ (sin eps) (cos eps)) (+ (* (+ (* (+ (* 17/315 (* eps eps)) 2/15) (* eps eps)) 1/3) (* eps eps)) 1) (+ (* (+ (* 17/315 (* eps eps)) 2/15) (* eps eps)) 1/3) (exp (log (- (tan (+ x eps)) (tan x)))) (log (- (tan (+ x eps)) (tan x))) (- (tan (+ x eps)) (tan x)) (tan (+ x eps)) (pow (+ (* (neg (tan eps)) (tan x)) 1) -1) (+ (* (pow (+ (* (neg (tan eps)) (tan x)) 1) -1) (+ (tan eps) (tan x))) (neg (tan x))) (+ (* (neg (tan eps)) (tan x)) 1) (neg (tan eps)) (pow (tan x) 2) (* (+ (* (+ (* (+ (* 17/315 (* eps eps)) 2/15) (* eps eps)) 1/3) (* eps eps)) 1) eps) (* eps eps) (+ (tan eps) (tan x)))
98.0ms	x	@	-inf	((- (pow (+ x 1) (/ 1 n)) (pow x (/ 1 n))) (pow (+ x 1) (/ 1 n)) (+ x 1) (/ 1 n) (pow x (/ 1 n)))
90.0ms	x	@	inf	((+ (* (/ eps (cos x)) (+ (/ (pow (sin x) 3) (pow (cos x) 2)) (sin x))) (/ (pow (sin x) 2) (pow (cos x) 2))) (+ (* (+ (* (/ eps (cos x)) (+ (/ (pow (sin x) 3) (pow (cos x) 2)) (sin x))) (/ (pow (sin x) 2) (pow (cos x) 2))) eps) eps) (- (tan (+ x eps)) (tan x)) (/ eps (cos x)) (- (tan (+ x eps)) (tan x)) (/ (sin eps) (cos eps)) (sin eps) (cos eps) (+ (* (pow (cos (+ eps x)) -1) (sin (+ eps x))) (neg (tan x))) (pow (cos (+ eps x)) -1) (cos (+ eps x)) (+ eps x) (exp (* (log (pow (- (tan (+ eps x)) (tan x)) -1)) -1)) (log (pow (- (tan (+ eps x)) (tan x)) -1)) (* (log (pow (- (tan (+ eps x)) (tan x)) -1)) -1) (pow (- (tan (+ eps x)) (tan x)) -1) (* (/ (+ (tan eps) (tan x)) (- 1 (pow (* (tan eps) (tan x)) 2))) (+ (* (tan eps) (tan x)) 1)) (- (* (/ (+ (tan eps) (tan x)) (- 1 (pow (* (tan eps) (tan x)) 2))) (+ (* (tan eps) (tan x)) 1)) (tan x)) (/ (+ (tan eps) (tan x)) (- 1 (pow (* (tan eps) (tan x)) 2))) (+ (tan eps) (tan x)) (pow (cos x) 2) (pow (sin x) 3) (sin (+ eps x)) (- (tan (+ eps x)) (tan x)) (tan (+ eps x)) (pow (* (tan eps) (tan x)) 2) (* (tan eps) (tan x)))
71.0ms	x	@	inf	((+ (* (+ (* (/ eps (cos x)) (* (+ (* (tan x) (tan x)) 1) (sin x))) (pow (tan x) 2)) eps) eps) (+ (* (/ eps (cos x)) (* (+ (* (tan x) (tan x)) 1) (sin x))) (pow (tan x) 2)) (- (tan (+ x eps)) (tan x)) (/ eps (cos x)) (- (tan (+ x eps)) (tan x)) (+ (* (+ (* (/ eps (cos x)) (+ (/ (pow (sin x) 3) (pow (cos x) 2)) (sin x))) (/ (pow (sin x) 2) (pow (cos x) 2))) eps) eps) (+ (* (/ eps (cos x)) (+ (/ (pow (sin x) 3) (pow (cos x) 2)) (sin x))) (/ (pow (sin x) 2) (pow (cos x) 2))) (* (+ x eps) x) (- (tan (+ x eps)) (tan x)) (/ (sin eps) (cos eps)) (sin eps) (cos eps) (- (tan (+ x eps)) (tan x)) (- (/ (sin (+ x eps)) (cos (+ x eps))) (/ (sin x) (cos x))) (/ (sin (+ x eps)) (cos (+ x eps))) (sin (+ x eps)) (exp (* (log (+ 1 (* (neg (tan x)) (tan eps)))) -1)) (+ (* (exp (* (log (+ 1 (* (neg (tan x)) (tan eps)))) -1)) (+ (tan eps) (tan x))) (neg (tan x))) (* (log (+ 1 (* (neg (tan x)) (tan eps)))) -1) (log (+ 1 (* (neg (tan x)) (tan eps)))) (pow (tan x) 2) (* (+ (* (tan x) (tan x)) 1) (sin x)) (cos (+ x eps)) (+ (tan eps) (tan x)) (* (neg (tan x)) (tan eps)))
58.0ms	x	@	-inf	((- (cbrt (+ x 1)) (cbrt x)) (* (pow (cbrt x) -2) 1/3) (pow (cbrt x) -2) (cbrt x) (- (pow (exp 1/3) (log (+ 1 x))) (cbrt x)) (* (* -2 (log x)) 1/3) (exp (* (* -2 (log x)) 1/3)) (- (cbrt (+ x 1)) (cbrt x)) (* (exp (* (* -2 (log x)) 1/3)) 1/3) (exp (* (log x) -2)) (- (cbrt (+ x 1)) (cbrt x)) (* (cbrt (exp (* (log x) -2))) 1/3) (cbrt (exp (* (log x) -2))) (- (pow (exp 1/3) (log (+ 1 x))) (cbrt x)) (* (+ (* (cbrt (/ 1 (pow x 8))) -1/9) (* (cbrt (/ 1 (pow x 5))) 1/3)) x) (+ (* (cbrt (/ 1 (pow x 8))) -1/9) (* (cbrt (/ 1 (pow x 5))) 1/3)) (cbrt (/ 1 (pow x 8))) (cbrt (/ 1 (pow x 5))) (/ 1 (pow x 5)))

regimes3.2s (1.3%)

Memory

-86.7MiB live, 3 620.1MiB allocated

Counts

3 289 → 283

Calls

42 calls:

961.0ms	x
210.0ms	b
205.0ms	eps
125.0ms	(+.f64 (-.f64 (/.f64 #s(literal 1 binary64) (+.f64 x #s(literal 1 binary64))) (/.f64 #s(literal 2 binary64) x)) (/.f64 #s(literal 1 binary64) (-.f64 x #s(literal 1 binary64))))
123.0ms	b_2

Compiler

Compiled 2 033 to 1 891 computations (7% saved)

analyze1.9s (0.8%)

Memory

-112.2MiB live, 1 824.6MiB allocated

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
7.4%	4.5%	56.6%	38.9%	0%	0%	0%	1
22.3%	13.6%	47.5%	38.9%	0%	0%	0%	2
40.2%	23.5%	34.9%	38.9%	0%	2.7%	0%	3
53.4%	31.1%	27.2%	38.9%	0%	2.8%	0%	4
63%	36.3%	21.3%	38.9%	0%	3.6%	0%	5
65.9%	37.5%	19.4%	38.9%	0%	4.2%	0%	6
70.4%	38.8%	16.3%	38.9%	0%	6%	0%	7
73.6%	40.2%	14.4%	38.9%	0%	6.5%	0%	8
76.3%	40.9%	12.7%	38.9%	0%	7.5%	0%	9
78.4%	41.4%	11.4%	38.9%	0%	8.3%	0%	10
81.1%	42.4%	9.9%	38.9%	0%	8.8%	0%	11
82.3%	42.7%	9.2%	38.9%	0%	9.3%	0%	12

Compiler

Compiled 483 to 337 computations (30.2% saved)

bsearch1.1s (0.4%)

Memory

115.7MiB live, 1 010.4MiB allocated

Algorithm

71×	binary-search
15×	left-value

Stop Event

67×	narrow-enough
4×	predicate-same

Samples

340.0ms	3 869×	0	valid
122.0ms	888×	1	valid
90.0ms	342×	2	valid
77.0ms	1 008×	0	invalid
1.0ms	5×	3	valid
1.0ms	13×	0	exit

Compiler

Compiled 24 972 to 19 248 computations (22.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 449.0ms

ival-mult: 88.0ms (19.6% of total)

ival-sub: 76.0ms (16.9% of total)

ival-pow: 61.0ms (13.6% of total)

ival-div: 56.0ms (12.5% of total)

ival-sqrt: 35.0ms (7.8% of total)

adjust: 30.0ms (6.7% of total)

ival-neg: 23.0ms (5.1% of total)

ival-add: 21.0ms (4.7% of total)

ival-exp: 19.0ms (4.2% of total)

ival-cos: 12.0ms (2.7% of total)

ival-cbrt: 8.0ms (1.8% of total)

ival-expm1: 7.0ms (1.6% of total)

ival-true: 5.0ms (1.1% of total)

ival-sin: 4.0ms (0.9% of total)

exact: 3.0ms (0.7% of total)

ival-assert: 2.0ms (0.4% of total)

start1.0ms (0%)

Memory: 1.5MiB live, 1.5MiB allocated

end0.0ms (0%)

Memory: 0.3MiB live, 0.3MiB allocated

sample1.9min (44.7%)

simplify32.7s (12.8%)

soundness27.0s (10.6%)

localize22.2s (8.7%)

rewrite21.7s (8.5%)

eval12.4s (4.9%)

explain6.8s (2.7%)

preprocess4.0s (1.6%)

prune3.9s (1.6%)

series3.8s (1.5%)

regimes3.2s (1.3%)

analyze1.9s (0.8%)

bsearch1.1s (0.4%)

start1.0ms (0%)

end0.0ms (0%)

Profiling