Metrics for Herbie run

Date:	Thursday, August 22nd, 2024
Commit:	efa1c98c on faster-localize
Hostname:	nightly with Racket 8.11.1
Seed:	2024235
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.9min (37.5%)

Memory

195.6MiB live, 116 522.6MiB allocated

Samples

27.7s	41 375×	2	valid
24.7s	146 941×	0	invalid
19.0s	92 132×	1	valid
9.9s	4 964×	5	exit
8.9s	94 617×	0	valid
2.2s	3 041×	3	valid
474.0ms	2 274×	1	exit
370.0ms	4 243×	0	exit
49.0ms	9×	4	exit
5.0ms	4×	3	exit
5.0ms	4×	2	exit
3.0ms	3×	4	valid

Precisions

Click to see histograms. Total time spent on operations: 1.3min

ival-tan: 13.9s (18% of total)

ival-pow: 9.7s (12.5% of total)

ival-mult: 6.0s (7.8% of total)

adjust: 5.0s (6.4% of total)

const: 4.9s (6.3% of total)

ival-cos: 4.7s (6% of total)

ival-sub: 4.1s (5.3% of total)

ival-add: 3.8s (4.9% of total)

ival-sin: 3.7s (4.8% of total)

ival-div: 3.7s (4.8% of total)

ival-log: 3.0s (3.9% of total)

ival-<=: 2.3s (3% of total)

ival-fabs: 2.2s (2.8% of total)

ival-exp: 2.1s (2.7% of total)

ival-expm1: 2.0s (2.5% of total)

ival-sqrt: 1.1s (1.5% of total)

ival-log1p: 1.1s (1.4% of total)

ival-<: 953.0ms (1.2% of total)

ival-neg: 663.0ms (0.9% of total)

ival-atan: 647.0ms (0.8% of total)

ival-and: 586.0ms (0.8% of total)

ival-fmin: 418.0ms (0.5% of total)

exact: 327.0ms (0.4% of total)

ival->: 276.0ms (0.4% of total)

ival-cbrt: 258.0ms (0.3% of total)

ival-assert: 146.0ms (0.2% of total)

ival-true: 65.0ms (0.1% of total)

Bogosity

simplify38.2s (12.6%)

Memory

1 286.9MiB live, 33 322.8MiB allocated

Algorithm

248×	egg-herbie

Rules

2 256 832×	`lower-fma.f32`
2 256 144×	`lower-fma.f64`
793 332×	`lower-*.f32`
792 310×	`lower-*.f64`
503 304×	`lower-+.f32`

Stop Event

330×	iter limit
177×	node limit
71×	saturated

Counts

30 432 → 29 947

soundness31.8s (10.5%)

Memory

232.1MiB live, 20 153.3MiB allocated

Rules

1 265 146×	`lower-fma.f32`
1 264 828×	`lower-fma.f64`
622 788×	`lower-*.f32`
622 312×	`lower-*.f64`
336 210×	`lower-+.f32`

Stop Event

197×	iter limit
134×	node limit
25×	fuel
3×	done
2×	saturated

Compiler

Compiled 11 639 to 5 602 computations (51.9% saved)

rewrite26.5s (8.7%)

Memory

-238.5MiB live, 26 470.6MiB allocated

Rules

497 284×	`lower-fma.f32`
496 596×	`lower-fma.f64`
456 388×	`lower-*.f32`
455 370×	`lower-*.f64`
413 252×	`lower-/.f32`

Stop Event

223×	iter limit
110×	node limit

Counts

1 757 → 66 987

localize23.8s (7.8%)

Memory

-92.6MiB live, 25 120.2MiB allocated

Samples

9.2s	5 986×	2	valid
6.1s	9 825×	1	valid
3.5s	11 122×	0	valid
602.0ms	374×	3	valid
178.0ms	772×	0	invalid
40.0ms	78×	0	exit
19.0ms	3×	5	exit

Compiler

Compiled 25 886 to 3 512 computations (86.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 15.6s

ival-mult: 2.8s (17.9% of total)

ival-div: 2.1s (13.2% of total)

adjust: 2.0s (12.5% of total)

ival-tan: 1.8s (11.6% of total)

ival-add: 1.3s (8.5% of total)

const: 923.0ms (5.9% of total)

ival-cos: 765.0ms (4.9% of total)

ival-sub: 752.0ms (4.8% of total)

ival-pow: 641.0ms (4.1% of total)

ival-exp: 559.0ms (3.6% of total)

ival-log: 496.0ms (3.2% of total)

ival-sin: 416.0ms (2.7% of total)

ival-sqrt: 304.0ms (2% of total)

ival-expm1: 199.0ms (1.3% of total)

ival-neg: 114.0ms (0.7% of total)

ival-log1p: 113.0ms (0.7% of total)

ival-cosh: 91.0ms (0.6% of total)

ival-pow2: 70.0ms (0.4% of total)

ival-cbrt: 60.0ms (0.4% of total)

exact: 41.0ms (0.3% of total)

ival-atan2: 34.0ms (0.2% of total)

ival-atan: 33.0ms (0.2% of total)

ival-true: 22.0ms (0.1% of total)

ival-assert: 12.0ms (0.1% of total)

ival-fabs: 7.0ms (0% of total)

ival-copysign: 3.0ms (0% of total)

prune23.2s (7.6%)

Memory: -992.0MiB live, 31 802.9MiB allocated
Counts: 114 304 → 2 238
Compiler: Compiled 88 528 to 40 690 computations (54% saved)

eval21.3s (7%)

Memory: 874.9MiB live, 26 596.9MiB allocated
Compiler: Compiled 3 350 233 to 259 817 computations (92.2% saved)

regimes6.1s (2%)

Memory

-136.1MiB live, 6 669.1MiB allocated

Counts

4 944 → 361

Calls

43 calls:

1.4s	x
631.0ms	(/.f64 #s(literal 1 binary64) n)
414.0ms	eps
300.0ms	(-.f64 (cos.f64 (+.f64 x eps)) (cos.f64 x))
217.0ms	n

Compiler

Compiled 3 370 to 2 243 computations (33.4% saved)

explain5.6s (1.8%)

Memory

-104.5MiB live, 6 788.7MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	4161	28
`log.f64`	`#f`	sensitivity	760	4
`/.f64`	`#f`	u/u	439	0
`sqrt.f64`	`#f`	oflow-rescue	416	0
`+.f64`	`#f`	cancellation	324	3
`/.f64`	`#f`	u/n	115	0
`pow.f64`	`(pow.f64 (+.f64 x #s(literal 1 binary64)) (/.f64 #s(literal 1 binary64) n))`	sensitivity	70	1
`sqrt.f64`	`#f`	uflow-rescue	28	0
`/.f64`	`(/.f64 (.f64 eps (-.f64 (exp.f64 (.f64 (+.f64 a b) eps)) #s(literal 1 binary64))) (.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))))`	n/u	23	0
↳	`(*.f64 b eps)`	underflow	141
↳	`(-.f64 (exp.f64 (*.f64 a eps)) #s(literal 1 binary64))`	underflow	143
↳	`(-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))`	underflow	141
↳	`(.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64)))`	underflow	230
↳	`(*.f64 a eps)`	underflow	143
`-.f64`	`#f`	nan-rescue	13	0
`/.f64`	`(/.f64 (-.f64 #s(literal 1 binary64) (cos.f64 x)) (*.f64 x x))`	n/o	3	0
↳	`(*.f64 x x)`	overflow	58
`exp.f64`	`#f`	sensitivity	2	0
`cos.f64`	`(cos.f64 (+.f64 x eps))`	sensitivity	1	1
`/.f64`	`(/.f64 (-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64)) (-.f64 (exp.f64 x) #s(literal 1 binary64)))`	o/o	1	0
↳	`(exp.f64 (*.f64 #s(literal 2 binary64) x))`	overflow	1
↳	`(-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64))`	overflow	1
↳	`(exp.f64 x)`	overflow	1
↳	`(-.f64 (exp.f64 x) #s(literal 1 binary64))`	overflow	1
`tan.f64`	`(tan.f64 (+.f64 x eps))`	sensitivity	1	1

Confusion

	Predicted +	Predicted -
+	5208	22
-	145	1793

Precision

0.9729123855781805

Recall

0.9957934990439771

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5208	13	9
-	145	20	1773

Precision?

0.9693650204233197

Recall?

0.9982791586998088

Freqs

test

number	freq
0	1815
1	4556
2	641
3	105
4	51

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	28	0	0
-	0	0	0

Precision?

1.0

Recall?

1.0

Samples

1.7s	2 640×	2	valid
1.1s	5 674×	1	valid
454.0ms	5 850×	0	valid
141.0ms	172×	3	valid

Compiler

Compiled 2 197 to 763 computations (65.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.8s

ival-tan: 786.0ms (28.4% of total)

ival-sub: 272.0ms (9.8% of total)

adjust: 234.0ms (8.5% of total)

ival-cos: 204.0ms (7.4% of total)

ival-div: 191.0ms (6.9% of total)

ival-log: 189.0ms (6.8% of total)

ival-exp: 174.0ms (6.3% of total)

ival-sin: 162.0ms (5.9% of total)

ival-mult: 118.0ms (4.3% of total)

ival-add: 115.0ms (4.2% of total)

ival-pow: 100.0ms (3.6% of total)

ival-log1p: 59.0ms (2.1% of total)

ival-sqrt: 58.0ms (2.1% of total)

ival-atan: 26.0ms (0.9% of total)

ival-expm1: 22.0ms (0.8% of total)

ival-cbrt: 19.0ms (0.7% of total)

ival-true: 12.0ms (0.4% of total)

ival-neg: 11.0ms (0.4% of total)

exact: 8.0ms (0.3% of total)

ival-assert: 6.0ms (0.2% of total)

series5.5s (1.8%)

Memory

-236.8MiB live, 6 224.0MiB allocated

Counts

1 757 → 30 432

Calls

510 calls:

Time	Variable		Point	Expression
137.0ms	x	@	-inf	((- (cbrt (+ x 1)) (cbrt x)) (* (/ (cbrt (/ -1 x)) (cbrt (neg x))) 1/3) (/ (cbrt (/ -1 x)) (cbrt (neg x))) (cbrt (/ -1 x)) (pow x 1/3) (- (cbrt (+ x 1)) (pow x 1/3)) (cbrt (+ x 1)) (/ (/ 1/3 (pow x 1/6)) (sqrt x)) (- (cbrt (+ x 1)) (cbrt x)) (/ 1/3 (pow x 1/6)) (pow x 1/6) (/ (/ 1/3 (cbrt x)) (cbrt x)) (- (cbrt (+ x 1)) (cbrt x)) (/ 1/3 (cbrt x)) (cbrt x) (- (cbrt (+ x 1)) (cbrt x)) (* (cbrt (pow (cbrt x) -6)) 1/3) (cbrt (pow (cbrt x) -6)) (pow (cbrt x) -6) (cbrt (neg x)))
93.0ms	x	@	0	((- (cbrt (+ x 1)) (cbrt x)) (* (cbrt (/ 1 (* x x))) 1/3) (cbrt (/ 1 (* x x))) (/ 1 (* x x)) (- (cbrt (+ x 1)) (cbrt x)) (cbrt (+ x 1)) (cbrt x) (- (cbrt (+ x 1)) (pow (sqrt x) 2/3)) (cbrt (+ x 1)) (+ x 1) (pow (sqrt x) 2/3) (- (cbrt (+ x 1)) (* (pow x 2/9) (pow x 1/9))) (* (pow x 2/9) (pow x 1/9)) (- (cbrt (+ (* (pow x 5/6) (pow x 1/6)) 1)) (cbrt x)) (cbrt (+ (* (pow x 5/6) (pow x 1/6)) 1)) (+ (* (pow x 5/6) (pow x 1/6)) 1) (pow x 5/6) (sqrt x) (pow x 2/9) (pow x 1/9) (pow x 1/6))
92.0ms	x	@	inf	((pow (cbrt x) 1/2) (/ (/ 1/3 (pow (cbrt x) 1/2)) (sqrt x)) (- (cbrt (+ x 1)) (cbrt x)) (/ 1/3 (pow (cbrt x) 1/2)) (- (cbrt (+ x 1)) (cbrt (neg x))) (cbrt (+ x 1)) (cbrt (neg x)) (neg x) (* (pow x -1/6) (/ 1 (sqrt x))) (- (cbrt (+ x 1)) (cbrt x)) (* (* (pow x -1/6) (/ 1 (sqrt x))) 1/3) (pow x -1/6) (- (cbrt (+ x 1)) (cbrt x)) (* (pow (cbrt x) -2) 1/3) (pow (cbrt x) -2) (cbrt x) (/ (/ (/ 1/3 (sqrt x)) (pow x 1/12)) (pow x 1/12)) (/ (/ 1/3 (sqrt x)) (pow x 1/12)) (- (cbrt (+ x 1)) (cbrt x)) (/ 1/3 (sqrt x)) (pow x 1/12))
82.0ms	x	@	inf	((- (cbrt (+ x 1)) (cbrt x)) (* (/ (cbrt (/ -1 x)) (cbrt (neg x))) 1/3) (/ (cbrt (/ -1 x)) (cbrt (neg x))) (cbrt (/ -1 x)) (pow x 1/3) (- (cbrt (+ x 1)) (pow x 1/3)) (cbrt (+ x 1)) (/ (/ 1/3 (pow x 1/6)) (sqrt x)) (- (cbrt (+ x 1)) (cbrt x)) (/ 1/3 (pow x 1/6)) (pow x 1/6) (/ (/ 1/3 (cbrt x)) (cbrt x)) (- (cbrt (+ x 1)) (cbrt x)) (/ 1/3 (cbrt x)) (cbrt x) (- (cbrt (+ x 1)) (cbrt x)) (* (cbrt (pow (cbrt x) -6)) 1/3) (cbrt (pow (cbrt x) -6)) (pow (cbrt x) -6) (cbrt (neg x)))
81.0ms	x	@	0	((- (cbrt (+ x 1)) (cbrt x)) (* (/ (cbrt (/ -1 x)) (cbrt (neg x))) 1/3) (/ (cbrt (/ -1 x)) (cbrt (neg x))) (cbrt (/ -1 x)) (pow x 1/3) (- (cbrt (+ x 1)) (pow x 1/3)) (cbrt (+ x 1)) (/ (/ 1/3 (pow x 1/6)) (sqrt x)) (- (cbrt (+ x 1)) (cbrt x)) (/ 1/3 (pow x 1/6)) (pow x 1/6) (/ (/ 1/3 (cbrt x)) (cbrt x)) (- (cbrt (+ x 1)) (cbrt x)) (/ 1/3 (cbrt x)) (cbrt x) (- (cbrt (+ x 1)) (cbrt x)) (* (cbrt (pow (cbrt x) -6)) 1/3) (cbrt (pow (cbrt x) -6)) (pow (cbrt x) -6) (cbrt (neg x)))

preprocess4.7s (1.5%)

Memory

-31.8MiB live, 5 665.8MiB allocated

Algorithm

28×	egg-herbie

Rules

27 478×	`lower-fma.f64`
27 478×	`lower-fma.f32`
10 768×	`div-sub`
10 444×	`sub-neg`
9 190×	`lower-*.f32`

Stop Event

56×	iter limit
50×	saturated
6×	node limit

Compiler

Compiled 12 085 to 4 041 computations (66.6% saved)

analyze1.9s (0.6%)

Memory

-278.0MiB live, 1 890.1MiB allocated

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
7.4%	4.5%	56.6%	38.9%	0%	0%	0%	1
22.3%	13.6%	47.5%	38.9%	0%	0%	0%	2
40.2%	23.5%	34.9%	38.9%	0%	2.7%	0%	3
53.4%	31.1%	27.2%	38.9%	0%	2.8%	0%	4
63%	36.3%	21.3%	38.9%	0%	3.6%	0%	5
65.9%	37.5%	19.4%	38.9%	0%	4.2%	0%	6
70.4%	38.8%	16.3%	38.9%	0%	6%	0%	7
73.6%	40.2%	14.4%	38.9%	0%	6.5%	0%	8
76.3%	40.9%	12.7%	38.9%	0%	7.5%	0%	9
78.4%	41.4%	11.4%	38.9%	0%	8.3%	0%	10
81.1%	42.4%	9.9%	38.9%	0%	8.8%	0%	11
82.3%	42.7%	9.2%	38.9%	0%	9.3%	0%	12

Compiler

Compiled 483 to 337 computations (30.2% saved)

bsearch888.0ms (0.3%)

Memory

-90.3MiB live, 938.9MiB allocated

Algorithm

68×	binary-search
56×	left-value

Stop Event

64×	narrow-enough
4×	predicate-same

Samples

388.0ms	3 453×	0	valid
64.0ms	449×	1	valid
55.0ms	226×	2	valid
52.0ms	695×	0	invalid
1.0ms	11×	0	exit

Compiler

Compiled 16 094 to 10 870 computations (32.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 382.0ms

ival-cos: 82.0ms (21.5% of total)

ival-mult: 77.0ms (20.2% of total)

ival-div: 36.0ms (9.4% of total)

ival-sub: 36.0ms (9.4% of total)

ival-pow: 34.0ms (8.9% of total)

ival-sqrt: 28.0ms (7.3% of total)

ival-neg: 26.0ms (6.8% of total)

ival-add: 22.0ms (5.8% of total)

adjust: 18.0ms (4.7% of total)

ival-expm1: 6.0ms (1.6% of total)

ival-sin: 4.0ms (1% of total)

ival-cbrt: 3.0ms (0.8% of total)

ival-true: 3.0ms (0.8% of total)

exact: 3.0ms (0.8% of total)

ival-exp: 2.0ms (0.5% of total)

ival-assert: 2.0ms (0.5% of total)

start1.0ms (0%)

Memory: 0.8MiB live, 0.8MiB allocated

end0.0ms (0%)

Memory: 0.4MiB live, 0.4MiB allocated

sample1.9min (37.5%)

simplify38.2s (12.6%)

soundness31.8s (10.5%)

rewrite26.5s (8.7%)

localize23.8s (7.8%)

prune23.2s (7.6%)

eval21.3s (7%)

regimes6.1s (2%)

explain5.6s (1.8%)

series5.5s (1.8%)

preprocess4.7s (1.5%)

analyze1.9s (0.6%)

bsearch888.0ms (0.3%)

start1.0ms (0%)

end0.0ms (0%)

Profiling