Metrics for Herbie run

Date:	Tuesday, August 6th, 2024
Commit:	2.2 on release
Hostname:	nightly with Racket 8.11.1
Seed:	2024219
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample3.4min (22.6%)

Memory

1 200.9MiB live, 252 320.2MiB allocated

Samples

56.4s	121 391×	1	valid
37.5s	280 563×	0	valid
30.8s	14 248×	5	exit
16.9s	24 123×	2	valid
8.7s	3 218×	3	valid
6.6s	35 075×	0	exit
4.0s	10 785×	1	exit
3.2s	20 651×	0	invalid
2.1s	11 116×	1	invalid
413.0ms	33×	4	exit
321.0ms	738×	2	invalid
234.0ms	20×	3	exit
78.0ms	17×	4	valid
42.0ms	11×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 2.4min

ival-pow: 25.3s (17.5% of total)

ival-mult: 17.9s (12.4% of total)

ival-cos: 17.7s (12.2% of total)

ival-sin: 16.1s (11.1% of total)

ival-div: 12.4s (8.6% of total)

adjust: 10.0s (6.9% of total)

ival-pow2: 8.3s (5.7% of total)

ival-add: 6.5s (4.5% of total)

ival-sub: 6.5s (4.5% of total)

ival-exp: 5.6s (3.8% of total)

ival-log: 4.1s (2.9% of total)

ival-sqrt: 3.8s (2.6% of total)

ival-neg: 1.9s (1.3% of total)

const: 1.6s (1.1% of total)

ival-<: 1.4s (1% of total)

ival-atan2: 753.0ms (0.5% of total)

ival-tan: 678.0ms (0.5% of total)

ival-hypot: 631.0ms (0.4% of total)

ival-pi: 556.0ms (0.4% of total)

exact: 414.0ms (0.3% of total)

ival-acos: 385.0ms (0.3% of total)

ival-atan: 338.0ms (0.2% of total)

ival-and: 324.0ms (0.2% of total)

ival-true: 296.0ms (0.2% of total)

ival-cbrt: 287.0ms (0.2% of total)

ival-assert: 224.0ms (0.2% of total)

ival-fabs: 180.0ms (0.1% of total)

ival-<=: 163.0ms (0.1% of total)

ival-asin: 142.0ms (0.1% of total)

ival-log1p: 115.0ms (0.1% of total)

ival-==: 1.0ms (0% of total)

ival-or: 0.0ms (0% of total)

Bogosity

simplify2.8min (18.4%)

Memory

-725.9MiB live, 223 182.2MiB allocated

Algorithm

458×	egg-herbie

Rules

3 573 984×	`lower-fma.f32`
3 572 992×	`lower-fma.f64`
1 798 608×	`lower-*.f32`
1 794 348×	`lower-*.f64`
969 556×	`lower-+.f32`

Stop Event

609×	iter limit
327×	node limit
131×	saturated

Counts

99 060 → 98 395

prune2.0min (13%)

Memory: -750.9MiB live, 226 440.4MiB allocated
Counts: 293 852 → 7 540
Compiler: Compiled 626 521 to 268 531 computations (57.1% saved)

rewrite1.3min (9%)

Memory

1 018.2MiB live, 116 576.1MiB allocated

Algorithm

203×	batch-egg-rewrite

Rules

896 958×	`lower-fma.f32`
895 994×	`lower-fma.f64`
886 122×	`lower-*.f32`
881 990×	`lower-*.f64`
684 196×	`lower-/.f32`

Stop Event

415×	iter limit
201×	node limit
1×	saturated
1×	unsound

Counts

3 705 → 139 606

localize1.3min (8.6%)

Memory

616.2MiB live, 113 685.9MiB allocated

Samples

21.8s	16 288×	1	valid
9.9s	5 515×	2	valid
8.4s	25 959×	0	valid
6.5s	586×	5	exit
1.5s	193×	4	exit
1.2s	546×	3	valid
1.1s	1 669×	0	invalid
430.0ms	191×	1	invalid
365.0ms	721×	1	exit
206.0ms	9×	3	exit
100.0ms	286×	0	exit
35.0ms	5×	2	exit

Compiler

Compiled 119 689 to 9 219 computations (92.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 42.3s

ival-mult: 9.3s (21.9% of total)

ival-cos: 6.5s (15.4% of total)

ival-sin: 6.5s (15.3% of total)

adjust: 4.0s (9.5% of total)

ival-div: 3.7s (8.8% of total)

ival-add: 2.6s (6.2% of total)

ival-sub: 1.6s (3.8% of total)

ival-pow2: 1.6s (3.7% of total)

ival-sqrt: 1.2s (2.9% of total)

const: 1.1s (2.7% of total)

ival-exp: 749.0ms (1.8% of total)

ival-log: 585.0ms (1.4% of total)

ival-neg: 466.0ms (1.1% of total)

ival-atan2: 413.0ms (1% of total)

ival-log1p: 359.0ms (0.8% of total)

ival-pow: 299.0ms (0.7% of total)

ival-tan: 216.0ms (0.5% of total)

ival-hypot: 187.0ms (0.4% of total)

ival-cbrt: 158.0ms (0.4% of total)

ival-fabs: 125.0ms (0.3% of total)

ival-acos: 123.0ms (0.3% of total)

ival-asin: 114.0ms (0.3% of total)

ival-atan: 109.0ms (0.3% of total)

exact: 94.0ms (0.2% of total)

ival-pi: 86.0ms (0.2% of total)

ival-true: 49.0ms (0.1% of total)

ival-assert: 25.0ms (0.1% of total)

ival-cosh: 9.0ms (0% of total)

ival-expm1: 7.0ms (0% of total)

ival-copysign: 4.0ms (0% of total)

ival-sinh: 2.0ms (0% of total)

ival-tanh: 1.0ms (0% of total)

soundness1.2min (7.8%)

Memory

-446.8MiB live, 55 644.4MiB allocated

Rules

2 206 148×	`lower-fma.f32`
2 205 502×	`lower-fma.f64`
1 466 614×	`lower-*.f32`
1 463 588×	`lower-*.f64`
751 162×	`lower-+.f32`

Stop Event

422×	iter limit
280×	node limit
46×	fuel
6×	done

Compiler

Compiled 58 059 to 24 921 computations (57.1% saved)

eval57.9s (6.5%)

Memory: -817.2MiB live, 89 135.1MiB allocated
Compiler: Compiled 15 321 001 to 711 093 computations (95.4% saved)

regimes45.2s (5%)

Memory

-65.2MiB live, 70 558.4MiB allocated

Counts

22 771 → 1 005

Calls

155 calls:

3.0s	phi1
2.8s	phi2
2.5s	lambda1
2.5s	lambda2
2.0s	b

Compiler

Compiled 32 163 to 17 728 computations (44.9% saved)

explain21.6s (2.4%)

Memory

5.8MiB live, 32 208.2MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`cos.f64`	`#f`	sensitivity	1807	6
`+.f64`	`#f`	cancellation	1717	35
`sin.f64`	`#f`	sensitivity	1552	2
`sqrt.f64`	`#f`	oflow-rescue	1403	0
`-.f64`	`#f`	cancellation	952	8
`log.f64`	`#f`	sensitivity	601	1
`-.f64`	`#f`	nan-rescue	493	0
`/.f64`	`#f`	o/n	457	0
`/.f64`	`#f`	u/u	344	0
`/.f64`	`#f`	o/o	268	0
`*.f64`	`#f`	*no**	263	0
`/.f64`	`#f`	u/n	180	0
`exp.f64`	`#f`	sensitivity	167	26
`sqrt.f64`	`#f`	uflow-rescue	159	0
`/.f64`	`#f`	n/o	121	0
`*.f64`	`#f`	*nu**	111	0
`cbrt.f64`	`#f`	oflow-rescue	93	0
`/.f64`	`#f`	n/u	40	0
`*.f64`	`#f`	*uo**	35	0
`cbrt.f64`	`#f`	uflow-rescue	34	0
`*.f64`	`#f`	*ou**	34	0
`acos.f64`	`(acos.f64 (+.f64 (.f64 (sin.f64 phi1) (sin.f64 phi2)) (.f64 (*.f64 (cos.f64 phi1) (cos.f64 phi2)) (cos.f64 (-.f64 lambda1 lambda2)))))`	sensitivity	22	6
`pow.f64`	`#f`	sensitivity	8	0
`pow.f64`	`(pow.f64 (/.f64 #s(literal 1 binary64) (+.f64 #s(literal 1 binary64) (exp.f64 (neg.f64 t)))) c_p)`	uflow-rescue	6	0
↳	`(pow.f64 (/.f64 #s(literal 1 binary64) (+.f64 #s(literal 1 binary64) (exp.f64 (neg.f64 t)))) c_p)`	underflow	9
↳	`(/.f64 #s(literal 1 binary64) (+.f64 #s(literal 1 binary64) (exp.f64 (neg.f64 t))))`	underflow	6
`log.f64`	`#f`	oflow-rescue	4	0
`log.f64`	`(log.f64 (+.f64 (exp.f64 a) (exp.f64 b)))`	uflow-rescue	2	0
↳	`(+.f64 (exp.f64 a) (exp.f64 b))`	underflow	2
↳	`(exp.f64 a)`	underflow	128
↳	`(exp.f64 b)`	underflow	2

Confusion

	Predicted +	Predicted -
+	5717	78
-	1406	6111

Precision

0.8026112593008564

Recall

0.9865401207937877

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5717	46	32
-	1406	27	6084

Precision?

0.8008615897720957

Recall?

0.9944779982743744

Freqs

test

number	freq
0	6189
1	4746
2	1648
3	354
4	224
5	84
6	35
7	17
8	11
9	4

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	42	1	0
-	2	0	7

Precision?

0.9555555555555556

Recall?

1.0

Samples

4.3s	7 888×	1	valid
2.0s	16 372×	0	valid
2.0s	2 038×	2	valid
547.0ms	326×	3	valid

Compiler

Compiled 21 748 to 3 336 computations (84.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 6.6s

ival-sin: 1.6s (23.7% of total)

ival-cos: 1.1s (17.2% of total)

ival-mult: 952.0ms (14.4% of total)

ival-div: 566.0ms (8.6% of total)

adjust: 418.0ms (6.3% of total)

ival-pow2: 392.0ms (5.9% of total)

ival-sub: 357.0ms (5.4% of total)

ival-add: 253.0ms (3.8% of total)

ival-exp: 218.0ms (3.3% of total)

ival-log: 182.0ms (2.8% of total)

ival-sqrt: 161.0ms (2.4% of total)

ival-neg: 63.0ms (1% of total)

ival-tan: 51.0ms (0.8% of total)

ival-atan2: 50.0ms (0.8% of total)

ival-hypot: 40.0ms (0.6% of total)

ival-pi: 31.0ms (0.5% of total)

ival-atan: 27.0ms (0.4% of total)

ival-true: 25.0ms (0.4% of total)

ival-pow: 24.0ms (0.4% of total)

ival-acos: 23.0ms (0.3% of total)

exact: 19.0ms (0.3% of total)

ival-cbrt: 18.0ms (0.3% of total)

ival-assert: 12.0ms (0.2% of total)

ival-fabs: 11.0ms (0.2% of total)

ival-asin: 9.0ms (0.1% of total)

ival-log1p: 5.0ms (0.1% of total)

preprocess18.4s (2.1%)

Memory

-161.5MiB live, 21 975.2MiB allocated

Algorithm

52×	egg-herbie

Rules

238 304×	`lower-fma.f64`
238 304×	`lower-fma.f32`
81 478×	`lower-*.f32`
81 146×	`lower-*.f64`
46 832×	`unsub-neg`

Stop Event

104×	iter limit
61×	saturated
43×	node limit

Compiler

Compiled 65 440 to 18 314 computations (72% saved)

series16.5s (1.8%)

Memory

418.9MiB live, 24 860.1MiB allocated

Counts

3 705 → 99 060

Calls

12909 calls:

Time	Variable		Point	Expression
152.0ms	C	@	0	(/ (+ (* B B) (* -4 (* A C))) (neg (sqrt (* (* (+ (* B B) (* -4 (* A C))) F) (* 2 (- (+ A C) (sqrt (+ (pow (- A C) 2) (pow B 2)))))))))
139.0ms	s	@	inf	(/ (* (pow (/ 1 (+ 1 (exp (neg s)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg s))))) c_n)) (* (pow (/ 1 (+ 1 (exp (neg t)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg t))))) c_n)))
115.0ms	t	@	inf	(/ (* (pow (/ 1 (+ 1 (exp (neg s)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg s))))) c_n)) (* (pow (/ 1 (+ 1 (exp (neg t)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg t))))) c_n)))
103.0ms	c_p	@	-inf	(/ (pow (/ 1 (+ 1 (exp (neg s)))) c_p) (pow (/ 1 (+ 1 (exp (neg t)))) c_p))
92.0ms	phi1	@	0	(+ (* (+ (* -1/6 (* phi1 phi1)) 1) (cos phi2)) (* (* (cos phi2) (+ (* (* phi1 phi1) -1/5040) 1/120)) (* (* phi1 phi1) (* phi1 phi1))))

analyze16.4s (1.8%)

Memory

-32.0MiB live, 23 615.3MiB allocated

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
17.2%	13.7%	65.7%	20.6%	0%	0%	0%	1
25%	19.6%	58.5%	20.6%	0%	1.3%	0%	2
35.2%	26.6%	48.9%	20.6%	0%	3.8%	0%	3
42.3%	31.7%	43.1%	20.6%	0%	4.5%	0%	4
47.9%	35.6%	38.7%	20.6%	0%	5.1%	0%	5
51%	37.6%	36.1%	20.6%	0%	5.7%	0%	6
54.4%	39.7%	33.2%	20.6%	0%	6.5%	0%	7
56.2%	40.7%	31.8%	20.6%	0%	6.8%	0%	8
59%	42.5%	29.5%	20.6%	0%	7.4%	0%	9
60.3%	43.2%	28.4%	20.6%	0%	7.7%	0%	10
62.1%	44.3%	27%	20.6%	0%	8.1%	0%	11
63.6%	45.1%	25.8%	20.6%	0%	8.5%	0%	12

Compiler

Compiled 1 826 to 990 computations (45.8% saved)

bsearch9.1s (1%)

Memory

-42.6MiB live, 12 387.5MiB allocated

Algorithm

248×	binary-search
215×	left-value

Stop Event

242×	narrow-enough
6×	predicate-same

Samples

4.2s	5 374×	1	valid
1.9s	10 734×	0	valid
421.0ms	544×	2	valid
339.0ms	68×	3	valid
49.0ms	426×	0	invalid
44.0ms	94×	1	exit
4.0ms	43×	0	exit

Compiler

Compiled 95 883 to 60 076 computations (37.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 6.1s

ival-sin: 1.5s (24.1% of total)

ival-cos: 1.5s (23.7% of total)

ival-mult: 670.0ms (10.9% of total)

ival-sub: 465.0ms (7.6% of total)

ival-add: 397.0ms (6.5% of total)

adjust: 393.0ms (6.4% of total)

ival-pow2: 369.0ms (6% of total)

ival-div: 368.0ms (6% of total)

ival-sqrt: 92.0ms (1.5% of total)

ival-atan2: 88.0ms (1.4% of total)

ival-neg: 73.0ms (1.2% of total)

ival-tan: 62.0ms (1% of total)

ival-acos: 61.0ms (1% of total)

ival-hypot: 35.0ms (0.6% of total)

ival-atan: 32.0ms (0.5% of total)

ival-asin: 22.0ms (0.4% of total)

ival-exp: 20.0ms (0.3% of total)

ival-pi: 15.0ms (0.2% of total)

ival-true: 14.0ms (0.2% of total)

ival-fabs: 9.0ms (0.1% of total)

exact: 9.0ms (0.1% of total)

ival-assert: 8.0ms (0.1% of total)

ival-log: 7.0ms (0.1% of total)

ival-log1p: 2.0ms (0% of total)

end0.0ms (0%)

Memory: 0.9MiB live, 0.8MiB allocated

sample3.4min (22.6%)

simplify2.8min (18.4%)

prune2.0min (13%)

rewrite1.3min (9%)

localize1.3min (8.6%)

soundness1.2min (7.8%)

eval57.9s (6.5%)

regimes45.2s (5%)

explain21.6s (2.4%)

preprocess18.4s (2.1%)

series16.5s (1.8%)

analyze16.4s (1.8%)

bsearch9.1s (1%)

end0.0ms (0%)

Profiling