Metrics for Herbie run

Date:	Tuesday, August 6th, 2024
Commit:	2.2 on release
Hostname:	nightly with Racket 8.11.1
Seed:	2024219
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample3.4min (25.1%)

Memory

418.3MiB live, 246 890.8MiB allocated

Samples

59.0s	121 391×	1	valid
37.6s	280 563×	0	valid
31.0s	14 248×	5	exit
16.5s	24 123×	2	valid
7.5s	3 218×	3	valid
5.9s	35 075×	0	exit
3.9s	10 785×	1	exit
3.1s	20 651×	0	invalid
2.6s	11 116×	1	invalid
524.0ms	33×	4	exit
338.0ms	738×	2	invalid
266.0ms	20×	3	exit
71.0ms	17×	4	valid
23.0ms	11×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 2.4min

ival-pow: 26.0s (17.8% of total)

ival-mult: 18.9s (12.9% of total)

ival-cos: 17.6s (12% of total)

ival-sin: 16.5s (11.3% of total)

ival-div: 11.6s (7.9% of total)

adjust: 10.0s (6.8% of total)

ival-pow2: 8.4s (5.7% of total)

ival-sub: 6.2s (4.2% of total)

ival-add: 6.0s (4.1% of total)

ival-exp: 5.4s (3.7% of total)

ival-log: 4.5s (3.1% of total)

ival-sqrt: 3.6s (2.5% of total)

ival-neg: 2.4s (1.7% of total)

const: 1.5s (1% of total)

ival-<: 1.2s (0.8% of total)

ival-pi: 1.0s (0.7% of total)

ival-atan2: 924.0ms (0.6% of total)

ival-hypot: 860.0ms (0.6% of total)

ival-tan: 512.0ms (0.3% of total)

ival-atan: 489.0ms (0.3% of total)

ival-acos: 478.0ms (0.3% of total)

exact: 440.0ms (0.3% of total)

ival-asin: 355.0ms (0.2% of total)

ival-cbrt: 321.0ms (0.2% of total)

ival-and: 321.0ms (0.2% of total)

ival-true: 316.0ms (0.2% of total)

ival-assert: 217.0ms (0.1% of total)

ival-log1p: 193.0ms (0.1% of total)

ival-fabs: 147.0ms (0.1% of total)

ival-<=: 137.0ms (0.1% of total)

ival-==: 1.0ms (0% of total)

ival-or: 0.0ms (0% of total)

Bogosity

simplify2.6min (19%)

Memory

-519.5MiB live, 193 372.9MiB allocated

Algorithm

458×	egg-herbie

Rules

3 564 130×	`lower-fma.f32`
3 563 110×	`lower-fma.f64`
1 753 866×	`lower-*.f32`
1 749 594×	`lower-*.f64`
942 940×	`lower-+.f32`

Stop Event

610×	iter limit
317×	node limit
141×	saturated

Counts

83 748 → 83 070

rewrite1.3min (9.4%)

Memory

779.4MiB live, 102 794.0MiB allocated

Algorithm

203×	batch-egg-rewrite

Rules

903 662×	`lower-fma.f32`
902 670×	`lower-fma.f64`
874 932×	`lower-*.f32`
870 806×	`lower-*.f64`
689 758×	`lower-/.f32`

Stop Event

416×	iter limit
200×	node limit
2×	unsound
1×	saturated

Counts

3 401 → 156 326

soundness1.2min (8.8%)

Memory

150.8MiB live, 52 929.4MiB allocated

Rules

2 302 080×	`lower-fma.f32`
2 301 406×	`lower-fma.f64`
1 531 192×	`lower-*.f32`
1 528 358×	`lower-*.f64`
769 690×	`lower-+.f32`

Stop Event

435×	iter limit
291×	node limit
45×	fuel
7×	done
2×	saturated

Compiler

Compiled 58 782 to 27 570 computations (53.1% saved)

localize57.8s (7.1%)

Memory

104.3MiB live, 79 525.9MiB allocated

Samples

17.6s	14 498×	1	valid
7.8s	28 426×	0	valid
6.8s	3 914×	2	valid
4.1s	664×	5	exit
1.3s	3 090×	0	invalid
748.0ms	418×	3	valid
613.0ms	117×	4	exit
318.0ms	561×	1	exit
301.0ms	181×	1	invalid
40.0ms	3×	3	exit
33.0ms	3×	2	exit
16.0ms	73×	0	exit
13.0ms	14×	2	invalid
7.0ms	6×	3	invalid

Compiler

Compiled 91 548 to 7 937 computations (91.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 31.3s

ival-mult: 7.2s (23.1% of total)

ival-cos: 4.8s (15.4% of total)

ival-sin: 4.6s (14.7% of total)

ival-div: 3.0s (9.7% of total)

adjust: 2.5s (8% of total)

ival-add: 2.0s (6.5% of total)

const: 1.3s (4.3% of total)

ival-pow2: 879.0ms (2.8% of total)

ival-sqrt: 831.0ms (2.7% of total)

ival-sub: 827.0ms (2.6% of total)

ival-exp: 473.0ms (1.5% of total)

ival-log: 456.0ms (1.5% of total)

ival-atan2: 403.0ms (1.3% of total)

ival-pow: 387.0ms (1.2% of total)

ival-neg: 266.0ms (0.8% of total)

ival-pi: 159.0ms (0.5% of total)

ival-cbrt: 147.0ms (0.5% of total)

ival-atan: 139.0ms (0.4% of total)

ival-acos: 126.0ms (0.4% of total)

ival-tan: 124.0ms (0.4% of total)

ival-log1p: 111.0ms (0.4% of total)

ival-hypot: 103.0ms (0.3% of total)

ival-fabs: 102.0ms (0.3% of total)

exact: 89.0ms (0.3% of total)

ival-asin: 58.0ms (0.2% of total)

ival-true: 48.0ms (0.2% of total)

ival-assert: 23.0ms (0.1% of total)

ival-cosh: 3.0ms (0% of total)

ival-expm1: 3.0ms (0% of total)

ival-tanh: 2.0ms (0% of total)

ival-sinh: 2.0ms (0% of total)

eval56.0s (6.9%)

Memory: 423.7MiB live, 83 593.2MiB allocated
Compiler: Compiled 12 910 116 to 795 223 computations (93.8% saved)

prune54.3s (6.7%)

Memory: -1 897.6MiB live, 90 001.7MiB allocated
Counts: 302 246 → 8 231
Compiler: Compiled 630 708 to 283 480 computations (55.1% saved)

regimes47.8s (5.9%)

Memory

359.4MiB live, 69 470.4MiB allocated

Counts

26 842 → 1 117

Calls

155 calls:

3.3s	phi2
3.3s	b
3.0s	phi1
3.0s	lambda1
2.5s	lambda2

Compiler

Compiled 31 624 to 17 499 computations (44.7% saved)

explain21.4s (2.6%)

Memory

-280.0MiB live, 29 670.3MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`cos.f64`	`#f`	sensitivity	1807	6
`+.f64`	`#f`	cancellation	1717	35
`sin.f64`	`#f`	sensitivity	1552	2
`sqrt.f64`	`#f`	oflow-rescue	1403	0
`-.f64`	`#f`	cancellation	952	8
`log.f64`	`#f`	sensitivity	601	1
`-.f64`	`#f`	nan-rescue	493	0
`/.f64`	`#f`	o/n	457	0
`/.f64`	`#f`	u/u	344	0
`/.f64`	`#f`	o/o	268	0
`*.f64`	`#f`	*no**	263	0
`/.f64`	`#f`	u/n	180	0
`exp.f64`	`#f`	sensitivity	167	26
`sqrt.f64`	`#f`	uflow-rescue	159	0
`/.f64`	`#f`	n/o	121	0
`*.f64`	`#f`	*nu**	111	0
`cbrt.f64`	`#f`	oflow-rescue	93	0
`/.f64`	`#f`	n/u	40	0
`*.f64`	`#f`	*uo**	35	0
`cbrt.f64`	`#f`	uflow-rescue	34	0
`*.f64`	`#f`	*ou**	34	0
`acos.f64`	`(acos.f64 (+.f64 (.f64 (sin.f64 phi1) (sin.f64 phi2)) (.f64 (*.f64 (cos.f64 phi1) (cos.f64 phi2)) (cos.f64 (-.f64 lambda1 lambda2)))))`	sensitivity	22	6
`pow.f64`	`#f`	sensitivity	8	0
`pow.f64`	`(pow.f64 (/.f64 #s(literal 1 binary64) (+.f64 #s(literal 1 binary64) (exp.f64 (neg.f64 t)))) c_p)`	uflow-rescue	6	0
↳	`(pow.f64 (/.f64 #s(literal 1 binary64) (+.f64 #s(literal 1 binary64) (exp.f64 (neg.f64 t)))) c_p)`	underflow	9
↳	`(/.f64 #s(literal 1 binary64) (+.f64 #s(literal 1 binary64) (exp.f64 (neg.f64 t))))`	underflow	6
`log.f64`	`#f`	oflow-rescue	4	0
`log.f64`	`(log.f64 (+.f64 (exp.f64 a) (exp.f64 b)))`	uflow-rescue	2	0
↳	`(+.f64 (exp.f64 a) (exp.f64 b))`	underflow	2
↳	`(exp.f64 a)`	underflow	128
↳	`(exp.f64 b)`	underflow	2

Confusion

	Predicted +	Predicted -
+	5717	78
-	1406	6111

Precision

0.8026112593008564

Recall

0.9865401207937877

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5717	46	32
-	1406	27	6084

Precision?

0.8008615897720957

Recall?

0.9944779982743744

Freqs

test

number	freq
0	6189
1	4746
2	1648
3	354
4	224
5	84
6	35
7	17
8	11
9	4

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	42	1	0
-	2	0	7

Precision?

0.9555555555555556

Recall?

1.0

Samples

3.9s	7 888×	1	valid
2.2s	2 038×	2	valid
2.2s	16 372×	0	valid
615.0ms	326×	3	valid

Compiler

Compiled 21 748 to 3 336 computations (84.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 7.1s

ival-sin: 1.7s (24.1% of total)

ival-cos: 1.1s (16% of total)

ival-mult: 966.0ms (13.6% of total)

ival-div: 547.0ms (7.7% of total)

ival-pow2: 449.0ms (6.3% of total)

adjust: 444.0ms (6.3% of total)

ival-sub: 316.0ms (4.5% of total)

ival-log: 299.0ms (4.2% of total)

ival-add: 297.0ms (4.2% of total)

ival-exp: 245.0ms (3.5% of total)

ival-sqrt: 178.0ms (2.5% of total)

ival-neg: 81.0ms (1.1% of total)

ival-tan: 63.0ms (0.9% of total)

ival-hypot: 61.0ms (0.9% of total)

ival-atan2: 55.0ms (0.8% of total)

ival-fabs: 47.0ms (0.7% of total)

ival-pi: 40.0ms (0.6% of total)

ival-atan: 27.0ms (0.4% of total)

ival-true: 26.0ms (0.4% of total)

ival-acos: 22.0ms (0.3% of total)

ival-pow: 21.0ms (0.3% of total)

ival-cbrt: 19.0ms (0.3% of total)

exact: 19.0ms (0.3% of total)

ival-assert: 12.0ms (0.2% of total)

ival-asin: 9.0ms (0.1% of total)

ival-log1p: 6.0ms (0.1% of total)

preprocess18.9s (2.3%)

Memory

145.1MiB live, 21 853.9MiB allocated

Algorithm

52×	egg-herbie

Rules

238 304×	`lower-fma.f64`
238 304×	`lower-fma.f32`
81 478×	`lower-*.f32`
81 146×	`lower-*.f64`
46 832×	`unsub-neg`

Stop Event

104×	iter limit
61×	saturated
43×	node limit

Compiler

Compiled 68 618 to 19 058 computations (72.2% saved)

analyze17.7s (2.2%)

Memory

-71.6MiB live, 21 214.4MiB allocated

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
17.2%	13.7%	65.7%	20.6%	0%	0%	0%	1
25%	19.6%	58.5%	20.6%	0%	1.3%	0%	2
35.2%	26.6%	48.9%	20.6%	0%	3.8%	0%	3
42.3%	31.7%	43.1%	20.6%	0%	4.5%	0%	4
47.9%	35.6%	38.7%	20.6%	0%	5.1%	0%	5
51%	37.6%	36.1%	20.6%	0%	5.7%	0%	6
54.4%	39.7%	33.2%	20.6%	0%	6.5%	0%	7
56.2%	40.7%	31.8%	20.6%	0%	6.8%	0%	8
59%	42.5%	29.5%	20.6%	0%	7.4%	0%	9
60.3%	43.2%	28.4%	20.6%	0%	7.7%	0%	10
62.1%	44.3%	27%	20.6%	0%	8.1%	0%	11
63.6%	45.1%	25.8%	20.6%	0%	8.5%	0%	12

Compiler

Compiled 1 826 to 990 computations (45.8% saved)

series16.9s (2.1%)

Memory

749.6MiB live, 22 147.2MiB allocated

Counts

3 401 → 83 748

Calls

16788 calls:

Time	Variable		Point	Expression
463.0ms	x	@	inf	(log (/ (+ 1 (sqrt (- 1 (* x x)))) x))
379.0ms	y-scale	@	-inf	(sqrt (+ (pow (- (/ (/ (+ (pow (* a (sin (* (/ angle 180) (PI)))) 2) (pow (* b (cos (* (/ angle 180) (PI)))) 2)) x-scale) x-scale) (/ (/ (+ (pow (* a (cos (* (/ angle 180) (PI)))) 2) (pow (* b (sin (* (/ angle 180) (PI)))) 2)) y-scale) y-scale)) 2) (pow (/ (/ (* (* (* 2 (- (pow b 2) (pow a 2))) (sin (* (/ angle 180) (PI)))) (cos (* (/ angle 180) (PI)))) x-scale) y-scale) 2)))
159.0ms	x	@	0	(log (* x 2))
119.0ms	s	@	inf	(/ (* (pow (/ 1 (+ 1 (exp (neg s)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg s))))) c_n)) (* (pow (/ 1 (+ 1 (exp (neg t)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg t))))) c_n)))
117.0ms	c_p	@	-inf	(/ (pow (/ 1 (+ 1 (exp (neg s)))) c_p) (pow (/ 1 (+ 1 (exp (neg t)))) c_p))

bsearch14.6s (1.8%)

Memory

-230.6MiB live, 18 092.7MiB allocated

Algorithm

350×	binary-search
204×	left-value

Stop Event

336×	narrow-enough
14×	predicate-same

Samples

6.9s	8 461×	1	valid
2.9s	13 625×	0	valid
1.3s	1 410×	2	valid
145.0ms	120×	3	valid
80.0ms	451×	0	invalid
71.0ms	131×	1	exit
1.0ms	2×	5	exit
0.0ms	2×	0	exit

Compiler

Compiled 130 992 to 87 700 computations (33% saved)

Precisions

Click to see histograms. Total time spent on operations: 10.1s

ival-cos: 2.5s (24.4% of total)

ival-sin: 2.0s (19.7% of total)

ival-mult: 1.6s (15.6% of total)

ival-pow2: 980.0ms (9.7% of total)

adjust: 841.0ms (8.3% of total)

ival-div: 679.0ms (6.7% of total)

ival-sub: 394.0ms (3.9% of total)

ival-add: 327.0ms (3.2% of total)

ival-sqrt: 163.0ms (1.6% of total)

ival-atan2: 162.0ms (1.6% of total)

ival-acos: 122.0ms (1.2% of total)

ival-atan: 101.0ms (1% of total)

ival-asin: 52.0ms (0.5% of total)

ival-tan: 46.0ms (0.5% of total)

ival-exp: 43.0ms (0.4% of total)

ival-pi: 38.0ms (0.4% of total)

ival-neg: 27.0ms (0.3% of total)

ival-hypot: 26.0ms (0.3% of total)

ival-true: 20.0ms (0.2% of total)

exact: 14.0ms (0.1% of total)

ival-fabs: 11.0ms (0.1% of total)

ival-assert: 10.0ms (0.1% of total)

ival-log: 7.0ms (0.1% of total)

ival-pow: 6.0ms (0.1% of total)

ival-log1p: 2.0ms (0% of total)

end0.0ms (0%)

Memory: 0.7MiB live, 0.7MiB allocated

sample3.4min (25.1%)

simplify2.6min (19%)

rewrite1.3min (9.4%)

soundness1.2min (8.8%)

localize57.8s (7.1%)

eval56.0s (6.9%)

prune54.3s (6.7%)

regimes47.8s (5.9%)

explain21.4s (2.6%)

preprocess18.9s (2.3%)

analyze17.7s (2.2%)

series16.9s (2.1%)

bsearch14.6s (1.8%)

end0.0ms (0%)

Profiling