Metrics for Herbie run

Date:	Tuesday, August 6th, 2024
Commit:	2.2 on release
Hostname:	nightly with Racket 8.11.1
Seed:	2024219
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.8min (33.9%)

Memory

669.9MiB live, 122 273.7MiB allocated

Samples

28.5s	41 371×	2	valid
23.0s	145 198×	0	invalid
18.0s	92 238×	1	valid
8.9s	4 838×	5	exit
8.0s	94 570×	0	valid
2.2s	2 986×	3	valid
610.0ms	2 264×	1	exit
402.0ms	4 141×	0	exit
21.0ms	3×	2	exit
15.0ms	8×	4	exit
3.0ms	3×	4	valid
2.0ms	3×	3	exit

Precisions

Click to see histograms. Total time spent on operations: 1.2min

ival-tan: 12.3s (16.7% of total)

ival-pow: 8.8s (11.9% of total)

ival-mult: 5.5s (7.4% of total)

adjust: 5.4s (7.3% of total)

const: 5.1s (6.9% of total)

ival-div: 4.4s (6% of total)

ival-cos: 4.3s (5.8% of total)

ival-log: 3.5s (4.8% of total)

ival-sub: 3.5s (4.8% of total)

ival-sin: 3.4s (4.5% of total)

ival-add: 3.2s (4.3% of total)

ival-exp: 2.4s (3.2% of total)

ival-expm1: 2.0s (2.7% of total)

ival-fabs: 2.0s (2.7% of total)

ival-<=: 1.8s (2.5% of total)

ival-sqrt: 1.2s (1.7% of total)

ival-<: 1.1s (1.5% of total)

ival-log1p: 1.0s (1.4% of total)

ival-and: 566.0ms (0.8% of total)

ival-fmin: 476.0ms (0.6% of total)

ival-atan: 457.0ms (0.6% of total)

exact: 324.0ms (0.4% of total)

ival->: 309.0ms (0.4% of total)

ival-neg: 304.0ms (0.4% of total)

ival-cbrt: 289.0ms (0.4% of total)

ival-assert: 144.0ms (0.2% of total)

ival-true: 68.0ms (0.1% of total)

Bogosity

simplify1.2min (21.5%)

Memory

-264.4MiB live, 83 887.6MiB allocated

Algorithm

240×	egg-herbie

Rules

2 020 556×	`lower-fma.f32`
2 020 034×	`lower-fma.f64`
738 746×	`lower-*.f32`
737 740×	`lower-*.f64`
457 382×	`lower-+.f32`

Stop Event

315×	iter limit
165×	node limit
78×	saturated

Counts

28 860 → 28 445

rewrite37.0s (11.5%)

Memory

632.2MiB live, 49 024.4MiB allocated

Algorithm

106×	batch-egg-rewrite

Rules

454 656×	`lower-fma.f32`
454 140×	`lower-fma.f64`
401 792×	`lower-*.f32`
400 802×	`lower-*.f64`
372 478×	`lower-/.f32`

Stop Event

222×	iter limit
105×	node limit
3×	saturated

Counts

1 668 → 61 923

soundness27.2s (8.4%)

Memory

156.8MiB live, 17 357.8MiB allocated

Rules

1 047 068×	`lower-fma.f32`
1 046 866×	`lower-fma.f64`
533 320×	`lower-*.f32`
532 920×	`lower-*.f64`
297 166×	`lower-+.f32`

Stop Event

182×	iter limit
120×	node limit
21×	fuel
7×	done
2×	saturated

Compiler

Compiled 8 641 to 4 156 computations (51.9% saved)

localize25.3s (7.8%)

Memory

80.6MiB live, 31 257.2MiB allocated

Samples

8.0s	6 072×	2	valid
6.2s	10 805×	1	valid
2.1s	9 238×	0	valid
2.1s	787×	3	valid
61.0ms	12×	4	valid
39.0ms	182×	0	invalid
23.0ms	36×	0	exit
12.0ms	4×	5	exit

Compiler

Compiled 22 936 to 3 334 computations (85.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 14.9s

ival-mult: 2.7s (17.8% of total)

adjust: 1.9s (12.5% of total)

ival-tan: 1.7s (11.5% of total)

ival-div: 1.6s (10.7% of total)

ival-cos: 1.4s (9.4% of total)

ival-add: 1.2s (8.1% of total)

ival-sub: 805.0ms (5.4% of total)

const: 682.0ms (4.6% of total)

ival-log: 674.0ms (4.5% of total)

ival-pow: 559.0ms (3.7% of total)

ival-sin: 505.0ms (3.4% of total)

ival-exp: 365.0ms (2.4% of total)

ival-sqrt: 229.0ms (1.5% of total)

ival-log1p: 136.0ms (0.9% of total)

ival-neg: 109.0ms (0.7% of total)

ival-cbrt: 84.0ms (0.6% of total)

ival-pow2: 73.0ms (0.5% of total)

ival-cosh: 66.0ms (0.4% of total)

ival-expm1: 59.0ms (0.4% of total)

exact: 40.0ms (0.3% of total)

ival-atan2: 30.0ms (0.2% of total)

ival-atan: 25.0ms (0.2% of total)

ival-true: 23.0ms (0.2% of total)

ival-assert: 11.0ms (0.1% of total)

ival-fabs: 5.0ms (0% of total)

ival-copysign: 4.0ms (0% of total)

eval17.7s (5.5%)

Memory: 642.6MiB live, 25 336.5MiB allocated
Compiler: Compiled 3 050 957 to 239 332 computations (92.2% saved)

prune16.1s (5%)

Memory: -1 016.9MiB live, 24 908.5MiB allocated
Counts: 105 967 → 2 066
Compiler: Compiled 84 180 to 37 797 computations (55.1% saved)

explain5.9s (1.8%)

Memory

-94.2MiB live, 7 477.5MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	4198	35
`log.f64`	`#f`	sensitivity	768	0
`sqrt.f64`	`#f`	oflow-rescue	422	0
`/.f64`	`#f`	u/u	420	0
`+.f64`	`#f`	cancellation	314	0
`/.f64`	`#f`	u/n	120	0
`pow.f64`	`(pow.f64 (+.f64 x #s(literal 1 binary64)) (/.f64 #s(literal 1 binary64) n))`	sensitivity	74	0
`/.f64`	`(/.f64 (.f64 eps (-.f64 (exp.f64 (.f64 (+.f64 a b) eps)) #s(literal 1 binary64))) (.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))))`	n/u	25	0
↳	`(*.f64 b eps)`	underflow	152
↳	`(-.f64 (exp.f64 (*.f64 a eps)) #s(literal 1 binary64))`	underflow	146
↳	`(-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))`	underflow	152
↳	`(.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64)))`	underflow	236
↳	`(*.f64 a eps)`	underflow	146
`sqrt.f64`	`#f`	uflow-rescue	18	0
`-.f64`	`#f`	nan-rescue	12	0
`exp.f64`	`#f`	sensitivity	4	0
`/.f64`	`(/.f64 (-.f64 #s(literal 1 binary64) (cos.f64 x)) (*.f64 x x))`	n/o	3	0
↳	`(*.f64 x x)`	overflow	69
`/.f64`	`(/.f64 (-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64)) (-.f64 (exp.f64 x) #s(literal 1 binary64)))`	o/o	2	0
↳	`(exp.f64 (*.f64 #s(literal 2 binary64) x))`	overflow	2
↳	`(-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64))`	overflow	2
↳	`(exp.f64 x)`	overflow	2
↳	`(-.f64 (exp.f64 x) #s(literal 1 binary64))`	overflow	2
`sin.f64`	`(sin.f64 (+.f64 x eps))`	sensitivity	2	0
`tan.f64`	`(tan.f64 (+.f64 x eps))`	sensitivity	2	0
`cos.f64`	`(cos.f64 (+.f64 x eps))`	sensitivity	2	0
`tan.f64`	`(tan.f64 (+.f64 x eps))`	cancellation	1	0
`sin.f64`	`(sin.f64 (+.f64 x eps))`	cancellation	1	0

Confusion

	Predicted +	Predicted -
+	5211	16
-	176	1765

Precision

0.9673287544087619

Recall

0.9969389707289076

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5211	14	2
-	176	21	1744

Precision?

0.9636665437108078

Recall?

0.9996173713411135

Freqs

test

number	freq
0	1781
1	4584
2	660
3	88
4	55

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	28	0	0
-	0	0	0

Precision?

1.0

Recall?

1.0

Samples

1.7s	2 616×	2	valid
1.1s	5 810×	1	valid
466.0ms	5 738×	0	valid
93.0ms	172×	3	valid

Compiler

Compiled 2 522 to 980 computations (61.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.6s

ival-tan: 703.0ms (26.6% of total)

adjust: 251.0ms (9.5% of total)

ival-cos: 211.0ms (8% of total)

ival-sub: 197.0ms (7.5% of total)

ival-log: 196.0ms (7.4% of total)

ival-sin: 194.0ms (7.4% of total)

ival-div: 183.0ms (6.9% of total)

ival-exp: 171.0ms (6.5% of total)

ival-add: 111.0ms (4.2% of total)

ival-pow: 102.0ms (3.9% of total)

ival-mult: 88.0ms (3.3% of total)

ival-log1p: 69.0ms (2.6% of total)

ival-sqrt: 62.0ms (2.4% of total)

ival-expm1: 22.0ms (0.8% of total)

ival-atan: 19.0ms (0.7% of total)

ival-neg: 18.0ms (0.7% of total)

ival-cbrt: 16.0ms (0.6% of total)

ival-true: 12.0ms (0.5% of total)

exact: 8.0ms (0.3% of total)

ival-assert: 6.0ms (0.2% of total)

preprocess5.0s (1.5%)

Memory

39.5MiB live, 5 880.9MiB allocated

Algorithm

28×	egg-herbie

Rules

27 478×	`lower-fma.f64`
27 478×	`lower-fma.f32`
10 768×	`div-sub`
10 444×	`sub-neg`
9 190×	`lower-*.f32`

Stop Event

56×	iter limit
50×	saturated
6×	node limit

Compiler

Compiled 10 172 to 3 496 computations (65.6% saved)

regimes4.1s (1.3%)

Memory

-121.6MiB live, 5 662.5MiB allocated

Counts

4 092 → 310

Calls

43 calls:

988.0ms	x
432.0ms	eps
192.0ms	a
166.0ms	(/.f64 #s(literal 1 binary64) n)
157.0ms	(/.f64 (-.f64 #s(literal 1 binary64) (cos.f64 x)) (*.f64 x x))

Compiler

Compiled 2 929 to 1 941 computations (33.7% saved)

series2.9s (0.9%)

Memory

-72.5MiB live, 3 878.5MiB allocated

Counts

1 668 → 28 860

Calls

3909 calls:

Time	Variable		Expression
63.0ms	x	@	(pow x (/ 1 n))
59.0ms	x	@	(- (cbrt (+ x 1)) (* (pow x 2/9) (pow x 1/9)))
55.0ms	n	@	(/ (- (log (+ 1 x)) (log x)) n)
43.0ms	x	@	(pow (exp 1/3) (log x))
38.0ms	n	@	(* n (log n))

analyze1.7s (0.5%)

Memory

159.4MiB live, 1 999.6MiB allocated

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
7.4%	4.5%	56.6%	38.9%	0%	0%	0%	1
22.3%	13.6%	47.5%	38.9%	0%	0%	0%	2
40.2%	23.5%	34.9%	38.9%	0%	2.7%	0%	3
53.4%	31.1%	27.2%	38.9%	0%	2.8%	0%	4
63%	36.3%	21.3%	38.9%	0%	3.6%	0%	5
65.9%	37.5%	19.4%	38.9%	0%	4.2%	0%	6
70.4%	38.8%	16.3%	38.9%	0%	6%	0%	7
73.6%	40.2%	14.4%	38.9%	0%	6.5%	0%	8
76.3%	40.9%	12.7%	38.9%	0%	7.5%	0%	9
78.4%	41.4%	11.4%	38.9%	0%	8.3%	0%	10
81.1%	42.4%	9.9%	38.9%	0%	8.8%	0%	11
82.3%	42.7%	9.2%	38.9%	0%	9.3%	0%	12

Compiler

Compiled 483 to 337 computations (30.2% saved)

bsearch1.0s (0.3%)

Memory

-55.0MiB live, 1 192.0MiB allocated

Algorithm

73×	binary-search
30×	left-value

Stop Event

71×	narrow-enough
2×	predicate-same

Samples

273.0ms	3 430×	0	valid
138.0ms	444×	2	valid
135.0ms	690×	1	valid
44.0ms	613×	0	invalid
5.0ms	54×	0	exit
3.0ms	12×	3	valid

Compiler

Compiled 16 146 to 10 556 computations (34.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 446.0ms

ival-pow: 146.0ms (32.7% of total)

ival-mult: 69.0ms (15.5% of total)

ival-div: 56.0ms (12.6% of total)

ival-sub: 41.0ms (9.2% of total)

adjust: 35.0ms (7.8% of total)

ival-sqrt: 24.0ms (5.4% of total)

ival-add: 20.0ms (4.5% of total)

ival-neg: 18.0ms (4% of total)

ival-cos: 16.0ms (3.6% of total)

ival-sin: 6.0ms (1.3% of total)

ival-expm1: 4.0ms (0.9% of total)

ival-true: 4.0ms (0.9% of total)

exact: 3.0ms (0.7% of total)

ival-exp: 2.0ms (0.4% of total)

ival-assert: 2.0ms (0.4% of total)

end0.0ms (0%)

Memory: 0.3MiB live, 0.3MiB allocated

sample1.8min (33.9%)

simplify1.2min (21.5%)

rewrite37.0s (11.5%)

soundness27.2s (8.4%)

localize25.3s (7.8%)

eval17.7s (5.5%)

prune16.1s (5%)

explain5.9s (1.8%)

preprocess5.0s (1.5%)

regimes4.1s (1.3%)

series2.9s (0.9%)

analyze1.7s (0.5%)

bsearch1.0s (0.3%)

end0.0ms (0%)

Profiling