Metrics for Herbie run

Date:	Thursday, July 25th, 2024
Commit:	3139208f on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024207
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.9min (34.8%)

Memory

-158.0MiB live, 131 008.4MiB allocated

Samples

29.4s	40 971×	2	valid
24.0s	146 574×	0	invalid
19.7s	92 392×	1	valid
8.8s	4 879×	5	exit
8.0s	94 413×	0	valid
2.2s	3 275×	3	valid
390.0ms	2 279×	1	exit
373.0ms	4 160×	0	exit
93.0ms	97×	2	exit
55.0ms	117×	4	valid
17.0ms	8×	4	exit
7.0ms	5×	3	exit

Precisions

Click to see histograms. Total time spent on operations: 1.3min

ival-tan: 13.8s (17.7% of total)

ival-pow: 9.0s (11.5% of total)

ival-mult: 6.1s (7.8% of total)

const: 5.4s (7% of total)

ival-cos: 4.5s (5.7% of total)

adjust: 4.5s (5.7% of total)

ival-sub: 4.2s (5.4% of total)

ival-div: 4.1s (5.3% of total)

ival-sin: 4.0s (5.2% of total)

ival-add: 3.3s (4.2% of total)

ival-log: 3.2s (4.2% of total)

ival-fabs: 2.5s (3.2% of total)

ival-exp: 2.2s (2.9% of total)

ival-expm1: 2.1s (2.7% of total)

ival-<=: 2.0s (2.5% of total)

ival-<: 1.3s (1.6% of total)

ival-sqrt: 1.2s (1.5% of total)

ival-log1p: 1.1s (1.4% of total)

ival-fmin: 666.0ms (0.9% of total)

ival-and: 610.0ms (0.8% of total)

ival->: 486.0ms (0.6% of total)

ival-neg: 427.0ms (0.5% of total)

exact: 419.0ms (0.5% of total)

ival-atan: 405.0ms (0.5% of total)

ival-cbrt: 240.0ms (0.3% of total)

ival-assert: 169.0ms (0.2% of total)

ival-true: 67.0ms (0.1% of total)

Bogosity

simplify1.2min (21.3%)

Memory

-145.9MiB live, 81 091.9MiB allocated

Algorithm

242×	egg-herbie

Rules

1 892 576×	`lower-fma.f32`
1 892 072×	`lower-fma.f64`
719 040×	`lower-*.f32`
718 144×	`lower-*.f64`
411 222×	`lower-+.f32`

Stop Event

316×	iter limit
157×	node limit
90×	saturated

Counts

22 440 → 22 041

rewrite39.7s (12.1%)

Memory

481.7MiB live, 46 442.8MiB allocated

Algorithm

107×	batch-egg-rewrite

Rules

495 970×	`lower-fma.f32`
495 470×	`lower-fma.f64`
412 458×	`lower-*.f32`
411 578×	`lower-*.f64`
357 796×	`lower-/.f32`

Stop Event

221×	iter limit
104×	node limit
4×	saturated
1×	unsound

Counts

1 349 → 72 328

soundness30.7s (9.4%)

Memory

-124.7MiB live, 18 470.3MiB allocated

Rules

1 133 912×	`lower-fma.f32`
1 133 652×	`lower-fma.f64`
578 326×	`lower-*.f32`
577 884×	`lower-*.f64`
299 300×	`lower-+.f32`

Stop Event

193×	iter limit
128×	node limit
23×	fuel
5×	done
2×	saturated

Compiler

Compiled 9 094 to 4 819 computations (47% saved)

eval19.6s (6%)

Memory: 732.8MiB live, 26 545.8MiB allocated
Compiler: Compiled 3 134 934 to 257 711 computations (91.8% saved)

prune16.3s (5%)

Memory: -898.0MiB live, 27 673.1MiB allocated
Counts: 111 004 → 2 184
Compiler: Compiled 80 814 to 39 035 computations (51.7% saved)

localize15.6s (4.8%)

Memory

478.3MiB live, 19 000.7MiB allocated

Samples

3.3s	6 706×	1	valid
2.9s	14 979×	0	valid
2.6s	3 421×	2	valid
1.4s	708×	3	valid
347.0ms	1 332×	0	invalid
106.0ms	90×	5	exit
58.0ms	126×	0	exit
15.0ms	18×	4	valid
13.0ms	12×	1	exit

Compiler

Compiled 16 202 to 2 660 computations (83.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 8.1s

ival-mult: 1.7s (20.8% of total)

ival-div: 1.6s (19.3% of total)

adjust: 778.0ms (9.6% of total)

ival-add: 778.0ms (9.6% of total)

const: 419.0ms (5.2% of total)

ival-sub: 386.0ms (4.8% of total)

ival-cos: 383.0ms (4.7% of total)

ival-tan: 375.0ms (4.6% of total)

ival-neg: 342.0ms (4.2% of total)

ival-pow: 306.0ms (3.8% of total)

ival-log: 242.0ms (3% of total)

ival-sin: 156.0ms (1.9% of total)

ival-sqrt: 146.0ms (1.8% of total)

ival-exp: 136.0ms (1.7% of total)

ival-log1p: 113.0ms (1.4% of total)

ival-cbrt: 68.0ms (0.8% of total)

ival-atan2: 50.0ms (0.6% of total)

exact: 47.0ms (0.6% of total)

ival-pow2: 44.0ms (0.5% of total)

ival-cosh: 30.0ms (0.4% of total)

ival-true: 22.0ms (0.3% of total)

ival-expm1: 21.0ms (0.3% of total)

ival-atan: 14.0ms (0.2% of total)

ival-assert: 11.0ms (0.1% of total)

ival-fabs: 3.0ms (0% of total)

explain6.3s (1.9%)

Memory

-20.1MiB live, 6 975.5MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	4146	39
`log.f64`	`#f`	sensitivity	767	0
`/.f64`	`#f`	u/u	435	0
`sqrt.f64`	`#f`	oflow-rescue	434	0
`+.f64`	`#f`	cancellation	318	0
`/.f64`	`#f`	u/n	93	0
`pow.f64`	`(pow.f64 (+.f64 x #s(literal 1 binary64)) (/.f64 #s(literal 1 binary64) n))`	sensitivity	80	0
`/.f64`	`(/.f64 (.f64 eps (-.f64 (exp.f64 (.f64 (+.f64 a b) eps)) #s(literal 1 binary64))) (.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))))`	n/u	27	0
↳	`(*.f64 b eps)`	underflow	148
↳	`(-.f64 (exp.f64 (*.f64 a eps)) #s(literal 1 binary64))`	underflow	147
↳	`(-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))`	underflow	148
↳	`(.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64)))`	underflow	237
↳	`(*.f64 a eps)`	underflow	147
`sqrt.f64`	`#f`	uflow-rescue	24	0
`-.f64`	`#f`	nan-rescue	16	0
`cos.f64`	`(cos.f64 (+.f64 x eps))`	sensitivity	4	1
`/.f64`	`(/.f64 (-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64)) (-.f64 (exp.f64 x) #s(literal 1 binary64)))`	o/o	4	0
↳	`(exp.f64 (*.f64 #s(literal 2 binary64) x))`	overflow	4
↳	`(-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64))`	overflow	4
↳	`(exp.f64 x)`	overflow	4
↳	`(-.f64 (exp.f64 x) #s(literal 1 binary64))`	overflow	4
`sin.f64`	`(sin.f64 (+.f64 x eps))`	sensitivity	4	0
`tan.f64`	`(tan.f64 (+.f64 x eps))`	sensitivity	4	0
`/.f64`	`(/.f64 (-.f64 #s(literal 1 binary64) (cos.f64 x)) (*.f64 x x))`	n/o	3	0
↳	`(*.f64 x x)`	overflow	80
`exp.f64`	`#f`	sensitivity	2	3

Confusion

	Predicted +	Predicted -
+	5226	15
-	139	1788

Precision

0.9740913327120224

Recall

0.9971379507727532

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5226	11	4
-	139	30	1758

Precision?

0.9687384387717352

Recall?

0.9992367868727342

Freqs

test

number	freq
0	1803
1	4573
2	642
3	96
4	54

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	28	0	0
-	0	0	0

Precision?

1.0

Recall?

1.0

Samples

1.8s	2 498×	2	valid
1.2s	5 840×	1	valid
570.0ms	5 764×	0	valid
192.0ms	226×	3	valid
3.0ms	8×	4	valid

Compiler

Compiled 2 522 to 980 computations (61.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 3.0s

ival-tan: 790.0ms (26.4% of total)

ival-sub: 352.0ms (11.8% of total)

ival-div: 289.0ms (9.7% of total)

ival-cos: 252.0ms (8.4% of total)

adjust: 210.0ms (7% of total)

ival-log: 206.0ms (6.9% of total)

ival-sin: 154.0ms (5.1% of total)

ival-add: 149.0ms (5% of total)

ival-mult: 140.0ms (4.7% of total)

ival-exp: 124.0ms (4.1% of total)

ival-pow: 88.0ms (2.9% of total)

ival-sqrt: 64.0ms (2.1% of total)

ival-log1p: 60.0ms (2% of total)

ival-atan: 26.0ms (0.9% of total)

ival-expm1: 23.0ms (0.8% of total)

ival-neg: 18.0ms (0.6% of total)

ival-cbrt: 15.0ms (0.5% of total)

exact: 13.0ms (0.4% of total)

ival-true: 12.0ms (0.4% of total)

ival-assert: 6.0ms (0.2% of total)

preprocess4.9s (1.5%)

Memory

187.5MiB live, 5 880.9MiB allocated

Algorithm

28×	egg-herbie

Rules

27 478×	`lower-fma.f64`
27 478×	`lower-fma.f32`
10 768×	`div-sub`
10 444×	`sub-neg`
9 190×	`lower-*.f32`

Stop Event

56×	iter limit
50×	saturated
6×	node limit

Compiler

Compiled 9 580 to 3 592 computations (62.5% saved)

regimes4.6s (1.4%)

Memory

86.3MiB live, 6 686.6MiB allocated

Counts

4 708 → 326

Calls

43 calls:

1.3s	x
362.0ms	eps
239.0ms	a
201.0ms	(exp.f64 x)
177.0ms	(-.f64 (/.f64 #s(literal 1 binary64) (sqrt.f64 x)) (/.f64 #s(literal 1 binary64) (sqrt.f64 (+.f64 x #s(literal 1 binary64)))))

Compiler

Compiled 3 047 to 2 024 computations (33.6% saved)

series2.8s (0.9%)

Memory

-101.4MiB live, 3 681.0MiB allocated

Counts

1 349 → 22 440

Calls

4560 calls:

Time	Variable		Point	Expression
58.0ms	x	@	0	(pow (exp 1/3) (log x))
52.0ms	x	@	0	(+ (/ (+ (/ 1/6 (* n (* n n))) (+ (/ 1/3 n) (/ -1/2 (* n n)))) (* x x)) (/ (+ (/ 1/24 (pow n 4)) (+ (+ (/ 11/24 (* n n)) (/ -1/4 n)) (/ -1/4 (* n (* n n))))) (* x (* x x))))
49.0ms	N	@	0	(log (/ 1 (atan2 1 (+ (* N N) (+ N 1)))))
46.0ms	b_2	@	-inf	(/ 1 (- (* b_2 b_2) (* a c)))
42.0ms	c	@	inf	(/ (- (neg b) (sqrt (- (* b b) (* 4 (* a c))))) (* 2 a))

bsearch1.9s (0.6%)

Memory

138.0MiB live, 2 302.3MiB allocated

Algorithm

68×	binary-search
45×	left-value

Stop Event

65×	narrow-enough
3×	predicate-same

Samples

504.0ms	5 892×	0	valid
416.0ms	1 916×	1	valid
306.0ms	769×	2	valid
115.0ms	1 351×	0	invalid
15.0ms	168×	0	exit
8.0ms	25×	3	valid
3.0ms	5×	1	exit
2.0ms	6×	4	valid

Compiler

Compiled 13 093 to 9 612 computations (26.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.0s

ival-pow: 308.0ms (29.9% of total)

ival-mult: 116.0ms (11.3% of total)

ival-sub: 111.0ms (10.8% of total)

ival-neg: 109.0ms (10.6% of total)

ival-div: 96.0ms (9.3% of total)

adjust: 69.0ms (6.7% of total)

ival-sqrt: 56.0ms (5.4% of total)

ival-add: 50.0ms (4.9% of total)

ival-cbrt: 41.0ms (4% of total)

ival-cos: 31.0ms (3% of total)

ival-sin: 13.0ms (1.3% of total)

exact: 7.0ms (0.7% of total)

ival-expm1: 7.0ms (0.7% of total)

ival-true: 7.0ms (0.7% of total)

ival-exp: 5.0ms (0.5% of total)

ival-assert: 4.0ms (0.4% of total)

analyze1.6s (0.5%)

Memory

114.8MiB live, 2 147.8MiB allocated

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
7.4%	4.5%	56.6%	38.9%	0%	0%	0%	1
22.3%	13.6%	47.5%	38.9%	0%	0%	0%	2
40.2%	23.5%	34.9%	38.9%	0%	2.7%	0%	3
53.4%	31.1%	27.2%	38.9%	0%	2.8%	0%	4
63%	36.3%	21.3%	38.9%	0%	3.6%	0%	5
65.9%	37.5%	19.4%	38.9%	0%	4.2%	0%	6
70.4%	38.8%	16.3%	38.9%	0%	6%	0%	7
73.6%	40.2%	14.4%	38.9%	0%	6.5%	0%	8
76.3%	40.9%	12.7%	38.9%	0%	7.5%	0%	9
78.4%	41.4%	11.4%	38.9%	0%	8.3%	0%	10
81.1%	42.4%	9.9%	38.9%	0%	8.8%	0%	11
82.3%	42.7%	9.2%	38.9%	0%	9.3%	0%	12

Compiler

Compiled 483 to 337 computations (30.2% saved)

end0.0ms (0%)

Memory: 0.5MiB live, 0.5MiB allocated

sample1.9min (34.8%)

simplify1.2min (21.3%)

rewrite39.7s (12.1%)

soundness30.7s (9.4%)

eval19.6s (6%)

prune16.3s (5%)

localize15.6s (4.8%)

explain6.3s (1.9%)

preprocess4.9s (1.5%)

regimes4.6s (1.4%)

series2.8s (0.9%)

bsearch1.9s (0.6%)

analyze1.6s (0.5%)

end0.0ms (0%)

Profiling