Metrics for Herbie run

Date:	Saturday, August 24th, 2024
Commit:	73092913 on zane-fix-unused
Hostname:	nightly with Racket 8.11.1
Seed:	2024237
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.8min (35.7%)

Memory

525.7MiB live, 122 534.7MiB allocated

Samples

27.9s	41 631×	2	valid
24.0s	144 735×	0	invalid
18.2s	92 071×	1	valid
9.3s	4 877×	5	exit
8.8s	94 506×	0	valid
2.2s	2 958×	3	valid
475.0ms	2 211×	1	exit
390.0ms	4 169×	0	exit
16.0ms	5×	4	exit
5.0ms	4×	2	exit
2.0ms	2×	4	valid
1.0ms	1×	3	exit

Precisions

Click to see histograms. Total time spent on operations: 1.3min

ival-tan: 12.6s (16.6% of total)

ival-pow: 9.3s (12.3% of total)

adjust: 5.4s (7.2% of total)

ival-cos: 5.4s (7.1% of total)

ival-mult: 5.3s (7% of total)

const: 5.2s (6.9% of total)

ival-div: 4.2s (5.6% of total)

ival-sub: 3.7s (4.9% of total)

ival-sin: 3.5s (4.6% of total)

ival-add: 3.2s (4.3% of total)

ival-log: 3.1s (4.1% of total)

ival-<=: 2.3s (3.1% of total)

ival-fabs: 2.3s (3.1% of total)

ival-exp: 2.2s (2.8% of total)

ival-expm1: 1.6s (2.1% of total)

ival-sqrt: 1.2s (1.6% of total)

ival-log1p: 1.1s (1.4% of total)

ival-<: 1.1s (1.4% of total)

ival-and: 586.0ms (0.8% of total)

ival-fmin: 572.0ms (0.8% of total)

ival-atan: 344.0ms (0.5% of total)

ival-neg: 343.0ms (0.5% of total)

exact: 341.0ms (0.5% of total)

ival->: 335.0ms (0.4% of total)

ival-cbrt: 256.0ms (0.3% of total)

ival-assert: 156.0ms (0.2% of total)

ival-true: 69.0ms (0.1% of total)

Bogosity

simplify51.2s (16.5%)

Memory

762.9MiB live, 54 009.0MiB allocated

Algorithm

246×	egg-herbie

Rules

2 134 648×	`lower-fma.f32`
2 134 030×	`lower-fma.f64`
779 270×	`lower-*.f32`
778 220×	`lower-*.f64`
478 252×	`lower-+.f32`

Stop Event

324×	iter limit
172×	node limit
77×	saturated

Counts

29 892 → 29 529

rewrite33.1s (10.7%)

Memory

-205.8MiB live, 38 713.8MiB allocated

Rules

483 044×	`lower-fma.f32`
482 426×	`lower-fma.f64`
449 472×	`lower-*.f32`
448 430×	`lower-*.f64`
403 782×	`lower-/.f32`

Stop Event

219×	iter limit
108×	node limit
3×	saturated

Counts

1 722 → 63 688

soundness28.2s (9.1%)

Memory

213.8MiB live, 17 157.4MiB allocated

Rules

1 084 086×	`lower-fma.f32`
1 083 794×	`lower-fma.f64`
584 368×	`lower-*.f32`
583 840×	`lower-*.f64`
314 632×	`lower-+.f32`

Stop Event

193×	iter limit
128×	node limit
22×	fuel
6×	done
2×	saturated

Compiler

Compiled 9 889 to 4 723 computations (52.2% saved)

localize23.7s (7.6%)

Memory

-171.1MiB live, 27 089.2MiB allocated

Samples

6.7s	10 309×	1	valid
6.0s	5 215×	2	valid
3.4s	11 456×	0	valid
1.6s	637×	3	valid
128.0ms	67×	5	exit
75.0ms	19×	4	valid
53.0ms	168×	0	invalid
17.0ms	33×	0	exit

Compiler

Compiled 24 163 to 3 470 computations (85.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 14.3s

ival-mult: 2.3s (16.1% of total)

ival-div: 2.2s (15.6% of total)

adjust: 2.0s (14.1% of total)

ival-tan: 1.4s (9.6% of total)

ival-add: 1.3s (8.9% of total)

ival-cos: 952.0ms (6.7% of total)

const: 794.0ms (5.6% of total)

ival-sub: 584.0ms (4.1% of total)

ival-pow: 552.0ms (3.9% of total)

ival-log: 476.0ms (3.3% of total)

ival-sin: 397.0ms (2.8% of total)

ival-exp: 380.0ms (2.7% of total)

ival-sqrt: 205.0ms (1.4% of total)

ival-log1p: 163.0ms (1.1% of total)

ival-neg: 149.0ms (1% of total)

ival-pow2: 146.0ms (1% of total)

ival-cbrt: 114.0ms (0.8% of total)

ival-expm1: 70.0ms (0.5% of total)

exact: 42.0ms (0.3% of total)

ival-true: 25.0ms (0.2% of total)

ival-atan2: 20.0ms (0.1% of total)

ival-atan: 12.0ms (0.1% of total)

ival-assert: 12.0ms (0.1% of total)

ival-fabs: 1.0ms (0% of total)

prune20.7s (6.7%)

Memory: -628.5MiB live, 29 366.3MiB allocated
Counts: 107 548 → 1 991
Compiler: Compiled 78 117 to 34 874 computations (55.4% saved)

eval20.2s (6.5%)

Memory: -170.8MiB live, 25 371.7MiB allocated
Compiler: Compiled 3 203 035 to 247 629 computations (92.3% saved)

explain6.6s (2.1%)

Memory

-109.2MiB live, 6 999.0MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	4135	29
`log.f64`	`#f`	sensitivity	763	0
`/.f64`	`#f`	u/u	434	0
`sqrt.f64`	`#f`	oflow-rescue	424	0
`+.f64`	`#f`	cancellation	350	0
`/.f64`	`#f`	u/n	118	0
`pow.f64`	`(pow.f64 (+.f64 x #s(literal 1 binary64)) (/.f64 #s(literal 1 binary64) n))`	sensitivity	65	0
`/.f64`	`(/.f64 (.f64 eps (-.f64 (exp.f64 (.f64 (+.f64 a b) eps)) #s(literal 1 binary64))) (.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))))`	n/u	35	0
↳	`(*.f64 b eps)`	underflow	136
↳	`(-.f64 (exp.f64 (*.f64 a eps)) #s(literal 1 binary64))`	underflow	145
↳	`(-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))`	underflow	136
↳	`(.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64)))`	underflow	239
↳	`(*.f64 a eps)`	underflow	145
`-.f64`	`#f`	nan-rescue	27	0
`sqrt.f64`	`#f`	uflow-rescue	18	0
`cos.f64`	`(cos.f64 (+.f64 x eps))`	sensitivity	1	0
`/.f64`	`(/.f64 (-.f64 #s(literal 1 binary64) (cos.f64 x)) (*.f64 x x))`	n/o	1	0
↳	`(*.f64 x x)`	overflow	65
`exp.f64`	`(exp.f64 (*.f64 a x))`	sensitivity	1	0
`/.f64`	`(/.f64 (-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64)) (-.f64 (exp.f64 x) #s(literal 1 binary64)))`	o/n	1	0
↳	`(exp.f64 (*.f64 #s(literal 2 binary64) x))`	overflow	1
↳	`(-.f64 (exp.f64 (*.f64 #s(literal 2 binary64) x)) #s(literal 1 binary64))`	overflow	1
`sin.f64`	`(sin.f64 (+.f64 x eps))`	sensitivity	1	0
`tan.f64`	`(tan.f64 (+.f64 x eps))`	sensitivity	1	0

Confusion

	Predicted +	Predicted -
+	5203	15
-	144	1806

Precision

0.9730690106601833

Recall

0.9971253353775393

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5203	14	1
-	144	14	1792

Precision?

0.9706046511627907

Recall?

0.9998083556918359

Freqs

test

number	freq
0	1821
1	4545
2	638
3	102
4	62

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	28	0	0
-	0	0	0

Precision?

1.0

Recall?

1.0

Samples

2.1s	2 638×	2	valid
1.3s	5 756×	1	valid
530.0ms	5 744×	0	valid
181.0ms	198×	3	valid

Compiler

Compiled 2 197 to 763 computations (65.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 3.5s

ival-tan: 979.0ms (28.1% of total)

adjust: 290.0ms (8.3% of total)

ival-div: 287.0ms (8.2% of total)

ival-pow: 264.0ms (7.6% of total)

ival-cos: 244.0ms (7% of total)

ival-sub: 207.0ms (5.9% of total)

ival-log: 205.0ms (5.9% of total)

ival-sin: 162.0ms (4.6% of total)

ival-log1p: 153.0ms (4.4% of total)

ival-add: 151.0ms (4.3% of total)

ival-mult: 137.0ms (3.9% of total)

ival-exp: 136.0ms (3.9% of total)

ival-sqrt: 126.0ms (3.6% of total)

ival-cbrt: 44.0ms (1.3% of total)

ival-expm1: 27.0ms (0.8% of total)

ival-atan: 24.0ms (0.7% of total)

exact: 20.0ms (0.6% of total)

ival-true: 13.0ms (0.4% of total)

ival-neg: 11.0ms (0.3% of total)

ival-assert: 6.0ms (0.2% of total)

preprocess5.0s (1.6%)

Memory

16.0MiB live, 5 836.9MiB allocated

Algorithm

28×	egg-herbie

Rules

27 478×	`lower-fma.f64`
27 478×	`lower-fma.f32`
10 768×	`div-sub`
10 444×	`sub-neg`
9 190×	`lower-*.f32`

Stop Event

56×	iter limit
50×	saturated
6×	node limit

Compiler

Compiled 11 199 to 3 871 computations (65.4% saved)

regimes4.1s (1.3%)

Memory

68.7MiB live, 5 117.7MiB allocated

Counts

4 026 → 345

Calls

43 calls:

1.3s	x
235.0ms	(/.f64 #s(literal 1 binary64) n)
202.0ms	eps
173.0ms	b
172.0ms	n

Compiler

Compiled 2 960 to 1 958 computations (33.9% saved)

series3.9s (1.3%)

Memory

32.8MiB live, 4 812.5MiB allocated

Counts

1 722 → 29 892

Calls

3996 calls:

Time	Variable		Point	Expression
60.0ms	N	@	0	(pow (exp -1) (neg (log (atan2 1 (+ 1 (+ (* N N) N))))))
54.0ms	a	@	inf	(- (neg b) (sqrt (- (* b b) (* 4 (* a c)))))
52.0ms	x	@	-inf	(pow x (/ 1 n))
45.0ms	n	@	0	(* n (log n))
42.0ms	x	@	0	(* 1/3 (log x))

analyze1.6s (0.5%)

Memory

44.7MiB live, 2 195.5MiB allocated

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
7.4%	4.5%	56.6%	38.9%	0%	0%	0%	1
22.3%	13.6%	47.5%	38.9%	0%	0%	0%	2
40.2%	23.5%	34.9%	38.9%	0%	2.7%	0%	3
53.4%	31.1%	27.2%	38.9%	0%	2.8%	0%	4
63%	36.3%	21.3%	38.9%	0%	3.6%	0%	5
65.9%	37.5%	19.4%	38.9%	0%	4.2%	0%	6
70.4%	38.8%	16.3%	38.9%	0%	6%	0%	7
73.6%	40.2%	14.4%	38.9%	0%	6.5%	0%	8
76.3%	40.9%	12.7%	38.9%	0%	7.5%	0%	9
78.4%	41.4%	11.4%	38.9%	0%	8.3%	0%	10
81.1%	42.4%	9.9%	38.9%	0%	8.8%	0%	11
82.3%	42.7%	9.2%	38.9%	0%	9.3%	0%	12

Compiler

Compiled 483 to 337 computations (30.2% saved)

bsearch988.0ms (0.3%)

Memory

-33.1MiB live, 1 120.1MiB allocated

Algorithm

90×	binary-search
28×	left-value

Stop Event

87×	narrow-enough
3×	predicate-same

Samples

358.0ms	4 148×	0	valid
102.0ms	335×	2	valid
85.0ms	570×	1	valid
58.0ms	803×	0	invalid
4.0ms	47×	0	exit
1.0ms	3×	3	valid

Compiler

Compiled 20 087 to 13 315 computations (33.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 418.0ms

ival-mult: 87.0ms (20.8% of total)

ival-pow: 76.0ms (18.2% of total)

ival-div: 52.0ms (12.4% of total)

ival-sqrt: 40.0ms (9.6% of total)

ival-sub: 39.0ms (9.3% of total)

ival-add: 36.0ms (8.6% of total)

adjust: 25.0ms (6% of total)

ival-cos: 20.0ms (4.8% of total)

ival-neg: 18.0ms (4.3% of total)

ival-expm1: 5.0ms (1.2% of total)

ival-cbrt: 4.0ms (1% of total)

ival-sin: 4.0ms (1% of total)

ival-true: 4.0ms (1% of total)

exact: 3.0ms (0.7% of total)

ival-exp: 2.0ms (0.5% of total)

ival-assert: 2.0ms (0.5% of total)

start1.0ms (0%)

Memory: 1.0MiB live, 1.0MiB allocated

end0.0ms (0%)

Memory: 0.3MiB live, 0.3MiB allocated

sample1.8min (35.7%)

simplify51.2s (16.5%)

rewrite33.1s (10.7%)

soundness28.2s (9.1%)

localize23.7s (7.6%)

prune20.7s (6.7%)

eval20.2s (6.5%)

explain6.6s (2.1%)

preprocess5.0s (1.6%)

regimes4.1s (1.3%)

series3.9s (1.3%)

analyze1.6s (0.5%)

bsearch988.0ms (0.3%)

start1.0ms (0%)

end0.0ms (0%)

Profiling