Metrics for Herbie run

Date:	Sunday, August 25th, 2024
Commit:	a6ae8219 on bhargav-log-space
Hostname:	nightly with Racket 8.11.1
Seed:	2024238
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample3.4min (58.2%)

Memory

874.6MiB live, 217 663.6MiB allocated

Samples

59.0s	122 147×	1	valid
37.7s	280 114×	0	valid
31.7s	14 436×	5	exit
16.0s	23 824×	2	valid
7.0s	3 197×	3	valid
5.7s	34 764×	0	exit
4.2s	10 869×	1	exit
3.2s	11 484×	1	invalid
3.2s	20 681×	0	invalid
385.0ms	28×	4	exit
352.0ms	767×	2	invalid
209.0ms	30×	4	valid
189.0ms	17×	3	exit
21.0ms	11×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 2.4min

ival-pow: 26.3s (18% of total)

ival-mult: 18.5s (12.7% of total)

ival-cos: 18.3s (12.6% of total)

ival-sin: 16.2s (11.1% of total)

ival-div: 11.6s (8% of total)

adjust: 9.7s (6.7% of total)

ival-pow2: 8.4s (5.8% of total)

ival-sub: 6.1s (4.2% of total)

ival-add: 6.0s (4.1% of total)

ival-exp: 5.3s (3.7% of total)

ival-log: 4.2s (2.9% of total)

ival-sqrt: 3.8s (2.6% of total)

ival-neg: 2.0s (1.4% of total)

const: 1.5s (1.1% of total)

ival-<: 1.5s (1% of total)

ival-pi: 1.2s (0.8% of total)

ival-hypot: 883.0ms (0.6% of total)

ival-atan2: 765.0ms (0.5% of total)

ival-tan: 588.0ms (0.4% of total)

ival-acos: 488.0ms (0.3% of total)

exact: 405.0ms (0.3% of total)

ival-atan: 353.0ms (0.2% of total)

ival-<=: 333.0ms (0.2% of total)

ival-cbrt: 319.0ms (0.2% of total)

ival-and: 316.0ms (0.2% of total)

ival-true: 311.0ms (0.2% of total)

ival-assert: 221.0ms (0.2% of total)

ival-asin: 156.0ms (0.1% of total)

ival-fabs: 147.0ms (0.1% of total)

ival-log1p: 120.0ms (0.1% of total)

ival-==: 1.0ms (0% of total)

ival-or: 0.0ms (0% of total)

Bogosity

simplify42.4s (12.1%)

Memory

41.2MiB live, 45 211.6MiB allocated

Algorithm

154×	egg-herbie

Rules

1 323 190×	`lower-fma.f32`
1 322 844×	`lower-fma.f64`
414 004×	`lower-*.f32`
413 416×	`lower-*.f64`
265 782×	`lower-+.f32`

Stop Event

204×	iter limit
102×	node limit
52×	saturated

Counts

18 672 → 18 431

rewrite22.7s (6.5%)

Memory

160.1MiB live, 28 919.2MiB allocated

Rules

286 672×	`lower-fma.f32`
286 326×	`lower-fma.f64`
259 486×	`lower-*.f32`
258 900×	`lower-*.f64`
251 048×	`lower-/.f32`

Stop Event

140×	iter limit
68×	node limit

Counts

1 036 → 46 312

soundness20.1s (5.7%)

Memory

-174.0MiB live, 11 528.4MiB allocated

Rules

682 882×	`lower-fma.f32`
682 704×	`lower-fma.f64`
298 584×	`lower-*.f32`
298 344×	`lower-*.f64`
184 236×	`lower-+.f32`

Stop Event

112×	iter limit
75×	node limit
14×	fuel
4×	done

Compiler

Compiled 8 168 to 3 701 computations (54.7% saved)

analyze16.3s (4.6%)

Memory

-29.6MiB live, 19 846.0MiB allocated

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
17.2%	13.7%	65.7%	20.6%	0%	0%	0%	1
25%	19.6%	58.5%	20.6%	0%	1.3%	0%	2
35.2%	26.6%	48.9%	20.6%	0%	3.8%	0%	3
42.3%	31.7%	43.1%	20.6%	0%	4.5%	0%	4
47.9%	35.6%	38.7%	20.6%	0%	5.1%	0%	5
51%	37.6%	36.1%	20.6%	0%	5.7%	0%	6
54.4%	39.7%	33.2%	20.6%	0%	6.5%	0%	7
56.2%	40.7%	31.8%	20.6%	0%	6.8%	0%	8
59%	42.5%	29.5%	20.6%	0%	7.4%	0%	9
60.3%	43.2%	28.4%	20.6%	0%	7.7%	0%	10
62.1%	44.3%	27%	20.6%	0%	8.1%	0%	11
63.6%	45.1%	25.8%	20.6%	0%	8.5%	0%	12

Compiler

Compiled 1 826 to 990 computations (45.8% saved)

eval11.4s (3.2%)

Memory: 282.6MiB live, 15 196.2MiB allocated
Compiler: Compiled 1 812 116 to 142 068 computations (92.2% saved)

prune9.7s (2.8%)

Memory: -199.4MiB live, 13 990.8MiB allocated
Counts: 71 392 → 1 344
Compiler: Compiled 49 197 to 23 290 computations (52.7% saved)

localize9.1s (2.6%)

Memory

-139.5MiB live, 9 692.0MiB allocated

Samples

2.6s	12 026×	0	valid
2.0s	3 473×	1	valid
1.4s	1 340×	2	valid
148.0ms	569×	0	invalid

Compiler

Compiled 12 368 to 1 859 computations (85% saved)

Precisions

Click to see histograms. Total time spent on operations: 4.6s

ival-mult: 1.1s (23.9% of total)

ival-add: 657.0ms (14.1% of total)

ival-div: 573.0ms (12.3% of total)

adjust: 478.0ms (10.3% of total)

ival-log: 459.0ms (9.9% of total)

const: 264.0ms (5.7% of total)

ival-sub: 246.0ms (5.3% of total)

ival-cos: 241.0ms (5.2% of total)

ival-hypot: 128.0ms (2.8% of total)

ival-exp: 116.0ms (2.5% of total)

ival-log1p: 62.0ms (1.3% of total)

ival-neg: 59.0ms (1.3% of total)

ival-sin: 49.0ms (1.1% of total)

ival-cbrt: 40.0ms (0.9% of total)

ival-sqrt: 36.0ms (0.8% of total)

ival-pow: 33.0ms (0.7% of total)

ival-tan: 24.0ms (0.5% of total)

exact: 23.0ms (0.5% of total)

ival-pow2: 21.0ms (0.5% of total)

ival-true: 14.0ms (0.3% of total)

ival-assert: 7.0ms (0.2% of total)

ival-copysign: 4.0ms (0.1% of total)

ival-fabs: 2.0ms (0% of total)

preprocess6.0s (1.7%)

Memory

-79.7MiB live, 6 065.2MiB allocated

Algorithm

18×	egg-herbie

Rules

99 950×	`lower-fma.f32`
99 950×	`lower-fma.f64`
17 370×	`unsub-neg`
15 540×	`lower-*.f32`
15 500×	`lower-*.f64`

Stop Event

36×	iter limit
25×	saturated
11×	node limit

Compiler

Compiled 9 217 to 3 109 computations (66.3% saved)

regimes4.5s (1.3%)

Memory

79.0MiB live, 5 867.4MiB allocated

Counts

3 645 → 261

Calls

56 calls:

557.0ms	x
276.0ms	a
236.0ms	v
179.0ms	m
154.0ms	b

Compiler

Compiled 4 038 to 2 580 computations (36.1% saved)

explain2.6s (0.7%)

Memory

-134.2MiB live, 3 072.2MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`sqrt.f64`	`#f`	oflow-rescue	269	0
`log.f64`	`#f`	sensitivity	254	3
`+.f64`	`#f`	oflow-right	239	0
`cos.f64`	`(cos.f64 (/.f64 (+.f64 phi1 phi2) #s(literal 2 binary64)))`	sensitivity	204	0
`-.f64`	`#f`	cancellation	197	1
`log.f64`	`#f`	oflow-rescue	189	0
`*.f64`	`(.f64 R (sqrt.f64 (+.f64 (.f64 (.f64 (-.f64 lambda1 lambda2) (cos.f64 (/.f64 (+.f64 phi1 phi2) #s(literal 2 binary64)))) (.f64 (-.f64 lambda1 lambda2) (cos.f64 (/.f64 (+.f64 phi1 phi2) #s(literal 2 binary64))))) (*.f64 (-.f64 phi1 phi2) (-.f64 phi1 phi2)))))`	*no**	53	0
`cbrt.f64`	`(cbrt.f64 (/.f64 g (*.f64 #s(literal 2 binary64) a)))`	uflow-rescue	32	0
↳	`(/.f64 g (*.f64 #s(literal 2 binary64) a))`	underflow	31
`cbrt.f64`	`(cbrt.f64 (/.f64 g (*.f64 #s(literal 2 binary64) a)))`	oflow-rescue	31	0
↳	`(/.f64 g (*.f64 #s(literal 2 binary64) a))`	overflow	32
`log.f64`	`#f`	uflow-rescue	30	0
`+.f64`	`(+.f64 x (sqrt.f64 (+.f64 (*.f64 x x) #s(literal 1 binary64))))`	cancellation	30	0
`+.f64`	`#f`	nan-rescue	25	0
`/.f64`	`(/.f64 (.f64 a1 a2) (.f64 b1 b2))`	o/n	11	0
↳	`(*.f64 a1 a2)`	overflow	33
`/.f64`	`(/.f64 (.f64 a1 a2) (.f64 b1 b2))`	n/o	9	0
↳	`(*.f64 b1 b2)`	overflow	24
`*.f64`	`#f`	*nu**	9	0
`/.f64`	`(/.f64 (.f64 a1 a2) (.f64 b1 b2))`	u/n	8	0
↳	`(*.f64 a1 a2)`	underflow	32
`/.f64`	`(/.f64 (.f64 a1 a2) (.f64 b1 b2))`	n/u	4	0
↳	`(*.f64 b1 b2)`	underflow	24
`/.f64`	`(/.f64 (.f64 a1 a2) (.f64 b1 b2))`	o/o	3	0
↳	`(*.f64 a1 a2)`	overflow	33
↳	`(*.f64 b1 b2)`	overflow	24
`sqrt.f64`	`(sqrt.f64 (+.f64 (.f64 (.f64 (-.f64 lambda1 lambda2) (cos.f64 (/.f64 (+.f64 phi1 phi2) #s(literal 2 binary64)))) (.f64 (-.f64 lambda1 lambda2) (cos.f64 (/.f64 (+.f64 phi1 phi2) #s(literal 2 binary64))))) (.f64 (-.f64 phi1 phi2) (-.f64 phi1 phi2))))`	uflow-rescue	3	0
↳	`(*.f64 (-.f64 phi1 phi2) (-.f64 phi1 phi2))`	underflow	13
↳	`(.f64 (.f64 (-.f64 lambda1 lambda2) (cos.f64 (/.f64 (+.f64 phi1 phi2) #s(literal 2 binary64)))) (*.f64 (-.f64 lambda1 lambda2) (cos.f64 (/.f64 (+.f64 phi1 phi2) #s(literal 2 binary64)))))`	underflow	15
↳	`(+.f64 (.f64 (.f64 (-.f64 lambda1 lambda2) (cos.f64 (/.f64 (+.f64 phi1 phi2) #s(literal 2 binary64)))) (.f64 (-.f64 lambda1 lambda2) (cos.f64 (/.f64 (+.f64 phi1 phi2) #s(literal 2 binary64))))) (.f64 (-.f64 phi1 phi2) (-.f64 phi1 phi2)))`	underflow	3
`/.f64`	`(/.f64 (.f64 a1 a2) (.f64 b1 b2))`	u/u	2	0
↳	`(*.f64 a1 a2)`	underflow	32
↳	`(*.f64 b1 b2)`	underflow	24

Confusion

	Predicted +	Predicted -
+	519	764
-	536	2789

Precision

0.4919431279620853

Recall

0.4045206547155105

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	519	1	763
-	536	3	2786

Precision?

0.4910292728989613

Recall?

0.4053000779423227

Freqs

test

number	freq
0	3553
1	761
2	55
3	225
4	14

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	11	0	2
-	2	0	3

Precision?

0.8461538461538461

Recall?

0.8461538461538461

Samples

613.0ms	6 989×	0	valid
469.0ms	1 688×	1	valid
200.0ms	540×	2	valid

Compiler

Compiled 2 428 to 896 computations (63.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 825.0ms

ival-div: 211.0ms (25.6% of total)

ival-log: 152.0ms (18.4% of total)

ival-mult: 86.0ms (10.4% of total)

ival-exp: 81.0ms (9.8% of total)

ival-add: 57.0ms (6.9% of total)

ival-sub: 56.0ms (6.8% of total)

adjust: 53.0ms (6.4% of total)

ival-cos: 36.0ms (4.4% of total)

ival-hypot: 34.0ms (4.1% of total)

ival-tan: 11.0ms (1.3% of total)

ival-sin: 11.0ms (1.3% of total)

ival-sqrt: 8.0ms (1% of total)

ival-true: 8.0ms (1% of total)

ival-log1p: 7.0ms (0.8% of total)

ival-cbrt: 5.0ms (0.6% of total)

exact: 5.0ms (0.6% of total)

ival-assert: 4.0ms (0.5% of total)

series1.6s (0.5%)

Memory

117.8MiB live, 2 006.6MiB allocated

Counts

1 036 → 18 672

Calls

2487 calls:

Time	Variable		Point	Expression
69.0ms	b	@	inf	(log (/ 1 (+ (exp a) (exp b))))
34.0ms	a	@	inf	(+ (log (+ 1 (exp a))) (/ b (+ 1 (exp a))))
30.0ms	a	@	inf	(log (+ (exp a) (exp b)))
26.0ms	x	@	inf	(log (+ 1 (exp x)))
26.0ms	x	@	-inf	(* x 2/5)

bsearch362.0ms (0.1%)

Memory

-8.6MiB live, 451.7MiB allocated

Algorithm

59×	left-value
41×	binary-search

Stop Event

37×	narrow-enough
4×	predicate-same

Samples

144.0ms	2 417×	0	valid
49.0ms	287×	1	valid
1.0ms	33×	0	exit

Compiler

Compiled 9 649 to 5 839 computations (39.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 133.0ms

ival-exp: 25.0ms (18.8% of total)

ival-mult: 24.0ms (18% of total)

ival-hypot: 21.0ms (15.8% of total)

ival-div: 16.0ms (12% of total)

ival-sub: 15.0ms (11.3% of total)

ival-add: 9.0ms (6.8% of total)

ival-cos: 7.0ms (5.3% of total)

adjust: 6.0ms (4.5% of total)

ival-log: 5.0ms (3.8% of total)

ival-log1p: 3.0ms (2.3% of total)

ival-true: 2.0ms (1.5% of total)

ival-assert: 1.0ms (0.8% of total)

exact: 1.0ms (0.8% of total)

start1.0ms (0%)

Memory: 2.2MiB live, 2.2MiB allocated

end0.0ms (0%)

Memory: 0.6MiB live, 0.6MiB allocated

sample3.4min (58.2%)

simplify42.4s (12.1%)

rewrite22.7s (6.5%)

soundness20.1s (5.7%)

analyze16.3s (4.6%)

eval11.4s (3.2%)

prune9.7s (2.8%)

localize9.1s (2.6%)

preprocess6.0s (1.7%)

regimes4.5s (1.3%)

explain2.6s (0.7%)

series1.6s (0.5%)

bsearch362.0ms (0.1%)

start1.0ms (0%)

end0.0ms (0%)

Profiling