Metrics for Herbie run

Date:	Tuesday, August 13th, 2024
Commit:	bd96486d on zane-server-ci
Hostname:	nightly with Racket 8.11.1
Seed:	2024226
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.9min (33%)

Memory

14.4MiB live, 124 768.8MiB allocated

Samples

31.5s	41 495×	2	valid
22.1s	144 407×	0	invalid
18.8s	92 047×	1	valid
9.6s	4 980×	5	exit
8.8s	94 691×	0	valid
1.9s	2 932×	3	valid
537.0ms	2 295×	1	exit
402.0ms	4 278×	0	exit
55.0ms	12×	4	exit
9.0ms	3×	3	exit
3.0ms	3×	4	valid
1.0ms	2×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 1.3min

ival-tan: 14.2s (18.1% of total)

ival-pow: 10.0s (12.7% of total)

ival-mult: 5.6s (7.2% of total)

const: 5.4s (6.8% of total)

adjust: 5.2s (6.6% of total)

ival-cos: 4.7s (6% of total)

ival-sub: 4.0s (5.1% of total)

ival-sin: 4.0s (5.1% of total)

ival-div: 3.9s (5% of total)

ival-log: 3.8s (4.9% of total)

ival-add: 2.8s (3.5% of total)

ival-fabs: 2.3s (2.9% of total)

ival-exp: 2.3s (2.9% of total)

ival-<=: 1.9s (2.5% of total)

ival-expm1: 1.9s (2.4% of total)

ival-log1p: 1.3s (1.6% of total)

ival-sqrt: 1.2s (1.5% of total)

ival-neg: 873.0ms (1.1% of total)

ival-<: 779.0ms (1% of total)

ival-and: 577.0ms (0.7% of total)

ival-fmin: 418.0ms (0.5% of total)

ival-atan: 396.0ms (0.5% of total)

ival-cbrt: 395.0ms (0.5% of total)

exact: 335.0ms (0.4% of total)

ival->: 257.0ms (0.3% of total)

ival-assert: 146.0ms (0.2% of total)

ival-true: 71.0ms (0.1% of total)

Bogosity

simplify1.2min (21.2%)

Memory

715.8MiB live, 84 519.6MiB allocated

Algorithm

242×	egg-herbie

Rules

2 141 496×	`lower-fma.f32`
2 140 850×	`lower-fma.f64`
778 128×	`lower-*.f32`
777 186×	`lower-*.f64`
480 972×	`lower-+.f32`

Stop Event

319×	iter limit
170×	node limit
74×	saturated

Counts

29 448 → 28 964

rewrite40.4s (11.7%)

Memory

131.4MiB live, 50 148.9MiB allocated

Rules

464 520×	`lower-fma.f32`
463 872×	`lower-fma.f64`
412 674×	`lower-*.f32`
411 746×	`lower-*.f64`
400 266×	`lower-/.f32`

Stop Event

218×	iter limit
107×	node limit

Counts

1 681 → 64 176

soundness29.4s (8.5%)

Memory

39.6MiB live, 17 720.0MiB allocated

Rules

1 059 616×	`lower-fma.f32`
1 059 304×	`lower-fma.f64`
561 444×	`lower-*.f32`
561 016×	`lower-*.f64`
313 212×	`lower-+.f32`

Stop Event

191×	iter limit
126×	node limit
24×	fuel
4×	done
2×	saturated

Compiler

Compiled 11 997 to 5 707 computations (52.4% saved)

localize22.9s (6.6%)

Memory

-42.4MiB live, 26 776.6MiB allocated

Samples

7.3s	10 585×	1	valid
6.6s	5 607×	2	valid
2.6s	10 073×	0	valid
452.0ms	445×	3	valid
115.0ms	417×	0	invalid
81.0ms	199×	0	exit
56.0ms	25×	5	exit
23.0ms	41×	1	exit

Compiler

Compiled 24 458 to 3 364 computations (86.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 13.5s

ival-mult: 2.4s (17.8% of total)

ival-div: 1.8s (13.6% of total)

adjust: 1.8s (13.2% of total)

ival-add: 1.4s (10.5% of total)

ival-tan: 1.2s (8.9% of total)

ival-log: 746.0ms (5.5% of total)

const: 673.0ms (5% of total)

ival-cos: 609.0ms (4.5% of total)

ival-pow: 563.0ms (4.2% of total)

ival-sub: 520.0ms (3.8% of total)

ival-sin: 446.0ms (3.3% of total)

ival-exp: 369.0ms (2.7% of total)

ival-sqrt: 209.0ms (1.5% of total)

ival-pow2: 173.0ms (1.3% of total)

ival-log1p: 110.0ms (0.8% of total)

ival-cosh: 102.0ms (0.8% of total)

ival-cbrt: 96.0ms (0.7% of total)

ival-neg: 85.0ms (0.6% of total)

ival-expm1: 54.0ms (0.4% of total)

exact: 42.0ms (0.3% of total)

ival-true: 24.0ms (0.2% of total)

ival-atan2: 17.0ms (0.1% of total)

ival-atan: 12.0ms (0.1% of total)

ival-assert: 12.0ms (0.1% of total)

ival-fabs: 9.0ms (0.1% of total)

prune21.4s (6.2%)

Memory: -903.1MiB live, 28 983.4MiB allocated
Counts: 111 995 → 2 050
Compiler: Compiled 83 166 to 37 089 computations (55.4% saved)

eval20.2s (5.9%)

Memory: 447.3MiB live, 24 850.3MiB allocated
Compiler: Compiled 3 776 104 to 256 267 computations (93.2% saved)

explain6.3s (1.8%)

Memory

-95.3MiB live, 6 752.4MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	4130	41
`log.f64`	`#f`	sensitivity	761	1
`/.f64`	`#f`	u/u	441	0
`sqrt.f64`	`#f`	oflow-rescue	402	0
`+.f64`	`#f`	cancellation	353	1
`/.f64`	`#f`	u/n	111	0
`pow.f64`	`(pow.f64 (+.f64 x #s(literal 1 binary64)) (/.f64 #s(literal 1 binary64) n))`	sensitivity	72	0
`sqrt.f64`	`#f`	uflow-rescue	32	0
`/.f64`	`(/.f64 (.f64 eps (-.f64 (exp.f64 (.f64 (+.f64 a b) eps)) #s(literal 1 binary64))) (.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))))`	n/u	23	0
↳	`(*.f64 b eps)`	underflow	155
↳	`(-.f64 (exp.f64 (*.f64 a eps)) #s(literal 1 binary64))`	underflow	150
↳	`(-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))`	underflow	155
↳	`(.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64)))`	underflow	231
↳	`(*.f64 a eps)`	underflow	150
`-.f64`	`#f`	nan-rescue	10	0
`/.f64`	`(/.f64 (-.f64 #s(literal 1 binary64) (cos.f64 x)) (*.f64 x x))`	n/o	5	0
↳	`(*.f64 x x)`	overflow	89
`exp.f64`	`(exp.f64 (neg.f64 x))`	sensitivity	1	1
`sin.f64`	`(sin.f64 (+.f64 x eps))`	sensitivity	1	1
`tan.f64`	`(tan.f64 (+.f64 x eps))`	sensitivity	1	1

Confusion

	Predicted +	Predicted -
+	5197	16
-	164	1791

Precision

0.9694086924081328

Recall

0.9969307500479571

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5197	14	2
-	164	30	1761

Precision?

0.9641073080481036

Recall?

0.9996163437559946

Freqs

test

number	freq
0	1807
1	4565
2	654
3	98
4	44

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	28	0	0
-	0	0	0

Precision?

1.0

Recall?

1.0

Samples

1.7s	2 572×	2	valid
1.3s	5 756×	1	valid
431.0ms	5 810×	0	valid
107.0ms	198×	3	valid

Compiler

Compiled 2 197 to 763 computations (65.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.8s

ival-tan: 745.0ms (26.4% of total)

ival-cos: 348.0ms (12.3% of total)

adjust: 275.0ms (9.7% of total)

ival-log: 230.0ms (8.1% of total)

ival-div: 227.0ms (8% of total)

ival-sub: 165.0ms (5.8% of total)

ival-mult: 132.0ms (4.7% of total)

ival-exp: 129.0ms (4.6% of total)

ival-sin: 125.0ms (4.4% of total)

ival-add: 120.0ms (4.2% of total)

ival-pow: 108.0ms (3.8% of total)

ival-log1p: 61.0ms (2.2% of total)

ival-sqrt: 58.0ms (2.1% of total)

ival-expm1: 30.0ms (1.1% of total)

ival-atan: 18.0ms (0.6% of total)

ival-cbrt: 15.0ms (0.5% of total)

ival-true: 12.0ms (0.4% of total)

ival-neg: 11.0ms (0.4% of total)

exact: 8.0ms (0.3% of total)

ival-assert: 6.0ms (0.2% of total)

preprocess5.9s (1.7%)

Memory

129.0MiB live, 6 047.1MiB allocated

Algorithm

28×	egg-herbie

Rules

27 478×	`lower-fma.f64`
27 478×	`lower-fma.f32`
10 768×	`div-sub`
10 444×	`sub-neg`
9 190×	`lower-*.f32`

Stop Event

56×	iter limit
50×	saturated
6×	node limit

Compiler

Compiled 12 031 to 4 089 computations (66% saved)

regimes4.8s (1.4%)

Memory

-41.4MiB live, 5 798.6MiB allocated

Counts

4 726 → 370

Calls

43 calls:

1.2s	x
395.0ms	eps
256.0ms	N
188.0ms	(-.f64 (cbrt.f64 (+.f64 x #s(literal 1 binary64))) (cbrt.f64 x))
174.0ms	b

Compiler

Compiled 3 240 to 2 153 computations (33.5% saved)

series4.3s (1.2%)

Memory

177.2MiB live, 5 169.5MiB allocated

Counts

1 681 → 29 448

Calls

3894 calls:

Time	Variable		Point	Expression
196.0ms	b_2	@	0	(/ (* a c) (* b_2 b_2))
97.0ms	x	@	inf	(/ (- 1 (cos x)) (* x x))
57.0ms	n	@	0	(* n (log n))
54.0ms	x	@	0	(pow (exp 1/3) (log x))
51.0ms	c	@	inf	(/ (+ (* b b) (+ (* b b) (* c (* a -4)))) (* (* a 2) (- b (sqrt (+ (* b b) (* c (* a -4)))))))

analyze1.6s (0.5%)

Memory

61.5MiB live, 1 981.7MiB allocated

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
7.4%	4.5%	56.6%	38.9%	0%	0%	0%	1
22.3%	13.6%	47.5%	38.9%	0%	0%	0%	2
40.2%	23.5%	34.9%	38.9%	0%	2.7%	0%	3
53.4%	31.1%	27.2%	38.9%	0%	2.8%	0%	4
63%	36.3%	21.3%	38.9%	0%	3.6%	0%	5
65.9%	37.5%	19.4%	38.9%	0%	4.2%	0%	6
70.4%	38.8%	16.3%	38.9%	0%	6%	0%	7
73.6%	40.2%	14.4%	38.9%	0%	6.5%	0%	8
76.3%	40.9%	12.7%	38.9%	0%	7.5%	0%	9
78.4%	41.4%	11.4%	38.9%	0%	8.3%	0%	10
81.1%	42.4%	9.9%	38.9%	0%	8.8%	0%	11
82.3%	42.7%	9.2%	38.9%	0%	9.3%	0%	12

Compiler

Compiled 483 to 337 computations (30.2% saved)

bsearch975.0ms (0.3%)

Memory

-23.4MiB live, 1 394.4MiB allocated

Algorithm

92×	binary-search
39×	left-value

Stop Event

86×	narrow-enough
6×	predicate-same

Samples

297.0ms	3 963×	0	valid
101.0ms	786×	1	valid
89.0ms	358×	2	valid
53.0ms	601×	0	invalid
6.0ms	29×	3	valid
1.0ms	7×	0	exit

Compiler

Compiled 17 912 to 12 042 computations (32.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 392.0ms

ival-mult: 94.0ms (24% of total)

ival-div: 63.0ms (16.1% of total)

ival-sub: 46.0ms (11.7% of total)

ival-sqrt: 35.0ms (8.9% of total)

ival-pow: 34.0ms (8.7% of total)

adjust: 33.0ms (8.4% of total)

ival-neg: 32.0ms (8.2% of total)

ival-add: 20.0ms (5.1% of total)

ival-cos: 15.0ms (3.8% of total)

ival-sin: 5.0ms (1.3% of total)

ival-cbrt: 4.0ms (1% of total)

ival-true: 4.0ms (1% of total)

exact: 3.0ms (0.8% of total)

ival-assert: 2.0ms (0.5% of total)

ival-expm1: 2.0ms (0.5% of total)

ival-exp: 0.0ms (0% of total)

start0.0ms (0%)

Memory: 1.0MiB live, 1.0MiB allocated

end0.0ms (0%)

Memory: 0.4MiB live, 0.5MiB allocated

sample1.9min (33%)

simplify1.2min (21.2%)

rewrite40.4s (11.7%)

soundness29.4s (8.5%)

localize22.9s (6.6%)

prune21.4s (6.2%)

eval20.2s (5.9%)

explain6.3s (1.8%)

preprocess5.9s (1.7%)

regimes4.8s (1.4%)

series4.3s (1.2%)

analyze1.6s (0.5%)

bsearch975.0ms (0.3%)

start0.0ms (0%)

end0.0ms (0%)

Profiling