Metrics for Herbie run

Date:	Tuesday, August 20th, 2024
Commit:	fce740b4 on ffi-types
Hostname:	nightly with Racket 8.11.1
Seed:	2024233
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

prune2.8min (28.8%)

Memory: -531.3MiB live, 174 742.2MiB allocated
Counts: 208 886 → 4 550
Compiler: Compiled 436 066 to 159 003 computations (63.5% saved)

sample1.3min (13.2%)

Memory

1 066.3MiB live, 101 979.9MiB allocated

Samples

55.8s	247 590×	0	valid
2.2s	10 328×	0	invalid
11.0ms	90×	1	valid

Precisions

Click to see histograms. Total time spent on operations: 46.2s

ival-mult: 11.1s (24% of total)

const: 6.7s (14.6% of total)

ival-<=: 6.1s (13.2% of total)

ival-div: 4.5s (9.8% of total)

ival-sub: 1.9s (4.2% of total)

ival-add: 1.9s (4.1% of total)

ival-sin: 1.7s (3.6% of total)

ival-log: 1.5s (3.2% of total)

ival-fabs: 1.5s (3.2% of total)

ival-sqrt: 1.3s (2.8% of total)

ival-and: 1.2s (2.5% of total)

ival-exp: 950.0ms (2.1% of total)

ival-floor: 771.0ms (1.7% of total)

ival-cos: 691.0ms (1.5% of total)

ival-neg: 611.0ms (1.3% of total)

ival-pi: 526.0ms (1.1% of total)

exact: 433.0ms (0.9% of total)

ival-atan: 395.0ms (0.9% of total)

ival-fmax: 358.0ms (0.8% of total)

ival-tan: 301.0ms (0.7% of total)

ival-<: 298.0ms (0.6% of total)

ival-asin: 277.0ms (0.6% of total)

ival-if: 251.0ms (0.5% of total)

ival-log2: 244.0ms (0.5% of total)

ival-==: 219.0ms (0.5% of total)

ival->: 194.0ms (0.4% of total)

ival-sinh: 153.0ms (0.3% of total)

ival-assert: 99.0ms (0.2% of total)

ival->=: 83.0ms (0.2% of total)

adjust: 2.0ms (0% of total)

Bogosity

simplify1.2min (12.8%)

Memory

938.2MiB live, 94 406.3MiB allocated

Algorithm

267×	egg-herbie

Rules

2 372 532×	`lower-fma.f64`
2 371 732×	`lower-fma.f32`
1 080 050×	`lower-*.f64`
1 077 266×	`lower-*.f32`
622 322×	`lower-+.f64`

Stop Event

360×	iter limit
206×	node limit
58×	saturated
3×	unsound

Counts

64 464 → 64 223

eval53.5s (9.2%)

Memory: 192.6MiB live, 82 460.9MiB allocated
Compiler: Compiled 35 572 243 to 489 085 computations (98.6% saved)

soundness43.1s (7.4%)

Memory

113.7MiB live, 35 025.2MiB allocated

Rules

1 419 340×	`lower-fma.f64`
1 418 808×	`lower-fma.f32`
950 722×	`lower-*.f64`
948 822×	`lower-*.f32`
477 680×	`lower-+.f64`

Stop Event

261×	iter limit
177×	node limit
29×	fuel

Compiler

Compiled 41 821 to 13 483 computations (67.8% saved)

rewrite42.6s (7.3%)

Memory

-1 070.9MiB live, 54 061.1MiB allocated

Rules

562 796×	`lower-fma.f64`
561 994×	`lower-fma.f32`
520 920×	`lower-*.f64`
518 216×	`lower-*.f32`
388 904×	`lower-/.f64`

Stop Event

241×	iter limit
116×	node limit
3×	unsound

Counts

2 320 → 71 663

regimes39.0s (6.7%)

Memory

230.2MiB live, 55 043.4MiB allocated

Counts

14 039 → 461

Calls

144 calls:

1.3s	cosTheta_i
1.2s	u1
1.1s	s
879.0ms	(/.f32 u1 (-.f32 #s(literal 1 binary32) u1))
816.0ms	u2

Compiler

Compiled 32 508 to 19 247 computations (40.8% saved)

localize30.3s (5.2%)

Memory

-273.4MiB live, 41 753.4MiB allocated

Samples

12.6s	26 615×	0	valid
1.8s	1 261×	1	valid
1.5s	1 913×	0	invalid
242.0ms	454×	0	exit
208.0ms	171×	1	exit
76.0ms	50×	5	exit

Compiler

Compiled 123 060 to 6 172 computations (95% saved)

Precisions

Click to see histograms. Total time spent on operations: 12.9s

ival-mult: 4.7s (36.1% of total)

ival-div: 1.7s (13.3% of total)

ival-add: 1.6s (12% of total)

const: 518.0ms (4% of total)

adjust: 489.0ms (3.8% of total)

ival-sub: 447.0ms (3.5% of total)

ival-pow2: 441.0ms (3.4% of total)

ival-sqrt: 419.0ms (3.2% of total)

ival-log: 334.0ms (2.6% of total)

ival-exp: 330.0ms (2.6% of total)

ival-sin: 265.0ms (2.1% of total)

ival-neg: 258.0ms (2% of total)

ival-cos: 209.0ms (1.6% of total)

ival-fabs: 192.0ms (1.5% of total)

ival-log1p: 176.0ms (1.4% of total)

ival-pow: 136.0ms (1.1% of total)

ival-floor: 119.0ms (0.9% of total)

ival-fmax: 101.0ms (0.8% of total)

ival-log2: 97.0ms (0.8% of total)

ival-tan: 88.0ms (0.7% of total)

ival-if: 64.0ms (0.5% of total)

exact: 57.0ms (0.4% of total)

ival-pi: 56.0ms (0.4% of total)

ival-expm1: 53.0ms (0.4% of total)

ival-true: 28.0ms (0.2% of total)

ival-atan: 21.0ms (0.2% of total)

ival-asin: 18.0ms (0.1% of total)

ival-assert: 14.0ms (0.1% of total)

ival->: 13.0ms (0.1% of total)

ival-sinh: 13.0ms (0.1% of total)

ival->=: 11.0ms (0.1% of total)

ival-acos: 6.0ms (0% of total)

ival-<: 3.0ms (0% of total)

analyze21.2s (3.6%)

Memory

-27.6MiB live, 30 355.7MiB allocated

Algorithm

30×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	2.6%	97.4%	0%	0%	0%	0
0%	0%	2.6%	97.4%	0%	0%	0%	1
7.8%	0.2%	2.4%	97.4%	0%	0%	0%	2
8.5%	0.2%	2.4%	97.4%	0%	0%	0%	3
12.8%	0.3%	2.3%	97.4%	0%	0%	0%	4
47%	1.2%	1.4%	97.4%	0%	0%	0%	5
51.8%	1.3%	1.2%	97.4%	0%	0.1%	0%	6
69.5%	1.8%	0.8%	97.4%	0%	0.1%	0%	7
71.6%	1.8%	0.7%	97.4%	0%	0.1%	0%	8
81.1%	2.1%	0.5%	97.4%	0%	0.1%	0%	9
82.6%	2.1%	0.4%	97.4%	0%	0.1%	0%	10
88.3%	2.2%	0.3%	97.4%	0%	0.1%	0%	11
89.1%	2.2%	0.3%	97.4%	0%	0.1%	0%	12

Compiler

Compiled 2 586 to 1 076 computations (58.4% saved)

series17.2s (2.9%)

Memory

467.9MiB live, 24 141.2MiB allocated

Counts

2 320 → 64 464

Calls

8331 calls:

Time	Variable		Point	Expression
311.0ms	d	@	-inf	(* (log (fmax (+ (pow (* (floor h) dX.v) 2) (+ (pow (* (floor w) dX.u) 2) (pow (* (floor d) dX.w) 2))) (+ (pow (* (floor h) dY.v) 2) (+ (pow (* (floor w) dY.u) 2) (pow (* (floor d) dY.w) 2))))) 1/2)
270.0ms	h	@	-inf	(pow (exp 2) (log (* (floor h) dY.v)))
165.0ms	dX.u	@	inf	(* (log (fmax (+ (pow (* (floor h) dX.v) 2) (+ (pow (* (floor w) dX.u) 2) (pow (* (floor d) dX.w) 2))) (+ (pow (* (floor h) dY.v) 2) (+ (pow (* (floor w) dY.u) 2) (pow (* (floor d) dY.w) 2))))) 1/2)
158.0ms	x	@	0	(/ (* (pow (+ (exp (neg (/ (fabs x) s))) 1) -2) (exp (neg (/ (fabs x) s)))) s)
152.0ms	alphay	@	inf	(sqrt (+ 1 (/ u0 (* (- 1 u0) (+ (/ (- 1 (/ 1 (+ 1 (pow (* (/ alphay alphax) (tan (* (PI) (+ (* 2 u1) 1/2)))) 2)))) (* alphay alphay)) (/ 1 (* alphax (* alphax (+ 1 (pow (* (/ alphay alphax) (tan (* (PI) (+ (* 2 u1) 1/2)))) 2))))))))))

preprocess9.5s (1.6%)

Memory

408.9MiB live, 12 000.4MiB allocated

Algorithm

30×	egg-herbie

Rules

132 696×	`lower-fma.f64`
132 696×	`lower-fma.f32`
46 474×	`lower-*.f64`
46 188×	`lower-*.f32`
27 984×	`unsub-neg`

Stop Event

60×	iter limit
31×	saturated
29×	node limit

Compiler

Compiled 63 294 to 19 288 computations (69.5% saved)

explain7.8s (1.3%)

Memory

-192.6MiB live, 13 619.9MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`log.f32`	`#f`	sensitivity	987	75
`-.f32`	`#f`	cancellation	393	35
`sqrt.f32`	`#f`	oflow-rescue	340	0
`cos.f32`	`#f`	sensitivity	197	17
`tan.f32`	`(tan.f32 (+.f32 (.f32 (.f32 #s(literal 2 binary32) (PI.f32)) u1) (*.f32 #s(literal 1/2 binary32) (PI.f32))))`	cancellation	192	9
`/.f32`	`#f`	o/n	110	0
`exp.f32`	`#f`	sensitivity	33	24
`/.f32`	`#f`	u/n	21	0
`sqrt.f32`	`(sqrt.f32 (-.f32 (.f32 eta eta) (/.f32 (.f32 sinTheta_O sinTheta_O) (sqrt.f32 (-.f32 #s(literal 1 binary32) (*.f32 sinTheta_O sinTheta_O))))))`	uflow-rescue	20	0
↳	`(*.f32 sinTheta_O sinTheta_O)`	underflow	300
↳	`(-.f32 (.f32 eta eta) (/.f32 (.f32 sinTheta_O sinTheta_O) (sqrt.f32 (-.f32 #s(literal 1 binary32) (*.f32 sinTheta_O sinTheta_O)))))`	underflow	20
↳	`(/.f32 (.f32 sinTheta_O sinTheta_O) (sqrt.f32 (-.f32 #s(literal 1 binary32) (.f32 sinTheta_O sinTheta_O))))`	underflow	150
↳	`(*.f32 eta eta)`	underflow	20
`/.f32`	`#f`	o/o	18	0
`/.f32`	`(/.f32 (neg.f32 (log.f32 (-.f32 #s(literal 1 binary32) u0))) (+.f32 (/.f32 cos2phi (.f32 alphax alphax)) (/.f32 sin2phi (.f32 alphay alphay))))`	n/o	3	0
↳	`(/.f32 sin2phi (*.f32 alphay alphay))`	overflow	11
↳	`(+.f32 (/.f32 cos2phi (.f32 alphax alphax)) (/.f32 sin2phi (.f32 alphay alphay)))`	overflow	11
`*.f32`	`(.f32 (sin.f32 (.f32 u normAngle)) (/.f32 #s(literal 1 binary32) (sin.f32 normAngle)))`	*nu**	3	0

Confusion

	Predicted +	Predicted -
+	1612	67
-	393	5608

Precision

0.8039900249376558

Recall

0.9600952948183442

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	1612	36	31
-	393	118	5490

Precision?

0.7633163501621121

Recall?

0.9815366289458011

Freqs

test

number	freq
0	5675
1	1711
2	276
3	18

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	19	1	1
-	5	2	2

Precision?

0.7407407407407407

Recall?

0.9523809523809523

Samples

2.3s	15 278×	0	valid
27.0ms	82×	1	valid

Compiler

Compiled 16 488 to 1 722 computations (89.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.6s

ival-mult: 498.0ms (30.9% of total)

ival-div: 219.0ms (13.6% of total)

ival-add: 158.0ms (9.8% of total)

ival-sin: 125.0ms (7.8% of total)

ival-pi: 101.0ms (6.3% of total)

ival-sub: 78.0ms (4.8% of total)

ival-log: 72.0ms (4.5% of total)

ival-sqrt: 60.0ms (3.7% of total)

ival-exp: 42.0ms (2.6% of total)

ival-floor: 39.0ms (2.4% of total)

ival-cos: 39.0ms (2.4% of total)

ival-neg: 25.0ms (1.6% of total)

const: 23.0ms (1.4% of total)

ival-fmax: 18.0ms (1.1% of total)

ival-tan: 18.0ms (1.1% of total)

ival-true: 15.0ms (0.9% of total)

ival-if: 13.0ms (0.8% of total)

exact: 13.0ms (0.8% of total)

ival-log2: 12.0ms (0.7% of total)

ival-fabs: 10.0ms (0.6% of total)

ival-asin: 8.0ms (0.5% of total)

ival-assert: 7.0ms (0.4% of total)

ival-atan: 5.0ms (0.3% of total)

ival-sinh: 5.0ms (0.3% of total)

ival->=: 4.0ms (0.2% of total)

adjust: 3.0ms (0.2% of total)

ival->: 3.0ms (0.2% of total)

ival-<: 1.0ms (0.1% of total)

bsearch51.0ms (0%)

Memory

28.0MiB live, 107.5MiB allocated

Algorithm

79×	left-value
23×	binary-search

Stop Event

23×	narrow-enough

Compiler

Compiled 3 682 to 2 277 computations (38.2% saved)

start1.0ms (0%)

Memory: 2.7MiB live, 2.7MiB allocated

end0.0ms (0%)

Memory: 0.4MiB live, 0.5MiB allocated

prune2.8min (28.8%)

sample1.3min (13.2%)

simplify1.2min (12.8%)

eval53.5s (9.2%)

soundness43.1s (7.4%)

rewrite42.6s (7.3%)

regimes39.0s (6.7%)

localize30.3s (5.2%)

analyze21.2s (3.6%)

series17.2s (2.9%)

preprocess9.5s (1.6%)

explain7.8s (1.3%)

bsearch51.0ms (0%)

start1.0ms (0%)

end0.0ms (0%)

Profiling