Metrics for Herbie run

Date:	Tuesday, August 6th, 2024
Commit:	2.2 on release
Hostname:	nightly with Racket 8.11.1
Seed:	2024219
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

simplify1.7min (16.7%)

Memory

382.2MiB live, 141 792.1MiB allocated

Algorithm

270×	egg-herbie

Rules

2 387 794×	`lower-fma.f64`
2 386 820×	`lower-fma.f32`
1 108 642×	`lower-*.f64`
1 105 576×	`lower-*.f32`
616 346×	`lower-+.f64`

Stop Event

363×	iter limit
206×	node limit
61×	saturated
3×	unsound

Counts

56 928 → 56 720

prune1.3min (12.9%)

Memory: -919.6MiB live, 87 807.7MiB allocated
Counts: 243 142 → 4 814
Compiler: Compiled 456 228 to 167 629 computations (63.3% saved)

sample1.3min (12.6%)

Memory

568.3MiB live, 104 258.4MiB allocated

Samples

55.3s	247 595×	0	valid
2.2s	10 581×	0	invalid
10.0ms	85×	1	valid

Precisions

Click to see histograms. Total time spent on operations: 46.1s

ival-mult: 10.0s (21.7% of total)

const: 7.8s (17% of total)

ival-<=: 6.1s (13.3% of total)

ival-div: 4.5s (9.8% of total)

ival-sub: 2.1s (4.6% of total)

ival-add: 1.6s (3.5% of total)

ival-log: 1.5s (3.3% of total)

ival-sqrt: 1.5s (3.3% of total)

ival-sin: 1.4s (3% of total)

ival-fabs: 1.3s (2.8% of total)

ival-floor: 1.1s (2.5% of total)

ival-and: 1.1s (2.5% of total)

ival-cos: 1.1s (2.5% of total)

ival-exp: 782.0ms (1.7% of total)

ival-pi: 581.0ms (1.3% of total)

ival-neg: 525.0ms (1.1% of total)

ival-if: 506.0ms (1.1% of total)

exact: 418.0ms (0.9% of total)

ival-log2: 323.0ms (0.7% of total)

ival-tan: 317.0ms (0.7% of total)

ival-fmax: 254.0ms (0.6% of total)

ival->: 233.0ms (0.5% of total)

ival-<: 233.0ms (0.5% of total)

ival-asin: 171.0ms (0.4% of total)

ival-==: 97.0ms (0.2% of total)

ival-assert: 95.0ms (0.2% of total)

ival-atan: 93.0ms (0.2% of total)

ival-sinh: 92.0ms (0.2% of total)

ival->=: 46.0ms (0.1% of total)

adjust: 2.0ms (0% of total)

Bogosity

end1.0min (10%)

Memory: 0.2MiB live, 29 279.1MiB allocated

eval57.6s (9.5%)

Memory: 249.5MiB live, 89 878.2MiB allocated
Compiler: Compiled 39 762 623 to 570 491 computations (98.6% saved)

soundness48.7s (8%)

Memory

43.6MiB live, 36 270.7MiB allocated

Rules

1 398 468×	`lower-fma.f64`
1 397 796×	`lower-fma.f32`
1 008 026×	`lower-*.f64`
1 005 744×	`lower-*.f32`
498 984×	`lower-/.f64`

Stop Event

280×	iter limit
185×	node limit
30×	fuel
1×	saturated

Compiler

Compiled 34 144 to 13 621 computations (60.1% saved)

regimes48.3s (7.9%)

Memory

518.0MiB live, 75 395.8MiB allocated

Counts

17 676 → 523

Calls

145 calls:

1.5s	cosTheta_i
1.4s	(.f32 (.f32 uy #s(literal 2 binary32)) (PI.f32))
1.4s	(*.f32 uy #s(literal 2 binary32))
1.3s	uy
1.1s	ux

Compiler

Compiled 39 600 to 22 443 computations (43.3% saved)

rewrite47.1s (7.8%)

Memory

262.3MiB live, 67 691.0MiB allocated

Algorithm

120×	batch-egg-rewrite

Rules

589 810×	`lower-fma.f64`
588 866×	`lower-fma.f32`
545 430×	`lower-*.f64`
542 522×	`lower-*.f32`
395 708×	`lower-/.f64`

Stop Event

244×	iter limit
117×	node limit
3×	unsound

Counts

2 207 → 80 169

localize31.7s (5.2%)

Memory

524.5MiB live, 45 811.7MiB allocated

Samples

11.6s	27 232×	0	valid
1.1s	2 183×	0	invalid
750.0ms	258×	4	exit
701.0ms	791×	1	valid
147.0ms	70×	5	exit
45.0ms	185×	0	exit
1.0ms	1×	1	exit

Compiler

Compiled 132 835 to 6 104 computations (95.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 10.5s

ival-mult: 3.8s (35.8% of total)

ival-div: 1.3s (12.5% of total)

ival-add: 1.1s (10.3% of total)

ival-sqrt: 647.0ms (6.1% of total)

const: 452.0ms (4.3% of total)

ival-pow2: 318.0ms (3% of total)

ival-log: 307.0ms (2.9% of total)

ival-neg: 274.0ms (2.6% of total)

ival-sin: 248.0ms (2.4% of total)

ival-exp: 232.0ms (2.2% of total)

ival-sub: 227.0ms (2.2% of total)

adjust: 226.0ms (2.1% of total)

ival-pow: 207.0ms (2% of total)

ival-cos: 165.0ms (1.6% of total)

ival-if: 138.0ms (1.3% of total)

ival-log1p: 128.0ms (1.2% of total)

ival-tan: 122.0ms (1.2% of total)

ival-fmax: 109.0ms (1% of total)

ival-log2: 85.0ms (0.8% of total)

ival-floor: 83.0ms (0.8% of total)

ival-fabs: 75.0ms (0.7% of total)

ival-asin: 60.0ms (0.6% of total)

exact: 55.0ms (0.5% of total)

ival-pi: 52.0ms (0.5% of total)

ival-true: 28.0ms (0.3% of total)

ival-atan: 15.0ms (0.1% of total)

ival->=: 15.0ms (0.1% of total)

ival->: 14.0ms (0.1% of total)

ival-acos: 13.0ms (0.1% of total)

ival-assert: 13.0ms (0.1% of total)

ival-hypot: 12.0ms (0.1% of total)

ival-expm1: 12.0ms (0.1% of total)

ival-sinh: 10.0ms (0.1% of total)

ival-<: 5.0ms (0% of total)

ival-e: 4.0ms (0% of total)

ival-cbrt: 2.0ms (0% of total)

analyze21.4s (3.5%)

Memory

-249.5MiB live, 31 828.9MiB allocated

Algorithm

30×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	2.6%	97.4%	0%	0%	0%	0
0%	0%	2.6%	97.4%	0%	0%	0%	1
7.8%	0.2%	2.4%	97.4%	0%	0%	0%	2
8.5%	0.2%	2.4%	97.4%	0%	0%	0%	3
12.8%	0.3%	2.3%	97.4%	0%	0%	0%	4
47%	1.2%	1.4%	97.4%	0%	0%	0%	5
51.8%	1.3%	1.2%	97.4%	0%	0.1%	0%	6
69.5%	1.8%	0.8%	97.4%	0%	0.1%	0%	7
71.6%	1.8%	0.7%	97.4%	0%	0.1%	0%	8
81.1%	2.1%	0.5%	97.4%	0%	0.1%	0%	9
82.6%	2.1%	0.4%	97.4%	0%	0.1%	0%	10
88.3%	2.2%	0.3%	97.4%	0%	0.1%	0%	11
89.1%	2.2%	0.3%	97.4%	0%	0.1%	0%	12

Compiler

Compiled 2 586 to 1 076 computations (58.4% saved)

series15.9s (2.6%)

Memory

80.1MiB live, 21 178.7MiB allocated

Counts

2 207 → 56 928

Calls

10863 calls:

Time	Variable		Point	Expression
335.0ms	h	@	-inf	(exp (+ (* (log dY.v) 2) (* 2 (log (floor h)))))
268.0ms	yi	@	0	(+ (* (sqrt (+ (* (* maxCos maxCos) (* (* (- 1 ux) (- 1 ux)) (* ux (neg ux)))) 1)) (+ (* 2 (* uy (* yi (PI)))) xi)) (* (* (* (- 1 ux) maxCos) ux) zi))
250.0ms	dY.u	@	inf	(pow (fmax (+ (pow (* (floor w) dX.u) 2) (pow (* (floor h) dX.v) 2)) (+ (pow (* (floor w) dY.u) 2) (pow (* (floor h) dY.v) 2))) 1/4)
205.0ms	w	@	-inf	(pow (fmax (+ (pow (* (floor w) dX.u) 2) (pow (* (floor h) dX.v) 2)) (pow (* (floor w) dY.u) 2)) 1/4)
193.0ms	uy	@	inf	(* (* 2 maxCos) (* (* ux uy) (* (PI) (sqrt -1))))

preprocess10.6s (1.7%)

Memory

52.7MiB live, 14 715.1MiB allocated

Algorithm

30×	egg-herbie

Rules

132 696×	`lower-fma.f64`
132 696×	`lower-fma.f32`
46 474×	`lower-*.f64`
46 188×	`lower-*.f32`
27 984×	`unsub-neg`

Stop Event

60×	iter limit
31×	saturated
29×	node limit

Compiler

Compiled 61 668 to 18 724 computations (69.6% saved)

explain8.4s (1.4%)

Memory

-188.0MiB live, 13 560.1MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`log.f32`	`#f`	sensitivity	1039	85
`-.f32`	`#f`	cancellation	384	51
`sqrt.f32`	`#f`	oflow-rescue	352	0
`cos.f32`	`#f`	sensitivity	193	15
`tan.f32`	`(tan.f32 (+.f32 (.f32 (.f32 #s(literal 2 binary32) (PI.f32)) u1) (*.f32 #s(literal 1/2 binary32) (PI.f32))))`	cancellation	183	13
`/.f32`	`#f`	o/n	148	0
`exp.f32`	`#f`	sensitivity	36	16
`sqrt.f32`	`(sqrt.f32 (-.f32 (.f32 eta eta) (/.f32 (.f32 sinTheta_O sinTheta_O) (sqrt.f32 (-.f32 #s(literal 1 binary32) (*.f32 sinTheta_O sinTheta_O))))))`	uflow-rescue	18	0
↳	`(*.f32 sinTheta_O sinTheta_O)`	underflow	284
↳	`(-.f32 (.f32 eta eta) (/.f32 (.f32 sinTheta_O sinTheta_O) (sqrt.f32 (-.f32 #s(literal 1 binary32) (*.f32 sinTheta_O sinTheta_O)))))`	underflow	18
↳	`(/.f32 (.f32 sinTheta_O sinTheta_O) (sqrt.f32 (-.f32 #s(literal 1 binary32) (.f32 sinTheta_O sinTheta_O))))`	underflow	142
↳	`(*.f32 eta eta)`	underflow	18
`/.f32`	`#f`	u/n	17	0
`/.f32`	`#f`	o/o	14	0
`/.f32`	`#f`	n/o	10	0
`*.f32`	`(.f32 (sin.f32 (.f32 u normAngle)) (/.f32 #s(literal 1 binary32) (sin.f32 normAngle)))`	*nu**	4	0
`log.f32`	`(log.f32 (/.f32 #s(literal 1 binary32) (*.f32 #s(literal 2 binary32) v)))`	oflow-rescue	1	0
↳	`(/.f32 #s(literal 1 binary32) (*.f32 #s(literal 2 binary32) v))`	overflow	1

Confusion

	Predicted +	Predicted -
+	1668	59
-	393	5560

Precision

0.8093158660844251

Recall

0.965836711059641

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	1668	43	16
-	393	127	5433

Precision?

0.7669206633796504

Recall?

0.9907353792704111

Freqs

test

number	freq
0	5619
1	1737
2	310
3	14

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	23	1	0
-	4	0	2

Precision?

0.8571428571428571

Recall?

1.0

Samples

2.5s	15 298×	0	valid
25.0ms	62×	1	valid

Compiler

Compiled 18 280 to 2 256 computations (87.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.6s

ival-mult: 459.0ms (29% of total)

ival-div: 238.0ms (15% of total)

ival-add: 150.0ms (9.5% of total)

ival-sub: 105.0ms (6.6% of total)

ival-log: 80.0ms (5.1% of total)

ival-floor: 78.0ms (4.9% of total)

ival-sin: 68.0ms (4.3% of total)

ival-sqrt: 59.0ms (3.7% of total)

ival-neg: 57.0ms (3.6% of total)

const: 48.0ms (3% of total)

ival-exp: 42.0ms (2.7% of total)

ival-cos: 39.0ms (2.5% of total)

ival-pi: 32.0ms (2% of total)

ival-tan: 18.0ms (1.1% of total)

ival-fmax: 16.0ms (1% of total)

ival-if: 14.0ms (0.9% of total)

ival-true: 14.0ms (0.9% of total)

ival-log2: 13.0ms (0.8% of total)

exact: 13.0ms (0.8% of total)

ival-fabs: 8.0ms (0.5% of total)

ival-assert: 6.0ms (0.4% of total)

ival-atan: 6.0ms (0.4% of total)

ival-sinh: 5.0ms (0.3% of total)

ival-asin: 4.0ms (0.3% of total)

ival->: 3.0ms (0.2% of total)

ival->=: 3.0ms (0.2% of total)

ival-<: 3.0ms (0.2% of total)

adjust: 2.0ms (0.1% of total)

bsearch71.0ms (0%)

Memory

66.1MiB live, 144.2MiB allocated

Algorithm

81×	left-value
38×	binary-search

Stop Event

38×	narrow-enough

Compiler

Compiled 4 220 to 2 756 computations (34.7% saved)

simplify1.7min (16.7%)

prune1.3min (12.9%)

sample1.3min (12.6%)

end1.0min (10%)

eval57.6s (9.5%)

soundness48.7s (8%)

regimes48.3s (7.9%)

rewrite47.1s (7.8%)

localize31.7s (5.2%)

analyze21.4s (3.5%)

series15.9s (2.6%)

preprocess10.6s (1.7%)

explain8.4s (1.4%)

bsearch71.0ms (0%)

Profiling