Metrics for Herbie run

Date:	Tuesday, August 6th, 2024
Commit:	2.2 on release
Hostname:	nightly with Racket 8.11.1
Seed:	2024219
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

simplify1.7min (16.8%)

Memory

-84.3MiB live, 142 964.5MiB allocated

Algorithm

270×	egg-herbie

Rules

2 387 794×	`lower-fma.f64`
2 386 820×	`lower-fma.f32`
1 108 642×	`lower-*.f64`
1 105 576×	`lower-*.f32`
616 346×	`lower-+.f64`

Stop Event

363×	iter limit
206×	node limit
61×	saturated
3×	unsound

Counts

56 928 → 56 720

prune1.3min (12.8%)

Memory: -289.1MiB live, 87 591.9MiB allocated
Counts: 243 142 → 4 814
Compiler: Compiled 456 228 to 167 629 computations (63.3% saved)

sample1.3min (12.6%)

Memory

303.9MiB live, 104 912.9MiB allocated

Samples

55.1s	247 595×	0	valid
2.2s	10 581×	0	invalid
10.0ms	85×	1	valid

Precisions

Click to see histograms. Total time spent on operations: 45.7s

ival-mult: 10.5s (23.1% of total)

const: 7.2s (15.8% of total)

ival-<=: 7.1s (15.6% of total)

ival-div: 3.5s (7.7% of total)

ival-sub: 1.8s (3.9% of total)

ival-add: 1.6s (3.6% of total)

ival-sin: 1.6s (3.6% of total)

ival-log: 1.6s (3.5% of total)

ival-fabs: 1.4s (3% of total)

ival-sqrt: 1.3s (2.9% of total)

ival-exp: 1.2s (2.5% of total)

ival-and: 1.1s (2.5% of total)

ival-floor: 866.0ms (1.9% of total)

ival-cos: 778.0ms (1.7% of total)

ival-pi: 722.0ms (1.6% of total)

ival-neg: 454.0ms (1% of total)

exact: 415.0ms (0.9% of total)

ival-asin: 342.0ms (0.7% of total)

ival-tan: 298.0ms (0.7% of total)

ival-fmax: 280.0ms (0.6% of total)

ival-log2: 269.0ms (0.6% of total)

ival-if: 264.0ms (0.6% of total)

ival-<: 247.0ms (0.5% of total)

ival-==: 232.0ms (0.5% of total)

ival->: 150.0ms (0.3% of total)

ival-assert: 99.0ms (0.2% of total)

ival-atan: 96.0ms (0.2% of total)

ival-sinh: 92.0ms (0.2% of total)

ival->=: 47.0ms (0.1% of total)

adjust: 2.0ms (0% of total)

Bogosity

end1.0min (10.1%)

Memory: 40.6MiB live, 29 279.9MiB allocated

eval58.5s (9.6%)

Memory: 569.4MiB live, 89 021.8MiB allocated
Compiler: Compiled 39 762 623 to 570 491 computations (98.6% saved)

rewrite49.6s (8.2%)

Memory

-98.0MiB live, 66 894.8MiB allocated

Algorithm

120×	batch-egg-rewrite

Rules

589 810×	`lower-fma.f64`
588 866×	`lower-fma.f32`
545 430×	`lower-*.f64`
542 522×	`lower-*.f32`
395 708×	`lower-/.f64`

Stop Event

244×	iter limit
117×	node limit
3×	unsound

Counts

2 207 → 80 169

regimes47.9s (7.9%)

Memory

23.6MiB live, 74 212.3MiB allocated

Counts

17 676 → 523

Calls

145 calls:

1.4s	cosTheta_i
1.4s	uy
1.4s	v
1.3s	s
1.3s	(.f32 (.f32 uy #s(literal 2 binary32)) (PI.f32))

Compiler

Compiled 39 600 to 22 443 computations (43.3% saved)

soundness47.0s (7.7%)

Memory

141.1MiB live, 37 461.9MiB allocated

Rules

1 398 468×	`lower-fma.f64`
1 397 796×	`lower-fma.f32`
1 008 026×	`lower-*.f64`
1 005 744×	`lower-*.f32`
498 984×	`lower-/.f64`

Stop Event

280×	iter limit
185×	node limit
30×	fuel
1×	saturated

Compiler

Compiled 34 144 to 13 621 computations (60.1% saved)

localize30.8s (5.1%)

Memory

172.8MiB live, 45 218.9MiB allocated

Samples

11.1s	27 232×	0	valid
1.3s	2 183×	0	invalid
750.0ms	258×	4	exit
685.0ms	791×	1	valid
159.0ms	70×	5	exit
52.0ms	185×	0	exit
1.0ms	1×	1	exit

Compiler

Compiled 132 835 to 6 104 computations (95.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 10.6s

ival-mult: 4.0s (37.9% of total)

ival-div: 1.3s (12.5% of total)

ival-add: 1.3s (12.2% of total)

const: 577.0ms (5.5% of total)

ival-sqrt: 461.0ms (4.4% of total)

ival-pow2: 261.0ms (2.5% of total)

ival-log: 257.0ms (2.4% of total)

ival-sub: 224.0ms (2.1% of total)

ival-neg: 223.0ms (2.1% of total)

adjust: 208.0ms (2% of total)

ival-exp: 202.0ms (1.9% of total)

ival-sin: 177.0ms (1.7% of total)

ival-pow: 151.0ms (1.4% of total)

ival-log1p: 150.0ms (1.4% of total)

ival-fmax: 141.0ms (1.3% of total)

ival-floor: 133.0ms (1.3% of total)

ival-cos: 125.0ms (1.2% of total)

ival-pi: 105.0ms (1% of total)

ival-tan: 98.0ms (0.9% of total)

ival-if: 93.0ms (0.9% of total)

ival-log2: 91.0ms (0.9% of total)

exact: 55.0ms (0.5% of total)

ival-asin: 41.0ms (0.4% of total)

ival-fabs: 38.0ms (0.4% of total)

ival-true: 29.0ms (0.3% of total)

ival-atan: 16.0ms (0.2% of total)

ival->: 14.0ms (0.1% of total)

ival-acos: 14.0ms (0.1% of total)

ival-assert: 14.0ms (0.1% of total)

ival-hypot: 14.0ms (0.1% of total)

ival->=: 13.0ms (0.1% of total)

ival-expm1: 11.0ms (0.1% of total)

ival-sinh: 9.0ms (0.1% of total)

ival-e: 4.0ms (0% of total)

ival-<: 4.0ms (0% of total)

ival-cbrt: 2.0ms (0% of total)

analyze20.5s (3.4%)

Memory

-48.4MiB live, 31 781.4MiB allocated

Algorithm

30×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	2.6%	97.4%	0%	0%	0%	0
0%	0%	2.6%	97.4%	0%	0%	0%	1
7.8%	0.2%	2.4%	97.4%	0%	0%	0%	2
8.5%	0.2%	2.4%	97.4%	0%	0%	0%	3
12.8%	0.3%	2.3%	97.4%	0%	0%	0%	4
47%	1.2%	1.4%	97.4%	0%	0%	0%	5
51.8%	1.3%	1.2%	97.4%	0%	0.1%	0%	6
69.5%	1.8%	0.8%	97.4%	0%	0.1%	0%	7
71.6%	1.8%	0.7%	97.4%	0%	0.1%	0%	8
81.1%	2.1%	0.5%	97.4%	0%	0.1%	0%	9
82.6%	2.1%	0.4%	97.4%	0%	0.1%	0%	10
88.3%	2.2%	0.3%	97.4%	0%	0.1%	0%	11
89.1%	2.2%	0.3%	97.4%	0%	0.1%	0%	12

Compiler

Compiled 2 586 to 1 076 computations (58.4% saved)

series15.9s (2.6%)

Memory

161.8MiB live, 21 387.7MiB allocated

Counts

2 207 → 56 928

Calls

10863 calls:

Time	Variable		Point	Expression
286.0ms	yi	@	inf	(* (* yi (* (PI) (* (PI) (PI)))) -4/3)
266.0ms	w	@	0	(pow (fmax (+ (pow (* (floor w) dX.u) 2) (pow (* (floor h) dX.v) 2)) (+ (pow (* (floor w) dY.u) 2) (pow (* (floor h) dY.v) 2))) 1/4)
265.0ms	alpha	@	0	(* (PI) (log (* alpha alpha)))
223.0ms	dY.u	@	inf	(pow (fmax (+ (pow (* (floor w) dX.u) 2) (pow (* (floor h) dX.v) 2)) (+ (pow (* (floor w) dY.u) 2) (pow (* (floor h) dY.v) 2))) 1/4)
211.0ms	s	@	0	(* (neg s) (log (- (/ (pow (+ (/ 1 (+ 1 (exp (/ (PI) s)))) (+ (/ u (+ 1 (exp (/ (PI) (neg s))))) (/ u (neg (+ 1 (exp (/ (PI) s))))))) -2) (+ 1 (/ 1 (+ (/ 1 (+ 1 (exp (/ (PI) s)))) (+ (/ u (+ 1 (exp (/ (PI) (neg s))))) (/ u (neg (+ 1 (exp (/ (PI) s)))))))))) (/ 1 (+ 1 (/ 1 (+ (/ 1 (+ 1 (exp (/ (PI) s)))) (+ (/ u (+ 1 (exp (/ (PI) (neg s))))) (/ u (neg (+ 1 (exp (/ (PI) s)))))))))))))

preprocess10.8s (1.8%)

Memory

-13.7MiB live, 14 701.9MiB allocated

Algorithm

30×	egg-herbie

Rules

132 696×	`lower-fma.f64`
132 696×	`lower-fma.f32`
46 474×	`lower-*.f64`
46 188×	`lower-*.f32`
27 984×	`unsub-neg`

Stop Event

60×	iter limit
31×	saturated
29×	node limit

Compiler

Compiled 61 668 to 18 724 computations (69.6% saved)

explain8.4s (1.4%)

Memory

-28.2MiB live, 13 474.7MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`log.f32`	`#f`	sensitivity	1039	85
`-.f32`	`#f`	cancellation	384	51
`sqrt.f32`	`#f`	oflow-rescue	352	0
`cos.f32`	`#f`	sensitivity	193	15
`tan.f32`	`(tan.f32 (+.f32 (.f32 (.f32 #s(literal 2 binary32) (PI.f32)) u1) (*.f32 #s(literal 1/2 binary32) (PI.f32))))`	cancellation	183	13
`/.f32`	`#f`	o/n	148	0
`exp.f32`	`#f`	sensitivity	36	16
`sqrt.f32`	`(sqrt.f32 (-.f32 (.f32 eta eta) (/.f32 (.f32 sinTheta_O sinTheta_O) (sqrt.f32 (-.f32 #s(literal 1 binary32) (*.f32 sinTheta_O sinTheta_O))))))`	uflow-rescue	18	0
↳	`(*.f32 sinTheta_O sinTheta_O)`	underflow	284
↳	`(-.f32 (.f32 eta eta) (/.f32 (.f32 sinTheta_O sinTheta_O) (sqrt.f32 (-.f32 #s(literal 1 binary32) (*.f32 sinTheta_O sinTheta_O)))))`	underflow	18
↳	`(/.f32 (.f32 sinTheta_O sinTheta_O) (sqrt.f32 (-.f32 #s(literal 1 binary32) (.f32 sinTheta_O sinTheta_O))))`	underflow	142
↳	`(*.f32 eta eta)`	underflow	18
`/.f32`	`#f`	u/n	17	0
`/.f32`	`#f`	o/o	14	0
`/.f32`	`#f`	n/o	10	0
`*.f32`	`(.f32 (sin.f32 (.f32 u normAngle)) (/.f32 #s(literal 1 binary32) (sin.f32 normAngle)))`	*nu**	4	0
`log.f32`	`(log.f32 (/.f32 #s(literal 1 binary32) (*.f32 #s(literal 2 binary32) v)))`	oflow-rescue	1	0
↳	`(/.f32 #s(literal 1 binary32) (*.f32 #s(literal 2 binary32) v))`	overflow	1

Confusion

	Predicted +	Predicted -
+	1668	59
-	393	5560

Precision

0.8093158660844251

Recall

0.965836711059641

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	1668	43	16
-	393	127	5433

Precision?

0.7669206633796504

Recall?

0.9907353792704111

Freqs

test

number	freq
0	5619
1	1737
2	310
3	14

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	23	1	0
-	4	0	2

Precision?

0.8571428571428571

Recall?

1.0

Samples

2.2s	15 298×	0	valid
22.0ms	62×	1	valid

Compiler

Compiled 18 280 to 2 256 computations (87.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.5s

ival-mult: 487.0ms (32.2% of total)

ival-div: 182.0ms (12% of total)

ival-add: 93.0ms (6.2% of total)

ival-sqrt: 86.0ms (5.7% of total)

ival-sub: 79.0ms (5.2% of total)

ival-log: 77.0ms (5.1% of total)

ival-sin: 76.0ms (5% of total)

ival-neg: 63.0ms (4.2% of total)

const: 56.0ms (3.7% of total)

ival-cos: 55.0ms (3.6% of total)

ival-log2: 41.0ms (2.7% of total)

ival-exp: 40.0ms (2.6% of total)

ival-floor: 38.0ms (2.5% of total)

ival-pi: 22.0ms (1.5% of total)

ival-tan: 19.0ms (1.3% of total)

ival-fmax: 17.0ms (1.1% of total)

ival-if: 14.0ms (0.9% of total)

ival-true: 14.0ms (0.9% of total)

exact: 13.0ms (0.9% of total)

ival-fabs: 8.0ms (0.5% of total)

ival-assert: 7.0ms (0.5% of total)

ival-atan: 6.0ms (0.4% of total)

ival-asin: 5.0ms (0.3% of total)

ival-sinh: 5.0ms (0.3% of total)

ival->: 3.0ms (0.2% of total)

ival->=: 3.0ms (0.2% of total)

adjust: 2.0ms (0.1% of total)

ival-<: 1.0ms (0.1% of total)

bsearch72.0ms (0%)

Memory

89.0MiB live, 167.6MiB allocated

Algorithm

81×	left-value
38×	binary-search

Stop Event

38×	narrow-enough

Compiler

Compiled 4 220 to 2 756 computations (34.7% saved)

simplify1.7min (16.8%)

prune1.3min (12.8%)

sample1.3min (12.6%)

end1.0min (10.1%)

eval58.5s (9.6%)

rewrite49.6s (8.2%)

regimes47.9s (7.9%)

soundness47.0s (7.7%)

localize30.8s (5.1%)

analyze20.5s (3.4%)

series15.9s (2.6%)

preprocess10.8s (1.8%)

explain8.4s (1.4%)

bsearch72.0ms (0%)

Profiling