Metrics for Herbie run

Date:	Friday, July 26th, 2024
Commit:	f71c0270 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024208
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

simplify1.7min (16.6%)

Memory

776.4MiB live, 138 246.7MiB allocated

Algorithm

270×	egg-herbie

Rules

2 253 828×	`lower-fma.f64`
2 252 966×	`lower-fma.f32`
1 068 358×	`lower-*.f64`
1 065 522×	`lower-*.f32`
608 792×	`lower-+.f64`

Stop Event

363×	iter limit
199×	node limit
68×	saturated
3×	unsound

Counts

56 856 → 56 588

prune1.4min (13.7%)

Memory: -761.0MiB live, 86 047.9MiB allocated
Counts: 247 496 → 4 931
Compiler: Compiled 421 482 to 162 699 computations (61.4% saved)

sample1.2min (12%)

Memory

686.2MiB live, 98 897.5MiB allocated

Samples

52.3s	247 586×	0	valid
1.8s	10 252×	0	invalid
14.0ms	94×	1	valid

Precisions

Click to see histograms. Total time spent on operations: 44.2s

ival-mult: 9.0s (20.3% of total)

ival-<=: 6.9s (15.6% of total)

const: 6.8s (15.4% of total)

ival-div: 3.6s (8.2% of total)

ival-add: 2.3s (5.1% of total)

ival-sin: 2.0s (4.5% of total)

ival-sub: 1.7s (3.8% of total)

ival-log: 1.6s (3.6% of total)

ival-sqrt: 1.4s (3.3% of total)

ival-fabs: 1.2s (2.8% of total)

ival-floor: 1.2s (2.7% of total)

ival-and: 1.2s (2.6% of total)

ival-exp: 928.0ms (2.1% of total)

ival-cos: 797.0ms (1.8% of total)

ival-neg: 565.0ms (1.3% of total)

ival-pi: 465.0ms (1.1% of total)

exact: 427.0ms (1% of total)

ival-tan: 328.0ms (0.7% of total)

ival-fmax: 296.0ms (0.7% of total)

ival-log2: 239.0ms (0.5% of total)

ival-if: 229.0ms (0.5% of total)

ival->: 217.0ms (0.5% of total)

ival-<: 210.0ms (0.5% of total)

ival-asin: 155.0ms (0.4% of total)

ival-sinh: 125.0ms (0.3% of total)

ival-==: 124.0ms (0.3% of total)

ival-assert: 101.0ms (0.2% of total)

ival-atan: 98.0ms (0.2% of total)

ival->=: 55.0ms (0.1% of total)

adjust: 1.0ms (0% of total)

Bogosity

eval1.0min (9.9%)

Memory: 382.9MiB live, 86 963.4MiB allocated
Compiler: Compiled 43 338 468 to 548 467 computations (98.7% saved)

end54.1s (8.9%)

Memory: -7.8MiB live, 25 911.5MiB allocated

regimes53.0s (8.7%)

Memory

139.0MiB live, 76 850.0MiB allocated

Counts

18 613 → 540

Calls

145 calls:

2.5s	cosTheta_i
1.6s	u2
1.6s	(*.f32 uy #s(literal 2 binary32))
1.6s	uy
1.5s	(.f32 (.f32 uy #s(literal 2 binary32)) (PI.f32))

Compiler

Compiled 38 838 to 22 783 computations (41.3% saved)

soundness50.5s (8.3%)

Memory

-415.0MiB live, 38 169.7MiB allocated

Rules

1 510 384×	`lower-fma.f64`
1 509 812×	`lower-fma.f32`
1 035 020×	`lower-*.f64`
1 033 016×	`lower-*.f32`
527 472×	`lower-+.f64`

Stop Event

275×	iter limit
188×	node limit
30×	fuel
1×	saturated

Compiler

Compiled 36 890 to 14 979 computations (59.4% saved)

rewrite46.5s (7.6%)

Memory

211.9MiB live, 65 809.6MiB allocated

Algorithm

120×	batch-egg-rewrite

Rules

574 520×	`lower-fma.f64`
573 658×	`lower-fma.f32`
532 962×	`lower-*.f64`
530 242×	`lower-*.f32`
409 132×	`lower-/.f64`

Stop Event

243×	iter limit
117×	node limit
3×	unsound

Counts

2 178 → 81 467

localize28.2s (4.6%)

Memory

190.7MiB live, 42 198.5MiB allocated

Samples

10.6s	26 971×	0	valid
1.4s	1 139×	1	valid
1.1s	1 754×	0	invalid
375.0ms	732×	0	exit
146.0ms	71×	5	exit
42.0ms	49×	2	valid
6.0ms	3×	3	valid
2.0ms	1×	4	exit

Compiler

Compiled 120 595 to 5 769 computations (95.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 10.1s

ival-mult: 3.7s (36.8% of total)

ival-div: 1.5s (14.9% of total)

ival-add: 1.2s (12% of total)

const: 448.0ms (4.4% of total)

ival-sqrt: 436.0ms (4.3% of total)

ival-pow2: 308.0ms (3% of total)

ival-exp: 285.0ms (2.8% of total)

ival-log: 237.0ms (2.3% of total)

ival-neg: 207.0ms (2% of total)

ival-sub: 196.0ms (1.9% of total)

adjust: 168.0ms (1.7% of total)

ival-sin: 162.0ms (1.6% of total)

ival-cos: 135.0ms (1.3% of total)

ival-log1p: 127.0ms (1.3% of total)

ival-floor: 121.0ms (1.2% of total)

ival-log2: 112.0ms (1.1% of total)

ival-fmax: 107.0ms (1.1% of total)

ival-pow: 104.0ms (1% of total)

ival-if: 92.0ms (0.9% of total)

ival-asin: 71.0ms (0.7% of total)

exact: 59.0ms (0.6% of total)

ival-pi: 59.0ms (0.6% of total)

ival-tan: 59.0ms (0.6% of total)

ival-fabs: 42.0ms (0.4% of total)

ival-true: 29.0ms (0.3% of total)

ival-e: 20.0ms (0.2% of total)

ival->=: 18.0ms (0.2% of total)

ival->: 16.0ms (0.2% of total)

ival-sinh: 15.0ms (0.1% of total)

ival-assert: 14.0ms (0.1% of total)

ival-atan: 11.0ms (0.1% of total)

ival-acos: 6.0ms (0.1% of total)

ival-<: 6.0ms (0.1% of total)

ival-hypot: 4.0ms (0% of total)

ival-expm1: 2.0ms (0% of total)

ival-cbrt: 2.0ms (0% of total)

analyze20.6s (3.4%)

Memory

125.6MiB live, 28 341.6MiB allocated

Algorithm

30×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	2.6%	97.4%	0%	0%	0%	0
0%	0%	2.6%	97.4%	0%	0%	0%	1
7.8%	0.2%	2.4%	97.4%	0%	0%	0%	2
8.5%	0.2%	2.4%	97.4%	0%	0%	0%	3
12.8%	0.3%	2.3%	97.4%	0%	0%	0%	4
47%	1.2%	1.4%	97.4%	0%	0%	0%	5
51.8%	1.3%	1.2%	97.4%	0%	0.1%	0%	6
69.5%	1.8%	0.8%	97.4%	0%	0.1%	0%	7
71.6%	1.8%	0.7%	97.4%	0%	0.1%	0%	8
81.1%	2.1%	0.5%	97.4%	0%	0.1%	0%	9
82.6%	2.1%	0.4%	97.4%	0%	0.1%	0%	10
88.3%	2.2%	0.3%	97.4%	0%	0.1%	0%	11
89.1%	2.2%	0.3%	97.4%	0%	0.1%	0%	12

Compiler

Compiled 2 586 to 1 076 computations (58.4% saved)

series17.8s (2.9%)

Memory

43.2MiB live, 23 993.7MiB allocated

Counts

2 178 → 56 856

Calls

10860 calls:

Time	Variable		Point	Expression
505.0ms	dX.u	@	inf	(* (log (fmax (pow (* (floor w) dX.u) 2) (+ (pow (* (floor h) dY.v) 2) (+ (pow (* (floor w) dY.u) 2) (pow (* (floor d) dY.w) 2))))) 1/2)
382.0ms	dX.u	@	0	(log (fmax (+ (pow (* dX.u (floor w)) 2) (pow (* (floor h) dX.v) 2)) (pow (* (floor h) dY.v) 2)))
311.0ms	u1	@	inf	(pow (+ (* alphay (/ (* alphay u0) (* (- 1 u0) (- 1 (/ 1 (+ 1 (pow (* (/ alphay alphax) (tan (* (PI) (+ (* 2 u1) 1/2)))) 2))))))) 1) -1/4)
299.0ms	w	@	-inf	(* (log (fmax (pow (* (floor w) dX.u) 2) (+ (pow (* (floor h) dY.v) 2) (+ (pow (* (floor w) dY.u) 2) (pow (* (floor d) dY.w) 2))))) 1/2)
276.0ms	d	@	-inf	(* (log (fmax (+ (pow (* (floor w) dX.u) 2) (+ (pow (* (floor d) dX.w) 2) (pow (* (floor h) dX.v) 2))) (+ (pow (exp 2) (log (* (floor w) dY.u))) (pow (* (floor d) dY.w) 2)))) 1/2)

preprocess11.4s (1.9%)

Memory

153.3MiB live, 14 236.0MiB allocated

Algorithm

30×	egg-herbie

Rules

132 696×	`lower-fma.f64`
132 696×	`lower-fma.f32`
46 474×	`lower-*.f64`
46 188×	`lower-*.f32`
27 984×	`unsub-neg`

Stop Event

60×	iter limit
31×	saturated
29×	node limit

Compiler

Compiled 55 782 to 17 146 computations (69.3% saved)

explain9.3s (1.5%)

Memory

-359.8MiB live, 13 240.6MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`log.f32`	`#f`	sensitivity	1022	73
`-.f32`	`#f`	cancellation	364	33
`sqrt.f32`	`#f`	oflow-rescue	334	0
`cos.f32`	`#f`	sensitivity	197	9
`tan.f32`	`(tan.f32 (+.f32 (.f32 (.f32 #s(literal 2 binary32) (PI.f32)) u1) (*.f32 #s(literal 1/2 binary32) (PI.f32))))`	cancellation	183	18
`/.f32`	`#f`	o/n	124	0
`exp.f32`	`#f`	sensitivity	51	27
`sqrt.f32`	`(sqrt.f32 (-.f32 (.f32 eta eta) (/.f32 (.f32 sinTheta_O sinTheta_O) (sqrt.f32 (-.f32 #s(literal 1 binary32) (*.f32 sinTheta_O sinTheta_O))))))`	uflow-rescue	14	0
↳	`(*.f32 sinTheta_O sinTheta_O)`	underflow	292
↳	`(-.f32 (.f32 eta eta) (/.f32 (.f32 sinTheta_O sinTheta_O) (sqrt.f32 (-.f32 #s(literal 1 binary32) (*.f32 sinTheta_O sinTheta_O)))))`	underflow	14
↳	`(/.f32 (.f32 sinTheta_O sinTheta_O) (sqrt.f32 (-.f32 #s(literal 1 binary32) (.f32 sinTheta_O sinTheta_O))))`	underflow	146
↳	`(*.f32 eta eta)`	underflow	14
`/.f32`	`#f`	u/n	13	0
`/.f32`	`#f`	o/o	6	0
`/.f32`	`(/.f32 (neg.f32 (log.f32 (-.f32 #s(literal 1 binary32) u0))) (+.f32 (/.f32 cos2phi (.f32 alphax alphax)) (/.f32 sin2phi (.f32 alphay alphay))))`	n/o	6	0
↳	`(/.f32 sin2phi (*.f32 alphay alphay))`	overflow	13
↳	`(+.f32 (/.f32 cos2phi (.f32 alphax alphax)) (/.f32 sin2phi (.f32 alphay alphay)))`	overflow	13
`sin.f32`	`#f`	cancellation	2	0
`log.f32`	`(log.f32 (/.f32 #s(literal 1 binary32) (*.f32 #s(literal 2 binary32) v)))`	oflow-rescue	1	0
↳	`(/.f32 #s(literal 1 binary32) (*.f32 #s(literal 2 binary32) v))`	overflow	1

Confusion

	Predicted +	Predicted -
+	1624	63
-	377	5616

Precision

0.8115942028985508

Recall

0.9626556016597511

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	1624	39	24
-	377	107	5509

Precision?

0.7745691662785282

Recall?

0.9857735625370481

Freqs

test

number	freq
0	5679
1	1691
2	304
3	6

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	20	2	2
-	4	0	2

Precision?

0.8461538461538461

Recall?

0.9166666666666666

Samples

3.0s	15 268×	0	valid
32.0ms	26×	5	exit
29.0ms	66×	1	valid

Compiler

Compiled 18 280 to 2 256 computations (87.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.9s

ival-mult: 633.0ms (34% of total)

ival-sub: 301.0ms (16.1% of total)

ival-div: 241.0ms (12.9% of total)

ival-add: 100.0ms (5.4% of total)

ival-sin: 82.0ms (4.4% of total)

ival-log: 74.0ms (4% of total)

ival-sqrt: 63.0ms (3.4% of total)

ival-cos: 54.0ms (2.9% of total)

ival-floor: 43.0ms (2.3% of total)

ival-neg: 41.0ms (2.2% of total)

ival-exp: 40.0ms (2.1% of total)

const: 23.0ms (1.2% of total)

ival-pi: 23.0ms (1.2% of total)

adjust: 21.0ms (1.1% of total)

ival-tan: 18.0ms (1% of total)

ival-fmax: 16.0ms (0.9% of total)

ival-if: 16.0ms (0.9% of total)

ival-true: 15.0ms (0.8% of total)

exact: 13.0ms (0.7% of total)

ival-log2: 12.0ms (0.6% of total)

ival-fabs: 8.0ms (0.4% of total)

ival-assert: 7.0ms (0.4% of total)

ival-atan: 6.0ms (0.3% of total)

ival-sinh: 5.0ms (0.3% of total)

ival-asin: 4.0ms (0.2% of total)

ival->: 3.0ms (0.2% of total)

ival->=: 3.0ms (0.2% of total)

ival-<: 1.0ms (0.1% of total)

bsearch82.0ms (0%)

Memory

-29.9MiB live, 171.0MiB allocated

Algorithm

80×	left-value
35×	binary-search

Stop Event

35×	narrow-enough

Compiler

Compiled 4 509 to 2 666 computations (40.9% saved)

simplify1.7min (16.6%)

prune1.4min (13.7%)

sample1.2min (12%)

eval1.0min (9.9%)

end54.1s (8.9%)

regimes53.0s (8.7%)

soundness50.5s (8.3%)

rewrite46.5s (7.6%)

localize28.2s (4.6%)

analyze20.6s (3.4%)

series17.8s (2.9%)

preprocess11.4s (1.9%)

explain9.3s (1.5%)

bsearch82.0ms (0%)

Profiling