Metrics for Herbie run

Date:	Thursday, July 25th, 2024
Commit:	3139208f on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024207
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

simplify1.7min (16.8%)

Memory

-54.2MiB live, 136 842.1MiB allocated

Algorithm

270×	egg-herbie

Rules

2 274 382×	`lower-fma.f64`
2 273 532×	`lower-fma.f32`
1 043 284×	`lower-*.f64`
1 040 408×	`lower-*.f32`
590 348×	`lower-+.f64`

Stop Event

363×	iter limit
196×	node limit
71×	saturated
3×	unsound

Counts

56 436 → 56 156

sample1.3min (12.9%)

Memory

-211.0MiB live, 98 169.6MiB allocated

Samples

56.8s	247 603×	0	valid
2.2s	10 750×	0	invalid
11.0ms	77×	1	valid

Precisions

Click to see histograms. Total time spent on operations: 47.6s

ival-mult: 10.3s (21.7% of total)

const: 8.0s (16.9% of total)

ival-<=: 6.9s (14.6% of total)

ival-div: 4.1s (8.5% of total)

ival-log: 2.2s (4.6% of total)

ival-add: 1.9s (4% of total)

ival-sub: 1.9s (3.9% of total)

ival-sin: 1.8s (3.9% of total)

ival-fabs: 1.5s (3.1% of total)

ival-sqrt: 1.4s (2.9% of total)

ival-and: 1.2s (2.4% of total)

ival-floor: 1.1s (2.3% of total)

ival-exp: 1.1s (2.3% of total)

ival-cos: 742.0ms (1.6% of total)

ival-neg: 509.0ms (1.1% of total)

ival-pi: 446.0ms (0.9% of total)

exact: 438.0ms (0.9% of total)

ival-tan: 323.0ms (0.7% of total)

ival-if: 267.0ms (0.6% of total)

ival-fmax: 260.0ms (0.5% of total)

ival-<: 245.0ms (0.5% of total)

ival-log2: 199.0ms (0.4% of total)

ival->: 162.0ms (0.3% of total)

ival-asin: 152.0ms (0.3% of total)

ival-atan: 130.0ms (0.3% of total)

ival-==: 118.0ms (0.2% of total)

ival-assert: 99.0ms (0.2% of total)

ival-sinh: 68.0ms (0.1% of total)

ival->=: 42.0ms (0.1% of total)

adjust: 3.0ms (0% of total)

Bogosity

prune1.2min (11.5%)

Memory: 13.5MiB live, 77 105.2MiB allocated
Counts: 236 612 → 4 694
Compiler: Compiled 389 789 to 154 562 computations (60.3% saved)

end1.2min (11.4%)

Memory: 3.7MiB live, 33 562.8MiB allocated

eval55.3s (9%)

Memory: 296.5MiB live, 86 368.2MiB allocated
Compiler: Compiled 40 304 301 to 542 968 computations (98.7% saved)

soundness53.7s (8.7%)

Memory

11.3MiB live, 39 823.3MiB allocated

Rules

1 584 866×	`lower-fma.f64`
1 584 326×	`lower-fma.f32`
1 024 470×	`lower-*.f64`
1 022 428×	`lower-*.f32`
510 436×	`lower-+.f64`

Stop Event

276×	iter limit
187×	node limit
29×	fuel
1×	done

Compiler

Compiled 35 520 to 15 566 computations (56.2% saved)

rewrite49.0s (8%)

Memory

710.7MiB live, 65 169.0MiB allocated

Algorithm

120×	batch-egg-rewrite

Rules

589 756×	`lower-fma.f64`
588 912×	`lower-fma.f32`
539 212×	`lower-*.f64`
536 428×	`lower-*.f32`
396 764×	`lower-/.f64`

Stop Event

246×	iter limit
117×	node limit
3×	unsound

Counts

2 160 → 79 071

regimes48.3s (7.9%)

Memory

140.3MiB live, 80 543.6MiB allocated

Counts

19 322 → 560

Calls

145 calls:

1.6s	u2
1.3s	s
1.3s	cosTheta_i
1.3s	u1
1.2s	(*.f32 uy #s(literal 2 binary32))

Compiler

Compiled 38 349 to 22 694 computations (40.8% saved)

localize29.6s (4.8%)

Memory

143.7MiB live, 43 178.7MiB allocated

Samples

11.6s	26 922×	0	valid
1.4s	1 069×	1	valid
1.1s	2 101×	0	invalid
257.0ms	93×	5	exit
185.0ms	509×	0	exit
21.0ms	22×	2	valid
5.0ms	4×	3	valid

Compiler

Compiled 111 927 to 5 796 computations (94.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 11.2s

ival-mult: 3.8s (33.6% of total)

ival-div: 1.7s (15.1% of total)

ival-add: 1.7s (14.7% of total)

const: 516.0ms (4.6% of total)

ival-sqrt: 474.0ms (4.2% of total)

ival-neg: 269.0ms (2.4% of total)

ival-sub: 265.0ms (2.4% of total)

ival-pow2: 263.0ms (2.3% of total)

ival-log: 239.0ms (2.1% of total)

ival-exp: 233.0ms (2.1% of total)

ival-pow: 219.0ms (2% of total)

ival-sin: 184.0ms (1.6% of total)

adjust: 183.0ms (1.6% of total)

ival-floor: 165.0ms (1.5% of total)

ival-asin: 141.0ms (1.3% of total)

ival-log1p: 121.0ms (1.1% of total)

ival-cos: 117.0ms (1% of total)

ival-fmax: 111.0ms (1% of total)

ival-log2: 88.0ms (0.8% of total)

ival-if: 86.0ms (0.8% of total)

ival-tan: 68.0ms (0.6% of total)

exact: 56.0ms (0.5% of total)

ival-acos: 54.0ms (0.5% of total)

ival-pi: 53.0ms (0.5% of total)

ival-fabs: 40.0ms (0.4% of total)

ival-e: 37.0ms (0.3% of total)

ival-true: 29.0ms (0.3% of total)

ival->: 28.0ms (0.2% of total)

ival->=: 16.0ms (0.1% of total)

ival-assert: 14.0ms (0.1% of total)

ival-atan: 14.0ms (0.1% of total)

ival-sinh: 9.0ms (0.1% of total)

ival-expm1: 6.0ms (0.1% of total)

ival-<: 6.0ms (0.1% of total)

analyze20.7s (3.4%)

Memory

68.0MiB live, 30 925.8MiB allocated

Algorithm

30×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	2.6%	97.4%	0%	0%	0%	0
0%	0%	2.6%	97.4%	0%	0%	0%	1
7.8%	0.2%	2.4%	97.4%	0%	0%	0%	2
8.5%	0.2%	2.4%	97.4%	0%	0%	0%	3
12.8%	0.3%	2.3%	97.4%	0%	0%	0%	4
47%	1.2%	1.4%	97.4%	0%	0%	0%	5
51.8%	1.3%	1.2%	97.4%	0%	0.1%	0%	6
69.5%	1.8%	0.8%	97.4%	0%	0.1%	0%	7
71.6%	1.8%	0.7%	97.4%	0%	0.1%	0%	8
81.1%	2.1%	0.5%	97.4%	0%	0.1%	0%	9
82.6%	2.1%	0.4%	97.4%	0%	0.1%	0%	10
88.3%	2.2%	0.3%	97.4%	0%	0.1%	0%	11
89.1%	2.2%	0.3%	97.4%	0%	0.1%	0%	12

Compiler

Compiled 2 586 to 1 076 computations (58.4% saved)

series13.9s (2.3%)

Memory

145.1MiB live, 19 788.2MiB allocated

Counts

2 160 → 56 436

Calls

10671 calls:

Time	Variable		Point	Expression
265.0ms	maxCos	@	inf	(* (sin (* (* uy 2) (PI))) (sqrt (* ux (+ (* maxCos -2) 2))))
224.0ms	ux	@	-inf	(- 1 ux)
175.0ms	s	@	inf	(* (neg s) (log (- (/ 1 (+ (- (/ u (+ 1 (exp (/ (neg (PI)) s)))) (/ u (+ 1 (exp (/ (PI) s))))) (/ 1 (+ 1 (pow (E) (/ (PI) s)))))) 1)))
163.0ms	ux	@	0	(+ (* (* -1/2 (sqrt (/ (* ux (* ux ux)) (+ (* maxCos -2) 2)))) (* (+ maxCos -1) (+ maxCos -1))) (sqrt (* ux (+ (* maxCos -2) 2))))
162.0ms	s	@	0	(* (* (neg s) (log (+ 1 (+ (* u -4/3) 1/3)))) 3)

preprocess11.2s (1.8%)

Memory

52.3MiB live, 15 052.5MiB allocated

Algorithm

30×	egg-herbie

Rules

132 696×	`lower-fma.f64`
132 696×	`lower-fma.f32`
46 474×	`lower-*.f64`
46 188×	`lower-*.f32`
27 984×	`unsub-neg`

Stop Event

60×	iter limit
31×	saturated
29×	node limit

Compiler

Compiled 53 696 to 16 712 computations (68.9% saved)

explain9.2s (1.5%)

Memory

-359.1MiB live, 13 381.3MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`log.f32`	`#f`	sensitivity	979	82
`-.f32`	`#f`	cancellation	387	34
`sqrt.f32`	`#f`	oflow-rescue	372	0
`cos.f32`	`#f`	sensitivity	175	11
`tan.f32`	`(tan.f32 (+.f32 (.f32 (.f32 #s(literal 2 binary32) (PI.f32)) u1) (*.f32 #s(literal 1/2 binary32) (PI.f32))))`	cancellation	169	24
`/.f32`	`#f`	o/n	162	0
`exp.f32`	`#f`	sensitivity	46	17
`/.f32`	`#f`	u/n	28	0
`/.f32`	`#f`	o/o	24	0
`sqrt.f32`	`(sqrt.f32 (-.f32 (.f32 eta eta) (/.f32 (.f32 sinTheta_O sinTheta_O) (sqrt.f32 (-.f32 #s(literal 1 binary32) (*.f32 sinTheta_O sinTheta_O))))))`	uflow-rescue	14	0
↳	`(*.f32 sinTheta_O sinTheta_O)`	underflow	300
↳	`(-.f32 (.f32 eta eta) (/.f32 (.f32 sinTheta_O sinTheta_O) (sqrt.f32 (-.f32 #s(literal 1 binary32) (*.f32 sinTheta_O sinTheta_O)))))`	underflow	14
↳	`(/.f32 (.f32 sinTheta_O sinTheta_O) (sqrt.f32 (-.f32 #s(literal 1 binary32) (.f32 sinTheta_O sinTheta_O))))`	underflow	150
↳	`(*.f32 eta eta)`	underflow	14
`/.f32`	`(/.f32 (neg.f32 (log.f32 (-.f32 #s(literal 1 binary32) u0))) (+.f32 (/.f32 cos2phi (.f32 alphax alphax)) (/.f32 sin2phi (.f32 alphay alphay))))`	n/o	3	0
↳	`(/.f32 sin2phi (*.f32 alphay alphay))`	overflow	9
↳	`(+.f32 (/.f32 cos2phi (.f32 alphax alphax)) (/.f32 sin2phi (.f32 alphay alphay)))`	overflow	9
`*.f32`	`#f`	*nu**	2	0
`+.f32`	`(+.f32 (.f32 (.f32 (sin.f32 (.f32 (-.f32 #s(literal 1 binary32) u) normAngle)) (/.f32 #s(literal 1 binary32) (sin.f32 normAngle))) n0_i) (.f32 (.f32 (sin.f32 (.f32 u normAngle)) (/.f32 #s(literal 1 binary32) (sin.f32 normAngle))) n1_i))`	cancellation	1	0

Confusion

	Predicted +	Predicted -
+	1650	52
-	368	5610

Precision

0.817641228939544

Recall

0.9694477085781433

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	1650	31	21
-	368	117	5493

Precision?

0.7760849492151431

Recall?

0.9876615746180963

Freqs

test

number	freq
0	5662
1	1698
2	296
3	24

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	21	0	0
-	3	0	6

Precision?

0.875

Recall?

1.0

Samples

2.3s	15 262×	0	valid
49.0ms	84×	1	valid
8.0ms	14×	5	exit

Compiler

Compiled 18 280 to 2 256 computations (87.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.6s

ival-mult: 455.0ms (29.2% of total)

ival-div: 204.0ms (13.1% of total)

ival-sub: 159.0ms (10.2% of total)

ival-add: 133.0ms (8.5% of total)

ival-log: 109.0ms (7% of total)

ival-sqrt: 87.0ms (5.6% of total)

ival-sin: 69.0ms (4.4% of total)

ival-floor: 52.0ms (3.3% of total)

ival-exp: 40.0ms (2.6% of total)

ival-cos: 39.0ms (2.5% of total)

ival-neg: 37.0ms (2.4% of total)

const: 24.0ms (1.5% of total)

ival-pi: 21.0ms (1.3% of total)

ival-tan: 18.0ms (1.2% of total)

ival-fmax: 17.0ms (1.1% of total)

ival-true: 15.0ms (1% of total)

exact: 14.0ms (0.9% of total)

ival-if: 13.0ms (0.8% of total)

ival-log2: 12.0ms (0.8% of total)

ival-fabs: 8.0ms (0.5% of total)

ival-assert: 7.0ms (0.4% of total)

ival-atan: 6.0ms (0.4% of total)

ival-sinh: 5.0ms (0.3% of total)

adjust: 4.0ms (0.3% of total)

ival-asin: 4.0ms (0.3% of total)

ival->=: 4.0ms (0.3% of total)

ival->: 3.0ms (0.2% of total)

ival-<: 1.0ms (0.1% of total)

bsearch103.0ms (0%)

Memory

77.0MiB live, 195.6MiB allocated

Algorithm

84×	left-value
40×	binary-search

Stop Event

40×	narrow-enough

Compiler

Compiled 4 193 to 2 844 computations (32.2% saved)

simplify1.7min (16.8%)

sample1.3min (12.9%)

prune1.2min (11.5%)

end1.2min (11.4%)

eval55.3s (9%)

soundness53.7s (8.7%)

rewrite49.0s (8%)

regimes48.3s (7.9%)

localize29.6s (4.8%)

analyze20.7s (3.4%)

series13.9s (2.3%)

preprocess11.2s (1.8%)

explain9.2s (1.5%)

bsearch103.0ms (0%)

Profiling