Metrics for Herbie run

Date:	Monday, August 19th, 2024
Commit:	2d359425 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024232
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

prune6.0min (33.5%)

Memory: -810.9MiB live, 909 252.2MiB allocated
Counts: 292 408 → 7 774
Compiler: Compiled 677 720 to 282 140 computations (58.4% saved)

sample3.4min (18.9%)

Memory

-563.0MiB live, 266 313.2MiB allocated

Samples

58.8s	121 711×	1	valid
37.8s	280 297×	0	valid
29.2s	14 269×	5	exit
16.8s	24 139×	2	valid
7.5s	3 129×	3	valid
7.0s	34 429×	0	exit
4.2s	10 849×	1	exit
3.2s	20 625×	0	invalid
2.6s	10 975×	1	invalid
726.0ms	36×	4	valid
560.0ms	792×	2	invalid
532.0ms	40×	4	exit
149.0ms	15×	3	exit
24.0ms	12×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 2.5min

ival-pow: 24.9s (16.9% of total)

ival-mult: 19.2s (13.1% of total)

ival-cos: 19.0s (12.9% of total)

ival-sin: 15.4s (10.5% of total)

ival-div: 12.4s (8.4% of total)

adjust: 10.0s (6.8% of total)

ival-pow2: 8.6s (5.9% of total)

ival-sub: 6.7s (4.6% of total)

ival-add: 6.4s (4.3% of total)

ival-exp: 5.6s (3.8% of total)

ival-log: 4.6s (3.1% of total)

ival-sqrt: 3.4s (2.3% of total)

ival-neg: 1.8s (1.3% of total)

ival-<: 1.8s (1.2% of total)

const: 1.6s (1.1% of total)

ival-atan2: 810.0ms (0.6% of total)

ival-hypot: 691.0ms (0.5% of total)

ival-pi: 621.0ms (0.4% of total)

ival-tan: 553.0ms (0.4% of total)

ival-acos: 452.0ms (0.3% of total)

ival-atan: 441.0ms (0.3% of total)

exact: 410.0ms (0.3% of total)

ival-and: 324.0ms (0.2% of total)

ival-true: 306.0ms (0.2% of total)

ival-cbrt: 295.0ms (0.2% of total)

ival-assert: 216.0ms (0.1% of total)

ival-asin: 170.0ms (0.1% of total)

ival-<=: 158.0ms (0.1% of total)

ival-fabs: 156.0ms (0.1% of total)

ival-log1p: 122.0ms (0.1% of total)

ival-==: 1.0ms (0% of total)

ival-or: 0.0ms (0% of total)

Bogosity

simplify2.1min (11.7%)

Memory

1 295.8MiB live, 164 723.6MiB allocated

Algorithm

451×	egg-herbie

Rules

3 603 528×	`lower-fma.f32`
3 602 434×	`lower-fma.f64`
1 712 566×	`lower-*.f32`
1 708 358×	`lower-*.f64`
963 960×	`lower-+.f32`

Stop Event

600×	iter limit
320×	node limit
131×	saturated

Counts

97 200 → 96 473

soundness1.1min (6.3%)

Memory

326.2MiB live, 55 983.6MiB allocated

Rules

2 256 514×	`lower-fma.f32`
2 255 750×	`lower-fma.f64`
1 475 318×	`lower-*.f32`
1 472 126×	`lower-*.f64`
761 218×	`lower-+.f32`

Stop Event

434×	iter limit
286×	node limit
44×	fuel
6×	done

Compiler

Compiled 59 828 to 26 731 computations (55.3% saved)

localize1.1min (6.2%)

Memory

-427.3MiB live, 103 785.4MiB allocated

Samples

24.5s	17 737×	1	valid
8.9s	26 275×	0	valid
8.6s	4 563×	2	valid
2.5s	349×	5	exit
943.0ms	483×	3	valid
798.0ms	272×	1	invalid
784.0ms	1 354×	0	invalid
413.0ms	48×	4	exit
128.0ms	8×	3	exit
22.0ms	30×	1	exit
21.0ms	2×	4	valid
16.0ms	77×	0	exit
12.0ms	2×	2	exit

Compiler

Compiled 124 146 to 9 162 computations (92.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 38.4s

ival-mult: 8.3s (21.6% of total)

ival-cos: 5.5s (14.3% of total)

ival-sin: 5.3s (13.8% of total)

ival-div: 3.6s (9.4% of total)

adjust: 3.3s (8.5% of total)

ival-add: 2.6s (6.8% of total)

ival-pow2: 1.6s (4.3% of total)

ival-sub: 1.2s (3.2% of total)

ival-sqrt: 1.1s (2.8% of total)

const: 1.0s (2.7% of total)

ival-exp: 988.0ms (2.6% of total)

ival-log: 925.0ms (2.4% of total)

ival-pow: 567.0ms (1.5% of total)

ival-atan2: 473.0ms (1.2% of total)

ival-neg: 331.0ms (0.9% of total)

ival-hypot: 285.0ms (0.7% of total)

ival-log1p: 227.0ms (0.6% of total)

ival-cbrt: 156.0ms (0.4% of total)

ival-tan: 147.0ms (0.4% of total)

ival-acos: 135.0ms (0.4% of total)

ival-fabs: 112.0ms (0.3% of total)

exact: 96.0ms (0.3% of total)

ival-pi: 81.0ms (0.2% of total)

ival-atan: 81.0ms (0.2% of total)

ival-asin: 56.0ms (0.1% of total)

ival-true: 46.0ms (0.1% of total)

ival-expm1: 30.0ms (0.1% of total)

ival-e: 26.0ms (0.1% of total)

ival-assert: 23.0ms (0.1% of total)

ival-cosh: 9.0ms (0% of total)

ival-copysign: 6.0ms (0% of total)

ival-sinh: 2.0ms (0% of total)

ival-tanh: 1.0ms (0% of total)

rewrite1.1min (6.1%)

Memory

-694.9MiB live, 92 222.4MiB allocated

Rules

869 044×	`lower-fma.f32`
867 964×	`lower-fma.f64`
857 126×	`lower-*.f32`
853 040×	`lower-*.f64`
664 886×	`lower-/.f32`

Stop Event

410×	iter limit
198×	node limit
1×	saturated
1×	unsound

Counts

3 673 → 141 974

eval58.5s (5.4%)

Memory: 1 987.9MiB live, 100 432.0MiB allocated
Compiler: Compiled 15 766 195 to 721 185 computations (95.4% saved)

regimes42.8s (4%)

Memory

397.4MiB live, 66 290.3MiB allocated

Counts

25 135 → 1 013

Calls

154 calls:

2.9s	phi2
2.8s	phi1
2.5s	lambda1
2.5s	lambda2
2.5s	b

Compiler

Compiled 26 115 to 15 556 computations (40.4% saved)

series24.0s (2.2%)

Memory

326.2MiB live, 37 826.5MiB allocated

Counts

3 673 → 97 200

Calls

13011 calls:

Time	Variable		Point	Expression
331.0ms	angle	@	inf	(+ (pow (exp 2) (log (* a (sqrt (+ (* 1/2 (cos (* (* (PI) angle) 1/90))) 1/2))))) (pow (* b (sin (* (* (PI) angle) 1/180))) 2))
198.0ms	s	@	inf	(/ (* (pow (/ 1 (+ 1 (exp (neg s)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg s))))) c_n)) (* (pow (/ 1 (+ 1 (exp (neg t)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg t))))) c_n)))
187.0ms	t	@	0	(* eh (sin t))
169.0ms	c	@	inf	(* a (+ (* c -3) (/ (* b b) a)))
156.0ms	phi2	@	-inf	(log (+ (* (cos phi2) (cos (- lambda1 lambda2))) (cos phi1)))

explain21.0s (1.9%)

Memory

-124.9MiB live, 32 435.9MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`cos.f64`	`#f`	sensitivity	1791	0
`+.f64`	`#f`	cancellation	1715	32
`sin.f64`	`#f`	sensitivity	1523	4
`sqrt.f64`	`#f`	oflow-rescue	1369	0
`-.f64`	`#f`	cancellation	957	9
`log.f64`	`#f`	sensitivity	585	1
`-.f64`	`#f`	nan-rescue	516	0
`/.f64`	`#f`	o/n	466	0
`/.f64`	`#f`	u/u	358	0
`/.f64`	`#f`	o/o	293	0
`*.f64`	`#f`	*no**	275	0
`/.f64`	`#f`	u/n	185	0
`sqrt.f64`	`#f`	uflow-rescue	161	0
`exp.f64`	`#f`	sensitivity	160	35
`/.f64`	`#f`	n/o	108	0
`cbrt.f64`	`#f`	oflow-rescue	90	0
`*.f64`	`#f`	*nu**	80	0
`cbrt.f64`	`#f`	uflow-rescue	38	0
`/.f64`	`#f`	n/u	37	0
`*.f64`	`#f`	*uo**	34	0
`*.f64`	`#f`	*ou**	23	0
`acos.f64`	`(acos.f64 (+.f64 (.f64 (sin.f64 phi1) (sin.f64 phi2)) (.f64 (*.f64 (cos.f64 phi1) (cos.f64 phi2)) (cos.f64 (-.f64 lambda1 lambda2)))))`	sensitivity	18	5
`pow.f64`	`#f`	uflow-rescue	7	0
`pow.f64`	`#f`	sensitivity	5	0
`log.f64`	`(log.f64 (+.f64 (exp.f64 a) (exp.f64 b)))`	oflow-rescue	3	0
↳	`(+.f64 (exp.f64 a) (exp.f64 b))`	overflow	3
↳	`(exp.f64 a)`	overflow	2
↳	`(exp.f64 b)`	overflow	1
`asin.f64`	`(asin.f64 (+.f64 (.f64 (sin.f64 phi1) (cos.f64 delta)) (.f64 (*.f64 (cos.f64 phi1) (sin.f64 delta)) (cos.f64 theta))))`	sensitivity	1	0

Confusion

	Predicted +	Predicted -
+	5724	84
-	1337	6167

Precision

0.8106500495680499

Recall

0.9855371900826446

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5724	55	29
-	1337	26	6141

Precision?

0.8091570988518623

Recall?

0.9950068870523416

Freqs

test

number	freq
0	6251
1	4721
2	1576
3	381
4	215
5	110
6	41
7	11
8	5
9	1

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	42	1	0
-	2	0	7

Precision?

0.9555555555555556

Recall?

1.0

Samples

4.0s	7 898×	1	valid
2.1s	16 506×	0	valid
2.1s	1 880×	2	valid
593.0ms	338×	3	valid
2.0ms	2×	4	valid

Compiler

Compiled 20 079 to 2 554 computations (87.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 6.9s

ival-sin: 1.8s (26.2% of total)

ival-cos: 1.1s (15.7% of total)

ival-mult: 945.0ms (13.6% of total)

ival-div: 531.0ms (7.7% of total)

adjust: 468.0ms (6.8% of total)

ival-pow2: 375.0ms (5.4% of total)

ival-sub: 296.0ms (4.3% of total)

ival-add: 284.0ms (4.1% of total)

ival-log: 282.0ms (4.1% of total)

ival-exp: 210.0ms (3% of total)

ival-sqrt: 172.0ms (2.5% of total)

ival-neg: 79.0ms (1.1% of total)

ival-hypot: 60.0ms (0.9% of total)

ival-tan: 48.0ms (0.7% of total)

ival-pi: 48.0ms (0.7% of total)

ival-atan2: 46.0ms (0.7% of total)

ival-atan: 35.0ms (0.5% of total)

ival-true: 25.0ms (0.4% of total)

ival-acos: 23.0ms (0.3% of total)

ival-pow: 21.0ms (0.3% of total)

exact: 19.0ms (0.3% of total)

ival-cbrt: 18.0ms (0.3% of total)

ival-assert: 12.0ms (0.2% of total)

ival-fabs: 12.0ms (0.2% of total)

ival-asin: 9.0ms (0.1% of total)

ival-log1p: 5.0ms (0.1% of total)

analyze16.3s (1.5%)

Memory

168.7MiB live, 25 369.5MiB allocated

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
17.2%	13.7%	65.7%	20.6%	0%	0%	0%	1
25%	19.6%	58.5%	20.6%	0%	1.3%	0%	2
35.2%	26.6%	48.9%	20.6%	0%	3.8%	0%	3
42.3%	31.7%	43.1%	20.6%	0%	4.5%	0%	4
47.9%	35.6%	38.7%	20.6%	0%	5.1%	0%	5
51%	37.6%	36.1%	20.6%	0%	5.7%	0%	6
54.4%	39.7%	33.2%	20.6%	0%	6.5%	0%	7
56.2%	40.7%	31.8%	20.6%	0%	6.8%	0%	8
59%	42.5%	29.5%	20.6%	0%	7.4%	0%	9
60.3%	43.2%	28.4%	20.6%	0%	7.7%	0%	10
62.1%	44.3%	27%	20.6%	0%	8.1%	0%	11
63.6%	45.1%	25.8%	20.6%	0%	8.5%	0%	12

Compiler

Compiled 1 826 to 990 computations (45.8% saved)

preprocess16.2s (1.5%)

Memory

181.5MiB live, 19 741.7MiB allocated

Algorithm

52×	egg-herbie

Rules

238 304×	`lower-fma.f64`
238 304×	`lower-fma.f32`
81 478×	`lower-*.f32`
81 146×	`lower-*.f64`
46 832×	`unsub-neg`

Stop Event

104×	iter limit
61×	saturated
43×	node limit

Compiler

Compiled 60 323 to 17 624 computations (70.8% saved)

bsearch9.1s (0.8%)

Memory

-251.7MiB live, 13 975.1MiB allocated

Algorithm

328×	binary-search
137×	left-value

Stop Event

317×	narrow-enough
11×	predicate-same

Samples

4.2s	6 394×	1	valid
2.5s	12 778×	0	valid
335.0ms	458×	2	valid
64.0ms	760×	0	invalid
8.0ms	22×	1	exit
3.0ms	2×	3	valid

Compiler

Compiled 122 565 to 77 213 computations (37% saved)

Precisions

Click to see histograms. Total time spent on operations: 5.9s

ival-sin: 1.5s (24.8% of total)

ival-cos: 1.4s (24.3% of total)

ival-mult: 834.0ms (14.2% of total)

ival-div: 403.0ms (6.9% of total)

ival-sub: 369.0ms (6.3% of total)

adjust: 323.0ms (5.5% of total)

ival-pow2: 274.0ms (4.7% of total)

ival-sqrt: 150.0ms (2.6% of total)

ival-add: 138.0ms (2.3% of total)

ival-atan2: 135.0ms (2.3% of total)

ival-hypot: 68.0ms (1.2% of total)

ival-acos: 52.0ms (0.9% of total)

ival-atan: 51.0ms (0.9% of total)

ival-neg: 48.0ms (0.8% of total)

ival-tan: 44.0ms (0.7% of total)

ival-exp: 27.0ms (0.5% of total)

ival-pi: 16.0ms (0.3% of total)

ival-true: 16.0ms (0.3% of total)

ival-fabs: 15.0ms (0.3% of total)

exact: 11.0ms (0.2% of total)

ival-assert: 8.0ms (0.1% of total)

ival-asin: 5.0ms (0.1% of total)

ival-log1p: 4.0ms (0.1% of total)

ival-log: 4.0ms (0.1% of total)

start1.0ms (0%)

Memory: 3.1MiB live, 3.0MiB allocated

end0.0ms (0%)

Memory: 0.9MiB live, 1.0MiB allocated

prune6.0min (33.5%)

sample3.4min (18.9%)

simplify2.1min (11.7%)

soundness1.1min (6.3%)

localize1.1min (6.2%)

rewrite1.1min (6.1%)

eval58.5s (5.4%)

regimes42.8s (4%)

series24.0s (2.2%)

explain21.0s (1.9%)

analyze16.3s (1.5%)

preprocess16.2s (1.5%)

bsearch9.1s (0.8%)

start1.0ms (0%)

end0.0ms (0%)

Profiling