Metrics for Herbie run

Date:	Tuesday, July 9th, 2024
Commit:	05213bce on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024191
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample3.5min (24.1%)

Memory

368.1MiB live, 254 624.5MiB allocated

Samples

1.1min	127 360×	1	valid
38.7s	273 724×	0	valid
29.5s	15 356×	5	exit
19.0s	24 905×	2	valid
8.4s	3 290×	3	valid
7.1s	34 383×	0	exit
4.3s	10 162×	1	exit
2.9s	19 819×	0	invalid
2.3s	12 087×	1	invalid
534.0ms	29×	4	exit
435.0ms	33×	4	valid
422.0ms	829×	2	invalid
262.0ms	23×	3	exit
76.0ms	16×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 2.5min

ival-pow: 24.7s (16.3% of total)

ival-mult: 21.9s (14.5% of total)

ival-cos: 17.2s (11.4% of total)

ival-sin: 15.8s (10.5% of total)

ival-div: 13.4s (8.9% of total)

ival-pow2: 8.9s (5.9% of total)

adjust: 7.7s (5.1% of total)

ival-sub: 7.6s (5% of total)

ival-add: 6.8s (4.5% of total)

ival-exp: 5.6s (3.7% of total)

ival-log: 5.4s (3.5% of total)

ival-sqrt: 4.3s (2.8% of total)

ival-neg: 2.7s (1.8% of total)

const: 2.1s (1.4% of total)

ival-<: 1.6s (1% of total)

ival-atan2: 863.0ms (0.6% of total)

ival-hypot: 714.0ms (0.5% of total)

ival-tan: 566.0ms (0.4% of total)

exact: 528.0ms (0.3% of total)

ival-pi: 501.0ms (0.3% of total)

ival-acos: 367.0ms (0.2% of total)

ival-atan: 342.0ms (0.2% of total)

ival-and: 326.0ms (0.2% of total)

ival-true: 302.0ms (0.2% of total)

ival-cbrt: 287.0ms (0.2% of total)

ival-assert: 204.0ms (0.1% of total)

ival-<=: 143.0ms (0.1% of total)

ival-asin: 141.0ms (0.1% of total)

ival-fabs: 140.0ms (0.1% of total)

ival-log1p: 116.0ms (0.1% of total)

ival-==: 1.0ms (0% of total)

ival-or: 0.0ms (0% of total)

Bogosity

simplify2.9min (19.6%)

Memory

813.7MiB live, 214 670.4MiB allocated

Algorithm

454×	egg-herbie

Rules

172 393×	`fma-define`
130 048×	`fmm-def`
106 251×	`distribute-lft-in`
93 343×	`times-frac`
91 791×	`distribute-rgt-in`

Stop Event

327×	node limit
125×	saturated
2×	unsound

Counts

146 258 → 121 999

soundness1.8min (12.2%)

Memory

417.8MiB live, 127 167.6MiB allocated

Rules

83 470×	`fma-define`
62 742×	`log1p-expm1-u`
48 890×	`distribute-lft-in`
48 479×	`expm1-log1p-u`
47 235×	`fmm-def`

Stop Event

239×	node limit
45×	fuel
15×	saturated
7×	done
4×	unsound

Compiler

Compiled 56 841 to 16 758 computations (70.5% saved)

localize1.0min (7.2%)

Memory

-302.9MiB live, 86 502.4MiB allocated

Samples

16.3s	12 351×	1	valid
9.2s	29 260×	0	valid
4.9s	996×	5	exit
4.8s	2 845×	2	valid
2.3s	4 222×	0	invalid
1.2s	354×	3	valid
1.0s	192×	4	exit
723.0ms	449×	1	invalid
375.0ms	94×	3	exit
348.0ms	256×	2	exit
334.0ms	410×	1	exit
53.0ms	19×	2	invalid
17.0ms	4×	4	valid
2.0ms	4×	0	exit

Compiler

Compiled 95 621 to 7 894 computations (91.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 32.7s

ival-mult: 6.5s (19.8% of total)

ival-sin: 4.7s (14.4% of total)

ival-cos: 4.0s (12.3% of total)

ival-div: 3.4s (10.5% of total)

ival-pow2: 1.9s (5.8% of total)

adjust: 1.9s (5.7% of total)

ival-pow: 1.6s (4.9% of total)

ival-add: 1.6s (4.9% of total)

ival-sub: 1.0s (3.2% of total)

const: 946.0ms (2.9% of total)

ival-sqrt: 809.0ms (2.5% of total)

ival-log: 804.0ms (2.5% of total)

ival-exp: 575.0ms (1.8% of total)

ival-atan2: 488.0ms (1.5% of total)

ival-log1p: 447.0ms (1.4% of total)

ival-hypot: 424.0ms (1.3% of total)

ival-cbrt: 341.0ms (1% of total)

ival-neg: 270.0ms (0.8% of total)

ival-expm1: 243.0ms (0.7% of total)

ival-acos: 147.0ms (0.4% of total)

exact: 132.0ms (0.4% of total)

ival-atan: 125.0ms (0.4% of total)

ival-tan: 101.0ms (0.3% of total)

ival-fabs: 97.0ms (0.3% of total)

ival-pi: 62.0ms (0.2% of total)

ival-true: 48.0ms (0.1% of total)

ival-assert: 22.0ms (0.1% of total)

ival-asin: 17.0ms (0.1% of total)

ival-copysign: 5.0ms (0% of total)

ival-cosh: 3.0ms (0% of total)

regimes1.0min (7.1%)

Memory

267.1MiB live, 81 835.1MiB allocated

Counts

25 415 → 830

Calls

155 calls:

4.7s	phi1
4.5s	lambda2
4.3s	phi2
4.3s	lambda1
2.8s	(-.f64 lambda1 lambda2)

Compiler

Compiled 13 582 to 8 845 computations (34.9% saved)

rewrite54.8s (6.2%)

Memory

-252.7MiB live, 57 549.7MiB allocated

Algorithm

201×	batch-egg-rewrite

Rules

124 300×	`log1p-expm1-u`
93 364×	`expm1-log1p-u`
52 621×	`pow1`
48 880×	`add-exp-log`
46 586×	`add-log-exp`

Stop Event

197×	node limit
4×	unsound

Counts

2 984 → 77 992

prune54.3s (6.2%)

Memory: -1 211.8MiB live, 88 208.7MiB allocated
Counts: 193 344 → 8 474
Compiler: Compiled 597 877 to 295 645 computations (50.6% saved)

eval42.9s (4.9%)

Memory: 852.4MiB live, 60 242.3MiB allocated
Compiler: Compiled 9 053 554 to 869 663 computations (90.4% saved)

series36.6s (4.2%)

Memory

473.5MiB live, 51 852.8MiB allocated

Counts

2 984 → 68 266

Calls

17670 calls:

Time	Variable		Point	Expression
378.0ms	phi2	@	inf	(- (exp (- (log (* (neg R) (cos (* 1/2 (+ phi1 phi2))))) (log (/ -1 lambda1)))) 1)
365.0ms	a	@	0	(sqrt (+ (* (* b (cos (* angle (* (PI) 1/180)))) (* b (cos (* angle (* (PI) 1/180))))) (* (* a (sin (* angle (* (PI) 1/180)))) (* a (sin (* angle (* (PI) 1/180)))))))
359.0ms	angle	@	-inf	(log (- (+ (/ (pow (* b (cos (* 1/180 (* angle (PI))))) 2) (pow x-scale 2)) (* (pow (* (sin (* 1/180 (* angle (PI)))) b) 2) (pow y-scale -2))) (sqrt (+ (* 4 (* (pow b 4) (/ (pow (* (cos (* 1/180 (* angle (PI)))) (sin (* 1/180 (* angle (PI))))) 2) (pow (* x-scale y-scale) 2)))) (pow (- (/ (pow b 2) (pow x-scale 2)) (* (pow (* (sin (* 1/180 (* angle (PI)))) b) 2) (pow y-scale -2))) 2)))))
289.0ms	angle	@	-inf	(log (* 2 (+ (pow (* a (cos (* 1/180 (* angle (PI))))) 2) (pow (* b (sin (* 1/180 (* angle (PI))))) 2))))
272.0ms	y-scale	@	-inf	(* 1/4 (* x-scale (* (* y-scale (sqrt 8)) (sqrt (+ (* (pow b 2) (/ (pow (cos (* 1/180 (* angle (PI)))) 2) (pow x-scale 2))) (- (/ (* (pow (sin (* 1/180 (* angle (PI)))) 2) (pow b 2)) (pow y-scale 2)) (sqrt (+ (* 4 (* (pow b 4) (* (pow (cos (* 1/180 (* angle (PI)))) 2) (/ (pow (sin (* 1/180 (* angle (PI)))) 2) (* (pow x-scale 2) (pow y-scale 2)))))) (pow (- (* (pow b 2) (/ (pow (cos (* 1/180 (* angle (PI)))) 2) (pow x-scale 2))) (/ (* (pow (sin (* 1/180 (* angle (PI)))) 2) (pow b 2)) (pow y-scale 2))) 2)))))))))

explain23.2s (2.6%)

Memory

519.0MiB live, 30 354.1MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`cos.f64`	`#f`	sensitivity	1791	3
`+.f64`	`#f`	cancellation	1711	33
`sin.f64`	`#f`	sensitivity	1540	5
`sqrt.f64`	`#f`	oflow-rescue	1480	0
`-.f64`	`#f`	cancellation	906	12
`log.f64`	`#f`	sensitivity	570	2
`-.f64`	`#f`	nan-rescue	502	0
`/.f64`	`#f`	o/n	490	0
`/.f64`	`#f`	u/u	345	0
`/.f64`	`#f`	o/o	305	0
`*.f64`	`#f`	*no**	236	0
`/.f64`	`#f`	u/n	190	0
`exp.f64`	`#f`	sensitivity	169	26
`sqrt.f64`	`#f`	uflow-rescue	167	0
`/.f64`	`#f`	n/o	107	0
`*.f64`	`#f`	*nu**	100	0
`cbrt.f64`	`#f`	oflow-rescue	81	0
`cbrt.f64`	`#f`	uflow-rescue	45	0
`/.f64`	`#f`	n/u	41	0
`*.f64`	`#f`	*uo**	35	0
`*.f64`	`#f`	*ou**	26	0
`acos.f64`	`(acos.f64 (+.f64 (.f64 (sin.f64 phi1) (sin.f64 phi2)) (.f64 (*.f64 (cos.f64 phi1) (cos.f64 phi2)) (cos.f64 (-.f64 lambda1 lambda2)))))`	sensitivity	15	2
`pow.f64`	`#f`	uflow-rescue	9	0
`log.f64`	`#f`	oflow-rescue	7	0
`pow.f64`	`#f`	sensitivity	6	2
`log.f64`	`(log.f64 (+.f64 (exp.f64 a) (exp.f64 b)))`	uflow-rescue	1	0
↳	`(+.f64 (exp.f64 a) (exp.f64 b))`	underflow	1
↳	`(exp.f64 a)`	underflow	117
↳	`(exp.f64 b)`	underflow	1
`sin.f64`	`(sin.f64 (*.f64 (/.f64 angle #s(literal 180 binary64)) (PI.f64)))`	cancellation	1	0

Confusion

	Predicted +	Predicted -
+	5760	75
-	1352	6125

Precision

0.8098987626546682

Recall

0.987146529562982

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5760	44	31
-	1352	33	6092

Precision?

0.8073445541799972

Recall?

0.994687232219366

Freqs

test

number	freq
0	6200
1	4729
2	1648
3	362
4	206
5	99
6	39
7	22
8	5
9	2

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	42	0	1
-	2	1	6

Precision?

0.9333333333333333

Recall?

0.9767441860465116

Samples

4.1s	8 230×	1	valid
2.4s	1 986×	2	valid
2.2s	16 080×	0	valid
513.0ms	324×	3	valid
11.0ms	4×	4	valid

Compiler

Compiled 21 748 to 3 336 computations (84.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 7.4s

ival-sin: 1.4s (19.6% of total)

ival-cos: 1.2s (16.3% of total)

ival-mult: 950.0ms (12.9% of total)

ival-div: 675.0ms (9.1% of total)

ival-add: 529.0ms (7.2% of total)

ival-pow2: 510.0ms (6.9% of total)

ival-exp: 418.0ms (5.7% of total)

adjust: 340.0ms (4.6% of total)

ival-log: 301.0ms (4.1% of total)

ival-sqrt: 289.0ms (3.9% of total)

ival-sub: 267.0ms (3.6% of total)

ival-neg: 80.0ms (1.1% of total)

ival-tan: 62.0ms (0.8% of total)

ival-atan2: 49.0ms (0.7% of total)

ival-pi: 43.0ms (0.6% of total)

ival-hypot: 33.0ms (0.4% of total)

ival-pow: 30.0ms (0.4% of total)

exact: 26.0ms (0.4% of total)

ival-atan: 26.0ms (0.4% of total)

ival-true: 25.0ms (0.3% of total)

ival-acos: 22.0ms (0.3% of total)

ival-cbrt: 18.0ms (0.2% of total)

ival-assert: 11.0ms (0.1% of total)

ival-fabs: 10.0ms (0.1% of total)

ival-asin: 8.0ms (0.1% of total)

ival-log1p: 5.0ms (0.1% of total)

analyze18.1s (2.1%)

Memory

-479.0MiB live, 22 546.4MiB allocated

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
17.2%	13.7%	65.7%	20.6%	0%	0%	0%	1
25%	19.6%	58.5%	20.6%	0%	1.3%	0%	2
35.2%	26.6%	48.9%	20.6%	0%	3.8%	0%	3
42.3%	31.7%	43.1%	20.6%	0%	4.5%	0%	4
47.9%	35.6%	38.7%	20.6%	0%	5.1%	0%	5
51%	37.6%	36.1%	20.6%	0%	5.7%	0%	6
54.4%	39.7%	33.2%	20.6%	0%	6.5%	0%	7
56.2%	40.7%	31.8%	20.6%	0%	6.8%	0%	8
59%	42.5%	29.5%	20.6%	0%	7.4%	0%	9
60.3%	43.2%	28.4%	20.6%	0%	7.7%	0%	10
62.1%	44.3%	27%	20.6%	0%	8.1%	0%	11
63.6%	45.1%	25.8%	20.6%	0%	8.5%	0%	12

Compiler

Compiled 1 826 to 990 computations (45.8% saved)

bsearch17.1s (1.9%)

Memory

-167.1MiB live, 20 329.0MiB allocated

Algorithm

282×	binary-search
56×	left-value

Stop Event

274×	narrow-enough
7×	predicate-same
1×	predicate-failed

Samples

7.4s	11 416×	1	valid
3.3s	23 110×	0	valid
1.1s	1 364×	2	valid
686.0ms	871×	5	exit
537.0ms	133×	3	valid
128.0ms	1 552×	0	invalid
6.0ms	18×	1	exit

Compiler

Compiled 92 678 to 64 361 computations (30.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 11.3s

ival-sin: 2.8s (24.4% of total)

ival-cos: 2.7s (23.5% of total)

ival-mult: 1.6s (14% of total)

ival-div: 817.0ms (7.2% of total)

adjust: 671.0ms (5.9% of total)

ival-sub: 623.0ms (5.5% of total)

ival-pow2: 472.0ms (4.2% of total)

ival-sqrt: 379.0ms (3.4% of total)

ival-add: 311.0ms (2.8% of total)

ival-atan2: 180.0ms (1.6% of total)

ival-exp: 174.0ms (1.5% of total)

ival-pow: 174.0ms (1.5% of total)

ival-acos: 113.0ms (1% of total)

ival-neg: 82.0ms (0.7% of total)

ival-pi: 46.0ms (0.4% of total)

ival-atan: 45.0ms (0.4% of total)

ival-log: 44.0ms (0.4% of total)

ival-tan: 36.0ms (0.3% of total)

ival-hypot: 35.0ms (0.3% of total)

ival-true: 30.0ms (0.3% of total)

exact: 27.0ms (0.2% of total)

ival-assert: 15.0ms (0.1% of total)

ival-fabs: 8.0ms (0.1% of total)

ival-asin: 7.0ms (0.1% of total)

ival-log1p: 4.0ms (0% of total)

preprocess14.8s (1.7%)

Memory

-16.3MiB live, 15 106.7MiB allocated

Algorithm

52×	egg-herbie

Rules

32 339×	`fma-define`
19 274×	`fmm-def`
13 261×	`div-sub`
11 418×	`sub-neg`
10 337×	`distribute-lft-in`

Stop Event

30×	node limit
22×	saturated

Compiler

Compiled 52 114 to 20 810 computations (60.1% saved)

end0.0ms (0%)

Memory: 0.9MiB live, 0.9MiB allocated

sample3.5min (24.1%)

simplify2.9min (19.6%)

soundness1.8min (12.2%)

localize1.0min (7.2%)

regimes1.0min (7.1%)

rewrite54.8s (6.2%)

prune54.3s (6.2%)

eval42.9s (4.9%)

series36.6s (4.2%)

explain23.2s (2.6%)

analyze18.1s (2.1%)

bsearch17.1s (1.9%)

preprocess14.8s (1.7%)

end0.0ms (0%)

Profiling