Metrics for Herbie run

Date:	Wednesday, July 10th, 2024
Commit:	f44c3a35 on platforms
Hostname:	nightly with Racket 8.11.1
Seed:	2024192
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample3.3min (23%)

Memory

821.0MiB live, 253 789.9MiB allocated

Samples

59.4s	127 575×	1	valid
34.4s	273 588×	0	valid
29.3s	15 482×	5	exit
17.9s	24 988×	2	valid
7.2s	3 126×	3	valid
6.2s	35 179×	0	exit
3.9s	9 774×	1	exit
2.9s	19 511×	0	invalid
2.2s	11 805×	1	invalid
480.0ms	778×	2	invalid
368.0ms	29×	4	exit
243.0ms	35×	4	valid
78.0ms	11×	3	exit
31.0ms	15×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 2.4min

ival-pow: 24.4s (17.2% of total)

ival-mult: 18.6s (13.1% of total)

ival-cos: 16.8s (11.9% of total)

ival-sin: 15.6s (11% of total)

ival-div: 11.7s (8.2% of total)

ival-pow2: 8.5s (6% of total)

adjust: 7.2s (5.1% of total)

ival-add: 6.7s (4.7% of total)

ival-sub: 6.7s (4.7% of total)

ival-exp: 6.3s (4.4% of total)

ival-log: 4.3s (3% of total)

ival-sqrt: 3.5s (2.5% of total)

ival-neg: 2.9s (2% of total)

ival-<: 1.6s (1.1% of total)

const: 1.4s (1% of total)

ival-atan2: 891.0ms (0.6% of total)

ival-tan: 717.0ms (0.5% of total)

ival-hypot: 641.0ms (0.5% of total)

ival-pi: 580.0ms (0.4% of total)

exact: 520.0ms (0.4% of total)

ival-acos: 376.0ms (0.3% of total)

ival-cbrt: 367.0ms (0.3% of total)

ival-and: 322.0ms (0.2% of total)

ival-atan: 308.0ms (0.2% of total)

ival-true: 300.0ms (0.2% of total)

ival-fabs: 197.0ms (0.1% of total)

ival-assert: 196.0ms (0.1% of total)

ival-<=: 138.0ms (0.1% of total)

ival-asin: 128.0ms (0.1% of total)

ival-log1p: 127.0ms (0.1% of total)

ival-==: 1.0ms (0% of total)

ival-or: 0.0ms (0% of total)

Bogosity

simplify2.9min (20.5%)

Memory

-437.5MiB live, 244 604.1MiB allocated

Algorithm

456×	egg-herbie

Rules

3 608 534×	`accelerator-lowering-fma.f32`
3 608 534×	`accelerator-lowering-fma.f64`
1 807 260×	`-lowering-.f32`
1 807 260×	`-lowering-.f64`
967 868×	`+-lowering-+.f32`

Stop Event

404×	iter limit
322×	node limit
134×	saturated

Counts

87 984 → 87 984

rewrite1.5min (10.3%)

Memory

418.0MiB live, 129 154.9MiB allocated

Algorithm

202×	batch-egg-rewrite

Rules

875 796×	`-lowering-.f32`
875 796×	`-lowering-.f64`
854 956×	`accelerator-lowering-fma.f32`
854 956×	`accelerator-lowering-fma.f64`
687 516×	`/-lowering-/.f32`

Stop Event

212×	iter limit
199×	node limit
2×	unsound
1×	saturated

Counts

3 509 → 153 243

soundness1.1min (7.8%)

Memory

587.0MiB live, 53 975.8MiB allocated

Rules

2 220 864×	`accelerator-lowering-fma.f32`
2 220 864×	`accelerator-lowering-fma.f64`
1 509 702×	`-lowering-.f32`
1 509 702×	`-lowering-.f64`
762 856×	`+-lowering-+.f32`

Stop Event

287×	iter limit
282×	node limit
45×	fuel
7×	done
2×	saturated

Compiler

Compiled 51 360 to 26 802 computations (47.8% saved)

localize1.1min (7.4%)

Memory

-142.1MiB live, 89 408.2MiB allocated

Samples

19.0s	14 394×	1	valid
7.8s	4 146×	2	valid
7.7s	28 199×	0	valid
4.8s	811×	5	exit
1.4s	3 241×	0	invalid
1.2s	398×	3	valid
695.0ms	110×	4	exit
573.0ms	242×	1	invalid
219.0ms	37×	4	valid
55.0ms	57×	1	exit
47.0ms	8×	2	invalid
45.0ms	5×	3	exit
16.0ms	63×	0	exit
6.0ms	1×	2	exit

Compiler

Compiled 103 586 to 8 129 computations (92.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 34.9s

ival-mult: 7.8s (22.4% of total)

ival-cos: 6.1s (17.4% of total)

ival-sin: 5.9s (17% of total)

ival-div: 4.1s (11.7% of total)

ival-add: 2.0s (5.7% of total)

adjust: 1.7s (5% of total)

ival-sub: 1.1s (3% of total)

const: 880.0ms (2.5% of total)

ival-pow2: 850.0ms (2.4% of total)

ival-pow: 824.0ms (2.4% of total)

ival-sqrt: 733.0ms (2.1% of total)

ival-tan: 496.0ms (1.4% of total)

ival-atan2: 367.0ms (1.1% of total)

ival-log: 345.0ms (1% of total)

ival-exp: 257.0ms (0.7% of total)

ival-atan: 256.0ms (0.7% of total)

ival-neg: 194.0ms (0.6% of total)

ival-acos: 167.0ms (0.5% of total)

exact: 162.0ms (0.5% of total)

ival-hypot: 162.0ms (0.5% of total)

ival-cbrt: 118.0ms (0.3% of total)

ival-fabs: 95.0ms (0.3% of total)

ival-pi: 92.0ms (0.3% of total)

ival-asin: 62.0ms (0.2% of total)

ival-log1p: 59.0ms (0.2% of total)

ival-true: 48.0ms (0.1% of total)

ival-assert: 21.0ms (0.1% of total)

ival-copysign: 7.0ms (0% of total)

ival-cosh: 5.0ms (0% of total)

ival-sinh: 3.0ms (0% of total)

ival-tanh: 2.0ms (0% of total)

ival-expm1: 2.0ms (0% of total)

regimes56.5s (6.6%)

Memory

25.0MiB live, 84 949.5MiB allocated

Counts

28 045 → 1 034

Calls

155 calls:

3.8s	phi2
3.4s	phi1
3.3s	lambda1
2.9s	b
2.7s	lambda2

Compiler

Compiled 12 966 to 8 389 computations (35.3% saved)

eval53.9s (6.3%)

Memory: 1 768.1MiB live, 87 895.5MiB allocated
Compiler: Compiled 13 689 678 to 803 513 computations (94.1% saved)

prune53.4s (6.2%)

Memory: -2 381.4MiB live, 94 096.1MiB allocated
Counts: 298 555 → 8 343
Compiler: Compiled 716 036 to 312 067 computations (56.4% saved)

bsearch25.4s (3%)

Memory

89.7MiB live, 34 278.2MiB allocated

Algorithm

432×	binary-search
45×	left-value

Stop Event

411×	narrow-enough
21×	predicate-same

Samples

9.2s	14 218×	1	valid
5.8s	35 338×	0	valid
2.6s	3 000×	5	exit
2.2s	2 811×	2	valid
203.0ms	87×	3	valid
182.0ms	1 538×	0	invalid
102.0ms	26×	4	valid
56.0ms	149×	1	exit
3.0ms	12×	1	invalid
0.0ms	2×	0	exit

Compiler

Compiled 138 497 to 94 021 computations (32.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 17.3s

ival-cos: 3.5s (20.3% of total)

ival-sin: 2.7s (15.8% of total)

ival-mult: 2.5s (14.5% of total)

ival-pow2: 1.4s (8.3% of total)

ival-div: 1.4s (8.2% of total)

adjust: 1.3s (7.3% of total)

ival-sub: 1.0s (5.8% of total)

ival-pow: 764.0ms (4.4% of total)

ival-add: 621.0ms (3.6% of total)

ival-exp: 392.0ms (2.3% of total)

ival-neg: 332.0ms (1.9% of total)

ival-sqrt: 315.0ms (1.8% of total)

ival-atan: 226.0ms (1.3% of total)

ival-atan2: 186.0ms (1.1% of total)

ival-acos: 166.0ms (1% of total)

ival-tan: 106.0ms (0.6% of total)

ival-pi: 68.0ms (0.4% of total)

ival-hypot: 48.0ms (0.3% of total)

ival-true: 44.0ms (0.3% of total)

exact: 43.0ms (0.2% of total)

ival-log: 30.0ms (0.2% of total)

ival-asin: 24.0ms (0.1% of total)

ival-assert: 22.0ms (0.1% of total)

ival-fabs: 19.0ms (0.1% of total)

ival-log1p: 15.0ms (0.1% of total)

explain21.8s (2.5%)

Memory

-71.5MiB live, 30 955.6MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`cos.f64`	`#f`	sensitivity	1802	0
`+.f64`	`#f`	cancellation	1748	45
`sin.f64`	`#f`	sensitivity	1534	0
`sqrt.f64`	`#f`	oflow-rescue	1402	0
`-.f64`	`#f`	cancellation	979	9
`log.f64`	`#f`	sensitivity	604	0
`-.f64`	`#f`	nan-rescue	486	0
`/.f64`	`#f`	o/n	479	0
`/.f64`	`#f`	o/o	317	0
`/.f64`	`#f`	u/u	312	0
`*.f64`	`#f`	*no**	243	0
`/.f64`	`#f`	u/n	189	0
`exp.f64`	`#f`	sensitivity	172	21
`sqrt.f64`	`#f`	uflow-rescue	141	0
`*.f64`	`#f`	*nu**	120	0
`/.f64`	`#f`	n/o	94	0
`cbrt.f64`	`#f`	oflow-rescue	83	0
`cbrt.f64`	`#f`	uflow-rescue	49	0
`/.f64`	`#f`	n/u	38	0
`*.f64`	`#f`	*uo**	30	0
`*.f64`	`#f`	*ou**	20	0
`acos.f64`	`(acos.f64 (+.f64 (.f64 (sin.f64 phi1) (sin.f64 phi2)) (.f64 (*.f64 (cos.f64 phi1) (cos.f64 phi2)) (cos.f64 (-.f64 lambda1 lambda2)))))`	sensitivity	19	2
`pow.f64`	`#f`	sensitivity	17	0
`pow.f64`	`#f`	uflow-rescue	11	0
`log.f64`	`#f`	oflow-rescue	6	0
`log.f64`	`(log.f64 (+.f64 (exp.f64 a) (exp.f64 b)))`	uflow-rescue	2	0
↳	`(+.f64 (exp.f64 a) (exp.f64 b))`	underflow	2
↳	`(exp.f64 a)`	underflow	147
↳	`(exp.f64 b)`	underflow	2

Confusion

	Predicted +	Predicted -
+	5761	71
-	1343	6137

Precision

0.8109515765765766

Recall

0.9878257887517147

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5761	44	27
-	1343	29	6108

Precision?

0.8088337745576146

Recall?

0.9953703703703703

Freqs

test

number	freq
0	6208
1	4713
2	1660
3	364
4	186
5	111
6	38
7	17
8	9
9	6

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	41	1	0
-	2	0	8

Precision?

0.9545454545454546

Recall?

1.0

Samples

4.3s	8 422×	1	valid
2.3s	15 778×	0	valid
1.8s	2 112×	2	valid
584.0ms	308×	3	valid
8.0ms	4×	4	valid

Compiler

Compiled 21 748 to 3 336 computations (84.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 7.1s

ival-sin: 1.7s (23.4% of total)

ival-cos: 1.2s (17.3% of total)

ival-mult: 1.1s (15.5% of total)

ival-div: 557.0ms (7.8% of total)

ival-pow2: 470.0ms (6.6% of total)

ival-sub: 384.0ms (5.4% of total)

adjust: 310.0ms (4.4% of total)

ival-add: 296.0ms (4.2% of total)

ival-exp: 229.0ms (3.2% of total)

ival-log: 194.0ms (2.7% of total)

ival-sqrt: 167.0ms (2.3% of total)

ival-neg: 116.0ms (1.6% of total)

ival-atan2: 66.0ms (0.9% of total)

ival-tan: 49.0ms (0.7% of total)

ival-pi: 46.0ms (0.6% of total)

ival-atan: 45.0ms (0.6% of total)

ival-hypot: 34.0ms (0.5% of total)

ival-pow: 31.0ms (0.4% of total)

exact: 25.0ms (0.4% of total)

ival-true: 25.0ms (0.4% of total)

ival-acos: 23.0ms (0.3% of total)

ival-cbrt: 17.0ms (0.2% of total)

ival-fabs: 11.0ms (0.2% of total)

ival-assert: 11.0ms (0.2% of total)

ival-asin: 8.0ms (0.1% of total)

ival-log1p: 5.0ms (0.1% of total)

preprocess19.3s (2.2%)

Memory

-472.9MiB live, 24 102.6MiB allocated

Algorithm

104×	egg-herbie

Rules

237 718×	`accelerator-lowering-fma.f32`
237 718×	`accelerator-lowering-fma.f64`
81 446×	`-lowering-.f32`
81 446×	`-lowering-.f64`
46 320×	`unsub-neg`

Stop Event

60×	saturated
52×	iter limit
44×	node limit

Compiler

Compiled 58 392 to 20 406 computations (65.1% saved)

series18.2s (2.1%)

Memory

330.0MiB live, 25 746.1MiB allocated

Counts

3 509 → 87 984

Calls

17886 calls:

Time	Variable		Point	Expression
331.0ms	angle	@	0	(* a (* 1/180 (* angle (PI))))
200.0ms	x	@	0	(- (exp x) (exp (neg x)))
173.0ms	s	@	inf	(/ (* (pow (/ 1 (+ 1 (exp (neg s)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg s))))) c_n)) (* (pow (/ 1 (+ 1 (exp (neg t)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg t))))) c_n)))
162.0ms	eh	@	0	(- (* (* ew (cos t)) (cos (atan (/ (* (neg eh) (tan t)) ew)))) (* (* eh (sin t)) (sin (atan (/ (* t (- 0 eh)) ew)))))
149.0ms	t	@	inf	(/ (pow (/ 1 (+ 1 (/ 1 (exp s)))) c_p) (pow (/ 1 (+ 1 (exp (- 0 t)))) c_p))

analyze17.8s (2.1%)

Memory

-243.7MiB live, 21 618.1MiB allocated

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
17.2%	13.7%	65.7%	20.6%	0%	0%	0%	1
25%	19.6%	58.5%	20.6%	0%	1.3%	0%	2
35.2%	26.6%	48.9%	20.6%	0%	3.8%	0%	3
42.3%	31.7%	43.1%	20.6%	0%	4.5%	0%	4
47.9%	35.6%	38.7%	20.6%	0%	5.1%	0%	5
51%	37.6%	36.1%	20.6%	0%	5.7%	0%	6
54.4%	39.7%	33.2%	20.6%	0%	6.5%	0%	7
56.2%	40.7%	31.8%	20.6%	0%	6.8%	0%	8
59%	42.5%	29.5%	20.6%	0%	7.4%	0%	9
60.3%	43.2%	28.4%	20.6%	0%	7.7%	0%	10
62.1%	44.3%	27%	20.6%	0%	8.1%	0%	11
63.6%	45.1%	25.8%	20.6%	0%	8.5%	0%	12

Compiler

Compiled 1 826 to 990 computations (45.8% saved)

end0.0ms (0%)

Memory: 0.8MiB live, 0.8MiB allocated

sample3.3min (23%)

simplify2.9min (20.5%)

rewrite1.5min (10.3%)

soundness1.1min (7.8%)

localize1.1min (7.4%)

regimes56.5s (6.6%)

eval53.9s (6.3%)

prune53.4s (6.2%)

bsearch25.4s (3%)

explain21.8s (2.5%)

preprocess19.3s (2.2%)

series18.2s (2.1%)

analyze17.8s (2.1%)

end0.0ms (0%)

Profiling