Metrics for Herbie run

Date:	Tuesday, July 16th, 2024
Commit:	f3c41df3 on doc-pass
Hostname:	nightly with Racket 8.11.1
Seed:	2024198
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample3.3min (22.9%)

Memory

666.3MiB live, 248 899.9MiB allocated

Samples

57.1s	121 588×	1	valid
37.9s	280 431×	0	valid
27.6s	14 588×	5	exit
15.9s	23 102×	2	valid
7.7s	4 022×	3	valid
6.1s	34 970×	0	exit
4.7s	10 951×	1	exit
3.0s	20 622×	0	invalid
2.4s	11 088×	1	invalid
463.0ms	36×	4	exit
450.0ms	816×	2	invalid
324.0ms	169×	4	valid
268.0ms	26×	3	exit
24.0ms	12×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 2.3min

ival-pow: 23.2s (16.4% of total)

ival-mult: 18.9s (13.4% of total)

ival-cos: 17.7s (12.5% of total)

ival-sin: 15.8s (11.2% of total)

ival-div: 12.2s (8.6% of total)

ival-pow2: 9.2s (6.5% of total)

ival-sub: 6.5s (4.6% of total)

adjust: 6.3s (4.5% of total)

ival-add: 6.1s (4.4% of total)

ival-exp: 5.7s (4% of total)

ival-log: 4.2s (3% of total)

ival-sqrt: 4.0s (2.8% of total)

ival-neg: 2.5s (1.8% of total)

const: 1.6s (1.1% of total)

ival-<: 1.4s (1% of total)

ival-atan2: 754.0ms (0.5% of total)

ival-pi: 657.0ms (0.5% of total)

ival-tan: 605.0ms (0.4% of total)

ival-hypot: 600.0ms (0.4% of total)

exact: 504.0ms (0.4% of total)

ival-acos: 421.0ms (0.3% of total)

ival-atan: 389.0ms (0.3% of total)

ival-and: 334.0ms (0.2% of total)

ival-true: 300.0ms (0.2% of total)

ival-cbrt: 261.0ms (0.2% of total)

ival-assert: 208.0ms (0.1% of total)

ival-asin: 149.0ms (0.1% of total)

ival-<=: 142.0ms (0.1% of total)

ival-fabs: 133.0ms (0.1% of total)

ival-log1p: 132.0ms (0.1% of total)

ival-==: 1.0ms (0% of total)

ival-or: 0.0ms (0% of total)

Bogosity

simplify2.8min (19.7%)

Memory

-271.5MiB live, 232 166.7MiB allocated

Algorithm

454×	egg-herbie

Rules

3 397 794×	`accelerator-lowering-fma.f32`
3 397 794×	`accelerator-lowering-fma.f64`
1 732 560×	`-lowering-.f32`
1 732 560×	`-lowering-.f64`
897 828×	`+-lowering-+.f32`

Stop Event

403×	iter limit
315×	node limit
139×	saturated

Counts

84 000 → 84 000

rewrite1.6min (11%)

Memory

-563.5MiB live, 132 006.4MiB allocated

Algorithm

201×	batch-egg-rewrite

Rules

898 926×	`accelerator-lowering-fma.f32`
898 926×	`accelerator-lowering-fma.f64`
847 446×	`-lowering-.f32`
847 446×	`-lowering-.f64`
678 900×	`/-lowering-/.f32`

Stop Event

209×	iter limit
200×	node limit
1×	saturated

Counts

3 372 → 179 641

soundness1.2min (8.1%)

Memory

216.5MiB live, 56 434.3MiB allocated

Rules

2 252 994×	`accelerator-lowering-fma.f32`
2 252 994×	`accelerator-lowering-fma.f64`
1 527 638×	`-lowering-.f32`
1 527 638×	`-lowering-.f64`
747 344×	`+-lowering-+.f32`

Stop Event

299×	iter limit
292×	node limit
45×	fuel
7×	done
1×	saturated

Compiler

Compiled 55 314 to 26 350 computations (52.4% saved)

eval1.0min (7.3%)

Memory: 1 266.4MiB live, 96 812.6MiB allocated
Compiler: Compiled 14 997 807 to 865 529 computations (94.2% saved)

localize59.2s (6.9%)

Memory

-213.4MiB live, 82 128.1MiB allocated

Samples

14.2s	12 127×	1	valid
8.5s	4 233×	2	valid
8.1s	29 316×	0	valid
4.5s	733×	5	exit
1.7s	3 807×	0	invalid
1.5s	614×	3	valid
618.0ms	107×	4	exit
458.0ms	87×	4	valid
221.0ms	66×	1	invalid
65.0ms	297×	0	exit
51.0ms	60×	1	exit
45.0ms	7×	3	exit
5.0ms	1×	2	exit
3.0ms	1×	2	invalid

Compiler

Compiled 91 966 to 8 158 computations (91.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 31.6s

ival-mult: 8.0s (25.2% of total)

ival-cos: 5.4s (17.1% of total)

ival-sin: 4.5s (14.2% of total)

ival-div: 3.0s (9.4% of total)

ival-add: 2.0s (6.2% of total)

adjust: 1.6s (5.2% of total)

ival-sub: 1.2s (3.7% of total)

ival-pow2: 977.0ms (3.1% of total)

const: 971.0ms (3.1% of total)

ival-sqrt: 850.0ms (2.7% of total)

ival-pow: 606.0ms (1.9% of total)

ival-exp: 435.0ms (1.4% of total)

ival-atan2: 377.0ms (1.2% of total)

ival-log: 334.0ms (1.1% of total)

ival-cbrt: 269.0ms (0.9% of total)

ival-neg: 154.0ms (0.5% of total)

ival-tan: 136.0ms (0.4% of total)

ival-acos: 132.0ms (0.4% of total)

ival-atan: 128.0ms (0.4% of total)

ival-expm1: 127.0ms (0.4% of total)

exact: 125.0ms (0.4% of total)

ival-pi: 111.0ms (0.4% of total)

ival-fabs: 88.0ms (0.3% of total)

ival-hypot: 65.0ms (0.2% of total)

ival-log1p: 51.0ms (0.2% of total)

ival-true: 46.0ms (0.1% of total)

ival-assert: 22.0ms (0.1% of total)

ival-asin: 4.0ms (0% of total)

ival-cosh: 3.0ms (0% of total)

ival-tanh: 2.0ms (0% of total)

ival-sinh: 2.0ms (0% of total)

ival-copysign: 1.0ms (0% of total)

prune58.9s (6.8%)

Memory: -1 052.4MiB live, 103 094.9MiB allocated
Counts: 337 804 → 8 208
Compiler: Compiled 697 066 to 299 784 computations (57% saved)

regimes56.0s (6.5%)

Memory

-158.8MiB live, 83 822.4MiB allocated

Counts

30 873 → 1 005

Calls

155 calls:

4.4s	phi2
3.6s	phi1
3.4s	lambda1
2.8s	lambda2
2.6s	a

Compiler

Compiled 33 023 to 18 686 computations (43.4% saved)

explain20.6s (2.4%)

Memory

105.0MiB live, 31 320.8MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`cos.f64`	`#f`	sensitivity	1817	6
`+.f64`	`#f`	cancellation	1729	35
`sin.f64`	`#f`	sensitivity	1566	3
`sqrt.f64`	`#f`	oflow-rescue	1458	0
`-.f64`	`#f`	cancellation	926	15
`log.f64`	`#f`	sensitivity	600	1
`-.f64`	`#f`	nan-rescue	526	0
`/.f64`	`#f`	o/n	465	0
`/.f64`	`#f`	u/u	331	0
`/.f64`	`#f`	o/o	320	0
`*.f64`	`#f`	*no**	250	0
`/.f64`	`#f`	u/n	167	0
`exp.f64`	`#f`	sensitivity	167	26
`sqrt.f64`	`#f`	uflow-rescue	155	0
`/.f64`	`#f`	n/o	118	0
`*.f64`	`#f`	*nu**	90	0
`cbrt.f64`	`#f`	oflow-rescue	81	0
`*.f64`	`#f`	*ou**	43	0
`/.f64`	`#f`	n/u	37	0
`cbrt.f64`	`#f`	uflow-rescue	37	0
`*.f64`	`#f`	*uo**	26	0
`pow.f64`	`#f`	sensitivity	15	3
`pow.f64`	`#f`	uflow-rescue	12	0
`acos.f64`	`(acos.f64 (+.f64 (.f64 (sin.f64 phi1) (sin.f64 phi2)) (.f64 (*.f64 (cos.f64 phi1) (cos.f64 phi2)) (cos.f64 (-.f64 lambda1 lambda2)))))`	sensitivity	10	4
`log.f64`	`#f`	oflow-rescue	5	0
`log.f64`	`(log.f64 (+.f64 (exp.f64 a) (exp.f64 b)))`	uflow-rescue	1	0
↳	`(+.f64 (exp.f64 a) (exp.f64 b))`	underflow	1
↳	`(exp.f64 a)`	underflow	141
↳	`(exp.f64 b)`	underflow	1

Confusion

	Predicted +	Predicted -
+	5831	69
-	1319	6093

Precision

0.8155244755244755

Recall

0.9883050847457627

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5831	42	27
-	1319	28	6065

Precision?

0.8134349030470914

Recall?

0.9954237288135593

Freqs

test

number	freq
0	6162
1	4725
2	1684
3	367
4	224
5	81
6	40
7	19
8	7
9	2
10	1

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	42	0	0
-	2	0	8

Precision?

0.9545454545454546

Recall?

1.0

Samples

4.2s	7 944×	1	valid
2.1s	16 410×	0	valid
1.8s	1 864×	2	valid
641.0ms	390×	3	valid
19.0ms	16×	4	valid

Compiler

Compiled 21 748 to 3 336 computations (84.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 7.0s

ival-sin: 1.5s (20.9% of total)

ival-mult: 1.2s (17.9% of total)

ival-cos: 1.0s (14.8% of total)

ival-div: 724.0ms (10.4% of total)

ival-pow2: 416.0ms (6% of total)

adjust: 367.0ms (5.3% of total)

ival-sub: 366.0ms (5.3% of total)

ival-add: 273.0ms (3.9% of total)

ival-exp: 220.0ms (3.2% of total)

ival-log: 201.0ms (2.9% of total)

ival-sqrt: 174.0ms (2.5% of total)

ival-neg: 83.0ms (1.2% of total)

ival-pi: 61.0ms (0.9% of total)

ival-atan2: 59.0ms (0.8% of total)

ival-tan: 57.0ms (0.8% of total)

ival-pow: 45.0ms (0.6% of total)

ival-hypot: 36.0ms (0.5% of total)

ival-atan: 26.0ms (0.4% of total)

ival-true: 25.0ms (0.4% of total)

exact: 24.0ms (0.3% of total)

ival-acos: 21.0ms (0.3% of total)

ival-cbrt: 18.0ms (0.3% of total)

ival-fabs: 11.0ms (0.2% of total)

ival-assert: 11.0ms (0.2% of total)

ival-asin: 9.0ms (0.1% of total)

ival-log1p: 6.0ms (0.1% of total)

preprocess19.5s (2.3%)

Memory

31.9MiB live, 24 451.0MiB allocated

Algorithm

104×	egg-herbie

Rules

237 718×	`accelerator-lowering-fma.f32`
237 718×	`accelerator-lowering-fma.f64`
81 446×	`-lowering-.f32`
81 446×	`-lowering-.f64`
46 320×	`unsub-neg`

Stop Event

60×	saturated
52×	iter limit
44×	node limit

Compiler

Compiled 71 844 to 21 372 computations (70.3% saved)

bsearch18.7s (2.2%)

Memory

41.2MiB live, 23 300.5MiB allocated

Algorithm

270×	binary-search
184×	left-value

Stop Event

260×	narrow-enough
10×	predicate-same

Samples

11.1s	13 354×	1	valid
3.2s	18 667×	0	valid
772.0ms	1 359×	2	valid
155.0ms	125×	3	valid
130.0ms	1 060×	0	invalid
53.0ms	132×	1	exit
13.0ms	31×	4	valid
1.0ms	22×	0	exit

Compiler

Compiled 115 284 to 74 164 computations (35.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 13.6s

ival-cos: 3.0s (22.1% of total)

ival-sin: 3.0s (22% of total)

ival-mult: 1.8s (13.1% of total)

ival-add: 1.7s (12.2% of total)

ival-atan2: 651.0ms (4.8% of total)

ival-sub: 636.0ms (4.7% of total)

ival-div: 573.0ms (4.2% of total)

adjust: 558.0ms (4.1% of total)

ival-pow2: 549.0ms (4% of total)

ival-sqrt: 430.0ms (3.2% of total)

ival-acos: 197.0ms (1.5% of total)

ival-atan: 121.0ms (0.9% of total)

ival-neg: 102.0ms (0.8% of total)

ival-hypot: 102.0ms (0.8% of total)

ival-pi: 59.0ms (0.4% of total)

ival-tan: 38.0ms (0.3% of total)

ival-exp: 33.0ms (0.2% of total)

ival-true: 28.0ms (0.2% of total)

exact: 25.0ms (0.2% of total)

ival-log: 16.0ms (0.1% of total)

ival-assert: 15.0ms (0.1% of total)

ival-fabs: 9.0ms (0.1% of total)

ival-log1p: 3.0ms (0% of total)

ival-asin: 2.0ms (0% of total)

series17.9s (2.1%)

Memory

60.8MiB live, 24 735.1MiB allocated

Counts

3 372 → 84 000

Calls

16503 calls:

Time	Variable		Point	Expression
389.0ms	t	@	-inf	(* (pow (- 1 (/ 1 (+ 1 (exp (- 0 s))))) c_n) (* (pow (+ 1 (/ 1 (- -1 (exp (- 0 t))))) (- 0 c_n)) (* (pow (+ 1 (exp (- 0 s))) (- 0 c_p)) (pow (+ 1 (exp (- 0 t))) (neg (- 0 c_p))))))
278.0ms	g	@	-inf	(pow (* (acos (- 0 (/ g h))) 1/3) 2)
268.0ms	eh	@	0	(* (/ 1 (sqrt (+ 1 (/ (* eh eh) (* (* t ew) (* t ew)))))) (/ 1 (sqrt (+ 1 (/ (* eh eh) (* (* t ew) (* t ew)))))))
187.0ms	angle	@	-inf	(log (* 2 (+ (* (- 1/2 (* 1/2 (cos (* 2 (* 1/180 (* angle (PI))))))) (/ (* a a) (* x-scale x-scale))) (* (+ 1/2 (* 1/2 (cos (* 2 (* 1/180 (* angle (PI))))))) (* b (/ b (* x-scale x-scale)))))))
158.0ms	s	@	inf	(/ (* (pow (/ 1 (+ 1 (exp (neg s)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg s))))) c_n)) (* (pow (/ 1 (+ 1 (exp (neg t)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg t))))) c_n)))

analyze16.8s (1.9%)

Memory

107.6MiB live, 22 332.2MiB allocated

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
17.2%	13.7%	65.7%	20.6%	0%	0%	0%	1
25%	19.6%	58.5%	20.6%	0%	1.3%	0%	2
35.2%	26.6%	48.9%	20.6%	0%	3.8%	0%	3
42.3%	31.7%	43.1%	20.6%	0%	4.5%	0%	4
47.9%	35.6%	38.7%	20.6%	0%	5.1%	0%	5
51%	37.6%	36.1%	20.6%	0%	5.7%	0%	6
54.4%	39.7%	33.2%	20.6%	0%	6.5%	0%	7
56.2%	40.7%	31.8%	20.6%	0%	6.8%	0%	8
59%	42.5%	29.5%	20.6%	0%	7.4%	0%	9
60.3%	43.2%	28.4%	20.6%	0%	7.7%	0%	10
62.1%	44.3%	27%	20.6%	0%	8.1%	0%	11
63.6%	45.1%	25.8%	20.6%	0%	8.5%	0%	12

Compiler

Compiled 1 826 to 990 computations (45.8% saved)

end0.0ms (0%)

Memory: 0.9MiB live, 0.9MiB allocated

sample3.3min (22.9%)

simplify2.8min (19.7%)

rewrite1.6min (11%)

soundness1.2min (8.1%)

eval1.0min (7.3%)

localize59.2s (6.9%)

prune58.9s (6.8%)

regimes56.0s (6.5%)

explain20.6s (2.4%)

preprocess19.5s (2.3%)

bsearch18.7s (2.2%)

series17.9s (2.1%)

analyze16.8s (1.9%)

end0.0ms (0%)

Profiling