Metrics for Herbie run

Date:	Tuesday, August 13th, 2024
Commit:	bd96486d on zane-server-ci
Hostname:	nightly with Racket 8.11.1
Seed:	2024226
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

prune6.3min (32.4%)

Memory: -891.0MiB live, 880 294.6MiB allocated
Counts: 290 109 → 7 617
Compiler: Compiled 667 213 to 280 527 computations (58% saved)

sample3.3min (17.2%)

Memory

1 427.1MiB live, 278 733.4MiB allocated

Samples

55.6s	121 694×	1	valid
36.9s	280 567×	0	valid
31.9s	14 273×	5	exit
16.0s	23 842×	2	valid
7.7s	3 179×	3	valid
6.3s	34 792×	0	exit
4.2s	10 697×	1	exit
3.3s	20 745×	0	invalid
2.5s	11 333×	1	invalid
572.0ms	803×	2	invalid
429.0ms	34×	4	exit
201.0ms	15×	3	exit
125.0ms	30×	4	valid
24.0ms	13×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 2.4min

ival-pow: 26.5s (18.4% of total)

ival-mult: 17.5s (12.2% of total)

ival-cos: 17.3s (12% of total)

ival-sin: 15.1s (10.5% of total)

ival-div: 11.9s (8.2% of total)

adjust: 10.0s (6.9% of total)

ival-pow2: 8.3s (5.8% of total)

ival-sub: 7.1s (4.9% of total)

ival-add: 6.4s (4.5% of total)

ival-exp: 6.0s (4.1% of total)

ival-sqrt: 3.8s (2.6% of total)

ival-log: 3.6s (2.5% of total)

ival-neg: 1.9s (1.3% of total)

const: 1.5s (1% of total)

ival-<: 1.4s (1% of total)

ival-hypot: 1.1s (0.8% of total)

ival-atan2: 735.0ms (0.5% of total)

ival-tan: 555.0ms (0.4% of total)

ival-pi: 527.0ms (0.4% of total)

ival-atan: 410.0ms (0.3% of total)

exact: 397.0ms (0.3% of total)

ival-acos: 394.0ms (0.3% of total)

ival-and: 329.0ms (0.2% of total)

ival-true: 301.0ms (0.2% of total)

ival-cbrt: 250.0ms (0.2% of total)

ival-assert: 202.0ms (0.1% of total)

ival-fabs: 158.0ms (0.1% of total)

ival-asin: 144.0ms (0.1% of total)

ival-<=: 123.0ms (0.1% of total)

ival-log1p: 117.0ms (0.1% of total)

ival-==: 1.0ms (0% of total)

ival-or: 0.0ms (0% of total)

Bogosity

simplify2.7min (14.1%)

Memory

862.1MiB live, 237 177.2MiB allocated

Algorithm

450×	egg-herbie

Rules

3 618 718×	`lower-fma.f32`
3 617 612×	`lower-fma.f64`
1 751 952×	`lower-*.f32`
1 747 658×	`lower-*.f64`
968 422×	`lower-+.f32`

Stop Event

600×	iter limit
322×	node limit
128×	saturated

Counts

97 344 → 96 608

rewrite1.3min (7%)

Memory

236.9MiB live, 124 331.9MiB allocated

Rules

897 664×	`lower-fma.f32`
896 572×	`lower-fma.f64`
872 690×	`lower-*.f32`
868 544×	`lower-*.f64`
671 724×	`lower-/.f32`

Stop Event

407×	iter limit
198×	node limit
1×	saturated
1×	unsound

Counts

3 659 → 138 989

localize1.2min (6.3%)

Memory

-573.5MiB live, 110 592.1MiB allocated

Samples

23.2s	16 396×	1	valid
9.3s	26 728×	0	valid
9.1s	4 783×	2	valid
8.6s	690×	5	exit
814.0ms	436×	3	valid
807.0ms	256×	1	invalid
735.0ms	1 504×	0	invalid
512.0ms	71×	4	exit
166.0ms	271×	1	exit
127.0ms	8×	3	exit
49.0ms	2×	4	valid
39.0ms	5×	2	exit
10.0ms	50×	0	exit

Compiler

Compiled 122 467 to 9 326 computations (92.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 43.7s

ival-mult: 10.0s (22.8% of total)

ival-cos: 6.0s (13.7% of total)

ival-sin: 5.6s (12.9% of total)

ival-div: 5.4s (12.5% of total)

adjust: 4.1s (9.3% of total)

ival-add: 3.1s (7% of total)

const: 1.5s (3.4% of total)

ival-pow2: 1.4s (3.2% of total)

ival-sub: 1.3s (3% of total)

ival-sqrt: 1.0s (2.4% of total)

ival-exp: 736.0ms (1.7% of total)

ival-pow: 662.0ms (1.5% of total)

ival-log: 538.0ms (1.2% of total)

ival-atan2: 476.0ms (1.1% of total)

ival-neg: 388.0ms (0.9% of total)

ival-hypot: 280.0ms (0.6% of total)

ival-log1p: 227.0ms (0.5% of total)

ival-cbrt: 184.0ms (0.4% of total)

ival-tan: 155.0ms (0.4% of total)

ival-acos: 151.0ms (0.3% of total)

ival-pi: 115.0ms (0.3% of total)

ival-atan: 114.0ms (0.3% of total)

exact: 91.0ms (0.2% of total)

ival-fabs: 59.0ms (0.1% of total)

ival-true: 45.0ms (0.1% of total)

ival-asin: 24.0ms (0.1% of total)

ival-assert: 22.0ms (0.1% of total)

ival-cosh: 19.0ms (0% of total)

ival-sinh: 5.0ms (0% of total)

ival-copysign: 5.0ms (0% of total)

ival-tanh: 2.0ms (0% of total)

soundness1.1min (5.8%)

Memory

414.9MiB live, 57 160.7MiB allocated

Rules

2 287 674×	`lower-fma.f32`
2 286 952×	`lower-fma.f64`
1 455 312×	`lower-*.f32`
1 452 474×	`lower-*.f64`
754 554×	`lower-+.f32`

Stop Event

416×	iter limit
279×	node limit
42×	fuel
8×	done

Compiler

Compiled 57 903 to 25 139 computations (56.6% saved)

eval1.0min (5.2%)

Memory: 657.2MiB live, 105 320.3MiB allocated
Compiler: Compiled 16 341 691 to 734 568 computations (95.5% saved)

regimes52.7s (4.5%)

Memory

77.6MiB live, 86 075.6MiB allocated

Counts

25 734 → 1 022

Calls

153 calls:

3.6s	phi1
3.5s	phi2
2.9s	lambda2
2.6s	lambda1
2.5s	b

Compiler

Compiled 31 720 to 17 865 computations (43.7% saved)

series23.2s (2%)

Memory

382.4MiB live, 39 977.3MiB allocated

Counts

3 659 → 97 344

Calls

13260 calls:

Time	Variable		Point	Expression
267.0ms	b	@	0	(+ (* (* angle (* angle (* (PI) (PI)))) (+ (* (* b b) -1/32400) (* (* a a) 1/32400))) (* b b))
185.0ms	c	@	0	(/ (/ (+ (* (sqrt (* (+ (* c (* a -4)) (* b b)) (+ (* b b) (* 4 (* c a))))) (+ 0 (+ (* b b) (* 0 b)))) (* (sqrt (+ (* b b) (* 4 (* c a)))) (- 0 (* b (* b b))))) (* (sqrt (+ (* b b) (* 4 (* c a)))) (+ 0 (+ (* b b) (* 0 b))))) (* 2 a))
132.0ms	s	@	inf	(/ (* (pow (/ 1 (+ 1 (exp (neg s)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg s))))) c_n)) (* (pow (/ 1 (+ 1 (exp (neg t)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg t))))) c_n)))
112.0ms	t	@	inf	(/ (* (pow (/ 1 (+ 1 (exp (neg s)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg s))))) c_n)) (* (pow (/ 1 (+ 1 (exp (neg t)))) c_p) (pow (- 1 (/ 1 (+ 1 (exp (neg t))))) c_n)))
107.0ms	s	@	0	(/ (pow (+ 1 (/ -1 (+ 1 (exp (neg s))))) c_n) (pow (+ 1 (/ -1 (+ 1 (exp (neg t))))) c_n))

explain19.7s (1.7%)

Memory

-150.7MiB live, 33 699.3MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`cos.f64`	`#f`	sensitivity	1752	3
`+.f64`	`#f`	cancellation	1732	29
`sin.f64`	`#f`	sensitivity	1526	1
`sqrt.f64`	`#f`	oflow-rescue	1375	0
`-.f64`	`#f`	cancellation	930	17
`log.f64`	`#f`	sensitivity	570	1
`-.f64`	`#f`	nan-rescue	502	0
`/.f64`	`#f`	o/n	435	0
`/.f64`	`#f`	u/u	330	0
`/.f64`	`#f`	o/o	302	0
`*.f64`	`#f`	*no**	276	0
`sqrt.f64`	`#f`	uflow-rescue	170	0
`exp.f64`	`#f`	sensitivity	164	31
`/.f64`	`#f`	u/n	163	0
`cbrt.f64`	`#f`	oflow-rescue	99	0
`/.f64`	`#f`	n/o	90	0
`*.f64`	`#f`	*nu**	68	0
`cbrt.f64`	`#f`	uflow-rescue	47	0
`/.f64`	`#f`	n/u	45	0
`*.f64`	`#f`	*uo**	37	0
`*.f64`	`#f`	*ou**	26	0
`acos.f64`	`(acos.f64 (+.f64 (.f64 (sin.f64 phi1) (sin.f64 phi2)) (.f64 (*.f64 (cos.f64 phi1) (cos.f64 phi2)) (cos.f64 (-.f64 lambda1 lambda2)))))`	sensitivity	18	2
`pow.f64`	`#f`	sensitivity	10	1
`log.f64`	`#f`	oflow-rescue	9	0
`pow.f64`	`#f`	uflow-rescue	8	0
`log.f64`	`(log.f64 (+.f64 (exp.f64 a) (exp.f64 b)))`	uflow-rescue	3	0
↳	`(+.f64 (exp.f64 a) (exp.f64 b))`	underflow	3
↳	`(exp.f64 a)`	underflow	57
↳	`(exp.f64 b)`	underflow	79
`asin.f64`	`(asin.f64 (+.f64 (.f64 (sin.f64 phi1) (cos.f64 delta)) (.f64 (*.f64 (cos.f64 phi1) (sin.f64 delta)) (cos.f64 theta))))`	sensitivity	1	2

Confusion

	Predicted +	Predicted -
+	5720	79
-	1335	6178

Precision

0.810772501771793

Recall

0.986376961545094

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5720	46	33
-	1335	28	6150

Precision?

0.8088090896338898

Recall?

0.9943093636833937

Freqs

test

number	freq
0	6257
1	4694
2	1648
3	363
4	221
5	85
6	21
7	15
8	5
9	1
10	2

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	42	1	0
-	2	0	7

Precision?

0.9555555555555556

Recall?

1.0

Samples

3.8s	7 948×	1	valid
2.2s	16 410×	0	valid
1.8s	1 976×	2	valid
454.0ms	286×	3	valid
97.0ms	4×	4	valid

Compiler

Compiled 20 079 to 2 554 computations (87.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 6.5s

ival-sin: 1.5s (22.5% of total)

ival-cos: 1.1s (16.5% of total)

ival-mult: 893.0ms (13.8% of total)

ival-div: 604.0ms (9.3% of total)

adjust: 452.0ms (7% of total)

ival-pow2: 346.0ms (5.3% of total)

ival-sub: 254.0ms (3.9% of total)

ival-add: 241.0ms (3.7% of total)

ival-exp: 224.0ms (3.5% of total)

ival-log: 190.0ms (2.9% of total)

ival-sqrt: 167.0ms (2.6% of total)

ival-pow: 163.0ms (2.5% of total)

ival-atan2: 78.0ms (1.2% of total)

ival-neg: 71.0ms (1.1% of total)

ival-tan: 47.0ms (0.7% of total)

ival-hypot: 37.0ms (0.6% of total)

ival-atan: 33.0ms (0.5% of total)

ival-pi: 29.0ms (0.4% of total)

ival-true: 24.0ms (0.4% of total)

ival-cbrt: 23.0ms (0.4% of total)

ival-acos: 21.0ms (0.3% of total)

exact: 18.0ms (0.3% of total)

ival-asin: 15.0ms (0.2% of total)

ival-assert: 11.0ms (0.2% of total)

ival-fabs: 10.0ms (0.2% of total)

ival-log1p: 6.0ms (0.1% of total)

preprocess18.4s (1.6%)

Memory

98.9MiB live, 24 611.7MiB allocated

Algorithm

52×	egg-herbie

Rules

238 304×	`lower-fma.f64`
238 304×	`lower-fma.f32`
81 478×	`lower-*.f32`
81 146×	`lower-*.f64`
46 832×	`unsub-neg`

Stop Event

104×	iter limit
61×	saturated
43×	node limit

Compiler

Compiled 69 055 to 22 684 computations (67.2% saved)

analyze16.4s (1.4%)

Memory

274.5MiB live, 25 277.9MiB allocated

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
17.2%	13.7%	65.7%	20.6%	0%	0%	0%	1
25%	19.6%	58.5%	20.6%	0%	1.3%	0%	2
35.2%	26.6%	48.9%	20.6%	0%	3.8%	0%	3
42.3%	31.7%	43.1%	20.6%	0%	4.5%	0%	4
47.9%	35.6%	38.7%	20.6%	0%	5.1%	0%	5
51%	37.6%	36.1%	20.6%	0%	5.7%	0%	6
54.4%	39.7%	33.2%	20.6%	0%	6.5%	0%	7
56.2%	40.7%	31.8%	20.6%	0%	6.8%	0%	8
59%	42.5%	29.5%	20.6%	0%	7.4%	0%	9
60.3%	43.2%	28.4%	20.6%	0%	7.7%	0%	10
62.1%	44.3%	27%	20.6%	0%	8.1%	0%	11
63.6%	45.1%	25.8%	20.6%	0%	8.5%	0%	12

Compiler

Compiled 1 826 to 990 computations (45.8% saved)

bsearch9.6s (0.8%)

Memory

-63.3MiB live, 16 902.4MiB allocated

Algorithm

292×	binary-search
178×	left-value

Stop Event

286×	narrow-enough
6×	predicate-same

Samples

4.8s	7 112×	1	valid
2.0s	13 612×	0	valid
574.0ms	728×	2	valid
50.0ms	504×	0	invalid
26.0ms	20×	3	valid
15.0ms	43×	1	exit
1.0ms	18×	0	exit

Compiler

Compiled 106 273 to 68 652 computations (35.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 6.6s

ival-sin: 1.8s (27.5% of total)

ival-cos: 1.5s (22.3% of total)

ival-mult: 1.1s (16.6% of total)

ival-div: 370.0ms (5.6% of total)

ival-pow2: 354.0ms (5.4% of total)

adjust: 352.0ms (5.4% of total)

ival-sub: 293.0ms (4.5% of total)

ival-sqrt: 158.0ms (2.4% of total)

ival-add: 141.0ms (2.1% of total)

ival-atan2: 116.0ms (1.8% of total)

ival-acos: 83.0ms (1.3% of total)

ival-tan: 67.0ms (1% of total)

ival-neg: 62.0ms (0.9% of total)

ival-atan: 49.0ms (0.7% of total)

ival-exp: 39.0ms (0.6% of total)

ival-hypot: 29.0ms (0.4% of total)

ival-pi: 27.0ms (0.4% of total)

ival-true: 17.0ms (0.3% of total)

ival-log: 12.0ms (0.2% of total)

exact: 11.0ms (0.2% of total)

ival-fabs: 10.0ms (0.2% of total)

ival-assert: 9.0ms (0.1% of total)

ival-asin: 7.0ms (0.1% of total)

ival-log1p: 3.0ms (0% of total)

start21.0ms (0%)

Memory: -67.2MiB live, 2.8MiB allocated

end0.0ms (0%)

Memory: 1.0MiB live, 1.0MiB allocated

prune6.3min (32.4%)

sample3.3min (17.2%)

simplify2.7min (14.1%)

rewrite1.3min (7%)

localize1.2min (6.3%)

soundness1.1min (5.8%)

eval1.0min (5.2%)

regimes52.7s (4.5%)

series23.2s (2%)

explain19.7s (1.7%)

preprocess18.4s (1.6%)

analyze16.4s (1.4%)

bsearch9.6s (0.8%)

start21.0ms (0%)

end0.0ms (0%)

Profiling