Metrics for Herbie run

Date:	Sunday, September 29th, 2024
Commit:	d3a144e8 on zane-concrete-values
Hostname:	nightly with Racket 8.10
Seed:	2024273
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.2min (66.7%)

Memory

621.0MiB live, 82 612.1MiB allocated

Samples

28.8s	225 317×	0	valid
8.5s	65 226×	0	invalid
5.7s	22 917×	1	valid
3.2s	9 759×	2	valid
3.1s	12 149×	1	invalid
2.5s	6 197×	3	valid
317.0ms	1 849×	1	exit
163.0ms	518×	2	invalid
26.0ms	219×	0	exit
2.0ms	2×	3	exit
1.0ms	2×	5	exit
1.0ms	2×	4	valid

Precisions

Click to see histograms. Total time spent on operations: 39.5s

ival-mult: 10.6s (26.7% of total)

ival-div: 6.1s (15.5% of total)

ival-sub: 3.3s (8.3% of total)

ival-add: 2.6s (6.5% of total)

ival-pow2: 2.4s (6% of total)

ival-sqrt: 2.0s (5.2% of total)

ival-pow: 2.0s (5% of total)

adjust: 1.8s (4.6% of total)

ival-sin: 1.7s (4.3% of total)

ival-exp: 1.7s (4.2% of total)

ival-cos: 743.0ms (1.9% of total)

ival-tan: 727.0ms (1.8% of total)

ival-neg: 622.0ms (1.6% of total)

ival-acos: 605.0ms (1.5% of total)

const: 372.0ms (0.9% of total)

ival-pi: 361.0ms (0.9% of total)

ival-hypot: 361.0ms (0.9% of total)

exact: 337.0ms (0.9% of total)

ival-log: 314.0ms (0.8% of total)

ival-true: 267.0ms (0.7% of total)

ival-tanu: 179.0ms (0.5% of total)

ival-asin: 177.0ms (0.4% of total)

ival-assert: 140.0ms (0.4% of total)

ival-fabs: 93.0ms (0.2% of total)

ival-atan: 87.0ms (0.2% of total)

ival-<: 57.0ms (0.1% of total)

ival-and: 11.0ms (0% of total)

Bogosity

analyze7.6s (7.3%)

Memory

153.6MiB live, 9 632.1MiB allocated

Algorithm

32×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	98.2%	1.8%	0%	0%	0%	0
22.2%	21.8%	76.4%	1.8%	0%	0%	0%	1
22.6%	21.8%	74.8%	1.8%	0%	1.6%	0%	2
28.6%	26.5%	66.3%	1.8%	0%	5.5%	0%	3
32.6%	29.6%	61.2%	1.8%	0%	7.4%	0%	4
35.8%	32.3%	58%	1.8%	0%	8%	0%	5
40.1%	36.1%	54%	1.8%	0%	8.1%	0%	6
45.5%	40.6%	48.7%	1.8%	0%	8.9%	0%	7
47.9%	42.1%	45.8%	1.8%	0%	10.3%	0%	8
51%	44.7%	42.9%	1.8%	0%	10.6%	0%	9
52.2%	45.5%	41.7%	1.8%	0%	11%	0%	10
53.9%	46.8%	39.9%	1.8%	0%	11.5%	0%	11
55.7%	47.9%	38.2%	1.8%	0%	12.2%	0%	12

Compiler

Compiled 798 to 574 computations (28.1% saved)

explain6.8s (6.5%)

Memory

-201.0MiB live, 9 306.4MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`acos.f64`	`(acos.f64 (/.f64 (-.f64 #s(literal 1 binary64) (.f64 #s(literal 5 binary64) (.f64 v v))) (-.f64 (*.f64 v v) #s(literal 1 binary64))))`	sensitivity	253	1
`-.f64`	`(-.f64 #s(literal 1 binary64) (sqrt.f64 (*.f64 #s(literal 1/2 binary64) (+.f64 #s(literal 1 binary64) (/.f64 #s(literal 1 binary64) (hypot.f64 #s(literal 1 binary64) x))))))`	cancellation	65	0

Confusion

	Predicted +	Predicted -
+	75	1
-	243	961

Precision

0.2358490566037736

Recall

0.9868421052631579

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	75	1	0
-	243	0	961

Precision?

0.23824451410658307

Recall?

1.0

Freqs

test

number	freq
0	962
1	318

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	2	0	0
-	0	0	3

Precision?

1.0

Recall?

1.0

Samples

1.1s	7 637×	0	valid
291.0ms	1 086×	1	valid
168.0ms	514×	2	valid
103.0ms	278×	3	valid
5.0ms	6×	5	exit

Compiler

Compiled 10 271 to 1 722 computations (83.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.1s

ival-mult: 268.0ms (23.6% of total)

ival-div: 153.0ms (13.5% of total)

ival-sub: 92.0ms (8.1% of total)

ival-pow: 76.0ms (6.7% of total)

adjust: 71.0ms (6.2% of total)

ival-add: 65.0ms (5.7% of total)

ival-sin: 64.0ms (5.6% of total)

ival-sqrt: 59.0ms (5.2% of total)

ival-pow2: 52.0ms (4.6% of total)

ival-exp: 47.0ms (4.1% of total)

ival-cos: 31.0ms (2.7% of total)

ival-tan: 30.0ms (2.6% of total)

ival-acos: 27.0ms (2.4% of total)

ival-hypot: 21.0ms (1.8% of total)

ival-neg: 13.0ms (1.1% of total)

exact: 12.0ms (1.1% of total)

ival-tanu: 10.0ms (0.9% of total)

ival-pi: 10.0ms (0.9% of total)

ival-true: 10.0ms (0.9% of total)

const: 6.0ms (0.5% of total)

ival-log: 6.0ms (0.5% of total)

ival-asin: 4.0ms (0.4% of total)

ival-assert: 4.0ms (0.4% of total)

ival-fabs: 3.0ms (0.3% of total)

ival-atan: 3.0ms (0.3% of total)

simplify5.2s (5%)

Memory

70.0MiB live, 5 187.2MiB allocated

Algorithm

33×	egg-herbie

Stop Event

48×	iter limit
30×	node limit
3×	saturated

Counts

2 688 → 2 688

localize4.8s (4.6%)

Memory

-99.1MiB live, 6 082.8MiB allocated

Samples

610.0ms	2 728×	0	valid
428.0ms	303×	3	valid
256.0ms	292×	2	valid
155.0ms	264×	1	valid

Compiler

Compiled 9 198 to 1 086 computations (88.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.1s

ival-mult: 294.0ms (26.6% of total)

adjust: 160.0ms (14.5% of total)

ival-div: 153.0ms (13.8% of total)

ival-add: 112.0ms (10.1% of total)

ival-sub: 91.0ms (8.2% of total)

ival-asin: 69.0ms (6.2% of total)

ival-acos: 62.0ms (5.6% of total)

ival-sqrt: 48.0ms (4.3% of total)

ival-pow: 43.0ms (3.9% of total)

ival-pi: 13.0ms (1.2% of total)

ival-pow2: 11.0ms (1% of total)

ival-hypot: 10.0ms (0.9% of total)

exact: 10.0ms (0.9% of total)

ival-neg: 9.0ms (0.8% of total)

const: 9.0ms (0.8% of total)

ival-cbrt: 8.0ms (0.7% of total)

ival-true: 3.0ms (0.3% of total)

ival-assert: 2.0ms (0.2% of total)

rewrite3.3s (3.2%)

Memory

89.8MiB live, 3 240.0MiB allocated

Stop Event

28×	iter limit
14×	node limit

Counts

224 → 11 065

eval2.9s (2.8%)

Memory: 82.7MiB live, 4 194.8MiB allocated
Compiler: Compiled 518 587 to 45 010 computations (91.3% saved)

soundness1.7s (1.6%)

Memory

0.5MiB live, 1 299.7MiB allocated

Stop Event

14×	iter limit
9×	node limit
1×	fuel
1×	done

Compiler

Compiled 1 040 to 429 computations (58.8% saved)

preprocess1.1s (1.1%)

Memory

88.8MiB live, 1 150.1MiB allocated

Algorithm

5×	egg-herbie

Stop Event

10×	iter limit
8×	node limit
2×	saturated

Compiler

Compiled 1 581 to 915 computations (42.1% saved)

prune502.0ms (0.5%)

Memory: -65.3MiB live, 1 226.2MiB allocated
Counts: 16 994 → 126
Compiler: Compiled 4 790 to 3 055 computations (36.2% saved)

series444.0ms (0.4%)

Memory

71.5MiB live, 466.7MiB allocated

Counts

224 → 2 688

Calls

54 calls:

Time	Variable		Point	Expression
43.0ms	v	@	inf	((/ (* (/ (+ (* -5 (* v v)) 1) (PI)) 1) (* (* t (- 1 (* v v))) (sqrt (+ (* -6 (* v v)) 2)))) (* (/ (+ (* -5 (* v v)) 1) (PI)) 1) (/ (+ (* -5 (* v v)) 1) (PI)) (+ (* -5 (* v v)) 1) (/ (- 1 (* 5 (* v v))) (* (* (* (PI) t) (sqrt (* 2 (- 1 (* 3 (* v v)))))) (- 1 (* v v)))) (/ 1 (* (* (sqrt 2) (PI)) t)) (* (* (sqrt 2) (PI)) t) (* (sqrt 2) (PI)) (- 1 (* 5 (* v v))) (* 5 (* v v)) (* v v) (* (* (* (PI) t) (sqrt (* 2 (- 1 (* 3 (* v v)))))) (- 1 (* v v))) (/ (- 1 (* 5 (* v v))) (* (* (* (sqrt (+ (* -6 (* v v)) 2)) t) (PI)) (- 1 (* v v)))) (/ (/ (+ (* -5 (* v v)) 1) (- 1 (* v v))) (* (sqrt (+ (* -6 (* v v)) 2)) (* t (PI)))) (/ (+ (* -5 (* v v)) 1) (- 1 (* v v))) (* (* t (- 1 (* v v))) (sqrt (+ (* -6 (* v v)) 2))) (sqrt (+ (* -6 (* v v)) 2)) (PI) (* 2 (- 1 (* 3 (* v v)))) (* (* (PI) t) (sqrt (* 2 (- 1 (* 3 (* v v)))))) (* (PI) t) (/ (- 1 (* 5 (* v v))) (* (* (* (PI) t) (sqrt (* 2 (- 1 (* 3 (* v v)))))) (- 1 (* v v)))) (* (sqrt (+ (* -6 (* v v)) 2)) t) (* (* (sqrt (+ (* -6 (* v v)) 2)) t) (PI)) (* (sqrt (+ (* -6 (* v v)) 2)) (* t (PI))) (* t (PI)))
10.0ms	v	@	0	((* (/ (+ (* -5 (* v v)) 1) t) (/ 1 (* (* (PI) (- 1 (* v v))) (sqrt (+ (* -6 (* v v)) 2))))) (/ (+ (* -5 (* v v)) 1) t) (+ (* -5 (* v v)) 1) (* v v) (/ (- 1 (* 5 (* v v))) (* (* (* (PI) t) (sqrt (* 2 (- 1 (* 3 (* v v)))))) (- 1 (* v v)))) (* (* t (PI)) (sqrt 2)) (* t (PI)) (PI) (/ (/ (+ (* -5 (* v v)) 1) (- 1 (* v v))) (* (sqrt (+ (* -6 (* v v)) 2)) (* t (PI)))) (/ (/ (sqrt 1/2) (PI)) t) (/ (sqrt 1/2) (PI)) (sqrt 1/2) (/ (+ (* -5 (* v v)) 1) (- 1 (* v v))) (+ (* -4 (* v v)) 1) (* (sqrt (+ (* -6 (* v v)) 2)) (* t (PI))) (/ (/ (+ (* 5 (* v v)) 1) (* t (PI))) (* (sqrt (* 2 (- 1 (* 3 (* v v))))) (- 1 (* v v)))) (+ (* 5 (* v v)) 1) (/ 1 (* (* (PI) (- 1 (* v v))) (sqrt (+ (* -6 (* v v)) 2)))) (* (PI) (- 1 (* v v))) (/ 1 (* (* t (PI)) (sqrt 2))) (/ (/ (+ (* -5 (* v v)) 1) (- 1 (* v v))) (* (sqrt (+ (* -6 (* v v)) 2)) (* t (PI)))) (* 2 (- 1 (* 3 (* v v)))) (/ (+ (* 5 (* v v)) 1) (* t (PI))))
10.0ms	v	@	0	((- 1 (* 5 (* v v))) (- (* v v) 1) (acos (/ (- 1 (* 5 (* v v))) (- (* v v) 1))) (/ (- 1 (* 5 (* v v))) (- (* v v) 1)) (* 5 (* v v)) (* v v))
8.0ms	t	@	0	((* (/ (+ (* -5 (* v v)) 1) t) (/ 1 (* (* (PI) (- 1 (* v v))) (sqrt (+ (* -6 (* v v)) 2))))) (/ (+ (* -5 (* v v)) 1) t) (+ (* -5 (* v v)) 1) (* v v) (/ (- 1 (* 5 (* v v))) (* (* (* (PI) t) (sqrt (* 2 (- 1 (* 3 (* v v)))))) (- 1 (* v v)))) (* (* t (PI)) (sqrt 2)) (* t (PI)) (PI) (/ (/ (+ (* -5 (* v v)) 1) (- 1 (* v v))) (* (sqrt (+ (* -6 (* v v)) 2)) (* t (PI)))) (/ (/ (sqrt 1/2) (PI)) t) (/ (sqrt 1/2) (PI)) (sqrt 1/2) (/ (+ (* -5 (* v v)) 1) (- 1 (* v v))) (+ (* -4 (* v v)) 1) (* (sqrt (+ (* -6 (* v v)) 2)) (* t (PI))) (/ (/ (+ (* 5 (* v v)) 1) (* t (PI))) (* (sqrt (* 2 (- 1 (* 3 (* v v))))) (- 1 (* v v)))) (+ (* 5 (* v v)) 1) (/ 1 (* (* (PI) (- 1 (* v v))) (sqrt (+ (* -6 (* v v)) 2)))) (* (PI) (- 1 (* v v))) (/ 1 (* (* t (PI)) (sqrt 2))) (/ (/ (+ (* -5 (* v v)) 1) (- 1 (* v v))) (* (sqrt (+ (* -6 (* v v)) 2)) (* t (PI)))) (* 2 (- 1 (* 3 (* v v)))) (/ (+ (* 5 (* v v)) 1) (* t (PI))))
8.0ms	t	@	-inf	((/ (* (/ (+ (* -5 (* v v)) 1) (PI)) 1) (* (* t (- 1 (* v v))) (sqrt (+ (* -6 (* v v)) 2)))) (* (/ (+ (* -5 (* v v)) 1) (PI)) 1) (/ (+ (* -5 (* v v)) 1) (PI)) (+ (* -5 (* v v)) 1) (/ (- 1 (* 5 (* v v))) (* (* (* (PI) t) (sqrt (* 2 (- 1 (* 3 (* v v)))))) (- 1 (* v v)))) (/ 1 (* (* (sqrt 2) (PI)) t)) (* (* (sqrt 2) (PI)) t) (* (sqrt 2) (PI)) (- 1 (* 5 (* v v))) (* 5 (* v v)) (* v v) (* (* (* (PI) t) (sqrt (* 2 (- 1 (* 3 (* v v)))))) (- 1 (* v v))) (/ (- 1 (* 5 (* v v))) (* (* (* (sqrt (+ (* -6 (* v v)) 2)) t) (PI)) (- 1 (* v v)))) (/ (/ (+ (* -5 (* v v)) 1) (- 1 (* v v))) (* (sqrt (+ (* -6 (* v v)) 2)) (* t (PI)))) (/ (+ (* -5 (* v v)) 1) (- 1 (* v v))) (* (* t (- 1 (* v v))) (sqrt (+ (* -6 (* v v)) 2))) (sqrt (+ (* -6 (* v v)) 2)) (PI) (* 2 (- 1 (* 3 (* v v)))) (* (* (PI) t) (sqrt (* 2 (- 1 (* 3 (* v v)))))) (* (PI) t) (/ (- 1 (* 5 (* v v))) (* (* (* (PI) t) (sqrt (* 2 (- 1 (* 3 (* v v)))))) (- 1 (* v v)))) (* (sqrt (+ (* -6 (* v v)) 2)) t) (* (* (sqrt (+ (* -6 (* v v)) 2)) t) (PI)) (* (sqrt (+ (* -6 (* v v)) 2)) (* t (PI))) (* t (PI)))

regimes308.0ms (0.3%)

Memory

51.7MiB live, 454.9MiB allocated

Counts

174 → 14

Calls

6 calls:

67.0ms	(/.f64 (-.f64 #s(literal 1 binary64) (.f64 #s(literal 5 binary64) (.f64 v v))) (.f64 (.f64 (.f64 (PI.f64) t) (sqrt.f64 (.f64 #s(literal 2 binary64) (-.f64 #s(literal 1 binary64) (.f64 #s(literal 3 binary64) (.f64 v v)))))) (-.f64 #s(literal 1 binary64) (*.f64 v v))))
58.0ms	v
56.0ms	t
56.0ms	(*.f64 (PI.f64) t)
53.0ms	(*.f64 v v)

Compiler

Compiled 465 to 381 computations (18.1% saved)

start1.0ms (0%)

Memory: 2.5MiB live, 2.5MiB allocated

end0.0ms (0%)

Memory: 0.4MiB live, 0.4MiB allocated

sample1.2min (66.7%)

analyze7.6s (7.3%)

explain6.8s (6.5%)

simplify5.2s (5%)

localize4.8s (4.6%)

rewrite3.3s (3.2%)

eval2.9s (2.8%)

soundness1.7s (1.6%)

preprocess1.1s (1.1%)

prune502.0ms (0.5%)

series444.0ms (0.4%)

regimes308.0ms (0.3%)

start1.0ms (0%)

end0.0ms (0%)

Profiling