Metrics for Herbie run

Date:	Tuesday, August 20th, 2024
Commit:	fce740b4 on ffi-types
Hostname:	nightly with Racket 8.11.1
Seed:	2024233
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample51.1s (25.4%)

Memory

-153.6MiB live, 47 453.4MiB allocated

Samples

18.3s	43 457×	1	valid
9.6s	109 844×	0	valid
8.7s	6 411×	5	exit
4.3s	11 819×	2	valid
1.2s	9 999×	1	exit
563.0ms	3 879×	0	invalid
146.0ms	1 432×	0	exit

Precisions

Click to see histograms. Total time spent on operations: 36.1s

const: 9.8s (27.1% of total)

ival-exp: 3.9s (10.8% of total)

ival-pow: 3.4s (9.3% of total)

ival-cos: 2.1s (5.9% of total)

adjust: 2.1s (5.7% of total)

ival-mult: 2.1s (5.7% of total)

ival-tan: 1.9s (5.2% of total)

ival-log: 1.5s (4.2% of total)

ival-sqrt: 1.3s (3.7% of total)

ival-add: 1.0s (2.8% of total)

ival-fmod: 1.0s (2.8% of total)

ival-sub: 893.0ms (2.5% of total)

ival-sin: 810.0ms (2.2% of total)

ival-sinh: 725.0ms (2% of total)

ival-div: 679.0ms (1.9% of total)

ival-pow2: 670.0ms (1.9% of total)

ival-<=: 535.0ms (1.5% of total)

ival-hypot: 480.0ms (1.3% of total)

ival-acos: 372.0ms (1% of total)

ival-neg: 159.0ms (0.4% of total)

ival-==: 134.0ms (0.4% of total)

ival-and: 119.0ms (0.3% of total)

ival-true: 93.0ms (0.3% of total)

exact: 74.0ms (0.2% of total)

ival-assert: 69.0ms (0.2% of total)

ival-<: 67.0ms (0.2% of total)

ival-atan: 46.0ms (0.1% of total)

ival->=: 40.0ms (0.1% of total)

ival-or: 39.0ms (0.1% of total)

ival->: 28.0ms (0.1% of total)

Bogosity

simplify38.5s (19.1%)

Memory

92.1MiB live, 29 173.6MiB allocated

Algorithm

170×	egg-herbie

Rules

1 123 318×	`lower-fma.f32`
1 123 096×	`lower-fma.f64`
379 264×	`lower-*.f32`
378 478×	`lower-*.f64`
221 784×	`lower-+.f32`

Stop Event

221×	iter limit
92×	saturated
82×	node limit

Counts

19 428 → 19 143

rewrite25.8s (12.8%)

Memory

163.7MiB live, 21 232.2MiB allocated

Rules

304 810×	`lower-fma.f32`
304 588×	`lower-fma.f64`
265 120×	`lower-*.f32`
264 384×	`lower-*.f64`
201 594×	`lower-/.f32`

Stop Event

163×	iter limit
70×	node limit
4×	saturated
4×	unsound

Counts

1 019 → 39 708

soundness22.0s (10.9%)

Memory

47.8MiB live, 10 635.2MiB allocated

Rules

606 730×	`lower-fma.f32`
606 594×	`lower-fma.f64`
293 374×	`lower-*.f32`
292 946×	`lower-*.f64`
155 324×	`lower-+.f32`

Stop Event

131×	iter limit
69×	node limit
14×	fuel
6×	done
5×	saturated
4×	unsound

Compiler

Compiled 6 696 to 3 182 computations (52.5% saved)

prune15.6s (7.8%)

Memory: -298.3MiB live, 20 498.5MiB allocated
Counts: 74 991 → 1 697
Compiler: Compiled 67 161 to 32 648 computations (51.4% saved)

eval12.9s (6.4%)

Memory: 362.6MiB live, 16 948.7MiB allocated
Compiler: Compiled 1 730 972 to 137 516 computations (92.1% saved)

localize11.0s (5.5%)

Memory

-105.4MiB live, 12 881.1MiB allocated

Samples

3.6s	5 442×	1	valid
2.7s	11 889×	0	valid
1.7s	1 549×	2	valid
60.0ms	196×	1	exit
24.0ms	124×	0	invalid

Compiler

Compiled 11 176 to 1 772 computations (84.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 6.0s

ival-mult: 1.7s (29.1% of total)

ival-div: 532.0ms (8.9% of total)

adjust: 531.0ms (8.9% of total)

ival-cos: 436.0ms (7.3% of total)

ival-add: 422.0ms (7.1% of total)

ival-tan: 340.0ms (5.7% of total)

const: 271.0ms (4.5% of total)

ival-sin: 260.0ms (4.4% of total)

ival-sqrt: 252.0ms (4.2% of total)

ival-sub: 246.0ms (4.1% of total)

ival-log: 205.0ms (3.4% of total)

ival-pow: 152.0ms (2.6% of total)

ival-pow2: 114.0ms (1.9% of total)

ival-exp: 108.0ms (1.8% of total)

ival-sinh: 95.0ms (1.6% of total)

ival-fmod: 58.0ms (1% of total)

ival-neg: 53.0ms (0.9% of total)

ival-acos: 38.0ms (0.6% of total)

ival-hypot: 30.0ms (0.5% of total)

ival-asin: 19.0ms (0.3% of total)

exact: 18.0ms (0.3% of total)

ival-atan: 17.0ms (0.3% of total)

ival-true: 15.0ms (0.3% of total)

ival-assert: 8.0ms (0.1% of total)

ival-pi: 4.0ms (0.1% of total)

regimes7.8s (3.9%)

Memory

73.0MiB live, 8 150.2MiB allocated

Counts

3 318 → 179

Calls

55 calls:

804.0ms	a
745.0ms	b
713.0ms	x
513.0ms	(sqrt.f64 (+.f64 (.f64 x x) (+.f64 (.f64 y y) (*.f64 z z))))
484.0ms	r

Compiler

Compiled 3 208 to 2 192 computations (31.7% saved)

explain4.1s (2%)

Memory

68.9MiB live, 3 016.2MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`sqrt.f64`	`#f`	oflow-rescue	553	0
`cos.f64`	`#f`	sensitivity	520	0
`-.f64`	`#f`	cancellation	339	0
`sqrt.f64`	`#f`	uflow-rescue	313	0
`/.f64`	`#f`	n/o	257	0
`acos.f64`	`(acos.f64 (-.f64 #s(literal 1 binary64) x))`	sensitivity	254	1
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	sensitivity	244	0
`tan.f64`	`(tan.f64 (+.f64 y z))`	sensitivity	193	0
`pow.f64`	`(pow.f64 l (exp.f64 w))`	sensitivity	109	12
`*.f64`	`#f`	*nu**	37	0
`*.f64`	`#f`	*no**	31	0
`*.f64`	`(.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (*.f64 x (pow.f64 s #s(literal 2 binary64))) x))`	*uo**	17	0
↳	`(pow.f64 c #s(literal 2 binary64))`	underflow	52
↳	`(.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)`	overflow	72
↳	`(*.f64 x (pow.f64 s #s(literal 2 binary64)))`	overflow	69
↳	`(pow.f64 s #s(literal 2 binary64))`	overflow	59
`*.f64`	`(.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (*.f64 x (pow.f64 s #s(literal 2 binary64))) x))`	*ou**	15	0
↳	`(pow.f64 c #s(literal 2 binary64))`	overflow	74
↳	`(.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)`	underflow	70
↳	`(*.f64 x (pow.f64 s #s(literal 2 binary64)))`	underflow	64
↳	`(pow.f64 s #s(literal 2 binary64))`	underflow	67
`-.f64`	`(-.f64 (.f64 a a) (.f64 b b))`	nan-rescue	13	0
↳	`(*.f64 a a)`	overflow	100
↳	`(*.f64 b b)`	overflow	13
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	oflow-rescue	5	0
↳	`(sinh.f64 x)`	overflow	5
↳	`(/.f64 (sinh.f64 x) x)`	overflow	5
`exp.f64`	`(exp.f64 (neg.f64 w))`	sensitivity	1	0

Confusion

	Predicted +	Predicted -
+	2129	261
-	700	2030

Precision

0.7525627430187345

Recall

0.8907949790794979

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	2129	0	261
-	700	13	2017

Precision?

0.7491203377902885

Recall?

0.8907949790794979

Freqs

test

number	freq
0	2291
1	2760
2	66
3	3

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	17	0	1
-	0	0	2

Precision?

1.0

Recall?

0.9444444444444444

Samples

812.0ms	742×	2	valid
485.0ms	2 694×	1	valid
385.0ms	6 706×	0	valid
13.0ms	98×	1	exit

Compiler

Compiled 1 103 to 440 computations (60.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 860.0ms

ival-tan: 137.0ms (15.9% of total)

ival-log: 116.0ms (13.5% of total)

ival-cos: 79.0ms (9.2% of total)

ival-mult: 70.0ms (8.1% of total)

adjust: 66.0ms (7.7% of total)

ival-exp: 48.0ms (5.6% of total)

ival-sqrt: 47.0ms (5.5% of total)

ival-sin: 46.0ms (5.3% of total)

ival-sinh: 37.0ms (4.3% of total)

ival-add: 36.0ms (4.2% of total)

ival-sub: 34.0ms (4% of total)

ival-div: 30.0ms (3.5% of total)

ival-fmod: 26.0ms (3% of total)

ival-pow2: 26.0ms (3% of total)

ival-acos: 19.0ms (2.2% of total)

ival-hypot: 12.0ms (1.4% of total)

ival-pow: 8.0ms (0.9% of total)

ival-true: 8.0ms (0.9% of total)

ival-neg: 5.0ms (0.6% of total)

ival-assert: 4.0ms (0.5% of total)

ival-atan: 3.0ms (0.3% of total)

exact: 2.0ms (0.2% of total)

analyze3.9s (1.9%)

Memory

37.8MiB live, 5 270.9MiB allocated

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
28.8%	21.3%	52.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.2%	0%	6
71.1%	51.1%	20.8%	26.3%	0%	1.9%	0%	7
72.1%	51.6%	20%	26.3%	0%	2.1%	0%	8
74.4%	53%	18.2%	26.3%	0%	2.5%	0%	9
75.8%	53.9%	17.2%	26.3%	0%	2.6%	0%	10
76.6%	54.3%	16.6%	26.3%	0%	2.8%	0%	11
77.3%	54.8%	16.1%	26.3%	0%	2.9%	0%	12

Compiler

Compiled 279 to 216 computations (22.6% saved)

preprocess3.9s (1.9%)

Memory

47.2MiB live, 3 654.5MiB allocated

Algorithm

20×	egg-herbie

Rules

26 494×	`lower-fma.f32`
26 494×	`lower-fma.f64`
5 788×	`lower-+.f32`
5 770×	`lower-+.f64`
5 074×	`unsub-neg`

Stop Event

39×	saturated
38×	iter limit
3×	node limit

Compiler

Compiled 12 271 to 5 272 computations (57% saved)

series3.7s (1.9%)

Memory

115.1MiB live, 3 907.9MiB allocated

Counts

1 019 → 19 428

Calls

2541 calls:

Time	Variable		Point	Expression
236.0ms	x	@	-inf	(* (sqrt (* x 2)) (sqrt (sqrt (sqrt x))))
170.0ms	x	@	inf	(sqrt (* (* 2 x) (sqrt (sqrt x))))
154.0ms	b	@	inf	(/ r (cos (+ b a)))
96.0ms	x	@	0	(* (pow 2 1/8) (* (pow 2 1/8) (* x (pow 2 1/4))))
84.0ms	x	@	-inf	(sqrt (* x (sqrt (sqrt x))))

bsearch691.0ms (0.3%)

Memory

20.0MiB live, 651.2MiB allocated

Algorithm

27×	left-value
27×	binary-search

Stop Event

25×	narrow-enough
2×	predicate-same

Samples

378.0ms	711×	1	valid
148.0ms	1 817×	0	valid
1.0ms	15×	0	exit

Compiler

Compiled 6 073 to 3 934 computations (35.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 369.0ms

ival-cos: 117.0ms (31.7% of total)

ival-tan: 80.0ms (21.7% of total)

ival-mult: 47.0ms (12.7% of total)

ival-sin: 37.0ms (10% of total)

ival-pow: 18.0ms (4.9% of total)

ival-exp: 16.0ms (4.3% of total)

ival-add: 15.0ms (4.1% of total)

adjust: 13.0ms (3.5% of total)

ival-div: 7.0ms (1.9% of total)

ival-neg: 5.0ms (1.4% of total)

ival-pow2: 4.0ms (1.1% of total)

ival-sqrt: 3.0ms (0.8% of total)

ival-sub: 2.0ms (0.5% of total)

ival-true: 2.0ms (0.5% of total)

ival-assert: 1.0ms (0.3% of total)

exact: 0.0ms (0% of total)

start0.0ms (0%)

Memory: 0.7MiB live, 0.7MiB allocated

end0.0ms (0%)

Memory: 0.2MiB live, 0.2MiB allocated

sample51.1s (25.4%)

simplify38.5s (19.1%)

rewrite25.8s (12.8%)

soundness22.0s (10.9%)

prune15.6s (7.8%)

eval12.9s (6.4%)

localize11.0s (5.5%)

regimes7.8s (3.9%)

explain4.1s (2%)

analyze3.9s (1.9%)

preprocess3.9s (1.9%)

series3.7s (1.9%)

bsearch691.0ms (0.3%)

start0.0ms (0%)

end0.0ms (0%)

Profiling