Metrics for Herbie run

Date:	Wednesday, July 17th, 2024
Commit:	c34c16ee on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024199
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

simplify49.0s (23.7%)

Memory

153.5MiB live, 49 332.2MiB allocated

Algorithm

168×	egg-herbie

Rules

1 112 098×	`accelerator-lowering-fma.f32`
1 112 098×	`accelerator-lowering-fma.f64`
382 888×	`-lowering-.f32`
382 888×	`-lowering-.f64`
209 976×	`+-lowering-+.f32`

Stop Event

146×	iter limit
90×	saturated
80×	node limit

Counts

15 588 → 15 588

sample47.8s (23.1%)

Memory

482.3MiB live, 50 034.4MiB allocated

Samples

18.6s	43 453×	1	valid
8.6s	6 488×	5	exit
8.2s	109 942×	0	valid
3.9s	11 716×	2	valid
919.0ms	9 396×	1	exit
437.0ms	3 912×	0	invalid
316.0ms	1 085×	2	exit
119.0ms	1 384×	0	exit
2.0ms	9×	3	valid

Precisions

Click to see histograms. Total time spent on operations: 34.6s

const: 8.7s (25.1% of total)

ival-exp: 3.8s (11.1% of total)

ival-pow: 3.5s (10.1% of total)

ival-tan: 2.4s (7.1% of total)

ival-cos: 2.2s (6.3% of total)

adjust: 1.8s (5.3% of total)

ival-mult: 1.7s (5% of total)

ival-<=: 1.3s (3.6% of total)

ival-sqrt: 1.2s (3.6% of total)

ival-log: 1.2s (3.5% of total)

ival-add: 1.0s (2.9% of total)

ival-acos: 811.0ms (2.3% of total)

ival-fmod: 811.0ms (2.3% of total)

ival-sinh: 720.0ms (2.1% of total)

ival-sin: 678.0ms (2% of total)

ival-sub: 636.0ms (1.8% of total)

ival-div: 600.0ms (1.7% of total)

ival-pow2: 370.0ms (1.1% of total)

ival-neg: 172.0ms (0.5% of total)

ival-hypot: 161.0ms (0.5% of total)

ival-and: 121.0ms (0.3% of total)

ival-==: 106.0ms (0.3% of total)

ival-true: 96.0ms (0.3% of total)

exact: 88.0ms (0.3% of total)

ival-assert: 77.0ms (0.2% of total)

ival-<: 71.0ms (0.2% of total)

ival-atan: 50.0ms (0.1% of total)

ival-or: 37.0ms (0.1% of total)

ival->=: 24.0ms (0.1% of total)

ival->: 18.0ms (0.1% of total)

Bogosity

rewrite26.2s (12.7%)

Memory

-99.2MiB live, 32 679.4MiB allocated

Algorithm

74×	batch-egg-rewrite

Rules

310 400×	`accelerator-lowering-fma.f32`
310 400×	`accelerator-lowering-fma.f64`
255 900×	`-lowering-.f32`
255 900×	`-lowering-.f64`
188 290×	`/-lowering-/.f64`

Stop Event

97×	iter limit
64×	node limit
9×	unsound
2×	saturated

Counts

872 → 38 171

soundness20.0s (9.7%)

Memory

-46.7MiB live, 9 883.5MiB allocated

Rules

532 204×	`accelerator-lowering-fma.f32`
532 204×	`accelerator-lowering-fma.f64`
249 786×	`-lowering-.f32`
249 786×	`-lowering-.f64`
127 080×	`+-lowering-+.f32`

Stop Event

82×	iter limit
56×	node limit
14×	fuel
6×	unsound
6×	done
4×	saturated

Compiler

Compiled 7 017 to 3 540 computations (49.6% saved)

localize17.3s (8.4%)

Memory

-68.0MiB live, 14 240.1MiB allocated

Samples

8.8s	13 060×	0	valid
2.9s	3 939×	1	valid
1.8s	1 645×	2	valid
143.0ms	224×	1	exit
114.0ms	62×	3	valid
33.0ms	7×	5	exit
4.0ms	7×	4	valid

Compiler

Compiled 10 108 to 1 648 computations (83.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 5.8s

ival-mult: 1.4s (23.7% of total)

ival-div: 627.0ms (10.7% of total)

adjust: 505.0ms (8.6% of total)

ival-add: 502.0ms (8.6% of total)

ival-cos: 430.0ms (7.4% of total)

ival-fmod: 407.0ms (7% of total)

ival-tan: 282.0ms (4.8% of total)

ival-pow: 268.0ms (4.6% of total)

const: 232.0ms (4% of total)

ival-sin: 224.0ms (3.8% of total)

ival-sqrt: 217.0ms (3.7% of total)

ival-log: 201.0ms (3.4% of total)

ival-sub: 146.0ms (2.5% of total)

ival-exp: 130.0ms (2.2% of total)

ival-neg: 60.0ms (1% of total)

ival-pow2: 54.0ms (0.9% of total)

ival-sinh: 42.0ms (0.7% of total)

ival-acos: 29.0ms (0.5% of total)

exact: 22.0ms (0.4% of total)

ival-hypot: 17.0ms (0.3% of total)

ival-true: 16.0ms (0.3% of total)

ival-cbrt: 13.0ms (0.2% of total)

ival-asin: 10.0ms (0.2% of total)

ival-assert: 8.0ms (0.1% of total)

ival-pi: 7.0ms (0.1% of total)

ival-atan: 7.0ms (0.1% of total)

ival-log1p: 4.0ms (0.1% of total)

eval12.2s (5.9%)

Memory: 131.5MiB live, 16 933.1MiB allocated
Compiler: Compiled 1 878 131 to 145 208 computations (92.3% saved)

prune10.2s (4.9%)

Memory: -145.4MiB live, 17 056.4MiB allocated
Counts: 69 807 → 1 746
Compiler: Compiled 67 008 to 33 771 computations (49.6% saved)

regimes9.6s (4.7%)

Memory

-81.0MiB live, 11 988.3MiB allocated

Counts

4 715 → 224

Calls

55 calls:

1.0s	a
825.0ms	x
817.0ms	(tan.f64 a)
657.0ms	b
489.0ms	r

Compiler

Compiled 3 235 to 2 241 computations (30.7% saved)

analyze3.7s (1.8%)

Memory

109.2MiB live, 4 989.9MiB allocated

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
28.8%	21.3%	52.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.2%	0%	6
71.1%	51.1%	20.8%	26.3%	0%	1.9%	0%	7
72.1%	51.6%	20%	26.3%	0%	2.1%	0%	8
74.4%	53%	18.2%	26.3%	0%	2.5%	0%	9
75.8%	53.9%	17.2%	26.3%	0%	2.6%	0%	10
76.6%	54.3%	16.6%	26.3%	0%	2.8%	0%	11
77.3%	54.8%	16.1%	26.3%	0%	2.9%	0%	12

Compiler

Compiled 279 to 216 computations (22.6% saved)

preprocess3.3s (1.6%)

Memory

131.1MiB live, 4 349.8MiB allocated

Algorithm

40×	egg-herbie

Rules

26 494×	`accelerator-lowering-fma.f32`
26 494×	`accelerator-lowering-fma.f64`
5 788×	`+-lowering-+.f32`
5 788×	`+-lowering-+.f64`
5 080×	`unsub-neg`

Stop Event

38×	saturated
19×	iter limit
3×	node limit

Compiler

Compiled 11 248 to 4 580 computations (59.3% saved)

series3.0s (1.4%)

Memory

104.6MiB live, 4 316.1MiB allocated

Counts

872 → 15 588

Calls

2928 calls:

Time	Variable		Point	Expression
245.0ms	x	@	-inf	(neg (log (/ x (sinh x))))
115.0ms	x	@	0	(* (sqrt (* (* 2 (sqrt x)) (sqrt (sqrt x)))) (sqrt (* x (sqrt (sqrt x)))))
98.0ms	x	@	0	(sqrt (* x (sqrt x)))
76.0ms	x	@	-inf	(sqrt (* x (sqrt (sqrt (sqrt x)))))
70.0ms	x	@	-inf	(pow x 3/4)

explain2.5s (1.2%)

Memory

-49.5MiB live, 3 422.7MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`sqrt.f64`	`#f`	oflow-rescue	594	0
`cos.f64`	`#f`	sensitivity	503	0
`-.f64`	`#f`	cancellation	341	1
`sqrt.f64`	`#f`	uflow-rescue	335	0
`/.f64`	`#f`	n/o	257	0
`acos.f64`	`(acos.f64 (-.f64 #s(literal 1 binary64) x))`	sensitivity	255	1
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	sensitivity	250	0
`tan.f64`	`(tan.f64 (+.f64 y z))`	sensitivity	185	0
`pow.f64`	`(pow.f64 l (exp.f64 w))`	sensitivity	119	18
`*.f64`	`#f`	*no**	59	0
`*.f64`	`(.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (*.f64 x (pow.f64 s #s(literal 2 binary64))) x))`	*uo**	40	0
↳	`(pow.f64 c #s(literal 2 binary64))`	underflow	104
↳	`(.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)`	overflow	111
↳	`(*.f64 x (pow.f64 s #s(literal 2 binary64)))`	overflow	118
↳	`(pow.f64 s #s(literal 2 binary64))`	overflow	124
`-.f64`	`(-.f64 (.f64 a a) (.f64 b b))`	nan-rescue	23	0
↳	`(*.f64 a a)`	overflow	113
↳	`(*.f64 b b)`	overflow	23
`*.f64`	`#f`	*nu**	18	0
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	oflow-rescue	3	0
↳	`(sinh.f64 x)`	overflow	3
↳	`(/.f64 (sinh.f64 x) x)`	overflow	3
`+.f64`	`(+.f64 x (-.f64 (tan.f64 (+.f64 y z)) (tan.f64 a)))`	cancellation	1	2

Confusion

	Predicted +	Predicted -
+	2232	260
-	669	1959

Precision

0.7693898655635988

Recall

0.8956661316211878

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	2232	1	259
-	669	20	1939

Precision?

0.7642026009582478

Recall?

0.8960674157303371

Freqs

test

number	freq
0	2219
1	2819
2	82

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	17	0	1
-	0	0	2

Precision?

1.0

Recall?

0.9444444444444444

Samples

523.0ms	2 666×	1	valid
437.0ms	6 748×	0	valid
246.0ms	714×	2	valid
17.0ms	112×	1	exit

Compiler

Compiled 1 288 to 560 computations (56.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 815.0ms

ival-cos: 81.0ms (9.9% of total)

ival-div: 80.0ms (9.8% of total)

ival-tan: 79.0ms (9.7% of total)

ival-mult: 75.0ms (9.2% of total)

ival-sqrt: 67.0ms (8.2% of total)

ival-log: 64.0ms (7.9% of total)

adjust: 62.0ms (7.6% of total)

ival-sinh: 41.0ms (5% of total)

ival-exp: 39.0ms (4.8% of total)

ival-sin: 36.0ms (4.4% of total)

ival-sub: 34.0ms (4.2% of total)

ival-add: 34.0ms (4.2% of total)

ival-fmod: 32.0ms (3.9% of total)

ival-pow2: 29.0ms (3.6% of total)

ival-acos: 21.0ms (2.6% of total)

ival-pow: 8.0ms (1% of total)

ival-hypot: 8.0ms (1% of total)

ival-true: 8.0ms (1% of total)

ival-assert: 5.0ms (0.6% of total)

ival-neg: 5.0ms (0.6% of total)

exact: 3.0ms (0.4% of total)

ival-atan: 3.0ms (0.4% of total)

bsearch1.9s (0.9%)

Memory

19.8MiB live, 2 376.6MiB allocated

Algorithm

60×	binary-search
26×	left-value

Stop Event

58×	narrow-enough
2×	predicate-same

Samples

550.0ms	4 740×	0	valid
461.0ms	1 788×	1	valid
455.0ms	864×	2	valid

Compiler

Compiled 13 367 to 8 712 computations (34.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.1s

ival-exp: 313.0ms (27.8% of total)

ival-fmod: 132.0ms (11.7% of total)

ival-mult: 122.0ms (10.8% of total)

adjust: 101.0ms (9% of total)

ival-tan: 83.0ms (7.4% of total)

ival-cos: 79.0ms (7% of total)

ival-pow: 73.0ms (6.5% of total)

ival-sqrt: 72.0ms (6.4% of total)

ival-add: 41.0ms (3.6% of total)

ival-sin: 34.0ms (3% of total)

ival-neg: 24.0ms (2.1% of total)

ival-div: 16.0ms (1.4% of total)

ival-acos: 12.0ms (1.1% of total)

ival-pow2: 8.0ms (0.7% of total)

ival-sub: 7.0ms (0.6% of total)

ival-true: 6.0ms (0.5% of total)

ival-assert: 3.0ms (0.3% of total)

exact: 1.0ms (0.1% of total)

end0.0ms (0%)

Memory: 0.4MiB live, 0.3MiB allocated

simplify49.0s (23.7%)

sample47.8s (23.1%)

rewrite26.2s (12.7%)

soundness20.0s (9.7%)

localize17.3s (8.4%)

eval12.2s (5.9%)

prune10.2s (4.9%)

regimes9.6s (4.7%)

analyze3.7s (1.8%)

preprocess3.3s (1.6%)

series3.0s (1.4%)

explain2.5s (1.2%)

bsearch1.9s (0.9%)

end0.0ms (0%)

Profiling