Metrics for Herbie run

Date:	Thursday, July 25th, 2024
Commit:	3139208f on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024207
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample53.2s (23.5%)

Memory

45.1MiB live, 51 346.7MiB allocated

Samples

18.6s	109 957×	0	valid
10.7s	43 357×	1	valid
8.7s	6 362×	5	exit
4.1s	11 799×	2	valid
1.0s	9 255×	1	exit
429.0ms	4 104×	0	invalid
241.0ms	1 098×	2	exit
124.0ms	1 400×	0	exit
1.0ms	7×	3	valid

Precisions

Click to see histograms. Total time spent on operations: 36.2s

const: 11.2s (31% of total)

ival-pow: 3.8s (10.4% of total)

ival-exp: 3.7s (10.2% of total)

ival-mult: 2.7s (7.3% of total)

ival-cos: 2.1s (5.7% of total)

ival-tan: 1.8s (4.9% of total)

adjust: 1.7s (4.6% of total)

ival-log: 1.4s (4% of total)

ival-div: 1.1s (2.9% of total)

ival-sqrt: 999.0ms (2.8% of total)

ival-sin: 762.0ms (2.1% of total)

ival-sinh: 742.0ms (2.1% of total)

ival-fmod: 720.0ms (2% of total)

ival-add: 656.0ms (1.8% of total)

ival-sub: 643.0ms (1.8% of total)

ival-<=: 574.0ms (1.6% of total)

ival-pow2: 410.0ms (1.1% of total)

ival-acos: 311.0ms (0.9% of total)

ival-neg: 155.0ms (0.4% of total)

ival-hypot: 155.0ms (0.4% of total)

ival-and: 121.0ms (0.3% of total)

ival-==: 101.0ms (0.3% of total)

ival-true: 96.0ms (0.3% of total)

ival-atan: 94.0ms (0.3% of total)

exact: 87.0ms (0.2% of total)

ival-assert: 75.0ms (0.2% of total)

ival-<: 62.0ms (0.2% of total)

ival-or: 40.0ms (0.1% of total)

ival->: 23.0ms (0.1% of total)

ival->=: 23.0ms (0.1% of total)

Bogosity

simplify37.2s (16.4%)

Memory

-148.5MiB live, 44 489.5MiB allocated

Algorithm

166×	egg-herbie

Rules

988 322×	`lower-fma.f32`
988 058×	`lower-fma.f64`
363 906×	`lower-*.f32`
363 076×	`lower-*.f64`
200 896×	`lower-+.f32`

Stop Event

213×	iter limit
93×	saturated
79×	node limit

Counts

16 248 → 15 905

soundness32.3s (14.2%)

Memory

-97.5MiB live, 11 666.6MiB allocated

Rules

584 514×	`lower-fma.f32`
584 380×	`lower-fma.f64`
308 320×	`lower-*.f32`
307 844×	`lower-*.f64`
163 268×	`lower-+.f32`

Stop Event

136×	iter limit
71×	node limit
14×	fuel
6×	done
5×	unsound
4×	saturated

Compiler

Compiled 7 098 to 3 580 computations (49.6% saved)

rewrite29.4s (13%)

Memory

447.7MiB live, 27 420.1MiB allocated

Algorithm

73×	batch-egg-rewrite

Rules

282 872×	`lower-fma.f32`
282 608×	`lower-fma.f64`
242 724×	`lower-*.f32`
241 940×	`lower-*.f64`
176 948×	`lower-/.f32`

Stop Event

162×	iter limit
63×	node limit
7×	saturated
7×	unsound

Counts

912 → 45 057

prune19.7s (8.7%)

Memory: -119.1MiB live, 18 279.0MiB allocated
Counts: 80 004 → 1 877
Compiler: Compiled 74 578 to 36 808 computations (50.6% saved)

eval12.5s (5.5%)

Memory: 182.2MiB live, 18 933.8MiB allocated
Compiler: Compiled 2 078 954 to 159 417 computations (92.3% saved)

localize11.5s (5.1%)

Memory

-98.4MiB live, 13 146.5MiB allocated

Samples

3.4s	4 179×	1	valid
2.2s	12 243×	0	valid
1.9s	1 595×	2	valid
504.0ms	92×	3	valid
76.0ms	296×	0	invalid
51.0ms	156×	1	exit
27.0ms	113×	0	exit
16.0ms	9×	5	exit
3.0ms	5×	4	valid

Compiler

Compiled 11 155 to 1 729 computations (84.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 6.4s

ival-mult: 1.8s (27.7% of total)

ival-tan: 610.0ms (9.5% of total)

adjust: 572.0ms (8.9% of total)

ival-add: 565.0ms (8.8% of total)

ival-div: 443.0ms (6.9% of total)

ival-cos: 354.0ms (5.5% of total)

ival-sin: 335.0ms (5.2% of total)

const: 272.0ms (4.2% of total)

ival-pow: 267.0ms (4.1% of total)

ival-sqrt: 245.0ms (3.8% of total)

ival-fmod: 225.0ms (3.5% of total)

ival-log: 218.0ms (3.4% of total)

ival-exp: 145.0ms (2.2% of total)

ival-sub: 99.0ms (1.5% of total)

ival-neg: 95.0ms (1.5% of total)

ival-pow2: 59.0ms (0.9% of total)

ival-sinh: 31.0ms (0.5% of total)

ival-acos: 24.0ms (0.4% of total)

exact: 22.0ms (0.3% of total)

ival-hypot: 18.0ms (0.3% of total)

ival-true: 15.0ms (0.2% of total)

ival-cbrt: 14.0ms (0.2% of total)

ival-log1p: 10.0ms (0.2% of total)

ival-asin: 9.0ms (0.1% of total)

ival-pi: 7.0ms (0.1% of total)

ival-assert: 7.0ms (0.1% of total)

ival-atan: 1.0ms (0% of total)

series11.3s (5%)

Memory

24.6MiB live, 4 148.8MiB allocated

Counts

912 → 16 248

Calls

3255 calls:

Time	Variable		Point	Expression
8.2s	x	@	-inf	(* (sqrt (sqrt (sqrt x))) (sqrt (sqrt (sqrt x))))
148.0ms	x	@	0	(* (pow 2 1/8) (* (pow 2 1/8) (* x (pow 2 1/4))))
137.0ms	x	@	0	(* x (pow 2 1/4))
88.0ms	x	@	-inf	(sqrt (* (* 2 x) (sqrt (sqrt x))))
84.0ms	y	@	-inf	(/ 1 (- (/ 1 (+ (* (tan y) (tan z)) 1)) (/ (pow (* (tan y) (tan z)) 2) (+ (* (tan y) (tan z)) 1))))

regimes8.7s (3.8%)

Memory

-57.3MiB live, 12 468.2MiB allocated

Counts

4 301 → 199

Calls

53 calls:

1.3s	x
884.0ms	a
460.0ms	(tan.f64 (+.f64 y z))
454.0ms	y
441.0ms	b

Compiler

Compiled 3 151 to 2 184 computations (30.7% saved)

analyze3.6s (1.6%)

Memory

79.1MiB live, 5 248.2MiB allocated

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
28.8%	21.3%	52.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.2%	0%	6
71.1%	51.1%	20.8%	26.3%	0%	1.9%	0%	7
72.1%	51.6%	20%	26.3%	0%	2.1%	0%	8
74.4%	53%	18.2%	26.3%	0%	2.5%	0%	9
75.8%	53.9%	17.2%	26.3%	0%	2.6%	0%	10
76.6%	54.3%	16.6%	26.3%	0%	2.8%	0%	11
77.3%	54.8%	16.1%	26.3%	0%	2.9%	0%	12

Compiler

Compiled 279 to 216 computations (22.6% saved)

preprocess3.2s (1.4%)

Memory

163.9MiB live, 4 114.6MiB allocated

Algorithm

20×	egg-herbie

Rules

26 494×	`lower-fma.f32`
26 494×	`lower-fma.f64`
5 788×	`lower-+.f32`
5 770×	`lower-+.f64`
5 074×	`unsub-neg`

Stop Event

39×	saturated
38×	iter limit
3×	node limit

Compiler

Compiled 8 726 to 3 428 computations (60.7% saved)

explain3.0s (1.3%)

Memory

-43.4MiB live, 3 365.0MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`sqrt.f64`	`#f`	oflow-rescue	558	0
`cos.f64`	`#f`	sensitivity	515	0
`sqrt.f64`	`#f`	uflow-rescue	345	0
`-.f64`	`#f`	cancellation	341	0
`/.f64`	`#f`	n/o	259	0
`acos.f64`	`(acos.f64 (-.f64 #s(literal 1 binary64) x))`	sensitivity	254	0
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	sensitivity	250	0
`tan.f64`	`(tan.f64 (+.f64 y z))`	sensitivity	194	0
`pow.f64`	`(pow.f64 l (exp.f64 w))`	sensitivity	117	8
`*.f64`	`#f`	*uo**	56	0
`*.f64`	`#f`	*no**	47	0
`*.f64`	`#f`	*nu**	29	0
`-.f64`	`(-.f64 (.f64 a a) (.f64 b b))`	nan-rescue	16	0
↳	`(*.f64 a a)`	overflow	105
↳	`(*.f64 b b)`	overflow	16
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	oflow-rescue	5	0
↳	`(sinh.f64 x)`	overflow	5
↳	`(/.f64 (sinh.f64 x) x)`	overflow	5
`exp.f64`	`(exp.f64 (neg.f64 x))`	sensitivity	1	0
`/.f64`	`(/.f64 (*.f64 r (sin.f64 b)) (cos.f64 (+.f64 a b)))`	u/n	1	0
↳	`(*.f64 r (sin.f64 b))`	underflow	32

Confusion

	Predicted +	Predicted -
+	2235	264
-	658	1963

Precision

0.7725544417559627

Recall

0.8943577430972389

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	2235	1	263
-	658	8	1955

Precision?

0.7705031013094418

Recall?

0.8947579031612645

Freqs

test

number	freq
0	2227
1	2799
2	93
3	1

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	18	0	0
-	0	0	2

Precision?

1.0

Recall?

1.0

Samples

578.0ms	2 724×	1	valid
564.0ms	6 726×	0	valid
316.0ms	686×	2	valid
14.0ms	104×	1	exit

Compiler

Compiled 1 288 to 560 computations (56.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.0s

ival-sqrt: 166.0ms (16.6% of total)

ival-tan: 138.0ms (13.8% of total)

ival-mult: 106.0ms (10.6% of total)

ival-cos: 66.0ms (6.6% of total)

ival-log: 66.0ms (6.6% of total)

adjust: 57.0ms (5.7% of total)

ival-div: 56.0ms (5.6% of total)

ival-sin: 55.0ms (5.5% of total)

ival-pow: 53.0ms (5.3% of total)

ival-add: 38.0ms (3.8% of total)

ival-exp: 36.0ms (3.6% of total)

ival-sub: 36.0ms (3.6% of total)

ival-sinh: 30.0ms (3% of total)

ival-fmod: 25.0ms (2.5% of total)

ival-pow2: 23.0ms (2.3% of total)

ival-acos: 18.0ms (1.8% of total)

ival-hypot: 8.0ms (0.8% of total)

ival-true: 8.0ms (0.8% of total)

ival-neg: 5.0ms (0.5% of total)

ival-assert: 4.0ms (0.4% of total)

exact: 3.0ms (0.3% of total)

ival-atan: 3.0ms (0.3% of total)

bsearch1.2s (0.5%)

Memory

-12.5MiB live, 1 424.4MiB allocated

Algorithm

45×	binary-search
24×	left-value

Stop Event

40×	narrow-enough
4×	predicate-failed
1×	predicate-same

Samples

322.0ms	3 883×	0	valid
202.0ms	336×	2	valid
168.0ms	1 141×	1	valid
89.0ms	404×	0	invalid

Compiler

Compiled 9 532 to 6 181 computations (35.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 607.0ms

adjust: 108.0ms (17.8% of total)

ival-exp: 89.0ms (14.7% of total)

ival-cos: 79.0ms (13% of total)

ival-tan: 71.0ms (11.7% of total)

ival-fmod: 44.0ms (7.2% of total)

ival-mult: 42.0ms (6.9% of total)

ival-pow2: 34.0ms (5.6% of total)

ival-pow: 27.0ms (4.4% of total)

ival-sin: 25.0ms (4.1% of total)

ival-div: 23.0ms (3.8% of total)

ival-sqrt: 17.0ms (2.8% of total)

ival-add: 16.0ms (2.6% of total)

ival-neg: 10.0ms (1.6% of total)

ival-acos: 8.0ms (1.3% of total)

ival-sub: 6.0ms (1% of total)

ival-true: 4.0ms (0.7% of total)

ival-assert: 2.0ms (0.3% of total)

exact: 1.0ms (0.2% of total)

end0.0ms (0%)

Memory: 0.3MiB live, 0.3MiB allocated

sample53.2s (23.5%)

simplify37.2s (16.4%)

soundness32.3s (14.2%)

rewrite29.4s (13%)

prune19.7s (8.7%)

eval12.5s (5.5%)

localize11.5s (5.1%)

series11.3s (5%)

regimes8.7s (3.8%)

analyze3.6s (1.6%)

preprocess3.2s (1.4%)

explain3.0s (1.3%)

bsearch1.2s (0.5%)

end0.0ms (0%)

Profiling