Metrics for Herbie run

Date:	Wednesday, October 9th, 2024
Commit:	b5a8073d on reorg-report-page
Hostname:	nightly with Racket 8.10
Seed:	2024283
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample57.6s (30.7%)

Memory

19.0MiB live, 42 841.4MiB allocated

Samples

22.1s	43 493×	1	valid
9.9s	109 876×	0	valid
8.4s	6 244×	5	exit
5.1s	11 751×	2	valid
1.2s	10 119×	1	exit
588.0ms	3 956×	0	invalid
302.0ms	1 343×	0	exit
0.0ms	1×	3	exit

Precisions

Click to see histograms. Total time spent on operations: 33.5s

ival-exp: 4.0s (11.9% of total)

ival-pow: 3.5s (10.4% of total)

ival-add: 3.1s (9.3% of total)

const: 2.7s (8.1% of total)

adjust: 2.3s (7% of total)

ival-cos: 2.2s (6.5% of total)

ival-sin: 1.9s (5.6% of total)

ival-mult: 1.9s (5.5% of total)

ival-<=: 1.6s (4.9% of total)

ival-tan: 1.6s (4.8% of total)

ival-log: 1.6s (4.7% of total)

ival-sqrt: 1.2s (3.5% of total)

ival-div: 1.1s (3.4% of total)

ival-fmod: 954.0ms (2.8% of total)

ival-sub: 875.0ms (2.6% of total)

ival-sinh: 786.0ms (2.3% of total)

ival-pow2: 434.0ms (1.3% of total)

ival-neg: 376.0ms (1.1% of total)

ival-acos: 362.0ms (1.1% of total)

ival-hypot: 198.0ms (0.6% of total)

ival-and: 123.0ms (0.4% of total)

ival-atan: 122.0ms (0.4% of total)

ival-true: 108.0ms (0.3% of total)

ival-==: 103.0ms (0.3% of total)

ival->=: 88.0ms (0.3% of total)

exact: 86.0ms (0.3% of total)

ival-assert: 78.0ms (0.2% of total)

ival-<: 66.0ms (0.2% of total)

ival-or: 42.0ms (0.1% of total)

ival->: 19.0ms (0.1% of total)

Bogosity

simplify29.7s (15.8%)

Memory

183.9MiB live, 16 432.5MiB allocated

Algorithm

164×	egg-herbie

Stop Event

214×	iter limit
89×	saturated
78×	node limit
1×	unsound

Counts

18 240 → 17 957

soundness26.9s (14.3%)

Memory

161.2MiB live, 9 777.5MiB allocated

Stop Event

133×	iter limit
75×	node limit
14×	fuel
6×	done
4×	saturated
4×	unsound

Compiler

Compiled 8 128 to 4 118 computations (49.3% saved)

localize17.6s (9.4%)

Memory

120.8MiB live, 12 294.0MiB allocated

Samples

4.0s	5 191×	1	valid
2.2s	10 741×	0	valid
2.2s	1 771×	2	valid
133.0ms	282×	0	exit
127.0ms	287×	0	invalid
58.0ms	145×	1	exit
14.0ms	12×	1	invalid
3.0ms	2×	3	valid
2.0ms	1×	5	exit

Compiler

Compiled 26 530 to 3 824 computations (85.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 6.6s

ival-mult: 1.3s (19.9% of total)

adjust: 703.0ms (10.7% of total)

ival-div: 616.0ms (9.4% of total)

ival-add: 507.0ms (7.7% of total)

ival-cos: 488.0ms (7.4% of total)

const: 429.0ms (6.5% of total)

ival-tan: 421.0ms (6.4% of total)

ival-sin: 344.0ms (5.2% of total)

ival-pow: 304.0ms (4.6% of total)

ival-sub: 245.0ms (3.7% of total)

ival-log: 237.0ms (3.6% of total)

ival-sqrt: 186.0ms (2.8% of total)

ival-neg: 143.0ms (2.2% of total)

ival-pow2: 136.0ms (2.1% of total)

ival-exp: 133.0ms (2% of total)

ival-sinh: 102.0ms (1.5% of total)

ival-fmod: 89.0ms (1.4% of total)

ival-acos: 48.0ms (0.7% of total)

ival-hypot: 36.0ms (0.5% of total)

ival-asin: 35.0ms (0.5% of total)

exact: 23.0ms (0.3% of total)

ival-true: 17.0ms (0.3% of total)

ival-cbrt: 14.0ms (0.2% of total)

ival-pi: 8.0ms (0.1% of total)

ival-assert: 8.0ms (0.1% of total)

ival-atan: 3.0ms (0% of total)

ival-fabs: 1.0ms (0% of total)

rewrite13.4s (7.1%)

Memory

31.4MiB live, 13 294.9MiB allocated

Stop Event

160×	iter limit
64×	node limit
7×	unsound
4×	saturated

Counts

986 → 37 841

eval12.2s (6.5%)

Memory: 361.4MiB live, 15 035.3MiB allocated
Compiler: Compiled 2 210 405 to 162 154 computations (92.7% saved)

regimes8.8s (4.7%)

Memory

-43.9MiB live, 7 942.0MiB allocated

Counts

3 475 → 185

Calls

55 calls:

1.9s	x
947.0ms	a
516.0ms	z
476.0ms	b
467.0ms	r

Compiler

Compiled 1 832 to 2 096 computations (-14.4% saved)

prune5.5s (2.9%)

Memory: -404.6MiB live, 7 917.6MiB allocated
Counts: 68 968 → 1 649
Compiler: Compiled 87 444 to 45 032 computations (48.5% saved)

series4.6s (2.5%)

Memory

31.3MiB live, 3 978.9MiB allocated

Counts

986 → 18 240

Calls

399 calls:

Time	Variable		Point	Expression
1.5s	x	@	0	((* (pow x 3/4) (sqrt (* 2 (sqrt x)))) (pow x 3/4) (sqrt (* 2 (sqrt x))) (* 2 (sqrt x)) (/ (* (* x x) (* 2 x)) x) (sqrt (/ (* (* x x) (* 2 x)) x)) (* x x) (* 2 x) (/ (neg x) (/ 1 (neg x))) (/ 1 (neg x)) (sqrt (* 2 (/ (neg x) (/ 1 (neg x))))) (* 2 (/ (neg x) (/ 1 (neg x)))) (* (pow x -1) (neg x)) (* (* (neg x) x) (* (pow x -1) (neg x))) (sqrt (* 2 (* (* (neg x) x) (* (pow x -1) (neg x))))) (* 2 (* (* (neg x) x) (* (pow x -1) (neg x)))) (sqrt x) (* (* x x) (* 2 x)) (neg x))
208.0ms	a	@	-inf	((+ (* (neg (+ (tan z) (tan y))) (/ 1 (neg (+ (* (neg (tan z)) (tan y)) 1)))) (neg (tan a))) (neg (+ (* (neg (tan z)) (tan y)) 1)) (+ x (+ (* (neg (+ (tan z) (tan y))) (/ 1 (neg (+ (* (neg (tan z)) (tan y)) 1)))) (neg (tan a)))) (neg (+ (tan z) (tan y))) (/ 1 (/ 1 (- (tan (+ z y)) (- (tan a) x)))) (/ 1 (- (tan (+ z y)) (- (tan a) x))) (/ 1 x) (/ 1 (/ 1 (+ z y))) (+ x (- (tan (/ 1 (/ 1 (+ z y)))) (tan a))) (- (tan (/ 1 (/ 1 (+ z y)))) (tan a)) (tan (/ 1 (/ 1 (+ z y)))) (pow (pow (- (tan (+ y z)) (- (tan a) x)) 1/2) 2) (pow (- (tan (+ y z)) (- (tan a) x)) 1/2) (- (tan (+ y z)) (- (tan a) x)) (tan (+ y z)) (/ 1 (/ (- 1 (* (tan y) (tan z))) (+ (tan y) (tan z)))) (- (/ 1 (/ (- 1 (* (tan y) (tan z))) (+ (tan y) (tan z)))) (- (tan a) x)) (/ (- 1 (* (tan y) (tan z))) (+ (tan y) (tan z))) (- 1 (* (tan y) (tan z))) (+ (tan z) (tan y)) (+ (* (neg (tan z)) (tan y)) 1) (* (tan y) (tan z)))
75.0ms	x	@	inf	((log (/ (sinh x) x)) (/ (* x x) (/ 1 (+ (* -1/180 (* x x)) 1/6))) (* x x) (/ 1 (+ (* -1/180 (* x x)) 1/6)) (log (/ (sinh x) x)) (/ (* x x) (/ 1 (+ (* -1/180 (* x x)) 1/6))) (/ 1 (+ (* -1/180 (* x x)) 1/6)) (/ x (/ 1 (+ (* -1/180 (* x x)) 1/6))) (log (/ (sinh x) x)) (/ 1 (+ (* -1/180 (* x x)) 1/6)) (+ (* -1/180 (* x x)) 1/6) (log (/ (sinh x) x)) (/ (sinh x) x) (+ (* (* x x) 1/6) 1) (* (* x x) 1/6) (* (- (/ 1/6 (* x x)) 1/180) (pow x 4)) (log (/ (sinh x) x)) (/ (* x x) (/ 1 (+ (* -1/180 (* x x)) 1/6))) (- (/ 1/6 (* x x)) 1/180) (+ (* 1/5 (* x x)) 6) (* (/ x (/ 1 (+ (* -1/180 (* x x)) 1/6))) x) (/ 1/6 (* x x)))
72.0ms	x	@	0	((sqrt (* 2 (pow x 2))) (* (pow 64 1/16) (* (pow 16 1/32) (neg x))) (pow 64 1/16) (* (pow 16 1/32) (neg x)) (sqrt (* 2 (pow x 2))) (* -2 x) (sqrt 2) (/ (* -2 x) (sqrt 2)) (/ (* 2 x) (sqrt 2)) (* 2 x) (sqrt (* 2 (pow x 2))) (/ -2 (/ (sqrt 2) x)) (/ (sqrt 2) x) (/ (* (sqrt 2) -1/2) (/ 1/2 x)) (sqrt (* 2 (pow x 2))) (* (sqrt 2) -1/2) (neg x))
69.0ms	l	@	0	((exp (neg w)) (neg w) (pow l (exp w)) (exp w) (* (exp (neg w)) (pow l (exp w))))

analyze3.9s (2.1%)

Memory

55.6MiB live, 4 527.5MiB allocated

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
28.8%	21.3%	52.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.2%	0%	6
71.1%	51.1%	20.8%	26.3%	0%	1.9%	0%	7
72.1%	51.6%	20%	26.3%	0%	2.1%	0%	8
74.4%	53%	18.2%	26.3%	0%	2.5%	0%	9
75.8%	53.9%	17.2%	26.3%	0%	2.6%	0%	10
76.6%	54.3%	16.6%	26.3%	0%	2.8%	0%	11
77.3%	54.8%	16.1%	26.3%	0%	2.9%	0%	12

Compiler

Compiled 279 to 216 computations (22.6% saved)

preprocess3.2s (1.7%)

Memory

-84.6MiB live, 2 991.4MiB allocated

Algorithm

20×	egg-herbie

Stop Event

39×	saturated
38×	iter limit
3×	node limit

Compiler

Compiled 10 681 to 4 284 computations (59.9% saved)

explain3.1s (1.7%)

Memory

-92.6MiB live, 2 707.9MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`sqrt.f64`	`#f`	oflow-rescue	579	0
`cos.f64`	`#f`	sensitivity	488	1
`-.f64`	`#f`	cancellation	335	0
`sqrt.f64`	`#f`	uflow-rescue	303	0
`/.f64`	`#f`	n/o	259	0
`acos.f64`	`(acos.f64 (-.f64 #s(literal 1 binary64) x))`	sensitivity	256	0
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	sensitivity	248	1
`tan.f64`	`(tan.f64 (+.f64 y z))`	sensitivity	205	0
`pow.f64`	`(pow.f64 l (exp.f64 w))`	sensitivity	105	18
`*.f64`	`#f`	*no**	44	0
`*.f64`	`#f`	*nu**	32	0
`*.f64`	`(.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (*.f64 x (pow.f64 s #s(literal 2 binary64))) x))`	*ou**	26	0
↳	`(pow.f64 c #s(literal 2 binary64))`	overflow	75
↳	`(.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)`	underflow	73
↳	`(*.f64 x (pow.f64 s #s(literal 2 binary64)))`	underflow	57
↳	`(pow.f64 s #s(literal 2 binary64))`	underflow	61
`*.f64`	`#f`	*uo**	23	0
`-.f64`	`(-.f64 (.f64 a a) (.f64 b b))`	nan-rescue	18	0
↳	`(*.f64 a a)`	overflow	116
↳	`(*.f64 b b)`	overflow	18
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	oflow-rescue	3	0
↳	`(sinh.f64 x)`	overflow	3
↳	`(/.f64 (sinh.f64 x) x)`	overflow	3
`exp.f64`	`(exp.f64 (neg.f64 x))`	sensitivity	1	0
`+.f64`	`(+.f64 x (-.f64 (tan.f64 (+.f64 y z)) (tan.f64 a)))`	cancellation	1	0

Confusion

	Predicted +	Predicted -
+	2138	264
-	708	2010

Precision

0.7512297962052003

Recall

0.8900915903413822

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	2138	0	264
-	708	19	1991

Precision?

0.7462478184991274

Recall?

0.8900915903413822

Freqs

test

number	freq
0	2274
1	2767
2	78
3	1

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	18	0	0
-	0	0	2

Precision?

1.0

Recall?

1.0

Samples

636.0ms	6 698×	0	valid
464.0ms	2 728×	1	valid
268.0ms	718×	2	valid
13.0ms	96×	1	exit

Compiler

Compiled 1 486 to 560 computations (62.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 796.0ms

ival-mult: 90.0ms (11.3% of total)

ival-tan: 81.0ms (10.2% of total)

adjust: 81.0ms (10.2% of total)

ival-cos: 69.0ms (8.7% of total)

ival-log: 69.0ms (8.7% of total)

ival-sqrt: 62.0ms (7.8% of total)

ival-sub: 44.0ms (5.5% of total)

ival-sinh: 42.0ms (5.3% of total)

ival-exp: 41.0ms (5.2% of total)

ival-add: 36.0ms (4.5% of total)

ival-sin: 34.0ms (4.3% of total)

ival-div: 33.0ms (4.1% of total)

ival-fmod: 29.0ms (3.6% of total)

ival-pow2: 24.0ms (3% of total)

ival-acos: 19.0ms (2.4% of total)

ival-hypot: 9.0ms (1.1% of total)

ival-true: 9.0ms (1.1% of total)

ival-pow: 8.0ms (1% of total)

ival-assert: 5.0ms (0.6% of total)

ival-neg: 5.0ms (0.6% of total)

ival-atan: 3.0ms (0.4% of total)

exact: 2.0ms (0.3% of total)

bsearch1.0s (0.5%)

Memory

57.0MiB live, 1 289.3MiB allocated

Algorithm

49×	binary-search
9×	left-value

Stop Event

45×	narrow-enough
3×	predicate-failed
1×	predicate-same

Samples

396.0ms	1 521×	1	valid
260.0ms	2 623×	0	valid
52.0ms	128×	2	valid
33.0ms	303×	0	invalid

Compiler

Compiled 13 083 to 10 880 computations (16.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 607.0ms

ival-tan: 122.0ms (20.1% of total)

ival-sin: 108.0ms (17.8% of total)

ival-cos: 77.0ms (12.7% of total)

ival-exp: 63.0ms (10.4% of total)

ival-pow: 56.0ms (9.2% of total)

ival-div: 33.0ms (5.4% of total)

adjust: 32.0ms (5.3% of total)

ival-mult: 31.0ms (5.1% of total)

ival-add: 26.0ms (4.3% of total)

ival-fmod: 22.0ms (3.6% of total)

ival-sqrt: 8.0ms (1.3% of total)

ival-sub: 6.0ms (1% of total)

ival-pow2: 6.0ms (1% of total)

ival-neg: 6.0ms (1% of total)

ival-acos: 4.0ms (0.7% of total)

ival-true: 4.0ms (0.7% of total)

ival-assert: 2.0ms (0.3% of total)

exact: 0.0ms (0% of total)

start1.0ms (0%)

Memory: 1.0MiB live, 1.0MiB allocated

end0.0ms (0%)

Memory: 0.3MiB live, 0.3MiB allocated

sample57.6s (30.7%)

simplify29.7s (15.8%)

soundness26.9s (14.3%)

localize17.6s (9.4%)

rewrite13.4s (7.1%)

eval12.2s (6.5%)

regimes8.8s (4.7%)

prune5.5s (2.9%)

series4.6s (2.5%)

analyze3.9s (2.1%)

preprocess3.2s (1.7%)

explain3.1s (1.7%)

bsearch1.0s (0.5%)

start1.0ms (0%)

end0.0ms (0%)

Profiling