Metrics for Herbie run

Date:	Friday, November 8th, 2024
Commit:	e1f2a9b8 on fix-1030
Hostname:	nightly with Racket 8.10
Seed:	2024313
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample53.8s (32.2%)

Memory

534.3MiB live, 39 201.5MiB allocated

Samples

20.0s	43 422×	1	valid
10.0s	109 903×	0	valid
8.9s	6 350×	5	exit
4.0s	11 795×	2	valid
1.2s	10 215×	1	exit
443.0ms	3 886×	0	invalid
136.0ms	1 442×	0	exit

Precisions

Click to see histograms. Total time spent on operations: 37.6s

ival-tan: 8.2s (21.9% of total)

const: 4.2s (11.1% of total)

ival-pow: 4.0s (10.7% of total)

ival-exp: 3.6s (9.6% of total)

adjust: 2.3s (6% of total)

ival-cos: 2.0s (5.4% of total)

ival-mult: 1.7s (4.5% of total)

ival-add: 1.6s (4.2% of total)

ival-sqrt: 1.4s (3.6% of total)

ival-log: 1.2s (3.3% of total)

ival-sin: 1.1s (3% of total)

ival-<=: 950.0ms (2.5% of total)

ival-fmod: 941.0ms (2.5% of total)

ival-sinh: 751.0ms (2% of total)

ival-sub: 736.0ms (2% of total)

ival-div: 709.0ms (1.9% of total)

ival-pow2: 530.0ms (1.4% of total)

ival-acos: 448.0ms (1.2% of total)

ival-neg: 200.0ms (0.5% of total)

ival-==: 178.0ms (0.5% of total)

ival-hypot: 175.0ms (0.5% of total)

ival-and: 119.0ms (0.3% of total)

ival-true: 103.0ms (0.3% of total)

exact: 82.0ms (0.2% of total)

ival-assert: 76.0ms (0.2% of total)

ival-<: 64.0ms (0.2% of total)

ival->=: 48.0ms (0.1% of total)

ival-atan: 46.0ms (0.1% of total)

ival-or: 42.0ms (0.1% of total)

ival->: 19.0ms (0.1% of total)

Bogosity

simplify26.8s (16%)

Memory

484.3MiB live, 14 787.8MiB allocated

Algorithm

162×	egg-herbie

Stop Event

209×	iter limit
97×	node limit
69×	saturated

Counts

4 039 → 3 972

soundness23.4s (14%)

Memory

48.8MiB live, 7 423.4MiB allocated

Stop Event

135×	iter limit
71×	node limit
15×	fuel
5×	done
4×	saturated
4×	unsound

Compiler

Compiled 7 926 to 4 022 computations (49.3% saved)

eval14.8s (8.9%)

Memory: 198.7MiB live, 10 074.8MiB allocated
Compiler: Compiled 1 333 582 to 155 426 computations (88.3% saved)

localize13.5s (8.1%)

Memory

-323.7MiB live, 9 929.4MiB allocated

Samples

4.6s	10 497×	0	valid
4.5s	5 529×	1	valid
1.2s	1 256×	2	valid
216.0ms	510×	0	invalid
72.0ms	208×	1	exit
53.0ms	174×	0	exit
4.0ms	2×	3	valid

Compiler

Compiled 25 762 to 3 667 computations (85.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 8.3s

ival-neg: 1.6s (19.5% of total)

ival-mult: 1.5s (17.9% of total)

ival-div: 772.0ms (9.3% of total)

ival-cos: 603.0ms (7.3% of total)

adjust: 545.0ms (6.6% of total)

ival-add: 532.0ms (6.4% of total)

ival-pow: 477.0ms (5.7% of total)

ival-sqrt: 369.0ms (4.4% of total)

ival-sub: 366.0ms (4.4% of total)

ival-log: 271.0ms (3.3% of total)

ival-sin: 247.0ms (3% of total)

ival-tan: 237.0ms (2.9% of total)

const: 200.0ms (2.4% of total)

ival-exp: 129.0ms (1.6% of total)

ival-pow2: 112.0ms (1.3% of total)

ival-sinh: 105.0ms (1.3% of total)

ival-fmod: 56.0ms (0.7% of total)

ival-acos: 51.0ms (0.6% of total)

ival-hypot: 33.0ms (0.4% of total)

ival-asin: 29.0ms (0.3% of total)

exact: 21.0ms (0.3% of total)

ival-true: 16.0ms (0.2% of total)

ival-assert: 8.0ms (0.1% of total)

ival-cbrt: 7.0ms (0.1% of total)

ival-pi: 7.0ms (0.1% of total)

ival-atan: 1.0ms (0% of total)

rewrite12.6s (7.6%)

Memory

41.3MiB live, 12 366.9MiB allocated

Stop Event

157×	iter limit
64×	node limit
6×	unsound
4×	saturated

Counts

1 017 → 40 939

regimes6.2s (3.7%)

Memory

-45.9MiB live, 7 046.6MiB allocated

Counts

3 442 → 161

Calls

53 calls:

791.0ms	a
697.0ms	x
413.0ms	r
399.0ms	b
343.0ms	(tan.f64 a)

Compiler

Compiled 1 732 to 1 984 computations (-14.5% saved)

series3.5s (2.1%)

Memory

-50.4MiB live, 3 648.2MiB allocated

Counts

1 017 → 4 039

Calls

393 calls:

Time	Variable		Point	Expression
110.0ms	x	@	0	((* (sqrt (* x 2)) (sqrt x)) (sqrt (* x 2)) (* x 2) (sqrt x) (* (pow x 1/4) (sqrt (* (sqrt x) (* x 2)))) (pow x 1/4) (sqrt (* (sqrt x) (* x 2))) (* (sqrt x) (* x 2)) (sqrt (* (* (* x 2) (sqrt x)) (sqrt x))) (* (* (* x 2) (sqrt x)) (sqrt x)) (* (* x 2) (sqrt x)) (* (sqrt (pow x 3)) 2) (* (pow (sqrt x) 3/2) (sqrt (* (sqrt x) 2))) (pow (sqrt x) 3/2) (sqrt (* (sqrt x) 2)) (pow (pow 16 1/16) 2) (* (pow (pow 16 1/16) 2) x) (pow 16 1/16) (sqrt (pow x 3)))
109.0ms	x	@	0	((* (pow 4 1/8) (* (sqrt (* (sqrt 2) x)) (sqrt x))) (pow 4 1/8) (* (sqrt (* (sqrt 2) x)) (sqrt x)) (sqrt (* (sqrt 2) x)) (* (sqrt (* (sqrt 2) x)) (sqrt (* (sqrt 2) x))) (* (sqrt 2) x) (sqrt 2) (* (* (sqrt x) 2) (sqrt x)) (* (sqrt (* (* (sqrt x) 2) (sqrt x))) (sqrt x)) (sqrt (* (* (sqrt x) 2) (sqrt x))) (* (sqrt x) 2) (sqrt (* (pow x 3/2) (* (sqrt x) 2))) (* (pow x 3/2) (* (sqrt x) 2)) (pow x 3/2) (* (* (pow 256 1/32) (sqrt (* (sqrt 2) x))) (sqrt x)) (* (pow 256 1/32) (sqrt (* (sqrt 2) x))) (pow 256 1/32) (sqrt x))
107.0ms	x	@	0	((* (pow x 3/4) (sqrt (* (sqrt x) 2))) (pow x 3/4) (sqrt (* (sqrt x) 2)) (* (sqrt x) 2) (* (sqrt 2) x) (sqrt 2) (* (* (* x 2) (sqrt x)) (sqrt x)) (sqrt (* (* (* x 2) (sqrt x)) (sqrt x))) (* (* x 2) (sqrt x)) (* x 2) (pow (* (pow x 4) 4) 1/4) (* (pow x 4) 4) (pow x 4) (* (pow (* x 4) 1/4) (pow x 3/4)) (pow (* x 4) 1/4) (* x 4) (sqrt x))
106.0ms	x	@	inf	((log (/ (sinh x) x)) (* (* (+ (* (+ (* 1/2835 (* x x)) -1/180) (* x x)) 1/6) x) x) (* (+ (* (+ (* 1/2835 (* x x)) -1/180) (* x x)) 1/6) x) (+ (* (+ (* 1/2835 (* x x)) -1/180) (* x x)) 1/6) (log (/ (sinh x) x)) (* (* x x) 1/6) (* x x) (log (/ (sinh x) x)) (/ (sinh x) x) (+ (* (* x x) 1/6) 1) (neg (log (/ x (sinh x)))) (log (/ x (sinh x))) (/ x (sinh x)) (sinh x) (- (log (* -2 (sinh x))) (log (* -2 x))) (log (* -2 (sinh x))) (* -2 (sinh x)) (+ (* 1/2835 (* x x)) -1/180) (log (* -2 x)))
95.0ms	x	@	-inf	((* (pow x 3/4) (sqrt (* (sqrt x) 2))) (pow x 3/4) (sqrt (* (sqrt x) 2)) (* (sqrt x) 2) (* (sqrt 2) x) (sqrt 2) (* (* (* x 2) (sqrt x)) (sqrt x)) (sqrt (* (* (* x 2) (sqrt x)) (sqrt x))) (* (* x 2) (sqrt x)) (* x 2) (pow (* (pow x 4) 4) 1/4) (* (pow x 4) 4) (pow x 4) (* (pow (* x 4) 1/4) (pow x 3/4)) (pow (* x 4) 1/4) (* x 4) (sqrt x))

analyze3.4s (2%)

Memory

6.0MiB live, 4 071.9MiB allocated

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
28.8%	21.3%	52.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.2%	0%	6
71.1%	51.1%	20.8%	26.3%	0%	1.9%	0%	7
72.1%	51.6%	20%	26.3%	0%	2.1%	0%	8
74.4%	53%	18.2%	26.3%	0%	2.5%	0%	9
75.8%	53.9%	17.2%	26.3%	0%	2.6%	0%	10
76.6%	54.3%	16.6%	26.3%	0%	2.8%	0%	11
77.3%	54.8%	16.1%	26.3%	0%	2.9%	0%	12

Compiler

Compiled 279 to 216 computations (22.6% saved)

prune3.1s (1.9%)

Memory: -188.8MiB live, 5 292.6MiB allocated
Counts: 44 173 → 1 724
Compiler: Compiled 88 390 to 46 997 computations (46.8% saved)

explain2.9s (1.7%)

Memory

-156.0MiB live, 2 675.8MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`sqrt.f64`	`#f`	oflow-rescue	575	0
`cos.f64`	`#f`	sensitivity	533	2
`-.f64`	`#f`	cancellation	341	0
`sqrt.f64`	`#f`	uflow-rescue	294	0
`/.f64`	`(/.f64 (-.f64 x lo) (-.f64 hi lo))`	n/o	256	0
↳	`(-.f64 hi lo)`	overflow	256
`acos.f64`	`(acos.f64 (-.f64 #s(literal 1 binary64) x))`	sensitivity	255	0
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	sensitivity	246	1
`tan.f64`	`(tan.f64 (+.f64 y z))`	sensitivity	197	0
`pow.f64`	`(pow.f64 l (exp.f64 w))`	sensitivity	130	17
`*.f64`	`#f`	*nu**	37	0
`*.f64`	`#f`	*no**	31	0
`-.f64`	`(-.f64 (.f64 a a) (.f64 b b))`	nan-rescue	20	0
↳	`(*.f64 a a)`	overflow	115
↳	`(*.f64 b b)`	overflow	20
`*.f64`	`(.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (*.f64 x (pow.f64 s #s(literal 2 binary64))) x))`	*uo**	17	0
↳	`(pow.f64 c #s(literal 2 binary64))`	underflow	71
↳	`(.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)`	overflow	72
↳	`(*.f64 x (pow.f64 s #s(literal 2 binary64)))`	overflow	66
↳	`(pow.f64 s #s(literal 2 binary64))`	overflow	62
`*.f64`	`(.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (*.f64 x (pow.f64 s #s(literal 2 binary64))) x))`	*ou**	13	0
↳	`(pow.f64 c #s(literal 2 binary64))`	overflow	67
↳	`(.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)`	underflow	73
↳	`(*.f64 x (pow.f64 s #s(literal 2 binary64)))`	underflow	60
↳	`(pow.f64 s #s(literal 2 binary64))`	underflow	60
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	oflow-rescue	6	0
↳	`(sinh.f64 x)`	overflow	6
↳	`(/.f64 (sinh.f64 x) x)`	overflow	6
`+.f64`	`(+.f64 x (-.f64 (tan.f64 (+.f64 y z)) (tan.f64 a)))`	cancellation	1	0

Confusion

	Predicted +	Predicted -
+	2147	283
-	731	1959

Precision

0.746004169562196

Recall

0.8835390946502057

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	2147	0	283
-	731	20	1939

Precision?

0.740855762594893

Recall?

0.8835390946502057

Freqs

test

number	freq
0	2242
1	2808
2	66
3	4

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	17	0	1
-	0	0	2

Precision?

1.0

Recall?

0.9444444444444444

Samples

680.0ms	6 644×	0	valid
540.0ms	2 758×	1	valid
278.0ms	734×	2	valid
14.0ms	104×	1	exit

Compiler

Compiled 1 486 to 560 computations (62.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 969.0ms

ival-mult: 117.0ms (12.1% of total)

ival-acos: 81.0ms (8.4% of total)

ival-log: 79.0ms (8.2% of total)

ival-tan: 78.0ms (8.1% of total)

adjust: 68.0ms (7% of total)

ival-cos: 68.0ms (7% of total)

ival-exp: 56.0ms (5.8% of total)

ival-sub: 54.0ms (5.6% of total)

ival-sqrt: 51.0ms (5.3% of total)

ival-pow2: 48.0ms (5% of total)

ival-sinh: 47.0ms (4.9% of total)

ival-neg: 44.0ms (4.5% of total)

ival-div: 42.0ms (4.3% of total)

ival-sin: 37.0ms (3.8% of total)

ival-add: 34.0ms (3.5% of total)

ival-fmod: 30.0ms (3.1% of total)

ival-pow: 9.0ms (0.9% of total)

ival-hypot: 9.0ms (0.9% of total)

ival-true: 9.0ms (0.9% of total)

ival-assert: 4.0ms (0.4% of total)

ival-atan: 3.0ms (0.3% of total)

exact: 2.0ms (0.2% of total)

preprocess2.8s (1.7%)

Memory

102.2MiB live, 2 411.2MiB allocated

Algorithm

20×	egg-herbie

Stop Event

39×	saturated
38×	iter limit
3×	node limit

Compiler

Compiled 9 499 to 3 798 computations (60% saved)

bsearch462.0ms (0.3%)

Memory

19.7MiB live, 304.0MiB allocated

Algorithm

27×	binary-search
19×	left-value

Stop Event

26×	narrow-enough
1×	predicate-same

Samples

262.0ms	2 122×	0	valid
49.0ms	262×	1	valid

Compiler

Compiled 8 522 to 6 979 computations (18.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 179.0ms

ival-mult: 48.0ms (26.9% of total)

ival-exp: 47.0ms (26.3% of total)

ival-pow: 26.0ms (14.6% of total)

ival-cos: 16.0ms (9% of total)

ival-sin: 9.0ms (5% of total)

ival-pow2: 6.0ms (3.4% of total)

ival-neg: 6.0ms (3.4% of total)

ival-add: 5.0ms (2.8% of total)

ival-div: 5.0ms (2.8% of total)

adjust: 5.0ms (2.8% of total)

ival-sqrt: 3.0ms (1.7% of total)

ival-true: 2.0ms (1.1% of total)

ival-assert: 1.0ms (0.6% of total)

exact: 0.0ms (0% of total)

start1.0ms (0%)

Memory: 1.3MiB live, 1.3MiB allocated

end0.0ms (0%)

Memory: 0.3MiB live, 0.3MiB allocated

sample53.8s (32.2%)

simplify26.8s (16%)

soundness23.4s (14%)

eval14.8s (8.9%)

localize13.5s (8.1%)

rewrite12.6s (7.6%)

regimes6.2s (3.7%)

series3.5s (2.1%)

analyze3.4s (2%)

prune3.1s (1.9%)

explain2.9s (1.7%)

preprocess2.8s (1.7%)

bsearch462.0ms (0.3%)

start1.0ms (0%)

end0.0ms (0%)

Profiling