Metrics for Herbie run

Date:	Sunday, December 29th, 2024
Commit:	fbbe2c7d on main
Seed:	2024364
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default
Memory:	1 773 650.7 MB

sample6.7min (23.4%)

Memory

4 730.0MiB live, 442 805.7MiB allocated; 2.4min collecting garbage

Samples

4.1min	2 144 688×	0	valid
25.2s	69 670×	1	valid
10.9s	63 952×	0	invalid
2.0s	5 891×	2	valid
1.8s	1 593×	5	exit
574.0ms	1 816×	1	invalid
220.0ms	612×	3	valid
1.0ms	3×	4	valid

Precisions

Click to see histograms. Total time spent on operations: 2.9min

ival-mult: 58.7s (33.8% of total)

ival-add: 26.8s (15.5% of total)

ival-sub: 23.9s (13.8% of total)

ival-div: 20.5s (11.8% of total)

ival-log: 9.2s (5.3% of total)

const: 6.9s (4% of total)

adjust: 6.6s (3.8% of total)

ival-sqrt: 5.5s (3.2% of total)

ival-sin: 4.8s (2.7% of total)

ival-cos: 2.9s (1.7% of total)

ival-exp: 2.0s (1.1% of total)

ival-true: 1.7s (1% of total)

exact: 1.1s (0.7% of total)

ival-assert: 970.0ms (0.6% of total)

ival-acos: 474.0ms (0.3% of total)

ival-cosh: 305.0ms (0.2% of total)

ival-fabs: 300.0ms (0.2% of total)

ival-tan: 275.0ms (0.2% of total)

ival-hypot: 216.0ms (0.1% of total)

ival-sinh: 166.0ms (0.1% of total)

ival-tanh: 92.0ms (0.1% of total)

Bogosity

simplify5.5min (19.2%)

Memory

2 928.6MiB live, 299 544.3MiB allocated; 1.5min collecting garbage

Stop Event

2 909×	iter limit
1 490×	node limit
720×	saturated
12×	unsound

Counts

75 022 → 73 789

rewrite4.0min (14%)

Memory

725.6MiB live, 243 777.8MiB allocated; 1.0min collecting garbage

Stop Event

2 014×	iter limit
926×	node limit
31×	unsound
18×	saturated

Counts

12 152 → 360 795

derivations3.5min (12.2%)

Memory

-169.8MiB live, 160 346.4MiB allocated; 34.0s collecting garbage

Stop Event

1 445×	iter limit
979×	node limit
163×	fuel
106×	done
24×	saturated
10×	unsound

Compiler

Compiled 138 832 to 19 238 computations (86.1% saved)

localize1.9min (6.7%)

Memory

1 179.9MiB live, 132 604.6MiB allocated; 27.9s collecting garbage

Samples

1.0min	223 037×	0	valid
13.9s	11 622×	1	valid
5.3s	2 972×	2	valid
4.0s	8 260×	0	invalid
629.0ms	1 337×	0	exit
516.0ms	308×	3	valid
332.0ms	254×	5	exit
32.0ms	16×	4	valid
1.0ms	2×	1	exit

Compiler

Compiled 151 306 to 24 029 computations (84.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 59.4s

ival-mult: 20.1s (33.9% of total)

ival-div: 8.5s (14.4% of total)

ival-add: 7.6s (12.8% of total)

ival-sub: 5.5s (9.2% of total)

adjust: 3.6s (6% of total)

const: 2.9s (4.8% of total)

ival-sin: 2.4s (4% of total)

ival-log: 1.9s (3.2% of total)

ival-pow: 1.5s (2.5% of total)

ival-cos: 1.2s (1.9% of total)

ival-neg: 1.1s (1.9% of total)

ival-sqrt: 1.0s (1.7% of total)

ival-pow2: 640.0ms (1.1% of total)

ival-exp: 420.0ms (0.7% of total)

exact: 249.0ms (0.4% of total)

ival-true: 214.0ms (0.4% of total)

ival-log1p: 107.0ms (0.2% of total)

ival-assert: 103.0ms (0.2% of total)

ival-tan: 67.0ms (0.1% of total)

ival-sinh: 63.0ms (0.1% of total)

ival-tanh: 58.0ms (0.1% of total)

ival-hypot: 48.0ms (0.1% of total)

ival-expm1: 33.0ms (0.1% of total)

ival-sinu: 31.0ms (0.1% of total)

ival-cosh: 30.0ms (0.1% of total)

ival-acos: 28.0ms (0% of total)

ival-pi: 21.0ms (0% of total)

ival-fabs: 21.0ms (0% of total)

ival-cosu: 20.0ms (0% of total)

ival-asin: 10.0ms (0% of total)

ival->: 1.0ms (0% of total)

ival-then: 0.0ms (0% of total)

eval1.5min (5.2%)

Memory: 285.7MiB live, 112 810.8MiB allocated; 25.1s collecting garbage
Compiler: Compiled 16 793 914 to 1 614 704 computations (90.4% saved)

regimes1.2min (4.1%)

Memory

-54.5MiB live, 86 244.1MiB allocated; 13.6s collecting garbage

Counts

32 003 → 4 733

Calls

509 calls:

10.2s	x
9.4s	y
7.2s	z
4.6s	t
2.7s	a

Compiler

Compiled 37 307 to 57 059 computations (-52.9% saved)

preprocess1.0min (3.5%)

Memory

1 923.1MiB live, 59 294.1MiB allocated; 19.1s collecting garbage

Stop Event

536×	iter limit
398×	saturated
142×	node limit

Compiler

Compiled 309 916 to 59 800 computations (80.7% saved)

series53.1s (3.1%)

Memory

-602.0MiB live, 66 072.6MiB allocated; 14.4s collecting garbage

Counts

12 152 → 75 022

Calls

9171 calls:

Time	Variable		Point	Expression
745.0ms	z	@	0	((+ (- (+ (log (+ x y)) (log z)) t) (* (- a 1/2) (log t))) (- (+ (log (+ x y)) (log z)) t) (+ (log (+ x y)) (log z)) (log (+ x y)) (+ (- (+ (log (+ x y)) (log z)) t) (* (- a 1/2) (log t))) (* (log t) a) (log t) (+ (* (- a 1/2) (log t)) (- (log (* (+ x y) z)) t)) (- a 1/2) (- (log (* (+ x y) z)) t) (+ (- (+ (log (+ x y)) (log z)) t) (* (- a 1/2) (log t))) (+ (+ (* (/ (- (* a a) 1/4) (- a -1/2)) (log t)) (log z)) (- (log y) t)) (+ (* (/ (- (* a a) 1/4) (- a -1/2)) (log t)) (log z)) (/ (- (* a a) 1/4) (- a -1/2)) (/ (- (* (+ (* (log t) (- a 1/2)) (log (+ y x))) (+ (* (log t) (- a 1/2)) (log (+ y x)))) (pow (- (log z) t) 2)) (- (+ (* (log t) (- a 1/2)) (log (+ y x))) (- (log z) t))) (- (* (+ (* (log t) (- a 1/2)) (log (+ y x))) (+ (* (log t) (- a 1/2)) (log (+ y x)))) (pow (- (log z) t) 2)) (* (pow (log t) 2) (* a a)) (pow (log t) 2) (* (- a 1/2) (log t)) (log (* (+ x y) z)) (* (+ x y) z) (+ (* (log t) (- a 1/2)) (log (+ y x))))
351.0ms	y	@	0	((* (+ (* x (/ (log (/ x y)) z)) -1) z) (- (* x (log (/ x y))) z) (+ (* x (/ (log (/ x y)) z)) -1) (/ (log (/ x y)) z) (- (* x (fabs (log (/ y x)))) z) (* x (fabs (log (/ y x)))) (fabs (log (/ y x))) (log (/ y x)) (- (* x (log (/ x y))) z) (* (- (log x) (log y)) x) (- (log x) (log y)) (log x) (exp (log (log (/ x y)))) (- (* x (log (/ x y))) z) (* (exp (log (log (/ x y)))) x) (log (log (/ x y))) (* (neg x) (neg y)) (- (* x (/ (- (pow (log (neg x)) 2) (pow (log (neg y)) 2)) (log (* (neg x) (neg y))))) z) (* x (/ (- (pow (log (neg x)) 2) (pow (log (neg y)) 2)) (log (* (neg x) (neg y))))) (/ (- (pow (log (neg x)) 2) (pow (log (neg y)) 2)) (log (* (neg x) (neg y)))) (log (/ x y)) (/ x y) (log y) (log (neg x)) (log (neg y)) (log (* (neg x) (neg y))) (neg x))
335.0ms	x	@	0	((* x (* 2 (log (sqrt (/ x y))))) (* 2 (log (sqrt (/ x y)))) (log (sqrt (/ x y))) (sqrt (/ x y)) (/ 0 0) (* (log (* (neg x) (neg y))) (* (log (/ x y)) (/ x (log (* (neg x) (neg y)))))) (log (* (neg x) (neg y))) (* (neg x) (neg y)) (neg x) (/ (* (* (+ (log (neg y)) (log (neg x))) (log (/ x y))) x) (log (* (neg y) (neg x)))) (* (* (+ (log (neg y)) (log (neg x))) (log (/ x y))) x) (* (+ (log (neg y)) (log (neg x))) (log (/ x y))) (+ (log (neg y)) (log (neg x))) (/ (+ (* (* (- (pow (log x) 2) (pow (log y) 2)) (/ x 2)) -2) (* (log (* y x)) (* (log (/ x y)) (neg x)))) (* (log (* y x)) -2)) (/ (* (- (pow (log x) 2) (pow (log y) 2)) x) (+ (log y) (log x))) (* (- (pow (log x) 2) (pow (log y) 2)) x) (- (pow (log x) 2) (pow (log y) 2)) (log (/ x y)) (neg y) (log (neg x)) (log (neg y)) (log (* (neg y) (neg x))) (log x) (log y))
194.0ms	x	@	0	((- (* x (- (log (neg x)) (log (neg y)))) z) (* x (- (log (neg x)) (log (neg y)))) (- (log (neg x)) (log (neg y))) (log (neg x)) (- (* x (log (/ x y))) z) (neg z) (- (* (sqrt (* (pow (log (/ x y)) 2) x)) (sqrt x)) z) (* (sqrt (* (pow (log (/ x y)) 2) x)) (sqrt x)) (sqrt (* (pow (log (/ x y)) 2) x)) (* (pow (log (/ x y)) 2) x) (+ (* (* (pow (log (/ x y)) 2) x) (/ x (+ (* (log (/ x y)) x) z))) (/ (* z z) (+ (* (log (/ x y)) x) z))) (pow (log (/ x y)) 2) (log (/ x y)) (- (* x (/ (- (pow (log x) 3) (pow (log y) 3)) (+ (* (log y) (log (* y x))) (pow (log x) 2)))) z) (* x (/ (- (pow (log x) 3) (pow (log y) 3)) (+ (* (log y) (log (* y x))) (pow (log x) 2)))) (/ (- (pow (log x) 3) (pow (log y) 3)) (+ (* (log y) (log (* y x))) (pow (log x) 2))) (- (pow (log x) 3) (pow (log y) 3)) (log (neg y)) (neg x) (neg y) (sqrt x) (* z z) (/ x y) (log x) (log y) (log (* y x)))
169.0ms	x	@	inf	((/ (* (sin x) (sinh y)) x) (* (sin x) (sinh y)) (sin x) (sinh y))

explain50.6s (3%)

Memory

-1 159.8MiB live, 58 512.3MiB allocated; 19.6s collecting garbage

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`log.f64`	`#f`	sensitivity	1559	3
`/.f64`	`#f`	o/n	1160	0
`sqrt.f64`	`#f`	oflow-rescue	743	0
`-.f64`	`#f`	cancellation	595	6
`/.f64`	`#f`	o/o	590	0
`+.f64`	`#f`	nan-rescue	493	0
`-.f64`	`#f`	nan-rescue	492	0
`*.f64`	`#f`	*no**	489	0
`cos.f64`	`#f`	sensitivity	345	1
`/.f64`	`#f`	n/o	330	0
`+.f64`	`#f`	cancellation	327	0
`/.f64`	`#f`	u/n	249	0
`sin.f64`	`#f`	sensitivity	211	1
`*.f64`	`#f`	*nu**	173	0
`cos.f64`	`#f`	oflow-rescue	153	0
`/.f64`	`#f`	n/u	129	0
`tan.f64`	`(tan.f64 (/.f64 x (*.f64 y #s(literal 2 binary64))))`	sensitivity	106	0
`log.f64`	`#f`	oflow-rescue	96	0
`/.f64`	`#f`	u/u	85	0
`log.f64`	`#f`	uflow-rescue	78	0
`sqrt.f64`	`#f`	uflow-rescue	43	0
`exp.f64`	`(exp.f64 (-.f64 (+.f64 (.f64 y (log.f64 z)) (.f64 (-.f64 t #s(literal 1 binary64)) (log.f64 a))) b))`	sensitivity	37	3
`*.f64`	`#f`	*ou**	36	0
`sin.f64`	`(sin.f64 (/.f64 x (*.f64 y #s(literal 2 binary64))))`	oflow-rescue	33	0
↳	`(/.f64 x (*.f64 y #s(literal 2 binary64)))`	overflow	33
`tan.f64`	`(tan.f64 (/.f64 x (*.f64 y #s(literal 2 binary64))))`	oflow-rescue	33	0
↳	`(/.f64 x (*.f64 y #s(literal 2 binary64)))`	overflow	33
`*.f64`	`(.f64 (.f64 (-.f64 (.f64 x #s(literal 1/2 binary64)) y) (sqrt.f64 (.f64 z #s(literal 2 binary64)))) (exp.f64 (/.f64 (*.f64 t t) #s(literal 2 binary64))))`	*uo**	1	0
↳	`(.f64 (-.f64 (.f64 x #s(literal 1/2 binary64)) y) (sqrt.f64 (*.f64 z #s(literal 2 binary64))))`	underflow	1
↳	`(exp.f64 (/.f64 (*.f64 t t) #s(literal 2 binary64)))`	overflow	135
↳	`(/.f64 (*.f64 t t) #s(literal 2 binary64))`	overflow	64
↳	`(*.f64 t t)`	overflow	64

Confusion

	Predicted +	Predicted -
+	6013	186
-	1672	60993

Precision

0.7824333116460638

Recall

0.9699951605097596

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	6013	3	183
-	1672	12	60981

Precision?

0.7812987012987013

Recall?

0.9704791095337958

Freqs

test

number	freq
0	61179
1	6898
2	705
3	59
4	14
5	9

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	133	1	0
-	2	1	132

Precision?

0.9781021897810219

Recall?

1.0

Samples

17.7s	130 304×	0	valid
2.3s	6 050×	1	valid
827.0ms	1 278×	2	valid
66.0ms	92×	3	valid
1.0ms	2×	4	valid
1.0ms	2×	5	exit

Compiler

Compiled 24 442 to 8 402 computations (65.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 13.1s

ival-sub: 4.7s (36.1% of total)

ival-mult: 2.7s (20.9% of total)

ival-add: 1.5s (11.7% of total)

ival-div: 1.0s (7.7% of total)

ival-log: 909.0ms (6.9% of total)

adjust: 551.0ms (4.2% of total)

ival-sin: 379.0ms (2.9% of total)

const: 348.0ms (2.7% of total)

ival-cos: 238.0ms (1.8% of total)

ival-sqrt: 218.0ms (1.7% of total)

ival-exp: 120.0ms (0.9% of total)

ival-true: 115.0ms (0.9% of total)

exact: 68.0ms (0.5% of total)

ival-assert: 57.0ms (0.4% of total)

ival-fabs: 18.0ms (0.1% of total)

ival-tan: 17.0ms (0.1% of total)

ival-cosh: 12.0ms (0.1% of total)

ival-sinh: 10.0ms (0.1% of total)

ival-hypot: 9.0ms (0.1% of total)

ival-tanh: 7.0ms (0.1% of total)

ival-acos: 5.0ms (0% of total)

bsearch36.5s (2.1%)

Memory

876.8MiB live, 39 835.9MiB allocated; 7.1s collecting garbage

Algorithm

1 732×	binary-search
955×	left-value

Stop Event

1 694×	narrow-enough
38×	predicate-same

Samples

20.0s	139 248×	0	valid
1.4s	3 907×	1	valid
241.0ms	2 682×	0	invalid
43.0ms	171×	2	valid
15.0ms	62×	1	invalid
4.0ms	18×	3	valid

Compiler

Compiled 947 996 to 682 668 computations (28% saved)

Precisions

Click to see histograms. Total time spent on operations: 14.6s

ival-mult: 6.2s (42.1% of total)

ival-sub: 3.3s (22.8% of total)

ival-add: 1.5s (10.6% of total)

ival-div: 900.0ms (6.2% of total)

const: 614.0ms (4.2% of total)

ival-sin: 484.0ms (3.3% of total)

ival-log: 415.0ms (2.8% of total)

adjust: 358.0ms (2.4% of total)

ival-cos: 234.0ms (1.6% of total)

ival-sqrt: 147.0ms (1% of total)

ival-true: 109.0ms (0.7% of total)

ival-exp: 101.0ms (0.7% of total)

ival-sinh: 83.0ms (0.6% of total)

ival-assert: 60.0ms (0.4% of total)

exact: 58.0ms (0.4% of total)

ival-cosh: 10.0ms (0.1% of total)

ival-fabs: 8.0ms (0.1% of total)

ival-tanh: 7.0ms (0% of total)

prune35.5s (2.1%)

Memory: -1 932.8MiB live, 48 049.2MiB allocated; 10.4s collecting garbage
Counts: 416 634 → 12 854
Compiler: Compiled 806 753 to 437 043 computations (45.8% saved)

analyze23.2s (1.4%)

Memory

247.8MiB live, 23 726.4MiB allocated; 8.9s collecting garbage

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.8%	46.8%	53.1%	0.1%	0%	0%	0%	1
50.5%	50.1%	49.2%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.2%	68.2%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.3%	23%	0.1%	0%	4.6%	0%	6
79.8%	75.6%	19.1%	0.1%	0%	5.1%	0%	7
81.7%	77%	17.3%	0.1%	0%	5.6%	0%	8
84.3%	79.3%	14.7%	0.1%	0%	5.9%	0%	9
85.9%	80.5%	13.2%	0.1%	0%	6.2%	0%	10
88.5%	82.8%	10.8%	0.1%	0%	6.2%	0%	11
89.6%	83.6%	9.8%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 3 462 to 2 977 computations (14% saved)

start21.0ms (0%)

Memory: -20.8MiB live, 21.2MiB allocated; 13ms collecting garbage

end2.0ms (0%)

Memory: -40.9MiB live, 5.1MiB allocated; 0ms collecting garbage

sample6.7min (23.4%)

simplify5.5min (19.2%)

rewrite4.0min (14%)

derivations3.5min (12.2%)

localize1.9min (6.7%)

eval1.5min (5.2%)

regimes1.2min (4.1%)

preprocess1.0min (3.5%)

series53.1s (3.1%)

explain50.6s (3%)

bsearch36.5s (2.1%)

prune35.5s (2.1%)

analyze23.2s (1.4%)

start21.0ms (0%)

end2.0ms (0%)

Profiling