Metrics for Herbie run

Date:	Friday, January 10th, 2025
Commit:	4dfe4069 on main
Seed:	2025010
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default
Memory:	116 783.7 MB

sample53.0s (40.8%)

Memory

528.1MiB live, 48 084.4MiB allocated; 15.8s collecting garbage

Samples

14.7s	16 458×	5	exit
12.3s	40 083×	1	valid
10.2s	108 588×	0	valid
5.9s	16 449×	2	valid
533.0ms	3 910×	0	invalid
116.0ms	1 387×	0	exit

Precisions

Click to see histograms. Total time spent on operations: 34.9s

ival-exp: 4.5s (12.9% of total)

ival-pow: 3.9s (11.1% of total)

adjust: 3.7s (10.5% of total)

const: 3.0s (8.5% of total)

ival-cos: 2.9s (8.4% of total)

ival-log: 2.8s (8% of total)

ival-tan: 1.8s (5.3% of total)

ival-mult: 1.8s (5.2% of total)

ival-sinh: 1.4s (3.9% of total)

ival-sub: 1.2s (3.4% of total)

ival-sqrt: 1.1s (3.2% of total)

ival-div: 1.1s (3.2% of total)

ival-sin: 1.1s (3.2% of total)

ival-add: 923.0ms (2.6% of total)

ival-fmod: 872.0ms (2.5% of total)

ival-<=: 609.0ms (1.7% of total)

ival-pow2: 511.0ms (1.5% of total)

ival-acos: 468.0ms (1.3% of total)

ival-neg: 228.0ms (0.7% of total)

ival-hypot: 205.0ms (0.6% of total)

ival-<: 177.0ms (0.5% of total)

ival-and: 123.0ms (0.4% of total)

ival-true: 117.0ms (0.3% of total)

ival-==: 94.0ms (0.3% of total)

ival-assert: 89.0ms (0.3% of total)

exact: 79.0ms (0.2% of total)

ival-atan: 58.0ms (0.2% of total)

ival-or: 41.0ms (0.1% of total)

ival->=: 29.0ms (0.1% of total)

ival->: 21.0ms (0.1% of total)

Bogosity

simplify22.5s (17.3%)

Memory

-56.1MiB live, 19 419.9MiB allocated; 4.2s collecting garbage

Stop Event

218×	iter limit
136×	node limit
19×	saturated
7×	unsound

Counts

3 972 → 3 912

localize11.7s (9%)

Memory

185.9MiB live, 10 814.2MiB allocated; 1.5s collecting garbage

Samples

4.5s	5 505×	1	valid
2.2s	9 863×	0	valid
1.6s	1 787×	2	valid
1.3s	221×	5	exit
31.0ms	288×	0	invalid

Compiler

Compiled 11 329 to 1 716 computations (84.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 7.5s

ival-cos: 1.4s (19% of total)

ival-mult: 1.3s (17.7% of total)

adjust: 1.3s (16.9% of total)

ival-div: 530.0ms (7.1% of total)

ival-add: 502.0ms (6.7% of total)

ival-sin: 352.0ms (4.7% of total)

ival-sub: 295.0ms (3.9% of total)

ival-tan: 250.0ms (3.3% of total)

ival-log: 241.0ms (3.2% of total)

const: 240.0ms (3.2% of total)

ival-sqrt: 204.0ms (2.7% of total)

ival-pow2: 133.0ms (1.8% of total)

ival-fmod: 125.0ms (1.7% of total)

ival-exp: 108.0ms (1.4% of total)

ival-pow: 98.0ms (1.3% of total)

ival-sinh: 97.0ms (1.3% of total)

ival-acos: 87.0ms (1.2% of total)

ival-neg: 61.0ms (0.8% of total)

ival-asin: 59.0ms (0.8% of total)

ival-pi: 34.0ms (0.5% of total)

ival-hypot: 24.0ms (0.3% of total)

exact: 18.0ms (0.2% of total)

ival-true: 14.0ms (0.2% of total)

ival-assert: 8.0ms (0.1% of total)

ival-atan: 1.0ms (0% of total)

ival->: 1.0ms (0% of total)

ival-then: 0.0ms (0% of total)

derivations11.1s (8.5%)

Memory

156.0MiB live, 7 272.4MiB allocated; 1.1s collecting garbage

Stop Event

178×	iter limit
65×	node limit
19×	unsound
12×	fuel
8×	done

Compiler

Compiled 3 498 to 911 computations (74% saved)

rewrite6.7s (5.2%)

Memory

96.7MiB live, 5 649.8MiB allocated; 752ms collecting garbage

Stop Event

215×	iter limit
43×	node limit
24×	unsound
5×	saturated

Counts

966 → 13 613

regimes4.5s (3.5%)

Memory

-64.7MiB live, 5 304.8MiB allocated; 549ms collecting garbage

Counts

2 770 → 160

Calls

53 calls:

556.0ms	x
407.0ms	a
363.0ms	b
279.0ms	r
217.0ms	(/.f64 (*.f64 r (sin.f64 b)) (cos.f64 (+.f64 a b)))

Compiler

Compiled 1 581 to 1 780 computations (-12.6% saved)

analyze4.4s (3.4%)

Memory

143.7MiB live, 3 789.8MiB allocated; 1.9s collecting garbage

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
28.8%	21.3%	52.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.2%	0%	6
71.1%	51.1%	20.8%	26.3%	0%	1.9%	0%	7
72.1%	51.6%	20%	26.3%	0%	2.1%	0%	8
74.4%	53%	18.2%	26.3%	0%	2.5%	0%	9
75.8%	53.9%	17.2%	26.3%	0%	2.6%	0%	10
76.6%	54.3%	16.6%	26.3%	0%	2.8%	0%	11
77.3%	54.8%	16.1%	26.3%	0%	2.9%	0%	12

Compiler

Compiled 279 to 216 computations (22.6% saved)

preprocess4.2s (3.2%)

Memory

74.2MiB live, 3 331.3MiB allocated; 591ms collecting garbage

Stop Event

38×	iter limit
29×	node limit
13×	saturated

Compiler

Compiled 8 555 to 2 920 computations (65.9% saved)

eval3.7s (2.9%)

Memory: -242.8MiB live, 3 942.9MiB allocated; 808ms collecting garbage
Compiler: Compiled 701 143 to 75 709 computations (89.2% saved)

explain2.9s (2.3%)

Memory

-36.3MiB live, 2 972.5MiB allocated; 484ms collecting garbage

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`sqrt.f64`	`#f`	oflow-rescue	558	0
`cos.f64`	`#f`	sensitivity	492	0
`-.f64`	`#f`	cancellation	339	2
`sqrt.f64`	`#f`	uflow-rescue	295	0
`/.f64`	`(/.f64 (-.f64 x lo) (-.f64 hi lo))`	n/o	256	0
↳	`(-.f64 hi lo)`	overflow	256
`acos.f64`	`(acos.f64 (-.f64 #s(literal 1 binary64) x))`	sensitivity	256	0
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	sensitivity	252	0
`tan.f64`	`(tan.f64 (+.f64 y z))`	sensitivity	192	0
`pow.f64`	`(pow.f64 l (exp.f64 w))`	sensitivity	127	14
`*.f64`	`#f`	*nu**	47	0
`*.f64`	`#f`	*no**	41	0
`*.f64`	`(.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (*.f64 x (pow.f64 s #s(literal 2 binary64))) x))`	*ou**	17	0
↳	`(pow.f64 c #s(literal 2 binary64))`	overflow	65
↳	`(.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)`	underflow	70
↳	`(*.f64 x (pow.f64 s #s(literal 2 binary64)))`	underflow	64
↳	`(pow.f64 s #s(literal 2 binary64))`	underflow	73
`-.f64`	`(-.f64 (.f64 a a) (.f64 b b))`	nan-rescue	14	0
↳	`(*.f64 a a)`	overflow	114
↳	`(*.f64 b b)`	overflow	14
`*.f64`	`(.f64 (pow.f64 c #s(literal 2 binary64)) (.f64 (*.f64 x (pow.f64 s #s(literal 2 binary64))) x))`	*uo**	13	0
↳	`(pow.f64 c #s(literal 2 binary64))`	underflow	57
↳	`(.f64 (.f64 x (pow.f64 s #s(literal 2 binary64))) x)`	overflow	59
↳	`(*.f64 x (pow.f64 s #s(literal 2 binary64)))`	overflow	53
↳	`(pow.f64 s #s(literal 2 binary64))`	overflow	60
`log.f64`	`(log.f64 (/.f64 (sinh.f64 x) x))`	oflow-rescue	4	0
↳	`(sinh.f64 x)`	overflow	4
↳	`(/.f64 (sinh.f64 x) x)`	overflow	4

Confusion

	Predicted +	Predicted -
+	2143	269
-	687	2021

Precision

0.757243816254417

Recall

0.8884742951907131

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	2143	2	267
-	687	14	2007

Precision?

0.7536893886156009

Recall?

0.8893034825870647

Freqs

test

number	freq
0	2290
1	2759
2	69
3	2

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	17	0	1
-	0	0	2

Precision?

1.0

Recall?

0.9444444444444444

Samples

551.0ms	110×	5	exit
452.0ms	2 434×	1	valid
430.0ms	6 652×	0	valid
332.0ms	1 044×	2	valid

Compiler

Compiled 1 067 to 440 computations (58.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.3s

ival-cos: 532.0ms (40% of total)

adjust: 149.0ms (11.2% of total)

ival-log: 94.0ms (7.1% of total)

ival-mult: 69.0ms (5.2% of total)

ival-tan: 68.0ms (5.1% of total)

ival-sqrt: 62.0ms (4.7% of total)

ival-sinh: 44.0ms (3.3% of total)

ival-exp: 43.0ms (3.2% of total)

ival-fmod: 42.0ms (3.2% of total)

ival-sub: 36.0ms (2.7% of total)

ival-sin: 36.0ms (2.7% of total)

ival-add: 34.0ms (2.6% of total)

ival-acos: 30.0ms (2.3% of total)

ival-div: 30.0ms (2.3% of total)

ival-pow2: 21.0ms (1.6% of total)

ival-true: 8.0ms (0.6% of total)

ival-pow: 8.0ms (0.6% of total)

ival-hypot: 8.0ms (0.6% of total)

ival-neg: 7.0ms (0.5% of total)

ival-assert: 4.0ms (0.3% of total)

ival-atan: 3.0ms (0.2% of total)

exact: 2.0ms (0.2% of total)

series2.3s (1.8%)

Memory

86.1MiB live, 2 795.7MiB allocated; 460ms collecting garbage

Counts

966 → 3 972

Calls

387 calls:

Time	Variable		Point	Expression
77.0ms	l	@	inf	((pow (sqrt (pow l (exp w))) 2) (* (exp (neg w)) (pow (sqrt (pow l (exp w))) 2)) (exp (neg w)) (neg w) (* (exp (neg w)) (pow l (exp w))) (+ (* (+ (* (log l) l) (neg l)) w) l) (+ (* (log l) l) (neg l)) (log l) (* (exp (neg w)) (pow l (exp w))) (pow l (exp w)) (- (* (+ (* -1/6 w) 1/2) w) 1) (* (exp (neg w)) (pow l (exp w))) (exp (neg w)) (+ (* (- (* (+ (* -1/6 w) 1/2) w) 1) w) 1) (exp (log l)) (* (exp (neg w)) (pow l (exp w))) (pow l (exp w)) (exp w) (exp w) (+ (* -1/6 w) 1/2) (* (+ (* -1/6 w) 1/2) w) (pow (exp (log l)) (exp w)) (pow l (exp w)))
75.0ms	b	@	0	((/ (* r (sin b)) (cos (+ a b))) (* r (sin b)) (sin b) (cos (+ a b)))
60.0ms	a	@	-inf	((+ (/ (tan y) (- 1 (* (tan z) (tan y)))) (- (/ (tan z) (- 1 (* (tan z) (tan y)))) (tan a))) (+ x (+ (/ (tan y) (- 1 (* (tan z) (tan y)))) (- (/ (tan z) (- 1 (* (tan z) (tan y)))) (tan a)))) (/ (tan y) (- 1 (* (tan z) (tan y)))) (tan y) (- (tan (+ z y)) (- (tan a) x)) (tan (+ z y)) (+ z y) (- (tan a) x) (+ x (- (tan (+ y z)) (tan a))) (- (tan (+ y z)) (tan a)) (- (/ (sin (+ z y)) (cos (+ z y))) a) (/ (sin (+ z y)) (cos (+ z y))) (+ x (/ (sin (- (+ z y) a)) (* (cos (+ z y)) (cos a)))) (/ (sin (- (+ z y) a)) (* (cos (+ z y)) (cos a))) (sin (- (+ z y) a)) (- (+ z y) a) (/ (- (pow (- (tan (+ z y)) (tan a)) 2) (* x x)) (- (tan (+ z y)) (+ (tan a) x))) (- (pow (- (tan (+ z y)) (tan a)) 2) (* x x)) (pow (- (tan (+ z y)) (tan a)) 2) (- (tan (+ z y)) (tan a)) (* (tan z) (tan y)) (- (/ (tan z) (- 1 (* (tan z) (tan y)))) (tan a)) (tan a) (sin (+ z y)) (cos (+ z y)) (* (cos (+ z y)) (cos a)))
41.0ms	w	@	-inf	((pow (sqrt (pow l (exp w))) 2) (* (exp (neg w)) (pow (sqrt (pow l (exp w))) 2)) (exp (neg w)) (neg w) (* (exp (neg w)) (pow l (exp w))) (+ (* (+ (* (log l) l) (neg l)) w) l) (+ (* (log l) l) (neg l)) (log l) (* (exp (neg w)) (pow l (exp w))) (pow l (exp w)) (- (* (+ (* -1/6 w) 1/2) w) 1) (* (exp (neg w)) (pow l (exp w))) (exp (neg w)) (+ (* (- (* (+ (* -1/6 w) 1/2) w) 1) w) 1) (exp (log l)) (* (exp (neg w)) (pow l (exp w))) (pow l (exp w)) (exp w) (exp w) (+ (* -1/6 w) 1/2) (* (+ (* -1/6 w) 1/2) w) (pow (exp (log l)) (exp w)) (pow l (exp w)))
39.0ms	l	@	inf	((* (exp (neg w)) (pow l (exp w))) (exp (neg w)) (neg w) (pow l (exp w)) (exp w))

prune2.1s (1.7%)

Memory: 110.5MiB live, 2 771.2MiB allocated; 290ms collecting garbage
Counts: 19 236 → 1 388
Compiler: Compiled 79 712 to 39 614 computations (50.3% saved)

bsearch625.0ms (0.5%)

Memory

-29.4MiB live, 633.3MiB allocated; 47ms collecting garbage

Algorithm

31×	binary-search
10×	left-value

Stop Event

30×	narrow-enough
1×	predicate-failed

Samples

185.0ms	845×	1	valid
121.0ms	101×	0	invalid
119.0ms	1 587×	0	valid
1.0ms	16×	0	exit

Compiler

Compiled 9 861 to 7 659 computations (22.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 337.0ms

ival-cos: 165.0ms (49% of total)

adjust: 46.0ms (13.7% of total)

ival-sin: 34.0ms (10.1% of total)

ival-mult: 23.0ms (6.8% of total)

ival-exp: 12.0ms (3.6% of total)

ival-pow2: 12.0ms (3.6% of total)

ival-add: 11.0ms (3.3% of total)

ival-div: 11.0ms (3.3% of total)

ival-fmod: 6.0ms (1.8% of total)

ival-sqrt: 5.0ms (1.5% of total)

ival-pow: 5.0ms (1.5% of total)

ival-true: 2.0ms (0.6% of total)

ival-neg: 2.0ms (0.6% of total)

ival-assert: 1.0ms (0.3% of total)

exact: 0.0ms (0% of total)

start1.0ms (0%)

Memory: 1.2MiB live, 1.2MiB allocated; 0ms collecting garbage

end0.0ms (0%)

Memory: 0.3MiB live, 0.3MiB allocated; 0ms collecting garbage

sample53.0s (40.8%)

simplify22.5s (17.3%)

localize11.7s (9%)

derivations11.1s (8.5%)

rewrite6.7s (5.2%)

regimes4.5s (3.5%)

analyze4.4s (3.4%)

preprocess4.2s (3.2%)

eval3.7s (2.9%)

explain2.9s (2.3%)

series2.3s (1.8%)

prune2.1s (1.7%)

bsearch625.0ms (0.5%)

start1.0ms (0%)

end0.0ms (0%)

Profiling