Metrics for Herbie run

Date:	Wednesday, October 2nd, 2024
Commit:	e7d6e0c5 on bhargav-log-space
Hostname:	nightly with Racket 8.10
Seed:	2024276
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample11.0min (65.8%)

Memory

26 893.7MiB live, 228 532.9MiB allocated

Samples

4.0min	287 914×	0	valid
2.4min	107 510×	1	valid
45.5s	23 053×	2	valid
34.7s	2 678×	3	valid
26.1s	14 532×	5	exit
5.2s	35 456×	0	exit
2.3s	21 088×	0	invalid
1.8s	11 508×	1	invalid
304.0ms	3 597×	1	exit
278.0ms	800×	2	invalid
186.0ms	24×	4	valid
7.0ms	3×	4	exit
3.0ms	1×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 7.1min

ival-mult: 1.5min (20.5% of total)

ival-pow2: 1.4min (19.2% of total)

ival-sub: 54.8s (12.9% of total)

ival-sin: 39.8s (9.4% of total)

ival-div: 25.4s (6% of total)

ival-add: 25.0s (5.9% of total)

adjust: 24.9s (5.9% of total)

ival-sinu: 22.8s (5.4% of total)

ival-pow: 21.2s (5% of total)

ival-cos: 12.1s (2.9% of total)

ival-cosu: 9.1s (2.1% of total)

ival-sqrt: 5.2s (1.2% of total)

ival-exp: 4.3s (1% of total)

ival-log: 3.0s (0.7% of total)

ival-neg: 1.4s (0.3% of total)

const: 1.3s (0.3% of total)

ival-<: 1.0s (0.2% of total)

ival-atan2: 616.0ms (0.1% of total)

ival-tan: 530.0ms (0.1% of total)

ival-hypot: 456.0ms (0.1% of total)

exact: 408.0ms (0.1% of total)

ival-and: 348.0ms (0.1% of total)

ival-acos: 346.0ms (0.1% of total)

ival-true: 323.0ms (0.1% of total)

ival-atan: 313.0ms (0.1% of total)

ival-assert: 238.0ms (0.1% of total)

ival-cbrt: 214.0ms (0.1% of total)

ival-asin: 133.0ms (0% of total)

ival-fabs: 118.0ms (0% of total)

ival-<=: 112.0ms (0% of total)

ival-log1p: 106.0ms (0% of total)

ival-pi: 94.0ms (0% of total)

ival-==: 1.0ms (0% of total)

ival-or: 0.0ms (0% of total)

Bogosity

analyze2.9min (17.1%)

Memory

3 031.2MiB live, 65 199.8MiB allocated

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
17.2%	13.7%	65.7%	20.6%	0%	0%	0%	1
25%	19.6%	58.5%	20.6%	0%	1.3%	0%	2
35.2%	26.6%	48.9%	20.6%	0%	3.8%	0%	3
42.3%	31.7%	43.1%	20.6%	0%	4.5%	0%	4
47.9%	35.6%	38.7%	20.6%	0%	5.1%	0%	5
51%	37.6%	36.1%	20.6%	0%	5.7%	0%	6
54.4%	39.7%	33.2%	20.6%	0%	6.5%	0%	7
56.2%	40.7%	31.8%	20.6%	0%	6.8%	0%	8
59%	42.5%	29.5%	20.6%	0%	7.4%	0%	9
60.3%	43.2%	28.4%	20.6%	0%	7.7%	0%	10
62.1%	44.3%	27%	20.6%	0%	8.1%	0%	11
63.6%	45.1%	25.8%	20.6%	0%	8.5%	0%	12

Compiler

Compiled 1 826 to 964 computations (47.2% saved)

preprocess40.0s (4%)

Memory

1 089.5MiB live, 6 597.4MiB allocated

Algorithm

24×	egg-herbie

Stop Event

48×	iter limit
37×	saturated
12×	node limit

Compiler

Compiled 11 314 to 4 023 computations (64.4% saved)

explain28.3s (2.8%)

Memory

1 547.0MiB live, 9 229.9MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`+.f64`	`#f`	cancellation	1661	30
`-.f64`	`#f`	cancellation	628	1
`log.f64`	`#f`	sensitivity	576	1
`sqrt.f64`	`#f`	oflow-rescue	415	0
`exp.f64`	`#f`	sensitivity	167	22
`cbrt.f64`	`(cbrt.f64 (/.f64 g (*.f64 #s(literal 2 binary64) a)))`	uflow-rescue	35	0
↳	`(/.f64 g (*.f64 #s(literal 2 binary64) a))`	underflow	35
`*.f64`	`#f`	*no**	24	0
`cbrt.f64`	`(cbrt.f64 (/.f64 g (*.f64 #s(literal 2 binary64) a)))`	oflow-rescue	24	0
↳	`(/.f64 g (*.f64 #s(literal 2 binary64) a))`	overflow	25
`*.f64`	`#f`	*nu**	21	0
`-.f64`	`(-.f64 (log.f64 (+.f64 #s(literal 1 binary64) (exp.f64 x))) (*.f64 x y))`	oflow-right	15	0
`sqrt.f64`	`#f`	uflow-rescue	10	0
`/.f64`	`#f`	o/o	8	0
`log.f64`	`#f`	oflow-rescue	8	0
`+.f64`	`(+.f64 (exp.f64 x) (exp.f64 (neg.f64 x)))`	oflow-right	1	0

Confusion

	Predicted +	Predicted -
+	3249	49
-	210	2892

Precision

0.9392888117953165

Recall

0.9851425106124925

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	3249	33	16
-	210	25	2867

Precision?

0.933181688939437

Recall?

0.9951485748938751

Freqs

test

number	freq
0	2941
1	3325
2	134

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	21	0	0
-	1	0	3

Precision?

0.9545454545454546

Recall?

1.0

Samples

17.2s	8 404×	0	valid
610.0ms	3 492×	1	valid
302.0ms	903×	2	valid
6.0ms	20×	3	valid

Compiler

Compiled 8 494 to 3 665 computations (56.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 17.7s

ival-mult: 7.5s (42.6% of total)

ival-sin: 4.7s (26.8% of total)

ival-cos: 4.6s (25.8% of total)

ival-exp: 160.0ms (0.9% of total)

ival-log: 156.0ms (0.9% of total)

ival-div: 117.0ms (0.7% of total)

adjust: 93.0ms (0.5% of total)

ival-add: 91.0ms (0.5% of total)

ival-sub: 75.0ms (0.4% of total)

ival-sqrt: 58.0ms (0.3% of total)

ival-neg: 29.0ms (0.2% of total)

ival-hypot: 21.0ms (0.1% of total)

ival-true: 14.0ms (0.1% of total)

exact: 9.0ms (0.1% of total)

ival-assert: 7.0ms (0% of total)

ival-log1p: 5.0ms (0% of total)

ival-cbrt: 3.0ms (0% of total)

ival-tan: 0.0ms (0% of total)

simplify23.9s (2.4%)

Memory

5 700.5MiB live, 7 912.5MiB allocated

Algorithm

204×	egg-herbie

Stop Event

270×	iter limit
132×	node limit
72×	saturated

Counts

30 972 → 30 710

soundness20.8s (2.1%)

Memory

403.9MiB live, 1 294.3MiB allocated

Stop Event

167×	iter limit
115×	node limit
19×	fuel
5×	done

Compiler

Compiled 12 595 to 6 471 computations (48.6% saved)

eval15.2s (1.5%)

Memory: 8 242.0MiB live, 11 605.1MiB allocated
Compiler: Compiled 3 158 874 to 284 515 computations (91% saved)

rewrite13.2s (1.3%)

Memory

4 198.6MiB live, 6 083.3MiB allocated

Stop Event

181×	iter limit
89×	node limit
1×	saturated

Counts

1 382 → 65 861

localize11.7s (1.2%)

Memory

3 448.7MiB live, 4 960.2MiB allocated

Samples

4.5s	6 945×	1	valid
3.0s	13 717×	0	valid
1.2s	1 739×	2	valid
157.0ms	144×	5	exit
73.0ms	345×	0	invalid
36.0ms	44×	3	valid
35.0ms	106×	0	exit

Compiler

Compiled 44 408 to 5 673 computations (87.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 6.8s

ival-mult: 1.8s (25.9% of total)

ival-div: 1.1s (16.4% of total)

ival-add: 834.0ms (12.3% of total)

adjust: 713.0ms (10.5% of total)

ival-pow: 462.0ms (6.8% of total)

ival-log: 405.0ms (6% of total)

const: 324.0ms (4.8% of total)

ival-sub: 289.0ms (4.2% of total)

ival-exp: 279.0ms (4.1% of total)

ival-sqrt: 216.0ms (3.2% of total)

ival-neg: 117.0ms (1.7% of total)

exact: 68.0ms (1% of total)

ival-expm1: 49.0ms (0.7% of total)

ival-hypot: 48.0ms (0.7% of total)

ival-cbrt: 31.0ms (0.5% of total)

ival-log1p: 27.0ms (0.4% of total)

ival-true: 26.0ms (0.4% of total)

ival-assert: 14.0ms (0.2% of total)

ival-cosh: 10.0ms (0.1% of total)

ival-pow2: 8.0ms (0.1% of total)

ival-sinh: 3.0ms (0% of total)

ival-tanh: 2.0ms (0% of total)

prune6.6s (0.7%)

Memory: 4 999.8MiB live, 6 877.7MiB allocated
Counts: 110 466 → 2 268
Compiler: Compiled 117 334 to 59 004 computations (49.7% saved)

regimes6.2s (0.6%)

Memory

2 313.4MiB live, 3 418.3MiB allocated

Counts

6 065 → 340

Calls

45 calls:

1.1s	b
911.0ms	a
653.0ms	c
617.0ms	(/.f64 (+.f64 (neg.f64 b) (sqrt.f64 (-.f64 (.f64 b b) (.f64 (.f64 #s(literal 3 binary64) a) c)))) (.f64 #s(literal 3 binary64) a))
384.0ms	(*.f64 #s(literal 3 binary64) a)

Compiler

Compiled 3 166 to 3 217 computations (-1.6% saved)

series4.8s (0.5%)

Memory

1 554.3MiB live, 2 830.8MiB allocated

Counts

1 382 → 30 972

Calls

483 calls:

Time	Variable		Point	Expression
93.0ms	a	@	-inf	((log (+ (exp a) (exp b))) (+ (/ b (+ (exp a) 1)) (log (+ 1 (exp a)))) (/ b (+ (exp a) 1)) (+ (exp a) 1) (log (+ (exp a) (exp b))) (log (+ 1 (exp a))) (exp a) (log (+ (exp a) (exp b))) (+ (exp a) (exp b)) (exp a) (exp b) (log (+ (exp a) (exp b))) (+ (exp a) (exp b)) (exp b) (log (/ 1 (+ (exp b) (exp a)))) (neg (log (/ 1 (+ (exp b) (exp a))))) (/ 1 (+ (exp b) (exp a))) (+ (exp b) (exp a)) (+ (* (+ (* 1/2 b) 1) b) 1))
42.0ms	a	@	inf	((exp (* (log (/ (+ (exp a) 1) b)) -1)) (* (log (/ (+ (exp a) 1) b)) -1) (log (+ (exp a) (exp b))) (+ (exp (* (log (/ (+ (exp a) 1) b)) -1)) (log (+ 1 (exp a)))) (log (+ (exp a) (exp b))) (+ (/ b (+ (exp a) 1)) (log (+ 1 (exp a)))) (+ (* 1/2 b) (log 2)) (* 1/2 b) (neg (log (/ 1 (+ (exp b) (exp a))))) (log (+ 1 (exp b))) (exp b) (+ b 1) (log (+ (exp a) (exp b))) (log (+ 1 (exp a))) (+ (* (+ (* 1/8 a) 1/2) a) (log 2)) (+ (* 1/8 a) 1/2) (log (+ (exp a) (exp b))) (+ (/ b (+ (exp a) 1)) (log (+ 1 (exp a)))) (/ b (+ (exp a) 1)) (+ (exp a) 1) (log (+ 1 (exp a))) (log 2) (exp a))
40.0ms	a	@	inf	((log (+ (exp a) (exp b))) (+ (/ b (+ (exp a) 1)) (log (+ 1 (exp a)))) (/ b (+ (exp a) 1)) (+ (exp a) 1) (log (+ (exp a) (exp b))) (log (+ 1 (exp a))) (exp a) (log (+ (exp a) (exp b))) (+ (exp a) (exp b)) (exp a) (exp b) (log (+ (exp a) (exp b))) (+ (exp a) (exp b)) (exp b) (log (/ 1 (+ (exp b) (exp a)))) (neg (log (/ 1 (+ (exp b) (exp a))))) (/ 1 (+ (exp b) (exp a))) (+ (exp b) (exp a)) (+ (* (+ (* 1/2 b) 1) b) 1))
40.0ms	b	@	-inf	((exp (* (log (/ (+ (exp a) 1) b)) -1)) (* (log (/ (+ (exp a) 1) b)) -1) (log (+ (exp a) (exp b))) (+ (exp (* (log (/ (+ (exp a) 1) b)) -1)) (log (+ 1 (exp a)))) (log (+ (exp a) (exp b))) (+ (/ b (+ (exp a) 1)) (log (+ 1 (exp a)))) (+ (* 1/2 b) (log 2)) (* 1/2 b) (neg (log (/ 1 (+ (exp b) (exp a))))) (log (+ 1 (exp b))) (exp b) (+ b 1) (log (+ (exp a) (exp b))) (log (+ 1 (exp a))) (+ (* (+ (* 1/8 a) 1/2) a) (log 2)) (+ (* 1/8 a) 1/2) (log (+ (exp a) (exp b))) (+ (/ b (+ (exp a) 1)) (log (+ 1 (exp a)))) (/ b (+ (exp a) 1)) (+ (exp a) 1) (log (+ 1 (exp a))) (log 2) (exp a))
39.0ms	a	@	-inf	((exp (* (log (/ (+ (exp a) 1) b)) -1)) (* (log (/ (+ (exp a) 1) b)) -1) (log (+ (exp a) (exp b))) (+ (exp (* (log (/ (+ (exp a) 1) b)) -1)) (log (+ 1 (exp a)))) (log (+ (exp a) (exp b))) (+ (/ b (+ (exp a) 1)) (log (+ 1 (exp a)))) (+ (* 1/2 b) (log 2)) (* 1/2 b) (neg (log (/ 1 (+ (exp b) (exp a))))) (log (+ 1 (exp b))) (exp b) (+ b 1) (log (+ (exp a) (exp b))) (log (+ 1 (exp a))) (+ (* (+ (* 1/8 a) 1/2) a) (log 2)) (+ (* 1/8 a) 1/2) (log (+ (exp a) (exp b))) (+ (/ b (+ (exp a) 1)) (log (+ 1 (exp a)))) (/ b (+ (exp a) 1)) (+ (exp a) 1) (log (+ 1 (exp a))) (log 2) (exp a))

bsearch715.0ms (0.1%)

Memory

234.4MiB live, 234.4MiB allocated

Algorithm

86×	binary-search
49×	left-value

Stop Event

80×	narrow-enough
6×	predicate-same

Samples

280.0ms	4 037×	0	valid
41.0ms	460×	0	invalid
13.0ms	84×	1	valid
8.0ms	39×	2	valid
4.0ms	75×	0	exit

Compiler

Compiled 14 620 to 13 837 computations (5.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 216.0ms

ival-mult: 53.0ms (24.5% of total)

ival-exp: 31.0ms (14.3% of total)

ival-div: 30.0ms (13.9% of total)

ival-add: 25.0ms (11.6% of total)

ival-sub: 16.0ms (7.4% of total)

ival-sqrt: 16.0ms (7.4% of total)

ival-neg: 12.0ms (5.5% of total)

ival-hypot: 10.0ms (4.6% of total)

ival-log: 6.0ms (2.8% of total)

ival-true: 5.0ms (2.3% of total)

exact: 4.0ms (1.8% of total)

adjust: 3.0ms (1.4% of total)

ival-assert: 3.0ms (1.4% of total)

ival-log1p: 2.0ms (0.9% of total)

start3.0ms (0%)

Memory: -35.5MiB live, 3.9MiB allocated

end0.0ms (0%)

Memory: 0.3MiB live, 0.3MiB allocated

sample11.0min (65.8%)

analyze2.9min (17.1%)

preprocess40.0s (4%)

explain28.3s (2.8%)

simplify23.9s (2.4%)

soundness20.8s (2.1%)

eval15.2s (1.5%)

rewrite13.2s (1.3%)

localize11.7s (1.2%)

prune6.6s (0.7%)

regimes6.2s (0.6%)

series4.8s (0.5%)

bsearch715.0ms (0.1%)

start3.0ms (0%)

end0.0ms (0%)

Profiling