Metrics for Herbie run

Date:	Saturday, August 3rd, 2024
Commit:	2.2 on release
Hostname:	nightly with Racket 8.11.1
Seed:	2024216
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.8min (33.8%)

Memory

183.1MiB live, 127 034.9MiB allocated

Samples

28.0s	41 383×	2	valid
21.7s	143 811×	0	invalid
18.5s	92 308×	1	valid
9.1s	4 922×	5	exit
9.1s	94 541×	0	valid
1.8s	2 928×	3	valid
462.0ms	2 236×	1	exit
322.0ms	4 074×	0	exit
9.0ms	8×	4	valid
8.0ms	5×	4	exit
5.0ms	3×	3	exit
4.0ms	2×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 1.2min

ival-tan: 13.0s (17.5% of total)

ival-pow: 8.9s (12% of total)

ival-mult: 5.5s (7.5% of total)

adjust: 5.4s (7.3% of total)

ival-cos: 5.0s (6.7% of total)

const: 4.8s (6.4% of total)

ival-sub: 4.0s (5.4% of total)

ival-div: 3.9s (5.2% of total)

ival-add: 3.5s (4.7% of total)

ival-log: 3.4s (4.6% of total)

ival-sin: 3.0s (4.1% of total)

ival-fabs: 2.1s (2.9% of total)

ival-<=: 2.1s (2.9% of total)

ival-exp: 1.9s (2.6% of total)

ival-expm1: 1.6s (2.1% of total)

ival-log1p: 1.3s (1.8% of total)

ival-sqrt: 1.3s (1.8% of total)

ival-<: 763.0ms (1% of total)

ival-and: 570.0ms (0.8% of total)

ival-fmin: 459.0ms (0.6% of total)

ival-atan: 397.0ms (0.5% of total)

exact: 327.0ms (0.4% of total)

ival-neg: 270.0ms (0.4% of total)

ival->: 249.0ms (0.3% of total)

ival-cbrt: 243.0ms (0.3% of total)

ival-assert: 140.0ms (0.2% of total)

ival-true: 68.0ms (0.1% of total)

Bogosity

simplify1.1min (21.4%)

Memory

51.3MiB live, 85 386.0MiB allocated

Algorithm

238×	egg-herbie

Rules

1 983 146×	`lower-fma.f32`
1 982 558×	`lower-fma.f64`
728 800×	`lower-*.f32`
727 812×	`lower-*.f64`
441 660×	`lower-+.f32`

Stop Event

315×	iter limit
159×	node limit
79×	saturated

Counts

24 072 → 23 633

rewrite37.8s (11.8%)

Memory

115.5MiB live, 48 180.2MiB allocated

Algorithm

105×	batch-egg-rewrite

Rules

508 958×	`lower-fma.f32`
508 366×	`lower-fma.f64`
408 388×	`lower-*.f32`
407 406×	`lower-*.f64`
370 562×	`lower-/.f32`

Stop Event

217×	iter limit
103×	node limit
1×	saturated
1×	unsound

Counts

1 452 → 72 394

soundness29.6s (9.2%)

Memory

185.1MiB live, 20 786.5MiB allocated

Rules

1 162 632×	`lower-fma.f32`
1 162 260×	`lower-fma.f64`
603 608×	`lower-*.f32`
603 000×	`lower-*.f64`
336 322×	`lower-/.f32`

Stop Event

213×	iter limit
137×	node limit
22×	fuel
6×	done
2×	saturated

Compiler

Compiled 10 611 to 5 552 computations (47.7% saved)

eval18.8s (5.9%)

Memory: 42.5MiB live, 27 696.1MiB allocated
Compiler: Compiled 3 459 726 to 282 731 computations (91.8% saved)

localize16.6s (5.2%)

Memory

-330.1MiB live, 19 911.6MiB allocated

Samples

4.2s	7 386×	1	valid
3.5s	3 731×	2	valid
3.0s	13 483×	0	valid
382.0ms	1 507×	0	invalid
271.0ms	617×	1	exit
237.0ms	150×	3	valid
66.0ms	6×	5	exit

Compiler

Compiled 20 552 to 2 886 computations (86% saved)

Precisions

Click to see histograms. Total time spent on operations: 8.9s

ival-mult: 1.6s (18.2% of total)

ival-div: 1.3s (14.1% of total)

adjust: 1.1s (12.6% of total)

ival-add: 1.1s (12.6% of total)

ival-cos: 551.0ms (6.2% of total)

const: 545.0ms (6.1% of total)

ival-log: 505.0ms (5.7% of total)

ival-sub: 420.0ms (4.7% of total)

ival-tan: 399.0ms (4.5% of total)

ival-pow: 247.0ms (2.8% of total)

ival-sqrt: 181.0ms (2% of total)

ival-sin: 177.0ms (2% of total)

ival-exp: 176.0ms (2% of total)

ival-log1p: 139.0ms (1.6% of total)

ival-neg: 101.0ms (1.1% of total)

ival-pow2: 79.0ms (0.9% of total)

ival-cbrt: 74.0ms (0.8% of total)

exact: 36.0ms (0.4% of total)

ival-cosh: 35.0ms (0.4% of total)

ival-expm1: 26.0ms (0.3% of total)

ival-atan2: 23.0ms (0.3% of total)

ival-true: 22.0ms (0.2% of total)

ival-atan: 12.0ms (0.1% of total)

ival-assert: 11.0ms (0.1% of total)

ival-fabs: 3.0ms (0% of total)

prune15.7s (4.9%)

Memory: -335.7MiB live, 27 074.4MiB allocated
Counts: 113 386 → 2 106
Compiler: Compiled 78 536 to 37 381 computations (52.4% saved)

explain5.9s (1.8%)

Memory

103.6MiB live, 7 126.8MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	4171	29
`log.f64`	`#f`	sensitivity	763	0
`/.f64`	`#f`	u/u	419	0
`sqrt.f64`	`#f`	oflow-rescue	356	0
`+.f64`	`#f`	cancellation	330	0
`/.f64`	`#f`	u/n	132	0
`pow.f64`	`(pow.f64 (+.f64 x #s(literal 1 binary64)) (/.f64 #s(literal 1 binary64) n))`	sensitivity	61	0
`sqrt.f64`	`#f`	uflow-rescue	28	0
`/.f64`	`(/.f64 (.f64 eps (-.f64 (exp.f64 (.f64 (+.f64 a b) eps)) #s(literal 1 binary64))) (.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))))`	n/u	19	0
↳	`(*.f64 b eps)`	underflow	136
↳	`(-.f64 (exp.f64 (*.f64 a eps)) #s(literal 1 binary64))`	underflow	146
↳	`(-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64))`	underflow	136
↳	`(.f64 (-.f64 (exp.f64 (.f64 a eps)) #s(literal 1 binary64)) (-.f64 (exp.f64 (*.f64 b eps)) #s(literal 1 binary64)))`	underflow	234
↳	`(*.f64 a eps)`	underflow	146
`-.f64`	`#f`	nan-rescue	12	0
`/.f64`	`(/.f64 (-.f64 #s(literal 1 binary64) (cos.f64 x)) (*.f64 x x))`	n/o	6	0
↳	`(*.f64 x x)`	overflow	58
`cos.f64`	`(cos.f64 (+.f64 x eps))`	sensitivity	2	1
`sin.f64`	`(sin.f64 (+.f64 x eps))`	sensitivity	2	0
`tan.f64`	`(tan.f64 (+.f64 x eps))`	sensitivity	2	0

Confusion

	Predicted +	Predicted -
+	5187	21
-	114	1846

Precision

0.978494623655914

Recall

0.9959677419354839

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	5187	8	13
-	114	20	1826

Precision?

0.9748545693375867

Recall?

0.9975038402457758

Freqs

test

number	freq
0	1867
1	4512
2	631
3	103
4	55

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	28	0	0
-	0	0	0

Precision?

1.0

Recall?

1.0

Samples

1.5s	2 704×	2	valid
1.1s	5 648×	1	valid
495.0ms	5 820×	0	valid
90.0ms	164×	3	valid

Compiler

Compiled 2 522 to 980 computations (61.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.5s

ival-tan: 565.0ms (22.3% of total)

ival-div: 317.0ms (12.5% of total)

adjust: 255.0ms (10% of total)

ival-log: 252.0ms (9.9% of total)

ival-sub: 191.0ms (7.5% of total)

ival-cos: 187.0ms (7.4% of total)

ival-exp: 143.0ms (5.6% of total)

ival-sin: 120.0ms (4.7% of total)

ival-add: 94.0ms (3.7% of total)

ival-mult: 83.0ms (3.3% of total)

ival-pow: 82.0ms (3.2% of total)

ival-sqrt: 70.0ms (2.8% of total)

ival-log1p: 57.0ms (2.2% of total)

ival-atan: 43.0ms (1.7% of total)

ival-expm1: 25.0ms (1% of total)

ival-cbrt: 16.0ms (0.6% of total)

ival-neg: 14.0ms (0.6% of total)

ival-true: 12.0ms (0.5% of total)

exact: 8.0ms (0.3% of total)

ival-assert: 6.0ms (0.2% of total)

series5.7s (1.8%)

Memory

-101.0MiB live, 7 168.1MiB allocated

Counts

1 452 → 24 072

Calls

4770 calls:

Time	Variable		Point	Expression
232.0ms	x	@	inf	(* 2/3 (log x))
93.0ms	n	@	0	(/ (neg (log (/ x (+ x 1)))) n)
77.0ms	n	@	inf	(/ (- (pow (log (+ 1 x)) 2) (pow (log x) 2)) n)
63.0ms	n	@	0	(/ (- (log (+ 1 x)) (log x)) n)
60.0ms	x	@	0	(+ 1/2 (* -1/2 (cos (+ x x))))

preprocess5.7s (1.8%)

Memory

127.2MiB live, 6 477.5MiB allocated

Algorithm

28×	egg-herbie

Rules

27 478×	`lower-fma.f64`
27 478×	`lower-fma.f32`
10 768×	`div-sub`
10 444×	`sub-neg`
9 190×	`lower-*.f32`

Stop Event

56×	iter limit
50×	saturated
6×	node limit

Compiler

Compiled 10 824 to 3 792 computations (65% saved)

regimes5.3s (1.6%)

Memory

10.2MiB live, 6 759.7MiB allocated

Counts

5 111 → 371

Calls

43 calls:

1.3s	x
507.0ms	eps
342.0ms	b
298.0ms	a
268.0ms	(-.f64 (cos.f64 (+.f64 x eps)) (cos.f64 x))

Compiler

Compiled 3 317 to 2 203 computations (33.6% saved)

analyze1.5s (0.5%)

Memory

46.2MiB live, 2 334.7MiB allocated

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
7.4%	4.5%	56.6%	38.9%	0%	0%	0%	1
22.3%	13.6%	47.5%	38.9%	0%	0%	0%	2
40.2%	23.5%	34.9%	38.9%	0%	2.7%	0%	3
53.4%	31.1%	27.2%	38.9%	0%	2.8%	0%	4
63%	36.3%	21.3%	38.9%	0%	3.6%	0%	5
65.9%	37.5%	19.4%	38.9%	0%	4.2%	0%	6
70.4%	38.8%	16.3%	38.9%	0%	6%	0%	7
73.6%	40.2%	14.4%	38.9%	0%	6.5%	0%	8
76.3%	40.9%	12.7%	38.9%	0%	7.5%	0%	9
78.4%	41.4%	11.4%	38.9%	0%	8.3%	0%	10
81.1%	42.4%	9.9%	38.9%	0%	8.8%	0%	11
82.3%	42.7%	9.2%	38.9%	0%	9.3%	0%	12

Compiler

Compiled 483 to 337 computations (30.2% saved)

bsearch1.2s (0.4%)

Memory

40.3MiB live, 1 266.0MiB allocated

Algorithm

86×	binary-search
41×	left-value

Stop Event

83×	narrow-enough
3×	predicate-same

Samples

393.0ms	4 110×	0	valid
162.0ms	617×	1	valid
84.0ms	302×	2	valid
59.0ms	828×	0	invalid
3.0ms	11×	3	valid
2.0ms	18×	0	exit

Compiler

Compiled 18 569 to 13 439 computations (27.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 536.0ms

ival-div: 118.0ms (22% of total)

ival-mult: 105.0ms (19.6% of total)

ival-add: 95.0ms (17.7% of total)

ival-pow: 46.0ms (8.6% of total)

ival-sub: 40.0ms (7.5% of total)

ival-sqrt: 40.0ms (7.5% of total)

ival-cos: 26.0ms (4.8% of total)

adjust: 23.0ms (4.3% of total)

ival-neg: 19.0ms (3.5% of total)

ival-expm1: 6.0ms (1.1% of total)

ival-true: 4.0ms (0.7% of total)

ival-cbrt: 3.0ms (0.6% of total)

ival-sin: 3.0ms (0.6% of total)

exact: 3.0ms (0.6% of total)

ival-exp: 2.0ms (0.4% of total)

ival-assert: 2.0ms (0.4% of total)

ival-log1p: 1.0ms (0.2% of total)

ival-log: 1.0ms (0.2% of total)

end0.0ms (0%)

Memory: 0.4MiB live, 0.3MiB allocated

sample1.8min (33.8%)

simplify1.1min (21.4%)

rewrite37.8s (11.8%)

soundness29.6s (9.2%)

eval18.8s (5.9%)

localize16.6s (5.2%)

prune15.7s (4.9%)

explain5.9s (1.8%)

series5.7s (1.8%)

preprocess5.7s (1.8%)

regimes5.3s (1.6%)

analyze1.5s (0.5%)

bsearch1.2s (0.4%)

end0.0ms (0%)

Profiling