Metrics for Herbie run

Date:	Sunday, July 14th, 2024
Commit:	2fc85eec on zane-odyssey-timeline
Hostname:	nightly with Racket 8.11.1
Seed:	2024196
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample3.3min (59.5%)

Memory

1 094.6MiB live, 219 528.1MiB allocated

Samples

57.5s	127 189×	1	valid
35.6s	273 805×	0	valid
26.9s	14 380×	5	exit
17.6s	23 800×	2	valid
8.1s	4 443×	3	valid
5.6s	34 942×	0	exit
4.2s	10 798×	1	exit
3.1s	20 046×	0	invalid
2.5s	11 746×	1	invalid
816.0ms	39×	4	exit
413.0ms	22×	3	exit
328.0ms	816×	2	invalid
243.0ms	75×	4	valid
23.0ms	12×	2	exit

Precisions

Click to see histograms. Total time spent on operations: 2.3min

ival-pow: 22.0s (15.7% of total)

ival-mult: 18.7s (13.4% of total)

ival-cos: 17.2s (12.3% of total)

ival-sin: 16.3s (11.7% of total)

ival-div: 12.2s (8.7% of total)

ival-pow2: 9.4s (6.7% of total)

adjust: 6.6s (4.7% of total)

ival-add: 6.5s (4.7% of total)

ival-sub: 6.5s (4.6% of total)

ival-exp: 5.1s (3.6% of total)

ival-log: 4.2s (3% of total)

ival-sqrt: 4.0s (2.8% of total)

ival-neg: 2.1s (1.5% of total)

const: 1.6s (1.2% of total)

ival-<: 1.3s (0.9% of total)

ival-tan: 1.1s (0.8% of total)

ival-atan2: 757.0ms (0.5% of total)

ival-hypot: 600.0ms (0.4% of total)

ival-pi: 557.0ms (0.4% of total)

exact: 521.0ms (0.4% of total)

ival-acos: 389.0ms (0.3% of total)

ival-atan: 363.0ms (0.3% of total)

ival-and: 343.0ms (0.2% of total)

ival-cbrt: 316.0ms (0.2% of total)

ival-true: 315.0ms (0.2% of total)

ival-assert: 216.0ms (0.2% of total)

ival-<=: 195.0ms (0.1% of total)

ival-asin: 177.0ms (0.1% of total)

ival-fabs: 151.0ms (0.1% of total)

ival-log1p: 119.0ms (0.1% of total)

ival-==: 1.0ms (0% of total)

ival-or: 0.0ms (0% of total)

Bogosity

simplify31.0s (9.4%)

Memory

-68.4MiB live, 36 510.5MiB allocated

Algorithm

125×	egg-herbie

Rules

890 586×	`accelerator-lowering-fma.f32`
890 586×	`accelerator-lowering-fma.f64`
260 314×	`-lowering-.f32`
260 314×	`-lowering-.f64`
142 406×	`+-lowering-+.f32`

Stop Event

112×	iter limit
67×	node limit
58×	saturated

Counts

11 028 → 11 028

rewrite22.3s (6.8%)

Memory

535.6MiB live, 27 493.7MiB allocated

Algorithm

54×	batch-egg-rewrite

Rules

264 584×	`accelerator-lowering-fma.f32`
264 584×	`accelerator-lowering-fma.f64`
201 616×	`-lowering-.f32`
201 616×	`-lowering-.f64`
173 366×	`/-lowering-/.f64`

Stop Event

56×	iter limit
53×	node limit
1×	saturated

Counts

581 → 57 267

analyze16.9s (5.1%)

Memory

-42.8MiB live, 19 528.6MiB allocated

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
17.2%	13.7%	65.7%	20.6%	0%	0%	0%	1
25%	19.6%	58.5%	20.6%	0%	1.3%	0%	2
35.2%	26.6%	48.9%	20.6%	0%	3.8%	0%	3
42.3%	31.7%	43.1%	20.6%	0%	4.5%	0%	4
47.9%	35.6%	38.7%	20.6%	0%	5.1%	0%	5
51%	37.6%	36.1%	20.6%	0%	5.7%	0%	6
54.4%	39.7%	33.2%	20.6%	0%	6.5%	0%	7
56.2%	40.7%	31.8%	20.6%	0%	6.8%	0%	8
59%	42.5%	29.5%	20.6%	0%	7.4%	0%	9
60.3%	43.2%	28.4%	20.6%	0%	7.7%	0%	10
62.1%	44.3%	27%	20.6%	0%	8.1%	0%	11
63.6%	45.1%	25.8%	20.6%	0%	8.5%	0%	12

Compiler

Compiled 1 826 to 990 computations (45.8% saved)

preprocess15.3s (4.6%)

Memory

-267.1MiB live, 14 051.5MiB allocated

Algorithm

104×	egg-herbie

Rules

237 718×	`accelerator-lowering-fma.f32`
237 718×	`accelerator-lowering-fma.f64`
81 446×	`-lowering-.f32`
81 446×	`-lowering-.f64`
46 320×	`unsub-neg`

Stop Event

60×	saturated
52×	iter limit
44×	node limit

Compiler

Compiled 4 548 to 1 716 computations (62.3% saved)

soundness13.9s (4.2%)

Memory

136.0MiB live, 8 186.6MiB allocated

Rules

509 806×	`accelerator-lowering-fma.f32`
509 806×	`accelerator-lowering-fma.f64`
226 226×	`-lowering-.f32`
226 226×	`-lowering-.f64`
156 380×	`/-lowering-/.f64`

Stop Event

59×	iter limit
58×	node limit
8×	fuel
5×	done
1×	saturated

Compiler

Compiled 4 312 to 2 239 computations (48.1% saved)

eval12.8s (3.9%)

Memory: 424.3MiB live, 16 655.2MiB allocated
Compiler: Compiled 2 095 715 to 147 480 computations (93% saved)

prune10.8s (3.3%)

Memory: -436.3MiB live, 15 365.4MiB allocated
Counts: 80 449 → 935
Compiler: Compiled 30 817 to 15 349 computations (50.2% saved)

localize3.7s (1.1%)

Memory

-114.1MiB live, 4 611.0MiB allocated

Samples

2.2s	13 418×	0	valid
57.0ms	512×	0	invalid

Compiler

Compiled 7 700 to 1 286 computations (83.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.6s

ival-mult: 519.0ms (33% of total)

ival-div: 323.0ms (20.5% of total)

ival-add: 171.0ms (10.9% of total)

ival-sin: 132.0ms (8.4% of total)

ival-sub: 68.0ms (4.3% of total)

const: 50.0ms (3.2% of total)

ival-log: 47.0ms (3% of total)

ival-cos: 39.0ms (2.5% of total)

ival-pow: 39.0ms (2.5% of total)

ival-sqrt: 28.0ms (1.8% of total)

ival-cbrt: 25.0ms (1.6% of total)

ival-exp: 22.0ms (1.4% of total)

ival-neg: 18.0ms (1.1% of total)

ival-fabs: 17.0ms (1.1% of total)

exact: 17.0ms (1.1% of total)

ival-tan: 15.0ms (1% of total)

ival-true: 12.0ms (0.8% of total)

ival-copysign: 9.0ms (0.6% of total)

ival-assert: 6.0ms (0.4% of total)

ival-log1p: 5.0ms (0.3% of total)

ival-cosh: 4.0ms (0.3% of total)

ival-asin: 4.0ms (0.3% of total)

ival-acos: 2.0ms (0.1% of total)

ival-atan2: 2.0ms (0.1% of total)

ival-pow2: 2.0ms (0.1% of total)

ival-pi: 1.0ms (0.1% of total)

explain2.4s (0.7%)

Memory

-67.0MiB live, 2 920.2MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`exp.f64`	`(exp.f64 (+.f64 (log.f64 a) (log.f64 b)))`	sensitivity	157	21
`sqrt.f64`	`(sqrt.f64 (-.f64 (*.f64 x x) #s(literal 1 binary64)))`	oflow-rescue	125	0
↳	`(-.f64 (*.f64 x x) #s(literal 1 binary64))`	overflow	125
↳	`(*.f64 x x)`	overflow	125
`log.f64`	`(log.f64 (+.f64 #s(literal 1 binary64) (exp.f64 x)))`	sensitivity	81	0
`/.f64`	`#f`	u/u	53	0
`*.f64`	`#f`	*nu**	45	0
`cbrt.f64`	`(cbrt.f64 (/.f64 g (*.f64 #s(literal 2 binary64) a)))`	oflow-rescue	33	0
↳	`(/.f64 g (*.f64 #s(literal 2 binary64) a))`	overflow	33
`cbrt.f64`	`(cbrt.f64 (/.f64 g (*.f64 #s(literal 2 binary64) a)))`	uflow-rescue	24	0
↳	`(/.f64 g (*.f64 #s(literal 2 binary64) a))`	underflow	24
`/.f64`	`(/.f64 (.f64 a1 a2) (.f64 b1 b2))`	n/o	13	0
↳	`(*.f64 b1 b2)`	overflow	33
`/.f64`	`(/.f64 (.f64 a1 a2) (.f64 b1 b2))`	n/u	10	0
↳	`(*.f64 b1 b2)`	underflow	30
`/.f64`	`(/.f64 (.f64 a1 a2) (.f64 b1 b2))`	o/n	7	0
↳	`(*.f64 a1 a2)`	overflow	27
`/.f64`	`(/.f64 (.f64 a1 a2) (.f64 b1 b2))`	u/n	7	0
↳	`(*.f64 a1 a2)`	underflow	24
`/.f64`	`#f`	o/o	4	0
`asin.f64`	`(asin.f64 (+.f64 (.f64 (sin.f64 phi1) (cos.f64 delta)) (.f64 (*.f64 (cos.f64 phi1) (sin.f64 delta)) (cos.f64 theta))))`	sensitivity	3	0
`+.f64`	`(+.f64 (log.f64 a) (log.f64 b))`	cancellation	3	1
`log.f64`	`(log.f64 (+.f64 #s(literal 1 binary64) (exp.f64 x)))`	oflow-rescue	1	0
↳	`(exp.f64 x)`	overflow	1
↳	`(+.f64 #s(literal 1 binary64) (exp.f64 x))`	overflow	1

Confusion

	Predicted +	Predicted -
+	469	27
-	97	3759

Precision

0.8286219081272085

Recall

0.9455645161290323

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	469	19	8
-	97	5	3754

Precision?

0.8271186440677966

Recall?

0.9838709677419355

Freqs

test

number	freq
0	3786
1	566

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	8	0	0
-	1	0	8

Precision?

0.8888888888888888

Recall?

1.0

Samples

852.0ms

8 752×

valid

Compiler

Compiled 10 429 to 1 358 computations (87% saved)

Precisions

Click to see histograms. Total time spent on operations: 468.0ms

ival-mult: 93.0ms (19.9% of total)

ival-div: 60.0ms (12.8% of total)

ival-cos: 54.0ms (11.5% of total)

ival-sin: 54.0ms (11.5% of total)

ival-exp: 34.0ms (7.3% of total)

ival-add: 32.0ms (6.8% of total)

ival-sub: 28.0ms (6% of total)

ival-log: 23.0ms (4.9% of total)

ival-tan: 21.0ms (4.5% of total)

ival-neg: 12.0ms (2.6% of total)

ival-sqrt: 11.0ms (2.4% of total)

ival-asin: 8.0ms (1.7% of total)

ival-true: 8.0ms (1.7% of total)

ival-acos: 5.0ms (1.1% of total)

ival-log1p: 5.0ms (1.1% of total)

ival-assert: 4.0ms (0.9% of total)

ival-atan2: 4.0ms (0.9% of total)

exact: 4.0ms (0.9% of total)

ival-cbrt: 3.0ms (0.6% of total)

ival-pi: 2.0ms (0.4% of total)

ival-fabs: 2.0ms (0.4% of total)

ival-pow2: 1.0ms (0.2% of total)

ival-atan: 0.0ms (0% of total)

ival-pow: 0.0ms (0% of total)

regimes2.3s (0.7%)

Memory

34.9MiB live, 3 823.2MiB allocated

Counts

2 230 → 153

Calls

41 calls:

360.0ms	x
174.0ms	a
143.0ms	(-.f64 (log.f64 (+.f64 #s(literal 1 binary64) (exp.f64 x))) (*.f64 x y))
138.0ms	b
133.0ms	m

Compiler

Compiled 1 891 to 1 233 computations (34.8% saved)

series1.1s (0.3%)

Memory

181.2MiB live, 1 296.6MiB allocated

Counts

581 → 11 028

Calls

2382 calls:

Time	Variable		Point	Expression
92.0ms	v	@	0	(/ (* e (sin v)) (+ 1 (* e (cos v))))
47.0ms	a	@	0	(exp (+ (log a) (log b)))
34.0ms	x	@	0	(log (+ x x))
30.0ms	x	@	-inf	(log (* x 1/2))
29.0ms	x	@	inf	(log (+ 1 (exp x)))

bsearch726.0ms (0.2%)

Memory

-42.8MiB live, 483.1MiB allocated

Algorithm

35×	binary-search
24×	left-value

Stop Event

29×	narrow-enough
6×	predicate-same

Samples

225.0ms

3 360×

valid

Compiler

Compiled 5 980 to 3 948 computations (34% saved)

Precisions

Click to see histograms. Total time spent on operations: 153.0ms

ival-exp: 89.0ms (58.3% of total)

ival-div: 19.0ms (12.5% of total)

ival-mult: 15.0ms (9.8% of total)

ival-sub: 10.0ms (6.6% of total)

ival-add: 9.0ms (5.9% of total)

ival-log1p: 4.0ms (2.6% of total)

ival-neg: 3.0ms (2% of total)

ival-true: 2.0ms (1.3% of total)

ival-assert: 1.0ms (0.7% of total)

exact: 1.0ms (0.7% of total)

end0.0ms (0%)

Memory: 1.0MiB live, 1.0MiB allocated

sample3.3min (59.5%)

simplify31.0s (9.4%)

rewrite22.3s (6.8%)

analyze16.9s (5.1%)

preprocess15.3s (4.6%)

soundness13.9s (4.2%)

eval12.8s (3.9%)

prune10.8s (3.3%)

localize3.7s (1.1%)

explain2.4s (0.7%)

regimes2.3s (0.7%)

series1.1s (0.3%)

bsearch726.0ms (0.2%)

end0.0ms (0%)

Profiling