Metrics for Herbie run

Date:	Monday, September 23rd, 2024
Commit:	675a8831 on bhargav-log-space
Hostname:	nightly with Racket 8.10
Seed:	2024267
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.3min (34.2%)

Memory

533.7MiB live, 95 543.4MiB allocated

Samples

33.3s	225 355×	0	valid
9.7s	65 298×	0	invalid
7.2s	22 974×	1	valid
3.7s	12 564×	1	invalid
3.5s	9 732×	2	valid
2.6s	6 130×	3	valid
367.0ms	1 793×	1	exit
149.0ms	514×	2	invalid
35.0ms	235×	0	exit
1.0ms	1×	5	exit
0.0ms	1×	4	valid
0.0ms	1×	3	exit

Precisions

Click to see histograms. Total time spent on operations: 45.0s

ival-mult: 11.8s (26.2% of total)

ival-div: 7.3s (16.3% of total)

ival-sub: 3.0s (6.6% of total)

ival-add: 2.8s (6.3% of total)

ival-pow2: 2.8s (6.3% of total)

ival-sqrt: 2.4s (5.2% of total)

ival-pow: 2.2s (4.8% of total)

ival-sin: 2.1s (4.6% of total)

adjust: 2.0s (4.5% of total)

ival-exp: 1.9s (4.2% of total)

ival-neg: 1.1s (2.5% of total)

ival-cos: 930.0ms (2.1% of total)

ival-tan: 889.0ms (2% of total)

ival-acos: 622.0ms (1.4% of total)

ival-log: 477.0ms (1.1% of total)

const: 448.0ms (1% of total)

ival-hypot: 443.0ms (1% of total)

ival-pi: 405.0ms (0.9% of total)

exact: 342.0ms (0.8% of total)

ival-true: 282.0ms (0.6% of total)

ival-asin: 205.0ms (0.5% of total)

ival-tanu: 176.0ms (0.4% of total)

ival-assert: 140.0ms (0.3% of total)

ival-fabs: 101.0ms (0.2% of total)

ival-atan: 91.0ms (0.2% of total)

ival-<: 57.0ms (0.1% of total)

ival-and: 12.0ms (0% of total)

Bogosity

simplify29.4s (12.5%)

Memory

683.4MiB live, 29 014.2MiB allocated

Algorithm

160×	egg-herbie

Rules

1 535 218×	`lower-fma.f32`
1 534 796×	`lower-fma.f64`
581 560×	`lower-*.f32`
580 574×	`lower-*.f64`
390 388×	`lower-+.f32`

Stop Event

213×	iter limit
119×	node limit
41×	saturated

Counts

30 464 → 30 267

soundness22.3s (9.5%)

Memory

192.4MiB live, 16 287.4MiB allocated

Rules

950 302×	`lower-fma.f32`
950 092×	`lower-fma.f64`
482 080×	`lower-*.f32`
481 512×	`lower-*.f64`
279 068×	`lower-+.f32`

Stop Event

135×	iter limit
93×	node limit
17×	fuel
1×	done

Compiler

Compiled 15 815 to 9 344 computations (40.9% saved)

eval17.9s (7.6%)

Memory: 257.1MiB live, 24 081.0MiB allocated
Compiler: Compiled 2 576 530 to 236 660 computations (90.8% saved)

rewrite17.7s (7.5%)

Memory

-290.9MiB live, 20 062.7MiB allocated

Rules

324 348×	`lower-*.f32`
323 366×	`lower-*.f64`
320 754×	`lower-fma.f32`
320 336×	`lower-fma.f64`
256 474×	`lower-/.f32`

Stop Event

143×	iter limit
71×	node limit

Counts

1 306 → 48 850

prune16.3s (6.9%)

Memory: -489.7MiB live, 22 705.7MiB allocated
Counts: 93 059 → 1 611
Compiler: Compiled 58 452 to 38 809 computations (33.6% saved)

localize12.4s (5.3%)

Memory

-237.0MiB live, 14 630.7MiB allocated

Samples

6.2s	14 837×	0	valid
1.8s	1 948×	1	valid
556.0ms	371×	2	valid
436.0ms	125×	5	exit
188.0ms	780×	0	invalid
99.0ms	51×	3	valid
23.0ms	64×	0	exit

Compiler

Compiled 22 098 to 2 742 computations (87.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 6.7s

ival-mult: 2.0s (29.6% of total)

ival-div: 1.2s (18.6% of total)

ival-add: 1.0s (15.3% of total)

ival-sqrt: 425.0ms (6.3% of total)

ival-sub: 328.0ms (4.9% of total)

ival-cos: 323.0ms (4.8% of total)

adjust: 293.0ms (4.4% of total)

ival-pow: 214.0ms (3.2% of total)

ival-exp: 199.0ms (3% of total)

ival-neg: 141.0ms (2.1% of total)

const: 106.0ms (1.6% of total)

ival-log: 100.0ms (1.5% of total)

ival-pow2: 60.0ms (0.9% of total)

ival-tan: 58.0ms (0.9% of total)

ival-sin: 46.0ms (0.7% of total)

exact: 36.0ms (0.5% of total)

ival-pi: 27.0ms (0.4% of total)

ival-tanu: 21.0ms (0.3% of total)

ival-tanh: 21.0ms (0.3% of total)

ival-true: 17.0ms (0.3% of total)

ival-sinh: 13.0ms (0.2% of total)

ival-assert: 8.0ms (0.1% of total)

ival-cbrt: 5.0ms (0.1% of total)

ival-hypot: 5.0ms (0.1% of total)

regimes9.6s (4.1%)

Memory

-59.6MiB live, 13 354.1MiB allocated

Counts

6 357 → 423

Calls

83 calls:

555.0ms	F
448.0ms	x
430.0ms	B
358.0ms	(*.f64 (PI.f64) l)
289.0ms	(+.f64 (/.f64 NdChar (+.f64 #s(literal 1 binary64) (exp.f64 (/.f64 (neg.f64 (-.f64 (-.f64 (-.f64 Ec Vef) EDonor) mu)) KbT)))) (/.f64 NaChar (+.f64 #s(literal 1 binary64) (exp.f64 (/.f64 (+.f64 (+.f64 (+.f64 Ev Vef) EAccept) (neg.f64 mu)) KbT)))))

Compiler

Compiled 5 641 to 5 773 computations (-2.3% saved)

analyze9.6s (4.1%)

Memory

-190.4MiB live, 12 131.7MiB allocated

Algorithm

32×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	98.2%	1.8%	0%	0%	0%	0
22.2%	21.8%	76.4%	1.8%	0%	0%	0%	1
22.6%	21.8%	74.8%	1.8%	0%	1.6%	0%	2
28.6%	26.5%	66.3%	1.8%	0%	5.5%	0%	3
32.6%	29.6%	61.2%	1.8%	0%	7.4%	0%	4
35.8%	32.3%	58%	1.8%	0%	8%	0%	5
40.1%	36.1%	54%	1.8%	0%	8.1%	0%	6
45.5%	40.6%	48.7%	1.8%	0%	8.9%	0%	7
47.9%	42.1%	45.8%	1.8%	0%	10.3%	0%	8
51%	44.7%	42.9%	1.8%	0%	10.6%	0%	9
52.2%	45.5%	41.7%	1.8%	0%	11%	0%	10
53.9%	46.8%	39.9%	1.8%	0%	11.5%	0%	11
55.7%	47.9%	38.2%	1.8%	0%	12.2%	0%	12

Compiler

Compiled 798 to 574 computations (28.1% saved)

series6.5s (2.7%)

Memory

16.1MiB live, 7 985.0MiB allocated

Counts

1 306 → 30 464

Calls

573 calls:

Time	Variable		Point	Expression
143.0ms	B	@	-inf	((/ 1 2) (* x (/ 1 (tan B))) (+ (neg (* x (/ 1 (tan B)))) (* (/ F (sin B)) (pow (+ (+ (* F F) 2) (* 2 x)) (neg (/ 1 2))))) (+ (+ (* F F) 2) (* 2 x)) (pow (+ (+ (* F F) 2) (* 2 x)) (neg (/ 1 2))) (* (/ F (sin B)) (pow (+ (+ (* F F) 2) (* 2 x)) (neg (/ 1 2)))) (/ 1 (tan B)))
113.0ms	l	@	inf	((/ (/ (tan (* l (PI))) F) F) (- (* (PI) l) (/ (/ (tan (* l (PI))) F) F)) (* (PI) l) (PI) (- (* (PI) l) (* (/ 1 (* F F)) (tan (* (PI) l)))) (+ (* (PI) l) (/ (tan (* l (PI))) (* (neg F) F))) (/ (tan (* l (PI))) (* (neg F) F)) (tan (* l (PI))) (/ 1 (/ F (/ (tan (* l (PI))) F))) (/ F (/ (tan (* l (PI))) F)) (- (* (PI) l) (/ 1 (/ F (/ (tan (* l (PI))) F)))) (cbrt (pow (PI) 3)) (* (/ 1 (* F F)) (tan (* (cbrt (pow (PI) 3)) l))) (- (* (PI) l) (* (/ 1 (* F F)) (tan (* (cbrt (pow (PI) 3)) l)))) (* l (PI)) (pow (PI) 3))
98.0ms	n	@	-inf	((* (/ 1 (sqrt k)) (pow (* (* 2 (PI)) n) (/ (- 1 k) 2))) (* (pow (* (* 2 n) (PI)) (+ (* k -1/2) 1/2)) (sqrt (/ 1 k))) (pow (* (* 2 n) (PI)) (+ (* k -1/2) 1/2)) (* (* 2 n) (PI)) (* (/ 1 (sqrt k)) (pow (* (* 2 (PI)) n) (/ (- 1 k) 2))) (* (sqrt 2) (sqrt (/ (* (PI) n) k))) (sqrt 2) (sqrt (/ (* (PI) n) k)) (* (/ 1 (sqrt k)) (pow (* (* 2 (PI)) n) (/ (- 1 k) 2))) (/ 1 (sqrt k)) (sqrt k) (pow (* (* 2 (PI)) n) (/ (- 1 k) 2)) (/ (* -2 (PI)) (/ -1 n)) (* (/ 1 (sqrt k)) (pow (* (* 2 (PI)) n) (/ (- 1 k) 2))) (* (pow n (+ (* 1/2 k) 1/2)) (/ (pow (* (PI) 2) (+ (* 1/2 k) 1/2)) (sqrt k))) (pow n (+ (* 1/2 k) 1/2)) (+ (* 1/2 k) 1/2) (/ (pow (* (PI) 2) (+ (* 1/2 k) 1/2)) (sqrt k)) (PI) (/ (* (PI) n) k) (/ (- 1 k) 2) (pow (/ (* -2 (PI)) (/ -1 n)) (+ (* k -1/2) 1/2)) (pow (* (PI) 2) (+ (* 1/2 k) 1/2)))
91.0ms	f	@	inf	((/ (+ (exp (* (/ (PI) 4) f)) (exp (neg (* (/ (PI) 4) f)))) (- (exp (* (/ (PI) 4) f)) (exp (neg (* (/ (PI) 4) f))))) (/ (PI) 4) (/ 1 (/ (PI) 4)) (neg (* (/ 1 (/ (PI) 4)) (log (/ (+ (exp (* (/ (PI) 4) f)) (exp (neg (* (/ (PI) 4) f)))) (- (exp (* (/ (PI) 4) f)) (exp (neg (* (/ (PI) 4) f)))))))) (- (exp (* (/ (PI) 4) f)) (exp (neg (* (/ (PI) 4) f)))) (* (/ 1 (/ (PI) 4)) (log (/ (+ (exp (* (/ (PI) 4) f)) (exp (neg (* (/ (PI) 4) f)))) (- (exp (* (/ (PI) 4) f)) (exp (neg (* (/ (PI) 4) f))))))) (* (/ (PI) 4) f))
75.0ms	f	@	-inf	((/ (log (tanh (* f (* 1/4 (PI))))) (* 1/4 (PI))) (log (tanh (* f (* 1/4 (PI))))) (tanh (* f (* 1/4 (PI)))) (* f (* 1/4 (PI))) (/ (PI) 4) (/ 1 (/ (PI) 4)) (neg (* (/ 1 (/ (PI) 4)) (log (/ (+ (exp (* (/ (PI) 4) f)) (exp (neg (* (/ (PI) 4) f)))) (- (exp (* (/ (PI) 4) f)) (exp (neg (* (/ (PI) 4) f)))))))) (* (/ 1 (/ (PI) 4)) (log (/ (+ (exp (* (/ (PI) 4) f)) (exp (neg (* (/ (PI) 4) f)))) (- (exp (* (/ (PI) 4) f)) (exp (neg (* (/ (PI) 4) f))))))) (/ 1 (/ (* 1/4 (PI)) (log (tanh (* f (* 1/4 (PI))))))) (/ (* 1/4 (PI)) (log (tanh (* f (* 1/4 (PI)))))) (* 1/4 (PI)) (PI) (pow (/ 4 (PI)) 1/2) (* (pow (/ 4 (PI)) 1/2) (* (pow (/ 4 (PI)) 1/2) (log (tanh (* f (* 1/4 (PI))))))) (/ 4 (PI)) (/ (* (log (tanh (* f (* 1/4 (PI))))) (/ -4 (PI))) (neg (pow (* (log (tanh (* f (* 1/4 (PI))))) (/ -4 (PI))) 2))) (/ 1 (/ (* (log (tanh (* f (* 1/4 (PI))))) (/ -4 (PI))) (neg (pow (* (log (tanh (* f (* 1/4 (PI))))) (/ -4 (PI))) 2)))) (* (log (tanh (* f (* 1/4 (PI))))) (/ -4 (PI))) (/ (+ (exp (* (/ (PI) 4) f)) (exp (neg (* (/ (PI) 4) f)))) (- (exp (* (/ (PI) 4) f)) (exp (neg (* (/ (PI) 4) f))))) (/ (/ 4 (PI)) f) (* (pow (/ 4 (PI)) 1/2) (log (tanh (* f (* 1/4 (PI)))))) (pow (* (log (tanh (* f (* 1/4 (PI))))) (/ -4 (PI))) 2))

preprocess6.1s (2.6%)

Memory

218.8MiB live, 6 146.4MiB allocated

Algorithm

18×	egg-herbie

Rules

126 326×	`lower-fma.f32`
126 326×	`lower-fma.f64`
29 876×	`lower-*.f32`
29 750×	`lower-*.f64`
21 036×	`lower-+.f32`

Stop Event

36×	iter limit
20×	node limit
16×	saturated

Compiler

Compiled 19 612 to 6 952 computations (64.6% saved)

explain4.8s (2.1%)

Memory

-181.8MiB live, 5 909.1MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	529	2
`+.f64`	`#f`	nan-rescue	464	0
`log.f64`	`(log.f64 (/.f64 (+.f64 (exp.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f)) (exp.f64 (neg.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f)))) (-.f64 (exp.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f)) (exp.f64 (neg.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f))))))`	oflow-rescue	235	0
↳	`(exp.f64 (*.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f))`	overflow	4
↳	`(-.f64 (exp.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f)) (exp.f64 (neg.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f))))`	overflow	2
↳	`(+.f64 (exp.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f)) (exp.f64 (neg.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f))))`	overflow	2
`pow.f64`	`(pow.f64 (.f64 (.f64 #s(literal 2 binary64) (PI.f64)) n) (/.f64 (-.f64 #s(literal 1 binary64) k) #s(literal 2 binary64)))`	sensitivity	223	24
`sqrt.f64`	`#f`	oflow-rescue	167	0
`cos.f64`	`(cos.f64 (/.f64 K #s(literal 2 binary64)))`	sensitivity	119	0
`tan.f64`	`(tan.f64 (*.f64 (PI.f64) l))`	sensitivity	105	0
`sqrt.f64`	`#f`	uflow-rescue	42	0
`/.f64`	`#f`	o/o	30	0
`*.f64`	`#f`	*no**	26	0
`/.f64`	`(/.f64 A (*.f64 V l))`	n/o	13	0
↳	`(*.f64 V l)`	overflow	31
`/.f64`	`(/.f64 A (*.f64 V l))`	n/u	7	0
↳	`(*.f64 V l)`	underflow	25
`exp.f64`	`#f`	sensitivity	3	0
`*.f64`	`(.f64 c0 (sqrt.f64 (/.f64 A (.f64 V l))))`	*nu**	1	0

Confusion

	Predicted +	Predicted -
+	746	124
-	835	2903

Precision

0.47185325743200507

Recall

0.8574712643678161

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	746	0	124
-	835	26	2877

Precision?

0.4642190416925949

Recall?

0.8574712643678161

Freqs

test

number	freq
0	3027
1	1226
2	327
3	28

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	10	0	2
-	2	0	4

Precision?

0.8333333333333334

Recall?

0.8333333333333334

Samples

1.4s	8 205×	0	valid
331.0ms	898×	1	valid
80.0ms	174×	2	valid
8.0ms	21×	3	valid

Compiler

Compiled 7 998 to 2 639 computations (67% saved)

Precisions

Click to see histograms. Total time spent on operations: 958.0ms

ival-mult: 227.0ms (23.7% of total)

ival-exp: 143.0ms (14.9% of total)

ival-add: 111.0ms (11.6% of total)

ival-div: 105.0ms (11% of total)

ival-sqrt: 68.0ms (7.1% of total)

ival-sub: 59.0ms (6.2% of total)

ival-cos: 36.0ms (3.8% of total)

ival-pow: 34.0ms (3.6% of total)

adjust: 32.0ms (3.3% of total)

ival-sin: 23.0ms (2.4% of total)

ival-neg: 22.0ms (2.3% of total)

ival-tan: 21.0ms (2.2% of total)

ival-pow2: 16.0ms (1.7% of total)

ival-pi: 13.0ms (1.4% of total)

ival-log: 12.0ms (1.3% of total)

exact: 11.0ms (1.1% of total)

ival-tanu: 10.0ms (1% of total)

ival-true: 9.0ms (0.9% of total)

ival-assert: 4.0ms (0.4% of total)

bsearch2.2s (1%)

Memory

8.6MiB live, 2 623.4MiB allocated

Algorithm

122×	binary-search
97×	left-value

Stop Event

118×	narrow-enough
4×	predicate-same

Samples

1.2s	8 429×	0	valid
63.0ms	680×	0	invalid
56.0ms	293×	1	valid
22.0ms	105×	1	invalid
10.0ms	30×	2	valid
2.0ms	9×	2	invalid

Compiler

Compiled 29 312 to 28 033 computations (4.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 998.0ms

ival-mult: 198.0ms (19.8% of total)

ival-div: 153.0ms (15.3% of total)

ival-add: 140.0ms (14% of total)

ival-tan: 111.0ms (11.1% of total)

ival-pow: 109.0ms (10.9% of total)

ival-sin: 77.0ms (7.7% of total)

ival-neg: 65.0ms (6.5% of total)

ival-sub: 48.0ms (4.8% of total)

ival-exp: 28.0ms (2.8% of total)

adjust: 18.0ms (1.8% of total)

ival-sqrt: 17.0ms (1.7% of total)

ival-pow2: 14.0ms (1.4% of total)

exact: 9.0ms (0.9% of total)

ival-true: 7.0ms (0.7% of total)

ival-assert: 4.0ms (0.4% of total)

ival-pi: 0.0ms (0% of total)

start1.0ms (0%)

Memory: 2.6MiB live, 2.6MiB allocated

end0.0ms (0%)

Memory: 0.5MiB live, 0.5MiB allocated

sample1.3min (34.2%)

simplify29.4s (12.5%)

soundness22.3s (9.5%)

eval17.9s (7.6%)

rewrite17.7s (7.5%)

prune16.3s (6.9%)

localize12.4s (5.3%)

regimes9.6s (4.1%)

analyze9.6s (4.1%)

series6.5s (2.7%)

preprocess6.1s (2.6%)

explain4.8s (2.1%)

bsearch2.2s (1%)

start1.0ms (0%)

end0.0ms (0%)

Profiling