Metrics for Herbie run

Date:	Thursday, July 25th, 2024
Commit:	3139208f on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024207
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

simplify1.7min (22.2%)

Memory

687.4MiB live, 137 520.0MiB allocated

Algorithm

288×	egg-herbie

Rules

2 527 676×	`lower-fma.f32`
2 527 032×	`lower-fma.f64`
1 274 294×	`lower-*.f32`
1 271 810×	`lower-*.f64`
670 512×	`lower-+.f32`

Stop Event

384×	iter limit
224×	node limit
64×	saturated

Counts

56 520 → 56 084

sample1.4min (18.2%)

Memory

281.0MiB live, 106 421.5MiB allocated

Samples

32.4s	221 687×	0	valid
11.2s	26 535×	1	valid
10.0s	65 115×	0	invalid
3.9s	9 664×	2	valid
3.1s	12 565×	1	invalid
2.4s	6 166×	3	valid
333.0ms	1 891×	1	exit
218.0ms	584×	2	invalid
98.0ms	140×	4	valid
34.0ms	234×	0	exit
27.0ms	41×	5	exit
1.0ms	3×	4	exit

Precisions

Click to see histograms. Total time spent on operations: 49.2s

ival-mult: 12.0s (24.5% of total)

ival-div: 8.7s (17.7% of total)

ival-tan: 4.2s (8.5% of total)

ival-sub: 3.2s (6.6% of total)

ival-sqrt: 2.7s (5.5% of total)

ival-pow2: 2.7s (5.4% of total)

ival-add: 2.5s (5.2% of total)

ival-pow: 2.3s (4.6% of total)

ival-sin: 1.9s (3.8% of total)

adjust: 1.8s (3.7% of total)

ival-exp: 1.8s (3.6% of total)

ival-cos: 850.0ms (1.7% of total)

ival-neg: 737.0ms (1.5% of total)

ival-acos: 700.0ms (1.4% of total)

ival-pi: 582.0ms (1.2% of total)

ival-hypot: 472.0ms (1% of total)

const: 417.0ms (0.8% of total)

exact: 390.0ms (0.8% of total)

ival-log: 311.0ms (0.6% of total)

ival-true: 254.0ms (0.5% of total)

ival-asin: 228.0ms (0.5% of total)

ival-assert: 135.0ms (0.3% of total)

ival-fabs: 116.0ms (0.2% of total)

ival-atan: 110.0ms (0.2% of total)

ival-<: 43.0ms (0.1% of total)

ival-and: 10.0ms (0% of total)

Bogosity

rewrite49.7s (10.9%)

Memory

112.6MiB live, 69 257.7MiB allocated

Algorithm

128×	batch-egg-rewrite

Rules

586 256×	`lower-*.f32`
583 834×	`lower-*.f64`
569 856×	`lower-fma.f32`
569 224×	`lower-fma.f64`
458 768×	`lower-/.f32`

Stop Event

264×	iter limit
128×	node limit

Counts

2 271 → 107 696

soundness45.8s (10%)

Memory

356.1MiB live, 37 858.5MiB allocated

Rules

1 611 200×	`lower-fma.f32`
1 610 806×	`lower-fma.f64`
1 075 920×	`lower-*.f32`
1 074 044×	`lower-*.f64`
515 090×	`lower-+.f32`

Stop Event

296×	iter limit
193×	node limit
30×	fuel
2×	done

Compiler

Compiled 43 925 to 21 473 computations (51.1% saved)

eval35.2s (7.7%)

Memory: 1 153.5MiB live, 52 590.6MiB allocated
Compiler: Compiled 7 007 649 to 492 993 computations (93% saved)

prune31.9s (7%)

Memory: -1 392.7MiB live, 52 137.3MiB allocated
Counts: 194 987 → 3 651
Compiler: Compiled 201 849 to 96 359 computations (52.3% saved)

localize29.2s (6.4%)

Memory

-255.8MiB live, 39 838.2MiB allocated

Samples

7.2s	21 562×	0	valid
4.1s	2 465×	2	valid
3.2s	3 616×	1	valid
1.7s	805×	3	valid
1.3s	3 415×	0	invalid
1.0s	292×	5	exit
155.0ms	65×	4	valid
133.0ms	438×	0	exit
43.0ms	70×	1	invalid
16.0ms	35×	2	exit
11.0ms	5×	4	exit

Compiler

Compiled 39 519 to 4 812 computations (87.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 14.6s

ival-mult: 4.0s (27.4% of total)

ival-div: 1.9s (13.3% of total)

ival-add: 1.5s (10.4% of total)

ival-cos: 1.4s (9.9% of total)

adjust: 902.0ms (6.2% of total)

ival-tan: 882.0ms (6% of total)

ival-sqrt: 762.0ms (5.2% of total)

ival-sin: 465.0ms (3.2% of total)

ival-sub: 445.0ms (3% of total)

ival-pow: 366.0ms (2.5% of total)

ival-log: 356.0ms (2.4% of total)

ival-asin: 285.0ms (2% of total)

const: 262.0ms (1.8% of total)

ival-pow2: 210.0ms (1.4% of total)

ival-exp: 181.0ms (1.2% of total)

ival-neg: 147.0ms (1% of total)

ival-acos: 122.0ms (0.8% of total)

exact: 80.0ms (0.5% of total)

ival-pi: 41.0ms (0.3% of total)

ival-atan: 30.0ms (0.2% of total)

ival-true: 29.0ms (0.2% of total)

ival-log1p: 28.0ms (0.2% of total)

ival-sinh: 23.0ms (0.2% of total)

ival-hypot: 21.0ms (0.1% of total)

ival-cosh: 17.0ms (0.1% of total)

ival-assert: 14.0ms (0.1% of total)

ival-tanh: 11.0ms (0.1% of total)

ival-fabs: 7.0ms (0% of total)

ival-cbrt: 3.0ms (0% of total)

regimes26.8s (5.9%)

Memory

64.4MiB live, 42 512.8MiB allocated

Counts

17 349 → 956

Calls

156 calls:

1.5s	l
877.0ms	F
803.0ms	t
719.0ms	B
690.0ms	k

Compiler

Compiled 20 167 to 13 915 computations (31% saved)

preprocess15.7s (3.4%)

Memory

-383.5MiB live, 18 596.1MiB allocated

Algorithm

32×	egg-herbie

Rules

229 844×	`lower-fma.f64`
229 844×	`lower-fma.f32`
79 498×	`lower-*.f32`
79 270×	`lower-*.f64`
36 848×	`lower-/.f32`

Stop Event

64×	iter limit
41×	node limit
23×	saturated

Compiler

Compiled 49 574 to 14 942 computations (69.9% saved)

bsearch10.3s (2.3%)

Memory

-33.4MiB live, 15 354.2MiB allocated

Algorithm

275×	left-value
263×	binary-search

Stop Event

252×	narrow-enough
11×	predicate-same

Samples

5.1s	29 909×	0	valid
1.6s	9 295×	0	invalid
221.0ms	891×	1	valid
145.0ms	238×	2	valid
34.0ms	175×	1	invalid
19.0ms	48×	3	valid
4.0ms	13×	2	invalid
1.0ms	2×	4	valid

Compiler

Compiled 82 119 to 57 696 computations (29.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 5.5s

ival-mult: 1.4s (24.9% of total)

ival-div: 1.1s (19.7% of total)

ival-pow: 823.0ms (14.9% of total)

ival-add: 424.0ms (7.7% of total)

ival-sin: 424.0ms (7.7% of total)

ival-tan: 348.0ms (6.3% of total)

ival-sub: 269.0ms (4.9% of total)

ival-pow2: 252.0ms (4.5% of total)

ival-sqrt: 120.0ms (2.2% of total)

ival-neg: 108.0ms (1.9% of total)

ival-exp: 60.0ms (1.1% of total)

ival-cos: 48.0ms (0.9% of total)

adjust: 46.0ms (0.8% of total)

const: 46.0ms (0.8% of total)

exact: 40.0ms (0.7% of total)

ival-true: 30.0ms (0.5% of total)

ival-assert: 16.0ms (0.3% of total)

ival-atan: 9.0ms (0.2% of total)

ival-fabs: 6.0ms (0.1% of total)

ival-pi: 1.0ms (0% of total)

explain9.6s (2.1%)

Memory

-112.1MiB live, 14 295.5MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`-.f64`	`#f`	cancellation	461	2
`sqrt.f64`	`#f`	oflow-rescue	451	0
`cos.f64`	`#f`	sensitivity	378	2
`acos.f64`	`(acos.f64 (/.f64 (-.f64 #s(literal 1 binary64) (.f64 #s(literal 5 binary64) (.f64 v v))) (-.f64 (*.f64 v v) #s(literal 1 binary64))))`	sensitivity	255	0
`*.f64`	`#f`	*no**	243	0
`+.f64`	`#f`	nan-rescue	217	0
`sqrt.f64`	`#f`	uflow-rescue	150	0
`pow.f64`	`#f`	oflow-rescue	137	0
`asin.f64`	`(asin.f64 (sqrt.f64 (/.f64 (-.f64 #s(literal 1 binary64) (pow.f64 (/.f64 Om Omc) #s(literal 2 binary64))) (+.f64 #s(literal 1 binary64) (*.f64 #s(literal 2 binary64) (pow.f64 (/.f64 t l) #s(literal 2 binary64)))))))`	sensitivity	131	1
`tan.f64`	`(tan.f64 (*.f64 (PI.f64) l))`	sensitivity	126	0
`*.f64`	`#f`	*uo**	107	0
`-.f64`	`#f`	nan-rescue	104	0
`pow.f64`	`(pow.f64 (.f64 (.f64 #s(literal 2 binary64) (PI.f64)) n) (/.f64 (-.f64 #s(literal 1 binary64) k) #s(literal 2 binary64)))`	sensitivity	82	37
`/.f64`	`#f`	o/o	79	0
`*.f64`	`#f`	*nu**	64	0
`/.f64`	`#f`	u/u	61	0
`cos.f64`	`(cos.f64 (-.f64 (/.f64 (*.f64 K (+.f64 m n)) #s(literal 2 binary64)) M))`	oflow-rescue	60	0
↳	`(/.f64 (*.f64 K (+.f64 m n)) #s(literal 2 binary64))`	overflow	60
↳	`(-.f64 (/.f64 (*.f64 K (+.f64 m n)) #s(literal 2 binary64)) M)`	overflow	60
↳	`(*.f64 K (+.f64 m n))`	overflow	60
`/.f64`	`#f`	o/n	57	0
`*.f64`	`#f`	*ou**	56	0
`pow.f64`	`#f`	uflow-rescue	54	0
`+.f64`	`#f`	cancellation	38	0
`/.f64`	`#f`	n/o	37	0
`/.f64`	`#f`	n/u	34	0
`/.f64`	`#f`	u/n	11	0
`log.f64`	`(log.f64 (/.f64 (+.f64 (exp.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f)) (exp.f64 (neg.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f)))) (-.f64 (exp.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f)) (exp.f64 (neg.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f))))))`	sensitivity	5	1
`exp.f64`	`#f`	sensitivity	4	5
`tan.f64`	`(tan.f64 (*.f64 (PI.f64) l))`	oflow-rescue	1	0
↳	`(*.f64 (PI.f64) l)`	overflow	1

Confusion

	Predicted +	Predicted -
+	1899	33
-	1104	5156

Precision

0.6323676323676324

Recall

0.9829192546583851

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	1899	0	33
-	1104	43	5113

Precision?

0.6234405778069599

Recall?

0.9829192546583851

Freqs

test

number	freq
0	5189
1	2647
2	319
3	31
4	5
5	1

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	25	0	0
-	1	0	6

Precision?

0.9615384615384616

Recall?

1.0

Samples

2.1s	13 178×	0	valid
783.0ms	2 030×	1	valid
624.0ms	764×	2	valid
182.0ms	396×	3	valid
5.0ms	10×	5	exit
5.0ms	6×	4	valid

Compiler

Compiled 8 430 to 2 164 computations (74.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.7s

ival-tan: 466.0ms (17.5% of total)

ival-mult: 464.0ms (17.4% of total)

adjust: 341.0ms (12.8% of total)

ival-div: 279.0ms (10.5% of total)

ival-sub: 151.0ms (5.7% of total)

ival-sin: 145.0ms (5.4% of total)

ival-sqrt: 136.0ms (5.1% of total)

ival-add: 130.0ms (4.9% of total)

ival-pow2: 126.0ms (4.7% of total)

ival-exp: 106.0ms (4% of total)

ival-pow: 76.0ms (2.8% of total)

ival-cos: 59.0ms (2.2% of total)

ival-acos: 34.0ms (1.3% of total)

ival-neg: 27.0ms (1% of total)

ival-hypot: 23.0ms (0.9% of total)

exact: 22.0ms (0.8% of total)

ival-true: 16.0ms (0.6% of total)

ival-pi: 14.0ms (0.5% of total)

ival-asin: 11.0ms (0.4% of total)

ival-log: 11.0ms (0.4% of total)

ival-fabs: 10.0ms (0.4% of total)

const: 9.0ms (0.3% of total)

ival-assert: 7.0ms (0.3% of total)

ival-atan: 5.0ms (0.2% of total)

analyze9.2s (2%)

Memory

-101.7MiB live, 11 964.7MiB allocated

Algorithm

32×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	98.2%	1.8%	0%	0%	0%	0
22.2%	21.8%	76.4%	1.8%	0%	0%	0%	1
22.6%	21.8%	74.8%	1.8%	0%	1.6%	0%	2
28.6%	26.5%	66.3%	1.8%	0%	5.5%	0%	3
32.6%	29.6%	61.2%	1.8%	0%	7.4%	0%	4
35.8%	32.3%	58%	1.8%	0%	8%	0%	5
40.1%	36.1%	54%	1.8%	0%	8.1%	0%	6
45.5%	40.6%	48.7%	1.8%	0%	8.9%	0%	7
47.9%	42.1%	45.8%	1.8%	0%	10.3%	0%	8
51%	44.7%	42.9%	1.8%	0%	10.6%	0%	9
52.2%	45.5%	41.7%	1.8%	0%	11%	0%	10
53.9%	46.8%	39.9%	1.8%	0%	11.5%	0%	11
55.7%	47.9%	38.2%	1.8%	0%	12.2%	0%	12

Compiler

Compiled 793 to 574 computations (27.6% saved)

series8.4s (1.8%)

Memory

244.8MiB live, 12 170.1MiB allocated

Counts

2 271 → 56 520

Calls

12246 calls:

Time	Variable		Point	Expression
180.0ms	f	@	inf	(neg (* (/ 1 (/ (PI) 4)) (log (/ 1/2 (* (/ 1 (* 2 (cosh (* (* (PI) 1/4) f)))) (sinh (* (* (PI) 1/4) f)))))))
177.0ms	f	@	inf	(neg (* (/ 1 (/ (PI) 4)) (+ (log 2) (- (log (cosh (* (* (PI) 1/4) f))) (log (* 2 (sinh (* (* (PI) 1/4) f))))))))
103.0ms	l	@	0	(* l (sqrt (sqrt (PI))))
84.0ms	t	@	0	(pow (* (/ (pow t 3/4) l) (pow t 3/8)) 2)
78.0ms	f	@	-inf	(* (pow (* (PI) 1/4) -1/2) (* (pow (* (PI) 1/4) -1/2) (log (tanh (* (* (PI) 1/4) f)))))

end0.0ms (0%)

Memory: 0.6MiB live, 0.6MiB allocated

simplify1.7min (22.2%)

sample1.4min (18.2%)

rewrite49.7s (10.9%)

soundness45.8s (10%)

eval35.2s (7.7%)

prune31.9s (7%)

localize29.2s (6.4%)

regimes26.8s (5.9%)

preprocess15.7s (3.4%)

bsearch10.3s (2.3%)

explain9.6s (2.1%)

analyze9.2s (2%)

series8.4s (1.8%)

end0.0ms (0%)

Profiling