Metrics for Herbie run

Date:	Saturday, June 29th, 2024
Commit:	903258ad on fix-regimes-can-split
Hostname:	nightly with Racket 8.11.1
Seed:	2024181
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.5min (20.2%)

Memory

581.4MiB live, 105 626.0MiB allocated

Samples

35.6s	221 108×	0	valid
13.1s	35 011×	1	valid
9.6s	56 939×	0	invalid
3.4s	11 395×	1	invalid
2.8s	4 489×	2	valid
1.3s	2 696×	3	valid
659.0ms	882×	4	valid
298.0ms	877×	2	invalid
23.0ms	177×	0	exit
4.0ms	6×	5	valid
1.0ms	2×	5	exit

Precisions

Click to see histograms. Total time spent on operations: 52.0s

ival-mult: 14.6s (28% of total)

ival-div: 7.4s (14.1% of total)

ival-tan: 4.6s (8.8% of total)

ival-add: 3.8s (7.2% of total)

ival-sub: 3.3s (6.3% of total)

ival-sqrt: 2.8s (5.4% of total)

ival-pow2: 2.8s (5.3% of total)

ival-exp: 2.5s (4.8% of total)

ival-sin: 2.1s (4% of total)

ival-pow: 2.0s (3.8% of total)

adjust: 1.3s (2.4% of total)

ival-neg: 924.0ms (1.8% of total)

ival-cos: 907.0ms (1.7% of total)

...in/eval/compile.rkt:111:19: 483.0ms (0.9% of total)

ival-pi: 420.0ms (0.8% of total)

ival-acos: 388.0ms (0.7% of total)

ival-<: 340.0ms (0.7% of total)

ival-log: 312.0ms (0.6% of total)

...in/eval/compile.rkt:110:19: 285.0ms (0.5% of total)

ival-hypot: 270.0ms (0.5% of total)

ival-true: 251.0ms (0.5% of total)

ival-asin: 185.0ms (0.4% of total)

ival-atan: 132.0ms (0.3% of total)

ival-assert: 125.0ms (0.2% of total)

ival-fabs: 93.0ms (0.2% of total)

ival-and: 10.0ms (0% of total)

Bogosity

simplify1.4min (19%)

Memory

508.5MiB live, 96 393.4MiB allocated

Algorithm

286×	egg-herbie

Rules

111 292×	`fma-define`
65 806×	`times-frac`
61 714×	`fmm-def`
61 051×	`*-commutative`
61 037×	`distribute-lft-in`

Stop Event

216×	node limit
70×	saturated

Counts

94 526 → 78 197

soundness1.1min (14.8%)

Memory

42.9MiB live, 63 209.1MiB allocated

Rules

53 749×	`fma-define`
46 508×	`log1p-expm1-u`
41 908×	`times-frac`
37 488×	`*-commutative`
33 705×	`associate-r`

Stop Event

184×	node limit
30×	fuel
7×	saturated
2×	done
1×	unsound

Compiler

Compiled 50 204 to 15 094 computations (69.9% saved)

rewrite34.7s (8%)

Memory

-608.8MiB live, 32 995.6MiB allocated

Algorithm

127×	batch-egg-rewrite

Rules

75 952×	`log1p-expm1-u`
50 068×	`expm1-log1p-u`
33 221×	`add-exp-log`
33 055×	`add-log-exp`
32 680×	`pow1`

Stop Event

126×	node limit
1×	unsound

Counts

1 873 → 49 244

localize33.5s (7.8%)

Memory

-240.5MiB live, 42 718.1MiB allocated

Samples

7.9s	273×	5	exit
7.6s	22 841×	0	valid
2.6s	3 749×	1	valid
2.2s	4 191×	0	invalid
1.5s	234×	3	valid
1.0s	654×	2	valid
407.0ms	144×	1	invalid
196.0ms	81×	4	valid
140.0ms	325×	0	exit
51.0ms	20×	2	invalid

Compiler

Compiled 35 383 to 4 351 computations (87.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 18.8s

ival-tan: 8.2s (43.4% of total)

ival-mult: 3.2s (16.9% of total)

ival-div: 1.9s (10.2% of total)

ival-pow: 677.0ms (3.6% of total)

ival-add: 646.0ms (3.4% of total)

ival-pow2: 606.0ms (3.2% of total)

ival-sub: 606.0ms (3.2% of total)

ival-sqrt: 561.0ms (3% of total)

ival-hypot: 355.0ms (1.9% of total)

adjust: 326.0ms (1.7% of total)

ival-cos: 303.0ms (1.6% of total)

...in/eval/compile.rkt:111:19: 276.0ms (1.5% of total)

ival-sin: 225.0ms (1.2% of total)

ival-exp: 141.0ms (0.8% of total)

ival-log: 134.0ms (0.7% of total)

ival-cbrt: 117.0ms (0.6% of total)

ival-acos: 111.0ms (0.6% of total)

ival-log1p: 84.0ms (0.4% of total)

ival-asin: 73.0ms (0.4% of total)

ival-expm1: 63.0ms (0.3% of total)

ival-neg: 55.0ms (0.3% of total)

...in/eval/compile.rkt:110:19: 45.0ms (0.2% of total)

ival-pi: 40.0ms (0.2% of total)

ival-atan: 30.0ms (0.2% of total)

ival-true: 30.0ms (0.2% of total)

ival-fabs: 23.0ms (0.1% of total)

ival-assert: 13.0ms (0.1% of total)

prune28.1s (6.5%)

Memory: -843.1MiB live, 43 257.0MiB allocated
Counts: 112 863 → 3 331
Compiler: Compiled 146 787 to 82 847 computations (43.6% saved)

eval23.2s (5.4%)

Memory: 753.1MiB live, 32 262.9MiB allocated
Compiler: Compiled 3 511 784 to 470 776 computations (86.6% saved)

regimes18.8s (4.4%)

Memory

75.2MiB live, 27 308.1MiB allocated

Counts

12 154 → 807

Calls

156 calls:

1.9s	l
1.1s	t
804.0ms	k
580.0ms	d
546.0ms	x

Compiler

Compiled 8 649 to 6 359 computations (26.5% saved)

series15.4s (3.6%)

Memory

399.2MiB live, 23 423.4MiB allocated

Counts

1 873 → 45 282

Calls

12312 calls:

Time	Variable		Point	Expression
209.0ms	n	@	0	(* (log (* 2 (/ (PI) (/ k n)))) 1/2)
176.0ms	v	@	inf	(acos (/ (- 1 (* 5 (* v v))) (* (+ v 1) (+ v -1))))
147.0ms	th	@	0	(* (/ (cos th) (sqrt 2)) (+ (* a1 a1) (* a2 a2)))
136.0ms	w	@	0	(* c0 (/ (+ (* c0 (* d (/ d (* D (* w (* h D)))))) (sqrt (* (+ (* c0 (* d (/ d (* D (* w (* h D)))))) M) (- (* c0 (* d (/ d (* D (* w (* h D)))))) M)))) (pow (* (cbrt w) (cbrt 2)) 3)))
133.0ms	c0	@	-inf	(sqrt (* (+ (* c0 (* d (/ d (* D (* w (* h D)))))) M) (+ (* (/ c0 (* w (* h D))) (/ (* d d) D)) (neg M))))

bsearch15.0s (3.5%)

Memory

-198.7MiB live, 17 050.2MiB allocated

Algorithm

343×	binary-search
102×	left-value

Stop Event

326×	narrow-enough
15×	predicate-same
2×	predicate-failed

Samples

7.3s	37 641×	0	valid
1.9s	8 480×	0	invalid
593.0ms	2 346×	1	valid
258.0ms	761×	2	valid
253.0ms	148×	3	valid
146.0ms	178×	1	invalid
138.0ms	202×	5	exit
15.0ms	59×	2	invalid

Compiler

Compiled 89 659 to 66 760 computations (25.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 7.9s

ival-mult: 2.0s (25.6% of total)

ival-div: 2.0s (24.8% of total)

ival-pow: 680.0ms (8.6% of total)

ival-tan: 556.0ms (7.1% of total)

ival-add: 445.0ms (5.7% of total)

ival-sin: 423.0ms (5.4% of total)

ival-sub: 390.0ms (5% of total)

ival-pow2: 360.0ms (4.6% of total)

adjust: 210.0ms (2.7% of total)

ival-exp: 170.0ms (2.2% of total)

ival-sqrt: 165.0ms (2.1% of total)

ival-neg: 163.0ms (2.1% of total)

ival-cos: 121.0ms (1.5% of total)

ival-log: 50.0ms (0.6% of total)

ival-true: 38.0ms (0.5% of total)

...in/eval/compile.rkt:110:19: 31.0ms (0.4% of total)

...in/eval/compile.rkt:111:19: 29.0ms (0.4% of total)

ival-assert: 19.0ms (0.2% of total)

ival-hypot: 18.0ms (0.2% of total)

ival-pi: 14.0ms (0.2% of total)

ival-atan: 11.0ms (0.1% of total)

ival-asin: 10.0ms (0.1% of total)

ival-fabs: 7.0ms (0.1% of total)

explain10.5s (2.4%)

Memory

61.0MiB live, 15 292.8MiB allocated

Explanations

Click to see full explanations table

Operator	Subexpression	Explanation	Count
`sqrt.f64`	`#f`	oflow-rescue	477	0
`-.f64`	`#f`	cancellation	464	1
`cos.f64`	`#f`	sensitivity	414	0
`*.f64`	`#f`	*no**	258	0
`acos.f64`	`(acos.f64 (/.f64 (-.f64 #s(literal 1 binary64) (.f64 #s(literal 5 binary64) (.f64 v v))) (-.f64 (*.f64 v v) #s(literal 1 binary64))))`	sensitivity	253	1
`+.f64`	`#f`	nan-rescue	243	0
`sqrt.f64`	`#f`	uflow-rescue	162	0
`pow.f64`	`#f`	oflow-rescue	140	0
`tan.f64`	`(tan.f64 (*.f64 (PI.f64) l))`	sensitivity	130	0
`asin.f64`	`(asin.f64 (sqrt.f64 (/.f64 (-.f64 #s(literal 1 binary64) (pow.f64 (/.f64 Om Omc) #s(literal 2 binary64))) (+.f64 #s(literal 1 binary64) (*.f64 #s(literal 2 binary64) (pow.f64 (/.f64 t l) #s(literal 2 binary64)))))))`	sensitivity	126	0
`*.f64`	`#f`	*uo**	109	0
`-.f64`	`#f`	nan-rescue	100	0
`/.f64`	`#f`	o/o	77	0
`pow.f64`	`#f`	uflow-rescue	70	0
`pow.f64`	`(pow.f64 (.f64 (.f64 #s(literal 2 binary64) (PI.f64)) n) (/.f64 (-.f64 #s(literal 1 binary64) k) #s(literal 2 binary64)))`	sensitivity	66	21
`*.f64`	`#f`	*nu**	59	0
`*.f64`	`#f`	*ou**	56	0
`cos.f64`	`(cos.f64 (-.f64 (/.f64 (*.f64 K (+.f64 m n)) #s(literal 2 binary64)) M))`	oflow-rescue	51	0
↳	`(/.f64 (*.f64 K (+.f64 m n)) #s(literal 2 binary64))`	overflow	51
↳	`(-.f64 (/.f64 (*.f64 K (+.f64 m n)) #s(literal 2 binary64)) M)`	overflow	51
↳	`(*.f64 K (+.f64 m n))`	overflow	51
`/.f64`	`#f`	o/n	51	0
`/.f64`	`#f`	u/u	48	0
`+.f64`	`#f`	cancellation	46	0
`/.f64`	`#f`	n/o	39	0
`/.f64`	`#f`	n/u	36	0
`/.f64`	`#f`	u/n	20	0
`log.f64`	`(log.f64 (/.f64 (+.f64 (exp.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f)) (exp.f64 (neg.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f)))) (-.f64 (exp.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f)) (exp.f64 (neg.f64 (.f64 (/.f64 (PI.f64) #s(literal 4 binary64)) f))))))`	sensitivity	6	0

Confusion

	Predicted +	Predicted -
+	1948	37
-	1128	5079

Precision

0.6332899869960988

Recall

0.981360201511335

Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	1948	1	36
-	1128	23	5056

Precision?

0.6287096774193548

Recall?

0.9818639798488665

Freqs

test

number	freq
0	5116
1	2697
2	338
3	36
4	5

Total Confusion?

	Predicted +	Predicted Maybe	Predicted -
+	25	0	0
-	0	0	7

Precision?

1.0

Recall?

1.0

Samples

2.2s	13 104×	0	valid
940.0ms	2 668×	1	valid
260.0ms	364×	2	valid
130.0ms	186×	3	valid
48.0ms	52×	4	valid
6.0ms	10×	5	exit

Compiler

Compiled 8 430 to 2 164 computations (74.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.5s

ival-mult: 546.0ms (21.7% of total)

ival-tan: 381.0ms (15.2% of total)

ival-div: 371.0ms (14.8% of total)

ival-sub: 131.0ms (5.2% of total)

adjust: 128.0ms (5.1% of total)

ival-add: 122.0ms (4.9% of total)

ival-sqrt: 121.0ms (4.8% of total)

ival-pow: 117.0ms (4.7% of total)

ival-exp: 106.0ms (4.2% of total)

ival-pow2: 103.0ms (4.1% of total)

ival-sin: 102.0ms (4.1% of total)

ival-log: 77.0ms (3.1% of total)

ival-cos: 69.0ms (2.7% of total)

ival-neg: 26.0ms (1% of total)

ival-hypot: 17.0ms (0.7% of total)

ival-true: 16.0ms (0.6% of total)

ival-pi: 15.0ms (0.6% of total)

...in/eval/compile.rkt:110:19: 14.0ms (0.6% of total)

ival-acos: 14.0ms (0.6% of total)

ival-asin: 10.0ms (0.4% of total)

...in/eval/compile.rkt:111:19: 9.0ms (0.4% of total)

ival-assert: 7.0ms (0.3% of total)

ival-atan: 6.0ms (0.2% of total)

ival-fabs: 4.0ms (0.2% of total)

analyze9.7s (2.3%)

Memory

95.8MiB live, 12 264.6MiB allocated

Algorithm

32×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	98.2%	1.8%	0%	0%	0%	0
22.2%	21.8%	76.4%	1.8%	0%	0%	0%	1
22.6%	21.8%	74.8%	1.8%	0%	1.6%	0%	2
28.8%	26.5%	65.5%	1.8%	0%	6.2%	0%	3
33.1%	29.6%	60%	1.8%	0%	8.6%	0%	4
36.2%	32.3%	56.8%	1.8%	0%	9.2%	0%	5
40.6%	36.1%	52.9%	1.8%	0%	9.3%	0%	6
45.8%	40.6%	48.1%	1.8%	0%	9.5%	0%	7
48.3%	42.1%	45%	1.8%	0%	11.1%	0%	8
51.5%	44.7%	42%	1.8%	0%	11.6%	0%	9
52.7%	45.5%	40.8%	1.8%	0%	11.9%	0%	10
54.5%	46.8%	39%	1.8%	0%	12.5%	0%	11
56.2%	47.9%	37.4%	1.8%	0%	12.9%	0%	12

Compiler

Compiled 793 to 574 computations (27.6% saved)

preprocess9.3s (2.2%)

Memory

-37.8MiB live, 9 485.0MiB allocated

Algorithm

32×	egg-herbie

Rules

20 054×	`fma-define`
13 409×	`fmm-def`
8 518×	`times-frac`
7 224×	`distribute-lft-in`
7 153×	`unsub-neg`

Stop Event

23×	node limit
9×	saturated

Compiler

Compiled 48 800 to 18 252 computations (62.6% saved)

end0.0ms (0%)

Memory: 0.4MiB live, 0.4MiB allocated

sample1.5min (20.2%)

simplify1.4min (19%)

soundness1.1min (14.8%)

rewrite34.7s (8%)

localize33.5s (7.8%)

prune28.1s (6.5%)

eval23.2s (5.4%)

regimes18.8s (4.4%)

series15.4s (3.6%)

bsearch15.0s (3.5%)

explain10.5s (2.4%)

analyze9.7s (2.3%)

preprocess9.3s (2.2%)

end0.0ms (0%)

Profiling