Metrics for Herbie run

Date:	Saturday, May 18th, 2024
Commit:	c2f4097e on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024139
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

simplify16.7s (20.9%)

Algorithm

72×	egg-herbie

Rules

27376×	`fma-neg`
25113×	`fma-define`
14434×	`distribute-lft-in`
12430×	`times-frac`
11510×	`distribute-rgt-in`

Stop Event

27×	saturated
45×	node limit

Counts

15286 → 14141

sample13.5s (16.9%)

Results

8.5s	70183×	0	valid
1.6s	4116×	2	valid
505.0ms	1994×	0	invalid
1.0ms	5×	1	valid

Precisions

Click to see histograms. Total time spent on operations: 7.1s

ival-mult: 2.0s (28.6% of total)

ival-div: 1.4s (19.2% of total)

ival-sub: 1.1s (15.1% of total)

ival-sqrt: 691.0ms (9.7% of total)

ival-neg: 513.0ms (7.2% of total)

ival-add: 435.0ms (6.1% of total)

ival-fabs: 225.0ms (3.2% of total)

ival-if: 186.0ms (2.6% of total)

backward-pass: 162.0ms (2.3% of total)

ival->=: 126.0ms (1.8% of total)

const: 116.0ms (1.6% of total)

ival-log: 108.0ms (1.5% of total)

ival-exp: 69.0ms (1% of total)

Bogosity

soundness10.0s (12.6%)

Rules

11004×	`fma-define`
9903×	`fma-neg`
6755×	`times-frac`
6455×	`log1p-expm1-u`
6003×	`*-commutative`

Stop Event

3×	saturated
32×	node limit
5×	fuel
4×	done

Compiler

Compiled 7603 to 2044 computations (73.1% saved)

localize8.0s (10%)

Results

1.8s	6505×	0	valid
1.6s	518×	2	valid
997.0ms	465×	0	invalid
700.0ms	556×	1	valid
328.0ms	82×	3	valid
265.0ms	43×	5	exit
58.0ms	18×	1	invalid
9.0ms	4×	2	invalid
3.0ms	1×	3	invalid

Compiler

Compiled 6097 to 731 computations (88% saved)

Precisions

Click to see histograms. Total time spent on operations: 3.2s

ival-div: 605.0ms (18.7% of total)

ival-mult: 552.0ms (17.1% of total)

ival-pow: 485.0ms (15% of total)

ival-sqrt: 362.0ms (11.2% of total)

backward-pass: 272.0ms (8.4% of total)

ival-sub: 180.0ms (5.6% of total)

ival-fma: 169.0ms (5.2% of total)

ival-hypot: 152.0ms (4.7% of total)

ival-add: 110.0ms (3.4% of total)

ival-if: 102.0ms (3.2% of total)

ival-cbrt: 85.0ms (2.6% of total)

ival-neg: 61.0ms (1.9% of total)

const: 28.0ms (0.9% of total)

...c/correct-round.rkt:121:19: 15.0ms (0.5% of total)

ival->=: 13.0ms (0.4% of total)

ival-log1p: 9.0ms (0.3% of total)

ival-fabs: 9.0ms (0.3% of total)

ival-log: 7.0ms (0.2% of total)

ival-e: 6.0ms (0.2% of total)

ival-exp: 6.0ms (0.2% of total)

ival-expm1: 2.0ms (0.1% of total)

prune7.9s (9.8%)

Counts: 23732 → 403
Compiler: Compiled 20558 to 10725 computations (47.8% saved)

rewrite7.8s (9.8%)

Algorithm

31×	batch-egg-rewrite

Rules

19511×	`log1p-expm1-u`
14656×	`expm1-log1p-u`
8615×	`pow1`
7618×	`add-exp-log`
7015×	`add-log-exp`

Stop Event

31×	node limit

Counts

283 → 9020

eval5.7s (7.1%)

Compiler: Compiled 869590 to 97052 computations (88.8% saved)

series2.4s (3%)

Counts

283 → 6266

Calls

1662 calls:

Time	Variable		Point	Expression
115.0ms	x	@	0	(/ (- -1/2 (/ (+ 1/8 (/ 1/16 x)) x)) x)
79.0ms	y	@	-inf	(/ (+ z -1) y)
79.0ms	c	@	inf	(if (>= b 0) (/ (- (neg b) (sqrt (- (* b b) (* (* 4 a) c)))) (* 2 a)) (/ (* 2 c) (+ (neg b) (pow (pow (+ (* b b) (* (* c -4) a)) 1/4) 2))))
65.0ms	c	@	inf	(/ (* 2 c) (+ (neg b) (/ (+ (* b b) (* a (* c -4))) (sqrt (+ (* b b) (* (sqrt (* a (* c -4))) (sqrt (* a (* c -4)))))))))
60.0ms	c	@	-inf	(pow (+ (* b b) (* (* c -4) a)) 1/4)

explain2.3s (2.9%)

Results

1.0s	3688×	0	valid
328.0ms	700×	2	valid
81.0ms	200×	1	valid
16.0ms	20×	3	valid

Compiler

Compiled 1140 to 282 computations (75.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 519.0ms

ival-neg: 91.0ms (17.5% of total)

ival-mult: 85.0ms (16.4% of total)

ival-sub: 83.0ms (16% of total)

ival-sqrt: 77.0ms (14.8% of total)

ival-div: 70.0ms (13.5% of total)

backward-pass: 48.0ms (9.2% of total)

ival-add: 19.0ms (3.7% of total)

ival-if: 12.0ms (2.3% of total)

ival->=: 11.0ms (2.1% of total)

const: 8.0ms (1.5% of total)

ival-log: 7.0ms (1.3% of total)

ival-fabs: 6.0ms (1.2% of total)

ival-exp: 4.0ms (0.8% of total)

preprocess2.1s (2.7%)

Algorithm

9×	egg-herbie

Rules

3285×	`fma-neg`
2821×	`fma-define`
1502×	`times-frac`
1470×	`div-sub`
1170×	`sub-neg`

Stop Event

5×	saturated
4×	node limit

Compiler

Compiled 4358 to 1158 computations (73.4% saved)

bsearch1.4s (1.7%)

Algorithm

4×	left-value
59×	binary-search

Stop Event

9×	predicate-same
50×	narrow-enough

Results

643.0ms	6944×	0	valid
326.0ms	32×	2	valid
42.0ms	336×	0	invalid

Compiler

Compiled 17159 to 11459 computations (33.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 758.0ms

ival-div: 415.0ms (54.7% of total)

ival-mult: 131.0ms (17.3% of total)

ival-sub: 55.0ms (7.3% of total)

ival-add: 42.0ms (5.5% of total)

ival-neg: 27.0ms (3.6% of total)

ival-sqrt: 26.0ms (3.4% of total)

ival->=: 17.0ms (2.2% of total)

ival-if: 16.0ms (2.1% of total)

ival-fabs: 14.0ms (1.8% of total)

const: 11.0ms (1.5% of total)

backward-pass: 2.0ms (0.3% of total)

analyze1.1s (1.4%)

Algorithm

9×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
22.2%	22.2%	77.7%	0.1%	0%	0%	0%	1
29.4%	27.8%	66.6%	0.1%	0%	5.6%	0%	2
50%	44.4%	44.4%	0.1%	0%	11.1%	0%	3
59.7%	51.3%	34.7%	0.1%	0%	13.9%	0%	4
67.2%	56.9%	27.7%	0.1%	0%	15.3%	0%	5
74.4%	62.4%	21.5%	0.1%	0%	16%	0%	6
78.9%	64.9%	17.3%	0.1%	0%	17.7%	0%	7
80.8%	66.3%	15.8%	0.1%	0%	17.9%	0%	8
85.9%	69.9%	11.5%	0.1%	0%	18.5%	0%	9
88%	70.7%	9.7%	0.1%	0%	19.6%	0%	10
90%	72.1%	8%	0.1%	0%	19.8%	0%	11
92.3%	73.5%	6.2%	0.1%	0%	20.3%	0%	12

Compiler

Compiled 161 to 97 computations (39.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 804.0ms

ival-mult: 303.0ms (37.7% of total)

ival-neg: 261.0ms (32.4% of total)

ival-sub: 108.0ms (13.4% of total)

ival-div: 48.0ms (6% of total)

ival-sqrt: 21.0ms (2.6% of total)

ival-add: 19.0ms (2.4% of total)

ival-if: 16.0ms (2% of total)

ival->=: 14.0ms (1.7% of total)

const: 7.0ms (0.9% of total)

ival-fabs: 6.0ms (0.7% of total)

backward-pass: 1.0ms (0.1% of total)

ival-exp: 0.0ms (0% of total)

ival-log: 0.0ms (0% of total)

regimes1.0s (1.3%)

Counts

853 → 125

Calls

26 calls:

166.0ms	(fabs.f64 (-.f64 (/.f64 (+.f64 x #s(literal 4 binary64)) y) (*.f64 (/.f64 x y) z)))
131.0ms	b
131.0ms	x
111.0ms	a
66.0ms	c

Compiler

Compiled 620 to 411 computations (33.7% saved)

Herbie run

simplify16.7s (20.9%)

sample13.5s (16.9%)

soundness10.0s (12.6%)

localize8.0s (10%)

prune7.9s (9.8%)

rewrite7.8s (9.8%)

eval5.7s (7.1%)

series2.4s (3%)

explain2.3s (2.9%)

preprocess2.1s (2.7%)

bsearch1.4s (1.7%)

analyze1.1s (1.4%)

regimes1.0s (1.3%)

end0.0ms (0%)

Profiling