Metrics for Herbie run

Date:	Thursday, May 2nd, 2024
Commit:	e0a5b8b3 on artem-safe-sampling
Hostname:	nightly with Racket 8.11.1
Seed:	2024123
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

simplify13.2s (17.6%)

Algorithm

38×	egg-herbie

Rules

12958×	`fma-define`
9114×	`fma-neg`
8464×	`times-frac`
8131×	`*-commutative`
7265×	`distribute-lft-in`

Stop Event

9×	saturated
29×	node limit

Counts

15181 → 14239

sample12.2s (16.3%)

Results

7.0s	70194×	0	valid
1.8s	4101×	2	valid
583.0ms	1812×	0	invalid
1.0ms	9×	1	valid

Precisions

Click to see histograms. Total time spent on operations: 6.3s

ival-div: 1.8s (28% of total)

ival-mult: 1.3s (20.7% of total)

ival-sub: 1.3s (20.5% of total)

ival-sqrt: 511.0ms (8.1% of total)

ival-add: 327.0ms (5.2% of total)

ival-neg: 255.0ms (4.1% of total)

ival->=: 177.0ms (2.8% of total)

ival-fabs: 148.0ms (2.4% of total)

backward-pass: 121.0ms (1.9% of total)

const: 117.0ms (1.9% of total)

ival-if: 104.0ms (1.7% of total)

ival-log: 101.0ms (1.6% of total)

ival-exp: 70.0ms (1.1% of total)

Bogosity

localize10.4s (13.8%)

Algorithm

31×	egg-herbie

Rules

11988×	`fma-neg`
8911×	`fma-define`
5768×	`div-sub`
4764×	`times-frac`
3988×	`distribute-lft-neg-in`

Stop Event

21×	saturated
10×	node limit

Results

2.3s	6514×	0	valid
1.3s	429×	2	valid
462.0ms	87×	5	exit
454.0ms	567×	0	invalid
401.0ms	88×	3	valid
336.0ms	210×	1	valid
129.0ms	30×	1	invalid
25.0ms	11×	2	invalid

Compiler

Compiled 6116 to 736 computations (88% saved)

Precisions

Click to see histograms. Total time spent on operations: 3.0s

ival-mult: 590.0ms (19.9% of total)

ival-pow: 567.0ms (19.2% of total)

ival-div: 538.0ms (18.2% of total)

ival-sub: 264.0ms (8.9% of total)

backward-pass: 250.0ms (8.4% of total)

ival-sqrt: 165.0ms (5.6% of total)

ival-add: 154.0ms (5.2% of total)

ival-fma: 147.0ms (5% of total)

ival-if: 123.0ms (4.2% of total)

ival-neg: 43.0ms (1.5% of total)

const: 25.0ms (0.8% of total)

ival-hypot: 18.0ms (0.6% of total)

ival-fabs: 18.0ms (0.6% of total)

ival-log: 16.0ms (0.5% of total)

ival->=: 12.0ms (0.4% of total)

ival-exp: 12.0ms (0.4% of total)

...c/correct-round.rkt:125:19: 7.0ms (0.2% of total)

ival-cbrt: 6.0ms (0.2% of total)

ival-e: 4.0ms (0.1% of total)

soundness10.0s (13.3%)

Rules

11133×	`fma-define`
8834×	`fma-neg`
6903×	`times-frac`
6230×	`log1p-expm1-u`
5866×	`*-commutative`

Stop Event

3×	saturated
4×	fuel
31×	node limit
5×	done

Compiler

Compiled 6682 to 1937 computations (71% saved)

rewrite7.5s (10%)

Algorithm

29×	batch-egg-rewrite

Rules

16921×	`log1p-expm1-u`
12497×	`expm1-log1p-u`
8146×	`pow1`
7817×	`add-exp-log`
6950×	`prod-diff`

Stop Event

29×	node limit

Counts

276 → 8805

prune6.3s (8.4%)

Counts: 23561 → 375
Compiler: Compiled 20100 to 10585 computations (47.3% saved)

eval5.6s (7.5%)

Compiler: Compiled 824522 to 94345 computations (88.6% saved)

explain2.7s (3.6%)

Results

1.1s	686×	2	valid
751.0ms	3738×	0	valid
196.0ms	176×	1	valid
5.0ms	8×	3	valid

Compiler

Compiled 1140 to 282 computations (75.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.5s

ival-mult: 677.0ms (46.3% of total)

ival-sqrt: 260.0ms (17.8% of total)

ival-div: 247.0ms (16.9% of total)

ival-sub: 92.0ms (6.3% of total)

backward-pass: 89.0ms (6.1% of total)

ival-neg: 29.0ms (2% of total)

ival-add: 22.0ms (1.5% of total)

ival-if: 11.0ms (0.8% of total)

ival->=: 10.0ms (0.7% of total)

const: 8.0ms (0.5% of total)

ival-fabs: 7.0ms (0.5% of total)

ival-log: 6.0ms (0.4% of total)

ival-exp: 4.0ms (0.3% of total)

series2.6s (3.5%)

Counts

276 → 6376

Calls

1599 calls:

Time	Variable		Point	Expression
159.0ms	a	@	-inf	(pow (* (* -4 a) c) 1/4)
157.0ms	c	@	0	(pow (* (* -4 a) c) 1/4)
128.0ms	b	@	inf	(sqrt (+ (* c (* a -4)) (* b b)))
128.0ms	a	@	-inf	(/ (+ b (sqrt (+ (* c (* a -4)) (* b b)))) a)
119.0ms	b	@	inf	(pow (sqrt (* c (/ -2 (+ b (sqrt (+ (* c (* a -4)) (pow b 2))))))) 2)

preprocess1.7s (2.3%)

Algorithm

9×	egg-herbie

Rules

3285×	`fma-neg`
2821×	`fma-define`
1502×	`times-frac`
1470×	`div-sub`
1170×	`sub-neg`

Stop Event

5×	saturated
4×	node limit

Compiler

Compiled 3400 to 1082 computations (68.2% saved)

bsearch1.5s (1.9%)

Algorithm

57×	binary-search
3×	left-value

Stop Event

6×	predicate-same
51×	narrow-enough

Results

750.0ms	7200×	0	valid
203.0ms	80×	2	valid
42.0ms	342×	0	invalid

Compiler

Compiled 15863 to 10650 computations (32.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 700.0ms

ival-mult: 316.0ms (45.1% of total)

ival-div: 102.0ms (14.6% of total)

ival->=: 76.0ms (10.9% of total)

ival-sub: 61.0ms (8.7% of total)

ival-add: 48.0ms (6.9% of total)

ival-sqrt: 24.0ms (3.4% of total)

ival-neg: 23.0ms (3.3% of total)

ival-fabs: 19.0ms (2.7% of total)

ival-if: 16.0ms (2.3% of total)

const: 12.0ms (1.7% of total)

backward-pass: 4.0ms (0.6% of total)

regimes809.0ms (1.1%)

Counts

857 → 114

Calls

26 calls:

177.0ms	x
100.0ms	y
91.0ms	b
59.0ms	a
57.0ms	c

Compiler

Compiled 538 to 357 computations (33.6% saved)

analyze566.0ms (0.8%)

Algorithm

9×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
22.2%	22.2%	77.7%	0.1%	0%	0%	0%	1
29.4%	27.8%	66.6%	0.1%	0%	5.6%	0%	2
50%	44.4%	44.4%	0.1%	0%	11.1%	0%	3
59.7%	51.3%	34.7%	0.1%	0%	13.9%	0%	4
67.2%	56.9%	27.7%	0.1%	0%	15.3%	0%	5
74.4%	62.4%	21.5%	0.1%	0%	16%	0%	6
78.9%	64.9%	17.3%	0.1%	0%	17.7%	0%	7
80.8%	66.3%	15.8%	0.1%	0%	17.9%	0%	8
85.9%	69.9%	11.5%	0.1%	0%	18.5%	0%	9
88%	70.7%	9.7%	0.1%	0%	19.6%	0%	10
90%	72.1%	8%	0.1%	0%	19.8%	0%	11
92.3%	73.5%	6.2%	0.1%	0%	20.3%	0%	12

Compiler

Compiled 161 to 97 computations (39.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 326.0ms

ival-mult: 113.0ms (34.7% of total)

ival-sub: 58.0ms (17.8% of total)

ival-sqrt: 43.0ms (13.2% of total)

ival-div: 33.0ms (10.1% of total)

ival-add: 20.0ms (6.1% of total)

ival-neg: 16.0ms (4.9% of total)

ival-if: 15.0ms (4.6% of total)

ival->=: 15.0ms (4.6% of total)

const: 7.0ms (2.1% of total)

ival-fabs: 4.0ms (1.2% of total)

backward-pass: 2.0ms (0.6% of total)

ival-exp: 0.0ms (0% of total)

ival-log: 0.0ms (0% of total)

Herbie run

simplify13.2s (17.6%)

sample12.2s (16.3%)

localize10.4s (13.8%)

soundness10.0s (13.3%)

rewrite7.5s (10%)

prune6.3s (8.4%)

eval5.6s (7.5%)

explain2.7s (3.6%)

series2.6s (3.5%)

preprocess1.7s (2.3%)

bsearch1.5s (1.9%)

regimes809.0ms (1.1%)

analyze566.0ms (0.8%)

end0.0ms (0%)

Profiling