Metrics for Herbie run

Date:	Monday, June 3rd, 2024
Commit:	e0929cca on platforms
Hostname:	nightly with Racket 8.11.1
Seed:	2024155
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample2.4min (39.4%)

Results

36.7s	55313×	2	valid
27.7s	116191×	1	valid
26.5s	142044×	0	precondition
25.7s	7123×	5	exit
5.4s	56993×	0	valid
3.3s	2671×	3	valid
562.0ms	4137×	0	unsamplable
387.0ms	4222×	0	invalid

Precisions

Click to see histograms. Total time spent on operations: 1.8min

ival-pow: 25.3s (23.8% of total)

ival-exp: 10.7s (10.1% of total)

ival-tan: 9.9s (9.4% of total)

ival-mult: 7.9s (7.4% of total)

ival-sub: 6.6s (6.2% of total)

...c/correct-round.rkt:119:19: 5.9s (5.5% of total)

ival-log: 5.1s (4.8% of total)

backward-pass: 4.6s (4.3% of total)

ival-add: 4.5s (4.3% of total)

ival-cos: 4.4s (4.2% of total)

ival-div: 3.8s (3.6% of total)

ival-<=: 3.4s (3.2% of total)

ival-sin: 3.4s (3.2% of total)

ival-fabs: 2.6s (2.5% of total)

ival-<: 1.7s (1.6% of total)

ival-sqrt: 1.5s (1.4% of total)

ival->: 1.1s (1% of total)

ival-neg: 927.0ms (0.9% of total)

ival-and: 843.0ms (0.8% of total)

ival-fmin: 636.0ms (0.6% of total)

const: 635.0ms (0.6% of total)

ival-atan: 347.0ms (0.3% of total)

ival-cbrt: 309.0ms (0.3% of total)

Bogosity

simplify48.1s (13%)

Algorithm

252×	egg-herbie

Rules

606316×	`-lowering-.f32`
606316×	`-lowering-.f64`
374216×	`+-lowering-+.f32`
374216×	`+-lowering-+.f64`
250756×	`fma-lowering-fma.f64`

Stop Event

224×	iter limit
72×	saturated
180×	node limit

Counts

28116 → 28116

soundness45.7s (12.3%)

Rules

482282×	`-lowering-.f32`
482282×	`-lowering-.f64`
271856×	`+-lowering-+.f32`
271856×	`+-lowering-+.f64`
230230×	`/-lowering-/.f64`

Stop Event

10×	saturated
142×	iter limit
132×	node limit
28×	fuel

Compiler

Compiled 10488 to 5712 computations (45.5% saved)

rewrite39.3s (10.6%)

Algorithm

112×	batch-egg-rewrite

Rules

387838×	`-lowering-.f32`
387838×	`-lowering-.f64`
295432×	`/-lowering-/.f32`
295432×	`/-lowering-/.f64`
170414×	`+-lowering-+.f32`

Stop Event

113×	iter limit
112×	node limit

Counts

1718 → 68784

localize33.5s (9%)

Results

9.2s	3343×	5	exit
6.3s	7647×	1	valid
5.3s	3702×	2	valid
4.7s	12762×	0	valid
724.0ms	344×	3	valid
272.0ms	758×	0	invalid
81.0ms	97×	0	unsamplable
40.0ms	19×	1	unsamplable

Compiler

Compiled 27371 to 3072 computations (88.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 19.0s

ival-mult: 3.1s (16.2% of total)

ival-log: 2.4s (12.7% of total)

backward-pass: 2.3s (12.2% of total)

ival-div: 1.9s (10% of total)

ival-pow: 1.9s (9.9% of total)

ival-add: 1.3s (7.1% of total)

compiled-spec: 1.2s (6.5% of total)

...c/correct-round.rkt:119:19: 1.2s (6.3% of total)

ival-tan: 875.0ms (4.6% of total)

ival-sub: 820.0ms (4.3% of total)

ival-exp: 673.0ms (3.5% of total)

ival-sin: 431.0ms (2.3% of total)

ival-cos: 324.0ms (1.7% of total)

ival-sqrt: 212.0ms (1.1% of total)

const: 119.0ms (0.6% of total)

ival-cbrt: 92.0ms (0.5% of total)

ival-neg: 45.0ms (0.2% of total)

ival-atan2: 29.0ms (0.2% of total)

ival-atan: 16.0ms (0.1% of total)

ival-e: 4.0ms (0% of total)

eval18.0s (4.9%)

Compiler: Compiled 3928773 to 296096 computations (92.5% saved)

prune15.8s (4.3%)

Counts: 120334 → 2584
Compiler: Compiled 116814 to 54390 computations (53.4% saved)

explain6.2s (1.7%)

Results

2.4s	3498×	2	valid
2.0s	7224×	1	valid
395.0ms	3460×	0	valid
167.0ms	154×	3	valid

Compiler

Compiled 2227 to 707 computations (68.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 3.3s

ival-tan: 585.0ms (17.6% of total)

ival-exp: 505.0ms (15.2% of total)

ival-div: 306.0ms (9.2% of total)

ival-log: 283.0ms (8.5% of total)

backward-pass: 275.0ms (8.3% of total)

ival-sub: 250.0ms (7.5% of total)

ival-cos: 217.0ms (6.5% of total)

ival-mult: 211.0ms (6.3% of total)

ival-sin: 207.0ms (6.2% of total)

ival-add: 151.0ms (4.5% of total)

ival-pow: 149.0ms (4.5% of total)

ival-sqrt: 84.0ms (2.5% of total)

ival-neg: 31.0ms (0.9% of total)

const: 30.0ms (0.9% of total)

ival-cbrt: 24.0ms (0.7% of total)

ival-atan: 21.0ms (0.6% of total)

preprocess4.4s (1.2%)

Algorithm

56×	egg-herbie

Rules

30322×	`fnmadd-define`
27570×	`sum3-define`
24790×	`fnmsub-define`
23844×	`fmsub-define`
21818×	`fmm-def`

Stop Event

44×	saturated
28×	iter limit
12×	node limit

Compiler

Compiled 11088 to 4128 computations (62.8% saved)

regimes4.2s (1.1%)

Counts

5589 → 332

Calls

43 calls:

1.0s	x
649.0ms	eps
262.0ms	b
222.0ms	N
163.0ms	b_2

Compiler

Compiled 1498 to 981 computations (34.5% saved)

series3.6s (1%)

Counts

1718 → 28116

Calls

5502 calls:

Time	Variable		Expression
259.0ms	a	@	(* (/ 1 a) (/ (* -1/2 (* c a)) b_2))
62.0ms	x	@	(- (sqrt (+ x 1)) (pow (* x x) 1/4))
61.0ms	n	@	(* n (log n))
54.0ms	n	@	(/ (log (/ x (+ 1 x))) (neg n))
54.0ms	x	@	(- (pow x -1/2) (pow (* (+ 1 x) (+ 1 x)) -1/4))

analyze3.2s (0.9%)

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
6.1%	3.7%	57.4%	38.9%	0%	0%	0%	1
16.5%	10.1%	51%	38.9%	0%	0%	0%	2
35.3%	20.6%	37.8%	41.6%	0%	0%	0%	3
46.1%	26.9%	31.4%	41.7%	0%	0%	0%	4
54.8%	31.5%	26%	42.4%	0%	0%	0%	5
57.1%	32.5%	24.4%	43.1%	0%	0%	0%	6
61.5%	33.9%	21.3%	44%	0%	0.8%	0.1%	7
64.6%	35.3%	19.3%	44.5%	0%	0.8%	0.1%	8
67.1%	36%	17.6%	44.9%	0%	1.2%	0.3%	9
69.1%	36.5%	16.3%	45.2%	0%	1.7%	0.3%	10
71.7%	37.5%	14.8%	45.4%	0%	1.9%	0.4%	11
72.8%	37.8%	14.1%	45.6%	0%	2.2%	0.4%	12

Compiler

Compiled 498 to 322 computations (35.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.8s

ival-sub: 279.0ms (15.8% of total)

ival-pow: 258.0ms (14.6% of total)

ival-mult: 204.0ms (11.6% of total)

...c/correct-round.rkt:119:19: 170.0ms (9.6% of total)

ival-div: 123.0ms (7% of total)

ival-<=: 103.0ms (5.8% of total)

ival-log: 100.0ms (5.7% of total)

ival-add: 94.0ms (5.3% of total)

ival-exp: 68.0ms (3.9% of total)

ival-sqrt: 64.0ms (3.6% of total)

ival-sin: 62.0ms (3.5% of total)

ival-neg: 50.0ms (2.8% of total)

ival-fabs: 48.0ms (2.7% of total)

ival-tan: 35.0ms (2% of total)

ival-cos: 23.0ms (1.3% of total)

const: 20.0ms (1.1% of total)

ival-<: 16.0ms (0.9% of total)

ival->: 15.0ms (0.9% of total)

ival-and: 12.0ms (0.7% of total)

backward-pass: 9.0ms (0.5% of total)

ival-fmin: 7.0ms (0.4% of total)

ival-atan: 0.0ms (0% of total)

ival-cbrt: 0.0ms (0% of total)

bsearch2.2s (0.6%)

Algorithm

81×	binary-search
23×	left-value

Stop Event

2×	predicate-same
79×	narrow-enough

Results

750.0ms	7870×	0	valid
325.0ms	775×	2	valid
287.0ms	1211×	1	valid
149.0ms	1804×	0	invalid
11.0ms	88×	0	unsamplable

Compiler

Compiled 16313 to 11756 computations (27.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.0s

ival-mult: 234.0ms (23% of total)

ival-pow: 227.0ms (22.3% of total)

ival-div: 132.0ms (13% of total)

ival-sub: 111.0ms (10.9% of total)

ival-sqrt: 71.0ms (7% of total)

ival-exp: 58.0ms (5.7% of total)

ival-add: 53.0ms (5.2% of total)

ival-neg: 50.0ms (4.9% of total)

backward-pass: 41.0ms (4% of total)

ival-cos: 21.0ms (2.1% of total)

const: 17.0ms (1.7% of total)

ival-cbrt: 3.0ms (0.3% of total)

ival-log: 1.0ms (0.1% of total)

ival-tan: 0.0ms (0% of total)

Herbie run

sample2.4min (39.4%)

simplify48.1s (13%)

soundness45.7s (12.3%)

rewrite39.3s (10.6%)

localize33.5s (9%)

eval18.0s (4.9%)

prune15.8s (4.3%)

explain6.2s (1.7%)

preprocess4.4s (1.2%)

regimes4.2s (1.1%)

series3.6s (1%)

analyze3.2s (0.9%)

bsearch2.2s (0.6%)

end0.0ms (0%)

Profiling