Metrics for Herbie run

Date:	Wednesday, June 12th, 2024
Commit:	01076b9b on varun10p-ablationgraphs
Hostname:	nightly with Racket 8.11.1
Seed:	2024164
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:porules:lynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample2.6min (43%)

Results

40.6s	55074×	2	valid
30.2s	116426×	1	valid
28.2s	142084×	0	precondition
28.1s	7252×	5	exit
6.9s	57043×	0	valid
2.6s	2625×	3	valid
534.0ms	4293×	0	unsamplable
429.0ms	4184×	0	invalid

Precisions

Click to see histograms. Total time spent on operations: 1.8min

ival-pow: 26.3s (23.8% of total)

ival-exp: 10.5s (9.5% of total)

ival-tan: 10.1s (9.1% of total)

ival-mult: 8.4s (7.6% of total)

backward-pass: 7.1s (6.4% of total)

ival-sub: 6.3s (5.7% of total)

...c/correct-round.rkt:119:19: 6.2s (5.7% of total)

ival-log: 5.2s (4.7% of total)

ival-div: 4.8s (4.4% of total)

ival-cos: 4.5s (4.1% of total)

ival-add: 4.2s (3.8% of total)

ival-sin: 3.5s (3.2% of total)

ival-<=: 2.9s (2.7% of total)

ival-fabs: 2.7s (2.5% of total)

ival-<: 1.5s (1.4% of total)

ival-sqrt: 1.4s (1.3% of total)

ival-and: 1.2s (1.1% of total)

ival->: 857.0ms (0.8% of total)

const: 684.0ms (0.6% of total)

ival-fmin: 627.0ms (0.6% of total)

ival-neg: 578.0ms (0.5% of total)

ival-atan: 347.0ms (0.3% of total)

ival-cbrt: 329.0ms (0.3% of total)

Bogosity

simplify43.4s (11.8%)

Algorithm

246×	egg-herbie

Rules

527698×	`-lowering-.f32`
527698×	`-lowering-.f64`
289870×	`+-lowering-+.f32`
289870×	`+-lowering-+.f64`
233600×	`fma-lowering-fma.f64`

Stop Event

218×	iter limit
85×	saturated
161×	node limit

Counts

25388 → 25388

soundness42.9s (11.7%)

Rules

361850×	`-lowering-.f32`
361850×	`-lowering-.f64`
205902×	`+-lowering-+.f32`
205902×	`+-lowering-+.f64`
155478×	`/-lowering-/.f64`

Stop Event

13×	saturated
127×	iter limit
23×	fuel
114×	node limit
5×	done

Compiler

Compiled 8896 to 5189 computations (41.7% saved)

localize34.2s (9.3%)

Results

7.3s	6620×	1	valid
7.0s	2516×	5	exit
6.6s	14328×	0	valid
5.8s	3370×	2	valid
1.4s	453×	3	valid
283.0ms	585×	0	invalid
44.0ms	32×	0	unsamplable

Compiler

Compiled 20712 to 2661 computations (87.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 15.6s

ival-mult: 2.6s (16.7% of total)

ival-div: 2.4s (15.1% of total)

backward-pass: 2.0s (13% of total)

ival-log: 1.6s (10% of total)

...c/correct-round.rkt:119:19: 1.2s (7.7% of total)

ival-add: 942.0ms (6% of total)

ival-pow: 868.0ms (5.6% of total)

compiled-spec: 738.0ms (4.7% of total)

ival-exp: 684.0ms (4.4% of total)

ival-tan: 674.0ms (4.3% of total)

ival-sub: 559.0ms (3.6% of total)

ival-cos: 553.0ms (3.5% of total)

ival-sin: 270.0ms (1.7% of total)

ival-sqrt: 215.0ms (1.4% of total)

ival-cbrt: 143.0ms (0.9% of total)

const: 111.0ms (0.7% of total)

ival-neg: 41.0ms (0.3% of total)

ival-atan2: 18.0ms (0.1% of total)

ival-cosh: 14.0ms (0.1% of total)

ival-atan: 11.0ms (0.1% of total)

rewrite28.4s (7.7%)

Algorithm

109×	batch-egg-rewrite

Rules

240910×	`-lowering-.f32`
240910×	`-lowering-.f64`
177820×	`/-lowering-/.f32`
177820×	`/-lowering-/.f64`
114548×	`+-lowering-+.f32`

Stop Event

9×	saturated
110×	iter limit
100×	node limit

Counts

1494 → 79727

eval17.2s (4.7%)

Compiler: Compiled 2842395 to 282316 computations (90.1% saved)

prune17.1s (4.7%)

Counts: 121306 → 1997
Compiler: Compiled 67450 to 36862 computations (45.3% saved)

explain8.4s (2.3%)

Results

3.4s	7384×	1	valid
2.9s	3388×	2	valid
500.0ms	3394×	0	valid
241.0ms	170×	3	valid

Compiler

Compiled 2227 to 707 computations (68.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 4.5s

ival-exp: 1.3s (28.9% of total)

ival-tan: 569.0ms (12.6% of total)

backward-pass: 527.0ms (11.7% of total)

ival-cos: 423.0ms (9.4% of total)

ival-div: 338.0ms (7.5% of total)

ival-log: 275.0ms (6.1% of total)

ival-sub: 253.0ms (5.6% of total)

ival-mult: 171.0ms (3.8% of total)

ival-sin: 168.0ms (3.7% of total)

ival-add: 166.0ms (3.7% of total)

ival-pow: 127.0ms (2.8% of total)

ival-sqrt: 79.0ms (1.8% of total)

const: 34.0ms (0.8% of total)

ival-neg: 27.0ms (0.6% of total)

ival-atan: 23.0ms (0.5% of total)

ival-cbrt: 22.0ms (0.5% of total)

preprocess4.5s (1.2%)

Algorithm

56×	egg-herbie

Rules

30774×	`fnmadd-define`
28154×	`sum3-define`
24932×	`fmsub-define`
24702×	`fnmsub-define`
22806×	`fmm-def`

Stop Event

45×	saturated
28×	iter limit
11×	node limit

Compiler

Compiled 8892 to 3570 computations (59.9% saved)

series3.7s (1%)

Counts

1494 → 25388

Calls

5004 calls:

Time	Variable		Expression
411.0ms	a	@	(/ 2 (* (/ a -1/2) (/ b (* c (+ a (/ (/ (* a (* a c)) b) b))))))
167.0ms	c	@	(- (neg b_2) (* (+ 1 (/ (* -1/2 (* c a)) (* b_2 b_2))) (- 0 b_2)))
52.0ms	N	@	(pow (exp 2) (log N))
52.0ms	x	@	(pow (* x x) 1/4)
50.0ms	n	@	(* n (log n))

analyze3.5s (0.9%)

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
6.1%	3.7%	57.4%	38.9%	0%	0%	0%	1
16.5%	10.1%	51%	38.9%	0%	0%	0%	2
35.3%	20.6%	37.8%	41.6%	0%	0%	0%	3
46.1%	26.9%	31.4%	41.7%	0%	0%	0%	4
54.8%	31.5%	26%	42.4%	0%	0%	0%	5
57.1%	32.5%	24.4%	43.1%	0%	0%	0%	6
61.5%	33.9%	21.3%	44%	0%	0.8%	0.1%	7
64.6%	35.3%	19.3%	44.5%	0%	0.8%	0.1%	8
67.1%	36%	17.6%	44.9%	0%	1.2%	0.3%	9
69.1%	36.5%	16.3%	45.2%	0%	1.7%	0.3%	10
71.7%	37.5%	14.8%	45.4%	0%	1.9%	0.4%	11
72.8%	37.8%	14.1%	45.6%	0%	2.2%	0.4%	12

Compiler

Compiled 498 to 322 computations (35.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.7s

ival-sub: 256.0ms (15.2% of total)

ival-mult: 243.0ms (14.4% of total)

...c/correct-round.rkt:119:19: 207.0ms (12.3% of total)

ival-pow: 168.0ms (9.9% of total)

ival-log: 128.0ms (7.6% of total)

ival-div: 103.0ms (6.1% of total)

ival-exp: 71.0ms (4.2% of total)

ival-sqrt: 71.0ms (4.2% of total)

ival-<=: 69.0ms (4.1% of total)

ival-sin: 65.0ms (3.8% of total)

ival-add: 63.0ms (3.7% of total)

ival-fabs: 46.0ms (2.7% of total)

ival-tan: 39.0ms (2.3% of total)

ival-neg: 34.0ms (2% of total)

ival->: 26.0ms (1.5% of total)

ival-cos: 25.0ms (1.5% of total)

const: 23.0ms (1.4% of total)

ival-and: 19.0ms (1.1% of total)

backward-pass: 18.0ms (1.1% of total)

ival-<: 9.0ms (0.5% of total)

ival-fmin: 7.0ms (0.4% of total)

ival-atan: 0.0ms (0% of total)

ival-cbrt: 0.0ms (0% of total)

regimes3.4s (0.9%)

Counts

4514 → 293

Calls

43 calls:

885.0ms	x
404.0ms	eps
279.0ms	b
169.0ms	b_2
167.0ms	a

Compiler

Compiled 1461 to 970 computations (33.6% saved)

bsearch2.6s (0.7%)

Algorithm

66×	binary-search
23×	left-value

Stop Event

2×	predicate-same
64×	narrow-enough

Results

750.0ms	7062×	0	valid
704.0ms	995×	1	valid
319.0ms	743×	2	valid
202.0ms	1659×	0	invalid
9.0ms	77×	0	unsamplable

Compiler

Compiled 13115 to 9621 computations (26.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.0s

ival-pow: 244.0ms (24.2% of total)

ival-mult: 236.0ms (23.4% of total)

ival-div: 110.0ms (10.9% of total)

ival-sub: 96.0ms (9.5% of total)

ival-sqrt: 65.0ms (6.5% of total)

ival-neg: 64.0ms (6.4% of total)

backward-pass: 63.0ms (6.3% of total)

ival-exp: 58.0ms (5.8% of total)

ival-add: 42.0ms (4.2% of total)

const: 16.0ms (1.6% of total)

ival-cos: 14.0ms (1.4% of total)

Herbie run

sample2.6min (43%)

simplify43.4s (11.8%)

soundness42.9s (11.7%)

localize34.2s (9.3%)

rewrite28.4s (7.7%)

eval17.2s (4.7%)

prune17.1s (4.7%)

explain8.4s (2.3%)

preprocess4.5s (1.2%)

series3.7s (1%)

analyze3.5s (0.9%)

regimes3.4s (0.9%)

bsearch2.6s (0.7%)

end0.0ms (0%)

Profiling