Metrics for Herbie run

Date:	Friday, April 19th, 2024
Commit:	a62871db on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024110
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize3.4min (23.5%)

Algorithm

506×	egg-herbie

Rules

384410×	`fma-define`
248264×	`fma-neg`
156952×	`unsub-neg`
147344×	`distribute-lft-in`
131980×	`distribute-rgt-in`

Stop Event

299×	saturated
207×	node limit

Results

1.0min	26508×	0	valid
5.0s	1366×	0	invalid
3.3s	878×	1	valid
575.0ms	648×	0	unsamplable
50.1s	551×	5	exit
1.0ms	1×	2	valid

Compiler

Compiled 98490 to 30426 computations (69.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.8min

ival-mult: 20.3s (19.2% of total)

ival-tan: 17.3s (16.3% of total)

ival-sin: 12.8s (12.1% of total)

ival-pow: 11.2s (10.6% of total)

ival-atan: 8.3s (7.8% of total)

ival-div: 7.2s (6.8% of total)

backward-pass: 5.7s (5.4% of total)

ival-add: 4.7s (4.4% of total)

ival-sub: 2.9s (2.8% of total)

ival-sqrt: 2.2s (2% of total)

ival-fmax: 2.0s (1.9% of total)

ival-fma: 1.9s (1.8% of total)

ival-cos: 1.8s (1.7% of total)

const: 1.3s (1.3% of total)

ival-log1p: 1.3s (1.3% of total)

ival-exp: 1.1s (1% of total)

ival-log: 963.0ms (0.9% of total)

ival-expm1: 479.0ms (0.5% of total)

ival-pi: 383.0ms (0.4% of total)

ival-neg: 319.0ms (0.3% of total)

ival-hypot: 287.0ms (0.3% of total)

ival-if: 251.0ms (0.2% of total)

ival-sinh: 209.0ms (0.2% of total)

ival-log2: 202.0ms (0.2% of total)

ival->: 176.0ms (0.2% of total)

ival-floor: 168.0ms (0.2% of total)

ival->=: 122.0ms (0.1% of total)

ival-cbrt: 121.0ms (0.1% of total)

ival-asin: 42.0ms (0% of total)

ival-<: 26.0ms (0% of total)

ival-fabs: 25.0ms (0% of total)

eval2.3min (16.2%)

Compiler: Compiled 16559570 to 4474020 computations (73% saved)

simplify1.9min (13.2%)

Algorithm

146×	egg-herbie

Rules

89450×	`fma-define`
78374×	`*-commutative`
69908×	`times-frac`
61788×	`distribute-lft-in`
58830×	`associate-r`

Stop Event

29×	saturated
117×	node limit

Counts

100246 → 72236

sample1.6min (11.4%)

Results

1.2min	247680×	0	valid
1.2s	8468×	0	invalid
720.0ms	2114×	0	precondition
41.0ms	64×	5	exit

Precisions

Click to see histograms. Total time spent on operations: 1.0min

ival-mult: 15.0s (25% of total)

ival-<=: 10.8s (18% of total)

ival-div: 5.9s (9.8% of total)

ival-sub: 3.2s (5.4% of total)

ival-fabs: 2.5s (4.1% of total)

ival-add: 2.5s (4.1% of total)

ival-sin: 2.4s (4.1% of total)

ival-sqrt: 2.0s (3.3% of total)

ival-log: 1.9s (3.1% of total)

ival-tan: 1.7s (2.9% of total)

ival-and: 1.5s (2.6% of total)

ival-cos: 1.5s (2.5% of total)

const: 1.3s (2.2% of total)

ival-exp: 1.1s (1.9% of total)

ival-pi: 1.1s (1.8% of total)

ival-atan: 1.0s (1.7% of total)

ival-floor: 850.0ms (1.4% of total)

ival-neg: 838.0ms (1.4% of total)

ival-fmax: 593.0ms (1% of total)

ival->: 444.0ms (0.7% of total)

ival-<: 328.0ms (0.5% of total)

ival-if: 324.0ms (0.5% of total)

ival-asin: 312.0ms (0.5% of total)

ival-==: 277.0ms (0.5% of total)

ival-log2: 236.0ms (0.4% of total)

backward-pass: 132.0ms (0.2% of total)

ival-sinh: 104.0ms (0.2% of total)

ival->=: 101.0ms (0.2% of total)

Bogosity

prune1.6min (11.1%)

Counts: 140792 → 4042
Compiler: Compiled 307879 to 167165 computations (45.7% saved)

soundness1.1min (7.9%)

Rules

92914×	`fma-define`
64484×	`times-frac`
60210×	`*-commutative`
57252×	`associate-r`
50264×	`distribute-lft-in`

Stop Event

8×	saturated
159×	node limit
28×	fuel
1×	done

Compiler

Compiled 42654 to 21525 computations (49.5% saved)

series32.2s (3.8%)

Counts

1962 → 55615

Calls

13563 calls:

Time	Variable		Point	Expression
500.0ms	dY.v	@	inf	(log (+ 1 (sqrt (fmax (pow (sqrt (+ (* (* dX.w (floor d)) (* dX.w (floor d))) (* (sqrt (+ (* (* dX.u (floor w)) (* dX.u (floor w))) (* (* dX.v (floor h)) (* dX.v (floor h))))) (sqrt (+ (* (* dX.u (floor w)) (* dX.u (floor w))) (* (* dX.v (floor h)) (* dX.v (floor h)))))))) 2) (+ (* (pow (floor d) 2) (pow dY.w 2)) (/ (- (pow (* (floor w) dY.u) 4) (pow (* (floor h) dY.v) 4)) (- (pow (* (floor w) dY.u) 2) (pow (* (floor h) dY.v) 2))))))))
410.0ms	w	@	-inf	(/ (fmax (+ (* (floor w) (* (* dX.u dX.u) (floor w))) (* (floor h) (* (floor h) (* dX.v dX.v)))) (+ (* (floor w) (* (* dY.u dY.u) (floor w))) (* (floor h) (* (* dY.v dY.v) (floor h))))) (fabs (* (floor w) (* (floor h) (- (* dY.v dX.u) (* dX.v dY.u))))))
362.0ms	dX.u	@	-inf	(* 2 (log (sqrt (exp (log2 (if (> (/ (fmax (pow (sqrt (+ (* (* dX.v (floor h)) (* dX.v (floor h))) (* (* dX.u (floor w)) (* dX.u (floor w))))) 2) (pow (sqrt (+ (* (* (floor w) dY.u) (* (floor w) dY.u)) (* (* (floor h) dY.v) (* (floor h) dY.v)))) 2)) (fabs (* (floor w) (* (floor h) (- (* dX.u dY.v) (* dX.v dY.u)))))) (floor maxAniso)) (/ (sqrt (fmax (pow (sqrt (+ (* (* dX.v (floor h)) (* dX.v (floor h))) (* (* dX.u (floor w)) (* dX.u (floor w))))) 2) (pow (sqrt (+ (* (* (floor w) dY.u) (* (floor w) dY.u)) (* (* (floor h) dY.v) (* (floor h) dY.v)))) 2))) (floor maxAniso)) (/ (fabs (* (floor w) (* (floor h) (- (* dX.u dY.v) (* dX.v dY.u))))) (sqrt (fmax (pow (sqrt (+ (* (* dX.v (floor h)) (* dX.v (floor h))) (* (* dX.u (floor w)) (* dX.u (floor w))))) 2) (pow (sqrt (+ (* (* (floor w) dY.u) (* (floor w) dY.u)) (* (* (floor h) dY.v) (* (floor h) dY.v)))) 2))))))))))
297.0ms	d	@	-inf	(cbrt (sqrt (fmax (pow (sqrt (+ (* (* (floor d) dX.w) (* (floor d) dX.w)) (* (sqrt (+ (* (* (floor w) dX.u) (* (floor w) dX.u)) (* (* (floor h) dX.v) (* (floor h) dX.v)))) (sqrt (+ (* (* (floor w) dX.u) (* (floor w) dX.u)) (* (* (floor h) dX.v) (* (floor h) dX.v))))))) 2) (* (pow (floor d) 2) (pow dY.w 2)))))
262.0ms	u1	@	inf	(log (+ 1 (pow (/ (cos (atan (/ (tan (* (PI) (+ (* 2 u1) 1/2))) (/ alphax alphay)))) alphax) 2)))

rewrite31.4s (3.7%)

Algorithm

117×	batch-egg-rewrite

Rules

59527×	`log1p-expm1-u`
50989×	`expm1-log1p-u`
37350×	`log-prod`
36691×	`pow1`
36230×	`add-exp-log`

Stop Event

117×	node limit

Counts

1962 → 44631

analyze29.0s (3.4%)

Algorithm

30×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	2.6%	97.4%	0%	0%	0%	0
0.2%	0%	2.6%	97.4%	0%	0%	0%	1
9.2%	0.2%	2.4%	97.4%	0%	0%	0%	2
10.8%	0.3%	2.3%	97.4%	0%	0%	0%	3
15.5%	0.4%	2.2%	97.4%	0%	0%	0%	4
48.8%	1.3%	1.3%	97.4%	0%	0%	0%	5
53.6%	1.4%	1.2%	97.4%	0%	0%	0%	6
70.7%	1.8%	0.8%	97.4%	0%	0%	0%	7
72.6%	1.9%	0.7%	97.4%	0%	0.1%	0%	8
81.8%	2.1%	0.5%	97.4%	0%	0.1%	0%	9
83.3%	2.1%	0.4%	97.4%	0%	0.1%	0%	10
88.8%	2.2%	0.3%	97.4%	0%	0.1%	0%	11
89.5%	2.2%	0.3%	97.4%	0%	0.1%	0%	12

Compiler

Compiled 2668 to 1267 computations (52.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 18.0s

ival-mult: 4.2s (23.5% of total)

ival-<=: 3.8s (21.4% of total)

ival-fabs: 2.4s (13.5% of total)

ival-div: 1.1s (5.9% of total)

ival-floor: 880.0ms (4.9% of total)

ival-add: 762.0ms (4.2% of total)

ival-if: 648.0ms (3.6% of total)

ival-fmax: 631.0ms (3.5% of total)

ival-and: 539.0ms (3% of total)

ival-sqrt: 446.0ms (2.5% of total)

ival-==: 401.0ms (2.2% of total)

ival-sub: 352.0ms (2% of total)

const: 324.0ms (1.8% of total)

ival-cos: 188.0ms (1% of total)

ival-sin: 186.0ms (1% of total)

ival-log2: 179.0ms (1% of total)

ival-tan: 164.0ms (0.9% of total)

ival-pi: 112.0ms (0.6% of total)

ival-log: 97.0ms (0.5% of total)

ival->: 91.0ms (0.5% of total)

ival->=: 84.0ms (0.5% of total)

ival-<: 77.0ms (0.4% of total)

ival-atan: 70.0ms (0.4% of total)

ival-neg: 68.0ms (0.4% of total)

ival-exp: 58.0ms (0.3% of total)

backward-pass: 29.0ms (0.2% of total)

ival-asin: 18.0ms (0.1% of total)

ival-sinh: 16.0ms (0.1% of total)

regimes24.4s (2.8%)

Counts

8753 → 368

Calls

144 calls:

1.0s	dY.v
886.0ms	s
823.0ms	uy
652.0ms	maxCos
614.0ms	u

Compiler

Compiled 11862 to 8898 computations (25% saved)

explain15.7s (1.8%)

Results

10.8s	15312×	0	valid
58.0ms	44×	5	exit
5.0ms	4×	1	valid

Compiler

Compiled 16652 to 4502 computations (73% saved)

Precisions

Click to see histograms. Total time spent on operations: 9.1s

ival-mult: 2.8s (30.4% of total)

ival-tan: 1.4s (15.8% of total)

ival-sub: 1.1s (12.5% of total)

ival-sin: 688.0ms (7.6% of total)

ival-div: 676.0ms (7.5% of total)

ival-add: 481.0ms (5.3% of total)

ival-cos: 475.0ms (5.2% of total)

ival-atan: 394.0ms (4.4% of total)

ival-log: 253.0ms (2.8% of total)

ival-sqrt: 226.0ms (2.5% of total)

const: 137.0ms (1.5% of total)

ival-pi: 101.0ms (1.1% of total)

ival-exp: 81.0ms (0.9% of total)

ival-floor: 48.0ms (0.5% of total)

ival-neg: 46.0ms (0.5% of total)

backward-pass: 23.0ms (0.3% of total)

ival-sinh: 22.0ms (0.2% of total)

ival-fmax: 21.0ms (0.2% of total)

ival-if: 16.0ms (0.2% of total)

ival-log2: 14.0ms (0.2% of total)

ival-fabs: 10.0ms (0.1% of total)

ival->=: 6.0ms (0.1% of total)

ival-asin: 6.0ms (0.1% of total)

ival->: 5.0ms (0.1% of total)

ival-<: 5.0ms (0.1% of total)

preprocess10.2s (1.2%)

Algorithm

30×	egg-herbie

Rules

30630×	`fma-define`
21782×	`fma-neg`
15892×	`unsub-neg`
14706×	`distribute-lft-neg-in`
11858×	`distribute-rgt-neg-in`

Stop Event

11×	saturated
19×	node limit

Compiler

Compiled 40806 to 20830 computations (49% saved)

bsearch35.0ms (0%)

Algorithm

52×	binary-search
18×	left-value

Stop Event

52×	narrow-enough

Compiler

Compiled 3350 to 1735 computations (48.2% saved)

Herbie run

localize3.4min (23.5%)

eval2.3min (16.2%)

simplify1.9min (13.2%)

sample1.6min (11.4%)

prune1.6min (11.1%)

soundness1.1min (7.9%)

series32.2s (3.8%)

rewrite31.4s (3.7%)

analyze29.0s (3.4%)

regimes24.4s (2.8%)

explain15.7s (1.8%)

preprocess10.2s (1.2%)

bsearch35.0ms (0%)

end2.0ms (0%)

Profiling