Metrics for Herbie run

Date:	Thursday, May 16th, 2024
Commit:	c2f4097e on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024137
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

simplify2.6min (25.7%)

Algorithm

269×	egg-herbie

Rules

225660×	`fma-define`
125996×	`distribute-lft-in`
123574×	`*-commutative`
116270×	`times-frac`
110434×	`distribute-rgt-in`

Stop Event

64×	saturated
204×	node limit
1×	unsound

Counts

103243 → 72475

soundness1.6min (16.1%)

Rules

105870×	`fma-define`
68950×	`associate-r`
64408×	`*-commutative`
60790×	`times-frac`
55416×	`distribute-lft-in`

Stop Event

8×	saturated
155×	node limit
29×	fuel
1×	unsound
1×	done

Compiler

Compiled 60003 to 11715 computations (80.5% saved)

sample1.6min (15.7%)

Results

1.2min	247624×	0	valid
1.8s	8373×	0	invalid
1.0s	2078×	0	precondition
15.0ms	56×	1	valid

Precisions

Click to see histograms. Total time spent on operations: 1.0min

ival-mult: 13.7s (22.8% of total)

ival-<=: 11.0s (18.3% of total)

...c/correct-round.rkt:121:19: 9.0s (14.9% of total)

ival-div: 5.2s (8.6% of total)

ival-sub: 2.8s (4.6% of total)

ival-add: 2.0s (3.3% of total)

ival-sin: 1.8s (3.1% of total)

ival-sqrt: 1.6s (2.7% of total)

ival-and: 1.6s (2.6% of total)

ival-fabs: 1.5s (2.6% of total)

ival-log: 1.5s (2.6% of total)

ival-cos: 1.2s (2% of total)

ival-pi: 1.2s (1.9% of total)

ival-floor: 917.0ms (1.5% of total)

ival-neg: 869.0ms (1.4% of total)

ival-exp: 741.0ms (1.2% of total)

const: 474.0ms (0.8% of total)

ival-<: 399.0ms (0.7% of total)

ival-atan: 391.0ms (0.6% of total)

ival-tan: 367.0ms (0.6% of total)

ival-fmax: 318.0ms (0.5% of total)

ival-==: 310.0ms (0.5% of total)

ival->: 305.0ms (0.5% of total)

ival-if: 277.0ms (0.5% of total)

ival-log2: 271.0ms (0.5% of total)

ival-asin: 189.0ms (0.3% of total)

ival-sinh: 88.0ms (0.1% of total)

ival->=: 81.0ms (0.1% of total)

backward-pass: 76.0ms (0.1% of total)

Bogosity

prune41.7s (6.9%)

Counts: 140095 → 4186
Compiler: Compiled 356311 to 135264 computations (62% saved)

localize39.1s (6.5%)

Results

19.0s	26792×	0	valid
3.1s	567×	5	exit
2.0s	2008×	0	invalid
557.0ms	1079×	0	unsamplable
545.0ms	262×	1	valid
15.0ms	3×	5	valid
12.0ms	6×	2	valid
6.0ms	2×	4	valid
2.0ms	1×	3	valid

Compiler

Compiled 103790 to 5495 computations (94.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 14.5s

ival-mult: 3.9s (27% of total)

ival-div: 1.9s (12.8% of total)

ival-pow: 1.4s (9.5% of total)

ival-log1p: 1.0s (7.1% of total)

ival-add: 797.0ms (5.5% of total)

ival-hypot: 594.0ms (4.1% of total)

ival-sqrt: 568.0ms (3.9% of total)

ival-exp: 533.0ms (3.7% of total)

...c/correct-round.rkt:121:19: 494.0ms (3.4% of total)

ival-fma: 451.0ms (3.1% of total)

ival-log: 393.0ms (2.7% of total)

ival-sub: 382.0ms (2.6% of total)

ival-sin: 288.0ms (2% of total)

backward-pass: 275.0ms (1.9% of total)

ival-neg: 178.0ms (1.2% of total)

ival-fmax: 168.0ms (1.2% of total)

ival-if: 161.0ms (1.1% of total)

ival-expm1: 157.0ms (1.1% of total)

ival-cos: 128.0ms (0.9% of total)

ival-floor: 101.0ms (0.7% of total)

ival-pi: 99.0ms (0.7% of total)

const: 99.0ms (0.7% of total)

ival-log2: 94.0ms (0.6% of total)

ival-tan: 63.0ms (0.4% of total)

ival-cbrt: 55.0ms (0.4% of total)

ival->=: 43.0ms (0.3% of total)

ival->: 40.0ms (0.3% of total)

ival-acos: 39.0ms (0.3% of total)

ival-asin: 37.0ms (0.3% of total)

ival-fabs: 33.0ms (0.2% of total)

ival-atan: 17.0ms (0.1% of total)

ival-sinh: 12.0ms (0.1% of total)

ival-<: 12.0ms (0.1% of total)

ival-e: 5.0ms (0% of total)

series34.2s (5.7%)

Counts

2010 → 57813

Calls

14034 calls:

Time	Variable		Point	Expression
442.0ms	s	@	inf	(* (neg s) (log (/ (+ -1 (pow (+ (/ u (+ 1 (exp (/ (PI) (neg s))))) (/ (- 1 u) (+ 1 (exp (/ (PI) s))))) -3)) (+ (pow (+ (/ u (+ 1 (exp (/ (PI) (neg s))))) (/ (- 1 u) (+ 1 (exp (/ (PI) s))))) -2) (- 1 (/ -1 (+ (/ u (+ 1 (exp (/ (PI) (neg s))))) (/ (- 1 u) (+ 1 (exp (/ (PI) s)))))))))))
404.0ms	dX.v	@	0	(/ 1 (sqrt (fmax (+ (* (* (floor w) dX.u) (* (floor w) dX.u)) (* (pow dX.v 2) (pow (floor h) 2))) (+ (* (* (floor w) dY.u) (* (floor w) dY.u)) (exp (* (log (* (floor h) dY.v)) 2))))))
330.0ms	h	@	-inf	(log (+ 1 (log2 (sqrt (fmax (pow (sqrt (+ (* (* dX.w (floor d)) (* dX.w (floor d))) (* (sqrt (+ (* (* dX.u (floor w)) (* dX.u (floor w))) (* (* dX.v (floor h)) (* dX.v (floor h))))) (sqrt (+ (* (* dX.u (floor w)) (* dX.u (floor w))) (* (* dX.v (floor h)) (* dX.v (floor h)))))))) 2) (pow (sqrt (+ (* (* (floor d) dY.w) (* (floor d) dY.w)) (* (sqrt (+ (* (* (floor w) dY.u) (* (floor w) dY.u)) (* (* (floor h) dY.v) (* (floor h) dY.v)))) (sqrt (+ (* (* (floor w) dY.u) (* (floor w) dY.u)) (* (* (floor h) dY.v) (* (floor h) dY.v))))))) 2))))))
306.0ms	dY.u	@	0	(/ (* (floor h) (- (* dX.u dY.v) (* dX.v dY.u))) (sqrt (fmax (pow (sqrt (+ (* (* (floor w) dX.u) (* (floor w) dX.u)) (* (* (floor h) dX.v) (* (floor h) dX.v)))) 2) (pow (sqrt (+ (* (* (floor h) dY.v) (* (floor h) dY.v)) (* (* (floor w) dY.u) (* (floor w) dY.u)))) 2))))
284.0ms	d	@	-inf	(log (log2 (sqrt (fmax (pow (sqrt (+ (* (* dX.w (floor d)) (* dX.w (floor d))) (* (sqrt (+ (* (* dX.u (floor w)) (* dX.u (floor w))) (* (* dX.v (floor h)) (* dX.v (floor h))))) (sqrt (+ (* (* dX.u (floor w)) (* dX.u (floor w))) (* (* dX.v (floor h)) (* dX.v (floor h)))))))) 2) (pow (* (floor d) dY.w) 2)))))

analyze32.8s (5.5%)

Algorithm

30×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	2.6%	97.4%	0%	0%	0%	0
0%	0%	2.6%	97.4%	0%	0%	0%	1
7.8%	0.2%	2.4%	97.4%	0%	0%	0%	2
8.5%	0.2%	2.4%	97.4%	0%	0%	0%	3
12.8%	0.3%	2.3%	97.4%	0%	0%	0%	4
47%	1.2%	1.4%	97.4%	0%	0%	0%	5
51.8%	1.3%	1.2%	97.4%	0%	0%	0%	6
69.5%	1.8%	0.8%	97.4%	0%	0%	0%	7
71.6%	1.8%	0.7%	97.4%	0%	0.1%	0%	8
81.1%	2.1%	0.5%	97.4%	0%	0.1%	0%	9
82.6%	2.1%	0.4%	97.4%	0%	0.1%	0%	10
88.3%	2.2%	0.3%	97.4%	0%	0.1%	0%	11
89.1%	2.2%	0.3%	97.4%	0%	0.1%	0%	12

Compiler

Compiled 2668 to 1046 computations (60.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 21.2s

ival-mult: 4.8s (22.5% of total)

ival-<=: 3.7s (17.4% of total)

...c/correct-round.rkt:121:19: 3.0s (14.1% of total)

ival-fabs: 1.7s (8% of total)

ival-div: 1.3s (6.3% of total)

ival-add: 997.0ms (4.7% of total)

ival-floor: 835.0ms (3.9% of total)

ival-and: 668.0ms (3.1% of total)

ival-sqrt: 595.0ms (2.8% of total)

ival-==: 444.0ms (2.1% of total)

ival-sin: 415.0ms (2% of total)

ival-sub: 407.0ms (1.9% of total)

ival-if: 382.0ms (1.8% of total)

ival-fmax: 310.0ms (1.5% of total)

ival-cos: 287.0ms (1.4% of total)

ival-log: 232.0ms (1.1% of total)

ival-log2: 190.0ms (0.9% of total)

ival-tan: 159.0ms (0.7% of total)

const: 137.0ms (0.6% of total)

ival->: 132.0ms (0.6% of total)

ival-<: 126.0ms (0.6% of total)

ival->=: 92.0ms (0.4% of total)

ival-exp: 77.0ms (0.4% of total)

ival-pi: 72.0ms (0.3% of total)

ival-neg: 70.0ms (0.3% of total)

ival-atan: 41.0ms (0.2% of total)

ival-sinh: 34.0ms (0.2% of total)

backward-pass: 23.0ms (0.1% of total)

ival-asin: 20.0ms (0.1% of total)

regimes32.5s (5.4%)

Counts

10874 → 435

Calls

145 calls:

889.0ms	uy
851.0ms	ux
786.0ms	u2
781.0ms	s
765.0ms	maxCos

Compiler

Compiled 14807 to 10347 computations (30.1% saved)

rewrite31.1s (5.2%)

Algorithm

119×	batch-egg-rewrite

Rules

58106×	`log1p-expm1-u`
50120×	`expm1-log1p-u`
36742×	`log-prod`
36453×	`pow1`
36346×	`add-exp-log`

Stop Event

119×	node limit

Counts

2010 → 45430

eval28.4s (4.7%)

Compiler: Compiled 13469505 to 594841 computations (95.6% saved)

preprocess9.0s (1.5%)

Algorithm

30×	egg-herbie

Rules

30630×	`fma-define`
21782×	`fma-neg`
15892×	`unsub-neg`
14706×	`distribute-lft-neg-in`
11858×	`distribute-rgt-neg-in`

Stop Event

11×	saturated
19×	node limit

Compiler

Compiled 54914 to 15066 computations (72.6% saved)

explain6.7s (1.1%)

Results

3.8s	15306×	0	valid
26.0ms	54×	1	valid

Compiler

Compiled 16652 to 1662 computations (90% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.0s

ival-mult: 632.0ms (31.6% of total)

ival-sub: 238.0ms (11.9% of total)

ival-div: 212.0ms (10.6% of total)

ival-floor: 107.0ms (5.4% of total)

ival-add: 107.0ms (5.4% of total)

ival-log: 93.0ms (4.7% of total)

ival-exp: 80.0ms (4% of total)

ival-sqrt: 77.0ms (3.9% of total)

ival-cos: 75.0ms (3.8% of total)

ival-sin: 75.0ms (3.8% of total)

ival-atan: 55.0ms (2.8% of total)

ival-neg: 33.0ms (1.7% of total)

const: 29.0ms (1.5% of total)

...c/correct-round.rkt:121:19: 28.0ms (1.4% of total)

ival-pi: 25.0ms (1.3% of total)

ival-fmax: 20.0ms (1% of total)

ival-if: 20.0ms (1% of total)

ival-tan: 19.0ms (1% of total)

ival-fabs: 19.0ms (1% of total)

ival-log2: 15.0ms (0.8% of total)

ival-asin: 13.0ms (0.7% of total)

backward-pass: 7.0ms (0.4% of total)

ival->=: 6.0ms (0.3% of total)

ival->: 5.0ms (0.3% of total)

ival-sinh: 5.0ms (0.3% of total)

ival-<: 2.0ms (0.1% of total)

bsearch45.0ms (0%)

Algorithm

64×	binary-search
27×	left-value

Stop Event

64×	narrow-enough

Compiler

Compiled 4890 to 2064 computations (57.8% saved)

Herbie run

simplify2.6min (25.7%)

soundness1.6min (16.1%)

sample1.6min (15.7%)

prune41.7s (6.9%)

localize39.1s (6.5%)

series34.2s (5.7%)

analyze32.8s (5.5%)

regimes32.5s (5.4%)

rewrite31.1s (5.2%)

eval28.4s (4.7%)

preprocess9.0s (1.5%)

explain6.7s (1.1%)

bsearch45.0ms (0%)

end0.0ms (0%)

Profiling