Metrics for Herbie run

Date:	Tuesday, April 9th, 2024
Commit:	ec545773 on artem-tuning-cleanup-128start-5ampl
Hostname:	nightly with Racket 8.11.1
Seed:	2024100
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample22.9min (22.9%)

Results

7.9min	3909051×	0	valid
3.0min	451257×	1	valid
30.1s	180335×	0	invalid
23.7s	143106×	0	precondition
1.4min	88229×	2	valid
3.1min	62080×	5	exit
14.8s	60871×	0	unsamplable
1.0min	15708×	3	valid
7.8s	15215×	1	invalid
26.3s	2263×	4	valid
1.2s	1245×	2	invalid
45.0ms	55×	1	unsamplable
20.0ms	8×	5	valid
3.0ms	1×	4	unsamplable

Precisions

Click to see histograms. Total time spent on operations: 14.3min

ival-mult: 2.6min (18.4% of total)

ival-sin: 1.9min (13.1% of total)

ival-div: 1.4min (10.1% of total)

ival-pow: 1.3min (9.2% of total)

backward-pass: 1.1min (7.5% of total)

ival-add: 1.0min (7.2% of total)

ival-sub: 58.8s (6.9% of total)

ival-cos: 51.1s (6% of total)

ival-exp: 41.1s (4.8% of total)

ival-log: 24.2s (2.8% of total)

ival-sqrt: 21.2s (2.5% of total)

ival-<=: 18.7s (2.2% of total)

ival-tan: 17.3s (2% of total)

const: 14.0s (1.6% of total)

ival-neg: 8.9s (1% of total)

ival-fabs: 7.8s (0.9% of total)

ival-<: 6.2s (0.7% of total)

ival-and: 3.7s (0.4% of total)

ival-pi: 3.0s (0.4% of total)

ival->: 2.5s (0.3% of total)

ival-atan2: 2.1s (0.2% of total)

ival-acos: 1.9s (0.2% of total)

ival-asin: 1.9s (0.2% of total)

ival-atan: 1.8s (0.2% of total)

ival-sinh: 1.1s (0.1% of total)

ival-fmod: 1.1s (0.1% of total)

ival-==: 1.1s (0.1% of total)

ival-fmin: 956.0ms (0.1% of total)

ival->=: 756.0ms (0.1% of total)

ival-floor: 722.0ms (0.1% of total)

ival-cbrt: 682.0ms (0.1% of total)

ival-cosh: 474.0ms (0.1% of total)

ival-if: 420.0ms (0% of total)

ival-fma: 401.0ms (0% of total)

ival-fmax: 325.0ms (0% of total)

ival-hypot: 303.0ms (0% of total)

ival-acosh: 282.0ms (0% of total)

ival-log2: 265.0ms (0% of total)

ival-asinh: 246.0ms (0% of total)

ival-atanh: 192.0ms (0% of total)

ival-tanh: 169.0ms (0% of total)

ival-or: 79.0ms (0% of total)

Bogosity

localize21.6min (21.5%)

Results

4.9min	377655×	0	valid
3.1min	39171×	1	valid
42.8s	25689×	0	invalid
1.4min	10982×	2	valid
6.6min	9984×	5	exit
2.7s	1870×	0	unsamplable
40.2s	1624×	3	valid
8.1s	526×	1	invalid
18.4s	93×	4	valid
103.0ms	19×	2	invalid
21.0ms	1×	5	valid

Compiler

Compiled 472430 to 213999 computations (54.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 15.4min

ival-pow: 2.6min (16.8% of total)

ival-mult: 2.6min (16.7% of total)

ival-sin: 1.5min (9.7% of total)

backward-pass: 1.5min (9.5% of total)

ival-div: 1.4min (9.1% of total)

ival-cos: 59.9s (6.5% of total)

ival-tan: 46.6s (5% of total)

ival-add: 45.8s (5% of total)

ival-sub: 33.0s (3.6% of total)

ival-fma: 26.0s (2.8% of total)

ival-atan: 22.6s (2.4% of total)

ival-sqrt: 18.8s (2% of total)

ival-expm1: 17.9s (1.9% of total)

ival-log: 16.2s (1.8% of total)

const: 15.3s (1.7% of total)

ival-exp: 12.8s (1.4% of total)

ival-log1p: 8.3s (0.9% of total)

ival-hypot: 7.1s (0.8% of total)

ival-cbrt: 6.5s (0.7% of total)

ival-acos: 3.9s (0.4% of total)

ival-asin: 3.5s (0.4% of total)

ival-neg: 2.9s (0.3% of total)

ival-atan2: 1.5s (0.2% of total)

ival-fmax: 1.3s (0.1% of total)

ival-pi: 565.0ms (0.1% of total)

ival-fmod: 457.0ms (0% of total)

ival-if: 379.0ms (0% of total)

ival-fabs: 366.0ms (0% of total)

ival-sinh: 281.0ms (0% of total)

ival->=: 233.0ms (0% of total)

ival-log2: 131.0ms (0% of total)

ival->: 123.0ms (0% of total)

ival-cosh: 106.0ms (0% of total)

ival-floor: 104.0ms (0% of total)

ival-e: 80.0ms (0% of total)

ival-copysign: 76.0ms (0% of total)

ival-<: 39.0ms (0% of total)

ival-tanh: 30.0ms (0% of total)

simplify9.9min (9.9%)

Algorithm

2258×

egg-herbie

Rules

690490×	`fma-define`
504731×	`*-commutative`
497783×	`fma-neg`
495083×	`associate-r`
482683×	`distribute-lft-in`

Stop Event

541×	saturated
1693×	node limit
24×	unsound

Counts

804931 → 699554

eval8.7min (8.7%)

Compiler: Compiled 41590103 to 19862512 computations (52.2% saved)

soundness8.4min (8.4%)

Rules

625501×	`fma-define`
466794×	`fma-neg`
436892×	`log1p-expm1-u`
396046×	`associate-r`
364305×	`times-frac`

Stop Event

156×	saturated
336×	fuel
1755×	node limit
21×	unsound
203×	done

Compiler

Compiled 422053 to 238551 computations (43.5% saved)

rewrite6.2min (6.2%)

Algorithm

1719×

batch-egg-rewrite

Rules

1124701×	`log1p-expm1-u`
837128×	`expm1-log1p-u`
365426×	`pow1`
355159×	`add-exp-log`
343611×	`add-log-exp`

Stop Event

1×	saturated
1702×	node limit
16×	unsound

Counts

13904 → 456075

prune5.2min (5.1%)

Counts: 1064157 → 35731
Compiler: Compiled 1645352 to 1089642 computations (33.8% saved)

regimes4.7min (4.7%)

Counts

89696 → 9243

Calls

1191 calls:

27.9s	x
22.7s	z
22.2s	y
18.7s	t
14.0s	a

Compiler

Compiled 90257 to 67764 computations (24.9% saved)

explain3.6min (3.6%)

Results

1.0min	234972×	0	valid
43.5s	33280×	1	valid
21.0s	7340×	2	valid
28.0s	1124×	3	valid
12.9s	146×	4	valid
706.0ms	130×	5	exit

Compiler

Compiled 97018 to 46947 computations (51.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.3min

ival-mult: 30.8s (22.1% of total)

ival-sin: 19.0s (13.7% of total)

ival-div: 17.8s (12.8% of total)

ival-cos: 13.5s (9.7% of total)

ival-pow: 13.4s (9.6% of total)

backward-pass: 12.8s (9.2% of total)

ival-add: 9.0s (6.4% of total)

ival-sub: 8.0s (5.7% of total)

ival-log: 3.6s (2.6% of total)

ival-sqrt: 2.8s (2% of total)

const: 2.4s (1.7% of total)

ival-tan: 2.1s (1.5% of total)

ival-exp: 2.0s (1.4% of total)

ival-neg: 481.0ms (0.3% of total)

ival-atan: 405.0ms (0.3% of total)

ival-atan2: 201.0ms (0.1% of total)

ival-fabs: 155.0ms (0.1% of total)

ival-asin: 123.0ms (0.1% of total)

ival-pi: 116.0ms (0.1% of total)

ival-acos: 102.0ms (0.1% of total)

ival-hypot: 88.0ms (0.1% of total)

ival-cbrt: 80.0ms (0.1% of total)

ival-floor: 45.0ms (0% of total)

ival-sinh: 43.0ms (0% of total)

ival->=: 35.0ms (0% of total)

ival-fmod: 35.0ms (0% of total)

ival-if: 30.0ms (0% of total)

ival-fmax: 22.0ms (0% of total)

ival-fma: 17.0ms (0% of total)

ival-log1p: 17.0ms (0% of total)

ival-log2: 15.0ms (0% of total)

ival-cosh: 14.0ms (0% of total)

ival-copysign: 11.0ms (0% of total)

ival-tanh: 8.0ms (0% of total)

ival->: 5.0ms (0% of total)

ival-<: 4.0ms (0% of total)

bsearch2.7min (2.7%)

Algorithm

4582×	binary-search
639×	left-value

Stop Event

128×	predicate-same
4454×	narrow-enough

Results

1.5min	528326×	0	valid
17.7s	31353×	1	valid
2.3s	13125×	0	invalid
2.6s	3701×	2	valid
581.0ms	789×	3	valid
157.0ms	372×	1	invalid
73.0ms	122×	2	invalid
10.0ms	109×	0	unsamplable
18.0ms	23×	4	valid
1.0ms	1×	5	exit

Compiler

Compiled 1127141 to 838218 computations (25.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.3min

ival-mult: 28.5s (35.8% of total)

ival-sub: 11.4s (14.3% of total)

ival-add: 9.9s (12.4% of total)

ival-div: 8.3s (10.4% of total)

ival-sin: 4.2s (5.3% of total)

ival-cos: 3.2s (4% of total)

ival-pow: 3.1s (3.9% of total)

backward-pass: 2.9s (3.6% of total)

ival-log: 2.1s (2.6% of total)

ival-sqrt: 1.9s (2.4% of total)

const: 1.2s (1.5% of total)

ival-exp: 955.0ms (1.2% of total)

ival-tan: 509.0ms (0.6% of total)

ival-neg: 448.0ms (0.6% of total)

ival-atan2: 384.0ms (0.5% of total)

ival-acos: 181.0ms (0.2% of total)

ival-atan: 116.0ms (0.1% of total)

ival-pi: 79.0ms (0.1% of total)

ival-asin: 66.0ms (0.1% of total)

ival-fabs: 44.0ms (0.1% of total)

ival-sinh: 25.0ms (0% of total)

ival-hypot: 21.0ms (0% of total)

ival-tanh: 18.0ms (0% of total)

ival-copysign: 11.0ms (0% of total)

ival->=: 10.0ms (0% of total)

ival-if: 8.0ms (0% of total)

ival-cbrt: 6.0ms (0% of total)

ival-cosh: 3.0ms (0% of total)

preprocess2.2min (2.2%)

Algorithm

541×	egg-herbie

Rules

254085×	`fma-define`
251881×	`fma-neg`
118912×	`unsub-neg`
100986×	`sub-neg`
94619×	`distribute-lft-in`

Stop Event

293×	saturated
248×	node limit

Compiler

Compiled 374258 to 209258 computations (44.1% saved)

series2.2min (2.1%)

Counts

13904 → 348856

Calls

85245 calls:

Time	Variable		Point	Expression
526.0ms	cosTheta	@	0	(* (* (cbrt (/ 1 (PI))) (cbrt (pow (PI) -1/2))) (/ (sqrt (- (- 1 cosTheta) cosTheta)) cosTheta))
507.0ms	y	@	inf	(- x (/ (* y (- (exp z) 1)) t))
420.0ms	dX.u	@	0	(log (fmax (+ (pow (* dX.u (floor w)) 2) (pow (* dX.v (floor h)) 2)) (pow (sqrt (+ (* (* (floor d) dY.w) (* (floor d) dY.w)) (* (sqrt (+ (* (* (floor w) dY.u) (* (floor w) dY.u)) (* (* (floor h) dY.v) (* (floor h) dY.v)))) (sqrt (+ (* (* (floor w) dY.u) (* (floor w) dY.u)) (* (* (floor h) dY.v) (* (floor h) dY.v))))))) 2)))
337.0ms	y	@	-inf	(* (/ (- y z) (+ t (- 1 z))) (+ -1 (/ a x)))
331.0ms	h	@	-inf	(log (fmax (+ (pow (* dX.v (floor h)) 2) (pow (* dX.w (floor d)) 2)) (pow (* (floor d) dY.w) 2)))

analyze1.9min (1.9%)

Algorithm

544×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	84.4%	15.6%	0%	0%	0%	0
39.7%	33.5%	50.9%	15.6%	0%	0%	0%	1
45.4%	38%	45.6%	15.6%	0%	0.7%	0%	2
54.5%	44.4%	37.1%	15.8%	0%	2.7%	0%	3
61.1%	49.3%	31.3%	15.8%	0%	3.6%	0%	4
67.3%	54%	26.2%	15.8%	0%	4%	0%	5
71.2%	56.8%	23%	15.9%	0%	4.3%	0%	6
75.1%	59.5%	19.7%	15.9%	0%	4.8%	0.1%	7
77.1%	60.8%	18%	15.9%	0%	5.2%	0.1%	8
79.7%	62.6%	15.9%	16%	0%	5.4%	0.1%	9
81.2%	63.5%	14.7%	16%	0%	5.7%	0.1%	10
83.5%	65.2%	12.9%	16%	0%	5.8%	0.1%	11
84.6%	65.8%	12%	16%	0%	6%	0.1%	12

Compiler

Compiled 13430 to 8677 computations (35.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.2min

ival-mult: 20.3s (27.9% of total)

ival-div: 12.5s (17.2% of total)

ival-pow: 6.6s (9.1% of total)

ival-add: 5.5s (7.6% of total)

ival-sub: 5.2s (7.2% of total)

ival-<=: 3.7s (5.1% of total)

ival-sqrt: 3.0s (4.2% of total)

ival-cos: 2.6s (3.6% of total)

ival-sin: 2.6s (3.5% of total)

ival-fabs: 1.9s (2.6% of total)

const: 1.2s (1.6% of total)

ival-tan: 799.0ms (1.1% of total)

ival-log: 743.0ms (1% of total)

ival-<: 743.0ms (1% of total)

ival-floor: 721.0ms (1% of total)

ival-exp: 651.0ms (0.9% of total)

ival-and: 648.0ms (0.9% of total)

ival-neg: 612.0ms (0.8% of total)

ival-if: 553.0ms (0.8% of total)

ival-==: 308.0ms (0.4% of total)

ival-fmax: 301.0ms (0.4% of total)

ival-atan2: 220.0ms (0.3% of total)

ival-log2: 198.0ms (0.3% of total)

ival-pi: 143.0ms (0.2% of total)

ival->: 131.0ms (0.2% of total)

ival-acos: 126.0ms (0.2% of total)

backward-pass: 124.0ms (0.2% of total)

ival-atan: 117.0ms (0.2% of total)

ival->=: 115.0ms (0.2% of total)

ival-asin: 79.0ms (0.1% of total)

ival-fmod: 53.0ms (0.1% of total)

ival-sinh: 42.0ms (0.1% of total)

ival-cosh: 28.0ms (0% of total)

ival-or: 23.0ms (0% of total)

ival-cbrt: 19.0ms (0% of total)

ival-tanh: 8.0ms (0% of total)

ival-fmin: 6.0ms (0% of total)

ival-atanh: 1.0ms (0% of total)

ival-asinh: 0.0ms (0% of total)

ival-hypot: 0.0ms (0% of total)

ival-fma: 0.0ms (0% of total)

ival-acosh: 0.0ms (0% of total)

end3.0ms (0%)

Precisions: Click to see histograms. Total time spent on operations: 5.7s
backward-pass: 3.5s (60.8% of total)
ival-mult: 2.2s (39.1% of total)

sample22.9min (22.9%)

localize21.6min (21.5%)

simplify9.9min (9.9%)

eval8.7min (8.7%)

soundness8.4min (8.4%)

rewrite6.2min (6.2%)

prune5.2min (5.1%)

regimes4.7min (4.7%)

explain3.6min (3.6%)

bsearch2.7min (2.7%)

preprocess2.2min (2.2%)

series2.2min (2.1%)

analyze1.9min (1.9%)

end3.0ms (0%)

Profiling