Metrics for Herbie run

Date:	Friday, April 12th, 2024
Commit:	f7c2f43b on zane-regimes-lt-or-eq
Hostname:	nightly with Racket 8.11.1
Seed:	2024103
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample23.5min (23.2%)

Results

8.0min	3882656×	0	valid
3.2min	470632×	1	valid
27.7s	181450×	0	invalid
24.6s	143464×	0	precondition
3.0min	94086×	5	exit
1.5min	94083×	2	valid
15.1s	61099×	0	unsamplable
1.1min	17032×	3	valid
8.6s	15007×	1	invalid
22.5s	2102×	4	valid
848.0ms	1168×	2	invalid
36.0ms	43×	1	unsamplable
15.0ms	7×	5	valid
9.0ms	3×	4	unsamplable
3.0ms	2×	2	unsamplable
3.0ms	1×	3	unsamplable

Precisions

Click to see histograms. Total time spent on operations: 14.4min

ival-mult: 2.8min (19.3% of total)

ival-sin: 1.5min (10.1% of total)

ival-div: 1.4min (9.9% of total)

ival-pow: 1.3min (9.1% of total)

backward-pass: 1.2min (8.1% of total)

ival-add: 1.1min (7.7% of total)

ival-sub: 1.0min (6.9% of total)

ival-cos: 50.1s (5.8% of total)

ival-exp: 42.0s (4.9% of total)

ival-log: 25.4s (2.9% of total)

ival-<=: 24.7s (2.9% of total)

ival-sqrt: 22.8s (2.6% of total)

ival-tan: 17.2s (2% of total)

const: 14.8s (1.7% of total)

<compiled-spec>: 8.0s (0.9% of total)

ival-neg: 7.7s (0.9% of total)

ival-fabs: 7.3s (0.8% of total)

ival-<: 6.1s (0.7% of total)

ival-and: 3.8s (0.4% of total)

ival-pi: 2.5s (0.3% of total)

ival-acos: 2.0s (0.2% of total)

ival-asin: 2.0s (0.2% of total)

ival->: 1.9s (0.2% of total)

ival-atan: 1.9s (0.2% of total)

ival-atan2: 1.8s (0.2% of total)

ival-sinh: 1.2s (0.1% of total)

ival-fmin: 1.1s (0.1% of total)

ival-floor: 864.0ms (0.1% of total)

ival-fmod: 843.0ms (0.1% of total)

ival-cosh: 684.0ms (0.1% of total)

ival-cbrt: 667.0ms (0.1% of total)

ival-==: 659.0ms (0.1% of total)

ival-if: 404.0ms (0% of total)

ival->=: 397.0ms (0% of total)

ival-fmax: 352.0ms (0% of total)

ival-asinh: 283.0ms (0% of total)

ival-acosh: 270.0ms (0% of total)

ival-log2: 245.0ms (0% of total)

ival-atanh: 144.0ms (0% of total)

ival-tanh: 94.0ms (0% of total)

ival-or: 80.0ms (0% of total)

Bogosity

localize22.5min (22.2%)

Results

4.9min	375951×	256	valid
40.5s	24973×	256	invalid
2.4min	21993×	1024	valid
2.4min	13705×	2048	valid
44.2s	12163×	512	valid
6.4min	9050×	8192	exit
4.2s	2653×	256	unsamplable
46.6s	1666×	4096	valid
1.9s	217×	1024	invalid
18.2s	167×	8192	valid
588.0ms	100×	2048	unsamplable
565.0ms	98×	512	invalid
640.0ms	62×	2048	invalid
75.0ms	38×	1024	unsamplable
37.0ms	30×	512	unsamplable
97.0ms	18×	4096	invalid
14.0ms	4×	4096	unsamplable

Compiler

Compiled 450728 to 205341 computations (54.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 17.2min

ival-mult: 3.2min (18.4% of total)

ival-pow: 2.9min (16.6% of total)

ival-sin: 2.0min (11.4% of total)

ival-div: 1.4min (8.3% of total)

ival-cos: 1.3min (7.5% of total)

<compiled-spec>: 1.2min (6.7% of total)

ival-add: 58.6s (5.7% of total)

ival-tan: 42.7s (4.1% of total)

ival-log: 40.4s (3.9% of total)

ival-sub: 36.4s (3.5% of total)

ival-exp: 31.9s (3.1% of total)

ival-asin: 24.3s (2.4% of total)

ival-sqrt: 23.7s (2.3% of total)

ival-atan: 17.9s (1.7% of total)

const: 14.6s (1.4% of total)

ival-cbrt: 8.9s (0.9% of total)

ival-acos: 8.0s (0.8% of total)

ival-atan2: 3.9s (0.4% of total)

ival-neg: 3.4s (0.3% of total)

ival-fmod: 1.5s (0.1% of total)

ival-fmax: 1.2s (0.1% of total)

ival-fabs: 491.0ms (0% of total)

ival->=: 440.0ms (0% of total)

ival-if: 414.0ms (0% of total)

ival-pi: 328.0ms (0% of total)

ival-sinh: 261.0ms (0% of total)

ival-e: 210.0ms (0% of total)

ival-log2: 178.0ms (0% of total)

ival-floor: 111.0ms (0% of total)

ival->: 103.0ms (0% of total)

ival-copysign: 102.0ms (0% of total)

ival-cosh: 76.0ms (0% of total)

ival-<: 29.0ms (0% of total)

ival-tanh: 18.0ms (0% of total)

simplify9.7min (9.6%)

Algorithm

2226×

egg-herbie

Rules

675297×	`fma-define`
493602×	`*-commutative`
488229×	`distribute-lft-in`
478052×	`fma-neg`
473442×	`associate-r`

Stop Event

538×	saturated
1668×	node limit
20×	unsound

Counts

775276 → 685725

soundness8.3min (8.2%)

Rules

646394×	`fma-define`
474574×	`log1p-expm1-u`
469591×	`fma-neg`
397074×	`associate-r`
364726×	`distribute-lft-in`

Stop Event

155×	saturated
331×	fuel
1802×	node limit
17×	unsound
208×	done

Compiler

Compiled 438657 to 245616 computations (44% saved)

eval7.8min (7.7%)

Compiler: Compiled 35785771 to 18473748 computations (48.4% saved)

rewrite6.1min (6%)

Algorithm

1687×

batch-egg-rewrite

Rules

1107589×	`log1p-expm1-u`
823274×	`expm1-log1p-u`
363808×	`pow1`
345912×	`add-exp-log`
333725×	`add-log-exp`

Stop Event

1675×	node limit
12×	unsound

Counts

13408 → 436319

prune5.1min (5%)

Counts: 1009635 → 34410
Compiler: Compiled 1585010 to 1060367 computations (33.1% saved)

regimes5.1min (5%)

Counts

93237 → 10286

Calls

1193 calls:

28.8s	x
25.8s	y
23.9s	z
19.1s	t
14.9s	a

Compiler

Compiled 92861 to 70085 computations (24.5% saved)

explain4.1min (4%)

Results

1.1min	241156×	256	valid
33.2s	16476×	1024	valid
10.6s	9660×	512	valid
28.1s	8068×	2048	valid
34.8s	1352×	4096	valid
18.8s	154×	8192	valid
210.0ms	126×	8192	exit

Compiler

Compiled 97018 to 46947 computations (51.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.6min

ival-mult: 32.9s (21% of total)

ival-sin: 28.0s (17.9% of total)

ival-cos: 20.4s (13% of total)

ival-div: 20.3s (13% of total)

ival-pow: 16.8s (10.8% of total)

ival-add: 9.7s (6.2% of total)

ival-sub: 9.1s (5.8% of total)

ival-log: 5.2s (3.3% of total)

ival-tan: 3.3s (2.1% of total)

ival-sqrt: 3.1s (2% of total)

const: 2.5s (1.6% of total)

ival-exp: 2.1s (1.3% of total)

ival-neg: 696.0ms (0.4% of total)

ival-atan: 686.0ms (0.4% of total)

<compiled-spec>: 343.0ms (0.2% of total)

ival-atan2: 318.0ms (0.2% of total)

ival-asin: 248.0ms (0.2% of total)

ival-acos: 166.0ms (0.1% of total)

ival-sinh: 164.0ms (0.1% of total)

ival-pi: 128.0ms (0.1% of total)

ival-cbrt: 111.0ms (0.1% of total)

ival-fabs: 79.0ms (0.1% of total)

ival->=: 65.0ms (0% of total)

ival-floor: 46.0ms (0% of total)

ival-fmod: 40.0ms (0% of total)

ival-cosh: 35.0ms (0% of total)

ival-if: 30.0ms (0% of total)

ival-fmax: 25.0ms (0% of total)

ival-log2: 22.0ms (0% of total)

ival-copysign: 15.0ms (0% of total)

ival-tanh: 10.0ms (0% of total)

ival->: 5.0ms (0% of total)

ival-<: 4.0ms (0% of total)

bsearch3.0min (2.9%)

Algorithm

5308×	binary-search
711×	left-value

Stop Event

125×	predicate-same
5183×	narrow-enough

Results

1.7min	598273×	0	valid
20.4s	40177×	1	valid
2.1s	16779×	0	invalid
3.4s	5194×	2	valid
1.3s	1317×	3	valid
43.0ms	281×	0	unsamplable
46.0ms	156×	1	invalid
350.0ms	79×	4	valid
29.0ms	63×	2	invalid
1.0ms	1×	5	exit

Compiler

Compiled 1285948 to 953246 computations (25.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.5min

ival-mult: 31.7s (36% of total)

ival-sub: 12.0s (13.7% of total)

ival-add: 10.6s (12% of total)

ival-div: 9.0s (10.2% of total)

ival-sin: 4.6s (5.2% of total)

ival-pow: 3.8s (4.4% of total)

backward-pass: 3.2s (3.6% of total)

ival-cos: 3.1s (3.5% of total)

ival-log: 2.5s (2.9% of total)

ival-sqrt: 2.3s (2.7% of total)

ival-exp: 1.4s (1.6% of total)

const: 1.4s (1.6% of total)

ival-neg: 597.0ms (0.7% of total)

ival-tan: 557.0ms (0.6% of total)

ival-atan2: 453.0ms (0.5% of total)

ival-acos: 245.0ms (0.3% of total)

ival-atan: 208.0ms (0.2% of total)

ival-pi: 144.0ms (0.2% of total)

ival-fabs: 58.0ms (0.1% of total)

ival-asin: 40.0ms (0% of total)

ival-copysign: 20.0ms (0% of total)

ival-tanh: 16.0ms (0% of total)

ival->=: 8.0ms (0% of total)

ival-if: 7.0ms (0% of total)

ival-cosh: 3.0ms (0% of total)

ival-cbrt: 3.0ms (0% of total)

ival-sinh: 0.0ms (0% of total)

preprocess2.3min (2.2%)

Algorithm

541×	egg-herbie

Rules

254085×	`fma-define`
251881×	`fma-neg`
118912×	`unsub-neg`
100986×	`sub-neg`
94619×	`distribute-lft-in`

Stop Event

293×	saturated
248×	node limit

Compiler

Compiled 389780 to 214076 computations (45.1% saved)

series2.1min (2.1%)

Counts

13408 → 338957

Calls

82608 calls:

Time	Variable		Point	Expression
475.0ms	x	@	0	(log (log (/ x y)))
359.0ms	a	@	-inf	(* a (+ (* -3/8 (/ (pow c 2) (pow b 3))) (* a (+ (* -9/16 (/ (pow c 3) (pow b 5))) (* -135/128 (/ (* a (pow c 4)) (pow b 7)))))))
340.0ms	c	@	0	(+ (+ (+ (+ (+ (* x (log y)) z) t) a) (* (- b 1/2) (log c))) (* y i))
314.0ms	ky	@	0	(/ (sin th) (sqrt (+ (* (sin ky) (sin ky)) (* (sin kx) (sin kx)))))
306.0ms	ky	@	0	(* (sin ky) (/ (sin th) (sqrt (+ (* (sin ky) (sin ky)) (* (sin kx) (sin kx))))))

analyze1.9min (1.9%)

Algorithm

544×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	84.4%	15.6%	0%	0%	0%	0
39.4%	33.3%	51.1%	15.6%	0%	0%	0%	1
45.3%	37.9%	45.7%	15.6%	0%	0.7%	0%	2
54.4%	44.4%	37.2%	15.8%	0%	2.7%	0%	3
61.1%	49.2%	31.4%	15.8%	0%	3.6%	0%	4
67.2%	53.9%	26.3%	15.8%	0%	4%	0%	5
71.1%	56.7%	23%	15.9%	0%	4.3%	0%	6
75%	59.4%	19.8%	15.9%	0%	4.8%	0.1%	7
77%	60.7%	18.1%	15.9%	0%	5.2%	0.1%	8
79.6%	62.5%	16%	16%	0%	5.4%	0.1%	9
81.2%	63.5%	14.7%	16%	0%	5.7%	0.1%	10
83.4%	65.1%	12.9%	16%	0%	5.8%	0.1%	11
84.5%	65.8%	12%	16%	0%	6%	0.1%	12

Compiler

Compiled 13430 to 8677 computations (35.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.1min

ival-mult: 17.5s (25.5% of total)

ival-add: 8.6s (12.5% of total)

ival-div: 8.2s (11.9% of total)

ival-pow: 5.9s (8.6% of total)

ival-sub: 4.3s (6.2% of total)

ival-sqrt: 3.7s (5.3% of total)

ival-cos: 3.5s (5.1% of total)

ival-<=: 3.2s (4.6% of total)

ival-sin: 2.6s (3.8% of total)

ival-fabs: 2.1s (3.1% of total)

const: 1.2s (1.7% of total)

ival-exp: 885.0ms (1.3% of total)

ival-floor: 881.0ms (1.3% of total)

ival-log: 735.0ms (1.1% of total)

ival-if: 729.0ms (1.1% of total)

ival-and: 662.0ms (1% of total)

ival-neg: 609.0ms (0.9% of total)

ival-tan: 563.0ms (0.8% of total)

ival-==: 555.0ms (0.8% of total)

ival-fmax: 459.0ms (0.7% of total)

ival-<: 382.0ms (0.6% of total)

ival-atan2: 291.0ms (0.4% of total)

ival-atan: 215.0ms (0.3% of total)

ival-log2: 200.0ms (0.3% of total)

ival-pi: 158.0ms (0.2% of total)

ival-acos: 136.0ms (0.2% of total)

ival->: 135.0ms (0.2% of total)

ival->=: 97.0ms (0.1% of total)

ival-asin: 84.0ms (0.1% of total)

ival-fmod: 74.0ms (0.1% of total)

ival-sinh: 32.0ms (0% of total)

ival-cbrt: 27.0ms (0% of total)

ival-or: 22.0ms (0% of total)

ival-cosh: 16.0ms (0% of total)

ival-tanh: 8.0ms (0% of total)

ival-fmin: 6.0ms (0% of total)

ival-atanh: 1.0ms (0% of total)

ival-asinh: 0.0ms (0% of total)

<compiled-spec>: 0.0ms (0% of total)

ival-acosh: 0.0ms (0% of total)

end3.0ms (0%)

Precisions: Click to see histograms. Total time spent on operations: 5.7s
ival-cos: 3.1s (53.8% of total)
ival-pow: 2.6s (46.2% of total)

sample23.5min (23.2%)

localize22.5min (22.2%)

simplify9.7min (9.6%)

soundness8.3min (8.2%)

eval7.8min (7.7%)

rewrite6.1min (6%)

prune5.1min (5%)

regimes5.1min (5%)

explain4.1min (4%)

bsearch3.0min (2.9%)

preprocess2.3min (2.2%)

series2.1min (2.1%)

analyze1.9min (1.9%)

end3.0ms (0%)

Profiling