Metrics for Herbie run

Date:	Tuesday, March 26th, 2024
Commit:	79027280 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024086
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample27.9min (23.6%)

Results

9.0min	3352198×	0	valid
1.4min	527568×	0	infinite
3.2min	448933×	1	valid
34.5s	189618×	0	invalid
25.1s	145213×	0	precondition
4.3min	123883×	5	exit
1.5min	92396×	2	valid
14.6s	60621×	0	unsamplable
12.6s	16445×	1	infinite
1.0min	15626×	3	valid
9.0s	14897×	1	invalid
23.4s	2083×	4	valid
4.0s	1848×	2	infinite
958.0ms	1199×	2	invalid
4.4s	1158×	3	infinite
34.0ms	40×	1	unsamplable
24.0ms	11×	5	valid
53.0ms	4×	4	infinite
2.0ms	1×	3	unsamplable

Precisions

Click to see histograms. Total time spent on operations: 16.1min

ival-mult: 3.1min (19% of total)

ival-div: 1.5min (9.4% of total)

ival-sin: 1.5min (9% of total)

ival-cos: 1.4min (8.8% of total)

ival-pow: 1.3min (8.3% of total)

backward-pass: 1.3min (7.8% of total)

ival-add: 1.2min (7.2% of total)

ival-exp: 1.1min (6.5% of total)

ival-sub: 1.0min (6.4% of total)

ival-sqrt: 27.0s (2.8% of total)

ival-log: 24.7s (2.6% of total)

ival-<=: 19.5s (2% of total)

ival-tan: 18.3s (1.9% of total)

const: 16.2s (1.7% of total)

composed: 9.8s (1% of total)

ival-neg: 9.2s (1% of total)

ival-<: 6.6s (0.7% of total)

ival-fabs: 5.8s (0.6% of total)

ival-fmod: 5.5s (0.6% of total)

ival-and: 3.9s (0.4% of total)

ival-pi: 3.3s (0.3% of total)

ival-if: 2.8s (0.3% of total)

ival-asin: 2.4s (0.3% of total)

ival-acos: 2.1s (0.2% of total)

ival-atan: 2.0s (0.2% of total)

ival->: 1.9s (0.2% of total)

ival-atan2: 1.8s (0.2% of total)

ival-sinh: 1.3s (0.1% of total)

ival-floor: 809.0ms (0.1% of total)

ival-==: 707.0ms (0.1% of total)

ival-fmin: 680.0ms (0.1% of total)

ival-cbrt: 652.0ms (0.1% of total)

ival->=: 508.0ms (0.1% of total)

ival-fmax: 445.0ms (0% of total)

ival-cosh: 334.0ms (0% of total)

ival-acosh: 276.0ms (0% of total)

ival-asinh: 244.0ms (0% of total)

ival-atanh: 180.0ms (0% of total)

ival-log2: 124.0ms (0% of total)

ival-tanh: 99.0ms (0% of total)

ival-or: 84.0ms (0% of total)

Bogosity

localize24.3min (20.5%)

Results

4.6min	329848×	256	valid
31.2s	45010×	256	infinite
42.6s	27226×	256	invalid
2.2min	20163×	1024	valid
2.1min	12640×	2048	valid
40.0s	11498×	512	valid
7.0min	9721×	8192	exit
2.5s	2158×	256	unsamplable
43.4s	1357×	4096	valid
16.3s	1236×	1024	infinite
17.8s	1204×	2048	infinite
4.1s	466×	512	infinite
6.3s	311×	1024	invalid
6.5s	228×	4096	infinite
2.6s	211×	512	invalid
1.2s	106×	2048	invalid
9.9s	57×	8192	valid
122.0ms	48×	2048	unsamplable
51.0ms	27×	1024	unsamplable
11.0ms	10×	512	unsamplable
97.0ms	9×	4096	invalid
3.0ms	1×	4096	unsamplable
1.1s	1×	8192	infinite

Compiler

Compiled 454638 to 205775 computations (54.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 18.0min

ival-mult: 3.2min (17.5% of total)

ival-sin: 2.9min (16.3% of total)

ival-pow: 2.9min (15.9% of total)

ival-cos: 1.5min (8.4% of total)

ival-div: 1.5min (8.4% of total)

composed: 1.2min (6.9% of total)

ival-add: 1.1min (5.9% of total)

ival-log: 43.7s (4% of total)

ival-sub: 38.6s (3.6% of total)

ival-tan: 29.5s (2.7% of total)

ival-exp: 26.4s (2.4% of total)

ival-sqrt: 23.6s (2.2% of total)

const: 15.5s (1.4% of total)

ival-atan: 12.4s (1.1% of total)

ival-asin: 9.9s (0.9% of total)

ival-cbrt: 6.6s (0.6% of total)

ival-acos: 6.2s (0.6% of total)

ival-neg: 3.4s (0.3% of total)

ival-atan2: 3.1s (0.3% of total)

ival-fmax: 893.0ms (0.1% of total)

ival-sinh: 413.0ms (0% of total)

ival->=: 388.0ms (0% of total)

ival-fmod: 372.0ms (0% of total)

ival-if: 363.0ms (0% of total)

ival-pi: 363.0ms (0% of total)

ival-fabs: 348.0ms (0% of total)

ival-log2: 113.0ms (0% of total)

ival-cosh: 112.0ms (0% of total)

ival-e: 111.0ms (0% of total)

ival->: 104.0ms (0% of total)

ival-floor: 99.0ms (0% of total)

ival-copysign: 74.0ms (0% of total)

ival-<: 43.0ms (0% of total)

ival-tanh: 10.0ms (0% of total)

eval13.1min (11.1%)

Compiler: Compiled 39024509 to 19351363 computations (50.4% saved)

simplify9.7min (8.2%)

Algorithm

2235×

egg-herbie

Rules

676367×	`fma-define`
501530×	`distribute-lft-in`
491039×	`*-commutative`
481060×	`fma-neg`
468147×	`associate-r`

Stop Event

536×	saturated
1683×	node limit
16×	unsound

Counts

784650 → 683617

soundness8.3min (7%)

Rules

611580×	`fma-define`
456865×	`fma-neg`
419410×	`log1p-expm1-u`
388026×	`associate-r`
358317×	`times-frac`

Stop Event

152×	saturated
325×	fuel
1737×	node limit
15×	unsound
212×	done

Compiler

Compiled 416358 to 232739 computations (44.1% saved)

analyze6.2min (5.3%)

Algorithm

544×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	84.4%	15.6%	0%	0%	0%	0
39.4%	33.3%	51.1%	15.6%	0%	0%	0%	1
45.3%	37.9%	45.7%	15.6%	0%	0.7%	0%	2
54.4%	44.4%	37.2%	15.8%	0%	2.7%	0%	3
61.1%	49.2%	31.4%	15.8%	0%	3.6%	0%	4
67.2%	53.9%	26.3%	15.8%	0%	4%	0%	5
71.1%	56.7%	23%	15.9%	0%	4.3%	0%	6
75%	59.4%	19.8%	15.9%	0%	4.8%	0.1%	7
77%	60.7%	18.1%	15.9%	0%	5.2%	0.1%	8
79.6%	62.5%	16%	16%	0%	5.4%	0.1%	9
81.2%	63.5%	14.7%	16%	0%	5.7%	0.1%	10
83.4%	65.1%	12.9%	16%	0%	5.8%	0.1%	11
84.5%	65.8%	12%	16%	0%	6%	0.1%	12

Compiler

Compiled 13430 to 8677 computations (35.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 3.6min

ival-mult: 1.0min (28.1% of total)

ival-<=: 39.0s (17.9% of total)

ival-fabs: 27.0s (12.4% of total)

ival-add: 15.5s (7.1% of total)

ival-floor: 11.9s (5.5% of total)

ival-div: 11.7s (5.4% of total)

ival-sqrt: 6.6s (3% of total)

ival-pow: 6.5s (3% of total)

ival-and: 6.1s (2.8% of total)

ival-sub: 5.2s (2.4% of total)

ival-log2: 5.1s (2.3% of total)

const: 4.2s (1.9% of total)

ival-fmax: 3.1s (1.4% of total)

ival-sin: 2.9s (1.3% of total)

ival-cos: 2.4s (1.1% of total)

ival-tan: 2.2s (1% of total)

ival-if: 1.5s (0.7% of total)

ival-==: 1.2s (0.5% of total)

ival-log: 714.0ms (0.3% of total)

ival-exp: 680.0ms (0.3% of total)

ival-<: 635.0ms (0.3% of total)

ival-neg: 546.0ms (0.3% of total)

ival->: 384.0ms (0.2% of total)

ival->=: 325.0ms (0.1% of total)

ival-atan2: 272.0ms (0.1% of total)

ival-or: 262.0ms (0.1% of total)

ival-pi: 151.0ms (0.1% of total)

ival-atan: 149.0ms (0.1% of total)

ival-acos: 127.0ms (0.1% of total)

ival-asin: 87.0ms (0% of total)

ival-fmod: 76.0ms (0% of total)

ival-sinh: 31.0ms (0% of total)

ival-cbrt: 18.0ms (0% of total)

ival-cosh: 14.0ms (0% of total)

ival-tanh: 8.0ms (0% of total)

ival-fmin: 6.0ms (0% of total)

ival-atanh: 1.0ms (0% of total)

composed: 0.0ms (0% of total)

ival-asinh: 0.0ms (0% of total)

ival-acosh: 0.0ms (0% of total)

rewrite6.1min (5.2%)

Algorithm

1698×

batch-egg-rewrite

Rules

1109446×	`log1p-expm1-u`
846111×	`expm1-log1p-u`
363227×	`pow1`
349096×	`add-exp-log`
334999×	`add-log-exp`

Stop Event

1686×	node limit
12×	unsound

Counts

13430 → 441728

prune5.2min (4.4%)

Counts: 1036941 → 35034
Compiler: Compiled 1613315 to 1075885 computations (33.3% saved)

regimes5.0min (4.3%)

Counts

93752 → 9551

Calls

1178 calls:

24.7s	x
22.8s	z
22.3s	y
18.1s	t
16.1s	a

Compiler

Compiled 90287 to 68304 computations (24.3% saved)

explain4.2min (3.5%)

Results

1.0min	208966×	256	valid
10.2s	31796×	256	infinite
28.2s	15358×	1024	valid
8.7s	8928×	512	valid
26.9s	7794×	2048	valid
31.0s	1204×	4096	valid
4.9s	910×	1024	infinite
1.4s	474×	512	infinite
706.0ms	414×	8192	exit
2.5s	338×	2048	infinite
2.5s	158×	4096	infinite
17.7s	138×	8192	valid
454.0ms	2×	8192	infinite

Compiler

Compiled 96190 to 46852 computations (51.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.6min

ival-mult: 32.1s (20.6% of total)

ival-sin: 26.0s (16.7% of total)

ival-div: 22.0s (14.2% of total)

ival-cos: 19.8s (12.7% of total)

ival-pow: 14.9s (9.6% of total)

ival-add: 10.9s (7% of total)

ival-sub: 9.0s (5.8% of total)

ival-log: 5.4s (3.5% of total)

ival-tan: 3.5s (2.2% of total)

ival-sqrt: 3.4s (2.2% of total)

const: 2.6s (1.7% of total)

ival-exp: 2.2s (1.4% of total)

ival-atan: 864.0ms (0.6% of total)

composed: 613.0ms (0.4% of total)

ival-neg: 532.0ms (0.3% of total)

ival-atan2: 389.0ms (0.3% of total)

ival-asin: 327.0ms (0.2% of total)

ival-acos: 180.0ms (0.1% of total)

ival-pi: 131.0ms (0.1% of total)

ival-cbrt: 95.0ms (0.1% of total)

ival-sinh: 84.0ms (0.1% of total)

ival-fabs: 71.0ms (0% of total)

ival-fmod: 42.0ms (0% of total)

ival->=: 37.0ms (0% of total)

ival-floor: 37.0ms (0% of total)

ival-if: 33.0ms (0% of total)

ival-fmax: 22.0ms (0% of total)

ival-copysign: 19.0ms (0% of total)

ival-tanh: 14.0ms (0% of total)

ival-cosh: 12.0ms (0% of total)

ival-log2: 10.0ms (0% of total)

ival-<: 7.0ms (0% of total)

ival->: 5.0ms (0% of total)

bsearch3.3min (2.8%)

Algorithm

4888×	binary-search
585×	left-value

Stop Event

110×	predicate-same
4769×	narrow-enough
9×	predicate-failed

Results

1.3min	432529×	0	valid
39.9s	125153×	0	infinite
17.0s	28823×	1	valid
4.3s	22248×	0	invalid
2.2s	3494×	2	valid
1.9s	2502×	1	infinite
2.4s	912×	5	exit
915.0ms	860×	3	valid
145.0ms	315×	1	invalid
57.0ms	294×	0	unsamplable
164.0ms	150×	3	infinite
109.0ms	137×	2	infinite
40.0ms	54×	2	invalid

Compiler

Compiled 1246009 to 926943 computations (25.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.5min

ival-mult: 32.9s (36.3% of total)

ival-sub: 12.8s (14.1% of total)

ival-add: 9.7s (10.7% of total)

ival-div: 8.8s (9.7% of total)

ival-pow: 5.7s (6.3% of total)

ival-sin: 4.5s (4.9% of total)

ival-cos: 3.8s (4.2% of total)

backward-pass: 3.5s (3.9% of total)

ival-sqrt: 2.3s (2.5% of total)

ival-log: 1.8s (1.9% of total)

ival-exp: 1.5s (1.7% of total)

const: 1.4s (1.6% of total)

ival-neg: 541.0ms (0.6% of total)

ival-tan: 427.0ms (0.5% of total)

ival-atan2: 292.0ms (0.3% of total)

ival-atan: 229.0ms (0.3% of total)

ival-fmod: 174.0ms (0.2% of total)

ival-pi: 87.0ms (0.1% of total)

ival-asin: 83.0ms (0.1% of total)

ival-acos: 77.0ms (0.1% of total)

ival-fabs: 41.0ms (0% of total)

ival->=: 14.0ms (0% of total)

ival-if: 12.0ms (0% of total)

ival-copysign: 12.0ms (0% of total)

ival-tanh: 8.0ms (0% of total)

ival-cosh: 6.0ms (0% of total)

ival-cbrt: 4.0ms (0% of total)

ival-sinh: 2.0ms (0% of total)

preprocess2.7min (2.3%)

Algorithm

540×	egg-herbie

Rules

253965×	`fma-define`
251881×	`fma-neg`
117280×	`unsub-neg`
100884×	`sub-neg`
93755×	`distribute-lft-in`

Stop Event

293×	saturated
247×	node limit

Compiler

Compiled 385974 to 213794 computations (44.6% saved)

series2.1min (1.8%)

Counts

13430 → 342922

Calls

82737 calls:

Time	Variable		Point	Expression
638.0ms	a	@	0	(pow (* a (* c -4)) 1/4)
445.0ms	K	@	inf	(cbrt (* J (* (* -2 (cos (* K 1/2))) (sqrt (+ (* 1 1) (* (* U (/ (/ 1/2 J) (cos (* K 1/2)))) (* U (/ (/ 1/2 J) (cos (* K 1/2))))))))))
414.0ms	t	@	0	(log (/ (pow t 3) l))
374.0ms	y	@	-inf	(log (/ x (cbrt y)))
353.0ms	theta	@	-inf	(log (pow (exp (sin phi1)) (+ (* (cos phi1) (* (sin delta) (cos theta))) (* (cos delta) (sin phi1)))))

end5.2s (0.1%)

Precisions: Click to see histograms. Total time spent on operations: 7.1s
ival-pow: 5.9s (82.8% of total)
ival-mult: 1.2s (17.2% of total)

sample27.9min (23.6%)

localize24.3min (20.5%)

eval13.1min (11.1%)

simplify9.7min (8.2%)

soundness8.3min (7%)

analyze6.2min (5.3%)

rewrite6.1min (5.2%)

prune5.2min (4.4%)

regimes5.0min (4.3%)

explain4.2min (3.5%)

bsearch3.3min (2.8%)

preprocess2.7min (2.3%)

series2.1min (1.8%)

end5.2s (0.1%)

Profiling