Metrics for Herbie run

Date:	Friday, April 5th, 2024
Commit:	deef6326 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024096
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize24.6min (23.9%)

Results

4.9min	376559×	256	valid
40.0s	27611×	256	invalid
2.4min	21846×	1024	valid
2.4min	15020×	2048	valid
47.4s	12247×	512	valid
8.2min	10606×	8192	exit
1.9s	2063×	256	unsamplable
54.5s	1767×	4096	valid
19.0s	203×	8192	valid
1.1s	150×	1024	invalid
399.0ms	102×	512	invalid
128.0ms	27×	2048	invalid
49.0ms	16×	2048	unsamplable
12.0ms	8×	1024	unsamplable
7.0ms	7×	512	unsamplable

Compiler

Compiled 463888 to 212102 computations (54.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 19.1min

ival-mult: 3.4min (17.9% of total)

ival-pow: 3.0min (15.9% of total)

ival-sin: 2.5min (13% of total)

ival-cos: 2.2min (11.3% of total)

ival-div: 1.5min (7.9% of total)

<compiled-spec>: 1.1min (5.7% of total)

ival-add: 1.0min (5.4% of total)

ival-log: 41.8s (3.6% of total)

ival-sub: 39.9s (3.5% of total)

ival-tan: 36.4s (3.2% of total)

ival-asin: 29.4s (2.6% of total)

ival-exp: 26.4s (2.3% of total)

ival-sqrt: 25.7s (2.2% of total)

ival-atan: 20.4s (1.8% of total)

const: 15.4s (1.3% of total)

ival-acos: 9.4s (0.8% of total)

ival-cbrt: 8.0s (0.7% of total)

ival-neg: 2.9s (0.3% of total)

ival-atan2: 2.6s (0.2% of total)

ival-fmod: 1.2s (0.1% of total)

ival-fmax: 686.0ms (0.1% of total)

ival-pi: 485.0ms (0% of total)

ival-fabs: 397.0ms (0% of total)

ival-if: 346.0ms (0% of total)

ival-sinh: 284.0ms (0% of total)

ival->=: 282.0ms (0% of total)

ival-e: 208.0ms (0% of total)

ival-cosh: 164.0ms (0% of total)

ival-log2: 154.0ms (0% of total)

ival-floor: 103.0ms (0% of total)

ival-copysign: 87.0ms (0% of total)

ival->: 84.0ms (0% of total)

ival-<: 29.0ms (0% of total)

ival-tanh: 12.0ms (0% of total)

sample23.6min (22.9%)

Results

8.2min	3883067×	0	valid
3.1min	469962×	1	valid
29.0s	180561×	0	invalid
24.2s	143745×	0	precondition
3.0min	94377×	5	exit
1.4min	94293×	2	valid
14.8s	60888×	0	unsamplable
1.1min	17027×	3	valid
8.1s	15004×	1	invalid
23.7s	2159×	4	valid
1.3s	1198×	2	invalid
42.0ms	51×	1	unsamplable
19.0ms	6×	5	valid
1.0ms	1×	2	unsamplable

Precisions

Click to see histograms. Total time spent on operations: 14.5min

ival-mult: 2.9min (19.6% of total)

ival-sin: 1.5min (10.2% of total)

ival-div: 1.4min (9.7% of total)

ival-pow: 1.3min (9.1% of total)

backward-pass: 1.2min (8.1% of total)

ival-add: 1.1min (7.7% of total)

ival-sub: 1.0min (7% of total)

ival-cos: 51.8s (5.9% of total)

ival-exp: 39.5s (4.5% of total)

ival-log: 24.4s (2.8% of total)

ival-sqrt: 23.5s (2.7% of total)

ival-<=: 20.7s (2.4% of total)

ival-tan: 17.9s (2.1% of total)

const: 14.7s (1.7% of total)

ival-neg: 8.8s (1% of total)

<compiled-spec>: 8.7s (1% of total)

ival-<: 6.6s (0.8% of total)

ival-fabs: 6.1s (0.7% of total)

ival-==: 4.1s (0.5% of total)

ival-and: 3.7s (0.4% of total)

ival-pi: 2.7s (0.3% of total)

ival->: 2.0s (0.2% of total)

ival-acos: 2.0s (0.2% of total)

ival-asin: 1.9s (0.2% of total)

ival-atan: 1.6s (0.2% of total)

ival-atan2: 1.5s (0.2% of total)

ival-sinh: 1.3s (0.1% of total)

ival-floor: 968.0ms (0.1% of total)

ival-fmod: 959.0ms (0.1% of total)

ival-cbrt: 898.0ms (0.1% of total)

ival-fmin: 673.0ms (0.1% of total)

ival-if: 453.0ms (0.1% of total)

ival-cosh: 372.0ms (0% of total)

ival->=: 367.0ms (0% of total)

ival-atanh: 358.0ms (0% of total)

ival-fmax: 338.0ms (0% of total)

ival-log2: 311.0ms (0% of total)

ival-acosh: 258.0ms (0% of total)

ival-asinh: 227.0ms (0% of total)

ival-tanh: 161.0ms (0% of total)

ival-or: 79.0ms (0% of total)

Bogosity

simplify10.0min (9.7%)

Algorithm

2256×

egg-herbie

Rules

693620×	`fma-define`
502330×	`*-commutative`
502088×	`distribute-lft-in`
495921×	`fma-neg`
492468×	`associate-r`

Stop Event

544×	saturated
1689×	node limit
23×	unsound

Counts

810187 → 702138

soundness8.4min (8.1%)

Rules

632675×	`fma-define`
461579×	`fma-neg`
437059×	`log1p-expm1-u`
397905×	`associate-r`
373366×	`distribute-lft-in`

Stop Event

157×	saturated
335×	fuel
1790×	node limit
20×	unsound
204×	done

Compiler

Compiled 420423 to 236739 computations (43.7% saved)

eval7.9min (7.7%)

Compiler: Compiled 34943543 to 19055392 computations (45.5% saved)

rewrite6.1min (5.9%)

Algorithm

1716×

batch-egg-rewrite

Rules

1126657×	`log1p-expm1-u`
827060×	`expm1-log1p-u`
372852×	`pow1`
356973×	`add-exp-log`
342054×	`add-log-exp`

Stop Event

1×	saturated
1702×	node limit
13×	unsound

Counts

13978 → 455047

prune5.1min (5%)

Counts: 1040940 → 35130
Compiler: Compiled 1615495 to 1077866 computations (33.3% saved)

regimes4.6min (4.5%)

Counts

86788 → 9267

Calls

1195 calls:

25.9s	x
23.9s	y
23.1s	z
16.9s	t
15.7s	a

Compiler

Compiled 88382 to 66776 computations (24.4% saved)

explain3.9min (3.8%)

Results

1.1min	241330×	256	valid
35.3s	16598×	1024	valid
10.4s	9464×	512	valid
25.6s	7968×	2048	valid
33.1s	1380×	4096	valid
14.9s	150×	8192	valid
282.0ms	102×	8192	exit

Compiler

Compiled 97018 to 46947 computations (51.6% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.5min

ival-mult: 32.8s (21.5% of total)

ival-sin: 24.3s (15.9% of total)

ival-div: 21.3s (13.9% of total)

ival-cos: 19.7s (12.9% of total)

ival-pow: 16.1s (10.5% of total)

ival-add: 10.2s (6.7% of total)

ival-sub: 9.1s (6% of total)

ival-log: 5.3s (3.5% of total)

ival-sqrt: 3.1s (2% of total)

ival-tan: 2.7s (1.8% of total)

const: 2.5s (1.6% of total)

ival-exp: 2.4s (1.6% of total)

ival-atan: 676.0ms (0.4% of total)

ival-neg: 620.0ms (0.4% of total)

ival-asin: 386.0ms (0.3% of total)

<compiled-spec>: 353.0ms (0.2% of total)

ival-atan2: 315.0ms (0.2% of total)

ival-acos: 188.0ms (0.1% of total)

ival-cbrt: 160.0ms (0.1% of total)

ival-pi: 125.0ms (0.1% of total)

ival-sinh: 103.0ms (0.1% of total)

ival-fabs: 72.0ms (0% of total)

ival-floor: 48.0ms (0% of total)

ival-fmod: 45.0ms (0% of total)

ival->=: 39.0ms (0% of total)

ival-if: 32.0ms (0% of total)

ival-fmax: 24.0ms (0% of total)

ival-log2: 18.0ms (0% of total)

ival-copysign: 14.0ms (0% of total)

ival-cosh: 13.0ms (0% of total)

ival-tanh: 10.0ms (0% of total)

ival->: 5.0ms (0% of total)

ival-<: 4.0ms (0% of total)

bsearch2.5min (2.5%)

Algorithm

4589×	binary-search
620×	left-value

Stop Event

126×	predicate-same
4463×	narrow-enough

Results

1.4min	524118×	0	valid
16.9s	27755×	1	valid
2.7s	19697×	0	invalid
2.2s	3440×	2	valid
631.0ms	874×	3	valid
120.0ms	133×	4	valid
89.0ms	112×	0	unsamplable
25.0ms	88×	1	invalid
3.0ms	6×	2	invalid

Compiler

Compiled 1109344 to 821357 computations (26% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.2min

ival-mult: 26.4s (36.1% of total)

ival-sub: 10.6s (14.6% of total)

ival-add: 8.7s (12% of total)

ival-div: 8.0s (11% of total)

ival-sin: 4.0s (5.5% of total)

ival-pow: 2.7s (3.7% of total)

ival-cos: 2.4s (3.3% of total)

backward-pass: 2.3s (3.2% of total)

ival-log: 2.0s (2.8% of total)

ival-sqrt: 1.6s (2.2% of total)

ival-exp: 1.3s (1.7% of total)

const: 1.2s (1.6% of total)

ival-neg: 573.0ms (0.8% of total)

ival-atan2: 447.0ms (0.6% of total)

ival-tan: 302.0ms (0.4% of total)

ival-acos: 125.0ms (0.2% of total)

ival-atan: 83.0ms (0.1% of total)

ival-pi: 60.0ms (0.1% of total)

ival-fabs: 36.0ms (0% of total)

ival-copysign: 26.0ms (0% of total)

ival-asin: 19.0ms (0% of total)

ival-tanh: 18.0ms (0% of total)

ival->=: 16.0ms (0% of total)

ival-sinh: 7.0ms (0% of total)

ival-if: 7.0ms (0% of total)

ival-cbrt: 6.0ms (0% of total)

ival-cosh: 5.0ms (0% of total)

preprocess2.3min (2.2%)

Algorithm

541×	egg-herbie

Rules

254085×	`fma-define`
251881×	`fma-neg`
118912×	`unsub-neg`
100986×	`sub-neg`
94619×	`distribute-lft-in`

Stop Event

293×	saturated
248×	node limit

Compiler

Compiled 361040 to 200276 computations (44.5% saved)

series2.1min (2%)

Counts

13978 → 355140

Calls

85986 calls:

Time	Variable		Point	Expression
380.0ms	v	@	-inf	(/ (+ e 1) (* v e))
358.0ms	phi2	@	inf	(- (exp (* R (sqrt (+ (* (* (- lambda1 lambda2) (cos (* (+ phi1 phi2) 1/2))) (* (- lambda1 lambda2) (cos (* (+ phi1 phi2) 1/2)))) (* (- phi1 phi2) (- phi1 phi2)))))) 1)
323.0ms	h	@	-inf	(log (+ 1 (pow (* (floor h) dX.v) 2)))
321.0ms	re	@	inf	(log (pow base (/ 1 (atan2 im re))))
318.0ms	x	@	-inf	(- (log 2) (log x))

analyze1.8min (1.8%)

Algorithm

544×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	84.4%	15.6%	0%	0%	0%	0
39.4%	33.3%	51.1%	15.6%	0%	0%	0%	1
45.3%	37.9%	45.7%	15.6%	0%	0.7%	0%	2
54.4%	44.4%	37.2%	15.8%	0%	2.7%	0%	3
61.1%	49.2%	31.4%	15.8%	0%	3.6%	0%	4
67.2%	53.9%	26.3%	15.8%	0%	4%	0%	5
71.1%	56.7%	23%	15.9%	0%	4.3%	0%	6
75%	59.4%	19.8%	15.9%	0%	4.8%	0.1%	7
77%	60.7%	18.1%	15.9%	0%	5.2%	0.1%	8
79.6%	62.5%	16%	16%	0%	5.4%	0.1%	9
81.2%	63.5%	14.7%	16%	0%	5.7%	0.1%	10
83.4%	65.1%	12.9%	16%	0%	5.8%	0.1%	11
84.5%	65.8%	12%	16%	0%	6%	0.1%	12

Compiler

Compiled 13430 to 8677 computations (35.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.1min

ival-mult: 17.4s (26.6% of total)

ival-div: 8.5s (12.9% of total)

ival-add: 6.5s (9.9% of total)

ival-pow: 6.0s (9.2% of total)

ival-sub: 4.5s (6.8% of total)

ival-<=: 3.4s (5.3% of total)

ival-sqrt: 2.8s (4.2% of total)

ival-sin: 2.8s (4.2% of total)

ival-fabs: 2.5s (3.8% of total)

ival-cos: 2.3s (3.6% of total)

const: 1.2s (1.9% of total)

ival-log: 928.0ms (1.4% of total)

ival-floor: 812.0ms (1.2% of total)

ival-exp: 742.0ms (1.1% of total)

ival-if: 676.0ms (1% of total)

ival-fmax: 669.0ms (1% of total)

ival-and: 656.0ms (1% of total)

ival-tan: 589.0ms (0.9% of total)

ival-neg: 482.0ms (0.7% of total)

ival-<: 404.0ms (0.6% of total)

ival-==: 280.0ms (0.4% of total)

ival-atan2: 218.0ms (0.3% of total)

ival-log2: 182.0ms (0.3% of total)

ival-cosh: 165.0ms (0.3% of total)

ival-pi: 140.0ms (0.2% of total)

ival-acos: 133.0ms (0.2% of total)

ival->: 127.0ms (0.2% of total)

ival-atan: 104.0ms (0.2% of total)

ival->=: 104.0ms (0.2% of total)

ival-asin: 82.0ms (0.1% of total)

ival-fmod: 52.0ms (0.1% of total)

ival-sinh: 31.0ms (0% of total)

ival-or: 22.0ms (0% of total)

ival-cbrt: 19.0ms (0% of total)

ival-fmin: 11.0ms (0% of total)

ival-tanh: 8.0ms (0% of total)

ival-atanh: 1.0ms (0% of total)

ival-asinh: 0.0ms (0% of total)

<compiled-spec>: 0.0ms (0% of total)

ival-acosh: 0.0ms (0% of total)

end3.0ms (0%)

Precisions: Click to see histograms. Total time spent on operations: 5.5s
ival-pow: 5.5s (100% of total)

localize24.6min (23.9%)

sample23.6min (22.9%)

simplify10.0min (9.7%)

soundness8.4min (8.1%)

eval7.9min (7.7%)

rewrite6.1min (5.9%)

prune5.1min (5%)

regimes4.6min (4.5%)

explain3.9min (3.8%)

bsearch2.5min (2.5%)

preprocess2.3min (2.2%)

series2.1min (2%)

analyze1.8min (1.8%)

end3.0ms (0%)

Profiling