Metrics for Herbie run

Date:	Thursday, May 23rd, 2024
Commit:	7841f259 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024144
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample23.1min (23.6%)

Results

8.8min	3839934×	0	valid
3.4min	59286×	5	exit
3.2min	483026×	1	valid
1.5min	130222×	2	valid
32.6s	19315×	3	valid
31.1s	143655×	0	precondition
30.5s	170482×	0	invalid
17.0s	60968×	0	unsamplable
8.6s	2271×	4	valid
8.2s	26935×	1	invalid
1.5s	2694×	2	invalid
50.0ms	64×	1	unsamplable
29.0ms	20×	3	invalid
7.0ms	6×	5	valid

Precisions

Click to see histograms. Total time spent on operations: 14.6min

ival-mult: 2.7min (18.7% of total)

ival-pow: 2.6min (17.9% of total)

ival-div: 1.2min (8.3% of total)

ival-sin: 1.2min (8% of total)

ival-add: 1.0min (6.9% of total)

ival-sub: 58.1s (6.6% of total)

backward-pass: 39.2s (4.5% of total)

ival-cos: 38.4s (4.4% of total)

...c/correct-round.rkt:121:19: 36.1s (4.1% of total)

ival-exp: 35.4s (4% of total)

ival-log: 29.3s (3.3% of total)

ival-sqrt: 24.0s (2.7% of total)

ival-tan: 20.9s (2.4% of total)

ival-<=: 19.7s (2.2% of total)

ival-neg: 8.2s (0.9% of total)

const: 7.4s (0.8% of total)

ival-fabs: 6.1s (0.7% of total)

ival-<: 5.8s (0.7% of total)

ival-pi: 3.8s (0.4% of total)

ival-and: 3.3s (0.4% of total)

ival->: 2.0s (0.2% of total)

ival-acos: 1.9s (0.2% of total)

ival-asin: 1.7s (0.2% of total)

ival-atan2: 1.7s (0.2% of total)

ival-atan: 1.1s (0.1% of total)

ival-fmod: 953.0ms (0.1% of total)

ival-==: 925.0ms (0.1% of total)

ival-sinh: 763.0ms (0.1% of total)

ival-floor: 731.0ms (0.1% of total)

ival-cbrt: 694.0ms (0.1% of total)

ival-fmin: 557.0ms (0.1% of total)

ival->=: 518.0ms (0.1% of total)

ival-if: 506.0ms (0.1% of total)

ival-asinh: 475.0ms (0.1% of total)

ival-acosh: 449.0ms (0.1% of total)

ival-atanh: 368.0ms (0% of total)

ival-fmax: 356.0ms (0% of total)

ival-hypot: 274.0ms (0% of total)

ival-log2: 259.0ms (0% of total)

ival-fma: 245.0ms (0% of total)

ival-cosh: 227.0ms (0% of total)

ival-tanh: 188.0ms (0% of total)

ival-or: 62.0ms (0% of total)

Bogosity

simplify18.9min (19.3%)

Algorithm

4378×

egg-herbie

Rules

1673056×	`fma-define`
1265307×	`fma-neg`
887554×	`distribute-lft-in`
850409×	`times-frac`
813530×	`associate-r`

Stop Event

1483×	saturated
2868×	node limit
27×	unsound

Counts

1140462 → 976754

soundness11.7min (12%)

Rules

654550×	`fma-define`
485926×	`log1p-expm1-u`
479199×	`fma-neg`
399372×	`associate-r`
382927×	`times-frac`

Stop Event

161×	saturated
364×	fuel
1911×	node limit
29×	unsound
178×	done

Compiler

Compiled 436576 to 129018 computations (70.4% saved)

rewrite8.4min (8.6%)

Algorithm

1897×

batch-egg-rewrite

Rules

1199922×	`log1p-expm1-u`
897831×	`expm1-log1p-u`
423141×	`pow1`
403871×	`add-exp-log`
388984×	`add-log-exp`

Stop Event

3×	saturated
1876×	node limit
18×	unsound

Counts

21757 → 658454

localize7.5min (7.7%)

Results

2.6min	393781×	0	valid
1.2min	48431×	1	valid
50.3s	8322×	5	exit
26.6s	13763×	2	valid
18.4s	27332×	0	invalid
7.1s	1797×	3	valid
1.6s	711×	1	invalid
1.3s	175×	4	valid
1.1s	2035×	0	unsamplable
249.0ms	36×	1	unsamplable
3.0ms	1×	2	unsamplable

Compiler

Compiled 459820 to 49379 computations (89.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 3.3min

ival-mult: 42.1s (21.4% of total)

ival-pow: 24.0s (12.2% of total)

ival-div: 23.7s (12% of total)

backward-pass: 15.3s (7.8% of total)

ival-add: 14.5s (7.4% of total)

ival-sin: 11.1s (5.6% of total)

ival-cos: 9.4s (4.8% of total)

ival-sub: 9.4s (4.8% of total)

...c/correct-round.rkt:121:19: 8.5s (4.3% of total)

ival-log: 5.9s (3% of total)

ival-fma: 5.2s (2.6% of total)

ival-sqrt: 5.1s (2.6% of total)

ival-expm1: 3.0s (1.5% of total)

ival-tan: 2.9s (1.5% of total)

ival-exp: 2.9s (1.5% of total)

ival-neg: 2.2s (1.1% of total)

ival-hypot: 2.1s (1.1% of total)

ival-log1p: 1.9s (1% of total)

ival-cbrt: 1.4s (0.7% of total)

const: 1.4s (0.7% of total)

ival-asin: 782.0ms (0.4% of total)

ival-acos: 630.0ms (0.3% of total)

ival-atan2: 578.0ms (0.3% of total)

ival-pi: 507.0ms (0.3% of total)

ival-atan: 489.0ms (0.2% of total)

ival-fabs: 457.0ms (0.2% of total)

ival-fmod: 421.0ms (0.2% of total)

ival-if: 238.0ms (0.1% of total)

ival-fmax: 160.0ms (0.1% of total)

ival-cosh: 156.0ms (0.1% of total)

ival-copysign: 96.0ms (0% of total)

ival-floor: 95.0ms (0% of total)

ival-log2: 90.0ms (0% of total)

ival-sinh: 84.0ms (0% of total)

ival->=: 57.0ms (0% of total)

ival->: 40.0ms (0% of total)

ival-e: 35.0ms (0% of total)

ival-<: 13.0ms (0% of total)

ival-tanh: 12.0ms (0% of total)

prune6.8min (6.9%)

Counts: 1449149 → 39665
Compiler: Compiled 1934313 to 980359 computations (49.3% saved)

eval5.3min (5.4%)

Compiler: Compiled 52544495 to 5507953 computations (89.5% saved)

regimes3.7min (3.8%)

Counts

106086 → 9017

Calls

1224 calls:

18.1s	x
13.6s	y
11.1s	z
9.1s	a
8.9s	t

Compiler

Compiled 99337 to 72337 computations (27.2% saved)

series3.1min (3.2%)

Counts

21757 → 482008

Calls

117627 calls:

Time	Variable		Point	Expression
714.0ms	cosTheta_O	@	0	(* (pow (exp sinTheta_i) (/ sinTheta_O (neg v))) (/ (* cosTheta_O (/ (/ cosTheta_i v) v)) (* (sinh (/ 1 v)) 2)))
645.0ms	x	@	0	(* x (- (log (neg x)) (log (neg y))))
568.0ms	y.re	@	0	(log (+ 1 (* y.re (atan2 x.im x.re))))
509.0ms	x	@	0	(* x (log y))
479.0ms	y	@	inf	(log (+ 1 (acos (* (/ x (* y z)) (* 1/18 (sqrt t))))))

bsearch2.5min (2.6%)

Algorithm

4047×	binary-search
564×	left-value

Stop Event

92×	predicate-same
3955×	narrow-enough

Results

1.4min	454695×	0	valid
19.2s	33530×	1	valid
3.8s	21018×	0	invalid
2.6s	4375×	2	valid
2.0s	1380×	3	valid
318.0ms	100×	4	valid
105.0ms	572×	1	invalid
37.0ms	83×	2	invalid
17.0ms	141×	0	unsamplable

Compiler

Compiled 951990 to 686808 computations (27.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.3min

ival-mult: 29.9s (37.4% of total)

ival-sub: 9.1s (11.4% of total)

ival-add: 7.7s (9.7% of total)

ival-div: 6.7s (8.4% of total)

ival-pow: 4.5s (5.6% of total)

ival-sin: 4.3s (5.4% of total)

ival-cos: 4.2s (5.2% of total)

ival-log: 2.6s (3.3% of total)

ival-sqrt: 2.3s (2.9% of total)

...c/correct-round.rkt:121:19: 1.8s (2.2% of total)

backward-pass: 1.5s (1.9% of total)

ival-atan2: 1.3s (1.6% of total)

ival-exp: 1.1s (1.4% of total)

const: 702.0ms (0.9% of total)

ival-neg: 627.0ms (0.8% of total)

ival-tan: 556.0ms (0.7% of total)

ival-acos: 215.0ms (0.3% of total)

ival-atan: 173.0ms (0.2% of total)

ival-fabs: 110.0ms (0.1% of total)

ival-fmod: 110.0ms (0.1% of total)

ival-pi: 108.0ms (0.1% of total)

ival-cosh: 49.0ms (0.1% of total)

ival-asin: 42.0ms (0.1% of total)

ival-hypot: 23.0ms (0% of total)

ival-copysign: 20.0ms (0% of total)

ival->=: 14.0ms (0% of total)

ival-cbrt: 14.0ms (0% of total)

ival-if: 12.0ms (0% of total)

ival-tanh: 9.0ms (0% of total)

ival-sinh: 6.0ms (0% of total)

preprocess2.2min (2.3%)

Algorithm

542×	egg-herbie

Rules

254384×	`fma-define`
252110×	`fma-neg`
118944×	`unsub-neg`
101039×	`sub-neg`
94642×	`distribute-lft-in`

Stop Event

294×	saturated
248×	node limit

Compiler

Compiled 372788 to 142360 computations (61.8% saved)

analyze2.1min (2.1%)

Algorithm

545×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	84.4%	15.6%	0%	0%	0%	0
38.9%	32.9%	51.6%	15.6%	0%	0%	0%	1
44.8%	37.5%	46.2%	15.6%	0%	0.7%	0%	2
54%	44.1%	37.5%	15.7%	0%	2.6%	0%	3
60.9%	49.1%	31.6%	15.8%	0%	3.6%	0%	4
67.1%	53.8%	26.4%	15.8%	0%	4%	0%	5
71%	56.7%	23.1%	15.8%	0%	4.3%	0%	6
75%	59.4%	19.8%	15.9%	0%	4.8%	0.1%	7
77%	60.7%	18.1%	15.9%	0%	5.2%	0.1%	8
79.6%	62.5%	16%	15.9%	0%	5.4%	0.1%	9
81.1%	63.5%	14.8%	16%	0%	5.7%	0.1%	10
83.4%	65.1%	13%	16%	0%	5.8%	0.1%	11
84.5%	65.8%	12.1%	16%	0%	6%	0.1%	12

Compiler

Compiled 13446 to 7366 computations (45.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.1min

ival-mult: 18.3s (26.9% of total)

...c/correct-round.rkt:121:19: 6.4s (9.5% of total)

ival-div: 5.6s (8.3% of total)

ival-add: 5.1s (7.5% of total)

ival-<=: 5.0s (7.4% of total)

ival-sub: 5.0s (7.4% of total)

ival-pow: 4.6s (6.8% of total)

ival-sqrt: 2.7s (3.9% of total)

ival-sin: 2.3s (3.4% of total)

ival-fabs: 1.9s (2.8% of total)

ival-cos: 1.9s (2.7% of total)

ival-log: 1.5s (2.2% of total)

ival-floor: 822.0ms (1.2% of total)

ival-and: 805.0ms (1.2% of total)

ival-exp: 693.0ms (1% of total)

ival-neg: 630.0ms (0.9% of total)

ival-tan: 561.0ms (0.8% of total)

ival-if: 557.0ms (0.8% of total)

const: 548.0ms (0.8% of total)

ival-<: 485.0ms (0.7% of total)

ival-fmax: 405.0ms (0.6% of total)

ival-atan2: 378.0ms (0.6% of total)

ival-==: 290.0ms (0.4% of total)

ival-pi: 279.0ms (0.4% of total)

ival->=: 212.0ms (0.3% of total)

ival-log2: 177.0ms (0.3% of total)

ival->: 174.0ms (0.3% of total)

backward-pass: 124.0ms (0.2% of total)

ival-acos: 118.0ms (0.2% of total)

ival-atan: 110.0ms (0.2% of total)

ival-asin: 73.0ms (0.1% of total)

ival-fmod: 47.0ms (0.1% of total)

ival-sinh: 46.0ms (0.1% of total)

ival-or: 29.0ms (0% of total)

ival-cbrt: 18.0ms (0% of total)

ival-cosh: 17.0ms (0% of total)

ival-tanh: 8.0ms (0% of total)

ival-fmin: 7.0ms (0% of total)

ival-atanh: 1.0ms (0% of total)

ival-asinh: 0.0ms (0% of total)

ival-hypot: 0.0ms (0% of total)

ival-fma: 0.0ms (0% of total)

ival-acosh: 0.0ms (0% of total)

explain1.7min (1.7%)

Results

39.0s	230846×	0	valid
16.8s	34488×	1	valid
8.4s	10460×	2	valid
2.4s	1438×	3	valid
450.0ms	146×	4	valid
329.0ms	126×	5	exit

Compiler

Compiled 97157 to 18586 computations (80.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 37.9s

ival-mult: 8.8s (23.1% of total)

ival-div: 4.2s (11.1% of total)

ival-sub: 3.5s (9.1% of total)

ival-add: 2.8s (7.5% of total)

ival-sin: 2.8s (7.4% of total)

ival-log: 2.5s (6.6% of total)

ival-cos: 2.4s (6.4% of total)

backward-pass: 2.2s (5.9% of total)

ival-sqrt: 1.7s (4.5% of total)

ival-pow: 1.5s (3.9% of total)

ival-exp: 1.3s (3.4% of total)

ival-tan: 1.1s (3% of total)

...c/correct-round.rkt:121:19: 757.0ms (2% of total)

const: 474.0ms (1.3% of total)

ival-neg: 332.0ms (0.9% of total)

ival-floor: 258.0ms (0.7% of total)

ival-pi: 251.0ms (0.7% of total)

ival-fabs: 144.0ms (0.4% of total)

ival-atan2: 123.0ms (0.3% of total)

ival-asin: 89.0ms (0.2% of total)

ival-cosh: 84.0ms (0.2% of total)

ival-acos: 80.0ms (0.2% of total)

ival-atan: 75.0ms (0.2% of total)

ival-log1p: 65.0ms (0.2% of total)

ival-cbrt: 47.0ms (0.1% of total)

ival-if: 45.0ms (0.1% of total)

ival-fmod: 37.0ms (0.1% of total)

ival-sinh: 30.0ms (0.1% of total)

ival-fma: 19.0ms (0.1% of total)

ival-fmax: 19.0ms (0.1% of total)

ival-hypot: 18.0ms (0% of total)

ival-log2: 17.0ms (0% of total)

ival-copysign: 15.0ms (0% of total)

ival->=: 13.0ms (0% of total)

ival-tanh: 11.0ms (0% of total)

ival->: 5.0ms (0% of total)

ival-<: 2.0ms (0% of total)

Herbie run

sample23.1min (23.6%)

simplify18.9min (19.3%)

soundness11.7min (12%)

rewrite8.4min (8.6%)

localize7.5min (7.7%)

prune6.8min (6.9%)

eval5.3min (5.4%)

regimes3.7min (3.8%)

series3.1min (3.2%)

bsearch2.5min (2.6%)

preprocess2.2min (2.3%)

analyze2.1min (2.1%)

explain1.7min (1.7%)

end44.9s (0.8%)

Profiling