Metrics for Herbie run

Date:	Saturday, February 24th, 2024
Commit:	79d5306a on longer-taylor
Hostname:	nightly with Racket 8.11.1
Seed:	2024055
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample7.3min (14.9%)

Results

4.1min	1821130×	256	valid
47.4s	343189×	256	infinite
11.9s	63780×	256	invalid
12.9s	30195×	512	valid
11.4s	19389×	1024	valid
2.7s	5094×	2048	valid
1.8s	1621×	8192	exit
407.0ms	1133×	512	infinite
308.0ms	729×	1024	infinite
312.0ms	704×	1024	invalid
109.0ms	566×	512	invalid
3.0ms	5×	4096	valid

Precisions

Click to see histograms. Total time spent on operations: 2.6min

Operation ival-mult, time spent: 48.8s, 31.0% of total-time

Operation ival-sub, time spent: 24.6s, 15.0% of total-time

Operation ival-add, time spent: 24.5s, 15.0% of total-time

Operation ival-div, time spent: 22.0s, 14.0% of total-time

Operation ival-log, time spent: 12.7s, 8.0% of total-time

Operation ival-sqrt, time spent: 9.5s, 6.0% of total-time

Operation ival-sin, time spent: 5.1s, 3.0% of total-time

Operation const, time spent: 4.2s, 3.0% of total-time

Operation ival-cos, time spent: 4.1s, 3.0% of total-time

Operation ival-exp, time spent: 1.3s, 1.0% of total-time

Operation ival-tan, time spent: 692.0ms, 0.0% of total-time

Operation ival-acos, time spent: 464.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 292.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 231.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 230.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 147.0ms, 0.0% of total-time

Bogosity

series6.2min (12.8%)

Counts

5739 → 247375

Calls

41205 calls:

Time	Variable		Point	Expression
9.9s	x	@	0	(* x (log y))
9.2s	y	@	inf	(* (log (cbrt (/ x y))) 3)
6.2s	t	@	inf	(log (+ 1 (* 1/3 (acos (* (/ x (* y z)) (* 1/18 (sqrt t)))))))
5.5s	x	@	-inf	(log (/ y x))
5.1s	a	@	inf	(log (* (* y z) (pow t (+ a -1/2))))

regimes5.7min (11.8%)

Counts

38219 → 5739

Calls

490 calls:

53.6s	y
52.9s	x
52.3s	z
34.6s	t
30.2s	a

Compiler

Compiled 45771 to 36245 computations (20.8% saved)

simplify5.2min (10.6%)

Algorithm

1079×

egg-herbie

Rules

582810×	`fma-define`
452490×	`fma-neg`
441836×	`*-commutative`
405020×	`distribute-lft-in`
370826×	`times-frac`

Stop Event

269×	saturated
808×	node limit
144×	fuel
2×	unsound
125×	done

Counts

456850 → 347251

Compiler

Compiled 71468 to 42633 computations (40.3% saved)

eval5.0min (10.3%)

Compiler: Compiled 13342813 to 7572505 computations (43.2% saved)

localize4.3min (8.8%)

Results

1.7min	175031×	256	valid
17.3s	28980×	256	infinite
9.7s	7790×	256	invalid
18.9s	3925×	1024	valid
11.2s	3351×	512	valid
20.1s	2453×	8192	exit
9.6s	1475×	2048	valid
351.0ms	412×	256	unsamplable
794.0ms	271×	1024	infinite
423.0ms	144×	512	infinite
668.0ms	55×	4096	valid
136.0ms	39×	2048	infinite
1.1s	37×	4096	infinite
124.0ms	31×	512	invalid
53.0ms	4×	512	unsamplable
16.0ms	2×	1024	unsamplable

Compiler

Compiled 116678 to 51374 computations (56% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.3min

Operation ival-mult, time spent: 38.4s, 27.0% of total-time

Operation ival-add, time spent: 18.8s, 13.0% of total-time

Operation ival-div, time spent: 18.2s, 13.0% of total-time

Operation ival-pow, time spent: 14.1s, 10.0% of total-time

Operation composed, time spent: 12.0s, 9.0% of total-time

Operation ival-log, time spent: 10.6s, 8.0% of total-time

Operation ival-sub, time spent: 9.1s, 6.0% of total-time

Operation ival-sqrt, time spent: 7.1s, 5.0% of total-time

Operation const, time spent: 3.4s, 2.0% of total-time

Operation ival-cos, time spent: 2.2s, 2.0% of total-time

Operation ival-sin, time spent: 2.0s, 1.0% of total-time

Operation ival-exp, time spent: 1.8s, 1.0% of total-time

Operation ival-cbrt, time spent: 1.1s, 1.0% of total-time

Operation ival-neg, time spent: 739.0ms, 1.0% of total-time

Operation ival-tan, time spent: 223.0ms, 0.0% of total-time

Operation ival-acos, time spent: 123.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 95.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 85.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 25.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 19.0ms, 0.0% of total-time

soundness4.0min (8.3%)

Rules

502452×	`fma-define`
426466×	`fma-neg`
282128×	`distribute-lft-in`
270936×	`associate-r`
266630×	`times-frac`

Stop Event

80×	saturated
744×	node limit
2×	unsound

Compiler

Compiled 99390 to 54793 computations (44.9% saved)

preprocess3.7min (7.5%)

Algorithm

269×	egg-herbie

Rules

275536×	`fma-neg`
234168×	`fma-define`
114704×	`unsub-neg`
100834×	`sub-neg`
94200×	`distribute-rgt-in`

Stop Event

153×	saturated
116×	node limit

Results

24.1s	110782×	256	valid
4.4s	21028×	256	infinite
3.7s	2468×	1024	valid
1.8s	2202×	512	valid
1.7s	858×	2048	valid
203.0ms	184×	512	infinite
421.0ms	166×	1024	infinite
26.0ms	36×	2048	infinite
10.0ms	4×	4096	valid

Compiler

Compiled 212481 to 104780 computations (50.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 19.3s

Operation ival-mult, time spent: 6.4s, 33.0% of total-time

Operation ival-add, time spent: 3.0s, 16.0% of total-time

Operation ival-log, time spent: 3.0s, 16.0% of total-time

Operation ival-sub, time spent: 2.5s, 13.0% of total-time

Operation ival-div, time spent: 1.9s, 10.0% of total-time

Operation ival-sqrt, time spent: 829.0ms, 4.0% of total-time

Operation const, time spent: 611.0ms, 3.0% of total-time

Operation ival-sin, time spent: 464.0ms, 2.0% of total-time

Operation ival-cos, time spent: 339.0ms, 2.0% of total-time

Operation ival-exp, time spent: 171.0ms, 1.0% of total-time

Operation ival-tan, time spent: 35.0ms, 0.0% of total-time

Operation ival-acos, time spent: 17.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 13.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 12.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 11.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 10.0ms, 0.0% of total-time

rewrite2.9min (5.9%)

Algorithm

810×	batch-egg-rewrite

Rules

564004×	`log1p-expm1-u`
407916×	`expm1-log1p-u`
285720×	`prod-diff`
256364×	`log-prod`
202330×	`unpow-prod-down`

Stop Event

808×	node limit
2×	unsound

Counts

5739 → 209475

prune2.1min (4.2%)

Counts: 432735 → 13223
Compiler: Compiled 456121 to 307176 computations (32.7% saved)

bsearch2.1min (4.2%)

Algorithm

3383×	binary-search
313×	left-value

Stop Event

48×	predicate-same
3335×	narrow-enough

Results

53.8s	309069×	256	valid
35.1s	100763×	256	infinite
521.0ms	4786×	256	invalid
1.5s	4171×	512	valid
1.1s	2445×	1024	valid
114.0ms	247×	2048	valid
32.0ms	86×	1024	infinite
25.0ms	83×	512	infinite
3.0ms	16×	512	invalid
4.0ms	12×	1024	invalid

Compiler

Compiled 845671 to 628072 computations (25.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 51.1s

Operation ival-mult, time spent: 23.6s, 46.0% of total-time

Operation ival-sub, time spent: 11.2s, 22.0% of total-time

Operation ival-add, time spent: 6.6s, 13.0% of total-time

Operation ival-div, time spent: 4.0s, 8.0% of total-time

Operation ival-log, time spent: 2.2s, 4.0% of total-time

Operation ival-sqrt, time spent: 1.0s, 2.0% of total-time

Operation ival-sin, time spent: 894.0ms, 2.0% of total-time

Operation const, time spent: 771.0ms, 2.0% of total-time

Operation ival-cos, time spent: 479.0ms, 1.0% of total-time

Operation ival-exp, time spent: 350.0ms, 1.0% of total-time

Operation ival-tanh, time spent: 13.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 8.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 6.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 3.0ms, 0.0% of total-time

analyze22.0s (0.7%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.3%	68.3%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.4%	22.9%	0.1%	0%	4.6%	0%	6
80%	75.7%	19%	0.1%	0%	5.1%	0%	7
81.8%	77.1%	17.1%	0.1%	0%	5.6%	0%	8
84.5%	79.4%	14.6%	0.1%	0%	5.9%	0%	9
86.1%	80.6%	13.1%	0.1%	0%	6.2%	0%	10
88.6%	83%	10.6%	0.1%	0%	6.2%	0%	11
89.7%	83.7%	9.6%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 10.1s

Operation ival-mult, time spent: 4.2s, 42.0% of total-time

Operation ival-add, time spent: 1.4s, 14.0% of total-time

Operation ival-sub, time spent: 1.4s, 14.0% of total-time

Operation ival-div, time spent: 1.2s, 12.0% of total-time

Operation ival-sqrt, time spent: 735.0ms, 7.0% of total-time

Operation ival-log, time spent: 463.0ms, 5.0% of total-time

Operation const, time spent: 245.0ms, 2.0% of total-time

Operation ival-exp, time spent: 187.0ms, 2.0% of total-time

Operation ival-sin, time spent: 150.0ms, 1.0% of total-time

Operation ival-cos, time spent: 64.0ms, 1.0% of total-time

Operation ival-acos, time spent: 40.0ms, 0.0% of total-time

Operation ival-tan, time spent: 26.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 17.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 13.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 4.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 4.0ms, 0.0% of total-time

Herbie run

sample7.3min (14.9%)

series6.2min (12.8%)

regimes5.7min (11.8%)

simplify5.2min (10.6%)

eval5.0min (10.3%)

localize4.3min (8.8%)

soundness4.0min (8.3%)

preprocess3.7min (7.5%)

rewrite2.9min (5.9%)

prune2.1min (4.2%)

bsearch2.1min (4.2%)

analyze22.0s (0.7%)

end158.0ms (0%)

Profiling