Metrics for Herbie run

Date:	Tuesday, March 26th, 2024
Commit:	79027280 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024086
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample7.1min (20.1%)

Results

3.8min	1811049×	0	valid
45.5s	338152×	0	infinite
10.6s	64363×	0	invalid
25.3s	60981×	1	valid
2.9s	7531×	2	valid
1.0s	2512×	1	infinite
583.0ms	1598×	1	invalid
1.4s	1544×	5	exit
157.0ms	521×	3	valid
33.0ms	114×	2	infinite
2.0ms	4×	4	valid

Precisions

Click to see histograms. Total time spent on operations: 2.5min

ival-mult: 51.4s (33.9% of total)

ival-add: 22.6s (14.9% of total)

ival-sub: 21.6s (14.2% of total)

ival-div: 19.7s (13% of total)

ival-log: 9.1s (6% of total)

ival-sqrt: 7.0s (4.6% of total)

ival-sin: 5.1s (3.3% of total)

backward-pass: 4.9s (3.2% of total)

const: 3.8s (2.5% of total)

ival-cos: 3.1s (2% of total)

ival-exp: 1.8s (1.2% of total)

ival-acos: 349.0ms (0.2% of total)

ival-cosh: 334.0ms (0.2% of total)

ival-fabs: 306.0ms (0.2% of total)

ival-sinh: 290.0ms (0.2% of total)

ival-tan: 276.0ms (0.2% of total)

ival-tanh: 99.0ms (0.1% of total)

Bogosity

localize4.3min (12.2%)

Results

1.5min	175868×	256	valid
14.6s	30475×	256	infinite
8.2s	8660×	256	invalid
22.9s	4518×	1024	valid
33.1s	2477×	8192	exit
6.1s	2378×	512	valid
11.7s	1609×	2048	valid
383.0ms	483×	256	unsamplable
487.0ms	240×	1024	infinite
1.0s	97×	1024	invalid
83.0ms	73×	512	infinite
716.0ms	64×	2048	invalid
389.0ms	63×	512	invalid
97.0ms	45×	2048	infinite
317.0ms	21×	4096	valid
2.0ms	1×	4096	infinite

Compiler

Compiled 114949 to 50190 computations (56.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.5min

ival-mult: 38.1s (25.8% of total)

ival-pow: 20.0s (13.6% of total)

ival-div: 16.6s (11.2% of total)

ival-add: 16.1s (10.9% of total)

composed: 13.0s (8.8% of total)

ival-log: 12.2s (8.2% of total)

ival-sub: 8.3s (5.7% of total)

ival-sqrt: 6.4s (4.4% of total)

ival-cos: 5.2s (3.5% of total)

ival-exp: 4.3s (2.9% of total)

const: 2.9s (1.9% of total)

ival-sin: 2.0s (1.3% of total)

ival-cbrt: 1.1s (0.8% of total)

ival-neg: 695.0ms (0.5% of total)

ival-tan: 425.0ms (0.3% of total)

ival-sinh: 147.0ms (0.1% of total)

ival-acos: 79.0ms (0.1% of total)

ival-cosh: 16.0ms (0% of total)

ival-fabs: 14.0ms (0% of total)

ival-tanh: 10.0ms (0% of total)

ival-e: 5.0ms (0% of total)

simplify4.2min (11.8%)

Algorithm

1097×

egg-herbie

Rules

296582×	`fma-define`
237611×	`fma-neg`
213087×	`distribute-lft-in`
208186×	`*-commutative`
200402×	`times-frac`

Stop Event

267×	saturated
825×	node limit
5×	unsound

Counts

374603 → 318306

soundness3.4min (9.7%)

Rules

240166×	`fma-define`
216155×	`fma-neg`
171027×	`log1p-expm1-u`
148676×	`associate-r`
143787×	`distribute-lft-in`

Stop Event

80×	saturated
727×	node limit
144×	fuel
4×	unsound
125×	done

Compiler

Compiled 161521 to 84360 computations (47.8% saved)

eval3.3min (9.4%)

Compiler: Compiled 9016517 to 4692530 computations (48% saved)

rewrite3.0min (8.4%)

Algorithm

828×	batch-egg-rewrite

Rules

581660×	`log1p-expm1-u`
439460×	`expm1-log1p-u`
159399×	`pow1`
151629×	`add-exp-log`
145446×	`add-log-exp`

Stop Event

828×	node limit

Counts

5685 → 207845

regimes2.5min (7.1%)

Counts

37138 → 5961

Calls

491 calls:

22.4s	z
21.8s	y
20.0s	x
13.8s	t
11.3s	a

Compiler

Compiled 46490 to 36862 computations (20.7% saved)

bsearch2.1min (6%)

Algorithm

3520×	binary-search
357×	left-value

Stop Event

32×	predicate-same
3488×	narrow-enough

Results

55.6s	321876×	0	valid
32.4s	101696×	0	infinite
4.2s	8946×	1	valid
434.0ms	5347×	0	invalid
241.0ms	668×	2	valid
89.0ms	258×	1	infinite
17.0ms	24×	3	valid
1.0ms	4×	2	infinite

Compiler

Compiled 833810 to 627649 computations (24.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 50.3s

ival-mult: 23.8s (47.2% of total)

ival-sub: 10.2s (20.3% of total)

ival-add: 6.5s (12.9% of total)

ival-div: 3.9s (7.7% of total)

ival-log: 1.5s (3% of total)

ival-sqrt: 1.2s (2.3% of total)

backward-pass: 1.0s (2% of total)

ival-sin: 869.0ms (1.7% of total)

const: 714.0ms (1.4% of total)

ival-cos: 388.0ms (0.8% of total)

ival-exp: 295.0ms (0.6% of total)

ival-tanh: 8.0ms (0% of total)

ival-fabs: 7.0ms (0% of total)

ival-cosh: 6.0ms (0% of total)

ival-sinh: 2.0ms (0% of total)

prune2.0min (5.6%)

Counts: 395135 → 13097
Compiler: Compiled 437533 to 296934 computations (32.1% saved)

preprocess1.4min (3.9%)

Algorithm

269×	egg-herbie

Rules

137764×	`fma-neg`
117084×	`fma-define`
57352×	`unsub-neg`
50425×	`sub-neg`
47106×	`distribute-rgt-in`

Stop Event

153×	saturated
116×	node limit

Compiler

Compiled 172572 to 86372 computations (50% saved)

series52.5s (2.5%)

Counts

5685 → 166758

Calls

40518 calls:

Time	Variable		Point	Expression
374.0ms	y	@	-inf	(log (/ x (cbrt y)))
334.0ms	c	@	inf	(* (- b 1/2) (log c))
330.0ms	y	@	-inf	(/ (log (/ -1 y)) t)
293.0ms	x	@	0	(* (log (cbrt (/ x y))) 3)
269.0ms	a	@	-inf	(log (* y (pow t (+ a -1/2))))

explain49.6s (2.3%)

Results

22.0s	111130×	256	valid
4.5s	20624×	256	infinite
4.4s	2866×	1024	valid
1.1s	1538×	512	valid
1.7s	1136×	2048	valid
671.0ms	224×	1024	infinite
100.0ms	140×	512	infinite
51.0ms	58×	2048	infinite
4.0ms	6×	8192	exit
7.0ms	6×	4096	valid

Compiler

Compiled 26361 to 12514 computations (52.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 17.8s

ival-mult: 5.8s (32.8% of total)

ival-add: 2.8s (16% of total)

ival-log: 2.7s (15.1% of total)

ival-sub: 2.1s (11.8% of total)

ival-div: 1.8s (10.3% of total)

ival-sqrt: 1.0s (5.9% of total)

const: 506.0ms (2.8% of total)

ival-sin: 345.0ms (1.9% of total)

ival-cos: 337.0ms (1.9% of total)

ival-exp: 167.0ms (0.9% of total)

ival-tan: 46.0ms (0.3% of total)

ival-tanh: 14.0ms (0.1% of total)

ival-cosh: 12.0ms (0.1% of total)

ival-fabs: 12.0ms (0.1% of total)

ival-acos: 11.0ms (0.1% of total)

ival-sinh: 9.0ms (0.1% of total)

analyze20.7s (1%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.2%	68.2%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.3%	23%	0.1%	0%	4.6%	0%	6
79.8%	75.6%	19.1%	0.1%	0%	5.1%	0%	7
81.7%	77%	17.2%	0.1%	0%	5.6%	0%	8
84.4%	79.3%	14.7%	0.1%	0%	5.9%	0%	9
86%	80.5%	13.1%	0.1%	0%	6.2%	0%	10
88.5%	82.9%	10.7%	0.1%	0%	6.2%	0%	11
89.6%	83.7%	9.7%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 8.6s

ival-mult: 3.4s (39.5% of total)

ival-add: 1.5s (17.1% of total)

ival-sub: 1.4s (16.6% of total)

ival-div: 1.3s (14.7% of total)

ival-sqrt: 271.0ms (3.1% of total)

ival-log: 247.0ms (2.9% of total)

const: 177.0ms (2.1% of total)

ival-exp: 117.0ms (1.4% of total)

ival-sin: 98.0ms (1.1% of total)

ival-cos: 66.0ms (0.8% of total)

ival-tan: 22.0ms (0.3% of total)

ival-acos: 21.0ms (0.2% of total)

ival-cosh: 14.0ms (0.2% of total)

ival-tanh: 8.0ms (0.1% of total)

ival-fabs: 4.0ms (0% of total)

ival-sinh: 4.0ms (0% of total)

Herbie run

sample7.1min (20.1%)

localize4.3min (12.2%)

simplify4.2min (11.8%)

soundness3.4min (9.7%)

eval3.3min (9.4%)

rewrite3.0min (8.4%)

regimes2.5min (7.1%)

bsearch2.1min (6%)

prune2.0min (5.6%)

preprocess1.4min (3.9%)

series52.5s (2.5%)

explain49.6s (2.3%)

analyze20.7s (1%)

end1.0ms (0%)

Profiling