Metrics for Herbie run

Date:	Friday, April 5th, 2024
Commit:	e8a91f21 on egg-serialize
Hostname:	nightly with Racket 8.11.1
Seed:	2024096
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample7.2min (21.7%)

Results

3.8min	1806228×	0	valid
51.1s	343173×	0	infinite
10.9s	64698×	0	invalid
25.2s	60491×	1	valid
3.2s	7641×	2	valid
887.0ms	2687×	1	infinite
1.6s	1671×	5	exit
336.0ms	1550×	1	invalid
269.0ms	521×	3	valid
32.0ms	118×	2	infinite
3.0ms	5×	4	valid

Precisions

Click to see histograms. Total time spent on operations: 2.5min

ival-mult: 52.9s (35% of total)

ival-sub: 22.2s (14.7% of total)

ival-add: 21.6s (14.3% of total)

ival-div: 20.2s (13.4% of total)

ival-log: 9.0s (6% of total)

backward-pass: 5.3s (3.5% of total)

ival-sqrt: 5.0s (3.3% of total)

ival-sin: 4.2s (2.8% of total)

const: 3.6s (2.4% of total)

ival-cos: 3.2s (2.1% of total)

ival-exp: 1.9s (1.3% of total)

ival-cosh: 510.0ms (0.3% of total)

ival-fabs: 363.0ms (0.2% of total)

ival-acos: 326.0ms (0.2% of total)

ival-sinh: 308.0ms (0.2% of total)

ival-tan: 225.0ms (0.1% of total)

ival-tanh: 98.0ms (0.1% of total)

Bogosity

localize4.4min (13.3%)

Results

1.5min	173337×	256	valid
14.5s	30726×	256	infinite
8.4s	9928×	256	invalid
23.6s	4736×	1024	valid
7.5s	2650×	512	valid
45.3s	2281×	8192	exit
16.8s	2099×	2048	valid
1.1s	361×	1024	infinite
223.0ms	315×	256	unsamplable
244.0ms	159×	512	infinite
281.0ms	96×	2048	infinite
186.0ms	42×	4096	infinite
413.0ms	35×	4096	valid
290.0ms	22×	1024	invalid
211.0ms	17×	2048	invalid
95.0ms	11×	512	invalid
8.0ms	1×	8192	valid

Compiler

Compiled 112673 to 48682 computations (56.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.7min

ival-mult: 39.5s (24% of total)

ival-div: 19.3s (11.7% of total)

ival-pow: 18.1s (11% of total)

ival-add: 15.8s (9.6% of total)

ival-cos: 13.6s (8.3% of total)

composed: 13.1s (8% of total)

ival-sub: 9.6s (5.8% of total)

ival-log: 8.6s (5.3% of total)

ival-sin: 7.7s (4.7% of total)

ival-sqrt: 6.1s (3.7% of total)

ival-exp: 3.7s (2.2% of total)

ival-tan: 3.2s (2% of total)

const: 3.0s (1.8% of total)

ival-cbrt: 1.9s (1.1% of total)

ival-neg: 933.0ms (0.6% of total)

ival-acos: 89.0ms (0.1% of total)

ival-cosh: 40.0ms (0% of total)

ival-fabs: 24.0ms (0% of total)

ival-sinh: 21.0ms (0% of total)

ival-tanh: 13.0ms (0% of total)

ival-e: 13.0ms (0% of total)

eval3.4min (10.1%)

Compiler: Compiled 8867655 to 4588152 computations (48.3% saved)

simplify3.0min (9.1%)

Algorithm

1099×

egg-herbie

Rules

290137×	`fma-define`
225871×	`times-frac`
224594×	`*-commutative`
221737×	`fma-neg`
184707×	`distribute-lft-in`

Stop Event

270×	saturated
827×	node limit
2×	unsound

Counts

434771 → 324346

soundness2.9min (8.7%)

Rules

240944×	`fma-define`
213478×	`log1p-expm1-u`
197211×	`fma-neg`
157323×	`expm1-log1p-u`
138536×	`times-frac`

Stop Event

73×	saturated
763×	node limit
149×	fuel
120×	done

Compiler

Compiled 146764 to 75566 computations (48.5% saved)

rewrite2.8min (8.5%)

Algorithm

830×	batch-egg-rewrite

Rules

584485×	`log1p-expm1-u`
429954×	`expm1-log1p-u`
160889×	`pow1`
153573×	`add-exp-log`
152018×	`prod-diff`

Stop Event

1×	saturated
827×	node limit
2×	unsound

Counts

5613 → 273262

regimes2.4min (7.2%)

Counts

34479 → 5528

Calls

491 calls:

21.6s	z
20.6s	y
20.4s	x
14.7s	t
11.6s	a

Compiler

Compiled 45457 to 36074 computations (20.6% saved)

prune2.0min (6%)

Counts: 407525 → 13319
Compiler: Compiled 457836 to 310713 computations (32.1% saved)

bsearch1.9min (5.6%)

Algorithm

3192×	binary-search
315×	left-value

Stop Event

47×	predicate-same
3145×	narrow-enough

Results

49.3s	299715×	0	valid
27.5s	88079×	0	infinite
4.1s	9174×	1	valid
933.0ms	6817×	0	invalid
460.0ms	673×	2	valid
165.0ms	257×	1	infinite
5.0ms	14×	3	valid
2.0ms	8×	2	infinite

Compiler

Compiled 732684 to 548947 computations (25.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 44.1s

ival-mult: 20.1s (45.5% of total)

ival-sub: 9.9s (22.4% of total)

ival-add: 5.8s (13.2% of total)

ival-div: 3.2s (7.2% of total)

ival-log: 1.8s (4% of total)

ival-sqrt: 773.0ms (1.8% of total)

backward-pass: 694.0ms (1.6% of total)

const: 633.0ms (1.4% of total)

ival-exp: 427.0ms (1% of total)

ival-cos: 368.0ms (0.8% of total)

ival-sin: 349.0ms (0.8% of total)

ival-fabs: 80.0ms (0.2% of total)

ival-tanh: 14.0ms (0% of total)

ival-sinh: 8.0ms (0% of total)

ival-cosh: 7.0ms (0% of total)

preprocess1.3min (3.9%)

Algorithm

269×	egg-herbie

Rules

137764×	`fma-neg`
117084×	`fma-define`
57352×	`unsub-neg`
50425×	`sub-neg`
47106×	`distribute-rgt-in`

Stop Event

153×	saturated
116×	node limit

Compiler

Compiled 154932 to 78092 computations (49.6% saved)

explain49.7s (2.5%)

Results

21.8s	110778×	256	valid
4.2s	20904×	256	infinite
4.1s	2786×	1024	valid
1.0s	1658×	512	valid
2.3s	1114×	2048	valid
577.0ms	250×	1024	infinite
142.0ms	156×	512	infinite
89.0ms	72×	2048	infinite
18.0ms	8×	8192	exit
3.0ms	2×	4096	valid

Compiler

Compiled 26361 to 12514 computations (52.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 18.1s

ival-mult: 6.0s (33.1% of total)

ival-add: 2.7s (14.7% of total)

ival-log: 2.6s (14.7% of total)

ival-sub: 2.4s (13% of total)

ival-div: 2.1s (11.4% of total)

ival-sqrt: 574.0ms (3.2% of total)

const: 498.0ms (2.8% of total)

ival-cos: 477.0ms (2.6% of total)

ival-sin: 422.0ms (2.3% of total)

ival-exp: 296.0ms (1.6% of total)

ival-tan: 49.0ms (0.3% of total)

ival-cosh: 13.0ms (0.1% of total)

ival-fabs: 12.0ms (0.1% of total)

ival-acos: 11.0ms (0.1% of total)

ival-sinh: 10.0ms (0.1% of total)

ival-tanh: 9.0ms (0% of total)

series47.5s (2.4%)

Counts

5613 → 161509

Calls

40470 calls:

Time	Variable		Point	Expression
271.0ms	c	@	0	(+ (* z (/ (sqrt (+ t a)) t)) (* (+ a (+ 5/6 (/ -2/3 t))) (- c b)))
223.0ms	y	@	0	(* x (* (log (cbrt (/ x y))) 3))
197.0ms	x	@	0	(* x (log y))
171.0ms	x	@	0	(* (log (cbrt (/ x y))) 3)
159.0ms	z	@	inf	(* c (- (* j a) (* b z)))

analyze18.8s (0.9%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.2%	68.2%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.3%	23%	0.1%	0%	4.6%	0%	6
79.8%	75.6%	19.1%	0.1%	0%	5.1%	0%	7
81.7%	77%	17.2%	0.1%	0%	5.6%	0%	8
84.4%	79.3%	14.7%	0.1%	0%	5.9%	0%	9
86%	80.5%	13.1%	0.1%	0%	6.2%	0%	10
88.5%	82.9%	10.7%	0.1%	0%	6.2%	0%	11
89.6%	83.7%	9.7%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 8.6s

ival-mult: 3.2s (37% of total)

ival-div: 1.5s (17.7% of total)

ival-add: 1.4s (16% of total)

ival-sub: 1.3s (15.5% of total)

ival-sqrt: 320.0ms (3.7% of total)

ival-log: 220.0ms (2.6% of total)

ival-exp: 187.0ms (2.2% of total)

const: 182.0ms (2.1% of total)

ival-sin: 164.0ms (1.9% of total)

ival-acos: 28.0ms (0.3% of total)

ival-cos: 28.0ms (0.3% of total)

ival-tan: 19.0ms (0.2% of total)

ival-cosh: 17.0ms (0.2% of total)

ival-tanh: 9.0ms (0.1% of total)

ival-fabs: 4.0ms (0% of total)

ival-sinh: 4.0ms (0% of total)

Herbie run

sample7.2min (21.7%)

localize4.4min (13.3%)

eval3.4min (10.1%)

simplify3.0min (9.1%)

soundness2.9min (8.7%)

rewrite2.8min (8.5%)

regimes2.4min (7.2%)

prune2.0min (6%)

bsearch1.9min (5.6%)

preprocess1.3min (3.9%)

explain49.7s (2.5%)

series47.5s (2.4%)

analyze18.8s (0.9%)

end2.0ms (0%)

Profiling