Metrics for Herbie run

Date:	Friday, October 6th, 2023
Commit:	f10612bf on report-tolerance
Hostname:	nightly with Racket 8.6
Seed:	2023279
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample31.2min (24.8%)

Results

12.5min	3365498×	body	256	valid
4.3min	45865×	body	8192	exit
4.1min	273960×	body	1024	valid
2.4min	97990×	body	2048	valid
1.9min	523059×	body	256	infinite
1.5min	14445×	body	4096	valid
1.2min	150330×	body	512	valid
1.0min	256429×	body	256	invalid
39.8s	2411×	body	8192	valid
22.1s	20043×	body	1024	infinite
10.6s	16251×	body	1024	invalid
10.6s	48199×	body	256	unsamplable
9.2s	1249×	body	4096	infinite
7.9s	10982×	body	512	infinite
7.3s	1634×	body	2048	infinite
3.7s	8790×	body	512	invalid
2.6s	5406×	body	2048	invalid
2.1s	2986×	body	256	precondition
351.0ms	18×	body	8192	infinite
228.0ms	508×	body	1024	unsamplable
205.0ms	291×	body	2048	unsamplable
70.0ms	247×	body	512	unsamplable
6.0ms	2×	body	8192	invalid
5.0ms	9×	body	4096	invalid

Bogosity

localize24.2min (19.2%)

Results

Compiler

Compiled 434055 to 180658 computations (58.4% saved)

soundness15.1min (12%)

Rules

2744010×	`fma-def`
1652036×	`associate-r`
1441024×	`log-prod`
1337088×	`fma-neg`
1327206×	`associate-l`

Stop Event

33×	unsound
122×	saturated
3670×	node limit

Results

Compiler

Compiled 346449 to 193835 computations (44.1% saved)

regimes12.8min (10.2%)

Counts

88540 → 10085

Calls

1163 calls:

1.4min	x
1.1min	y
1.1min	z
47.2s	t
41.4s	a

Compiler

Compiled 1352513 to 692986 computations (48.8% saved)

eval12.6min (10%)

Results

Compiler

Compiled 28695441 to 14448621 computations (49.6% saved)

simplify8.2min (6.5%)

Algorithm

2206×

egg-herbie

Rules

1282894×	`fma-def`
931120×	`associate-r`
892532×	`log-prod`
807366×	`associate-l`
721948×	`times-frac`

Stop Event

21×	unsound
535×	saturated
139×	done
397×	fuel
1650×	node limit

Counts

718490 → 561181

Compiler

Compiled 135925 to 83533 computations (38.5% saved)

prune6.2min (4.9%)

Counts: 848469 → 34827
Compiler: Compiled 2543490 to 1691466 computations (33.5% saved)

rewrite4.6min (3.6%)

Algorithm

1670×

batch-egg-rewrite

Rules

1105672×	`pow1`
1044322×	`add-exp-log`
1043250×	`log1p-expm1-u`
1043050×	`expm1-log1p-u`
997128×	`add-log-exp`

Stop Event

11×	unsound
1659×	node limit

Counts

13325 → 402055

bsearch3.9min (3.1%)

Algorithm

5320×	binary-search
640×	left-value

Stop Event

5190×	narrow-enough
3×	predicate-failed
127×	predicate-same

Results

1.9min	465668×	body	256	valid
52.7s	125705×	body	256	infinite
26.1s	26224×	body	1024	valid
9.3s	15675×	body	512	valid
4.8s	3822×	body	2048	valid
4.1s	4577×	body	1024	infinite
4.1s	23057×	body	256	invalid
2.2s	1069×	body	4096	valid
1.7s	2766×	body	512	infinite
432.0ms	46×	body	4096	infinite
344.0ms	611×	body	1024	invalid
273.0ms	108×	body	2048	infinite
147.0ms	346×	body	512	invalid
33.0ms	20×	body	8192	valid
23.0ms	116×	body	256	unsamplable

Compiler

Compiled 1284879 to 946303 computations (26.4% saved)

preprocess3.0min (2.3%)

Algorithm

540×	egg-herbie

Rules

717430×	`fma-def`
266840×	`fma-neg`
215172×	`sub-neg`
202918×	`div-sub`
198574×	`unsub-neg`

Stop Event

204×	saturated
336×	node limit

Compiler

Compiled 297825 to 153206 computations (48.6% saved)

analyze2.6min (2%)

Algorithm

544×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	86%	14%	0%	0%	0%	0
40.4%	34.7%	51.3%	14%	0%	0%	0%	1
46.4%	39.6%	45.8%	14.1%	0%	0.6%	0%	2
56.1%	47.2%	37%	14.1%	0%	1.7%	0%	3
62.1%	51.9%	31.7%	14.1%	0%	2.3%	0%	4
67.8%	56.4%	26.8%	14.1%	0%	2.7%	0%	5
71.5%	59.1%	23.5%	14.1%	0%	3.2%	0%	6
75.4%	61.7%	20.1%	14.1%	0%	4%	0%	7
77.2%	62.9%	18.5%	14.1%	0%	4.4%	0%	8
79.8%	64.6%	16.4%	14.1%	0%	4.8%	0.1%	9
81.3%	65.5%	15%	14.1%	0%	5.3%	0.1%	10
83.6%	67%	13.2%	14.1%	0%	5.6%	0.1%	11
84.7%	67.6%	12.2%	14.1%	0%	5.9%	0.1%	12

Compiler

Compiled 13307 to 8604 computations (35.3% saved)

series1.7min (1.4%)

Counts

13325 → 316435

Calls

82059 calls:

Time	Variable		Expression
378.0ms	x	@	(log.f64 (+.f64 1 (expm1.f64 (*.f64 x 27061/100000))))
343.0ms	x	@	(log.f64 (cbrt.f64 (pow.f64 (exp.f64 27061/100000) x)))
339.0ms	w	@	(+.f64 (.f64 -1 (.f64 (log.f64 (/.f64 1 l)) (.f64 l w))) (.f64 (neg.f64 l) w))
333.0ms	re	@	(pow.f64 (/.f64 1 (cbrt.f64 (/.f64 (log.f64 base) (atan2.f64 im re)))) 3)
321.0ms	z	@	(+.f64 (/.f64 (+.f64 2 (/.f64 2 z)) t) (+.f64 -2 (/.f64 x y)))

Herbie run

sample31.2min (24.8%)

localize24.2min (19.2%)

soundness15.1min (12%)

regimes12.8min (10.2%)

eval12.6min (10%)

simplify8.2min (6.5%)

prune6.2min (4.9%)

rewrite4.6min (3.6%)

bsearch3.9min (3.1%)

preprocess3.0min (2.3%)

analyze2.6min (2%)

series1.7min (1.4%)

end176.0ms (0%)

Profiling