Metrics for Herbie run

Date:	Thursday, September 28th, 2023
Commit:	4fc72252 on main
Hostname:	nightly with Racket 8.6
Seed:	2023271
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

soundness6.1min (19.2%)

Rules

1344960×	`fma-def`
748826×	`associate-r`
696276×	`log-prod`
694704×	`fma-neg`
656400×	`times-frac`

Stop Event

4×	unsound
83×	saturated
1631×	node limit

Compiler

Compiled 116914 to 63744 computations (45.5% saved)

sample5.7min (18.2%)

Results

3.8min	1788995×	body	256	valid
46.7s	336172×	body	256	infinite
24.3s	143443×	body	256	invalid
22.0s	45524×	body	1024	valid
10.0s	31921×	body	512	valid
6.2s	9771×	body	2048	valid
2.1s	5007×	body	1024	infinite
1.5s	1568×	body	8192	exit
772.0ms	3123×	body	512	infinite
569.0ms	351×	body	4096	valid
269.0ms	1233×	body	1024	invalid
188.0ms	897×	body	512	invalid
1.0ms	3×	body	2048	invalid

Bogosity

regimes5.3min (16.9%)

Counts

35765 → 6092

Calls

492 calls:

49.9s	z
49.9s	x
48.7s	y
33.5s	t
25.7s	a

Compiler

Compiled 416782 to 226832 computations (45.6% saved)

simplify2.7min (8.6%)

Algorithm

1093×

egg-herbie

Rules

606350×	`fma-def`
489430×	`log-prod`
436548×	`associate-r`
388588×	`times-frac`
386250×	`associate-l`

Stop Event

75×	done
8×	unsound
268×	saturated
194×	fuel
817×	node limit

Counts

368816 → 267816

Compiler

Compiled 69861 to 41912 computations (40% saved)

localize2.7min (8.5%)

Compiler: Compiled 112913 to 46614 computations (58.7% saved)

eval2.6min (8.2%)

Compiler: Compiled 8156032 to 3984244 computations (51.1% saved)

rewrite1.7min (5.2%)

Algorithm

824×	batch-egg-rewrite

Rules

525418×	`pow1`
494842×	`add-exp-log`
494586×	`log1p-expm1-u`
494544×	`expm1-log1p-u`
459894×	`add-log-exp`

Stop Event

2×	unsound
822×	node limit

Counts

5787 → 210768

prune1.6min (5.2%)

Counts: 347107 → 13244
Compiler: Compiled 693517 to 475823 computations (31.4% saved)

bsearch1.5min (4.6%)

Algorithm

3592×	binary-search
404×	left-value

Stop Event

3523×	narrow-enough
69×	predicate-same

Results

51.7s	333950×	body	256	valid
20.1s	89373×	body	256	infinite
3.9s	6554×	body	1024	valid
2.3s	6704×	body	512	valid
794.0ms	6475×	body	256	invalid
334.0ms	373×	body	2048	valid
207.0ms	729×	body	1024	infinite
142.0ms	492×	body	512	infinite
4.0ms	15×	body	1024	invalid
3.0ms	19×	body	512	invalid
0.0ms	1×	body	4096	valid

Compiler

Compiled 787316 to 588030 computations (25.3% saved)

preprocess1.0min (3.3%)

Algorithm

269×	egg-herbie

Rules

379496×	`fma-def`
124614×	`fma-neg`
117016×	`sub-neg`
102806×	`unsub-neg`
98826×	`div-sub`

Stop Event

123×	saturated
146×	node limit

Compiler

Compiled 153357 to 73692 computations (51.9% saved)

series25.3s (1.3%)

Counts

5787 → 158048

Calls

40368 calls:

Time	Variable		Point	Expression
151.0ms	x	@	inf	(*.f64 (/.f64 (-.f64 (sqrt.f64 5) 1) 2) (cos.f64 x))
143.0ms	x	@	0	(*.f64 x (log.f64 y))
129.0ms	z	@	inf	(log.f64 (*.f64 (pow.f64 y x) (/.f64 t (exp.f64 z))))
118.0ms	y	@	-inf	(log1p.f64 (log.f64 (/.f64 x y)))
112.0ms	z	@	inf	(/.f64 2 (*.f64 (/.f64 z x) (-.f64 y t)))

analyze14.5s (0.8%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
49.9%	49.7%	49.9%	0.1%	0%	0.2%	0%	2
57.9%	57.4%	41.7%	0.1%	0%	0.7%	0%	3
64%	63.2%	35.5%	0.1%	0%	1.2%	0%	4
69.8%	68.7%	29.8%	0.1%	0%	1.4%	0%	5
74.4%	72.7%	25.1%	0.1%	0%	2.1%	0%	6
78.5%	76%	20.8%	0.1%	0%	3%	0%	7
80.3%	77.4%	19%	0.1%	0%	3.5%	0%	8
83.1%	79.6%	16.2%	0.1%	0%	4.1%	0%	9
84.8%	80.8%	14.4%	0.1%	0%	4.7%	0%	10
87.7%	83.1%	11.7%	0.1%	0%	5.1%	0%	11
88.9%	83.8%	10.5%	0.1%	0%	5.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Herbie run

soundness6.1min (19.2%)

sample5.7min (18.2%)

regimes5.3min (16.9%)

simplify2.7min (8.6%)

localize2.7min (8.5%)

eval2.6min (8.2%)

rewrite1.7min (5.2%)

prune1.6min (5.2%)

bsearch1.5min (4.6%)

preprocess1.0min (3.3%)

series25.3s (1.3%)

analyze14.5s (0.8%)

end59.0ms (0%)

Profiling