Metrics for Herbie run

Date:	Thursday, January 18th, 2024
Commit:	24741fd0 on main
Hostname:	nightly with Racket 8.6
Seed:	2024018
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample24.6min (22%)

Results

11.1min	3475656×	body	256	valid
4.1min	39620×	body	8192	exit
1.7min	86709×	body	2048	valid
1.6min	534853×	body	256	infinite
1.5min	170245×	body	512	valid
1.4min	162519×	body	1024	valid
1.1min	13064×	body	4096	valid
41.2s	183136×	body	256	invalid
21.8s	1846×	body	8192	valid
16.0s	65139×	body	256	precondition
12.7s	12466×	body	512	infinite
8.9s	11556×	body	1024	invalid
8.2s	38043×	body	256	unsamplable
5.1s	1011×	body	4096	infinite
4.3s	1321×	body	2048	infinite
2.9s	6603×	body	512	invalid
2.6s	1997×	body	1024	infinite
1.5s	1181×	body	2048	invalid
6.0ms	7×	body	512	unsamplable
6.0ms	4×	body	4096	invalid
6.0ms	1×	body	4096	unsamplable
3.0ms	1×	body	8192	invalid
2.0ms	1×	body	1024	unsamplable

Bogosity

localize21.1min (18.8%)

Results

Compiler

Compiled 438040 to 199641 computations (54.4% saved)

soundness15.2min (13.6%)

Rules

2292535×	`fma-def`
1323546×	`associate-r`
1102372×	`times-frac`
1029893×	`log-prod`
1016223×	`associate-l`

Stop Event

40×	unsound
122×	saturated
3324×	node limit

Compiler

Compiled 302581 to 172845 computations (42.9% saved)

eval11.7min (10.5%)

Compiler: Compiled 34639130 to 17799204 computations (48.6% saved)

regimes9.3min (8.3%)

Counts

83017 → 9513

Calls

1176 calls:

55.9s	x
51.4s	y
45.7s	z
42.1s	t
38.6s	a

Compiler

Compiled 1382938 to 749672 computations (45.8% saved)

simplify7.9min (7.1%)

Algorithm

2193×

egg-herbie

Rules

1234703×	`fma-def`
818423×	`log-prod`
790416×	`associate-r`
702044×	`times-frac`
684588×	`associate-l`

Stop Event

21×	unsound
534×	saturated
137×	done
398×	fuel
1638×	node limit

Counts

748181 → 587631

Compiler

Compiled 128800 to 80556 computations (37.5% saved)

rewrite5.9min (5.2%)

Algorithm

1658×

batch-egg-rewrite

Rules

944935×	`log1p-expm1-u`
730223×	`expm1-log1p-u`
564721×	`prod-diff`
547231×	`expm1-udef`
501494×	`log1p-udef`

Stop Event

13×	unsound
1645×	node limit

Counts

13023 → 448625

prune5.0min (4.4%)

Counts: 926237 → 34615
Compiler: Compiled 2507674 to 1713258 computations (31.7% saved)

preprocess4.5min (4%)

Algorithm

540×	egg-herbie

Rules

688760×	`fma-def`
250704×	`fma-neg`
220606×	`sub-neg`
215885×	`div-sub`
202671×	`unsub-neg`

Stop Event

201×	saturated
339×	node limit

Compiler

Compiled 456027 to 247146 computations (45.8% saved)

bsearch2.9min (2.6%)

Algorithm

4984×	binary-search
552×	left-value

Stop Event

4880×	narrow-enough
104×	predicate-same

Results

1.7min	465498×	body	256	valid
32.1s	104282×	body	256	infinite
12.8s	19226×	body	512	valid
4.7s	23938×	body	256	invalid
4.6s	8227×	body	1024	valid
2.5s	3068×	body	2048	valid
1.8s	1822×	body	512	infinite
1.0s	1008×	body	4096	valid
101.0ms	98×	body	8192	valid
99.0ms	121×	body	1024	infinite
75.0ms	183×	body	1024	invalid
75.0ms	26×	body	2048	infinite
36.0ms	123×	body	512	invalid
6.0ms	22×	body	256	unsamplable
1.0ms	1×	body	8192	exit

Compiler

Compiled 1189334 to 877864 computations (26.2% saved)

analyze2.2min (2%)

Algorithm

544×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	85.5%	14.5%	0%	0%	0%	0
39.9%	34.2%	51.4%	14.5%	0%	0%	0%	1
46.1%	39%	45.6%	14.5%	0%	0.9%	0%	2
55%	45.4%	37.1%	14.5%	0%	2.9%	0%	3
61.6%	50.2%	31.3%	14.5%	0%	3.9%	0%	4
67.6%	54.9%	26.3%	14.5%	0%	4.3%	0%	5
71.5%	57.7%	23%	14.5%	0%	4.6%	0%	6
75.3%	60.4%	19.8%	14.6%	0%	5.1%	0.1%	7
77.3%	61.7%	18.1%	14.6%	0%	5.5%	0.1%	8
79.8%	63.5%	16%	14.6%	0%	5.8%	0.1%	9
81.4%	64.4%	14.8%	14.6%	0%	6%	0.1%	10
83.6%	66.1%	13%	14.6%	0%	6.2%	0.1%	11
84.7%	66.7%	12.1%	14.6%	0%	6.4%	0.1%	12

Compiler

Compiled 13340 to 8644 computations (35.2% saved)

series1.8min (1.6%)

Counts

13023 → 299556

Calls

80100 calls:

Time	Variable		Point	Expression
5.0s	x	@	0	(-.f64 (log.f64 (sqrt.f64 x)) (log.f64 (/.f64 y (sqrt.f64 x))))
4.4s	x	@	0	(*.f64 x (-.f64 (log.f64 (sqrt.f64 x)) (log.f64 (/.f64 y (sqrt.f64 x)))))
729.0ms	dY.u	@	inf	(exp.f32 (.f32 (.f32 3 (log.f32 (cbrt.f32 (fmax.f32 (pow.f32 (.f32 dX.v (floor.f32 h)) 2) (pow.f32 (hypot.f32 (.f32 (floor.f32 d) dY.w) (hypot.f32 (.f32 (floor.f32 w) dY.u) (.f32 (floor.f32 h) dY.v))) 2))))) 1/2))
366.0ms	A	@	inf	(.f64 180 (atan.f64 (.f64 1/2 (+.f64 (/.f64 B A) (/.f64 (*.f64 B C) (pow.f64 A 2))))))
353.0ms	b	@	0	(cbrt.f64 (pow.f64 (/.f64 (+.f64 (exp.f64 b) (exp.f64 a)) (exp.f64 a)) -3))

Herbie run

sample24.6min (22%)

localize21.1min (18.8%)

soundness15.2min (13.6%)

eval11.7min (10.5%)

regimes9.3min (8.3%)

simplify7.9min (7.1%)

rewrite5.9min (5.2%)

prune5.0min (4.4%)

preprocess4.5min (4%)

bsearch2.9min (2.6%)

analyze2.2min (2%)

series1.8min (1.6%)

end357.0ms (0%)

Profiling