Metrics for Herbie run

Date:	Thursday, February 15th, 2024
Commit:	aa763581 on add-id-expand-rule
Hostname:	nightly with Racket 8.11.1
Seed:	2024046
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample25.7min (21%)

Results

10.9min	3475857×	256	valid
1.6min	532287×	256	infinite
1.4min	166860×	1024	valid
1.3min	163905×	512	valid
33.1s	162860×	256	invalid
26.4s	144567×	256	precondition
1.7min	90479×	2048	valid
6.0min	89576×	8192	exit
9.3s	37595×	256	unsamplable
52.3s	13375×	4096	valid
9.6s	12289×	512	infinite
4.6s	6866×	1024	invalid
2.3s	4247×	512	invalid
2.6s	2102×	1024	infinite
17.0s	1842×	8192	valid
4.2s	1421×	2048	infinite
5.3s	1140×	4096	infinite
1.1s	1130×	2048	invalid
3.0ms	4×	512	unsamplable
5.0ms	3×	1024	unsamplable

Bogosity

localize21.2min (17.3%)

Results

Compiler

Compiled 436030 to 202065 computations (53.7% saved)

soundness18.3min (14.9%)

Rules

2063219×	`add0`
2032896×	`fma-define`
1325444×	`fma-neg`
1308838×	`distribute-rgt-in`
1245370×	`distribute-lft-in`

Stop Event

136×	saturated
3298×	node limit
25×	unsound

Compiler

Compiled 299793 to 171978 computations (42.6% saved)

eval13.3min (10.9%)

Results

Compiler

Compiled 38537839 to 20498876 computations (46.8% saved)

simplify9.4min (7.6%)

Algorithm

2227×

egg-herbie

Rules

1515021×	`add0`
1106494×	`fma-define`
884947×	`distribute-rgt-in`
876137×	`distribute-lft-in`
717794×	`times-frac`

Stop Event

534×	saturated
1669×	node limit
338×	fuel
24×	unsound
198×	done

Counts

882909 → 702880

Compiler

Compiled 118969 to 75387 computations (36.6% saved)

regimes9.1min (7.5%)

Counts

81873 → 9009

Calls

1169 calls:

59.2s	x
50.7s	z
48.9s	y
40.6s	t
33.2s	a

Results

Compiler

Compiled 89977 to 67866 computations (24.6% saved)

preprocess6.4min (5.3%)

Algorithm

540×	egg-herbie

Rules

592050×	`fma-neg`
550639×	`fma-define`
208402×	`distribute-rgt-in`
204340×	`add0`
179881×	`unsub-neg`

Stop Event

223×	saturated
317×	node limit

Compiler

Compiled 465911 to 252136 computations (45.9% saved)

rewrite6.4min (5.2%)

Algorithm

1691×

batch-egg-rewrite

Rules

1055383×	`log1p-expm1-u`
789605×	`expm1-log1p-u`
557773×	`fma-define`
529267×	`prod-diff`
456985×	`log-prod`

Stop Event

1681×	node limit
10×	unsound

Counts

13018 → 579482

prune5.4min (4.4%)

Counts: 1128231 → 34277
Compiler: Compiled 1583511 to 1050764 computations (33.6% saved)

bsearch2.7min (2.2%)

Algorithm

519×	left-value
4608×	binary-search

Stop Event

96×	predicate-same
4512×	narrow-enough

Results

1.5min	429754×	256	valid
32.2s	103776×	256	infinite
1.8s	12628×	256	invalid
5.6s	10457×	512	valid
11.8s	7438×	8192	exit
4.1s	7185×	1024	valid
1.7s	2480×	2048	valid
998.0ms	1031×	512	infinite
716.0ms	746×	4096	valid
73.0ms	139×	1024	invalid
98.0ms	133×	1024	infinite
116.0ms	99×	512	invalid
184.0ms	81×	2048	invalid
11.0ms	55×	256	unsamplable
5.0ms	6×	2048	infinite

Compiler

Compiled 1077579 to 802517 computations (25.5% saved)

series2.6min (2.1%)

Counts

13018 → 303427

Calls

79158 calls:

Time	Variable		Point	Expression
420.0ms	d	@	inf	(log.f32 (fmax.f32 (pow.f32 (hypot.f32 (.f32 (floor.f32 d) dX.w) (hypot.f32 (.f32 (floor.f32 w) dX.u) (.f32 (floor.f32 h) dX.v))) 2) (.f32 (pow.f32 (floor.f32 w) 2) (pow.f32 dY.u 2))))
418.0ms	i	@	0	(*.f64 1/2 (/.f64 (-.f64 beta alpha) i))
390.0ms	x	@	-inf	(-.f64 (log.f64 (sinh.f64 x)) (log.f64 x))
347.0ms	x-scale	@	-inf	(-.f64 (.f64 (/.f64 (/.f64 (.f64 (.f64 (.f64 2 (-.f64 (pow.f64 b 2) (pow.f64 a 2))) (sin.f64 (.f64 (/.f64 angle 180) (PI.f64)))) (+.f64 1 (.f64 (.f64 -1/64800 (pow.f64 angle 2)) (pow.f64 (PI.f64) 2)))) x-scale) y-scale) (/.f64 (/.f64 (.f64 (.f64 (.f64 2 (-.f64 (pow.f64 b 2) (pow.f64 a 2))) (sin.f64 (.f64 (/.f64 angle 180) (PI.f64)))) (cos.f64 (.f64 (/.f64 angle 180) (PI.f64)))) x-scale) y-scale)) (.f64 (.f64 4 (/.f64 (/.f64 (+.f64 (pow.f64 (.f64 a (sin.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2) (pow.f64 (.f64 b (cos.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2)) x-scale) x-scale)) (/.f64 (/.f64 (+.f64 (pow.f64 (.f64 a (cos.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2) (pow.f64 (.f64 b (sin.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2)) y-scale) y-scale)))
320.0ms	a	@	0	(-.f64 (+.f64 b (.f64 -3/2 (/.f64 (.f64 a c) b))) b)

analyze2.0min (1.6%)

Algorithm

544×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	84.4%	15.6%	0%	0%	0%	0
39.6%	33.4%	51%	15.6%	0%	0%	0%	1
45.6%	38.2%	45.5%	15.6%	0%	0.7%	0%	2
54.7%	44.6%	37%	15.8%	0%	2.7%	0%	3
61.3%	49.4%	31.2%	15.8%	0%	3.6%	0%	4
67.4%	54%	26.1%	15.8%	0%	4%	0%	5
71.3%	56.8%	22.9%	15.9%	0%	4.3%	0%	6
75.1%	59.5%	19.7%	15.9%	0%	4.8%	0.1%	7
77.1%	60.8%	18.1%	15.9%	0%	5.1%	0.1%	8
79.6%	62.6%	16%	16%	0%	5.4%	0.1%	9
81.2%	63.6%	14.7%	16%	0%	5.6%	0.1%	10
83.4%	65.2%	13%	16%	0%	5.7%	0.1%	11
84.5%	65.8%	12.1%	16%	0%	5.9%	0.1%	12

Compiler

Compiled 13437 to 8705 computations (35.2% saved)

Herbie run

sample25.7min (21%)

localize21.2min (17.3%)

soundness18.3min (14.9%)

eval13.3min (10.9%)

simplify9.4min (7.6%)

regimes9.1min (7.5%)

preprocess6.4min (5.3%)

rewrite6.4min (5.2%)

prune5.4min (4.4%)

bsearch2.7min (2.2%)

series2.6min (2.1%)

analyze2.0min (1.6%)

end402.0ms (0%)

Profiling