Metrics for Herbie run

Date:	Saturday, October 28th, 2023
Commit:	f24e89ef on platforms
Hostname:	nightly with Racket 8.6
Seed:	2023301
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.4min (27.4%)

Results

30.2s	33597×	body	2048	valid
25.6s	62254×	body	1024	valid
12.6s	86403×	body	256	valid
8.2s	33229×	body	512	valid
1.9s	13209×	body	256	infinite
1.3s	2146×	body	4096	valid
845.0ms	1177×	body	1024	invalid
716.0ms	7206×	body	256	unsamplable
522.0ms	4907×	body	256	invalid
227.0ms	594×	body	512	invalid
221.0ms	448×	body	1024	unsamplable
152.0ms	291×	body	2048	unsamplable
123.0ms	144×	body	1024	infinite
82.0ms	183×	body	512	infinite
65.0ms	248×	body	512	unsamplable
4.0ms	4×	body	2048	invalid
2.0ms	3×	body	2048	infinite

Bogosity

soundness45.0s (14.8%)

Rules

47045×	`associate-r`
45881×	`*-commutative`
44923×	`+-commutative`
42849×	`associate-*r/`
41201×	`associate-/r*`

Stop Event

2×	unsound
2×	saturated
179×	node limit

Compiler

Compiled 16564 to 9977 computations (39.8% saved)

localize40.9s (13.5%)

Compiler: Compiled 14272 to 7438 computations (47.9% saved)

eval37.1s (12.2%)

Compiler: Compiled 1673043 to 1018280 computations (39.1% saved)

simplify24.9s (8.2%)

Algorithm

115×	egg-herbie

Rules

31873×	`associate-r`
28835×	`associate-/l*`
28633×	`associate-l`
28526×	`+-commutative`
26636×	`*-commutative`

Stop Event

6×	done
1×	unsound
28×	saturated
22×	fuel
86×	node limit

Counts

40078 → 40549

Compiler

Compiled 3221 to 2225 computations (30.9% saved)

rewrite19.1s (6.3%)

Algorithm

87×	batch-egg-rewrite

Rules

18039×	`*-un-lft-identity`
15729×	`*-commutative`
14990×	`associate-*r/`
14674×	`add-sqr-sqrt`
14570×	`associate-r`

Stop Event

1×	unsound
86×	node limit

Counts

667 → 30531

prune18.4s (6.1%)

Counts: 61808 → 2091
Compiler: Compiled 108976 to 74181 computations (31.9% saved)

regimes12.8s (4.2%)

Counts

3795 → 306

Calls

43 calls:

3.4s	x
2.6s	eps
995.0ms	a
859.0ms	c
489.0ms	b

Compiler

Compiled 42854 to 24118 computations (43.7% saved)

preprocess10.1s (3.3%)

Algorithm

28×	egg-herbie

Rules

12370×	`fma-def`
5696×	`associate-/r*`
5607×	`associate-+r+`
5463×	`distribute-lft-in`
4995×	`associate-/l*`

Stop Event

13×	saturated
15×	node limit

Compiler

Compiled 9456 to 5576 computations (41% saved)

series4.3s (1.4%)

Counts

667 → 9547

Calls

3141 calls:

Time	Variable		Point	Expression
474.0ms	x	@	inf	(-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x))
108.0ms	N	@	-inf	(*.f64 (pow.f64 (atan2.f64 1 (+.f64 1 (fma.f64 N N N))) 1/4) (sqrt.f64 (atan2.f64 1 (+.f64 1 (fma.f64 N N N)))))
91.0ms	n	@	inf	(/.f64 (-.f64 (log1p.f64 x) (log.f64 x)) n)
82.0ms	x	@	-inf	(*.f64 (pow.f64 x -2) (-.f64 1 (cos.f64 x)))
79.0ms	c	@	0	(log.f64 (+.f64 1 (expm1.f64 (*.f64 -1/2 (/.f64 c b_2)))))

bsearch4.3s (1.4%)

Algorithm

108×	binary-search
28×	left-value

Stop Event

106×	narrow-enough
2×	predicate-same

Results

1.5s	9996×	body	256	valid
1.2s	2379×	body	1024	valid
506.0ms	735×	body	2048	valid
352.0ms	1054×	body	512	valid
118.0ms	1163×	body	256	invalid
74.0ms	381×	body	256	infinite
34.0ms	39×	body	1024	infinite
27.0ms	159×	body	256	unsamplable
19.0ms	41×	body	512	infinite
9.0ms	15×	body	4096	valid
1.0ms	5×	body	512	unsamplable
1.0ms	3×	body	1024	unsamplable
1.0ms	1×	body	2048	unsamplable

Compiler

Compiled 21895 to 16289 computations (25.6% saved)

analyze3.2s (1.1%)

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	90.9%	9.1%	0%	0%	0%	0
27.4%	24.9%	66%	9.1%	0%	0%	0%	1
39%	34.7%	54.4%	9.1%	0%	1.8%	0%	2
51%	44.1%	42.4%	9.1%	0%	4.5%	0%	3
58.9%	50.1%	35%	9.1%	0%	5.8%	0%	4
65.5%	55%	29%	9.1%	0%	6.9%	0%	5
67.8%	56.6%	26.9%	9.1%	0%	7.5%	0%	6
70.2%	57.8%	24.6%	9.1%	0%	8.4%	0.1%	7
72.2%	59.3%	22.8%	9.1%	0%	8.7%	0.1%	8
73.5%	60%	21.6%	9.1%	0%	9.1%	0.3%	9
74.7%	60.5%	20.4%	9.1%	0%	9.7%	0.3%	10
76.2%	61.5%	19.2%	9.1%	0%	9.9%	0.4%	11
76.9%	61.8%	18.5%	9.1%	0%	10.2%	0.4%	12

Compiler

Compiled 375 to 278 computations (25.9% saved)

Herbie run

sample1.4min (27.4%)

soundness45.0s (14.8%)

localize40.9s (13.5%)

eval37.1s (12.2%)

simplify24.9s (8.2%)

rewrite19.1s (6.3%)

prune18.4s (6.1%)

regimes12.8s (4.2%)

preprocess10.1s (3.3%)

series4.3s (1.4%)

bsearch4.3s (1.4%)

analyze3.2s (1.1%)

end2.0ms (0%)

Profiling