Metrics for Herbie run

Date:	Saturday, January 20th, 2024
Commit:	70513fd1 on error-explanations-2
Hostname:	nightly with Racket 8.6
Seed:	2024020
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize7.9min (29.8%)

Results

Compiler

Compiled 83099 to 44592 computations (46.3% saved)

sample7.5min (28.2%)

Results

2.7min	16979×	body	8192	exit
1.2min	299056×	body	256	valid
57.1s	7340×	body	4096	valid
44.3s	45768×	body	512	valid
32.0s	11184×	body	2048	valid
21.5s	25406×	body	1024	valid
20.1s	1084×	body	8192	valid
7.4s	5985×	body	512	infinite
6.7s	27136×	body	256	unsamplable
6.3s	27104×	body	256	infinite
5.7s	27455×	body	256	invalid
3.2s	650×	body	2048	infinite
2.9s	389×	body	4096	infinite
1.7s	555×	body	1024	infinite
1.5s	1687×	body	1024	invalid
1.4s	1166×	body	2048	invalid
595.0ms	1143×	body	512	invalid
101.0ms	904×	body	256	precondition
34.0ms	1×	body	8192	unsamplable
9.0ms	6×	body	1024	unsamplable
3.0ms	4×	body	512	unsamplable

Bogosity

eval2.3min (8.7%)

Results

Compiler

Compiled 6479570 to 3761393 computations (41.9% saved)

preprocess1.9min (7.3%)

Algorithm

51×	egg-herbie

Rules

76366×	`fma-def`
27106×	`div-sub`
26806×	`fma-neg`
24952×	`sub-neg`
22390×	`distribute-lft-in`

Stop Event

8×	saturated
43×	node limit

Compiler

Compiled 76416 to 46210 computations (39.5% saved)

soundness1.8min (6.9%)

Rules

272780×	`fma-def`
172066×	`associate-r`
135860×	`log-prod`
135446×	`fma-neg`
133096×	`associate-l`

Stop Event

6×	saturated
8×	unsound
404×	node limit

Compiler

Compiled 50393 to 30401 computations (39.7% saved)

regimes1.4min (5.3%)

Counts

15814 → 781

Calls

137 calls:

5.9s	phi1
5.7s	b
5.6s	phi2
5.0s	lambda1
4.8s	lambda2

Compiler

Compiled 376467 to 202802 computations (46.1% saved)

simplify57.6s (3.6%)

Algorithm

221×	egg-herbie

Rules

151162×	`fma-def`
91232×	`associate-r`
86882×	`log-prod`
80192×	`associate-l`
79302×	`times-frac`

Stop Event

1×	unsound
48×	saturated
8×	done
40×	fuel
172×	node limit

Counts

81548 → 66550

Compiler

Compiled 14191 to 9528 computations (32.9% saved)

prune56.9s (3.6%)

Counts: 149073 → 6473
Compiler: Compiled 707772 to 496756 computations (29.8% saved)

analyze43.5s (2.7%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
14.8%	11.8%	67.6%	20.6%	0%	0%	0%	1
22.6%	17.7%	60.4%	21%	0%	0.9%	0%	2
32.7%	24.7%	50.8%	21.2%	0%	3.3%	0%	3
39.8%	29.8%	45%	21.2%	0%	4%	0%	4
45.4%	33.8%	40.6%	21.2%	0%	4.5%	0%	5
48.4%	35.7%	38%	21.2%	0%	5.1%	0%	6
51.8%	37.8%	35.2%	21.2%	0%	5.7%	0.1%	7
53.5%	38.9%	33.8%	21.3%	0%	6%	0.1%	8
56.4%	40.6%	31.4%	21.3%	0%	6.6%	0.2%	9
57.7%	41.4%	30.3%	21.3%	0%	6.8%	0.2%	10
59.8%	42.7%	28.7%	21.3%	0%	7.1%	0.3%	11
61.3%	43.5%	27.5%	21.3%	0%	7.5%	0.3%	12

Compiler

Compiled 1919 to 1343 computations (30% saved)

rewrite35.1s (2.2%)

Algorithm

173×	batch-egg-rewrite

Rules

98691×	`log1p-expm1-u`
71354×	`expm1-log1p-u`
57806×	`expm1-udef`
56244×	`log1p-udef`
49506×	`log-prod`

Stop Event

3×	unsound
170×	node limit

Counts

1667 → 47235

series14.5s (0.9%)

Counts

1667 → 34313

Calls

9489 calls:

Time	Variable		Point	Expression
309.0ms	g	@	-inf	(pow.f64 (*.f64 1/2 (/.f64 g a)) 1/6)
251.0ms	x	@	inf	(log.f64 (+.f64 1 (exp.f64 x)))
146.0ms	lambda1	@	-inf	(-.f64 (exp.f64 (log1p.f64 (+.f64 (cos.f64 phi1) (cos.f64 (-.f64 lambda2 lambda1))))) 1)
145.0ms	lambda2	@	inf	(log.f64 (+.f64 1 (expm1.f64 (sin.f64 (-.f64 lambda1 lambda2)))))
102.0ms	phi1	@	inf	(log1p.f64 (cos.f64 (*.f64 (+.f64 phi1 phi2) 1/2)))

bsearch13.3s (0.8%)

Algorithm

269×	binary-search
87×	left-value

Stop Event

268×	narrow-enough
1×	predicate-same

Results

5.2s	23721×	body	256	valid
4.0s	5287×	body	512	valid
1.4s	1097×	body	4096	valid
1.0s	1328×	body	2048	valid
487.0ms	870×	body	1024	valid
240.0ms	1668×	body	256	invalid
107.0ms	463×	body	256	infinite
79.0ms	162×	body	512	infinite
7.0ms	9×	body	1024	invalid
5.0ms	4×	body	2048	invalid
3.0ms	7×	body	512	invalid

Compiler

Compiled 79545 to 59491 computations (25.2% saved)

Herbie run

localize7.9min (29.8%)

sample7.5min (28.2%)

eval2.3min (8.7%)

preprocess1.9min (7.3%)

soundness1.8min (6.9%)

regimes1.4min (5.3%)

simplify57.6s (3.6%)

prune56.9s (3.6%)

analyze43.5s (2.7%)

rewrite35.1s (2.2%)

series14.5s (0.9%)

bsearch13.3s (0.8%)

end28.0ms (0%)

Profiling