Metrics for Herbie run

Date:	Saturday, January 20th, 2024
Commit:	d8d592a2 on error-explanations-2
Hostname:	nightly with Racket 8.6
Seed:	2024020
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize8.0min (30.3%)

Results

Compiler

Compiled 83099 to 44592 computations (46.3% saved)

sample7.4min (28.2%)

Results

2.7min	16994×	body	8192	exit
1.2min	299060×	body	256	valid
55.8s	7340×	body	4096	valid
43.6s	45768×	body	512	valid
31.0s	11184×	body	2048	valid
20.8s	25406×	body	1024	valid
20.8s	1084×	body	8192	valid
7.1s	5985×	body	512	infinite
6.6s	27165×	body	256	unsamplable
6.0s	27104×	body	256	infinite
5.4s	27455×	body	256	invalid
3.0s	389×	body	4096	infinite
3.0s	650×	body	2048	infinite
2.0s	555×	body	1024	infinite
1.7s	1166×	body	2048	invalid
1.6s	1687×	body	1024	invalid
789.0ms	1143×	body	512	invalid
111.0ms	904×	body	256	precondition
34.0ms	1×	body	8192	unsamplable
9.0ms	6×	body	1024	unsamplable
3.0ms	4×	body	512	unsamplable

Bogosity

eval2.1min (7.9%)

Compiler: Compiled 6479570 to 3761393 computations (41.9% saved)

preprocess1.9min (7.1%)

Algorithm

51×	egg-herbie

Rules

76366×	`fma-def`
27106×	`div-sub`
26806×	`fma-neg`
24952×	`sub-neg`
22390×	`distribute-lft-in`

Stop Event

8×	saturated
43×	node limit

Compiler

Compiled 76416 to 46210 computations (39.5% saved)

soundness1.8min (7%)

Rules

272780×	`fma-def`
172066×	`associate-r`
135860×	`log-prod`
135446×	`fma-neg`
133096×	`associate-l`

Stop Event

6×	saturated
8×	unsound
404×	node limit

Compiler

Compiled 50393 to 30401 computations (39.7% saved)

regimes1.4min (5.5%)

Counts

15814 → 781

Calls

137 calls:

5.9s	phi2
5.4s	phi1
5.4s	lambda1
5.2s	lambda2
4.7s	b

Compiler

Compiled 376467 to 202802 computations (46.1% saved)

simplify55.2s (3.5%)

Algorithm

221×	egg-herbie

Rules

151162×	`fma-def`
91232×	`associate-r`
86882×	`log-prod`
80192×	`associate-l`
79302×	`times-frac`

Stop Event

1×	unsound
48×	saturated
8×	done
40×	fuel
172×	node limit

Counts

81548 → 66550

Compiler

Compiled 14191 to 9528 computations (32.9% saved)

prune55.1s (3.5%)

Counts

149073 → 6473

Results

Compiler

Compiled 707772 to 496756 computations (29.8% saved)

analyze46.2s (2.9%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
14.8%	11.8%	67.6%	20.6%	0%	0%	0%	1
22.6%	17.7%	60.4%	21%	0%	0.9%	0%	2
32.7%	24.7%	50.8%	21.2%	0%	3.3%	0%	3
39.8%	29.8%	45%	21.2%	0%	4%	0%	4
45.4%	33.8%	40.6%	21.2%	0%	4.5%	0%	5
48.4%	35.7%	38%	21.2%	0%	5.1%	0%	6
51.8%	37.8%	35.2%	21.2%	0%	5.7%	0.1%	7
53.5%	38.9%	33.8%	21.3%	0%	6%	0.1%	8
56.4%	40.6%	31.4%	21.3%	0%	6.6%	0.2%	9
57.7%	41.4%	30.3%	21.3%	0%	6.8%	0.2%	10
59.8%	42.7%	28.7%	21.3%	0%	7.1%	0.3%	11
61.3%	43.5%	27.5%	21.3%	0%	7.5%	0.3%	12

Compiler

Compiled 1919 to 1343 computations (30% saved)

rewrite36.0s (2.3%)

Algorithm

173×	batch-egg-rewrite

Rules

98691×	`log1p-expm1-u`
71354×	`expm1-log1p-u`
57806×	`expm1-udef`
56244×	`log1p-udef`
49506×	`log-prod`

Stop Event

3×	unsound
170×	node limit

Counts

1667 → 47235

series15.0s (0.9%)

Counts

1667 → 34313

Calls

9489 calls:

Time	Variable		Point	Expression
389.0ms	a	@	0	(pow.f64 (sqrt.f64 (cbrt.f64 (/.f64 (*.f64 a 2) g))) -2)
352.0ms	a	@	0	(+.f64 (neg.f64 b) (pow.f64 (cbrt.f64 (fma.f64 b b (.f64 c (.f64 a -3)))) 3/2))
342.0ms	phi2	@	-inf	(log1p.f64 (cos.f64 (*.f64 (+.f64 phi1 phi2) 1/2)))
319.0ms	g	@	0	(pow.f64 (sqrt.f64 (cbrt.f64 (/.f64 (*.f64 a 2) g))) -2)
159.0ms	lambda2	@	inf	(log.f64 (+.f64 1 (expm1.f64 (sin.f64 (-.f64 lambda1 lambda2)))))

bsearch14.0s (0.9%)

Algorithm

269×	binary-search
87×	left-value

Stop Event

268×	narrow-enough
1×	predicate-same

Results

5.7s	23721×	body	256	valid
4.1s	5287×	body	512	valid
1.3s	1097×	body	4096	valid
1.2s	1328×	body	2048	valid
614.0ms	870×	body	1024	valid
240.0ms	1668×	body	256	invalid
110.0ms	463×	body	256	infinite
77.0ms	162×	body	512	infinite
6.0ms	9×	body	1024	invalid
3.0ms	4×	body	2048	invalid
3.0ms	7×	body	512	invalid

Compiler

Compiled 79545 to 59491 computations (25.2% saved)

Herbie run

localize8.0min (30.3%)

sample7.4min (28.2%)

eval2.1min (7.9%)

preprocess1.9min (7.1%)

soundness1.8min (7%)

regimes1.4min (5.5%)

simplify55.2s (3.5%)

prune55.1s (3.5%)

analyze46.2s (2.9%)

rewrite36.0s (2.3%)

series15.0s (0.9%)

bsearch14.0s (0.9%)

end24.0ms (0%)

Profiling