Metrics for Herbie run

Date:	Saturday, August 12th, 2023
Commit:	e1aa4bdc on compare-reports
Hostname:	nightly with Racket 8.6
Seed:	2023224
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize9.4min (38.2%)

Results

Compiler

Compiled 91631 to 43351 computations (52.7% saved)

sample7.5min (30.6%)

Results

2.6min	16785×	body	8192	exit
1.1min	64622×	body	1024	valid
59.3s	8292×	body	4096	valid
51.5s	270139×	body	256	valid
31.1s	13258×	body	2048	valid
27.7s	1557×	body	8192	valid
16.3s	32188×	body	512	valid
6.9s	4192×	body	1024	infinite
5.8s	26954×	body	256	infinite
5.8s	28155×	body	256	unsamplable
4.2s	580×	body	4096	infinite
3.5s	21387×	body	256	invalid
3.2s	810×	body	2048	infinite
2.0s	2138×	body	512	infinite
1.9s	5437×	body	2048	invalid
1.5s	3864×	body	1024	invalid
644.0ms	2170×	body	512	invalid
438.0ms	30×	body	8192	infinite
82.0ms	918×	body	256	precondition
13.0ms	1×	body	4096	unsamplable
5.0ms	4×	body	1024	unsamplable
2.0ms	9×	body	4096	invalid
2.0ms	3×	body	512	unsamplable

Bogosity

eval1.8min (7.3%)

Compiler: Compiled 5983768 to 3186173 computations (46.8% saved)

soundness1.5min (6.2%)

Rules

343434×	`fma-def`
190722×	`associate-r`
157294×	`fma-neg`
153564×	`*-commutative`
148576×	`log-prod`

Stop Event

7×	unsound
12×	saturated
446×	node limit

Compiler

Compiled 57047 to 32779 computations (42.5% saved)

regimes1.2min (4.8%)

Counts

17950 → 853

Calls

137 calls:

7.0s	phi2
5.5s	phi1
5.1s	lambda2
5.0s	lambda1
3.6s	b

Compiler

Compiled 420948 to 188667 computations (55.2% saved)

simplify50.5s (3.4%)

Algorithm

277×	egg-herbie

Rules

208968×	`fma-def`
117398×	`associate-r`
94762×	`associate-l`
92240×	`fma-neg`
92098×	`*-commutative`

Stop Event

2×	unsound
65×	saturated
6×	done
42×	fuel
210×	node limit

Counts

79374 → 61585

Compiler

Compiled 16183 to 10422 computations (35.6% saved)

prune43.1s (2.9%)

Counts: 128947 → 6796
Compiler: Compiled 702426 to 466665 computations (33.6% saved)

analyze33.4s (2.3%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
19.6%	15.5%	63.8%	20.6%	0%	0%	0%	1
27.1%	21.4%	57.6%	21%	0%	0%	0%	2
36.8%	28.5%	48.9%	21.2%	0%	1.4%	0%	3
42.3%	32.2%	43.9%	21.2%	0%	2.8%	0%	4
47.2%	35.4%	39.6%	21.2%	0%	3.8%	0%	5
50.2%	37.2%	36.9%	21.2%	0%	4.6%	0%	6
53.6%	39.3%	34%	21.2%	0%	5.4%	0.1%	7
55.3%	40.3%	32.5%	21.3%	0%	5.8%	0.1%	8
58.3%	42%	30.1%	21.3%	0%	6.4%	0.2%	9
59.6%	42.8%	29%	21.3%	0%	6.7%	0.2%	10
61.9%	44.2%	27.2%	21.3%	0%	7.1%	0.3%	11
63.3%	45%	26%	21.3%	0%	7.4%	0.3%	12

Compiler

Compiled 1919 to 1338 computations (30.3% saved)

rewrite20.3s (1.4%)

Algorithm

178×	batch-egg-rewrite

Rules

132550×	`pow1`
125520×	`add-exp-log`
125460×	`log1p-expm1-u`
125412×	`expm1-log1p-u`
116942×	`add-log-exp`

Stop Event

3×	unsound
175×	node limit

Counts

1708 → 40430

bsearch18.3s (1.2%)

Algorithm

335×	binary-search
71×	left-value

Stop Event

323×	narrow-enough
12×	predicate-same

Results

8.2s	7692×	body	1024	valid
4.5s	24175×	body	256	valid
1.7s	3050×	body	512	valid
1.5s	1570×	body	2048	valid
1.1s	1081×	body	4096	valid
251.0ms	1813×	body	256	invalid
122.0ms	899×	body	256	infinite
62.0ms	113×	body	1024	infinite
61.0ms	172×	body	512	infinite
4.0ms	11×	body	512	invalid
4.0ms	7×	body	1024	invalid
3.0ms	47×	body	256	unsamplable
3.0ms	4×	body	2048	invalid

Compiler

Compiled 95616 to 69587 computations (27.2% saved)

preprocess12.5s (0.9%)

Algorithm

51×	egg-herbie

Rules

66624×	`fma-def`
26490×	`fma-neg`
25742×	`div-sub`
23584×	`sub-neg`
22428×	`distribute-lft-neg-in`

Stop Event

10×	saturated
41×	node limit

Compiler

Compiled 37172 to 19510 computations (47.5% saved)

series11.4s (0.8%)

Counts

1708 → 38893

Calls

9909 calls:

Time	Variable		Point	Expression
142.0ms	phi2	@	inf	(log1p.f64 (*.f64 (cos.f64 phi2) (cos.f64 (-.f64 lambda2 lambda1))))
104.0ms	a	@	0	(expm1.f64 (log1p.f64 (fma.f64 (/.f64 (pow.f64 (pow.f64 (+.f64 1 (exp.f64 a)) 8) 1/18) (+.f64 1 (exp.f64 a))) b (log1p.f64 (exp.f64 a)))))
71.0ms	lambda1	@	inf	(log1p.f64 (*.f64 (cos.f64 phi2) (cos.f64 (-.f64 lambda2 lambda1))))
70.0ms	h	@	inf	(log1p.f64 (.f64 1/3 (cos.f64 (fma.f64 2/3 (PI.f64) (.f64 (acos.f64 (/.f64 g h)) 1/3)))))
63.0ms	angle	@	inf	(log1p.f64 (pow.f64 (.f64 (sin.f64 (.f64 angle (*.f64 (PI.f64) 1/180))) a) 2))

Herbie run

localize9.4min (38.2%)

sample7.5min (30.6%)

eval1.8min (7.3%)

soundness1.5min (6.2%)

regimes1.2min (4.8%)

simplify50.5s (3.4%)

prune43.1s (2.9%)

analyze33.4s (2.3%)

rewrite20.3s (1.4%)

bsearch18.3s (1.2%)

preprocess12.5s (0.9%)

series11.4s (0.8%)

end17.0ms (0%)

Profiling