Metrics for Herbie run

Date:	Thursday, January 18th, 2024
Commit:	24741fd0 on main
Hostname:	nightly with Racket 8.6
Seed:	2024018
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize8.3min (31.8%)

Results

Compiler

Compiled 83622 to 45289 computations (45.8% saved)

sample7.5min (28.8%)

Results

2.7min	17310×	body	8192	exit
1.2min	298974×	body	256	valid
58.3s	7512×	body	4096	valid
45.5s	45920×	body	512	valid
30.6s	10847×	body	2048	valid
21.0s	1057×	body	8192	valid
20.2s	25411×	body	1024	valid
8.1s	5947×	body	512	infinite
6.8s	27315×	body	256	unsamplable
6.5s	27216×	body	256	infinite
5.3s	27751×	body	256	invalid
3.1s	426×	body	4096	infinite
2.9s	658×	body	2048	infinite
2.0s	1684×	body	1024	invalid
1.6s	530×	body	1024	infinite
1.5s	1181×	body	2048	invalid
974.0ms	1217×	body	512	invalid
109.0ms	918×	body	256	precondition
6.0ms	7×	body	512	unsamplable
6.0ms	1×	body	4096	unsamplable
2.0ms	1×	body	1024	unsamplable

Bogosity

eval2.2min (8.4%)

Compiler: Compiled 6416416 to 3751801 computations (41.5% saved)

soundness1.6min (6.2%)

Rules

266614×	`fma-def`
185944×	`associate-r`
128154×	`log-prod`
128116×	`fma-neg`
127100×	`associate-l`

Stop Event

5×	saturated
8×	unsound
378×	node limit

Compiler

Compiled 46817 to 28478 computations (39.2% saved)

regimes1.6min (6.1%)

Counts

16354 → 769

Calls

134 calls:

9.5s	phi2
7.6s	phi1
7.4s	lambda2
7.0s	lambda1
4.8s	(-.f64 lambda1 lambda2)

Compiler

Compiled 449835 to 238280 computations (47% saved)

preprocess1.2min (4.5%)

Algorithm

51×	egg-herbie

Rules

76366×	`fma-def`
27106×	`div-sub`
26806×	`fma-neg`
24952×	`sub-neg`
22390×	`distribute-lft-in`

Stop Event

8×	saturated
43×	node limit

Compiler

Compiled 62530 to 37313 computations (40.3% saved)

simplify57.1s (3.7%)

Algorithm

218×	egg-herbie

Rules

142072×	`fma-def`
97596×	`associate-r`
86042×	`log-prod`
75966×	`associate-l`
73826×	`*-commutative`

Stop Event

2×	unsound
47×	saturated
6×	done
41×	fuel
169×	node limit

Counts

80806 → 65787

Compiler

Compiled 15279 to 10304 computations (32.6% saved)

prune52.9s (3.4%)

Counts: 146383 → 6374
Compiler: Compiled 667859 to 471169 computations (29.5% saved)

analyze46.2s (3%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
14.8%	11.8%	67.6%	20.6%	0%	0%	0%	1
22.6%	17.7%	60.4%	21%	0%	0.9%	0%	2
32.7%	24.7%	50.8%	21.2%	0%	3.3%	0%	3
39.8%	29.8%	45%	21.2%	0%	4%	0%	4
45.4%	33.8%	40.6%	21.2%	0%	4.5%	0%	5
48.4%	35.7%	38%	21.2%	0%	5.1%	0%	6
51.8%	37.8%	35.2%	21.2%	0%	5.7%	0.1%	7
53.5%	38.9%	33.8%	21.3%	0%	6%	0.1%	8
56.4%	40.6%	31.4%	21.3%	0%	6.6%	0.2%	9
57.7%	41.4%	30.3%	21.3%	0%	6.8%	0.2%	10
59.8%	42.7%	28.7%	21.3%	0%	7.1%	0.3%	11
61.3%	43.5%	27.5%	21.3%	0%	7.5%	0.3%	12

Compiler

Compiled 1919 to 1343 computations (30% saved)

rewrite35.4s (2.3%)

Algorithm

171×	batch-egg-rewrite

Rules

87949×	`log1p-expm1-u`
68625×	`expm1-log1p-u`
57670×	`expm1-udef`
53142×	`log1p-udef`
50224×	`prod-diff`

Stop Event

3×	unsound
168×	node limit

Counts

1585 → 48076

bsearch15.9s (1%)

Algorithm

284×	binary-search
63×	left-value

Stop Event

274×	narrow-enough
10×	predicate-same

Results

6.6s	7692×	body	512	valid
5.7s	23467×	body	256	valid
971.0ms	1226×	body	2048	valid
790.0ms	683×	body	4096	valid
595.0ms	855×	body	1024	valid
278.0ms	1723×	body	256	invalid
52.0ms	281×	body	256	infinite
41.0ms	68×	body	512	infinite

Compiler

Compiled 99729 to 73684 computations (26.1% saved)

series13.6s (0.9%)

Counts

1585 → 32730

Calls

8973 calls:

Time	Variable		Point	Expression
366.0ms	A	@	inf	(.f64 180 (atan.f64 (.f64 1/2 (+.f64 (/.f64 B A) (/.f64 (*.f64 B C) (pow.f64 A 2))))))
353.0ms	b	@	0	(cbrt.f64 (pow.f64 (/.f64 (+.f64 (exp.f64 b) (exp.f64 a)) (exp.f64 a)) -3))
160.0ms	x	@	inf	(log1p.f64 (exp.f64 x))
141.0ms	ew	@	inf	(sqrt.f64 (*.f64 ew (/.f64 (sin.f64 t) (hypot.f64 1 (/.f64 (/.f64 eh ew) (tan.f64 t))))))
109.0ms	lambda2	@	-inf	(log.f64 (+.f64 1 (expm1.f64 (*.f64 (sin.f64 lambda1) (sin.f64 lambda2)))))

Herbie run

localize8.3min (31.8%)

sample7.5min (28.8%)

eval2.2min (8.4%)

soundness1.6min (6.2%)

regimes1.6min (6.1%)

preprocess1.2min (4.5%)

simplify57.1s (3.7%)

prune52.9s (3.4%)

analyze46.2s (3%)

rewrite35.4s (2.3%)

bsearch15.9s (1%)

series13.6s (0.9%)

end32.0ms (0%)

Profiling