Metrics for Herbie run

Date:	Friday, August 18th, 2023
Commit:	5f639494 on main
Hostname:	nightly with Racket 8.6
Seed:	2023230
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize8.5min (35.5%)

Results

Compiler

Compiled 91259 to 44103 computations (51.7% saved)

sample7.6min (32%)

Results

2.6min	16915×	body	8192	exit
1.2min	64470×	body	1024	valid
56.5s	8114×	body	4096	valid
53.9s	268882×	body	256	valid
33.1s	13569×	body	2048	valid
28.6s	1603×	body	8192	valid
17.6s	32587×	body	512	valid
7.3s	4154×	body	1024	infinite
5.9s	27916×	body	256	unsamplable
5.7s	27713×	body	256	infinite
3.8s	21265×	body	256	invalid
3.8s	553×	body	4096	infinite
3.5s	842×	body	2048	infinite
2.2s	5424×	body	2048	invalid
2.1s	2208×	body	512	infinite
1.4s	3688×	body	1024	invalid
600.0ms	2166×	body	512	invalid
413.0ms	29×	body	8192	infinite
114.0ms	2×	body	8192	unsamplable
79.0ms	902×	body	256	precondition
8.0ms	12×	body	512	unsamplable
4.0ms	3×	body	1024	unsamplable
3.0ms	11×	body	4096	invalid

Bogosity

eval1.9min (7.9%)

Results

Compiler

Compiled 6555228 to 3503313 computations (46.6% saved)

soundness1.4min (5.9%)

Rules

337628×	`fma-def`
201114×	`associate-r`
161382×	`log-prod`
149990×	`associate-l`
132024×	`times-frac`

Stop Event

4×	unsound
12×	saturated
430×	node limit

Compiler

Compiled 48869 to 28687 computations (41.3% saved)

regimes1.1min (4.7%)

Counts

17014 → 829

Calls

137 calls:

4.8s	phi2
4.8s	lambda1
4.7s	lambda2
4.6s	phi1
4.4s	b

Compiler

Compiled 365678 to 173666 computations (52.5% saved)

simplify52.6s (3.7%)

Algorithm

280×	egg-herbie

Rules

214718×	`fma-def`
132456×	`associate-r`
108802×	`associate-l`
91340×	`log-prod`
90736×	`times-frac`

Stop Event

1×	unsound
65×	saturated
6×	done
42×	fuel
214×	node limit

Counts

83834 → 65482

Compiler

Compiled 14903 to 9714 computations (34.8% saved)

prune47.6s (3.3%)

Counts: 141970 → 6790
Compiler: Compiled 738130 to 491988 computations (33.3% saved)

analyze33.6s (2.4%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
19.6%	15.5%	63.8%	20.6%	0%	0%	0%	1
27.1%	21.4%	57.6%	21%	0%	0%	0%	2
36.8%	28.5%	48.9%	21.2%	0%	1.4%	0%	3
42.3%	32.2%	43.9%	21.2%	0%	2.8%	0%	4
47.2%	35.4%	39.6%	21.2%	0%	3.8%	0%	5
50.2%	37.2%	36.9%	21.2%	0%	4.6%	0%	6
53.6%	39.3%	34%	21.2%	0%	5.4%	0.1%	7
55.3%	40.3%	32.5%	21.3%	0%	5.8%	0.1%	8
58.3%	42%	30.1%	21.3%	0%	6.4%	0.2%	9
59.6%	42.8%	29%	21.3%	0%	6.7%	0.2%	10
61.9%	44.2%	27.2%	21.3%	0%	7.1%	0.3%	11
63.3%	45%	26%	21.3%	0%	7.4%	0.3%	12

Compiler

Compiled 1919 to 1338 computations (30.3% saved)

rewrite21.7s (1.5%)

Algorithm

181×	batch-egg-rewrite

Rules

122982×	`pow1`
116622×	`add-exp-log`
116498×	`log1p-expm1-u`
116460×	`expm1-log1p-u`
111386×	`add-log-exp`

Stop Event

3×	unsound
178×	node limit

Counts

1770 → 44398

bsearch18.8s (1.3%)

Algorithm

329×	binary-search
54×	left-value

Stop Event

320×	narrow-enough
9×	predicate-same

Results

8.3s	7287×	body	1024	valid
4.9s	26341×	body	256	valid
1.6s	1760×	body	2048	valid
1.6s	2675×	body	512	valid
804.0ms	806×	body	4096	valid
310.0ms	2568×	body	256	invalid
127.0ms	759×	body	256	infinite
65.0ms	103×	body	1024	infinite
54.0ms	9×	body	4096	infinite
29.0ms	76×	body	512	infinite
26.0ms	8×	body	2048	infinite
2.0ms	6×	body	512	invalid

Compiler

Compiled 97809 to 71667 computations (26.7% saved)

preprocess13.2s (0.9%)

Algorithm

51×	egg-herbie

Rules

66624×	`fma-def`
26490×	`fma-neg`
25742×	`div-sub`
23584×	`sub-neg`
22428×	`distribute-lft-neg-in`

Stop Event

10×	saturated
41×	node limit

Compiler

Compiled 34094 to 18096 computations (46.9% saved)

series13.2s (0.9%)

Counts

1770 → 39385

Calls

10122 calls:

Time	Variable		Point	Expression
416.0ms	phi1	@	inf	(log.f64 (/.f64 (exp.f64 (cos.f64 delta)) (exp.f64 (.f64 (sin.f64 phi1) (fma.f64 (sin.f64 delta) (.f64 (cos.f64 phi1) (cos.f64 theta)) (*.f64 (cos.f64 delta) (sin.f64 phi1)))))))
217.0ms	c	@	0	(exp.f64 (.f64 1/4 (+.f64 (.f64 -1 (log.f64 (/.f64 1 a))) (log.f64 (*.f64 -4 c)))))
155.0ms	theta	@	-inf	(log.f64 (cbrt.f64 (pow.f64 (pow.f64 (exp.f64 (sin.f64 theta)) (cos.f64 phi1)) (sin.f64 delta))))
107.0ms	b	@	inf	(-.f64 b (sqrt.f64 (fma.f64 b b (.f64 (.f64 a c) -3))))
95.0ms	delta	@	-inf	(log.f64 (+.f64 1 (expm1.f64 (.f64 (sin.f64 delta) (.f64 (cos.f64 phi1) (sin.f64 theta))))))

Herbie run

localize8.5min (35.5%)

sample7.6min (32%)

eval1.9min (7.9%)

soundness1.4min (5.9%)

regimes1.1min (4.7%)

simplify52.6s (3.7%)

prune47.6s (3.3%)

analyze33.6s (2.4%)

rewrite21.7s (1.5%)

bsearch18.8s (1.3%)

preprocess13.2s (0.9%)

series13.2s (0.9%)

end22.0ms (0%)

Profiling