Metrics for Herbie run

Date:	Wednesday, July 19th, 2023
Commit:	687f458a on main
Hostname:	nightly with Racket 8.6
Seed:	2023200
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

localize7.9min (34%)

Results

Compiler

Compiled 90752 to 42937 computations (52.7% saved)

sample7.5min (32.3%)

Results

2.6min	16917×	body	8192	exit
1.2min	65106×	body	1024	valid
58.3s	8218×	body	4096	valid
53.1s	269337×	body	256	valid
31.9s	13412×	body	2048	valid
28.4s	1611×	body	8192	valid
17.0s	32237×	body	512	valid
6.6s	3984×	body	1024	infinite
5.9s	27877×	body	256	unsamplable
5.5s	27232×	body	256	infinite
3.9s	841×	body	2048	infinite
3.7s	525×	body	4096	infinite
3.6s	21221×	body	256	invalid
2.1s	2215×	body	512	infinite
1.9s	5248×	body	2048	invalid
1.4s	3755×	body	1024	invalid
570.0ms	2217×	body	512	invalid
250.0ms	16×	body	8192	infinite
90.0ms	920×	body	256	precondition
5.0ms	3×	body	1024	unsamplable
4.0ms	6×	body	512	unsamplable
2.0ms	8×	body	4096	invalid

Bogosity

eval2.0min (8.4%)

Compiler: Compiled 6440088 to 3478058 computations (46% saved)

soundness1.4min (6.2%)

Rules

341974×	`fma-def`
193850×	`associate-r`
174690×	`log-prod`
165734×	`associate-l`
152748×	`fma-neg`

Stop Event

4×	unsound
15×	saturated
438×	node limit

Compiler

Compiled 54693 to 31689 computations (42.1% saved)

regimes1.2min (5.1%)

Counts

17075 → 826

Calls

137 calls:

6.2s	phi1
5.7s	b
5.0s	phi2
4.8s	lambda1
3.9s	lambda2

Compiler

Compiled 376373 to 179850 computations (52.2% saved)

simplify52.6s (3.8%)

Algorithm

275×	egg-herbie

Rules

205382×	`fma-def`
125358×	`associate-r`
107486×	`associate-l`
91316×	`fma-neg`
89366×	`*-commutative`

Stop Event

1×	unsound
65×	saturated
6×	done
42×	fuel
209×	node limit

Counts

80077 → 63117

Compiler

Compiled 14976 to 9600 computations (35.9% saved)

prune43.2s (3.1%)

Counts: 132106 → 6497
Compiler: Compiled 669978 to 450786 computations (32.7% saved)

analyze33.3s (2.4%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
19.6%	15.5%	63.8%	20.6%	0%	0%	0%	1
27.1%	21.4%	57.6%	21%	0%	0%	0%	2
36.8%	28.5%	48.9%	21.2%	0%	1.4%	0%	3
42.3%	32.2%	43.9%	21.2%	0%	2.8%	0%	4
47.2%	35.4%	39.6%	21.2%	0%	3.8%	0%	5
50.2%	37.2%	36.9%	21.2%	0%	4.6%	0%	6
53.6%	39.3%	34%	21.2%	0%	5.4%	0.1%	7
55.3%	40.3%	32.5%	21.3%	0%	5.8%	0.1%	8
58.3%	42%	30.1%	21.3%	0%	6.4%	0.2%	9
59.6%	42.8%	29%	21.3%	0%	6.7%	0.2%	10
61.9%	44.2%	27.2%	21.3%	0%	7.1%	0.3%	11
63.3%	45%	26%	21.3%	0%	7.4%	0.3%	12

Compiler

Compiled 1919 to 1338 computations (30.3% saved)

bsearch21.4s (1.5%)

Algorithm

349×	binary-search
37×	left-value

Stop Event

341×	narrow-enough
8×	predicate-same

Results

9.7s	8493×	body	1024	valid
4.8s	24578×	body	256	valid
1.8s	3101×	body	512	valid
1.6s	1812×	body	2048	valid
1.1s	1162×	body	4096	valid
725.0ms	3655×	body	256	invalid
200.0ms	339×	body	1024	invalid
178.0ms	962×	body	256	infinite
172.0ms	309×	body	1024	infinite
164.0ms	253×	body	2048	invalid
71.0ms	191×	body	512	infinite
70.0ms	206×	body	512	invalid
2.0ms	31×	body	256	unsamplable

Compiler

Compiled 101859 to 73634 computations (27.7% saved)

rewrite20.3s (1.5%)

Algorithm

176×	batch-egg-rewrite

Rules

127366×	`pow1`
120520×	`add-exp-log`
120428×	`log1p-expm1-u`
120394×	`expm1-log1p-u`
113662×	`add-log-exp`

Stop Event

3×	unsound
173×	node limit

Counts

1709 → 41937

preprocess12.1s (0.9%)

Algorithm

51×	egg-herbie

Rules

66624×	`fma-def`
26490×	`fma-neg`
25742×	`div-sub`
23584×	`sub-neg`
22428×	`distribute-lft-neg-in`

Stop Event

10×	saturated
41×	node limit

Compiler

Compiled 34990 to 18268 computations (47.8% saved)

series11.9s (0.9%)

Counts

1709 → 38089

Calls

9843 calls:

Time	Variable		Point	Expression
248.0ms	x	@	-inf	(log1p.f64 (exp.f64 x))
91.0ms	phi1	@	inf	(log1p.f64 (*.f64 (cos.f64 delta) (sin.f64 phi1)))
82.0ms	a	@	inf	(-.f64 (exp.f64 (log1p.f64 (/.f64 1/3 a))) 1)
75.0ms	delta	@	-inf	(log.f64 (-.f64 (+.f64 (cos.f64 delta) 1) (.f64 (sin.f64 phi1) (+.f64 (.f64 (sin.f64 delta) (cos.f64 phi1)) (*.f64 (cos.f64 delta) (sin.f64 phi1))))))
71.0ms	delta	@	inf	(log1p.f64 (*.f64 (cos.f64 delta) (sin.f64 phi1)))

Herbie run

localize7.9min (34%)

sample7.5min (32.3%)

eval2.0min (8.4%)

soundness1.4min (6.2%)

regimes1.2min (5.1%)

simplify52.6s (3.8%)

prune43.2s (3.1%)

analyze33.3s (2.4%)

bsearch21.4s (1.5%)

rewrite20.3s (1.5%)

preprocess12.1s (0.9%)

series11.9s (0.9%)

end18.0ms (0%)

Profiling