Metrics for Herbie run

Date:	Sunday, October 1st, 2023
Commit:	89d2ba58 on better-profiles
Hostname:	nightly with Racket 8.6
Seed:	2023274
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample10.0min (34.6%)

Results

2.7min	15587×	body	8192	exit
1.8min	64534×	body	1024	valid
1.4min	8166×	body	4096	valid
1.3min	269420×	body	256	valid
49.5s	13417×	body	2048	valid
36.4s	1515×	body	8192	valid
26.9s	32423×	body	512	valid
9.9s	4278×	body	1024	infinite
7.7s	26799×	body	256	infinite
6.7s	25565×	body	256	unsamplable
6.5s	633×	body	4096	infinite
6.2s	21406×	body	256	invalid
4.9s	798×	body	2048	infinite
3.4s	5197×	body	2048	invalid
3.0s	2112×	body	512	infinite
2.4s	3748×	body	1024	invalid
1.1s	2283×	body	512	invalid
482.0ms	24×	body	8192	infinite
158.0ms	899×	body	256	precondition
9.0ms	6×	body	1024	unsamplable
4.0ms	5×	body	512	unsamplable
4.0ms	10×	body	4096	invalid

Bogosity

localize8.5min (29.5%)

Results

Compiler

Compiled 80396 to 37770 computations (53% saved)

eval2.4min (8.3%)

Results

Compiler

Compiled 5479615 to 2881929 computations (47.4% saved)

soundness1.8min (6.2%)

Rules

296372×	`fma-def`
177940×	`associate-r`
158108×	`log-prod`
143976×	`associate-l`
143590×	`*-commutative`

Stop Event

4×	unsound
7×	saturated
406×	node limit

Compiler

Compiled 41589 to 23790 computations (42.8% saved)

regimes1.7min (6%)

Counts

14490 → 807

Calls

130 calls:

7.8s	phi2
5.9s	a
5.9s	angle
5.9s	b
5.7s	(/.f64 angle 180)

Compiler

Compiled 292248 to 128416 computations (56.1% saved)

simplify1.0min (3.6%)

Algorithm

217×	egg-herbie

Rules

139242×	`fma-def`
99060×	`associate-r`
90172×	`log-prod`
87192×	`associate-l`
76920×	`*-commutative`

Stop Event

1×	unsound
47×	saturated
8×	done
39×	fuel
169×	node limit

Counts

77508 → 59889

Compiler

Compiled 13311 to 8554 computations (35.7% saved)

prune1.0min (3.5%)

Counts: 125716 → 6334
Compiler: Compiled 669642 to 454153 computations (32.2% saved)

analyze56.4s (3.2%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
19.6%	15.5%	63.8%	20.6%	0%	0%	0%	1
27.1%	21.4%	57.6%	21%	0%	0%	0%	2
36.8%	28.5%	48.9%	21.2%	0%	1.4%	0%	3
42.3%	32.2%	43.9%	21.2%	0%	2.8%	0%	4
47.2%	35.4%	39.6%	21.2%	0%	3.8%	0%	5
50.2%	37.2%	36.9%	21.2%	0%	4.6%	0%	6
53.6%	39.3%	34%	21.2%	0%	5.4%	0.1%	7
55.3%	40.3%	32.5%	21.3%	0%	5.8%	0.1%	8
58.3%	42%	30.1%	21.3%	0%	6.4%	0.2%	9
59.6%	42.8%	29%	21.3%	0%	6.7%	0.2%	10
61.9%	44.2%	27.2%	21.3%	0%	7.1%	0.3%	11
63.3%	45%	26%	21.3%	0%	7.4%	0.3%	12

Compiler

Compiled 1919 to 1338 computations (30.3% saved)

rewrite27.9s (1.6%)

Algorithm

170×	batch-egg-rewrite

Rules

122298×	`pow1`
115692×	`add-exp-log`
115656×	`log1p-expm1-u`
115608×	`expm1-log1p-u`
109006×	`add-log-exp`

Stop Event

2×	unsound
168×	node limit

Counts

1635 → 41060

bsearch27.2s (1.6%)

Algorithm

327×	binary-search
57×	left-value

Stop Event

319×	narrow-enough
8×	predicate-same

Results

9.4s	25637×	body	256	valid
8.0s	6115×	body	1024	valid
2.3s	2766×	body	512	valid
2.1s	1850×	body	2048	valid
1.4s	5574×	body	256	invalid
962.0ms	671×	body	4096	valid
469.0ms	181×	body	1024	infinite
408.0ms	749×	body	1024	invalid
321.0ms	438×	body	2048	invalid
246.0ms	610×	body	256	infinite
149.0ms	409×	body	512	invalid
138.0ms	112×	body	512	infinite
5.0ms	27×	body	256	unsamplable

Compiler

Compiled 88812 to 65501 computations (26.2% saved)

preprocess17.4s (1%)

Algorithm

51×	egg-herbie

Rules

66624×	`fma-def`
26490×	`fma-neg`
25742×	`div-sub`
23584×	`sub-neg`
22428×	`distribute-lft-neg-in`

Stop Event

10×	saturated
41×	node limit

Compiler

Compiled 30946 to 16162 computations (47.8% saved)

series16.9s (1%)

Counts

1635 → 36448

Calls

9492 calls:

Time	Variable		Point	Expression
317.0ms	phi1	@	inf	(log.f64 (+.f64 (atan2.f64 (.f64 (.f64 (sin.f64 theta) (sin.f64 delta)) (cos.f64 phi1)) (cos.f64 delta)) lambda1))
184.0ms	b	@	-inf	(/.f64 (pow.f64 (cbrt.f64 (*.f64 -3/2 (/.f64 c (/.f64 b a)))) 3) (/.f64 a 1/3))
135.0ms	phi1	@	inf	(log1p.f64 (-.f64 (cos.f64 delta) (.f64 (sin.f64 phi1) (fma.f64 (cos.f64 delta) (sin.f64 phi1) (.f64 (cos.f64 theta) (*.f64 (cos.f64 phi1) (sin.f64 delta)))))))
134.0ms	g	@	0	(log.f64 (cbrt.f64 (exp.f64 (cos.f64 (fma.f64 1/3 (acos.f64 (/.f64 g h)) (*.f64 2/3 (PI.f64)))))))
132.0ms	h	@	inf	(log.f64 (cbrt.f64 (exp.f64 (cos.f64 (fma.f64 1/3 (acos.f64 (/.f64 g h)) (*.f64 2/3 (PI.f64)))))))

Herbie run

sample10.0min (34.6%)

localize8.5min (29.5%)

eval2.4min (8.3%)

soundness1.8min (6.2%)

regimes1.7min (6%)

simplify1.0min (3.6%)

prune1.0min (3.5%)

analyze56.4s (3.2%)

rewrite27.9s (1.6%)

bsearch27.2s (1.6%)

preprocess17.4s (1%)

series16.9s (1%)

end27.0ms (0%)

Profiling