Metrics for Herbie run

Date:	Saturday, January 6th, 2024
Commit:	b16ab614 on platforms
Hostname:	nightly with Racket 8.6
Seed:	2024006
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample7.4min (28.2%)

Results

2.6min	17169×	body	8192	exit
1.0min	295848×	body	256	valid
56.9s	8245×	body	4096	valid
50.7s	43308×	body	1024	valid
31.6s	13029×	body	2048	valid
29.0s	1596×	body	8192	valid
16.3s	27788×	body	512	valid
7.6s	4171×	body	1024	infinite
6.4s	27836×	body	256	unsamplable
5.7s	27083×	body	256	infinite
4.7s	27616×	body	256	invalid
4.1s	565×	body	4096	infinite
3.9s	880×	body	2048	infinite
2.3s	2174×	body	512	infinite
1.4s	1189×	body	2048	invalid
1.3s	1656×	body	1024	invalid
734.0ms	1173×	body	512	invalid
384.0ms	26×	body	8192	infinite
97.0ms	872×	body	256	precondition
7.0ms	10×	body	512	unsamplable
4.0ms	2×	body	1024	unsamplable

Bogosity

localize7.3min (27.8%)

Results

Compiler

Compiled 81828 to 44475 computations (45.6% saved)

eval2.5min (9.5%)

Compiler: Compiled 7696384 to 4494309 computations (41.6% saved)

soundness2.1min (7.9%)

Rules

116309×	`associate-r`
111044×	`*-commutative`
91733×	`associate-l`
88887×	`+-commutative`
83223×	`associate-*r/`

Stop Event

3×	saturated
8×	unsound
410×	node limit

Results

Compiler

Compiled 52424 to 30943 computations (41% saved)

regimes1.9min (7.1%)

Counts

22845 → 834

Calls

137 calls:

9.7s	phi2
8.8s	phi1
8.2s	lambda2
8.0s	lambda1
6.1s	b

Compiler

Compiled 559630 to 302970 computations (45.9% saved)

preprocess1.2min (4.7%)

Algorithm

51×	egg-herbie

Rules

23347×	`fma-def`
16429×	`*-commutative`
15412×	`distribute-lft-in`
12579×	`associate-r`
12151×	`distribute-rgt-in`

Stop Event

7×	saturated
44×	node limit

Compiler

Compiled 65102 to 37977 computations (41.7% saved)

simplify1.1min (4.2%)

Algorithm

220×	egg-herbie

Rules

58423×	`*-commutative`
54087×	`+-commutative`
53433×	`associate-/l*`
52380×	`associate-r`
51544×	`associate-*r/`

Stop Event

3×	unsound
48×	saturated
9×	done
39×	fuel
169×	node limit

Counts

98485 → 84608

Compiler

Compiled 17275 to 11517 computations (33.3% saved)

prune1.1min (4%)

Counts: 180194 → 6632
Compiler: Compiled 688196 to 483875 computations (29.7% saved)

rewrite37.9s (2.4%)

Algorithm

172×	batch-egg-rewrite

Rules

42171×	`*-un-lft-identity`
39887×	`associate-r`
33796×	`add-sqr-sqrt`
30231×	`add-cube-cbrt`
28955×	`add-cbrt-cube`

Stop Event

3×	unsound
169×	node limit

Counts

1662 → 63987

analyze36.7s (2.3%)

Algorithm

53×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	79.4%	20.6%	0%	0%	0%	0
14.8%	11.8%	67.6%	20.6%	0%	0%	0%	1
22.6%	17.7%	60.4%	21%	0%	0.9%	0%	2
32.7%	24.7%	50.8%	21.2%	0%	3.3%	0%	3
39.8%	29.8%	45%	21.2%	0%	4%	0%	4
45.4%	33.8%	40.6%	21.2%	0%	4.5%	0%	5
48.4%	35.7%	38%	21.2%	0%	5.1%	0%	6
51.8%	37.8%	35.2%	21.2%	0%	5.7%	0.1%	7
53.5%	38.9%	33.8%	21.3%	0%	6%	0.1%	8
56.4%	40.6%	31.4%	21.3%	0%	6.6%	0.2%	9
57.7%	41.4%	30.3%	21.3%	0%	6.8%	0.2%	10
59.8%	42.7%	28.7%	21.3%	0%	7.1%	0.3%	11
61.3%	43.5%	27.5%	21.3%	0%	7.5%	0.3%	12

Compiler

Compiled 1919 to 1338 computations (30.3% saved)

bsearch17.5s (1.1%)

Algorithm

279×	binary-search
104×	left-value

Stop Event

269×	narrow-enough
10×	predicate-same

Results

5.6s	5144×	body	1024	valid
5.3s	22351×	body	256	valid
2.5s	3018×	body	512	valid
1.5s	1078×	body	2048	valid
1.1s	742×	body	4096	valid
256.0ms	1891×	body	256	invalid
112.0ms	83×	body	1024	infinite
107.0ms	17×	body	4096	infinite
75.0ms	393×	body	256	infinite
75.0ms	19×	body	2048	infinite
48.0ms	83×	body	1024	invalid
43.0ms	58×	body	2048	invalid
23.0ms	51×	body	512	infinite
16.0ms	45×	body	512	invalid

Compiler

Compiled 89083 to 66283 computations (25.6% saved)

series12.1s (0.8%)

Counts

1662 → 34498

Calls

9567 calls:

Time	Variable		Point	Expression
211.0ms	y-scale	@	inf	(/.f64 (neg.f64 (sqrt.f64 (.f64 (.f64 (.f64 2 (/.f64 (.f64 4 (.f64 (.f64 b a) (.f64 b (neg.f64 a)))) (pow.f64 (.f64 x-scale y-scale) 2))) (.f64 (.f64 b a) (.f64 b (neg.f64 a)))) (+.f64 (+.f64 (/.f64 (/.f64 (+.f64 (pow.f64 (.f64 a (sin.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2) (pow.f64 (.f64 b (cos.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2)) x-scale) x-scale) (/.f64 (/.f64 (+.f64 (pow.f64 (.f64 a (cos.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2) (pow.f64 (.f64 b (sin.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2)) y-scale) y-scale)) (sqrt.f64 (+.f64 (pow.f64 (-.f64 (/.f64 (/.f64 (+.f64 (pow.f64 (.f64 a (sin.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2) (pow.f64 (.f64 b (cos.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2)) x-scale) x-scale) (/.f64 (/.f64 (+.f64 (pow.f64 (.f64 a (cos.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2) (pow.f64 (.f64 b (sin.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2)) y-scale) y-scale)) 2) (pow.f64 (/.f64 (/.f64 (.f64 (.f64 (.f64 2 (-.f64 (pow.f64 b 2) (pow.f64 a 2))) (sin.f64 (.f64 (/.f64 angle 180) (PI.f64)))) (cos.f64 (.f64 (/.f64 angle 180) (PI.f64)))) x-scale) y-scale) 2))))))) (/.f64 (.f64 4 (.f64 (.f64 b a) (.f64 b (neg.f64 a)))) (pow.f64 (*.f64 x-scale y-scale) 2)))
152.0ms	x-scale	@	0	(/.f64 (neg.f64 (sqrt.f64 (.f64 (.f64 (.f64 2 (/.f64 (.f64 4 (.f64 (.f64 b a) (.f64 b (neg.f64 a)))) (pow.f64 (.f64 x-scale y-scale) 2))) (.f64 (.f64 b a) (.f64 b (neg.f64 a)))) (+.f64 (+.f64 (/.f64 (/.f64 (+.f64 (pow.f64 (.f64 a (sin.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2) (pow.f64 (.f64 b (cos.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2)) x-scale) x-scale) (/.f64 (/.f64 (+.f64 (pow.f64 (.f64 a (cos.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2) (pow.f64 (.f64 b (sin.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2)) y-scale) y-scale)) (sqrt.f64 (+.f64 (pow.f64 (-.f64 (/.f64 (/.f64 (+.f64 (pow.f64 (.f64 a (sin.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2) (pow.f64 (.f64 b (cos.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2)) x-scale) x-scale) (/.f64 (/.f64 (+.f64 (pow.f64 (.f64 a (cos.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2) (pow.f64 (.f64 b (sin.f64 (.f64 (/.f64 angle 180) (PI.f64)))) 2)) y-scale) y-scale)) 2) (pow.f64 (/.f64 (/.f64 (.f64 (.f64 (.f64 2 (-.f64 (pow.f64 b 2) (pow.f64 a 2))) (sin.f64 (.f64 (/.f64 angle 180) (PI.f64)))) (cos.f64 (.f64 (/.f64 angle 180) (PI.f64)))) x-scale) y-scale) 2))))))) (/.f64 (.f64 4 (.f64 (.f64 b a) (.f64 b (neg.f64 a)))) (pow.f64 (*.f64 x-scale y-scale) 2)))
99.0ms	b	@	0	(/.f64 (neg.f64 (sqrt.f64 (.f64 (.f64 (.f64 a (.f64 b (.f64 b (neg.f64 a)))) (.f64 2 (/.f64 (.f64 4 (.f64 a (.f64 b (.f64 b (neg.f64 a))))) (pow.f64 (.f64 x-scale y-scale) 2)))) (+.f64 (/.f64 (+.f64 (pow.f64 (.f64 a (sin.f64 (/.f64 (.f64 angle (PI.f64)) 180))) 2) (pow.f64 (.f64 b (cos.f64 (/.f64 (.f64 angle (PI.f64)) 180))) 2)) (pow.f64 x-scale 2)) (+.f64 (/.f64 (+.f64 (pow.f64 (.f64 a (cos.f64 (/.f64 (.f64 angle (PI.f64)) 180))) 2) (pow.f64 (.f64 b (sin.f64 (/.f64 (.f64 angle (PI.f64)) 180))) 2)) (pow.f64 y-scale 2)) (sqrt.f64 (+.f64 (pow.f64 (-.f64 (/.f64 (+.f64 (pow.f64 (.f64 a (sin.f64 (/.f64 (.f64 angle (PI.f64)) 180))) 2) (pow.f64 (.f64 b (cos.f64 (/.f64 (.f64 angle (PI.f64)) 180))) 2)) (pow.f64 x-scale 2)) (/.f64 (+.f64 (pow.f64 (.f64 a (cos.f64 (/.f64 (.f64 angle (PI.f64)) 180))) 2) (pow.f64 (.f64 b (sin.f64 (/.f64 (.f64 angle (PI.f64)) 180))) 2)) (pow.f64 y-scale 2))) 2) (pow.f64 (/.f64 (.f64 (cos.f64 (/.f64 (.f64 angle (PI.f64)) 180)) (.f64 (sin.f64 (/.f64 (.f64 angle (PI.f64)) 180)) (.f64 2 (-.f64 (pow.f64 b 2) (pow.f64 a 2))))) (.f64 x-scale y-scale)) 2)))))))) (.f64 4 (.f64 a (.f64 b (*.f64 b (neg.f64 a))))))
99.0ms	x	@	0	(log.f64 (+.f64 x x))
89.0ms	phi2	@	inf	(+.f64 (cos.f64 phi1) (*.f64 (cos.f64 phi2) (cos.f64 lambda2)))

Results

Herbie run

sample7.4min (28.2%)

localize7.3min (27.8%)

eval2.5min (9.5%)

soundness2.1min (7.9%)

regimes1.9min (7.1%)

preprocess1.2min (4.7%)

simplify1.1min (4.2%)

prune1.1min (4%)

rewrite37.9s (2.4%)

analyze36.7s (2.3%)

bsearch17.5s (1.1%)

series12.1s (0.8%)

end34.0ms (0%)

Profiling