Metrics for Herbie run

Date:	Wednesday, November 1st, 2023
Commit:	9364c08b on platforms
Hostname:	nightly with Racket 8.6
Seed:	2023305
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

eval1.8min (17.2%)

Compiler: Compiled 3789470 to 2455191 computations (35.2% saved)

sample1.8min (17.1%)

Results

33.0s	154808×	body	256	valid
20.9s	29428×	body	1024	valid
11.5s	66404×	body	256	invalid
8.4s	39367×	body	256	infinite
8.1s	7905×	body	8192	exit
5.7s	13973×	body	512	valid
5.7s	10203×	body	2048	valid
3.5s	5991×	body	1024	invalid
2.4s	637×	body	4096	infinite
2.0s	2000×	body	4096	valid
1.7s	7965×	body	256	unsamplable
1.4s	2622×	body	1024	infinite
1.3s	642×	body	2048	infinite
952.0ms	3020×	body	512	invalid
769.0ms	811×	body	8192	valid
464.0ms	1445×	body	512	infinite
1.0ms	1×	body	2048	invalid

Bogosity

soundness1.7min (16.1%)

Rules

119956×	`associate-r`
100364×	`*-commutative`
96835×	`associate-/r*`
94826×	`associate-*r/`
92458×	`associate-l`

Stop Event

2×	unsound
5×	saturated
381×	node limit

Compiler

Compiled 38063 to 23171 computations (39.1% saved)

localize1.5min (14.6%)

Compiler: Compiled 39632 to 21728 computations (45.2% saved)

regimes58.8s (9.3%)

Counts

9429 → 896

Calls

152 calls:

5.1s	l
4.0s	t
3.2s	h
2.4s	d
2.4s	F

Compiler

Compiled 147370 to 84206 computations (42.9% saved)

simplify43.9s (6.9%)

Algorithm

147×	egg-herbie

Rules

43946×	`associate-/r*`
43109×	`*-commutative`
41954×	`associate-/l*`
41472×	`associate-*r/`
35377×	`associate-r`

Stop Event

3×	done
31×	saturated
28×	fuel
116×	node limit

Counts

70619 → 59969

Compiler

Compiled 15347 to 9875 computations (35.7% saved)

prune31.9s (5%)

Counts: 95590 → 2849
Compiler: Compiled 213225 to 153088 computations (28.2% saved)

rewrite25.0s (3.9%)

Algorithm

116×	batch-egg-rewrite

Rules

31509×	`associate-r`
28802×	`*-un-lft-identity`
25231×	`add-sqr-sqrt`
22223×	`add-cube-cbrt`
20704×	`add-cbrt-cube`

Stop Event

2×	unsound
114×	node limit

Counts

1198 → 42561

bsearch24.6s (3.9%)

Algorithm

464×	binary-search
93×	left-value

Stop Event

458×	narrow-enough
6×	predicate-same

Results

8.4s	33777×	body	256	valid
5.3s	7662×	body	1024	valid
2.8s	12100×	body	256	invalid
2.8s	11159×	body	256	infinite
1.5s	3443×	body	512	valid
887.0ms	1359×	body	4096	valid
707.0ms	795×	body	8192	valid
672.0ms	1236×	body	2048	valid
128.0ms	371×	body	1024	invalid
122.0ms	327×	body	1024	infinite
60.0ms	204×	body	512	infinite
59.0ms	266×	body	512	invalid
23.0ms	32×	body	2048	infinite
6.0ms	6×	body	4096	infinite

Compiler

Compiled 152157 to 113668 computations (25.3% saved)

preprocess19.2s (3%)

Algorithm

31×	egg-herbie

Rules

10369×	`fma-def`
9749×	`distribute-lft-in`
9512×	`*-commutative`
7807×	`distribute-rgt-in`
7442×	`associate-/r*`

Stop Event

5×	saturated
26×	node limit

Compiler

Compiled 42286 to 23101 computations (45.4% saved)

analyze9.9s (1.6%)

Algorithm

31×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	98.2%	1.8%	0%	0%	0%	0
23%	22.6%	75.6%	1.8%	0%	0%	0%	1
24.2%	23.3%	73.2%	1.8%	0%	1.6%	0%	2
30.2%	28.2%	65.2%	1.8%	0%	4.8%	0%	3
34%	31.2%	60.6%	1.8%	0%	6.4%	0%	4
36.2%	33.2%	58.5%	1.8%	0%	6.4%	0%	5
40.4%	37%	54.5%	1.8%	0%	6.6%	0%	6
45.4%	41.1%	49.4%	1.8%	0%	7.3%	0.4%	7
47.7%	42.6%	46.7%	1.8%	0%	8.6%	0.4%	8
50.6%	44.9%	43.9%	1.8%	0%	8.9%	0.5%	9
51.7%	45.7%	42.7%	1.8%	0%	9.3%	0.5%	10
53.4%	46.8%	40.9%	1.8%	0%	9.9%	0.6%	11
55.1%	48%	39.1%	1.8%	0%	10.5%	0.6%	12

Compiler

Compiled 845 to 604 computations (28.5% saved)

series8.5s (1.3%)

Counts

1198 → 28058

Calls

8118 calls:

Time	Variable		Point	Expression
311.0ms	M	@	0	(.f64 (pow.f64 (.f64 (/.f64 M 2) (/.f64 D d)) 2) (/.f64 h l))
173.0ms	D	@	-inf	(fma.f64 (pow.f64 (/.f64 M (.f64 (/.f64 -2 D) d)) 2) (.f64 -1/2 (/.f64 h l)) 1)
139.0ms	D	@	inf	(/.f64 (.f64 (/.f64 M (.f64 d 2)) D) (/.f64 1 h))
138.0ms	ky	@	inf	(pow.f64 (fma.f64 (/.f64 1/4 l) (/.f64 Om (sin.f64 ky)) 1/2) 3/2)
109.0ms	l	@	0	(.f64 (.f64 n U) (-.f64 t (fma.f64 2 (.f64 (/.f64 l Om) l) (.f64 (.f64 n (pow.f64 (/.f64 l Om) 2)) (-.f64 U U)))))

Herbie run

eval1.8min (17.2%)

sample1.8min (17.1%)

soundness1.7min (16.1%)

localize1.5min (14.6%)

regimes58.8s (9.3%)

simplify43.9s (6.9%)

prune31.9s (5%)

rewrite25.0s (3.9%)

bsearch24.6s (3.9%)

preprocess19.2s (3%)

analyze9.9s (1.6%)

series8.5s (1.3%)

end16.0ms (0%)

Profiling