Metrics for Herbie run

Date:	Wednesday, August 30th, 2023
Commit:	5f639494 on main
Hostname:	nightly with Racket 8.6
Seed:	2023242
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample22.2min (24.5%)

Results

8.4min	3331741×	body	256	valid
3.9min	47537×	body	8192	exit
2.7min	274413×	body	1024	valid
1.7min	97751×	body	2048	valid
1.3min	524752×	body	256	infinite
1.0min	14727×	body	4096	valid
50.7s	149069×	body	512	valid
44.2s	258962×	body	256	invalid
28.9s	2408×	body	8192	valid
14.5s	20226×	body	1024	infinite
8.9s	50515×	body	256	unsamplable
7.6s	16183×	body	1024	invalid
6.4s	1229×	body	4096	infinite
4.8s	1577×	body	2048	infinite
4.6s	11013×	body	512	infinite
2.9s	8839×	body	512	invalid
2.0s	5295×	body	2048	invalid
833.0ms	3011×	body	256	precondition
339.0ms	24×	body	8192	infinite
182.0ms	428×	body	1024	unsamplable
150.0ms	282×	body	2048	unsamplable
60.0ms	244×	body	512	unsamplable
3.0ms	6×	body	4096	invalid
2.0ms	1×	body	8192	invalid

Bogosity

localize20.2min (22.4%)

Results

Compiler

Compiled 381986 to 180648 computations (52.7% saved)

soundness11.4min (12.6%)

Rules

2642086×	`fma-def`
1558688×	`associate-r`
1333238×	`log-prod`
1268246×	`associate-l`
1182634×	`fma-neg`

Stop Event

25×	unsound
208×	saturated
3487×	node limit

Compiler

Compiled 321402 to 184941 computations (42.5% saved)

eval8.0min (8.9%)

Compiler: Compiled 26795277 to 14573710 computations (45.6% saved)

regimes7.8min (8.6%)

Counts

83114 → 9704

Calls

1154 calls:

51.6s	x
45.0s	y
38.3s	z
29.4s	t
27.2s	a

Compiler

Compiled 1294164 to 687027 computations (46.9% saved)

simplify6.3min (7%)

Algorithm

2754×

egg-herbie

Rules

1870500×	`fma-def`
1056424×	`associate-r`
913224×	`associate-l`
910260×	`log-prod`
886538×	`fma-neg`

Stop Event

12×	unsound
814×	saturated
134×	done
399×	fuel
1928×	node limit

Counts

734679 → 577661

Results

Compiler

Compiled 126111 to 79203 computations (37.2% saved)

prune4.1min (4.6%)

Counts: 855757 → 35761
Compiler: Compiled 2403975 to 1629398 computations (32.2% saved)

rewrite3.3min (3.6%)

Algorithm

1685×

batch-egg-rewrite

Rules

1116008×	`pow1`
1054264×	`add-exp-log`
1053262×	`log1p-expm1-u`
1053052×	`expm1-log1p-u`
998832×	`add-log-exp`

Stop Event

10×	unsound
1675×	node limit

Counts

13641 → 413088

bsearch2.5min (2.7%)

Algorithm

5098×	binary-search
541×	left-value

Stop Event

4996×	narrow-enough
3×	predicate-failed
99×	predicate-same

Results

1.3min	467981×	body	256	valid
25.9s	109016×	body	256	infinite
17.4s	24857×	body	1024	valid
5.8s	14471×	body	512	valid
3.7s	25350×	body	256	invalid
3.3s	3979×	body	2048	valid
1.9s	4263×	body	1024	infinite
1.8s	1809×	body	4096	valid
776.0ms	2474×	body	512	infinite
281.0ms	345×	body	8192	valid
199.0ms	502×	body	1024	invalid
84.0ms	352×	body	512	invalid
40.0ms	53×	body	2048	infinite
9.0ms	15×	body	2048	invalid
5.0ms	7×	body	8192	exit
5.0ms	32×	body	256	unsamplable

Compiler

Compiled 1196607 to 881415 computations (26.3% saved)

preprocess2.0min (2.2%)

Algorithm

536×	egg-herbie

Rules

704136×	`fma-def`
261454×	`fma-neg`
211808×	`sub-neg`
201670×	`div-sub`
191518×	`unsub-neg`

Stop Event

208×	saturated
328×	node limit

Compiler

Compiled 292259 to 153466 computations (47.5% saved)

analyze1.4min (1.5%)

Algorithm

540×	search
2×	random

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	86.8%	13.2%	0%	0%	0%	0
40.5%	35.1%	51.6%	13.2%	0%	0%	0%	1
46.5%	40.1%	46.1%	13.3%	0%	0.6%	0%	2
56.2%	47.7%	37.3%	13.3%	0%	1.8%	0%	3
62.2%	52.5%	31.9%	13.3%	0%	2.4%	0%	4
67.9%	57%	27%	13.3%	0%	2.7%	0%	5
71.6%	59.8%	23.7%	13.3%	0%	3.2%	0%	6
75.5%	62.4%	20.3%	13.3%	0%	4.1%	0%	7
77.3%	63.6%	18.7%	13.3%	0%	4.4%	0%	8
79.8%	65.3%	16.5%	13.3%	0%	4.9%	0.1%	9
81.4%	66.2%	15.1%	13.3%	0%	5.3%	0.1%	10
83.6%	67.7%	13.3%	13.3%	0%	5.7%	0.1%	11
84.7%	68.3%	12.3%	13.3%	0%	6%	0.1%	12

Compiler

Compiled 11868 to 8225 computations (30.7% saved)

series1.2min (1.3%)

Counts

13641 → 321878

Calls

83154 calls:

Time	Variable		Point	Expression
456.0ms	y	@	inf	(.f64 -9 (.f64 (*.f64 y t) z))
297.0ms	n	@	-inf	(fma.f64 (+.f64 n 1) (log.f64 (+.f64 n 1)) (neg.f64 (*.f64 n (log.f64 n))))
284.0ms	Om	@	-inf	(log.f64 (.f64 (.f64 l (/.f64 2 Om)) (hypot.f64 (sin.f64 kx) (sin.f64 ky))))
259.0ms	x	@	0	(+.f64 x (fma.f64 x y y))
257.0ms	z	@	0	(*.f64 (log1p.f64 (neg.f64 y)) z)

Herbie run

sample22.2min (24.5%)

localize20.2min (22.4%)

soundness11.4min (12.6%)

eval8.0min (8.9%)

regimes7.8min (8.6%)

simplify6.3min (7%)

prune4.1min (4.6%)

rewrite3.3min (3.6%)

bsearch2.5min (2.7%)

preprocess2.0min (2.2%)

analyze1.4min (1.5%)

series1.2min (1.3%)

end111.0ms (0%)

Profiling