Metrics for Herbie run

Date:	Saturday, November 18th, 2023
Commit:	fb1f2946 on main
Hostname:	nightly with Racket 8.6
Seed:	2023322
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

soundness6.4min (18.8%)

Rules

1150160×	`fma-def`
609272×	`associate-r`
561412×	`times-frac`
505820×	`log-prod`
489066×	`fma-neg`

Stop Event

85×	saturated
6×	unsound
1481×	node limit

Compiler

Compiled 104978 to 57714 computations (45% saved)

sample6.1min (18%)

Results

4.0min	1790804×	body	256	valid
49.1s	333912×	body	256	infinite
24.9s	144803×	body	256	invalid
24.0s	45563×	body	1024	valid
11.1s	32368×	body	512	valid
7.2s	9670×	body	2048	valid
1.7s	5010×	body	1024	infinite
1.6s	1546×	body	8192	exit
785.0ms	3195×	body	512	infinite
580.0ms	342×	body	4096	valid
284.0ms	1282×	body	1024	invalid
216.0ms	932×	body	512	invalid

Bogosity

regimes4.9min (14.3%)

Counts

33099 → 5610

Calls

494 calls:

44.6s	y
43.4s	x
42.2s	z
28.3s	t
23.3s	a

Compiler

Compiled 381386 to 211334 computations (44.6% saved)

simplify3.2min (9.5%)

Algorithm

1074×

egg-herbie

Rules

621962×	`fma-def`
441508×	`log-prod`
403134×	`associate-r`
353176×	`times-frac`
348372×	`associate-l`

Stop Event

75×	done
6×	unsound
268×	saturated
194×	fuel
800×	node limit

Counts

360399 → 267935

Compiler

Compiled 64223 to 38956 computations (39.3% saved)

localize3.2min (9.4%)

Compiler: Compiled 109728 to 48199 computations (56.1% saved)

eval2.8min (8.2%)

Compiler: Compiled 8005837 to 4314454 computations (46.1% saved)

rewrite2.0min (5.9%)

Algorithm

805×	batch-egg-rewrite

Rules

483665×	`log1p-expm1-u`
371926×	`expm1-log1p-u`
302472×	`prod-diff`
284888×	`expm1-udef`
271474×	`log-prod`

Stop Event

1×	unsound
804×	node limit

Counts

5509 → 211393

prune1.7min (5.1%)

Counts: 344335 → 13320
Compiler: Compiled 720825 to 502269 computations (30.3% saved)

bsearch1.5min (4.5%)

Algorithm

3324×	binary-search
291×	left-value

Stop Event

3273×	narrow-enough
51×	predicate-same

Results

52.2s	316857×	body	256	valid
25.0s	84894×	body	256	infinite
3.1s	3891×	body	1024	valid
1.6s	4402×	body	512	valid
816.0ms	8699×	body	256	invalid
633.0ms	4470×	body	512	invalid
86.0ms	92×	body	512	infinite
55.0ms	181×	body	2048	valid
30.0ms	97×	body	1024	infinite
1.0ms	2×	body	1024	invalid
0.0ms	2×	body	4096	valid

Compiler

Compiled 753121 to 566181 computations (24.8% saved)

preprocess1.4min (4%)

Algorithm

269×	egg-herbie

Rules

366494×	`fma-def`
126856×	`fma-neg`
120926×	`sub-neg`
110364×	`unsub-neg`
108576×	`div-sub`

Stop Event

123×	saturated
146×	node limit

Compiler

Compiled 157046 to 76262 computations (51.4% saved)

series27.9s (1.4%)

Counts

5509 → 149006

Calls

39288 calls:

Time	Variable		Point	Expression
160.0ms	x	@	0	(+.f64 (*.f64 -2 (log.f64 (cbrt.f64 y))) (log.f64 x))
152.0ms	y	@	0	(/.f64 (+.f64 (/.f64 x (/.f64 (-.f64 y b) y)) (/.f64 y (/.f64 (pow.f64 (-.f64 y b) 2) (-.f64 t a)))) z)
137.0ms	x	@	0	(*.f64 x (log.f64 y))
128.0ms	y	@	inf	(/.f64 y (/.f64 (neg.f64 z) x))
124.0ms	x	@	inf	(log.f64 (/.f64 (exp.f64 x) (pow.f64 y (+.f64 y 1/2))))

analyze17.1s (0.8%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
49.9%	49.7%	49.9%	0.1%	0%	0.2%	0%	2
57.9%	57.4%	41.7%	0.1%	0%	0.7%	0%	3
64%	63.2%	35.5%	0.1%	0%	1.2%	0%	4
69.8%	68.7%	29.8%	0.1%	0%	1.4%	0%	5
74.4%	72.7%	25.1%	0.1%	0%	2.1%	0%	6
78.5%	76%	20.8%	0.1%	0%	3%	0%	7
80.3%	77.4%	19%	0.1%	0%	3.5%	0%	8
83.1%	79.6%	16.2%	0.1%	0%	4.1%	0%	9
84.8%	80.8%	14.4%	0.1%	0%	4.7%	0%	10
87.7%	83.1%	11.7%	0.1%	0%	5.1%	0%	11
88.9%	83.8%	10.5%	0.1%	0%	5.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Herbie run

soundness6.4min (18.8%)

sample6.1min (18%)

regimes4.9min (14.3%)

simplify3.2min (9.5%)

localize3.2min (9.4%)

eval2.8min (8.2%)

rewrite2.0min (5.9%)

prune1.7min (5.1%)

bsearch1.5min (4.5%)

preprocess1.4min (4%)

series27.9s (1.4%)

analyze17.1s (0.8%)

end55.0ms (0%)

Profiling