Metrics for Herbie run

Date:	Friday, October 6th, 2023
Commit:	f10612bf on report-tolerance
Hostname:	nightly with Racket 8.6
Seed:	2023279
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample2.4min (20.1%)

Results

41.9s	155048×	body	256	valid
27.4s	29574×	body	1024	valid
15.7s	66599×	body	256	invalid
10.8s	7768×	body	8192	exit
9.9s	39054×	body	256	infinite
8.3s	10373×	body	2048	valid
7.8s	13865×	body	512	valid
4.6s	5991×	body	1024	invalid
2.9s	622×	body	4096	infinite
2.6s	2031×	body	4096	valid
2.1s	8054×	body	256	unsamplable
1.9s	666×	body	2048	infinite
1.7s	2459×	body	1024	infinite
1.3s	3032×	body	512	invalid
960.0ms	815×	body	8192	valid
640.0ms	1429×	body	512	infinite
1.0ms	1×	body	2048	invalid

Bogosity

localize2.3min (19.4%)

Compiler: Compiled 39606 to 17702 computations (55.3% saved)

soundness1.8min (15.1%)

Rules

276698×	`fma-def`
212896×	`associate-r`
176982×	`times-frac`
170326×	`associate-l`
166524×	`log-prod`

Stop Event

3×	unsound
4×	saturated
429×	node limit

Compiler

Compiled 43736 to 25622 computations (41.4% saved)

regimes1.5min (12.5%)

Counts

10309 → 862

Calls

152 calls:

7.5s	l
3.9s	mu
3.6s	F
3.5s	t
3.4s	NaChar

Compiler

Compiled 162305 to 83527 computations (48.5% saved)

eval1.2min (10%)

Compiler: Compiled 2535788 to 1450799 computations (42.8% saved)

simplify42.0s (6%)

Algorithm

152×	egg-herbie

Rules

98756×	`fma-def`
79074×	`associate-r`
73200×	`times-frac`
64908×	`associate-l`
55500×	`log-prod`

Stop Event

1×	unsound
1×	done
31×	saturated
30×	fuel
120×	node limit

Counts

57985 → 46684

Compiler

Compiled 14261 to 9099 computations (36.2% saved)

prune32.5s (4.6%)

Counts: 72689 → 3093
Compiler: Compiled 232654 to 157748 computations (32.2% saved)

bsearch25.3s (3.6%)

Algorithm

409×	binary-search
96×	left-value

Stop Event

395×	narrow-enough
14×	predicate-same

Results

10.6s	33657×	body	256	valid
6.3s	6716×	body	1024	valid
2.1s	6220×	body	256	infinite
1.9s	3027×	body	512	valid
1.6s	5563×	body	256	invalid
341.0ms	606×	body	1024	invalid
245.0ms	414×	body	1024	infinite
158.0ms	374×	body	512	infinite
145.0ms	340×	body	512	invalid
136.0ms	162×	body	2048	valid
85.0ms	31×	body	4096	infinite
82.0ms	24×	body	2048	infinite
76.0ms	59×	body	4096	valid
33.0ms	20×	body	8192	valid

Compiler

Compiled 128338 to 94074 computations (26.7% saved)

rewrite21.0s (3%)

Algorithm

121×	batch-egg-rewrite

Rules

83906×	`pow1`
79374×	`add-exp-log`
79274×	`log1p-expm1-u`
79264×	`expm1-log1p-u`
79244×	`add-log-exp`

Stop Event

1×	unsound
120×	node limit

Counts

1291 → 26446

analyze15.4s (2.2%)

Algorithm

31×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	98.2%	1.8%	0%	0%	0%	0
23%	22.6%	75.6%	1.8%	0%	0%	0%	1
24.2%	23.3%	73.2%	1.8%	0%	1.6%	0%	2
30.2%	28.2%	65.2%	1.8%	0%	4.8%	0%	3
34%	31.2%	60.6%	1.8%	0%	6.4%	0%	4
36.2%	33.2%	58.5%	1.8%	0%	6.4%	0%	5
40.4%	37%	54.5%	1.8%	0%	6.6%	0%	6
45.4%	41.1%	49.4%	1.8%	0%	7.3%	0.4%	7
47.7%	42.6%	46.7%	1.8%	0%	8.6%	0.4%	8
50.6%	44.9%	43.9%	1.8%	0%	8.9%	0.5%	9
51.7%	45.7%	42.7%	1.8%	0%	9.3%	0.5%	10
53.4%	46.8%	40.9%	1.8%	0%	9.9%	0.6%	11
55.1%	48%	39.1%	1.8%	0%	10.5%	0.6%	12

Compiler

Compiled 845 to 604 computations (28.5% saved)

preprocess14.9s (2.1%)

Algorithm

31×	egg-herbie

Rules

36464×	`fma-def`
16456×	`fma-neg`
13966×	`div-sub`
13472×	`distribute-lft-neg-in`
12750×	`distribute-lft-in`

Stop Event

5×	saturated
26×	node limit

Compiler

Compiled 33910 to 17996 computations (46.9% saved)

series11.7s (1.7%)

Counts

1291 → 31539

Calls

8799 calls:

Time	Variable		Point	Expression
159.0ms	h	@	inf	(-.f64 (exp.f64 (log1p.f64 (/.f64 1 (*.f64 h l)))) 1)
155.0ms	l	@	-inf	(-.f64 (exp.f64 (log1p.f64 (/.f64 1 (*.f64 h l)))) 1)
141.0ms	v	@	inf	(log.f64 (acos.f64 (/.f64 (+.f64 (.f64 v (.f64 v -5)) 1) (fma.f64 v v -1))))
131.0ms	A	@	inf	(/.f64 c0 (sqrt.f64 (*.f64 V (/.f64 l A))))
126.0ms	V	@	0	(pow.f64 (/.f64 A (*.f64 V l)) 3/2)

Herbie run

sample2.4min (20.1%)

localize2.3min (19.4%)

soundness1.8min (15.1%)

regimes1.5min (12.5%)

eval1.2min (10%)

simplify42.0s (6%)

prune32.5s (4.6%)

bsearch25.3s (3.6%)

rewrite21.0s (3%)

analyze15.4s (2.2%)

preprocess14.9s (2.1%)

series11.7s (1.7%)

end23.0ms (0%)

Profiling