Metrics for Herbie run

Date:	Tuesday, October 24th, 2023
Commit:	21d611eb on main
Hostname:	nightly with Racket 8.6
Seed:	2023297
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

soundness6.1min (18.8%)

Rules

1361940×	`fma-def`
795464×	`associate-r`
720274×	`log-prod`
695830×	`fma-neg`
651484×	`associate-l`

Stop Event

9×	unsound
81×	saturated
1674×	node limit

Compiler

Compiled 117395 to 63904 computations (45.6% saved)

sample5.9min (18.2%)

Results

3.8min	1787675×	body	256	valid
47.3s	337108×	body	256	infinite
23.7s	45824×	body	1024	valid
23.6s	142352×	body	256	invalid
10.9s	31616×	body	512	valid
7.2s	9829×	body	2048	valid
2.1s	5044×	body	1024	infinite
1.6s	1558×	body	8192	exit
845.0ms	3412×	body	512	infinite
668.0ms	356×	body	4096	valid
280.0ms	1275×	body	1024	invalid
155.0ms	912×	body	512	invalid
1.0ms	4×	body	2048	invalid

Bogosity

regimes5.0min (15.6%)

Counts

35930 → 5903

Calls

493 calls:

49.1s	y
44.2s	x
42.0s	z
31.5s	t
25.4s	a

Compiler

Compiled 417960 to 226209 computations (45.9% saved)

localize2.9min (9%)

Compiler: Compiled 114807 to 47454 computations (58.7% saved)

simplify2.8min (8.8%)

Algorithm

1104×

egg-herbie

Rules

614784×	`fma-def`
508738×	`log-prod`
451406×	`associate-r`
392860×	`associate-l`
376354×	`fma-neg`

Stop Event

7×	unsound
69×	done
269×	saturated
200×	fuel
828×	node limit

Counts

374359 → 270922

Compiler

Compiled 67727 to 41485 computations (38.7% saved)

eval2.6min (8.1%)

Compiler: Compiled 8194279 to 3993460 computations (51.3% saved)

rewrite1.7min (5.2%)

Algorithm

835×	batch-egg-rewrite

Rules

516592×	`pow1`
487056×	`add-exp-log`
486744×	`log1p-expm1-u`
486716×	`expm1-log1p-u`
458386×	`add-log-exp`

Stop Event

3×	unsound
832×	node limit

Counts

5860 → 215230

prune1.6min (5.1%)

Counts: 348277 → 13099
Compiler: Compiled 696534 to 477127 computations (31.5% saved)

bsearch1.6min (4.9%)

Algorithm

3517×	binary-search
259×	left-value

Stop Event

3451×	narrow-enough
3×	predicate-failed
63×	predicate-same

Results

50.6s	324211×	body	256	valid
28.9s	94282×	body	256	infinite
3.4s	5531×	body	1024	valid
2.7s	6707×	body	512	valid
526.0ms	5201×	body	256	invalid
403.0ms	1260×	body	1024	infinite
216.0ms	620×	body	512	infinite
65.0ms	191×	body	1024	invalid
62.0ms	157×	body	2048	valid
17.0ms	120×	body	512	invalid
1.0ms	4×	body	2048	invalid

Compiler

Compiled 802748 to 599129 computations (25.4% saved)

preprocess1.3min (4.1%)

Algorithm

269×	egg-herbie

Rules

379496×	`fma-def`
124614×	`fma-neg`
117016×	`sub-neg`
102806×	`unsub-neg`
98826×	`div-sub`

Stop Event

123×	saturated
146×	node limit

Compiler

Compiled 159520 to 77314 computations (51.5% saved)

series27.4s (1.4%)

Counts

5860 → 159129

Calls

40815 calls:

Time	Variable		Point	Expression
265.0ms	x	@	0	(-.f64 (.f64 (log.f64 x) (log.f64 x)) (.f64 (log.f64 y) (log.f64 y)))
169.0ms	y	@	-inf	(cbrt.f64 (*.f64 (+.f64 x -1) (log.f64 y)))
125.0ms	x	@	0	(*.f64 x (log.f64 y))
120.0ms	x	@	-inf	(*.f64 (sqrt.f64 (/.f64 1 x)) y)
104.0ms	z	@	inf	(/.f64 (log1p.f64 (*.f64 y (expm1.f64 z))) t)

analyze15.7s (0.8%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
49.9%	49.7%	49.9%	0.1%	0%	0.2%	0%	2
57.9%	57.4%	41.7%	0.1%	0%	0.7%	0%	3
64%	63.2%	35.5%	0.1%	0%	1.2%	0%	4
69.8%	68.7%	29.8%	0.1%	0%	1.4%	0%	5
74.4%	72.7%	25.1%	0.1%	0%	2.1%	0%	6
78.5%	76%	20.8%	0.1%	0%	3%	0%	7
80.3%	77.4%	19%	0.1%	0%	3.5%	0%	8
83.1%	79.6%	16.2%	0.1%	0%	4.1%	0%	9
84.8%	80.8%	14.4%	0.1%	0%	4.7%	0%	10
87.7%	83.1%	11.7%	0.1%	0%	5.1%	0%	11
88.9%	83.8%	10.5%	0.1%	0%	5.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Herbie run

soundness6.1min (18.8%)

sample5.9min (18.2%)

regimes5.0min (15.6%)

localize2.9min (9%)

simplify2.8min (8.8%)

eval2.6min (8.1%)

rewrite1.7min (5.2%)

prune1.6min (5.1%)

bsearch1.6min (4.9%)

preprocess1.3min (4.1%)

series27.4s (1.4%)

analyze15.7s (0.8%)

end58.0ms (0%)

Profiling