Metrics for Herbie run

Date:	Tuesday, October 17th, 2023
Commit:	837340cc on main
Hostname:	nightly with Racket 8.6
Seed:	2023290
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample5.9min (18.6%)

Results

3.8min	1790199×	body	256	valid
48.7s	334974×	body	256	infinite
23.7s	143757×	body	256	invalid
22.0s	45111×	body	1024	valid
11.1s	31894×	body	512	valid
6.9s	10005×	body	2048	valid
2.0s	5024×	body	1024	infinite
1.5s	1569×	body	8192	exit
830.0ms	3303×	body	512	infinite
588.0ms	354×	body	4096	valid
449.0ms	1278×	body	1024	invalid
205.0ms	956×	body	512	invalid
0.0ms	2×	body	2048	invalid

Bogosity

soundness5.5min (17.6%)

Rules

1286754×	`fma-def`
724258×	`associate-r`
682952×	`fma-neg`
655412×	`times-frac`
632644×	`log-prod`

Stop Event

7×	unsound
82×	saturated
1632×	node limit

Compiler

Compiled 118037 to 66079 computations (44% saved)

regimes5.0min (16%)

Counts

37958 → 5902

Calls

490 calls:

46.3s	y
45.4s	x
45.4s	z
31.3s	t
23.6s	a

Compiler

Compiled 463484 to 260382 computations (43.8% saved)

localize2.9min (9.3%)

Compiler: Compiled 114473 to 47487 computations (58.5% saved)

simplify2.7min (8.7%)

Algorithm

1088×

egg-herbie

Rules

589902×	`fma-def`
468780×	`log-prod`
432888×	`associate-r`
388590×	`associate-l`
377568×	`times-frac`

Stop Event

71×	done
5×	unsound
268×	saturated
198×	fuel
815×	node limit

Counts

367080 → 270483

Compiler

Compiled 69797 to 42644 computations (38.9% saved)

eval2.6min (8.2%)

Compiler: Compiled 8143479 to 4012169 computations (50.7% saved)

rewrite1.6min (5.1%)

Algorithm

819×	batch-egg-rewrite

Rules

512988×	`pow1`
483312×	`add-exp-log`
483016×	`log1p-expm1-u`
482982×	`expm1-log1p-u`
457828×	`add-log-exp`

Stop Event

1×	unsound
818×	node limit

Counts

5803 → 208136

prune1.6min (5.1%)

Counts: 346134 → 13402
Compiler: Compiled 723164 to 495435 computations (31.5% saved)

bsearch1.6min (5%)

Algorithm

3446×	binary-search
347×	left-value

Stop Event

3379×	narrow-enough
67×	predicate-same

Results

53.7s	329081×	body	256	valid
22.6s	80189×	body	256	infinite
4.5s	6749×	body	1024	valid
2.4s	6113×	body	512	valid
1.6s	15491×	body	256	invalid
638.0ms	830×	body	1024	infinite
214.0ms	427×	body	2048	valid
127.0ms	538×	body	512	infinite
6.0ms	9×	body	4096	valid
3.0ms	17×	body	512	invalid
2.0ms	6×	body	1024	invalid

Compiler

Compiled 782557 to 585702 computations (25.2% saved)

preprocess1.3min (4.2%)

Algorithm

269×	egg-herbie

Rules

379496×	`fma-def`
124614×	`fma-neg`
117016×	`sub-neg`
102806×	`unsub-neg`
98826×	`div-sub`

Stop Event

123×	saturated
146×	node limit

Compiler

Compiled 164396 to 80686 computations (50.9% saved)

series28.2s (1.5%)

Counts

5803 → 158944

Calls

40608 calls:

Time	Variable		Point	Expression
290.0ms	x	@	inf	(-.f64 (exp.f64 (log1p.f64 (*.f64 x 27061/100000))) 1)
269.0ms	z	@	0	(fma.f64 (+.f64 a -1/2) (log.f64 t) (log.f64 z))
168.0ms	x	@	0	(-.f64 (exp.f64 (log1p.f64 (*.f64 x 27061/100000))) 1)
166.0ms	i	@	inf	(-.f64 (.f64 x (-.f64 (.f64 y z) (.f64 t a))) (-.f64 (.f64 b (-.f64 (.f64 z c) (.f64 t i))) (.f64 j (-.f64 (.f64 a c) (*.f64 y i)))))
160.0ms	z	@	0	(log.f64 (.f64 (pow.f64 t -1/2) (.f64 (+.f64 x y) z)))

analyze14.8s (0.8%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
49.9%	49.7%	49.9%	0.1%	0%	0.2%	0%	2
57.9%	57.4%	41.7%	0.1%	0%	0.7%	0%	3
64%	63.2%	35.5%	0.1%	0%	1.2%	0%	4
69.8%	68.7%	29.8%	0.1%	0%	1.4%	0%	5
74.4%	72.7%	25.1%	0.1%	0%	2.1%	0%	6
78.5%	76%	20.8%	0.1%	0%	3%	0%	7
80.3%	77.4%	19%	0.1%	0%	3.5%	0%	8
83.1%	79.6%	16.2%	0.1%	0%	4.1%	0%	9
84.8%	80.8%	14.4%	0.1%	0%	4.7%	0%	10
87.7%	83.1%	11.7%	0.1%	0%	5.1%	0%	11
88.9%	83.8%	10.5%	0.1%	0%	5.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Herbie run

sample5.9min (18.6%)

soundness5.5min (17.6%)

regimes5.0min (16%)

localize2.9min (9.3%)

simplify2.7min (8.7%)

eval2.6min (8.2%)

rewrite1.6min (5.1%)

prune1.6min (5.1%)

bsearch1.6min (5%)

preprocess1.3min (4.2%)

series28.2s (1.5%)

analyze14.8s (0.8%)

end204.0ms (0%)

Profiling