Metrics for Herbie run

Date:	Saturday, August 26th, 2023
Commit:	5f639494 on main
Hostname:	nightly with Racket 8.6
Seed:	2023238
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample6.3min (19.9%)

Results

4.1min	1795106×	body	256	valid
50.6s	337877×	body	256	infinite
27.1s	142893×	body	256	invalid
25.0s	45623×	body	1024	valid
12.3s	32167×	body	512	valid
7.3s	9979×	body	2048	valid
1.9s	1652×	body	8192	exit
1.8s	4959×	body	1024	infinite
794.0ms	3081×	body	512	infinite
470.0ms	328×	body	4096	valid
409.0ms	1237×	body	1024	invalid
175.0ms	902×	body	512	invalid
1.0ms	3×	body	2048	invalid

Bogosity

soundness5.1min (16.1%)

Rules

1226596×	`fma-def`
674382×	`associate-r`
597510×	`log-prod`
571290×	`times-frac`
548166×	`fma-neg`

Stop Event

132×	saturated
3×	unsound
1449×	node limit

Compiler

Compiled 111237 to 60698 computations (45.4% saved)

regimes4.7min (14.8%)

Counts

35662 → 5937

Calls

488 calls:

47.9s	x
44.1s	y
37.9s	z
27.7s	t
24.2s	a

Compiler

Compiled 422907 to 228713 computations (45.9% saved)

localize3.2min (10.3%)

Compiler: Compiled 116236 to 47393 computations (59.2% saved)

simplify3.1min (9.7%)

Algorithm

1364×

egg-herbie

Rules

916988×	`fma-def`
506848×	`associate-r`
475898×	`log-prod`
438242×	`fma-neg`
431102×	`associate-l`

Stop Event

4×	unsound
75×	done
436×	saturated
195×	fuel
924×	node limit

Counts

372046 → 276902

Compiler

Compiled 68505 to 40883 computations (40.3% saved)

eval2.6min (8.3%)

Compiler: Compiled 8308779 to 3932437 computations (52.7% saved)

rewrite1.7min (5.3%)

Algorithm

824×	batch-egg-rewrite

Rules

526512×	`pow1`
496028×	`add-exp-log`
495722×	`log1p-expm1-u`
495690×	`expm1-log1p-u`
467146×	`add-log-exp`

Stop Event

824×	node limit

Counts

5864 → 208708

prune1.6min (5.1%)

Counts: 350619 → 13710
Compiler: Compiled 711350 to 478526 computations (32.7% saved)

bsearch1.6min (4.9%)

Algorithm

3558×	binary-search
290×	left-value

Stop Event

3496×	narrow-enough
62×	predicate-same

Results

54.5s	336501×	body	256	valid
23.9s	90826×	body	256	infinite
3.3s	5295×	body	1024	valid
2.4s	6164×	body	512	valid
1.1s	10021×	body	256	invalid
246.0ms	534×	body	1024	infinite
142.0ms	239×	body	2048	valid
69.0ms	297×	body	512	infinite
4.0ms	13×	body	1024	invalid
2.0ms	16×	body	512	invalid

Compiler

Compiled 827423 to 611748 computations (26.1% saved)

preprocess1.0min (3.2%)

Algorithm

270×	egg-herbie

Rules

380012×	`fma-def`
124642×	`fma-neg`
117048×	`sub-neg`
102858×	`unsub-neg`
98826×	`div-sub`

Stop Event

124×	saturated
146×	node limit

Compiler

Compiled 151031 to 71848 computations (52.4% saved)

series27.9s (1.5%)

Counts

5864 → 163068

Calls

41667 calls:

Time	Variable		Point	Expression
398.0ms	a	@	inf	(log.f64 (.f64 (pow.f64 t (-.f64 a 1/2)) (.f64 (+.f64 y x) z)))
320.0ms	y	@	-inf	(-.f64 (.f64 y y) (.f64 x x))
171.0ms	x	@	0	(*.f64 x (log.f64 y))
161.0ms	z	@	-inf	(+.f64 x (*.f64 (-.f64 y z) (/.f64 (-.f64 t x) (-.f64 a z))))
156.0ms	z	@	inf	(log.f64 (pow.f64 (*.f64 z (exp.f64 (-.f64 1 z))) y))

analyze17.9s (0.9%)

Algorithm

270×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.7%	46.6%	53.2%	0.1%	0%	0%	0%	1
50.1%	49.9%	49.7%	0.1%	0%	0.2%	0%	2
58%	57.5%	41.6%	0.1%	0%	0.7%	0%	3
64.2%	63.3%	35.4%	0.1%	0%	1.2%	0%	4
69.9%	68.8%	29.6%	0.1%	0%	1.4%	0%	5
74.5%	72.8%	25%	0.1%	0%	2%	0%	6
78.6%	76.1%	20.7%	0.1%	0%	3%	0%	7
80.4%	77.4%	18.9%	0.1%	0%	3.5%	0%	8
83.2%	79.7%	16.1%	0.1%	0%	4%	0%	9
84.9%	80.8%	14.4%	0.1%	0%	4.6%	0%	10
87.7%	83.1%	11.6%	0.1%	0%	5.1%	0%	11
88.9%	83.9%	10.5%	0.1%	0%	5.5%	0%	12

Compiler

Compiled 4021 to 2770 computations (31.1% saved)

Herbie run

sample6.3min (19.9%)

soundness5.1min (16.1%)

regimes4.7min (14.8%)

localize3.2min (10.3%)

simplify3.1min (9.7%)

eval2.6min (8.3%)

rewrite1.7min (5.3%)

prune1.6min (5.1%)

bsearch1.6min (4.9%)

preprocess1.0min (3.2%)

series27.9s (1.5%)

analyze17.9s (0.9%)

end60.0ms (0%)

Profiling