Metrics for Herbie run

Date:	Saturday, November 4th, 2023
Commit:	14fe7950 on main
Hostname:	nightly with Racket 8.6
Seed:	2023308
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

soundness6.9min (19%)

Rules

1121080×	`fma-def`
649932×	`associate-r`
564228×	`times-frac`
511928×	`associate-l`
509196×	`log-prod`

Stop Event

8×	unsound
85×	saturated
1489×	node limit

Compiler

Compiled 103685 to 56949 computations (45.1% saved)

sample6.4min (17.7%)

Results

4.2min	1788133×	body	256	valid
52.3s	336938×	body	256	infinite
27.0s	143426×	body	256	invalid
26.6s	45707×	body	1024	valid
11.9s	31978×	body	512	valid
6.8s	9784×	body	2048	valid
2.0s	4851×	body	1024	infinite
1.8s	1533×	body	8192	exit
880.0ms	3132×	body	512	infinite
548.0ms	341×	body	4096	valid
276.0ms	1216×	body	1024	invalid
174.0ms	952×	body	512	invalid
1.0ms	4×	body	2048	invalid

Bogosity

regimes5.4min (15%)

Counts

34966 → 5793

Calls

495 calls:

52.2s	y
50.0s	x
47.2s	z
34.1s	t
23.8s	a

Compiler

Compiled 403971 to 223358 computations (44.7% saved)

simplify3.4min (9.3%)

Algorithm

1087×

egg-herbie

Rules

599468×	`fma-def`
449378×	`log-prod`
411924×	`associate-r`
370452×	`times-frac`
361538×	`associate-l`

Stop Event

73×	done
6×	unsound
268×	saturated
196×	fuel
813×	node limit

Counts

366612 → 269931

Compiler

Compiled 67521 to 40216 computations (40.4% saved)

localize3.2min (8.8%)

Compiler: Compiled 110854 to 47676 computations (57% saved)

eval3.0min (8.3%)

Compiler: Compiled 8170965 to 4307010 computations (47.3% saved)

rewrite2.1min (5.8%)

Algorithm

818×	batch-egg-rewrite

Rules

499304×	`log1p-expm1-u`
387810×	`expm1-log1p-u`
301430×	`prod-diff`
282328×	`expm1-udef`
273494×	`log-prod`

Stop Event

1×	unsound
817×	node limit

Counts

5599 → 213423

prune1.8min (5%)

Counts: 351846 → 13203
Compiler: Compiled 701911 to 486555 computations (30.7% saved)

bsearch1.7min (4.6%)

Algorithm

3402×	binary-search
333×	left-value

Stop Event

3338×	narrow-enough
64×	predicate-same

Results

55.1s	315430×	body	256	valid
27.5s	91628×	body	256	infinite
4.0s	6070×	body	1024	valid
3.2s	7514×	body	512	valid
968.0ms	8062×	body	256	invalid
413.0ms	318×	body	2048	valid
142.0ms	287×	body	1024	infinite
62.0ms	206×	body	512	infinite
11.0ms	43×	body	512	invalid
8.0ms	24×	body	1024	invalid
1.0ms	3×	body	4096	valid

Compiler

Compiled 787635 to 587407 computations (25.4% saved)

preprocess1.4min (3.9%)

Algorithm

269×	egg-herbie

Rules

379496×	`fma-def`
124020×	`fma-neg`
116236×	`sub-neg`
103518×	`unsub-neg`
98712×	`div-sub`

Stop Event

123×	saturated
146×	node limit

Compiler

Compiled 160956 to 76452 computations (52.5% saved)

series39.1s (1.8%)

Counts

5599 → 153189

Calls

39996 calls:

Time	Variable		Point	Expression
4.9s	x	@	0	(-.f64 (log.f64 (sqrt.f64 x)) (log.f64 (/.f64 y (sqrt.f64 x))))
4.3s	x	@	0	(*.f64 x (-.f64 (log.f64 (sqrt.f64 x)) (log.f64 (/.f64 y (sqrt.f64 x)))))
462.0ms	x	@	-inf	(-.f64 (log.f64 (sqrt.f64 x)) (log.f64 (/.f64 y (sqrt.f64 x))))
323.0ms	x	@	0	(pow.f64 (cbrt.f64 (-.f64 (log.f64 x) (log.f64 y))) 3)
241.0ms	t	@	-inf	(log.f64 (/.f64 (exp.f64 (-.f64 (*.f64 y (-.f64 1 z)) t)) y))

analyze16.7s (0.8%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
49.9%	49.7%	49.9%	0.1%	0%	0.2%	0%	2
57.9%	57.4%	41.7%	0.1%	0%	0.7%	0%	3
64%	63.2%	35.5%	0.1%	0%	1.2%	0%	4
69.8%	68.7%	29.8%	0.1%	0%	1.4%	0%	5
74.4%	72.7%	25.1%	0.1%	0%	2.1%	0%	6
78.5%	76%	20.8%	0.1%	0%	3%	0%	7
80.3%	77.4%	19%	0.1%	0%	3.5%	0%	8
83.1%	79.6%	16.2%	0.1%	0%	4.1%	0%	9
84.8%	80.8%	14.4%	0.1%	0%	4.7%	0%	10
87.7%	83.1%	11.7%	0.1%	0%	5.1%	0%	11
88.9%	83.8%	10.5%	0.1%	0%	5.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Herbie run

soundness6.9min (19%)

sample6.4min (17.7%)

regimes5.4min (15%)

simplify3.4min (9.3%)

localize3.2min (8.8%)

eval3.0min (8.3%)

rewrite2.1min (5.8%)

prune1.8min (5%)

bsearch1.7min (4.6%)

preprocess1.4min (3.9%)

series39.1s (1.8%)

analyze16.7s (0.8%)

end60.0ms (0%)

Profiling