Metrics for Herbie run

Date:	Saturday, December 9th, 2023
Commit:	665878db on main
Hostname:	nightly with Racket 8.6
Seed:	2023343
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

soundness7.0min (20.3%)

Rules

1242070×	`fma-def`
655196×	`associate-r`
572762×	`times-frac`
525030×	`log-prod`
501692×	`associate-l`

Stop Event

89×	saturated
4×	unsound
1555×	node limit

Compiler

Compiled 110297 to 60771 computations (44.9% saved)

sample5.8min (16.7%)

Results

4.2min	1821070×	body	256	valid
51.9s	341758×	body	256	infinite
12.4s	26151×	body	1024	valid
11.7s	64637×	body	256	invalid
7.9s	22197×	body	512	valid
4.8s	7762×	body	2048	valid
1.6s	1549×	body	8192	exit
285.0ms	772×	body	1024	infinite
267.0ms	1137×	body	512	infinite
184.0ms	721×	body	1024	invalid
101.0ms	579×	body	512	invalid
16.0ms	17×	body	4096	valid

Bogosity

regimes5.1min (14.8%)

Counts

34721 → 5672

Calls

492 calls:

51.5s	y
46.4s	x
44.7s	z
31.0s	t
26.7s	a

Compiler

Compiled 404785 to 225983 computations (44.2% saved)

simplify3.2min (9.2%)

Algorithm

1061×

egg-herbie

Rules

580590×	`fma-def`
444904×	`log-prod`
388308×	`associate-r`
336964×	`times-frac`
336810×	`associate-l`

Stop Event

7×	unsound
76×	done
268×	saturated
193×	fuel
786×	node limit

Counts

357959 → 265242

Compiler

Compiled 65936 to 40485 computations (38.6% saved)

localize3.1min (8.9%)

Compiler: Compiled 109154 to 47435 computations (56.5% saved)

eval2.9min (8.4%)

Compiler: Compiled 8224449 to 4375771 computations (46.8% saved)

rewrite2.0min (5.7%)

Algorithm

792×	batch-egg-rewrite

Rules

488478×	`log1p-expm1-u`
371762×	`expm1-log1p-u`
282198×	`expm1-udef`
273338×	`log-prod`
268496×	`prod-diff`

Stop Event

1×	unsound
791×	node limit

Counts

5470 → 209481

prune1.8min (5.2%)

Counts: 343154 → 13299
Compiler: Compiled 715462 to 500219 computations (30.1% saved)

preprocess1.4min (4.2%)

Algorithm

269×	egg-herbie

Rules

366494×	`fma-def`
126856×	`fma-neg`
120926×	`sub-neg`
110364×	`unsub-neg`
108576×	`div-sub`

Stop Event

123×	saturated
146×	node limit

Compiler

Compiled 186952 to 94778 computations (49.3% saved)

bsearch1.4min (4.1%)

Algorithm

3309×	binary-search
310×	left-value

Stop Event

3257×	narrow-enough
52×	predicate-same

Results

56.0s	327806×	body	256	valid
18.6s	77355×	body	256	infinite
1.4s	2979×	body	1024	valid
1.0s	7565×	body	256	invalid
876.0ms	3302×	body	512	valid
262.0ms	1686×	body	512	invalid
144.0ms	148×	body	2048	valid
36.0ms	33×	body	1024	infinite
16.0ms	73×	body	512	infinite

Compiler

Compiled 744352 to 557693 computations (25.1% saved)

series34.5s (1.7%)

Counts

5470 → 148478

Calls

39633 calls:

Time	Variable		Point	Expression
289.0ms	z	@	inf	(*.f64 (pow.f64 y y) (exp.f64 (-.f64 x z)))
281.0ms	z	@	0	(.f64 x (.f64 y z))
265.0ms	x	@	inf	(*.f64 z (/.f64 x y))
247.0ms	x	@	-inf	(*.f64 6 (/.f64 1 (/.f64 x (+.f64 x -1))))
244.0ms	y	@	inf	(log1p.f64 (-.f64 (*.f64 -1/2 (log.f64 y)) z))

analyze14.2s (0.7%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.2%	68.2%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.3%	23%	0.1%	0%	4.6%	0%	6
79.8%	75.6%	19.1%	0.1%	0%	5.1%	0%	7
81.7%	77%	17.2%	0.1%	0%	5.6%	0%	8
84.4%	79.3%	14.7%	0.1%	0%	5.9%	0%	9
86%	80.5%	13.1%	0.1%	0%	6.2%	0%	10
88.5%	82.9%	10.7%	0.1%	0%	6.2%	0%	11
89.6%	83.7%	9.7%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Herbie run

soundness7.0min (20.3%)

sample5.8min (16.7%)

regimes5.1min (14.8%)

simplify3.2min (9.2%)

localize3.1min (8.9%)

eval2.9min (8.4%)

rewrite2.0min (5.7%)

prune1.8min (5.2%)

preprocess1.4min (4.2%)

bsearch1.4min (4.1%)

series34.5s (1.7%)

analyze14.2s (0.7%)

end63.0ms (0%)

Profiling