Metrics for Herbie run

Date:	Friday, February 9th, 2024
Commit:	b35bd1f1 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024040
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample55.7s (24.6%)

Results

16.3s	116015×	256	valid
7.7s	23333×	512	valid
20.1s	17167×	8192	exit
5.8s	16095×	1024	valid
618.0ms	4949×	256	infinite
4.3s	4726×	2048	valid
584.0ms	3862×	256	invalid
162.0ms	1276×	256	unsamplable
1.0ms	2×	512	infinite

Bogosity

localize38.2s (16.9%)

Compiler: Compiled 8562 to 3952 computations (53.8% saved)

soundness29.6s (13.1%)

Rules

44466×	`log1p-expm1-u`
42240×	`fma-define`
30440×	`associate-r`
29708×	`log-prod`
28082×	`fma-neg`

Stop Event

5×	saturated
93×	node limit
3×	unsound

Compiler

Compiled 8575 to 4563 computations (46.8% saved)

eval22.0s (9.7%)

Compiler: Compiled 1013122 to 594051 computations (41.4% saved)

simplify15.8s (7%)

Algorithm

81×	egg-herbie

Rules

43776×	`fma-define`
40750×	`log-prod`
35736×	`fma-neg`
29702×	`associate-r`
26754×	`associate-l`

Stop Event

20×	saturated
56×	node limit
12×	fuel
5×	unsound
8×	done

Counts

26979 → 20024

Compiler

Compiled 1375 to 931 computations (32.3% saved)

regimes14.4s (6.4%)

Counts

3002 → 119

Calls

53 calls:

2.1s	b
1.9s	a
1.6s	r
1.3s	x
1.1s	y

Compiler

Compiled 1704 to 1205 computations (29.3% saved)

analyze13.2s (5.9%)

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
22.1%	16.3%	57.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.1%	0.2%	6
71%	51.1%	20.8%	26.3%	0%	1.6%	0.2%	7
72%	51.6%	20.1%	26.3%	0%	1.8%	0.2%	8
74.2%	53%	18.4%	26.3%	0%	2%	0.2%	9
75.6%	53.9%	17.4%	26.3%	0%	2.1%	0.3%	10
76.3%	54.3%	16.8%	26.3%	0%	2.3%	0.3%	11
77%	54.8%	16.3%	26.3%	0%	2.3%	0.3%	12

Compiler

Compiled 295 to 210 computations (28.8% saved)

rewrite12.7s (5.6%)

Algorithm

61×	batch-egg-rewrite

Rules

42817×	`log1p-expm1-u`
28883×	`expm1-log1p-u`
22612×	`unpow-prod-down`
20350×	`log-prod`
14882×	`associate-r`

Stop Event

61×	node limit

Counts

472 → 18611

prune10.5s (4.6%)

Counts: 40188 → 1595
Compiler: Compiled 57655 to 35608 computations (38.2% saved)

preprocess7.9s (3.5%)

Algorithm

20×	egg-herbie

Rules

15490×	`fma-neg`
13456×	`fma-define`
6058×	`distribute-lft-neg-in`
5264×	`distribute-rgt-neg-in`
4554×	`distribute-lft-in`

Stop Event

13×	saturated
7×	node limit

Compiler

Compiled 8429 to 4818 computations (42.8% saved)

series5.6s (2.5%)

Counts

472 → 8368

Calls

1998 calls:

Time	Variable		Point	Expression
295.0ms	x	@	0	(*.f64 (pow.f64 2 1/4) x)
142.0ms	x	@	-inf	(/.f64 (/.f64 (cos.f64 (.f64 x 2)) (.f64 c (.f64 s x))) (.f64 c (*.f64 s x)))
131.0ms	y	@	0	(log.f64 (-.f64 (tan.f64 (+.f64 y z)) (-.f64 (tan.f64 a) x)))
121.0ms	x	@	inf	(*.f64 x (sqrt.f64 2))
118.0ms	x	@	inf	(*.f64 -1/6 (pow.f64 x 2))

bsearch568.0ms (0.3%)

Algorithm

9×	left-value
12×	binary-search

Stop Event

3×	predicate-same
9×	narrow-enough

Results

131.0ms	878×	256	valid
395.0ms	590×	512	valid
15.0ms	100×	256	infinite

Compiler

Compiled 2504 to 1777 computations (29% saved)

Herbie run

sample55.7s (24.6%)

localize38.2s (16.9%)

soundness29.6s (13.1%)

eval22.0s (9.7%)

simplify15.8s (7%)

regimes14.4s (6.4%)

analyze13.2s (5.9%)

rewrite12.7s (5.6%)

prune10.5s (4.6%)

preprocess7.9s (3.5%)

series5.6s (2.5%)

bsearch568.0ms (0.3%)

end2.0ms (0%)

Profiling