Metrics for Herbie run

Date:	Saturday, February 3rd, 2024
Commit:	69687665 on add-id-expand-rule
Hostname:	nightly with Racket 8.11.1
Seed:	2024034
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

series2.6min (31.5%)

Counts

692 → 10487

Calls

3275 calls:

Time	Variable		Point	Expression
2.4min	x	@	inf	(pow.f64 (pow.f64 (-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x)) 3) 1/3)
412.0ms	x	@	inf	(-.f64 (cbrt.f64 (+.f64 x 1)) (cbrt.f64 x))
158.0ms	N	@	-inf	(log.f64 (exp.f64 (-.f64 (sqrt.f64 (log1p.f64 N)) (sqrt.f64 (log.f64 N)))))
126.0ms	a	@	0	(exp.f64 (.f64 1/4 (+.f64 (log.f64 (.f64 4 a)) (*.f64 -1 (log.f64 (/.f64 -1 c))))))
93.0ms	eps	@	inf	(-.f64 (tan.f64 (+.f64 x eps)) (tan.f64 x))

Results

sample2.1min (26.3%)

Results

26.8s	142921×	256	precondition
15.6s	94859×	256	valid
28.0s	59187×	1024	valid
42.0s	35776×	2048	valid
9.5s	34874×	512	valid
895.0ms	5156×	256	invalid
829.0ms	4248×	256	infinite
516.0ms	3927×	256	unsamplable
1.3s	1900×	4096	valid
1.4s	1181×	1024	invalid
236.0ms	576×	512	invalid
99.0ms	180×	512	infinite
175.0ms	144×	1024	infinite

Bogosity

localize51.4s (10.6%)

Compiler: Compiled 14857 to 8387 computations (43.5% saved)

eval35.6s (7.3%)

Compiler: Compiled 1834456 to 978878 computations (46.6% saved)

soundness32.6s (6.7%)

Rules

81298×	`fma-define`
80479×	`add0`
68394×	`fma-neg`
54986×	`distribute-rgt-in`
51038×	`distribute-lft-in`

Stop Event

2×	saturated
143×	node limit

Compiler

Compiled 14682 to 9816 computations (33.1% saved)

simplify22.0s (4.5%)

Algorithm

119×	egg-herbie

Rules

83086×	`add0`
61540×	`fma-define`
45834×	`distribute-rgt-in`
45818×	`fma-neg`
44182×	`distribute-lft-in`

Stop Event

27×	saturated
91×	node limit
16×	fuel
1×	unsound
11×	done

Counts

40627 → 37291

Compiler

Compiled 2407 to 1684 computations (30% saved)

rewrite19.2s (4%)

Algorithm

92×	batch-egg-rewrite

Rules

56610×	`log1p-expm1-u`
46413×	`expm1-log1p-u`
39524×	`prod-diff`
35180×	`fma-define`
21194×	`log-prod`

Stop Event

92×	node limit

Counts

692 → 30140

prune15.2s (3.1%)

Counts: 59318 → 1629
Compiler: Compiled 53822 to 38340 computations (28.8% saved)

preprocess15.1s (3.1%)

Algorithm

28×	egg-herbie

Rules

29256×	`fma-neg`
16582×	`fma-define`
13838×	`div-sub`
9432×	`distribute-rgt-in`
9360×	`add0`

Stop Event

13×	saturated
15×	node limit

Compiler

Compiled 9761 to 5902 computations (39.5% saved)

regimes7.3s (1.5%)

Counts

2225 → 229

Calls

42 calls:

1.4s	a
1.2s	x
1.0s	c
735.0ms	b
608.0ms	(/.f64 1 n)

Compiler

Compiled 1242 to 868 computations (30.1% saved)

bsearch3.7s (0.8%)

Algorithm

72×	binary-search
22×	left-value

Stop Event

1×	predicate-same
71×	narrow-enough

Results

945.0ms	5832×	256	valid
170.0ms	1090×	256	invalid
781.0ms	1024×	1024	valid
216.0ms	800×	256	infinite
910.0ms	685×	2048	valid
411.0ms	635×	512	valid
40.0ms	80×	512	infinite
16.0ms	46×	256	unsamplable

Compiler

Compiled 12935 to 9554 computations (26.1% saved)

analyze2.7s (0.5%)

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
18.1%	11.1%	50%	38.9%	0%	0%	0%	1
25.4%	15.5%	45.6%	38.9%	0%	0%	0%	2
40.7%	23.8%	34.6%	41.6%	0%	0%	0%	3
49.4%	28.8%	29.5%	41.7%	0%	0%	0%	4
56.9%	32.5%	24.6%	42.4%	0%	0.4%	0%	5
59.4%	33.4%	22.8%	43.1%	0%	0.7%	0%	6
63.2%	34.4%	20%	44%	0%	1.4%	0.1%	7
66.4%	35.7%	18.1%	44.5%	0%	1.6%	0.1%	8
68.8%	36.4%	16.5%	44.9%	0%	2%	0.3%	9
70.9%	36.8%	15.1%	45.2%	0%	2.6%	0.3%	10
73.5%	37.8%	13.6%	45.4%	0%	2.8%	0.4%	11
74.7%	38.1%	12.9%	45.6%	0%	3.1%	0.4%	12

Compiler

Compiled 505 to 355 computations (29.7% saved)

Herbie run

series2.6min (31.5%)

sample2.1min (26.3%)

localize51.4s (10.6%)

eval35.6s (7.3%)

soundness32.6s (6.7%)

simplify22.0s (4.5%)

rewrite19.2s (4%)

prune15.2s (3.1%)

preprocess15.1s (3.1%)

regimes7.3s (1.5%)

bsearch3.7s (0.8%)

analyze2.7s (0.5%)

end3.0ms (0%)

Profiling