Metrics for Herbie run

Date:	Thursday, February 15th, 2024
Commit:	aa763581 on add-id-expand-rule
Hostname:	nightly with Racket 8.11.1
Seed:	2024046
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.0min (27.1%)

Results

15.2s	116057×	256	valid
11.1s	23410×	512	valid
21.6s	17691×	8192	exit
6.8s	15860×	1024	valid
848.0ms	4955×	256	infinite
4.5s	4836×	2048	valid
599.0ms	3887×	256	invalid
206.0ms	1223×	256	unsamplable
1.0ms	2×	512	infinite

Bogosity

localize32.8s (14.6%)

Compiler: Compiled 8062 to 3773 computations (53.2% saved)

soundness28.0s (12.5%)

Rules

59662×	`fma-define`
39582×	`add0`
36126×	`fma-neg`
31756×	`distribute-rgt-in`
29070×	`associate-r`

Stop Event

7×	saturated
87×	node limit
2×	unsound

Compiler

Compiled 8346 to 4441 computations (46.8% saved)

eval21.9s (9.8%)

Compiler: Compiled 996184 to 576237 computations (42.2% saved)

regimes15.8s (7.1%)

Counts

3103 → 135

Calls

53 calls:

2.0s	a
1.8s	x
1.3s	(tan.f64 a)
1.1s	r
1.1s	z

Compiler

Compiled 1783 to 1279 computations (28.3% saved)

simplify15.4s (6.9%)

Algorithm

84×	egg-herbie

Rules

52568×	`add0`
42756×	`fma-define`
31740×	`distribute-rgt-in`
29646×	`distribute-lft-in`
29610×	`fma-neg`

Stop Event

20×	saturated
58×	node limit
12×	fuel
6×	unsound
8×	done

Counts

31792 → 23956

Compiler

Compiled 1660 to 1091 computations (34.3% saved)

rewrite13.7s (6.1%)

Algorithm

64×	batch-egg-rewrite

Rules

35898×	`log1p-expm1-u`
29140×	`expm1-log1p-u`
25704×	`fma-define`
22182×	`unpow-prod-down`
19048×	`log-prod`

Stop Event

63×	node limit
1×	unsound

Counts

463 → 23391

analyze11.4s (5.1%)

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
22.1%	16.3%	57.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.1%	0.2%	6
71%	51.1%	20.8%	26.3%	0%	1.6%	0.2%	7
72%	51.6%	20.1%	26.3%	0%	1.8%	0.2%	8
74.2%	53%	18.4%	26.3%	0%	2%	0.2%	9
75.6%	53.9%	17.4%	26.3%	0%	2.1%	0.3%	10
76.3%	54.3%	16.8%	26.3%	0%	2.3%	0.3%	11
77%	54.8%	16.3%	26.3%	0%	2.3%	0.3%	12

Compiler

Compiled 295 to 210 computations (28.8% saved)

prune11.3s (5.1%)

Counts: 44085 → 1618
Compiler: Compiled 55662 to 36024 computations (35.3% saved)

preprocess7.5s (3.4%)

Algorithm

20×	egg-herbie

Rules

21080×	`fma-define`
17598×	`fma-neg`
5518×	`distribute-lft-neg-in`
4962×	`distribute-rgt-in`
4875×	`add0`

Stop Event

13×	saturated
7×	node limit

Compiler

Compiled 8787 to 4804 computations (45.3% saved)

series5.1s (2.3%)

Counts

463 → 8401

Calls

2232 calls:

Time	Variable		Point	Expression
390.0ms	x	@	-inf	(-.f64 (log.f64 (sinh.f64 x)) (log.f64 x))
290.0ms	s	@	0	(.f64 (/.f64 (/.f64 1 (.f64 s (.f64 c x))) (.f64 s x)) (/.f64 1 c))
138.0ms	a	@	inf	(-.f64 (.f64 (+.f64 (tan.f64 y) (tan.f64 z)) (/.f64 1 (-.f64 1 (.f64 (tan.f64 y) (tan.f64 z))))) (tan.f64 a))
137.0ms	b	@	inf	(fma.f64 (neg.f64 (sin.f64 b)) (sin.f64 a) (*.f64 (sin.f64 a) (sin.f64 b)))
135.0ms	a	@	-inf	(*.f64 r (/.f64 (sin.f64 b) (exp.f64 (log.f64 (cos.f64 (+.f64 b a))))))

bsearch549.0ms (0.2%)

Algorithm

14×	left-value
18×	binary-search

Stop Event

18×	narrow-enough

Results

372.0ms	1290×	256	valid
102.0ms	354×	512	valid
42.0ms	260×	256	infinite

Compiler

Compiled 3791 to 2601 computations (31.4% saved)

Herbie run

sample1.0min (27.1%)

localize32.8s (14.6%)

soundness28.0s (12.5%)

eval21.9s (9.8%)

regimes15.8s (7.1%)

simplify15.4s (6.9%)

rewrite13.7s (6.1%)

analyze11.4s (5.1%)

prune11.3s (5.1%)

preprocess7.5s (3.4%)

series5.1s (2.3%)

bsearch549.0ms (0.2%)

end2.0ms (0%)

Profiling