Metrics for Herbie run

Date:	Monday, October 2nd, 2023
Commit:	2a64fc33 on main
Hostname:	nightly with Racket 8.6
Seed:	2023275
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample1.2min (32.9%)

Results

19.0s	109621×	body	256	valid
17.9s	29558×	body	1024	valid
16.5s	12878×	body	8192	exit
6.2s	5966×	body	2048	valid
5.2s	14958×	body	512	valid
2.2s	3939×	body	1024	invalid
907.0ms	4714×	body	256	infinite
671.0ms	2029×	body	512	invalid
362.0ms	2377×	body	256	invalid
229.0ms	1166×	body	256	unsamplable
82.0ms	149×	body	1024	infinite
55.0ms	154×	body	512	infinite
3.0ms	4×	body	2048	invalid

Bogosity

localize34.8s (16.4%)

Compiler: Compiled 9128 to 3914 computations (57.1% saved)

soundness19.1s (9%)

Rules

57184×	`fma-def`
54634×	`log-prod`
33304×	`associate-r`
32740×	`pow1`
32060×	`fma-neg`

Stop Event

4×	saturated
94×	node limit

Compiler

Compiled 6932 to 4104 computations (40.8% saved)

eval18.0s (8.5%)

Compiler: Compiled 672991 to 337209 computations (49.9% saved)

simplify13.9s (6.5%)

Algorithm

85×	egg-herbie

Rules

54898×	`fma-def`
45330×	`log-prod`
36676×	`associate-r`
31516×	`associate-l`
24714×	`distribute-lft-in`

Stop Event

2×	unsound
5×	done
20×	saturated
15×	fuel
63×	node limit

Counts

23203 → 17825

Compiler

Compiled 1346 to 923 computations (31.4% saved)

analyze13.7s (6.5%)

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
22.1%	16.3%	57.5%	26.3%	0%	0%	0%	1
47.5%	35%	38.7%	26.3%	0%	0%	0%	2
56%	41.2%	32.5%	26.3%	0%	0%	0%	3
65.3%	48.1%	25.6%	26.3%	0%	0%	0%	4
68.7%	50%	22.8%	26.3%	0%	0.9%	0%	5
70.3%	50.9%	21.5%	26.3%	0%	1.1%	0.2%	6
74.5%	53.6%	18.3%	26.3%	0%	1.6%	0.2%	7
75.5%	54.1%	17.6%	26.3%	0%	1.8%	0.2%	8
77.7%	55.5%	15.9%	26.3%	0%	2%	0.2%	9
79.1%	56.4%	14.9%	26.3%	0%	2.2%	0.3%	10
79.8%	56.8%	14.3%	26.3%	0%	2.3%	0.3%	11
80.5%	57.2%	13.8%	26.3%	0%	2.4%	0.3%	12

Compiler

Compiled 295 to 210 computations (28.8% saved)

regimes12.4s (5.9%)

Counts

2748 → 120

Calls

53 calls:

1.9s	a
1.5s	r
1.3s	x
1.2s	b
621.0ms	(tan.f64 a)

Compiler

Compiled 35628 to 15220 computations (57.3% saved)

prune12.2s (5.8%)

Counts: 29581 → 1609
Compiler: Compiled 91742 to 57254 computations (37.6% saved)

rewrite9.9s (4.7%)

Algorithm

65×	batch-egg-rewrite

Rules

49586×	`pow1`
46520×	`add-exp-log`
46474×	`log1p-expm1-u`
46464×	`expm1-log1p-u`
45962×	`add-log-exp`

Stop Event

65×	node limit

Counts

505 → 14059

preprocess4.1s (1.9%)

Algorithm

20×	egg-herbie

Rules

18794×	`fma-def`
9552×	`fma-neg`
5312×	`distribute-lft-neg-in`
4910×	`sub-neg`
4300×	`distribute-rgt-in`

Stop Event

12×	saturated
8×	node limit

Compiler

Compiled 3573 to 1990 computations (44.3% saved)

series3.7s (1.8%)

Counts

505 → 9144

Calls

2409 calls:

Time	Variable		Point	Expression
296.0ms	x	@	0	(.f64 (.f64 s (.f64 c x)) (.f64 s (*.f64 c x)))
235.0ms	x	@	0	(*.f64 (pow.f64 2 1/4) x)
126.0ms	lo	@	inf	(-.f64 1 (/.f64 (-.f64 x hi) lo))
125.0ms	x	@	-inf	(log.f64 (/.f64 x (sinh.f64 x)))
106.0ms	a	@	inf	(log1p.f64 (tan.f64 a))

bsearch706.0ms (0.3%)

Algorithm

9×	left-value
19×	binary-search

Stop Event

18×	narrow-enough
1×	predicate-same

Results

279.0ms	642×	body	1024	valid
240.0ms	1285×	body	256	valid
78.0ms	240×	body	512	valid
54.0ms	66×	body	2048	valid
15.0ms	87×	body	256	infinite

Compiler

Compiled 3567 to 2556 computations (28.3% saved)

Herbie run

sample1.2min (32.9%)

localize34.8s (16.4%)

soundness19.1s (9%)

eval18.0s (8.5%)

simplify13.9s (6.5%)

analyze13.7s (6.5%)

regimes12.4s (5.9%)

prune12.2s (5.8%)

rewrite9.9s (4.7%)

preprocess4.1s (1.9%)

series3.7s (1.8%)

bsearch706.0ms (0.3%)

end1.0ms (0%)

Profiling