Metrics for Herbie run

Date:	Saturday, February 3rd, 2024
Commit:	69687665 on add-id-expand-rule
Hostname:	nightly with Racket 8.11.1
Seed:	2024034
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample56.0s (26.4%)

Results

15.9s	115969×	256	valid
12.2s	23426×	512	valid
6.6s	15865×	1024	valid
13.6s	13019×	8192	exit
742.0ms	5084×	256	infinite
760.0ms	4914×	256	invalid
4.7s	4776×	2048	valid
854.0ms	2285×	1024	invalid
150.0ms	1230×	256	unsamplable
382.0ms	1085×	512	invalid
5.0ms	2×	8192	invalid
1.0ms	1×	4096	invalid
1.0ms	1×	2048	invalid

Bogosity

soundness31.4s (14.8%)

Rules

61038×	`fma-define`
45229×	`add0`
39542×	`log1p-expm1-u`
38696×	`fma-neg`
30968×	`distribute-lft-in`

Stop Event

4×	saturated
100×	node limit

Compiler

Compiled 9424 to 4980 computations (47.2% saved)

localize26.4s (12.5%)

Compiler: Compiled 7505 to 3575 computations (52.4% saved)

eval19.5s (9.2%)

Compiler: Compiled 857992 to 493892 computations (42.4% saved)

simplify16.6s (7.8%)

Algorithm

81×	egg-herbie

Rules

50024×	`add0`
38172×	`fma-define`
29528×	`distribute-rgt-in`
29336×	`distribute-lft-in`
28098×	`fma-neg`

Stop Event

21×	saturated
57×	node limit
11×	fuel
3×	unsound
9×	done

Counts

29631 → 22884

Compiler

Compiled 1298 to 884 computations (31.9% saved)

regimes14.4s (6.8%)

Counts

2704 → 116

Calls

53 calls:

2.2s	a
1.8s	x
1.4s	r
1.3s	b
717.0ms	(pow.f64 s 2)

Compiler

Compiled 1617 to 1148 computations (29% saved)

rewrite14.0s (6.6%)

Algorithm

61×	batch-egg-rewrite

Rules

38853×	`log1p-expm1-u`
26814×	`expm1-log1p-u`
23792×	`fma-define`
22300×	`prod-diff`
17190×	`log-prod`

Stop Event

61×	node limit

Counts

434 → 21555

analyze10.9s (5.1%)

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
22.1%	16.3%	57.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.1%	0.2%	6
71%	51.1%	20.8%	26.3%	0%	1.6%	0.2%	7
72%	51.6%	20.1%	26.3%	0%	1.8%	0.2%	8
74.2%	53%	18.4%	26.3%	0%	2%	0.2%	9
75.7%	53.9%	17.3%	26.3%	0%	2.2%	0.3%	10
76.4%	54.3%	16.8%	26.3%	0%	2.3%	0.3%	11
77.2%	54.8%	16.2%	26.3%	0%	2.4%	0.3%	12

Compiler

Compiled 295 to 210 computations (28.8% saved)

prune9.4s (4.4%)

Counts: 38839 → 1486
Compiler: Compiled 50448 to 33067 computations (34.5% saved)

preprocess7.6s (3.6%)

Algorithm

20×	egg-herbie

Rules

22006×	`fma-define`
18924×	`fma-neg`
7526×	`div-sub`
5854×	`distribute-lft-neg-in`
5105×	`add0`

Stop Event

12×	saturated
8×	node limit

Compiler

Compiled 7965 to 4462 computations (44% saved)

series4.8s (2.2%)

Counts

434 → 8076

Calls

2151 calls:

Time	Variable		Point	Expression
177.0ms	x	@	inf	(-.f64 (sqrt.f64 (+.f64 1 x)) (sqrt.f64 (-.f64 1 x)))
125.0ms	x	@	-inf	(pow.f64 (cbrt.f64 (*.f64 1/3 (sqrt.f64 (cos.f64 x)))) 3)
124.0ms	a	@	0	(exp.f64 (log.f64 (-.f64 (tan.f64 (+.f64 y z)) (-.f64 (tan.f64 a) x))))
100.0ms	x	@	0	(pow.f64 (cbrt.f64 (-.f64 (sin.f64 x) x)) 3)
94.0ms	x	@	-inf	(pow.f64 (cos.f64 x) 3/2)

bsearch910.0ms (0.4%)

Algorithm

25×	binary-search
1×	left-value

Stop Event

2×	predicate-same
22×	narrow-enough
1×	predicate-failed

Results

390.0ms	1400×	256	valid
311.0ms	729×	512	valid
16.0ms	101×	256	invalid
17.0ms	95×	256	infinite

Compiler

Compiled 3379 to 2390 computations (29.3% saved)

Herbie run

sample56.0s (26.4%)

soundness31.4s (14.8%)

localize26.4s (12.5%)

eval19.5s (9.2%)

simplify16.6s (7.8%)

regimes14.4s (6.8%)

rewrite14.0s (6.6%)

analyze10.9s (5.1%)

prune9.4s (4.4%)

preprocess7.6s (3.6%)

series4.8s (2.2%)

bsearch910.0ms (0.4%)

end1.0ms (0%)

Profiling