Metrics for Herbie run

Date:	Thursday, February 1st, 2024
Commit:	93f5a71d on minor-egg-herbie-cleanup
Hostname:	nightly with Racket 8.11.1
Seed:	2024032
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample52.1s (25.5%)

Results

15.5s	116222×	256	valid
7.5s	23381×	512	valid
6.1s	15820×	1024	valid
15.3s	12895×	8192	exit
1.3s	4948×	256	invalid
1.0s	4899×	256	infinite
4.1s	4798×	2048	valid
902.0ms	2164×	1024	invalid
143.0ms	1167×	256	unsamplable
223.0ms	1147×	512	invalid
9.0ms	4×	8192	invalid
3.0ms	2×	4096	invalid
2.0ms	2×	2048	invalid

Bogosity

localize34.9s (17.1%)

Compiler: Compiled 8814 to 4440 computations (49.6% saved)

soundness25.2s (12.4%)

Rules

56832×	`fma-def`
33276×	`associate-r`
32820×	`log-prod`
32257×	`log1p-expm1-u`
27042×	`fma-neg`

Stop Event

5×	saturated
100×	node limit
1×	unsound

Compiler

Compiled 9793 to 5560 computations (43.2% saved)

eval19.3s (9.4%)

Compiler: Compiled 929244 to 513636 computations (44.7% saved)

simplify17.0s (8.3%)

Algorithm

84×	egg-herbie

Rules

51488×	`fma-def`
37672×	`log-prod`
29794×	`associate-r`
28298×	`associate-l`
24838×	`*-commutative`

Stop Event

20×	saturated
61×	node limit
11×	fuel
3×	unsound
9×	done

Counts

28276 → 21288

Compiler

Compiled 1538 to 1021 computations (33.6% saved)

rewrite13.6s (6.7%)

Algorithm

64×	batch-egg-rewrite

Rules

34478×	`log1p-expm1-u`
28595×	`expm1-log1p-u`
22976×	`log-prod`
19932×	`prod-diff`
19918×	`expm1-udef`

Stop Event

64×	node limit

Counts

489 → 20134

analyze11.3s (5.5%)

Algorithm

20×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	73.7%	26.3%	0%	0%	0%	0
22.1%	16.3%	57.5%	26.3%	0%	0%	0%	1
44.1%	32.5%	41.2%	26.3%	0%	0%	0%	2
52.6%	38.7%	35%	26.3%	0%	0%	0%	3
61.9%	45.6%	28.1%	26.3%	0%	0%	0%	4
65.2%	47.5%	25.3%	26.3%	0%	0.9%	0%	5
66.8%	48.4%	24%	26.3%	0%	1.1%	0.2%	6
71%	51.1%	20.8%	26.3%	0%	1.6%	0.2%	7
72%	51.6%	20.1%	26.3%	0%	1.8%	0.2%	8
74.2%	53%	18.4%	26.3%	0%	2%	0.2%	9
75.7%	53.9%	17.3%	26.3%	0%	2.2%	0.3%	10
76.4%	54.3%	16.8%	26.3%	0%	2.3%	0.3%	11
77.2%	54.8%	16.2%	26.3%	0%	2.4%	0.3%	12

Compiler

Compiled 295 to 210 computations (28.8% saved)

prune9.7s (4.7%)

Counts: 37187 → 1688
Compiler: Compiled 62113 to 40487 computations (34.8% saved)

regimes9.4s (4.6%)

Counts

2526 → 139

Calls

55 calls:

1.8s	a
1.2s	x
1.1s	r
822.0ms	b
515.0ms	c

Compiler

Compiled 1540 to 1094 computations (29% saved)

preprocess7.3s (3.6%)

Algorithm

20×	egg-herbie

Rules

23976×	`fma-def`
6950×	`fma-neg`
6346×	`distribute-lft-neg-in`
5212×	`div-sub`
4916×	`distribute-rgt-neg-in`

Stop Event

12×	saturated
8×	node limit

Compiler

Compiled 9115 to 5164 computations (43.3% saved)

series3.5s (1.7%)

Counts

489 → 8142

Calls

2244 calls:

Time	Variable		Point	Expression
98.0ms	x	@	-inf	(log.f64 (/.f64 x (sinh.f64 x)))
84.0ms	x	@	0	(.f64 (pow.f64 2 1/8) (.f64 x (pow.f64 2 1/4)))
79.0ms	b	@	inf	(log.f64 (cos.f64 (+.f64 b a)))
76.0ms	x	@	0	(*.f64 (pow.f64 2 1/4) x)
68.0ms	x	@	-inf	(log.f64 (*.f64 1/2 (/.f64 (fmod.f64 (exp.f64 x) (sqrt.f64 (cos.f64 x))) (exp.f64 x))))

bsearch1.0s (0.5%)

Algorithm

15×	left-value
24×	binary-search

Stop Event

2×	predicate-same
20×	narrow-enough
2×	predicate-failed

Results

598.0ms	1784×	256	valid
191.0ms	686×	512	valid
32.0ms	202×	256	invalid
23.0ms	170×	256	infinite
87.0ms	128×	2048	valid
33.0ms	96×	1024	valid

Compiler

Compiled 4431 to 3156 computations (28.8% saved)

Herbie run

sample52.1s (25.5%)

localize34.9s (17.1%)

soundness25.2s (12.4%)

eval19.3s (9.4%)

simplify17.0s (8.3%)

rewrite13.6s (6.7%)

analyze11.3s (5.5%)

prune9.7s (4.7%)

regimes9.4s (4.6%)

preprocess7.3s (3.6%)

series3.5s (1.7%)

bsearch1.0s (0.5%)

end1.0ms (0%)

Profiling