Metrics for Herbie run

Date:	Thursday, May 9th, 2024
Commit:	66dd3019 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024130
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample2.8min (47.8%)

Results

43.5s	55190×	2	valid
30.1s	116140×	1	valid
30.0s	141669×	0	precondition
29.5s	7179×	5	exit
6.8s	57197×	0	valid
3.4s	2641×	3	valid
498.0ms	4225×	0	unsamplable
386.0ms	4244×	0	invalid

Precisions

Click to see histograms. Total time spent on operations: 2.0min

ival-pow: 28.8s (23.5% of total)

ival-tan: 12.7s (10.4% of total)

ival-exp: 12.1s (9.9% of total)

ival-mult: 9.2s (7.5% of total)

ival-sub: 7.9s (6.5% of total)

...c/correct-round.rkt:119:19: 7.2s (5.8% of total)

ival-div: 5.5s (4.5% of total)

ival-log: 5.2s (4.2% of total)

backward-pass: 5.2s (4.2% of total)

ival-add: 4.5s (3.7% of total)

ival-<=: 4.4s (3.6% of total)

ival-cos: 4.0s (3.3% of total)

ival-fabs: 3.6s (3% of total)

ival-sin: 3.6s (2.9% of total)

ival-<: 2.2s (1.8% of total)

ival->: 1.6s (1.3% of total)

ival-sqrt: 1.5s (1.2% of total)

ival-and: 818.0ms (0.7% of total)

ival-fmin: 674.0ms (0.6% of total)

const: 647.0ms (0.5% of total)

ival-neg: 539.0ms (0.4% of total)

ival-atan: 429.0ms (0.4% of total)

ival-cbrt: 357.0ms (0.3% of total)

Bogosity

simplify45.6s (13.1%)

Algorithm

240×	egg-herbie

Rules

84220×	`fma-define`
72171×	`fma-neg`
45512×	`distribute-lft-in`
44373×	`times-frac`
41418×	`distribute-rgt-in`

Stop Event

77×	saturated
158×	node limit
5×	unsound

Counts

56021 → 57223

soundness27.3s (7.9%)

Rules

33119×	`log1p-expm1-u`
30734×	`fma-define`
25631×	`expm1-log1p-u`
25124×	`fma-neg`
20054×	`associate-r`

Stop Event

9×	saturated
109×	node limit
22×	fuel
4×	unsound
6×	done

Compiler

Compiled 20753 to 6066 computations (70.8% saved)

localize25.4s (7.3%)

Results

7.3s	7662×	1	valid
6.1s	4208×	2	valid
4.6s	13577×	0	valid
1.0s	408×	3	valid
842.0ms	1476×	0	invalid
135.0ms	61×	5	exit

Compiler

Compiled 17275 to 2502 computations (85.5% saved)

Precisions

Click to see histograms. Total time spent on operations: 12.5s

ival-pow: 2.3s (18.2% of total)

ival-mult: 1.6s (12.4% of total)

ival-div: 1.2s (9.8% of total)

backward-pass: 1.1s (9% of total)

ival-sub: 1.0s (8.1% of total)

ival-add: 894.0ms (7.2% of total)

...c/correct-round.rkt:119:19: 745.0ms (6% of total)

ival-tan: 673.0ms (5.4% of total)

ival-sin: 481.0ms (3.8% of total)

ival-cos: 400.0ms (3.2% of total)

ival-log: 370.0ms (3% of total)

ival-exp: 328.0ms (2.6% of total)

ival-fma: 291.0ms (2.3% of total)

ival-sqrt: 245.0ms (2% of total)

ival-log1p: 184.0ms (1.5% of total)

ival-cbrt: 163.0ms (1.3% of total)

const: 135.0ms (1.1% of total)

ival-neg: 120.0ms (1% of total)

ival-cosh: 105.0ms (0.8% of total)

ival-hypot: 84.0ms (0.7% of total)

ival-atan: 32.0ms (0.3% of total)

ival-expm1: 26.0ms (0.2% of total)

ival-atan2: 21.0ms (0.2% of total)

ival-fabs: 6.0ms (0% of total)

ival-e: 5.0ms (0% of total)

rewrite24.9s (7.2%)

Algorithm

105×	batch-egg-rewrite

Rules

66604×	`log1p-expm1-u`
51144×	`expm1-log1p-u`
21624×	`pow1`
21186×	`add-exp-log`
21025×	`add-log-exp`

Stop Event

105×	node limit

Counts

1196 → 38431

prune16.0s (4.6%)

Counts: 78117 → 2097
Compiler: Compiled 68559 to 39246 computations (42.8% saved)

eval13.9s (4%)

Compiler: Compiled 1847123 to 289589 computations (84.3% saved)

explain6.9s (2%)

Results

2.5s	3478×	2	valid
2.0s	7158×	1	valid
490.0ms	3500×	0	valid
316.0ms	200×	3	valid

Compiler

Compiled 2227 to 707 computations (68.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 3.8s

ival-exp: 741.0ms (19.4% of total)

ival-tan: 697.0ms (18.2% of total)

backward-pass: 540.0ms (14.1% of total)

ival-log: 334.0ms (8.7% of total)

ival-sub: 249.0ms (6.5% of total)

ival-sin: 222.0ms (5.8% of total)

ival-cos: 210.0ms (5.5% of total)

ival-add: 185.0ms (4.8% of total)

ival-div: 171.0ms (4.5% of total)

ival-mult: 167.0ms (4.4% of total)

ival-pow: 139.0ms (3.6% of total)

ival-sqrt: 71.0ms (1.9% of total)

const: 31.0ms (0.8% of total)

ival-neg: 25.0ms (0.7% of total)

ival-atan: 21.0ms (0.5% of total)

ival-cbrt: 19.0ms (0.5% of total)

series6.6s (1.9%)

Counts

1196 → 17590

Calls

4719 calls:

Time	Variable		Point	Expression
147.0ms	eps	@	inf	(log (+ (* (+ (tan x) (tan eps)) (/ 1 (- 1 (* (tan x) (tan eps))))) (neg (tan x))))
130.0ms	a	@	-inf	(cbrt (* a c))
84.0ms	x	@	inf	(+ (* (cbrt x) (+ (cbrt (+ 1 x)) (cbrt x))) (* (pow (sqrt (exp 2/3)) (log (+ 1 x))) (pow (sqrt (exp 2/3)) (log (+ 1 x)))))
74.0ms	a	@	-inf	(* 4 (pow (cbrt (* a c)) 3))
65.0ms	eps	@	inf	(log (+ 1 (- (tan (+ eps x)) (tan x))))

preprocess4.7s (1.3%)

Algorithm

28×	egg-herbie

Rules

8308×	`fma-neg`
6663×	`fma-define`
4279×	`div-sub`
2669×	`sub-neg`
2621×	`times-frac`

Stop Event

23×	saturated
5×	node limit

Compiler

Compiled 9178 to 3722 computations (59.4% saved)

analyze4.0s (1.1%)

Algorithm

28×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	61.1%	38.9%	0%	0%	0%	0
6.1%	3.7%	57.4%	38.9%	0%	0%	0%	1
16.5%	10.1%	51%	38.9%	0%	0%	0%	2
35.3%	20.6%	37.8%	41.6%	0%	0%	0%	3
46.1%	26.9%	31.4%	41.7%	0%	0%	0%	4
54.8%	31.5%	26%	42.4%	0%	0%	0%	5
57.1%	32.5%	24.4%	43.1%	0%	0%	0%	6
61.5%	33.9%	21.3%	44%	0%	0.8%	0.1%	7
64.6%	35.3%	19.3%	44.5%	0%	0.8%	0.1%	8
67.1%	36%	17.6%	44.9%	0%	1.2%	0.3%	9
69.1%	36.5%	16.3%	45.2%	0%	1.7%	0.3%	10
71.7%	37.5%	14.8%	45.4%	0%	1.9%	0.4%	11
72.8%	37.8%	14.1%	45.6%	0%	2.2%	0.4%	12

Compiler

Compiled 498 to 322 computations (35.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 2.1s

ival-mult: 405.0ms (19.3% of total)

ival-sub: 273.0ms (13% of total)

ival-add: 235.0ms (11.2% of total)

...c/correct-round.rkt:119:19: 165.0ms (7.9% of total)

ival-neg: 162.0ms (7.7% of total)

ival-pow: 154.0ms (7.4% of total)

ival-log: 103.0ms (4.9% of total)

ival-div: 98.0ms (4.7% of total)

ival-exp: 90.0ms (4.3% of total)

ival-<=: 87.0ms (4.2% of total)

ival-sqrt: 58.0ms (2.8% of total)

ival-sin: 54.0ms (2.6% of total)

ival-fabs: 53.0ms (2.5% of total)

ival-cos: 44.0ms (2.1% of total)

ival-tan: 38.0ms (1.8% of total)

const: 21.0ms (1% of total)

ival->: 14.0ms (0.7% of total)

ival-and: 12.0ms (0.6% of total)

ival-<: 11.0ms (0.5% of total)

backward-pass: 9.0ms (0.4% of total)

ival-fmin: 7.0ms (0.3% of total)

ival-atan: 0.0ms (0% of total)

ival-cbrt: 0.0ms (0% of total)

regimes3.4s (1%)

Counts

3819 → 285

Calls

43 calls:

738.0ms	x
479.0ms	b_2
290.0ms	c
262.0ms	eps
155.0ms	(-.f64 (cbrt.f64 (+.f64 x #s(literal 1 binary64))) (cbrt.f64 x))

Compiler

Compiled 1548 to 1025 computations (33.8% saved)

bsearch2.2s (0.6%)

Algorithm

68×	binary-search
25×	left-value

Stop Event

7×	predicate-same
61×	narrow-enough

Results

592.0ms	6352×	0	valid
308.0ms	1302×	1	valid
277.0ms	618×	2	valid
188.0ms	1330×	0	invalid
12.0ms	89×	0	unsamplable

Compiler

Compiled 13298 to 9587 computations (27.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 906.0ms

ival-mult: 191.0ms (21.1% of total)

ival-sqrt: 156.0ms (17.2% of total)

ival-pow: 145.0ms (16% of total)

ival-sub: 96.0ms (10.6% of total)

ival-div: 87.0ms (9.6% of total)

ival-exp: 57.0ms (6.3% of total)

ival-neg: 50.0ms (5.5% of total)

ival-add: 41.0ms (4.5% of total)

backward-pass: 36.0ms (4% of total)

ival-cbrt: 15.0ms (1.7% of total)

ival-cos: 14.0ms (1.5% of total)

const: 13.0ms (1.4% of total)

ival-sin: 4.0ms (0.4% of total)

ival-log: 1.0ms (0.1% of total)

Herbie run

sample2.8min (47.8%)

simplify45.6s (13.1%)

soundness27.3s (7.9%)

localize25.4s (7.3%)

rewrite24.9s (7.2%)

prune16.0s (4.6%)

eval13.9s (4%)

explain6.9s (2%)

series6.6s (1.9%)

preprocess4.7s (1.3%)

analyze4.0s (1.1%)

regimes3.4s (1%)

bsearch2.2s (0.6%)

end0.0ms (0%)

Profiling