Metrics for Herbie run

Date:	Friday, May 24th, 2024
Commit:	7841f259 on main
Hostname:	nightly with Racket 8.11.1
Seed:	2024145
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

simplify7.6min (20.9%)

Algorithm

2110×

egg-herbie

Rules

716171×	`fma-define`
611821×	`fma-neg`
376319×	`times-frac`
361436×	`distribute-lft-in`
330277×	`associate-r`

Stop Event

784×	saturated
1319×	node limit
7×	unsound

Counts

516045 → 444375

sample6.6min (18.3%)

Results

4.2min	2145779×	0	valid
27.5s	65845×	1	valid
12.8s	63928×	0	invalid
3.0s	8127×	2	valid
2.2s	1510×	5	exit
641.0ms	1109×	3	valid
467.0ms	1800×	1	invalid
1.0ms	4×	4	valid

Precisions

Click to see histograms. Total time spent on operations: 3.0min

ival-mult: 1.1min (36% of total)

ival-sub: 23.9s (13.2% of total)

ival-add: 23.9s (13.2% of total)

ival-div: 21.9s (12.2% of total)

ival-log: 11.0s (6.1% of total)

...c/correct-round.rkt:121:19: 8.1s (4.5% of total)

ival-sqrt: 6.8s (3.8% of total)

ival-sin: 4.8s (2.6% of total)

ival-cos: 4.5s (2.5% of total)

backward-pass: 3.1s (1.7% of total)

const: 2.8s (1.6% of total)

ival-exp: 2.4s (1.3% of total)

ival-cosh: 512.0ms (0.3% of total)

ival-fabs: 481.0ms (0.3% of total)

ival-acos: 467.0ms (0.3% of total)

ival-tan: 370.0ms (0.2% of total)

ival-tanh: 194.0ms (0.1% of total)

ival-sinh: 191.0ms (0.1% of total)

Bogosity

soundness4.5min (12.3%)

Rules

263169×	`fma-define`
237211×	`fma-neg`
180668×	`log1p-expm1-u`
154720×	`associate-r`
152546×	`times-frac`

Stop Event

87×	saturated
788×	node limit
152×	fuel
6×	unsound
117×	done

Compiler

Compiled 145237 to 49660 computations (65.8% saved)

rewrite3.9min (10.6%)

Algorithm

907×	batch-egg-rewrite

Rules

619711×	`log1p-expm1-u`
457346×	`expm1-log1p-u`
181237×	`pow1`
172633×	`add-exp-log`
164328×	`add-log-exp`

Stop Event

1×	saturated
904×	node limit
2×	unsound

Counts

8923 → 302128

prune2.9min (7.9%)

Counts: 599287 → 14213
Compiler: Compiled 454749 to 273563 computations (39.8% saved)

localize2.4min (6.7%)

Results

1.3min	219825×	0	valid
11.0s	8046×	1	valid
8.6s	2073×	5	exit
3.9s	7139×	0	invalid
1.9s	1182×	2	valid
271.0ms	165×	3	valid
245.0ms	150×	1	invalid
143.0ms	459×	0	unsamplable
43.0ms	15×	3	unsamplable
31.0ms	28×	1	unsamplable
29.0ms	15×	2	unsamplable
10.0ms	7×	4	valid

Compiler

Compiled 114021 to 18496 computations (83.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 51.7s

ival-mult: 15.7s (30.5% of total)

ival-div: 6.6s (12.8% of total)

ival-pow: 4.7s (9.2% of total)

ival-add: 4.5s (8.7% of total)

ival-sub: 4.1s (7.9% of total)

...c/correct-round.rkt:121:19: 2.7s (5.2% of total)

backward-pass: 2.5s (4.9% of total)

ival-log: 2.1s (4% of total)

ival-expm1: 2.0s (3.8% of total)

ival-fma: 2.0s (3.8% of total)

ival-sqrt: 1.3s (2.5% of total)

ival-cos: 628.0ms (1.2% of total)

ival-sin: 590.0ms (1.1% of total)

ival-neg: 514.0ms (1% of total)

const: 465.0ms (0.9% of total)

ival-cbrt: 409.0ms (0.8% of total)

ival-exp: 336.0ms (0.7% of total)

ival-log1p: 303.0ms (0.6% of total)

ival-tan: 113.0ms (0.2% of total)

ival-hypot: 83.0ms (0.2% of total)

ival-fabs: 24.0ms (0% of total)

ival-cosh: 23.0ms (0% of total)

ival-sinh: 15.0ms (0% of total)

ival-acos: 13.0ms (0% of total)

ival-tanh: 11.0ms (0% of total)

ival-e: 2.0ms (0% of total)

eval2.2min (6.1%)

Compiler: Compiled 12415320 to 2075219 computations (83.3% saved)

regimes1.4min (3.9%)

Counts

38206 → 5039

Calls

511 calls:

14.8s	x
13.6s	y
11.6s	z
6.8s	t
4.3s	a

Compiler

Compiled 48168 to 38067 computations (21% saved)

bsearch1.4min (3.8%)

Algorithm

2596×	binary-search
293×	left-value

Stop Event

41×	predicate-same
2555×	narrow-enough

Results

54.5s	323857×	0	valid
3.3s	8013×	1	valid
1.0s	8473×	0	invalid
188.0ms	715×	2	valid
7.0ms	23×	3	valid

Compiler

Compiled 584484 to 433625 computations (25.8% saved)

Precisions

Click to see histograms. Total time spent on operations: 37.2s

ival-mult: 15.7s (42% of total)

ival-sub: 7.0s (18.9% of total)

ival-add: 4.9s (13.1% of total)

ival-div: 3.5s (9.5% of total)

...c/correct-round.rkt:121:19: 1.7s (4.5% of total)

ival-log: 1.1s (2.9% of total)

ival-sin: 784.0ms (2.1% of total)

backward-pass: 683.0ms (1.8% of total)

ival-cos: 608.0ms (1.6% of total)

ival-sqrt: 604.0ms (1.6% of total)

const: 409.0ms (1.1% of total)

ival-exp: 239.0ms (0.6% of total)

ival-fabs: 18.0ms (0% of total)

ival-tanh: 9.0ms (0% of total)

ival-sinh: 4.0ms (0% of total)

ival-cosh: 3.0ms (0% of total)

series1.2min (3.3%)

Counts

8923 → 213917

Calls

50487 calls:

Time	Variable		Point	Expression
521.0ms	y	@	inf	(* x (+ (log (pow (cbrt y) 2)) (log (cbrt y))))
452.0ms	x	@	inf	(log (log (/ x y)))
400.0ms	y	@	-inf	(* x (+ (log (pow (cbrt y) 2)) (log (cbrt y))))
394.0ms	z	@	inf	(/ (* (- (* y (- 1 z)) (* z t)) x) (* z (- 1 z)))
389.0ms	x	@	-inf	(log (* x 2/3))

preprocess1.2min (3.2%)

Algorithm

269×	egg-herbie

Rules

137764×	`fma-neg`
117084×	`fma-define`
57352×	`unsub-neg`
50425×	`sub-neg`
47106×	`distribute-rgt-in`

Stop Event

153×	saturated
116×	node limit

Compiler

Compiled 143834 to 56840 computations (60.5% saved)

explain38.0s (1.7%)

Results

18.1s	130596×	0	valid
3.6s	5960×	1	valid
985.0ms	1002×	2	valid
379.0ms	168×	3	valid
1.0ms	2×	4	valid

Compiler

Compiled 26361 to 7864 computations (70.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 10.7s

ival-mult: 3.3s (30.7% of total)

ival-sub: 1.6s (14.8% of total)

ival-div: 1.4s (13.5% of total)

ival-log: 1.4s (13.2% of total)

ival-add: 1.2s (11.4% of total)

...c/correct-round.rkt:121:19: 413.0ms (3.9% of total)

backward-pass: 279.0ms (2.6% of total)

ival-sqrt: 258.0ms (2.4% of total)

ival-sin: 222.0ms (2.1% of total)

const: 187.0ms (1.7% of total)

ival-cos: 175.0ms (1.6% of total)

ival-exp: 87.0ms (0.8% of total)

ival-cosh: 56.0ms (0.5% of total)

ival-acos: 42.0ms (0.4% of total)

ival-fabs: 15.0ms (0.1% of total)

ival-tan: 13.0ms (0.1% of total)

ival-sinh: 8.0ms (0.1% of total)

ival-tanh: 7.0ms (0.1% of total)

analyze26.1s (1.2%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.2%	68.2%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.3%	23%	0.1%	0%	4.6%	0%	6
79.8%	75.6%	19.1%	0.1%	0%	5.1%	0%	7
81.7%	77%	17.3%	0.1%	0%	5.6%	0%	8
84.3%	79.3%	14.7%	0.1%	0%	5.9%	0%	9
85.9%	80.5%	13.2%	0.1%	0%	6.2%	0%	10
88.5%	82.8%	10.8%	0.1%	0%	6.2%	0%	11
89.6%	83.6%	9.8%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2711 computations (32.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 11.0s

ival-mult: 3.9s (35.8% of total)

ival-sub: 1.8s (16.8% of total)

ival-add: 1.8s (16.7% of total)

ival-div: 1.3s (11.6% of total)

...c/correct-round.rkt:121:19: 724.0ms (6.6% of total)

ival-sqrt: 505.0ms (4.6% of total)

ival-exp: 234.0ms (2.1% of total)

ival-log: 227.0ms (2.1% of total)

const: 138.0ms (1.3% of total)

ival-sin: 114.0ms (1% of total)

backward-pass: 39.0ms (0.4% of total)

ival-cos: 29.0ms (0.3% of total)

ival-cosh: 25.0ms (0.2% of total)

ival-tan: 22.0ms (0.2% of total)

ival-acos: 20.0ms (0.2% of total)

ival-tanh: 7.0ms (0.1% of total)

ival-sinh: 4.0ms (0% of total)

ival-fabs: 3.0ms (0% of total)

Herbie run

simplify7.6min (20.9%)

sample6.6min (18.3%)

soundness4.5min (12.3%)

rewrite3.9min (10.6%)

prune2.9min (7.9%)

localize2.4min (6.7%)

eval2.2min (6.1%)

regimes1.4min (3.9%)

bsearch1.4min (3.8%)

series1.2min (3.3%)

preprocess1.2min (3.2%)

explain38.0s (1.7%)

analyze26.1s (1.2%)

end1.0ms (0%)

Profiling