Metrics for Herbie run

Date:	Saturday, May 18th, 2024
Commit:	fffc84a6 on zane-better-job-hash
Hostname:	nightly with Racket 8.11.1
Seed:	2024139
Parameters:	256 points for 4 iterations
Flags:	`localize:costslocalize:errorsreduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

simplify7.7min (21%)

Algorithm

2119×

egg-herbie

Rules

742445×	`fma-define`
603416×	`fma-neg`
386912×	`times-frac`
367337×	`distribute-lft-in`
345335×	`associate-r`

Stop Event

753×	saturated
1358×	node limit
8×	unsound

Counts

527130 → 451347

sample6.5min (17.7%)

Results

4.2min	2145833×	0	valid
27.0s	65899×	1	valid
12.9s	64718×	0	invalid
3.6s	7997×	2	valid
2.4s	1623×	5	exit
834.0ms	1131×	3	valid
567.0ms	1763×	1	invalid
1.0ms	4×	4	valid

Precisions

Click to see histograms. Total time spent on operations: 3.0min

ival-mult: 1.1min (35.9% of total)

ival-sub: 25.7s (14.3% of total)

ival-add: 24.5s (13.7% of total)

ival-div: 22.2s (12.4% of total)

ival-log: 10.3s (5.7% of total)

...c/correct-round.rkt:121:19: 7.2s (4% of total)

ival-sqrt: 6.5s (3.6% of total)

ival-sin: 4.9s (2.7% of total)

ival-cos: 3.6s (2% of total)

backward-pass: 3.2s (1.8% of total)

const: 3.0s (1.6% of total)

ival-exp: 2.6s (1.4% of total)

ival-tan: 346.0ms (0.2% of total)

ival-sinh: 287.0ms (0.2% of total)

ival-acos: 246.0ms (0.1% of total)

ival-cosh: 212.0ms (0.1% of total)

ival-fabs: 192.0ms (0.1% of total)

ival-tanh: 116.0ms (0.1% of total)

Bogosity

soundness4.6min (12.6%)

Rules

280542×	`fma-define`
238384×	`fma-neg`
195795×	`log1p-expm1-u`
163540×	`times-frac`
155898×	`distribute-lft-in`

Stop Event

92×	saturated
823×	node limit
158×	fuel
6×	unsound
111×	done

Compiler

Compiled 157367 to 52550 computations (66.6% saved)

rewrite3.9min (10.8%)

Algorithm

911×	batch-egg-rewrite

Rules

617014×	`log1p-expm1-u`
461599×	`expm1-log1p-u`
184379×	`pow1`
177435×	`add-exp-log`
170183×	`add-log-exp`

Stop Event

1×	saturated
907×	node limit
3×	unsound

Counts

9173 → 306377

prune2.8min (7.6%)

Counts: 612251 → 14931
Compiler: Compiled 485402 to 290720 computations (40.1% saved)

localize2.5min (6.8%)

Results

1.3min	219418×	0	valid
12.7s	2854×	5	exit
11.5s	7976×	1	valid
4.4s	7696×	0	invalid
2.9s	1644×	2	valid
321.0ms	240×	3	valid
214.0ms	91×	1	invalid
190.0ms	405×	0	unsamplable
61.0ms	48×	1	unsamplable
13.0ms	12×	4	valid

Compiler

Compiled 117831 to 18913 computations (83.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 58.8s

ival-mult: 15.4s (26.1% of total)

ival-div: 9.1s (15.5% of total)

ival-add: 7.7s (13.1% of total)

ival-pow: 5.0s (8.5% of total)

ival-sub: 4.4s (7.4% of total)

ival-log: 2.6s (4.4% of total)

...c/correct-round.rkt:121:19: 2.5s (4.3% of total)

backward-pass: 2.3s (3.9% of total)

ival-expm1: 1.9s (3.2% of total)

ival-fma: 1.7s (2.9% of total)

ival-sin: 1.4s (2.4% of total)

ival-sqrt: 1.2s (2% of total)

ival-cos: 765.0ms (1.3% of total)

ival-neg: 722.0ms (1.2% of total)

ival-log1p: 602.0ms (1% of total)

const: 497.0ms (0.8% of total)

ival-exp: 459.0ms (0.8% of total)

ival-cbrt: 424.0ms (0.7% of total)

ival-hypot: 86.0ms (0.1% of total)

ival-tan: 60.0ms (0.1% of total)

ival-sinh: 53.0ms (0.1% of total)

ival-fabs: 32.0ms (0.1% of total)

ival-cosh: 20.0ms (0% of total)

ival-tanh: 14.0ms (0% of total)

ival-acos: 8.0ms (0% of total)

ival-e: 2.0ms (0% of total)

eval2.2min (6%)

Compiler: Compiled 12698802 to 2123820 computations (83.3% saved)

regimes1.6min (4.3%)

Counts

42798 → 5206

Calls

511 calls:

17.5s	x
13.2s	y
12.0s	z
8.6s	t
4.3s	a

Compiler

Compiled 50206 to 39514 computations (21.3% saved)

bsearch1.4min (3.9%)

Algorithm

2660×	binary-search
330×	left-value

Stop Event

42×	predicate-same
2618×	narrow-enough

Results

55.8s	321799×	0	valid
3.1s	8998×	1	valid
465.0ms	5996×	0	invalid
299.0ms	931×	2	valid
4.0ms	16×	3	valid

Compiler

Compiled 609707 to 446883 computations (26.7% saved)

Precisions

Click to see histograms. Total time spent on operations: 39.2s

ival-mult: 17.0s (43.3% of total)

ival-sub: 6.5s (16.7% of total)

ival-add: 5.6s (14.3% of total)

ival-div: 2.8s (7.1% of total)

...c/correct-round.rkt:121:19: 2.5s (6.3% of total)

ival-log: 1.6s (4.1% of total)

ival-cos: 716.0ms (1.8% of total)

ival-sin: 621.0ms (1.6% of total)

ival-sqrt: 556.0ms (1.4% of total)

ival-exp: 440.0ms (1.1% of total)

const: 430.0ms (1.1% of total)

backward-pass: 376.0ms (1% of total)

ival-fabs: 21.0ms (0.1% of total)

ival-cosh: 19.0ms (0% of total)

ival-tanh: 18.0ms (0% of total)

ival-sinh: 2.0ms (0% of total)

preprocess1.2min (3.3%)

Algorithm

269×	egg-herbie

Rules

137764×	`fma-neg`
117084×	`fma-define`
57352×	`unsub-neg`
50425×	`sub-neg`
47106×	`distribute-rgt-in`

Stop Event

153×	saturated
116×	node limit

Compiler

Compiled 151752 to 57828 computations (61.9% saved)

series1.2min (3.2%)

Counts

9173 → 220753

Calls

51942 calls:

Time	Variable		Point	Expression
493.0ms	x	@	0	(* x (log y))
432.0ms	x	@	inf	(pow (+ (* x z) (* y (+ x z))) 1/4)
348.0ms	z	@	inf	(* z 1/2)
344.0ms	y	@	0	(* (/ y (- 1 (* (pow (* x y) 2) 1/4))) (- 1 (* x (* y 1/2))))
343.0ms	x	@	0	(* 2 (* (cbrt x) (cbrt (sqrt x))))

explain38.2s (1.7%)

Results

19.8s	130498×	0	valid
3.1s	5974×	1	valid
855.0ms	1080×	2	valid
99.0ms	174×	3	valid
1.0ms	2×	5	exit

Compiler

Compiled 26361 to 7864 computations (70.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 11.6s

ival-mult: 3.6s (31.5% of total)

ival-sub: 1.8s (15.7% of total)

ival-add: 1.8s (15.1% of total)

ival-div: 1.2s (10.2% of total)

ival-log: 941.0ms (8.1% of total)

...c/correct-round.rkt:121:19: 522.0ms (4.5% of total)

backward-pass: 424.0ms (3.7% of total)

ival-cos: 403.0ms (3.5% of total)

ival-sqrt: 355.0ms (3.1% of total)

const: 196.0ms (1.7% of total)

ival-sin: 192.0ms (1.7% of total)

ival-exp: 90.0ms (0.8% of total)

ival-fabs: 16.0ms (0.1% of total)

ival-tan: 14.0ms (0.1% of total)

ival-cosh: 13.0ms (0.1% of total)

ival-sinh: 13.0ms (0.1% of total)

ival-tanh: 8.0ms (0.1% of total)

ival-acos: 6.0ms (0.1% of total)

analyze22.9s (1%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.2%	68.2%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.3%	23%	0.1%	0%	4.6%	0%	6
79.8%	75.6%	19.1%	0.1%	0%	5.1%	0%	7
81.7%	77%	17.3%	0.1%	0%	5.6%	0%	8
84.3%	79.3%	14.7%	0.1%	0%	5.9%	0%	9
85.9%	80.5%	13.2%	0.1%	0%	6.2%	0%	10
88.5%	82.8%	10.8%	0.1%	0%	6.2%	0%	11
89.6%	83.6%	9.8%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2711 computations (32.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 10.6s

ival-mult: 3.5s (32.8% of total)

ival-sub: 2.0s (19.1% of total)

ival-div: 1.7s (15.7% of total)

ival-add: 1.2s (11.5% of total)

...c/correct-round.rkt:121:19: 678.0ms (6.4% of total)

ival-sqrt: 518.0ms (4.9% of total)

ival-log: 414.0ms (3.9% of total)

ival-exp: 244.0ms (2.3% of total)

const: 146.0ms (1.4% of total)

ival-sin: 74.0ms (0.7% of total)

backward-pass: 42.0ms (0.4% of total)

ival-acos: 27.0ms (0.3% of total)

ival-cos: 26.0ms (0.2% of total)

ival-tan: 19.0ms (0.2% of total)

ival-cosh: 15.0ms (0.1% of total)

ival-tanh: 8.0ms (0.1% of total)

ival-sinh: 6.0ms (0.1% of total)

ival-fabs: 3.0ms (0% of total)

Herbie run

simplify7.7min (21%)

sample6.5min (17.7%)

soundness4.6min (12.6%)

rewrite3.9min (10.8%)

prune2.8min (7.6%)

localize2.5min (6.8%)

eval2.2min (6%)

regimes1.6min (4.3%)

bsearch1.4min (3.9%)

preprocess1.2min (3.3%)

series1.2min (3.2%)

explain38.2s (1.7%)

analyze22.9s (1%)

end1.0ms (0%)

Profiling