Metrics for Herbie run

Date:	Wednesday, January 31st, 2024
Commit:	c25f4985 on artem-tuning-128start-20-256-512-1024-2048
Hostname:	nightly with Racket 8.11.1
Seed:	2024031
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample8.8min (20.9%)

Results

5.9min	1815402×	0	valid
1.3min	340171×	0	infinite
20.6s	64654×	0	invalid
19.1s	43325×	1	valid
14.2s	14981×	2	valid
4.2s	5152×	5	exit
2.9s	5135×	3	valid
549.0ms	1405×	1	infinite
627.0ms	1103×	2	invalid
235.0ms	448×	1	invalid
174.0ms	246×	4	valid
48.0ms	137×	2	infinite
26.0ms	60×	3	infinite
4.0ms	2×	5	valid

Precisions

Click to see histograms. Total time spent on operations: 4.1min

Operation ival-add, time spent: 1.1min, 27.0% of total-time

Operation ival-sub, time spent: 1.1min, 27.0% of total-time

Operation ival-mult, time spent: 51.5s, 21.0% of total-time

Operation ival-div, time spent: 22.2s, 9.0% of total-time

Operation ival-sqrt, time spent: 10.7s, 4.0% of total-time

Operation ival-log, time spent: 8.6s, 4.0% of total-time

Operation const, time spent: 6.1s, 3.0% of total-time

Operation ival-cos, time spent: 4.3s, 2.0% of total-time

Operation ival-sin, time spent: 4.3s, 2.0% of total-time

Operation ival-exp, time spent: 1.3s, 1.0% of total-time

Operation ival-tan, time spent: 421.0ms, 0.0% of total-time

Operation ival-acos, time spent: 335.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 334.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 197.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 172.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 103.0ms, 0.0% of total-time

Bogosity

soundness7.2min (17.2%)

Rules

1080872×	`fma-def`
606522×	`associate-r`
539020×	`times-frac`
528436×	`log-prod`
505420×	`fma-neg`

Stop Event

87×	saturated
1455×	node limit
5×	unsound

Compiler

Compiled 98672 to 54483 computations (44.8% saved)

regimes4.9min (11.6%)

Counts

32537 → 5580

Calls

498 calls:

44.9s	x
43.4s	z
42.8s	y
31.9s	t
25.5s	a

Compiler

Compiled 44601 to 35188 computations (21.1% saved)

localize4.4min (10.4%)

Compiler: Compiled 109412 to 48022 computations (56.1% saved)
Precisions: Click to see histograms. Total time spent on operations: 2.8min
Operation ival-add, time spent: 39.3s, 23.0% of total-time
Operation ival-mult, time spent: 28.8s, 17.0% of total-time
Operation ival-sub, time spent: 25.3s, 15.0% of total-time
Operation ival-div, time spent: 18.1s, 11.0% of total-time
Operation ival-pow, time spent: 17.5s, 10.0% of total-time
Operation ival-sqrt, time spent: 9.6s, 6.0% of total-time
Operation ival-fma, time spent: 7.4s, 4.0% of total-time
Operation const, time spent: 4.7s, 3.0% of total-time
Operation ival-log, time spent: 4.4s, 3.0% of total-time
Operation ival-cos, time spent: 4.3s, 3.0% of total-time
Operation ival-sin, time spent: 2.7s, 2.0% of total-time
Operation ival-exp, time spent: 2.2s, 1.0% of total-time
Operation ival-cbrt, time spent: 1.4s, 1.0% of total-time
Operation ival-log1p, time spent: 1.1s, 1.0% of total-time
Operation ival-neg, time spent: 681.0ms, 0.0% of total-time
Operation ival-tan, time spent: 618.0ms, 0.0% of total-time
Operation ival-hypot, time spent: 345.0ms, 0.0% of total-time
Operation ival-acos, time spent: 122.0ms, 0.0% of total-time
Operation ival-expm1, time spent: 119.0ms, 0.0% of total-time
Operation ival-sinh, time spent: 38.0ms, 0.0% of total-time
Operation ival-cosh, time spent: 20.0ms, 0.0% of total-time
Operation ival-tanh, time spent: 14.0ms, 0.0% of total-time
Operation ival-fabs, time spent: 11.0ms, 0.0% of total-time
Operation ival-e, time spent: 6.0ms, 0.0% of total-time

simplify3.8min (8.9%)

Algorithm

1086×

egg-herbie

Rules

591390×	`fma-def`
467368×	`log-prod`
403754×	`associate-r`
371460×	`times-frac`
357184×	`associate-l`

Stop Event

268×	saturated
811×	node limit
141×	fuel
7×	unsound
128×	done

Counts

361117 → 269277

Compiler

Compiled 65117 to 38934 computations (40.2% saved)

eval3.0min (7.1%)

Compiler: Compiled 8243088 to 4457144 computations (45.9% saved)

rewrite2.8min (6.8%)

Algorithm

817×	batch-egg-rewrite

Rules

510989×	`log1p-expm1-u`
374248×	`expm1-log1p-u`
298826×	`prod-diff`
295996×	`expm1-udef`
275650×	`log1p-udef`

Stop Event

815×	node limit
2×	unsound

Counts

5561 → 213491

bsearch2.5min (5.9%)

Algorithm

3329×	binary-search
252×	left-value

Stop Event

53×	predicate-same
3276×	narrow-enough

Results

1.3min	305617×	0	valid
45.8s	90279×	0	infinite
1.2s	7373×	0	invalid
2.3s	3378×	2	valid
1.8s	3191×	1	valid
622.0ms	677×	3	valid
501.0ms	434×	5	exit
33.0ms	103×	1	invalid
25.0ms	74×	1	infinite
5.0ms	8×	4	valid
2.0ms	6×	2	infinite
1.0ms	2×	3	infinite

Compiler

Compiled 769871 to 575252 computations (25.3% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.3min

Operation ival-sub, time spent: 30.3s, 39.0% of total-time

Operation ival-mult, time spent: 21.7s, 28.0% of total-time

Operation ival-add, time spent: 17.3s, 22.0% of total-time

Operation ival-div, time spent: 3.2s, 4.0% of total-time

Operation ival-log, time spent: 2.0s, 3.0% of total-time

Operation const, time spent: 1.1s, 1.0% of total-time

Operation ival-sqrt, time spent: 1.0s, 1.0% of total-time

Operation ival-cos, time spent: 467.0ms, 1.0% of total-time

Operation ival-sin, time spent: 395.0ms, 1.0% of total-time

Operation ival-exp, time spent: 243.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 17.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 15.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 11.0ms, 0.0% of total-time

preprocess2.1min (5.1%)

Algorithm

269×	egg-herbie

Rules

366494×	`fma-def`
126628×	`fma-neg`
120808×	`sub-neg`
110422×	`unsub-neg`
108590×	`div-sub`

Stop Event

123×	saturated
146×	node limit

Compiler

Compiled 195153 to 96880 computations (50.4% saved)

Precisions

Click to see histograms. Total time spent on operations: 28.4s

Operation ival-add, time spent: 8.0s, 28.0% of total-time

Operation ival-sub, time spent: 7.4s, 26.0% of total-time

Operation ival-mult, time spent: 6.8s, 24.0% of total-time

Operation ival-div, time spent: 2.0s, 7.0% of total-time

Operation ival-sqrt, time spent: 1.3s, 4.0% of total-time

Operation ival-log, time spent: 1.1s, 4.0% of total-time

Operation const, time spent: 822.0ms, 3.0% of total-time

Operation ival-sin, time spent: 471.0ms, 2.0% of total-time

Operation ival-cos, time spent: 427.0ms, 2.0% of total-time

Operation ival-exp, time spent: 90.0ms, 0.0% of total-time

Operation ival-tan, time spent: 35.0ms, 0.0% of total-time

Operation ival-acos, time spent: 17.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 10.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 9.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 8.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 7.0ms, 0.0% of total-time

prune1.6min (3.9%)

Counts: 349328 → 12840
Compiler: Compiled 423314 to 289570 computations (31.6% saved)

series38.4s (1.5%)

Counts

5561 → 147626

Calls

38523 calls:

Time	Variable		Point	Expression
331.0ms	a	@	inf	(/.f64 (+.f64 x (.f64 (/.f64 y t) z)) (+.f64 a (+.f64 1 (.f64 (/.f64 y t) b))))
273.0ms	y	@	-inf	(log.f64 (log.f64 (/.f64 x y)))
267.0ms	y	@	0	(/.f64 (+.f64 (/.f64 x y) 1) (-.f64 (/.f64 1 x) -1))
239.0ms	x	@	0	(-.f64 (exp.f64 (log1p.f64 (*.f64 x 27061/100000))) 1)
207.0ms	z	@	-inf	(/.f64 (+.f64 x (/.f64 (*.f64 y z) t)) (+.f64 1 a))

analyze18.8s (0.7%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.2%	68.2%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.3%	23%	0.1%	0%	4.6%	0%	6
79.8%	75.6%	19.1%	0.1%	0%	5.1%	0%	7
81.7%	77%	17.2%	0.1%	0%	5.6%	0%	8
84.4%	79.3%	14.7%	0.1%	0%	5.9%	0%	9
86%	80.5%	13.1%	0.1%	0%	6.2%	0%	10
88.5%	82.9%	10.7%	0.1%	0%	6.2%	0%	11
89.6%	83.7%	9.7%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 9.6s

Operation ival-mult, time spent: 3.0s, 31.0% of total-time

Operation ival-sub, time spent: 1.6s, 17.0% of total-time

Operation ival-add, time spent: 1.6s, 17.0% of total-time

Operation ival-div, time spent: 1.5s, 16.0% of total-time

Operation ival-log, time spent: 651.0ms, 7.0% of total-time

Operation ival-sqrt, time spent: 372.0ms, 4.0% of total-time

Operation ival-sin, time spent: 243.0ms, 3.0% of total-time

Operation const, time spent: 191.0ms, 2.0% of total-time

Operation ival-exp, time spent: 158.0ms, 2.0% of total-time

Operation ival-cos, time spent: 99.0ms, 1.0% of total-time

Operation ival-tan, time spent: 84.0ms, 1.0% of total-time

Operation ival-acos, time spent: 41.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 18.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 9.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 4.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 2.0ms, 0.0% of total-time

Herbie run

sample8.8min (20.9%)

soundness7.2min (17.2%)

regimes4.9min (11.6%)

localize4.4min (10.4%)

simplify3.8min (8.9%)

eval3.0min (7.1%)

rewrite2.8min (6.8%)

bsearch2.5min (5.9%)

preprocess2.1min (5.1%)

prune1.6min (3.9%)

series38.4s (1.5%)

analyze18.8s (0.7%)

end113.0ms (0%)

Profiling