Metrics for Herbie run

Date:	Wednesday, January 31st, 2024
Commit:	fcee7d92 on artem-tuning-64start-20-128-512-1024-2048
Hostname:	nightly with Racket 8.11.1
Seed:	2024031
Parameters:	256 points for 4 iterations
Flags:	`reduce:regimesreduce:avg-errorreduce:binary-searchreduce:branch-expressionssetup:simplifysetup:searchrules:arithmeticrules:polynomialsrules:fractionsrules:exponentsrules:trigonometryrules:hyperbolicrules:numericsrules:specialrules:boolsrules:branchesgenerate:rrgenerate:taylorgenerate:simplifygenerate:proofs` default

sample8.9min (20.9%)

Results

6.0min	1809740×	0	valid
1.2min	339600×	0	infinite
21.2s	64474×	0	invalid
20.1s	42817×	1	valid
14.9s	16943×	2	valid
5.8s	8708×	3	valid
5.3s	5464×	5	exit
511.0ms	1150×	2	infinite
479.0ms	1077×	2	invalid
648.0ms	924×	1	infinite
702.0ms	851×	4	valid
141.0ms	458×	1	invalid
119.0ms	196×	3	invalid
61.0ms	129×	3	infinite
4.0ms	2×	5	valid

Precisions

Click to see histograms. Total time spent on operations: 4.2min

Operation ival-add, time spent: 1.1min, 27.0% of total-time

Operation ival-sub, time spent: 1.1min, 27.0% of total-time

Operation ival-mult, time spent: 55.3s, 22.0% of total-time

Operation ival-div, time spent: 21.1s, 8.0% of total-time

Operation ival-sqrt, time spent: 11.7s, 5.0% of total-time

Operation ival-log, time spent: 8.8s, 4.0% of total-time

Operation const, time spent: 6.2s, 2.0% of total-time

Operation ival-sin, time spent: 4.5s, 2.0% of total-time

Operation ival-cos, time spent: 3.9s, 2.0% of total-time

Operation ival-exp, time spent: 1.3s, 1.0% of total-time

Operation ival-tan, time spent: 436.0ms, 0.0% of total-time

Operation ival-acos, time spent: 378.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 273.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 233.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 224.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 188.0ms, 0.0% of total-time

Bogosity

soundness7.1min (16.7%)

Rules

1060938×	`fma-def`
604830×	`associate-r`
533680×	`times-frac`
531604×	`log-prod`
508870×	`fma-neg`

Stop Event

86×	saturated
1453×	node limit
5×	unsound

Results

Compiler

Compiled 98328 to 54475 computations (44.6% saved)

regimes5.0min (11.8%)

Counts

32410 → 5576

Calls

498 calls:

46.4s	x
45.1s	y
43.4s	z
31.7s	t
25.6s	a

Compiler

Compiled 44464 to 35092 computations (21.1% saved)

localize4.5min (10.6%)

Compiler: Compiled 108914 to 47661 computations (56.2% saved)
Precisions: Click to see histograms. Total time spent on operations: 3.0min
Operation ival-add, time spent: 43.0s, 24.0% of total-time
Operation ival-mult, time spent: 29.8s, 17.0% of total-time
Operation ival-sub, time spent: 26.7s, 15.0% of total-time
Operation ival-div, time spent: 17.9s, 10.0% of total-time
Operation ival-pow, time spent: 17.5s, 10.0% of total-time
Operation ival-sqrt, time spent: 11.1s, 6.0% of total-time
Operation ival-fma, time spent: 7.5s, 4.0% of total-time
Operation const, time spent: 5.0s, 3.0% of total-time
Operation ival-cos, time spent: 4.9s, 3.0% of total-time
Operation ival-sin, time spent: 3.4s, 2.0% of total-time
Operation ival-log, time spent: 3.2s, 2.0% of total-time
Operation ival-exp, time spent: 2.7s, 2.0% of total-time
Operation ival-cbrt, time spent: 1.5s, 1.0% of total-time
Operation ival-log1p, time spent: 920.0ms, 1.0% of total-time
Operation ival-tan, time spent: 770.0ms, 0.0% of total-time
Operation ival-neg, time spent: 682.0ms, 0.0% of total-time
Operation ival-hypot, time spent: 230.0ms, 0.0% of total-time
Operation ival-acos, time spent: 190.0ms, 0.0% of total-time
Operation ival-expm1, time spent: 114.0ms, 0.0% of total-time
Operation ival-sinh, time spent: 92.0ms, 0.0% of total-time
Operation ival-cosh, time spent: 14.0ms, 0.0% of total-time
Operation ival-tanh, time spent: 14.0ms, 0.0% of total-time
Operation ival-fabs, time spent: 13.0ms, 0.0% of total-time
Operation ival-e, time spent: 10.0ms, 0.0% of total-time

simplify3.8min (8.8%)

Algorithm

1086×

egg-herbie

Rules

591886×	`fma-def`
468928×	`log-prod`
403640×	`associate-r`
372364×	`times-frac`
357032×	`associate-l`

Stop Event

268×	saturated
811×	node limit
141×	fuel
7×	unsound
128×	done

Counts

361016 → 269674

Compiler

Compiled 64999 to 38856 computations (40.2% saved)

eval3.0min (7%)

Compiler: Compiled 8203586 to 4430118 computations (46% saved)

rewrite2.9min (6.8%)

Algorithm

817×	batch-egg-rewrite

Rules

513343×	`log1p-expm1-u`
375109×	`expm1-log1p-u`
299910×	`prod-diff`
294472×	`expm1-udef`
275774×	`log1p-udef`

Stop Event

815×	node limit
2×	unsound

Counts

5561 → 213304

bsearch2.6min (6%)

Algorithm

3333×	binary-search
250×	left-value

Stop Event

56×	predicate-same
3277×	narrow-enough

Results

1.3min	305395×	0	valid
48.7s	90201×	0	infinite
1.6s	7457×	0	invalid
1.4s	3548×	1	valid
3.0s	3544×	2	valid
1.3s	1557×	3	valid
579.0ms	407×	5	exit
27.0ms	90×	1	invalid
30.0ms	78×	1	infinite
33.0ms	45×	4	valid
14.0ms	40×	2	infinite
27.0ms	35×	2	invalid
4.0ms	8×	3	infinite

Compiler

Compiled 770709 to 576256 computations (25.2% saved)

Precisions

Click to see histograms. Total time spent on operations: 1.3min

Operation ival-sub, time spent: 29.7s, 37.0% of total-time

Operation ival-mult, time spent: 25.4s, 31.0% of total-time

Operation ival-add, time spent: 17.5s, 22.0% of total-time

Operation ival-div, time spent: 3.5s, 4.0% of total-time

Operation ival-sqrt, time spent: 1.4s, 2.0% of total-time

Operation ival-log, time spent: 1.3s, 2.0% of total-time

Operation const, time spent: 1.1s, 1.0% of total-time

Operation ival-sin, time spent: 408.0ms, 1.0% of total-time

Operation ival-cos, time spent: 303.0ms, 0.0% of total-time

Operation ival-exp, time spent: 240.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 13.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 12.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 11.0ms, 0.0% of total-time

preprocess2.2min (5.2%)

Algorithm

269×	egg-herbie

Rules

366494×	`fma-def`
126628×	`fma-neg`
120808×	`sub-neg`
110422×	`unsub-neg`
108590×	`div-sub`

Stop Event

123×	saturated
146×	node limit

Compiler

Compiled 180149 to 93908 computations (47.9% saved)

Precisions

Click to see histograms. Total time spent on operations: 30.4s

Operation ival-add, time spent: 9.8s, 32.0% of total-time

Operation ival-sub, time spent: 7.7s, 25.0% of total-time

Operation ival-mult, time spent: 6.5s, 22.0% of total-time

Operation ival-div, time spent: 2.1s, 7.0% of total-time

Operation ival-sqrt, time spent: 1.6s, 5.0% of total-time

Operation ival-log, time spent: 885.0ms, 3.0% of total-time

Operation const, time spent: 865.0ms, 3.0% of total-time

Operation ival-cos, time spent: 418.0ms, 1.0% of total-time

Operation ival-sin, time spent: 343.0ms, 1.0% of total-time

Operation ival-exp, time spent: 98.0ms, 0.0% of total-time

Operation ival-tan, time spent: 37.0ms, 0.0% of total-time

Operation ival-acos, time spent: 15.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 11.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 10.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 10.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 7.0ms, 0.0% of total-time

prune1.6min (3.9%)

Counts: 346956 → 12831
Compiler: Compiled 422396 to 288902 computations (31.6% saved)

series40.1s (1.6%)

Counts

5561 → 147712

Calls

38571 calls:

Time	Variable		Point	Expression
365.0ms	z	@	0	(/.f64 (-.f64 y z) t)
322.0ms	x	@	inf	(+.f64 x (/.f64 y (+.f64 3350343815022304/279195317918525 (*.f64 z 155900051080628738716045985239/389750127738131234692690878125))))
314.0ms	z	@	0	(pow.f64 (*.f64 x z) 1/4)
264.0ms	x	@	0	(*.f64 x (log.f64 y))
234.0ms	t	@	0	(+.f64 (.f64 y (-.f64 (log.f64 z) t)) (.f64 a (-.f64 (log.f64 (-.f64 1 z)) b)))

analyze18.0s (0.7%)

Algorithm

269×

Search

Probability	Valid	Unknown	Precondition	Infinite	Domain	Can't	Iter
0%	0%	99.9%	0.1%	0%	0%	0%	0
46.5%	46.4%	53.4%	0.1%	0%	0%	0%	1
50.1%	49.7%	49.5%	0.1%	0%	0.6%	0%	2
58.6%	57%	40.3%	0.1%	0%	2.6%	0%	3
65.2%	62.7%	33.5%	0.1%	0%	3.6%	0%	4
71.2%	68.2%	27.5%	0.1%	0%	4.1%	0%	5
75.9%	72.3%	23%	0.1%	0%	4.6%	0%	6
79.8%	75.6%	19.1%	0.1%	0%	5.1%	0%	7
81.7%	77%	17.2%	0.1%	0%	5.6%	0%	8
84.4%	79.3%	14.7%	0.1%	0%	5.9%	0%	9
86%	80.5%	13.1%	0.1%	0%	6.2%	0%	10
88.5%	82.9%	10.7%	0.1%	0%	6.2%	0%	11
89.6%	83.7%	9.7%	0.1%	0%	6.5%	0%	12

Compiler

Compiled 4012 to 2763 computations (31.1% saved)

Precisions

Click to see histograms. Total time spent on operations: 9.0s

Operation ival-mult, time spent: 3.1s, 34.0% of total-time

Operation ival-add, time spent: 1.6s, 18.0% of total-time

Operation ival-sub, time spent: 1.6s, 18.0% of total-time

Operation ival-div, time spent: 1.2s, 13.0% of total-time

Operation ival-sqrt, time spent: 485.0ms, 5.0% of total-time

Operation ival-log, time spent: 441.0ms, 5.0% of total-time

Operation const, time spent: 196.0ms, 2.0% of total-time

Operation ival-exp, time spent: 114.0ms, 1.0% of total-time

Operation ival-cos, time spent: 93.0ms, 1.0% of total-time

Operation ival-sin, time spent: 83.0ms, 1.0% of total-time

Operation ival-acos, time spent: 42.0ms, 0.0% of total-time

Operation ival-tan, time spent: 38.0ms, 0.0% of total-time

Operation ival-cosh, time spent: 12.0ms, 0.0% of total-time

Operation ival-tanh, time spent: 8.0ms, 0.0% of total-time

Operation ival-sinh, time spent: 6.0ms, 0.0% of total-time

Operation ival-fabs, time spent: 5.0ms, 0.0% of total-time

Herbie run

sample8.9min (20.9%)

soundness7.1min (16.7%)

regimes5.0min (11.8%)

localize4.5min (10.6%)

simplify3.8min (8.8%)

eval3.0min (7%)

rewrite2.9min (6.8%)

bsearch2.6min (6%)

preprocess2.2min (5.2%)

prune1.6min (3.9%)

series40.1s (1.6%)

analyze18.0s (0.7%)

end91.0ms (0%)

Profiling