Profiling results ----------------- Total cpu time observed: 47840ms (out of 49916ms) Number of samples taken: 204 (once every 235ms) (Hiding functions with self<1.0% and local<2.0%: 1 of 101 hidden) ======================================================================= Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ======================================================================= ??? [32] 100.0% [1] 45574(95.3%) 0(0.0%) profile-thunk14 ...t/pkgs/profile-lib/main.rkt:9:0 run [9] 100.0% ----------------------------------------------------------------------- ??? [32] 100.0% [2] 7370(15.4%) 0(0.0%) run-improve58 ...ock/herbie/src/mainloop.rkt:242:0 for-loop [10] 72.5% loop [37] 16.4% get-final-combination [12] 11.2% ----------------------------------------------------------------------- loop [70] 20.6% ??? [32] 79.4% [3] 3998(8.4%) 0(0.0%) simplify ...lock/herbie/src/core/simplify.rkt:39:0 iterate-egraph!5 [18] 69.4% simplify-expr [11] 25.1% for-loop [16] 5.5% ----------------------------------------------------------------------- hash-ref! [73] 100.0% [4] 1980(4.1%) 0(0.0%) ??? /home/ztatlock/herbie/src/programs.rkt:197:5 loop [70] 100.0% ----------------------------------------------------------------------- hash-ref! [73] 100.0% [5] 664(1.4%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:285:26 for-loop [13] 100.0% ----------------------------------------------------------------------- hash-ref! [73] 100.0% [6] 424(0.9%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:295:23 for-loop [14] 100.0% ----------------------------------------------------------------------- hash-ref! [73] 100.0% [7] 222(0.5%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:392:23 for-loop [15] 100.0% ----------------------------------------------------------------------- loop [70] 100.0% [8] 220(0.5%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [73] 50.0% map [67] 50.0% ----------------------------------------------------------------------- profile-thunk14 [1] 97.9% [9] 46540(97.3%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:31:2 ??? [32] 100.0% ----------------------------------------------------------------------- run-improve58 [2] 100.0% [10] 5340(11.2%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:253:8 run-iter! [17] 100.0% ----------------------------------------------------------------------- simplify [3] 100.0% [11] 1004(2.1%) 0(0.0%) simplify-expr ...herbie/src/core/simplify.rkt:68:0 iterate-egraph!5 [18] 100.0% ----------------------------------------------------------------------- run-improve58 [2] 100.0% [12] 824(1.7%) 0(0.0%) get-final-combination ...ie/src/mainloop.rkt:269:0 extract-alt [19] 100.0% ----------------------------------------------------------------------- ??? [5] 100.0% [13] 664(1.4%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:285:52 hash-ref! [73] 69.9% ??? [21] 30.1% ----------------------------------------------------------------------- ??? [6] 100.0% [14] 424(0.9%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:298:27 hash-ref! [73] 100.0% ----------------------------------------------------------------------- ??? [7] 100.0% [15] 222(0.5%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:396:33 for-loop [20] 100.0% ----------------------------------------------------------------------- simplify [3] 100.0% [16] 220(0.5%) 0(0.0%) for-loop ...ock/herbie/src/core/simplify.rkt:61:12 iterate-egraph!5 [18] 100.0% ----------------------------------------------------------------------- for-loop [10] 100.0% [17] 5340(11.2%) 0(0.0%) run-iter! ...tatlock/herbie/src/mainloop.rkt:223:0 simplify! [23] 59.4% gen-series! [24] 24.1% finalize-iter! [25] 12.4% localize-error [26] 4.1% ----------------------------------------------------------------------- for-loop [16] 5.5% simplify-expr [11] 25.1% simplify [3] 69.4% [18] 3998(8.4%) 0(0.0%) iterate-egraph!5 ...bie/src/core/simplify.rkt:95:0 one-iter [22] 100.0% ----------------------------------------------------------------------- get-final-combination [12] 100.0% [19] 824(1.7%) 0(0.0%) extract-alt ...e/ztatlock/herbie/src/glue.rkt:57:0 loop [70] 100.0% ----------------------------------------------------------------------- for-loop [15] 100.0% [20] 222(0.5%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:398:39 hash-ref! [73] 100.0% ----------------------------------------------------------------------- for-loop [13] 100.0% [21] 200(0.4%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:288:19 hash-ref! [73] 100.0% ----------------------------------------------------------------------- iterate-egraph!5 [18] 100.0% [22] 3998(8.4%) 0(0.0%) one-iter ...ock/herbie/src/core/simplify.rkt:106:0 for-loop [27] 84.5% loop [31] 15.5% ----------------------------------------------------------------------- run-iter! [17] 100.0% [23] 3174(6.6%) 0(0.0%) simplify! ...tatlock/herbie/src/mainloop.rkt:162:0 for-loop [28] 100.0% ----------------------------------------------------------------------- run-iter! [17] 100.0% [24] 1286(2.7%) 0(0.0%) gen-series! ...tlock/herbie/src/mainloop.rkt:134:0 for-loop [29] 100.0% ----------------------------------------------------------------------- run-iter! [17] 100.0% [25] 660(1.4%) 0(0.0%) finalize-iter! ...ck/herbie/src/mainloop.rkt:177:0 ??? [30] 100.0% ----------------------------------------------------------------------- run-iter! [17] 100.0% [26] 220(0.5%) 0(0.0%) localize-error ...erbie/src/core/localize.rkt:47:0 hash-ref! [73] 100.0% ----------------------------------------------------------------------- for-loop [27] 50.0% one-iter [22] 50.0% [27] 3378(7.1%) 402(0.8%) for-loop ...ck/herbie/src/core/simplify.rkt:116:12 for-loop [27] 50.0% match-e [33] 44.0% ----------------------------------------------------------------------- simplify! [23] 100.0% [28] 3174(6.6%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:166:6 ??? [32] 100.0% ----------------------------------------------------------------------- gen-series! [24] 100.0% [29] 1286(2.7%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:140:7 taylor-alt [34] 100.0% ----------------------------------------------------------------------- finalize-iter! [25] 100.0% [30] 660(1.4%) 0(0.0%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [35] 100.0% ----------------------------------------------------------------------- one-iter [22] 100.0% [31] 620(1.3%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:53:19 apply-match [36] 100.0% ----------------------------------------------------------------------- for-loop [28] 2.3% run [9] 49.5% [32] 46980(98.2%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk14 [1] 47.5% loop [37] 42.6% run-improve58 [2] 7.6% simplify [3] 2.3% ----------------------------------------------------------------------- for-loop [45] 11.9% for-loop [27] 88.1% [33] 2976(6.2%) 1250(2.6%) match-e ...tatlock/herbie/src/core/ematch.rkt:46:0 for-loop [38] 38.2% for-loop [45] 10.2% loop [70] 6.8% constant? [41] 6.3% ----------------------------------------------------------------------- for-loop [29] 100.0% [34] 1286(2.7%) 0(0.0%) taylor-alt ...e/ztatlock/herbie/src/glue.rkt:142:0 for-loop [39] 100.0% ----------------------------------------------------------------------- ??? [30] 100.0% [35] 660(1.4%) 0(0.0%) for-loop ...ock/herbie/src/core/alt-table.rkt:51:2 atab-add-altn [40] 100.0% ----------------------------------------------------------------------- loop [31] 100.0% [36] 620(1.3%) 200(0.4%) apply-match .../herbie/src/core/simplify.rkt:122:2 merge-egraph-nodes! [42] 67.7% ----------------------------------------------------------------------- run-improve58 [2] 3.0% ??? [32] 97.0% [37] 40816(85.3%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:122:2 loop [43] 50.1% make-exacts* [50] 34.9% loop [51] 15.0% ----------------------------------------------------------------------- match-e [33] 100.0% [38] 1322(2.8%) 240(0.5%) for-loop ...tlock/herbie/src/core/ematch.rkt:59:11 for-loop [45] 48.4% list-cartesian-product [46] 33.4% ----------------------------------------------------------------------- taylor-alt [34] 100.0% [39] 1286(2.7%) 0(0.0%) for-loop /home/ztatlock/herbie/src/glue.rkt:144:2 location-do [44] 100.0% ----------------------------------------------------------------------- for-loop [35] 100.0% [40] 660(1.4%) 0(0.0%) atab-add-altn ...rbie/src/core/alt-table.rkt:208:0 best-and-tied-at-points [47] 66.7% override-at-pnts [49] 33.3% ----------------------------------------------------------------------- match-e [33] 100.0% [41] 440(0.9%) 440(0.9%) constant? ...ck/herbie/src/syntax/syntax.rkt:221:0 ----------------------------------------------------------------------- apply-match [36] 100.0% [42] 420(0.9%) 200(0.4%) merge-egraph-nodes! ...e/src/core/egraph.rkt:152:0 loop! [48] 52.4% ----------------------------------------------------------------------- loop [37] 100.0% [43] 20430(42.7%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:93:2 loop [51] 47.7% make-exacts* [50] 45.5% eval-prog [56] 6.8% ----------------------------------------------------------------------- for-loop [39] 47.3% location-do [44] 52.7% [44] 1286(2.7%) 0(0.0%) location-do ...tlock/herbie/src/programs.rkt:129:0 location-do [44] 52.7% approximate9 [52] 47.3% ----------------------------------------------------------------------- match-e [33] 38.7% for-loop [38] 61.3% [45] 1044(2.2%) 202(0.4%) for-loop ...tlock/herbie/src/core/ematch.rkt:65:37 match-e [33] 61.5% ??? [55] 19.2% ----------------------------------------------------------------------- list-cartesian-product [46] 50.0% for-loop [38] 50.0% [46] 442(0.9%) 442(0.9%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [46] 50.0% ----------------------------------------------------------------------- atab-add-altn [40] 100.0% [47] 440(0.9%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 errors [53] 100.0% ----------------------------------------------------------------------- merge-egraph-nodes! [42] 100.0% [48] 220(0.5%) 0(0.0%) loop! .../ztatlock/herbie/src/core/enode.rkt:163:2 custom-set-union [54] 100.0% ----------------------------------------------------------------------- atab-add-altn [40] 100.0% [49] 220(0.5%) 0(0.0%) override-at-pnts ...e/src/core/alt-table.rkt:145:0 errors [53] 100.0% ----------------------------------------------------------------------- loop [43] 39.5% loop [37] 60.5% [50] 23552(49.2%) 0(0.0%) make-exacts* ...tatlock/herbie/src/points.rkt:80:0 map [67] 51.4% loop [70] 45.1% eval-prog [56] 3.5% ----------------------------------------------------------------------- loop [37] 38.6% loop [43] 61.4% [51] 15880(33.2%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:83:4 map [67] 100.0% ----------------------------------------------------------------------- location-do [44] 100.0% [52] 1286(2.7%) 0(0.0%) approximate9 ...ck/herbie/src/core/taylor.rkt:11:0 loop [57] 67.3% f37 [65] 17.1% taylor-exp [61] 15.6% ----------------------------------------------------------------------- override-at-pnts [49] 33.3% best-and-tied-at-points [47] 66.7% [53] 660(1.4%) 0(0.0%) errors /home/ztatlock/herbie/src/points.rkt:144:0 eval-prog [56] 66.7% for-loop [59] 33.3% ----------------------------------------------------------------------- loop! [48] 100.0% [54] 220(0.5%) 0(0.0%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [58] 100.0% ----------------------------------------------------------------------- for-loop [45] 100.0% [55] 200(0.4%) 0(0.0%) ??? /home/ztatlock/herbie/src/core/ematch.rkt:50:5 for-loop [60] 100.0% ----------------------------------------------------------------------- errors [53] 16.7% make-exacts* [50] 30.9% loop [43] 52.5% [56] 2638(5.5%) 440(0.9%) eval-prog ...tatlock/herbie/src/programs.rkt:162:0 hash-ref! [73] 75.1% go [64] 8.3% ----------------------------------------------------------------------- approximate9 [52] 100.0% [57] 866(1.8%) 0(0.0%) loop ...e/ztatlock/herbie/src/core/taylor.rkt:82:4 hash-ref! [73] 100.0% ----------------------------------------------------------------------- custom-set-union [54] 100.0% [58] 220(0.5%) 0(0.0%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [63] 100.0% ----------------------------------------------------------------------- errors [53] 100.0% [59] 220(0.5%) 0(0.0%) for-loop ...e/ztatlock/herbie/src/points.rkt:147:4 ??? [72] 100.0% ----------------------------------------------------------------------- ??? [55] 100.0% [60] 200(0.4%) 200(0.4%) for-loop ...atlock/herbie/src/core/ematch.rkt:51:7 ----------------------------------------------------------------------- approximate9 [52] 100.0% [61] 200(0.4%) 0(0.0%) taylor-exp ...ock/herbie/src/core/taylor.rkt:386:0 simplify [62] 100.0% ----------------------------------------------------------------------- taylor-exp [61] 18.8% hash-ref! [73] 81.2% [62] 1066(2.2%) 0(0.0%) simplify ...atlock/herbie/src/core/reduce.rkt:18:0 f37 [65] 56.5% parse-loop12 [79] 43.5% ----------------------------------------------------------------------- for-loop [58] 100.0% [63] 220(0.5%) 220(0.5%) for-loop ...cts/racket/private/set-types.rkt:178:5 ----------------------------------------------------------------------- eval-prog [56] 100.0% [64] 218(0.5%) 0(0.0%) go .../collects/racket/private/qq-and-or.rkt:50:20 loop [66] 100.0% ----------------------------------------------------------------------- parse-loop12 [79] 12.2% hash-ref! [73] 12.3% f37 [65] 13.4% approximate9 [52] 13.4% simplify [62] 48.8% [65] 822(1.7%) 200(0.4%) f37 ...t/collects/racket/match/compiler.rkt:499:40 map [67] 36.6% f37 [65] 13.4% taylor [68] 13.4% loop [69] 12.3% ----------------------------------------------------------------------- go [64] 100.0% [66] 218(0.5%) 218(0.5%) loop ...llects/racket/private/qq-and-or.rkt:101:61 ----------------------------------------------------------------------- ??? [8] 0.8% f37 [65] 1.4% make-exacts* [50] 42.3% loop [51] 55.5% [67] 28612(59.8%) 220(0.5%) map ...acket/collects/racket/private/map.rkt:21:13 loop [70] 95.7% ->flonum [74] 1.5% parse-loop12 [79] 1.4% ??? [72] 0.7% ----------------------------------------------------------------------- f37 [65] 100.0% [68] 220(0.5%) 0(0.0%) taylor ...tatlock/herbie/src/core/taylor.rkt:157:0 debug-print [71] 100.0% ----------------------------------------------------------------------- f37 [65] 100.0% [69] 202(0.4%) 0(0.0%) loop .../ztatlock/herbie/src/core/taylor.rkt:262:2 hash-ref! [73] 100.0% ----------------------------------------------------------------------- parse-loop12 [79] 0.0% make-exacts* [50] 0.2% match-e [33] 0.2% extract-alt [19] 1.2% map [67] 2.5% ??? [4] 4.7% loop [70] 91.2% [70] 42090(88.0%) 202(0.4%) loop ...cket/collects/racket/private/map.rkt:26:19 loop [70] 91.2% hash-ref! [73] 4.7% ??? [72] 2.7% simplify [3] 1.2% ??? [8] 0.0% ->flonum [74] 0.0% ----------------------------------------------------------------------- taylor [68] 100.0% [71] 220(0.5%) 0(0.0%) debug-print ...ztatlock/herbie/src/debug.rkt:107:0 for-loop [75] 100.0% ----------------------------------------------------------------------- map [67] 0.5% for-loop [59] 0.6% loop [70] 98.9% [72] 38826(81.2%) 1682(3.5%) ??? /home/ztatlock/herbie/src/programs.rkt:168:4 ??? [76] 78.9% real->bigfloat [77] 13.6% ??? [93] 2.4% ----------------------------------------------------------------------- for-loop [20] 1.2% ??? [21] 1.6% loop [69] 1.6% for-loop [14] 2.9% ??? [8] 3.6% localize-error [26] 3.6% for-loop [13] 3.8% ??? [81] 4.5% ??? [80] 5.5% loop [57] 7.1% eval-prog [56] 16.4% loop [70] 48.2% [73] 3066(6.4%) 0(0.0%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [4] 48.2% bigfloat-hash [78] 16.4% parse-loop12 [79] 7.2% simplify [62] 7.1% ??? [80] 5.5% ??? [5] 5.5% ??? [81] 4.5% ??? [6] 2.9% f37 [65] 1.6% ??? [7] 1.2% ----------------------------------------------------------------------- map [67] 47.9% loop [70] 52.1% [74] 872(1.8%) 216(0.5%) ->flonum ...ock/herbie/src/syntax/syntax.rkt:224:0 ??? [82] 27.3% ??? [95] 25.2% ??? [83] 22.7% ----------------------------------------------------------------------- debug-print [71] 100.0% [75] 220(0.5%) 220(0.5%) for-loop /home/ztatlock/herbie/src/debug.rkt:113:2 ----------------------------------------------------------------------- ??? [72] 100.0% [76] 30650(64.1%) 658(1.4%) ??? ...acket/collects/racket/private/kw.rkt:400:14 ??? [90] 67.9% bf* [88] 10.9% bfcube [84] 9.2% ...higher-order.rkt:373:33 [85] 5.5% ...ow-val-first.rkt:357:18 [89] 4.3% ----------------------------------------------------------------------- ??? [72] 100.0% [77] 5288(11.1%) 5072(10.6%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [96] 4.1% ----------------------------------------------------------------------- hash-ref! [73] 100.0% [78] 1980(4.1%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bfcanonicalize [86] 62.4% sig+exp->bigfloat [87] 37.6% ----------------------------------------------------------------------- parse-loop12 [79] 16.4% hash-ref! [73] 20.3% map [67] 30.9% simplify [62] 32.5% [79] 1086(2.3%) 866(1.8%) parse-loop12 ...s/racket/match/compiler.rkt:410:15 loop [70] 20.3% parse-loop12 [79] 16.4% f37 [65] 6.1% ----------------------------------------------------------------------- hash-ref! [73] 100.0% [80] 664(1.4%) 0(0.0%) ??? ...e/ztatlock/herbie/src/core/taylor.rkt:42:15 hash-ref! [73] 100.0% ----------------------------------------------------------------------- hash-ref! [73] 100.0% [81] 624(1.3%) 0(0.0%) ??? ...e/ztatlock/herbie/src/core/taylor.rkt:63:15 hash-ref! [73] 100.0% ----------------------------------------------------------------------- ->flonum [74] 100.0% [82] 238(0.5%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:47:15 ??? [96] 100.0% ----------------------------------------------------------------------- ->flonum [74] 100.0% [83] 198(0.4%) 198(0.4%) ??? /home/ztatlock/herbie/src/config.rkt:29:0 ----------------------------------------------------------------------- ??? [76] 100.0% [84] 2834(5.9%) 0(0.0%) bfcube ...tlock/herbie/src/syntax/syntax.rkt:119:0 bf* [88] 76.6% ...ow-val-first.rkt:357:18 [89] 23.4% ----------------------------------------------------------------------- ??? [76] 100.0% [85] 1686(3.5%) 126(0.3%) ...higher-order.rkt:373:33 (unknown source) ??? [91] 65.8% ??? [93] 26.7% ----------------------------------------------------------------------- bigfloat-hash [78] 100.0% [86] 1236(2.6%) 1236(2.6%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 ----------------------------------------------------------------------- bigfloat-hash [78] 100.0% [87] 744(1.6%) 744(1.6%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 ----------------------------------------------------------------------- bfcube [84] 39.5% ??? [76] 60.5% [88] 5500(11.5%) 212(0.4%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [90] 96.1% ----------------------------------------------------------------------- bfcube [84] 33.4% ??? [76] 66.6% [89] 1988(4.2%) 0(0.0%) ...ow-val-first.rkt:357:18 (unknown source) ??? [91] 100.0% ----------------------------------------------------------------------- bf* [88] 20.3% ??? [76] 79.7% [90] 26106(54.6%) 12678(26.5%) ??? ...-racket/utils/simple-result-arrow.rkt:26:12 bfexpt [92] 30.2% ??? [95] 15.7% bfcbrt [94] 5.5% ----------------------------------------------------------------------- ...higher-order.rkt:373:33 [85] 35.8% ...ow-val-first.rkt:357:18 [89] 64.2% [91] 3098(6.5%) 238(0.5%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [93] 92.3% ----------------------------------------------------------------------- ??? [90] 100.0% [92] 7872(16.5%) 5712(11.9%) bfexpt ...lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [96] 27.4% ----------------------------------------------------------------------- ...higher-order.rkt:373:33 [85] 10.6% ??? [72] 21.8% ??? [91] 67.5% [93] 4234(8.9%) 650(1.4%) ??? ...ects/racket/contract/private/guts.rkt:638:8 ??? [95] 84.6% ----------------------------------------------------------------------- ??? [90] 100.0% [94] 1448(3.0%) 1448(3.0%) bfcbrt ...lib/math/private/bigfloat/mpfr.rkt:616:4 ----------------------------------------------------------------------- ->flonum [74] 2.8% ??? [93] 45.3% ??? [90] 51.9% [95] 7912(16.5%) 2708(5.7%) ??? ...tract/private/arrow-higher-order.rkt:373:33 ??? [97] 57.4% ??? [98] 8.4% ----------------------------------------------------------------------- real->bigfloat [77] 8.3% ??? [82] 9.1% bfexpt [92] 82.6% [96] 2614(5.5%) 2614(5.5%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ----------------------------------------------------------------------- ??? [95] 100.0% [97] 4538(9.5%) 2756(5.8%) ??? ...llects/racket/contract/combinator.rkt:178:4 any-wrap/traverse [99] 39.3% ----------------------------------------------------------------------- ??? [95] 100.0% [98] 666(1.4%) 432(0.9%) ??? ...ects/racket/contract/private/prop.rkt:489:4 ??? [100] 35.1% ----------------------------------------------------------------------- ??? [97] 100.0% [99] 1782(3.7%) 1782(3.7%) any-wrap/traverse ...cket/utils/any-wrap.rkt:106:2 ----------------------------------------------------------------------- ??? [98] 100.0% [100] 234(0.5%) 234(0.5%) ??? ...lects/racket/contract/private/orc.rkt:73:14 -----------------------------------------------------------------------