Profiling results ----------------- Total cpu time observed: 32970ms (out of 33564ms) Number of samples taken: 132 (once every 250ms) (Hiding functions with self<1.0% and local<2.0%: 4 of 106 hidden) ====================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ====================================================================== ??? [29] 100.0% [1] 31626(95.9%) 0(0.0%) profile-thunk14 ...t/pkgs/profile-lib/main.rkt:9:0 run [4] 100.0% ---------------------------------------------------------------------- ??? [29] 100.0% [2] 11096(33.7%) 0(0.0%) run-improve58 ...ock/herbie/src/mainloop.rkt:242:0 for-loop [5] 88.9% get-final-combination [8] 3.8% setup-prog [9] 3.7% loop [36] 3.7% ---------------------------------------------------------------------- simplify-alt [14] 4.9% loop [64] 5.1% ??? [29] 90.0% [3] 8228(25.0%) 0(0.0%) simplify ...lock/herbie/src/core/simplify.rkt:39:0 simplify-expr [6] 67.5% iterate-egraph!5 [12] 20.0% for-loop [7] 10.0% loop [10] 2.4% ---------------------------------------------------------------------- profile-thunk14 [1] 100.0% [4] 31626(95.9%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:31:2 ??? [29] 100.0% ---------------------------------------------------------------------- run-improve58 [2] 100.0% [5] 9864(29.9%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:253:8 run-iter! [11] 100.0% ---------------------------------------------------------------------- simplify [3] 100.0% [6] 5558(16.9%) 0(0.0%) simplify-expr ...herbie/src/core/simplify.rkt:68:0 iterate-egraph!5 [12] 100.0% ---------------------------------------------------------------------- simplify [3] 100.0% [7] 822(2.5%) 0(0.0%) for-loop ...ock/herbie/src/core/simplify.rkt:61:12 iterate-egraph!5 [12] 100.0% ---------------------------------------------------------------------- run-improve58 [2] 100.0% [8] 420(1.3%) 0(0.0%) get-final-combination ...ie/src/mainloop.rkt:269:0 extract-alt [13] 100.0% ---------------------------------------------------------------------- run-improve58 [2] 100.0% [9] 406(1.2%) 0(0.0%) setup-prog /home/ztatlock/herbie/src/glue.rkt:46:0 simplify-alt [14] 100.0% ---------------------------------------------------------------------- simplify [3] 100.0% [10] 200(0.6%) 0(0.0%) loop ...tatlock/herbie/src/core/simplify.rkt:203:2 pass [15] 100.0% ---------------------------------------------------------------------- for-loop [5] 100.0% [11] 9864(29.9%) 0(0.0%) run-iter! ...tatlock/herbie/src/mainloop.rkt:223:0 simplify! [17] 75.0% finalize-iter! [18] 12.8% gen-series! [19] 6.1% choose-best-alt! [20] 4.1% localize-error [22] 2.0% ---------------------------------------------------------------------- for-loop [7] 10.2% simplify [3] 20.5% simplify-expr [6] 69.2% [12] 8028(24.3%) 0(0.0%) iterate-egraph!5 ...bie/src/core/simplify.rkt:95:0 one-iter [16] 100.0% ---------------------------------------------------------------------- get-final-combination [8] 100.0% [13] 420(1.3%) 0(0.0%) extract-alt ...e/ztatlock/herbie/src/glue.rkt:57:0 loop [64] 100.0% ---------------------------------------------------------------------- setup-prog [9] 100.0% [14] 406(1.2%) 0(0.0%) simplify-alt .../ztatlock/herbie/src/glue.rkt:84:0 simplify [3] 100.0% ---------------------------------------------------------------------- loop [10] 100.0% [15] 200(0.6%) 0(0.0%) pass ...tatlock/herbie/src/core/simplify.rkt:193:2 for-loop [21] 100.0% ---------------------------------------------------------------------- iterate-egraph!5 [12] 100.0% [16] 8028(24.3%) 0(0.0%) one-iter ...ock/herbie/src/core/simplify.rkt:106:0 for-loop [24] 69.5% loop [25] 30.5% ---------------------------------------------------------------------- run-iter! [11] 100.0% [17] 7402(22.5%) 0(0.0%) simplify! ...tatlock/herbie/src/mainloop.rkt:162:0 for-loop [23] 100.0% ---------------------------------------------------------------------- run-iter! [11] 100.0% [18] 1260(3.8%) 0(0.0%) finalize-iter! ...ck/herbie/src/mainloop.rkt:177:0 ??? [26] 100.0% ---------------------------------------------------------------------- run-iter! [11] 100.0% [19] 602(1.8%) 0(0.0%) gen-series! ...tlock/herbie/src/mainloop.rkt:134:0 for-loop [27] 100.0% ---------------------------------------------------------------------- run-iter! [11] 100.0% [20] 400(1.2%) 0(0.0%) choose-best-alt! .../herbie/src/mainloop.rkt:120:0 ??? [26] 100.0% ---------------------------------------------------------------------- pass [15] 100.0% [21] 200(0.6%) 0(0.0%) for-loop ...ck/herbie/src/core/simplify.rkt:196:29 argmin [28] 100.0% ---------------------------------------------------------------------- run-iter! [11] 100.0% [22] 200(0.6%) 0(0.0%) localize-error ...erbie/src/core/localize.rkt:47:0 hash-ref! [73] 100.0% ---------------------------------------------------------------------- simplify! [17] 100.0% [23] 7402(22.5%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:166:6 ??? [29] 100.0% ---------------------------------------------------------------------- for-loop [24] 46.2% one-iter [16] 53.8% [24] 5582(16.9%) 1264(3.8%) for-loop ...ck/herbie/src/core/simplify.rkt:116:12 for-loop [24] 46.2% match-e [37] 36.9% ??? [35] 1.8% ---------------------------------------------------------------------- one-iter [16] 100.0% [25] 2446(7.4%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:53:19 apply-match [30] 100.0% ---------------------------------------------------------------------- choose-best-alt! [20] 24.1% finalize-iter! [18] 75.9% [26] 1660(5.0%) 0(0.0%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [31] 75.9% atab-pick-alt8 [33] 24.1% ---------------------------------------------------------------------- gen-series! [19] 100.0% [27] 602(1.8%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:140:7 taylor-alt [32] 100.0% ---------------------------------------------------------------------- for-loop [21] 100.0% [28] 200(0.6%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 expression-cost [34] 100.0% ---------------------------------------------------------------------- for-loop [23] 7.9% run [4] 45.9% [29] 31826(96.5%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk14 [1] 45.9% loop [36] 32.6% run-improve58 [2] 13.7% simplify [3] 7.9% ---------------------------------------------------------------------- loop [25] 100.0% [30] 2446(7.4%) 0(0.0%) apply-match .../herbie/src/core/simplify.rkt:122:2 match-e [37] 33.4% merge-egraph-nodes! [47] 25.1% loop! [70] 17.0% for-loop [41] 16.4% substitute-e [43] 8.2% ---------------------------------------------------------------------- ??? [26] 100.0% [31] 1260(3.8%) 0(0.0%) for-loop ...ock/herbie/src/core/alt-table.rkt:51:2 atab-add-altn [38] 100.0% ---------------------------------------------------------------------- for-loop [27] 100.0% [32] 602(1.8%) 0(0.0%) taylor-alt ...e/ztatlock/herbie/src/glue.rkt:142:0 for-loop [39] 100.0% ---------------------------------------------------------------------- ??? [26] 100.0% [33] 400(1.2%) 0(0.0%) atab-pick-alt8 ...rbie/src/core/alt-table.rkt:54:0 ??? [40] 100.0% ---------------------------------------------------------------------- argmin [28] 100.0% [34] 200(0.6%) 200(0.6%) expression-cost ...k/herbie/src/programs.rkt:212:0 ---------------------------------------------------------------------- for-loop [24] 100.0% [35] 200(0.6%) 0(0.0%) ??? /home/ztatlock/herbie/src/core/ematch.rkt:50:5 for-loop [42] 100.0% ---------------------------------------------------------------------- run-improve58 [2] 1.9% ??? [29] 98.1% [36] 21136(64.1%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:122:2 make-exacts* [50] 54.3% loop [44] 43.8% loop [51] 1.9% ---------------------------------------------------------------------- for-loop [52] 8.1% apply-match [30] 14.5% for-loop [24] 77.4% [37] 4934(15.0%) 3498(10.6%) match-e ...tatlock/herbie/src/core/ematch.rkt:46:0 for-loop [45] 27.1% list-cartesian-product [55] 4.1% for-loop [52] 2.0% ---------------------------------------------------------------------- for-loop [31] 100.0% [38] 1260(3.8%) 0(0.0%) atab-add-altn ...rbie/src/core/alt-table.rkt:208:0 best-and-tied-at-points [46] 100.0% ---------------------------------------------------------------------- taylor-alt [32] 100.0% [39] 602(1.8%) 0(0.0%) for-loop /home/ztatlock/herbie/src/glue.rkt:144:2 location-do [48] 100.0% ---------------------------------------------------------------------- atab-pick-alt8 [33] 100.0% [40] 400(1.2%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:369:33 best-alt [49] 100.0% ---------------------------------------------------------------------- apply-match [30] 100.0% [41] 400(1.2%) 0(0.0%) for-loop ...ck/herbie/src/core/simplify.rkt:136:10 merge-egraph-nodes! [47] 50.0% loop! [70] 50.0% ---------------------------------------------------------------------- ??? [35] 100.0% [42] 200(0.6%) 200(0.6%) for-loop ...atlock/herbie/src/core/ematch.rkt:51:7 ---------------------------------------------------------------------- apply-match [30] 100.0% [43] 200(0.6%) 200(0.6%) substitute-e ...ck/herbie/src/core/ematch.rkt:71:0 ---------------------------------------------------------------------- loop [36] 100.0% [44] 9256(28.1%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:93:2 loop [51] 67.8% make-exacts* [50] 32.2% ---------------------------------------------------------------------- match-e [37] 100.0% [45] 1636(5.0%) 400(1.2%) for-loop ...tlock/herbie/src/core/ematch.rkt:59:11 for-loop [52] 43.9% loop [64] 25.6% list-cartesian-product [55] 12.2% ---------------------------------------------------------------------- atab-add-altn [38] 100.0% [46] 1260(3.8%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 errors [65] 100.0% ---------------------------------------------------------------------- for-loop [41] 24.6% apply-match [30] 75.4% [47] 814(2.5%) 0(0.0%) merge-egraph-nodes! ...e/src/core/egraph.rkt:152:0 update-leader! [53] 75.4% for-loop [56] 24.6% ---------------------------------------------------------------------- for-loop [39] 100.0% [48] 602(1.8%) 0(0.0%) location-do ...tlock/herbie/src/programs.rkt:129:0 approximate9 [54] 100.0% ---------------------------------------------------------------------- ??? [40] 100.0% [49] 400(1.2%) 0(0.0%) best-alt /home/ztatlock/herbie/src/glue.rkt:79:0 loop [57] 50.0% argmins [58] 50.0% ---------------------------------------------------------------------- loop [44] 20.6% loop [36] 79.4% [50] 14456(43.8%) 0(0.0%) make-exacts* ...tatlock/herbie/src/points.rkt:80:0 loop [64] 53.2% map [59] 46.8% ---------------------------------------------------------------------- loop [36] 6.1% loop [44] 93.9% [51] 6680(20.3%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:83:4 map [59] 100.0% ---------------------------------------------------------------------- match-e [37] 19.6% for-loop [45] 80.4% [52] 1020(3.1%) 218(0.7%) for-loop ...tlock/herbie/src/core/ematch.rkt:65:37 match-e [37] 78.6% ---------------------------------------------------------------------- merge-egraph-nodes! [47] 100.0% [53] 614(1.9%) 0(0.0%) update-leader! ...herbie/src/core/egraph.rkt:217:0 for-loop [61] 100.0% ---------------------------------------------------------------------- location-do [48] 100.0% [54] 602(1.8%) 0(0.0%) approximate9 ...ck/herbie/src/core/taylor.rkt:11:0 f66 [90] 33.6% taylor-quotient [62] 33.2% for-loop [63] 33.2% ---------------------------------------------------------------------- match-e [37] 25.0% for-loop [45] 25.0% list-cartesian-product [55] 50.0% [55] 400(1.2%) 400(1.2%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [55] 50.0% ---------------------------------------------------------------------- merge-egraph-nodes! [47] 100.0% [56] 200(0.6%) 200(0.6%) for-loop ...tlock/herbie/src/core/egraph.rkt:232:6 ---------------------------------------------------------------------- best-alt [49] 100.0% [57] 200(0.6%) 0(0.0%) loop /home/ztatlock/herbie/src/common.rkt:86:2 composed [60] 100.0% ---------------------------------------------------------------------- best-alt [49] 100.0% [58] 200(0.6%) 0(0.0%) argmins /home/ztatlock/herbie/src/common.rkt:85:0 composed [60] 100.0% ---------------------------------------------------------------------- ??? [75] 0.5% parse-loop12 [86] 1.0% f66 [90] 1.5% loop [51] 48.2% make-exacts* [50] 48.9% [59] 13850(42.0%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:21:13 loop [64] 97.1% taylor [67] 1.5% ??? [75] 1.0% ---------------------------------------------------------------------- argmins [58] 25.0% loop [57] 25.0% f66 [90] 50.0% [60] 800(2.4%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 errors [65] 50.0% f66 [90] 50.0% ---------------------------------------------------------------------- update-leader! [53] 100.0% [61] 614(1.9%) 0(0.0%) for-loop ...tlock/herbie/src/core/egraph.rkt:222:6 for-loop [66] 100.0% ---------------------------------------------------------------------- approximate9 [54] 100.0% [62] 200(0.6%) 0(0.0%) taylor-quotient ...erbie/src/core/taylor.rkt:328:0 first-nonzero-exp [68] 100.0% ---------------------------------------------------------------------- approximate9 [54] 100.0% [63] 200(0.6%) 0(0.0%) for-loop ...tlock/herbie/src/core/taylor.rkt:28:18 f66 [90] 100.0% ---------------------------------------------------------------------- parse-loop12 [86] 0.0% make-exacts* [50] 0.2% loop! [70] 0.4% extract-alt [13] 0.6% f66 [90] 0.9% map [59] 1.0% ??? [76] 1.2% for-loop [45] 1.8% loop [64] 93.8% [64] 22974(69.7%) 1222(3.7%) loop ...cket/collects/racket/private/map.rkt:26:19 loop [64] 93.8% ??? [76] 1.3% simplify [79] 0.9% simplify [3] 0.6% loop! [70] 0.4% real->bigfloat [83] 0.3% ??? [75] 0.0% ??? [96] 0.0% ---------------------------------------------------------------------- composed [60] 24.1% best-and-tied-at-points [46] 75.9% [65] 1660(5.0%) 0(0.0%) errors /home/ztatlock/herbie/src/points.rkt:144:0 for-loop [69] 74.6% eval-prog [72] 25.4% ---------------------------------------------------------------------- for-loop [61] 100.0% [66] 614(1.9%) 0(0.0%) for-loop ...tlock/herbie/src/core/egraph.rkt:223:8 hash-update! [71] 100.0% ---------------------------------------------------------------------- map [59] 100.0% [67] 202(0.6%) 0(0.0%) taylor ...tatlock/herbie/src/core/taylor.rkt:157:0 debug-print [74] 100.0% ---------------------------------------------------------------------- taylor-quotient [62] 100.0% [68] 200(0.6%) 0(0.0%) first-nonzero-exp ...bie/src/core/taylor.rkt:260:0 hash-ref! [73] 100.0% ---------------------------------------------------------------------- errors [65] 100.0% [69] 1238(3.8%) 0(0.0%) for-loop ...e/ztatlock/herbie/src/points.rkt:147:4 ??? [76] 100.0% ---------------------------------------------------------------------- for-loop [41] 16.2% loop [64] 32.5% apply-match [30] 51.3% [70] 616(1.9%) 0(0.0%) loop! .../ztatlock/herbie/src/core/enode.rkt:163:2 custom-set-union [77] 67.5% loop [64] 32.5% ---------------------------------------------------------------------- for-loop [66] 100.0% [71] 614(1.9%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [78] 100.0% ---------------------------------------------------------------------- errors [65] 100.0% [72] 422(1.3%) 220(0.7%) eval-prog ...tatlock/herbie/src/programs.rkt:162:0 inductor [81] 47.9% ---------------------------------------------------------------------- localize-error [22] 12.5% ??? [75] 37.5% first-nonzero-exp [68] 50.0% [73] 400(1.2%) 0(0.0%) hash-ref! ...racket/private/more-scheme.rkt:373:13 simplify [79] 50.0% parse-loop12 [86] 50.0% ---------------------------------------------------------------------- taylor [67] 100.0% [74] 202(0.6%) 0(0.0%) debug-print ...ztatlock/herbie/src/debug.rkt:107:0 for-loop [80] 100.0% ---------------------------------------------------------------------- loop [64] 50.0% map [59] 50.0% [75] 200(0.6%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [73] 75.0% map [59] 25.0% ---------------------------------------------------------------------- for-loop [69] 5.5% loop [64] 94.5% [76] 22374(67.9%) 730(2.2%) ??? /home/ztatlock/herbie/src/programs.rkt:168:4 ??? [82] 59.6% loop [64] 23.1% real->bigfloat [83] 12.7% ??? [96] 1.3% ---------------------------------------------------------------------- loop! [70] 100.0% [77] 616(1.9%) 216(0.7%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [85] 64.9% ---------------------------------------------------------------------- hash-update! [71] 100.0% [78] 614(1.9%) 0(0.0%) ??? .../ztatlock/herbie/src/core/egraph.rkt:225:24 for-loop [84] 100.0% ---------------------------------------------------------------------- loop [64] 50.0% hash-ref! [73] 50.0% [79] 400(1.2%) 0(0.0%) simplify ...atlock/herbie/src/core/reduce.rkt:18:0 f66 [90] 50.0% parse-loop12 [86] 50.0% ---------------------------------------------------------------------- debug-print [74] 100.0% [80] 202(0.6%) 202(0.6%) for-loop /home/ztatlock/herbie/src/debug.rkt:113:2 ---------------------------------------------------------------------- eval-prog [72] 100.0% [81] 202(0.6%) 202(0.6%) inductor .../ztatlock/herbie/src/programs.rkt:73:2 ---------------------------------------------------------------------- ??? [76] 100.0% [82] 13344(40.5%) 1308(4.0%) ??? ...acket/collects/racket/private/kw.rkt:400:14 ??? [95] 32.4% bffma [87] 26.8% bf* [92] 12.7% ...higher-order.rkt:373:33 [88] 8.6% ...ow-val-first.rkt:357:18 [89] 8.2% ---------------------------------------------------------------------- ??? [76] 43.4% loop [64] 56.6% [83] 6566(19.9%) 4376(13.3%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [100] 33.4% ---------------------------------------------------------------------- ??? [78] 100.0% [84] 614(1.9%) 614(1.9%) for-loop ...lock/herbie/src/core/egraph.rkt:226:26 ---------------------------------------------------------------------- custom-set-union [77] 100.0% [85] 400(1.2%) 200(0.6%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [91] 50.0% ---------------------------------------------------------------------- hash-ref! [73] 50.0% simplify [79] 50.0% [86] 400(1.2%) 0(0.0%) parse-loop12 ...s/racket/match/compiler.rkt:410:15 f66 [90] 50.0% map [59] 25.0% loop [64] 25.0% ---------------------------------------------------------------------- ??? [82] 100.0% [87] 3574(10.8%) 284(0.9%) bffma ...atlock/herbie/src/syntax/syntax.rkt:122:0 bf* [92] 92.1% ---------------------------------------------------------------------- ??? [82] 100.0% [88] 1150(3.5%) 0(0.0%) ...higher-order.rkt:373:33 (unknown source) ??? [93] 100.0% ---------------------------------------------------------------------- ??? [82] 100.0% [89] 1094(3.3%) 0(0.0%) ...ow-val-first.rkt:357:18 (unknown source) ??? [93] 100.0% ---------------------------------------------------------------------- parse-loop12 [86] 6.6% for-loop [63] 6.6% simplify [79] 6.6% composed [60] 13.3% approximate9 [54] 16.8% f66 [90] 23.4% append-map [94] 26.6% [90] 602(1.8%) 200(0.6%) f66 ...t/collects/racket/match/compiler.rkt:499:40 append-map [94] 33.2% f66 [90] 23.4% map [59] 16.8% composed [60] 13.3% loop [64] 6.6% ---------------------------------------------------------------------- for-loop [85] 100.0% [91] 200(0.6%) 200(0.6%) for-loop ...cts/racket/private/set-types.rkt:178:5 ---------------------------------------------------------------------- ??? [82] 34.0% bffma [87] 66.0% [92] 4984(15.1%) 300(0.9%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [95] 94.0% ---------------------------------------------------------------------- ...ow-val-first.rkt:357:18 [89] 48.8% ...higher-order.rkt:373:33 [88] 51.2% [93] 2244(6.8%) 212(0.6%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [96] 90.6% ---------------------------------------------------------------------- f66 [90] 100.0% [94] 400(1.2%) 0(0.0%) append-map ...acket/collects/racket/list.rkt:565:2 f66 [90] 75.0% free-variables [97] 25.0% ---------------------------------------------------------------------- ??? [82] 48.0% bf* [92] 52.0% [95] 9008(27.3%) 572(1.7%) ??? ...-racket/utils/simple-result-arrow.rkt:26:12 bfadd [98] 67.9% ??? [99] 25.7% ---------------------------------------------------------------------- loop [64] 8.3% ??? [76] 11.1% ??? [93] 80.6% [96] 2522(7.6%) 0(0.0%) ??? ...ects/racket/contract/private/guts.rkt:638:8 ??? [99] 100.0% ---------------------------------------------------------------------- append-map [94] 100.0% [97] 200(0.6%) 200(0.6%) free-variables ...ock/herbie/src/programs.rkt:89:0 ---------------------------------------------------------------------- ??? [95] 100.0% [98] 6120(18.6%) 4628(14.0%) bfadd ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [100] 24.4% ---------------------------------------------------------------------- ??? [95] 47.9% ??? [96] 52.1% [99] 4838(14.7%) 3680(11.2%) ??? ...tract/private/arrow-higher-order.rkt:373:33 ??? [101] 23.9% ---------------------------------------------------------------------- bfadd [98] 40.5% real->bigfloat [83] 59.5% [100] 3682(11.2%) 3682(11.2%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ---------------------------------------------------------------------- ??? [99] 100.0% [101] 1158(3.5%) 254(0.8%) ??? ...llects/racket/contract/combinator.rkt:178:4 any-wrap/traverse [102] 78.1% ---------------------------------------------------------------------- ??? [101] 100.0% [102] 904(2.7%) 904(2.7%) any-wrap/traverse ...cket/utils/any-wrap.rkt:106:2 ----------------------------------------------------------------------