Profiling results ----------------- Total cpu time observed: 29550ms (out of 29888ms) Number of samples taken: 142 (once every 208ms) (Hiding functions with self<1.0% and local<2.0%: 3 of 107 hidden) ======================================================================= Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ======================================================================= ??? [34] 100.0% [1] 28422(96.2%) 0(0.0%) profile-thunk14 ...t/pkgs/profile-lib/main.rkt:9:0 run [6] 100.0% ----------------------------------------------------------------------- ??? [34] 100.0% [2] 17296(58.5%) 0(0.0%) run-improve58 ...ock/herbie/src/mainloop.rkt:242:0 for-loop [7] 95.3% get-final-combination [10] 2.3% loop [40] 1.2% setup-prog [12] 1.2% ----------------------------------------------------------------------- simplify-alt [18] 1.3% loop [70] 2.6% ??? [34] 96.2% [3] 15746(53.3%) 0(0.0%) simplify ...lock/herbie/src/core/simplify.rkt:39:0 simplify-expr [8] 58.8% for-loop [9] 29.2% iterate-egraph!5 [15] 12.1% ----------------------------------------------------------------------- hash-ref! [73] 100.0% [4] 350(1.2%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:285:26 for-loop [11] 100.0% ----------------------------------------------------------------------- hash-ref! [73] 100.0% [5] 152(0.5%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:295:23 for-loop [13] 100.0% ----------------------------------------------------------------------- profile-thunk14 [1] 100.0% [6] 28422(96.2%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:31:2 ??? [34] 100.0% ----------------------------------------------------------------------- run-improve58 [2] 100.0% [7] 16484(55.8%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:253:8 run-iter! [14] 100.0% ----------------------------------------------------------------------- simplify [3] 100.0% [8] 9256(31.3%) 0(0.0%) simplify-expr ...herbie/src/core/simplify.rkt:68:0 iterate-egraph!5 [15] 97.8% loop [19] 2.2% ----------------------------------------------------------------------- simplify [3] 100.0% [9] 4592(15.5%) 0(0.0%) for-loop ...ock/herbie/src/core/simplify.rkt:61:12 iterate-egraph!5 [15] 100.0% ----------------------------------------------------------------------- run-improve58 [2] 100.0% [10] 402(1.4%) 0(0.0%) get-final-combination ...ie/src/mainloop.rkt:269:0 extract-alt [16] 100.0% ----------------------------------------------------------------------- ??? [4] 100.0% [11] 350(1.2%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:285:52 simplify [17] 56.6% hash-ref! [73] 43.4% ----------------------------------------------------------------------- run-improve58 [2] 100.0% [12] 202(0.7%) 0(0.0%) setup-prog /home/ztatlock/herbie/src/glue.rkt:46:0 simplify-alt [18] 100.0% ----------------------------------------------------------------------- ??? [5] 100.0% [13] 152(0.5%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:298:27 hash-ref! [73] 100.0% ----------------------------------------------------------------------- for-loop [7] 100.0% [14] 16484(55.8%) 0(0.0%) run-iter! ...tatlock/herbie/src/mainloop.rkt:223:0 simplify! [21] 91.9% finalize-iter! [22] 5.0% gen-series! [23] 2.1% localize-error [26] 1.0% ----------------------------------------------------------------------- simplify [3] 12.2% for-loop [9] 29.5% simplify-expr [8] 58.3% [15] 15546(52.6%) 0(0.0%) iterate-egraph!5 ...bie/src/core/simplify.rkt:95:0 one-iter [20] 97.5% debug7 [25] 1.2% ----------------------------------------------------------------------- get-final-combination [10] 100.0% [16] 402(1.4%) 0(0.0%) extract-alt ...e/ztatlock/herbie/src/glue.rkt:57:0 loop [70] 100.0% ----------------------------------------------------------------------- hash-ref! [73] 43.4% for-loop [11] 56.6% [17] 350(1.2%) 0(0.0%) simplify ...atlock/herbie/src/core/reduce.rkt:18:0 f37 [72] 100.0% ----------------------------------------------------------------------- setup-prog [12] 100.0% [18] 202(0.7%) 0(0.0%) simplify-alt .../ztatlock/herbie/src/glue.rkt:84:0 simplify [3] 100.0% ----------------------------------------------------------------------- simplify-expr [8] 100.0% [19] 200(0.7%) 0(0.0%) loop ...tatlock/herbie/src/core/simplify.rkt:203:2 pass [24] 100.0% ----------------------------------------------------------------------- iterate-egraph!5 [15] 100.0% [20] 15164(51.3%) 0(0.0%) one-iter ...ock/herbie/src/core/simplify.rkt:106:0 for-loop [28] 57.0% loop [29] 41.7% apply-match [35] 1.3% ----------------------------------------------------------------------- run-iter! [14] 100.0% [21] 15142(51.2%) 0(0.0%) simplify! ...tatlock/herbie/src/mainloop.rkt:162:0 for-loop [27] 100.0% ----------------------------------------------------------------------- run-iter! [14] 100.0% [22] 830(2.8%) 0(0.0%) finalize-iter! ...ck/herbie/src/mainloop.rkt:177:0 ??? [30] 100.0% ----------------------------------------------------------------------- run-iter! [14] 100.0% [23] 350(1.2%) 0(0.0%) gen-series! ...tlock/herbie/src/mainloop.rkt:134:0 for-loop [31] 100.0% ----------------------------------------------------------------------- loop [19] 100.0% [24] 200(0.7%) 0(0.0%) pass ...tatlock/herbie/src/core/simplify.rkt:193:2 for-loop [32] 100.0% ----------------------------------------------------------------------- iterate-egraph!5 [15] 100.0% [25] 180(0.6%) 0(0.0%) debug7 /home/ztatlock/herbie/src/debug.rkt:102:0 ??? [30] 100.0% ----------------------------------------------------------------------- run-iter! [14] 100.0% [26] 162(0.5%) 0(0.0%) localize-error ...erbie/src/core/localize.rkt:47:0 for-loop [33] 100.0% ----------------------------------------------------------------------- simplify! [21] 100.0% [27] 15142(51.2%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:166:6 ??? [34] 100.0% ----------------------------------------------------------------------- for-loop [28] 49.1% one-iter [20] 50.9% [28] 8642(29.2%) 1682(5.7%) for-loop ...ck/herbie/src/core/simplify.rkt:116:12 for-loop [28] 49.1% match-e [41] 39.3% ----------------------------------------------------------------------- one-iter [20] 100.0% [29] 6326(21.4%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:53:19 apply-match [35] 100.0% ----------------------------------------------------------------------- debug7 [25] 17.8% finalize-iter! [22] 82.2% [30] 1010(3.4%) 0(0.0%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [36] 82.2% ??? [98] 17.8% ----------------------------------------------------------------------- gen-series! [23] 100.0% [31] 350(1.2%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:140:7 taylor-alt [37] 100.0% ----------------------------------------------------------------------- pass [24] 100.0% [32] 200(0.7%) 0(0.0%) for-loop ...ck/herbie/src/core/simplify.rkt:196:29 argmin [38] 100.0% ----------------------------------------------------------------------- localize-error [26] 100.0% [33] 162(0.5%) 0(0.0%) for-loop ...ock/herbie/src/core/localize.rkt:61:10 loop [39] 100.0% ----------------------------------------------------------------------- for-loop [27] 17.6% run [6] 40.1% [34] 29550(100.0%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk14 [1] 40.1% run-improve58 [2] 21.2% loop [40] 21.1% simplify [3] 17.6% ----------------------------------------------------------------------- one-iter [20] 3.0% loop [29] 97.0% [35] 6522(22.1%) 0(0.0%) apply-match .../herbie/src/core/simplify.rkt:122:2 match-e [41] 27.4% merge-egraph-nodes! [50] 26.5% update-leader! [59] 17.8% for-loop [43] 10.8% loop! [77] 9.1% mk-enode! [44] 6.0% reduce-to-single! [47] 2.4% ----------------------------------------------------------------------- ??? [30] 100.0% [36] 830(2.8%) 0(0.0%) for-loop ...ock/herbie/src/core/alt-table.rkt:51:2 atab-add-altn [42] 100.0% ----------------------------------------------------------------------- for-loop [31] 100.0% [37] 350(1.2%) 0(0.0%) taylor-alt ...e/ztatlock/herbie/src/glue.rkt:142:0 for-loop [45] 100.0% ----------------------------------------------------------------------- for-loop [32] 100.0% [38] 200(0.7%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 expression-cost [46] 100.0% ----------------------------------------------------------------------- for-loop [33] 100.0% [39] 162(0.5%) 162(0.5%) loop ...ket/collects/racket/private/map.rkt:113:23 ----------------------------------------------------------------------- run-improve58 [2] 1.7% ??? [34] 98.3% [40] 12462(42.2%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:122:2 loop [48] 44.3% make-exacts* [56] 34.6% loop [57] 21.0% ----------------------------------------------------------------------- apply-match [35] 14.1% for-loop [58] 18.6% for-loop [28] 67.3% [41] 8574(29.0%) 4998(16.9%) match-e ...tatlock/herbie/src/core/ematch.rkt:46:0 for-loop [49] 37.8% for-loop [58] 5.2% loop [70] 4.3% list-cartesian-product [60] 2.0% ----------------------------------------------------------------------- for-loop [36] 100.0% [42] 830(2.8%) 0(0.0%) atab-add-altn ...rbie/src/core/alt-table.rkt:208:0 best-and-tied-at-points [51] 100.0% ----------------------------------------------------------------------- apply-match [35] 100.0% [43] 704(2.4%) 184(0.6%) for-loop ...ck/herbie/src/core/simplify.rkt:136:10 merge-egraph-nodes! [50] 47.7% substitute-e [54] 26.1% ----------------------------------------------------------------------- apply-match [35] 100.0% [44] 394(1.3%) 394(1.3%) mk-enode! ...lock/herbie/src/core/egraph.rkt:101:0 ----------------------------------------------------------------------- taylor-alt [37] 100.0% [45] 350(1.2%) 0(0.0%) for-loop /home/ztatlock/herbie/src/glue.rkt:144:2 location-do [52] 100.0% ----------------------------------------------------------------------- argmin [38] 100.0% [46] 200(0.7%) 0(0.0%) expression-cost ...k/herbie/src/programs.rkt:212:0 compile [53] 100.0% ----------------------------------------------------------------------- apply-match [35] 100.0% [47] 154(0.5%) 0(0.0%) reduce-to-single! ...bie/src/core/egraph.rkt:324:0 for-loop [55] 100.0% ----------------------------------------------------------------------- loop [40] 100.0% [48] 5526(18.7%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:93:2 loop [57] 59.5% make-exacts* [56] 40.5% ----------------------------------------------------------------------- match-e [41] 100.0% [49] 3816(12.9%) 1954(6.6%) for-loop ...tlock/herbie/src/core/ematch.rkt:59:11 for-loop [58] 45.2% list-cartesian-product [60] 12.1% ----------------------------------------------------------------------- merge-egraph-nodes! [50] 4.4% for-loop [43] 16.3% apply-match [35] 79.3% [50] 2062(7.0%) 0(0.0%) merge-egraph-nodes! ...e/src/core/egraph.rkt:152:0 update-leader! [59] 68.1% loop! [77] 9.8% for-loop [63] 8.9% enode-merge! [64] 8.8% merge-egraph-nodes! [50] 4.4% ----------------------------------------------------------------------- atab-add-altn [42] 100.0% [51] 830(2.8%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 errors [61] 100.0% ----------------------------------------------------------------------- for-loop [45] 100.0% [52] 350(1.2%) 0(0.0%) location-do ...tlock/herbie/src/programs.rkt:129:0 approximate9 [62] 100.0% ----------------------------------------------------------------------- expression-cost [46] 100.0% [53] 200(0.7%) 200(0.7%) compile .../ztatlock/herbie/src/programs.rkt:189:0 ----------------------------------------------------------------------- substitute-e [54] 50.0% for-loop [43] 50.0% [54] 184(0.6%) 184(0.6%) substitute-e ...ck/herbie/src/core/ematch.rkt:71:0 substitute-e [54] 50.0% ----------------------------------------------------------------------- reduce-to-single! [47] 100.0% [55] 154(0.5%) 154(0.5%) for-loop ...tlock/herbie/src/core/egraph.rkt:325:8 ----------------------------------------------------------------------- loop [48] 34.2% loop [40] 65.8% [56] 6556(22.2%) 0(0.0%) make-exacts* ...tatlock/herbie/src/points.rkt:80:0 loop [70] 50.9% map [65] 49.1% ----------------------------------------------------------------------- loop [40] 44.4% loop [48] 55.6% [57] 5906(20.0%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:83:4 map [65] 100.0% ----------------------------------------------------------------------- match-e [41] 28.0% for-loop [49] 72.0% [58] 3184(10.8%) 0(0.0%) for-loop ...tlock/herbie/src/core/ematch.rkt:65:37 match-e [41] 100.0% ----------------------------------------------------------------------- apply-match [35] 43.7% merge-egraph-nodes! [50] 56.3% [59] 2652(9.0%) 0(0.0%) update-leader! ...herbie/src/core/egraph.rkt:217:0 for-loop [66] 100.0% ----------------------------------------------------------------------- match-e [41] 38.7% for-loop [49] 61.3% [60] 904(3.1%) 904(3.1%) list-cartesian-product ...src/core/ematch.rkt:20:0 ----------------------------------------------------------------------- best-and-tied-at-points [51] 100.0% [61] 830(2.8%) 0(0.0%) errors /home/ztatlock/herbie/src/points.rkt:144:0 eval-prog [67] 56.4% for-loop [68] 43.6% ----------------------------------------------------------------------- location-do [52] 100.0% [62] 350(1.2%) 0(0.0%) approximate9 ...ck/herbie/src/core/taylor.rkt:11:0 loop [69] 100.0% ----------------------------------------------------------------------- merge-egraph-nodes! [50] 100.0% [63] 184(0.6%) 184(0.6%) for-loop ...tlock/herbie/src/core/egraph.rkt:232:6 ----------------------------------------------------------------------- merge-egraph-nodes! [50] 100.0% [64] 182(0.6%) 182(0.6%) enode-merge! ...ck/herbie/src/core/enode.rkt:100:0 ----------------------------------------------------------------------- f37 [72] 1.6% make-exacts* [56] 34.7% loop [57] 63.7% [65] 9276(31.4%) 152(0.5%) map ...acket/collects/racket/private/map.rkt:21:13 loop [70] 95.5% ??? [75] 2.9% f37 [72] 1.2% ----------------------------------------------------------------------- update-leader! [59] 100.0% [66] 2652(9.0%) 0(0.0%) for-loop ...tlock/herbie/src/core/egraph.rkt:222:6 for-loop [71] 100.0% ----------------------------------------------------------------------- errors [61] 100.0% [67] 468(1.6%) 300(1.0%) eval-prog ...tatlock/herbie/src/programs.rkt:162:0 ??? [74] 35.9% ----------------------------------------------------------------------- errors [61] 100.0% [68] 362(1.2%) 202(0.7%) for-loop ...e/ztatlock/herbie/src/points.rkt:147:4 ??? [75] 44.2% ----------------------------------------------------------------------- approximate9 [62] 100.0% [69] 350(1.2%) 0(0.0%) loop ...e/ztatlock/herbie/src/core/taylor.rkt:82:4 hash-ref! [73] 100.0% ----------------------------------------------------------------------- make-exacts* [56] 0.1% extract-alt [16] 0.8% loop! [77] 1.4% map [65] 2.5% match-e [41] 4.1% loop [70] 90.8% [70] 13960(47.2%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:26:19 loop [70] 90.8% foldl [78] 4.1% ??? [75] 2.5% loop! [77] 1.4% simplify [3] 0.8% for-loop [82] 0.4% ->flonum [79] 0.1% ----------------------------------------------------------------------- for-loop [66] 100.0% [71] 2652(9.0%) 184(0.6%) for-loop ...tlock/herbie/src/core/egraph.rkt:223:8 hash-update! [76] 93.1% ----------------------------------------------------------------------- map [65] 32.6% simplify [17] 67.4% [72] 350(1.2%) 198(0.7%) f37 ...t/collects/racket/match/compiler.rkt:499:40 map [65] 43.4% ----------------------------------------------------------------------- for-loop [13] 8.7% for-loop [11] 8.7% ??? [80] 27.5% ??? [81] 27.5% loop [69] 27.5% [73] 350(1.2%) 0(0.0%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [81] 27.5% ??? [80] 27.5% ??? [4] 27.5% ??? [5] 8.7% simplify [17] 8.7% ----------------------------------------------------------------------- eval-prog [67] 100.0% [74] 168(0.6%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [83] 100.0% ----------------------------------------------------------------------- for-loop [68] 1.3% map [65] 2.2% loop [70] 96.5% [75] 12124(41.0%) 1128(3.8%) ??? /home/ztatlock/herbie/src/programs.rkt:168:4 ??? [84] 70.1% real->bigfloat [85] 20.6% ----------------------------------------------------------------------- for-loop [71] 100.0% [76] 2468(8.4%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [86] 100.0% ----------------------------------------------------------------------- merge-egraph-nodes! [50] 12.7% apply-match [35] 37.3% loop [70] 50.0% [77] 798(2.7%) 202(0.7%) loop! .../ztatlock/herbie/src/core/enode.rkt:163:2 loop [70] 50.0% set [87] 37.3% ----------------------------------------------------------------------- loop [70] 100.0% [78] 566(1.9%) 166(0.6%) foldl ...et/collects/racket/private/list.rkt:229:4 merge2 [88] 70.7% ----------------------------------------------------------------------- loop [70] 100.0% [79] 498(1.7%) 0(0.0%) ->flonum ...ock/herbie/src/syntax/syntax.rkt:224:0 ??? [101] 55.8% ??? [89] 44.2% ----------------------------------------------------------------------- hash-ref! [73] 100.0% [80] 350(1.2%) 0(0.0%) ??? ...e/ztatlock/herbie/src/core/taylor.rkt:42:15 hash-ref! [73] 100.0% ----------------------------------------------------------------------- hash-ref! [73] 100.0% [81] 350(1.2%) 0(0.0%) ??? ...e/ztatlock/herbie/src/core/taylor.rkt:63:15 hash-ref! [73] 100.0% ----------------------------------------------------------------------- loop [70] 100.0% [82] 202(0.7%) 0(0.0%) for-loop ...ock/herbie/src/core/simplify.rkt:161:2 setfindf [90] 100.0% ----------------------------------------------------------------------- ??? [74] 100.0% [83] 168(0.6%) 168(0.6%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 ----------------------------------------------------------------------- ??? [75] 100.0% [84] 8500(28.8%) 160(0.5%) ??? ...acket/collects/racket/private/kw.rkt:400:14 ??? [94] 49.9% bf* [91] 30.4% ...higher-order.rkt:373:33 [93] 17.8% ----------------------------------------------------------------------- ??? [75] 100.0% [85] 2496(8.4%) 2276(7.7%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [100] 8.8% ----------------------------------------------------------------------- hash-update! [76] 100.0% [86] 2468(8.4%) 0(0.0%) ??? .../ztatlock/herbie/src/core/egraph.rkt:225:24 for-loop [92] 100.0% ----------------------------------------------------------------------- loop! [77] 100.0% [87] 596(2.0%) 596(2.0%) set ...collects/racket/private/set-types.rkt:982:0 ----------------------------------------------------------------------- foldl [78] 100.0% [88] 400(1.4%) 400(1.4%) merge2 ...ztatlock/herbie/src/core/ematch.rkt:31:0 ----------------------------------------------------------------------- ->flonum [79] 100.0% [89] 220(0.7%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:47:15 ??? [100] 100.0% ----------------------------------------------------------------------- for-loop [82] 100.0% [90] 202(0.7%) 202(0.7%) setfindf ...e/ztatlock/herbie/src/common.rkt:173:0 ----------------------------------------------------------------------- ??? [84] 100.0% [91] 2582(8.7%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [94] 100.0% ----------------------------------------------------------------------- ??? [86] 100.0% [92] 2468(8.4%) 2076(7.0%) for-loop ...lock/herbie/src/core/egraph.rkt:226:26 update-en-expr [96] 15.9% ----------------------------------------------------------------------- ??? [84] 100.0% [93] 1516(5.1%) 0(0.0%) ...higher-order.rkt:373:33 (unknown source) ??? [95] 84.2% ??? [98] 15.8% ----------------------------------------------------------------------- bf* [91] 37.8% ??? [84] 62.2% [94] 6824(23.1%) 272(0.9%) ??? ...-racket/utils/simple-result-arrow.rkt:26:12 bfsub [97] 70.8% ??? [101] 14.2% bfneg [99] 10.9% ----------------------------------------------------------------------- ...higher-order.rkt:373:33 [93]100.0% [95] 1276(4.3%) 216(0.7%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [98] 83.1% ----------------------------------------------------------------------- for-loop [92] 100.0% [96] 392(1.3%) 392(1.3%) update-en-expr ...herbie/src/core/egraph.rkt:211:0 ----------------------------------------------------------------------- ??? [94] 100.0% [97] 4834(16.4%) 2800(9.5%) bfsub ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [100] 42.1% ----------------------------------------------------------------------- ??? [30] 12.2% ...higher-order.rkt:373:33 [93] 16.2% ??? [95] 71.6% [98] 1480(5.0%) 180(0.6%) ??? ...ects/racket/contract/private/guts.rkt:638:8 ??? [101] 87.8% ----------------------------------------------------------------------- ??? [94] 100.0% [99] 746(2.5%) 496(1.7%) bfneg ...-lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [100] 33.5% ----------------------------------------------------------------------- real->bigfloat [85] 8.1% ??? [89] 8.1% bfneg [99] 9.2% bfsub [97] 74.7% [100] 2724(9.2%) 2724(9.2%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ----------------------------------------------------------------------- ->flonum [79] 10.9% ??? [94] 38.1% ??? [98] 51.0% [101] 2550(8.6%) 1650(5.6%) ??? ...tract/private/arrow-higher-order.rkt:373:33 ??? [102] 27.6% ??? [103] 7.7% ----------------------------------------------------------------------- ??? [101] 100.0% [102] 704(2.4%) 222(0.8%) ??? ...llects/racket/contract/combinator.rkt:178:4 any-wrap/traverse [104] 68.5% ----------------------------------------------------------------------- ??? [101] 100.0% [103] 196(0.7%) 196(0.7%) ??? ...ects/racket/contract/private/prop.rkt:489:4 ----------------------------------------------------------------------- ??? [102] 100.0% [104] 482(1.6%) 482(1.6%) any-wrap/traverse ...cket/utils/any-wrap.rkt:106:2 -----------------------------------------------------------------------