Profiling results ----------------- Total cpu time observed: 52718ms (out of 54896ms) Number of samples taken: 203 (once every 260ms) (Hiding functions with self<1.0% and local<2.0%: 4 of 105 hidden) ====================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ====================================================================== ??? [47] 100.0% [1] 51452(97.6%) 0(0.0%) profile-thunk14 ...t/pkgs/profile-lib/main.rkt:9:0 run [9] 100.0% ---------------------------------------------------------------------- ??? [47] 100.0% [2] 9074(17.2%) 0(0.0%) run-improve58 ...ock/herbie/src/mainloop.rkt:242:0 for-loop [11] 52.2% loop [10] 38.2% finalize-table! [14] 7.2% setup-prog [18] 2.4% ---------------------------------------------------------------------- hash-ref! [73] 100.0% [3] 7564(14.3%) 0(0.0%) ??? /home/ztatlock/herbie/src/programs.rkt:197:5 loop [48] 97.4% hash-ref! [73] 2.6% ---------------------------------------------------------------------- simplify-alt [23] 6.4% ??? [47] 93.6% [4] 3454(6.6%) 0(0.0%) simplify ...lock/herbie/src/core/simplify.rkt:39:0 simplify-expr [12] 69.7% for-loop [15] 18.0% iterate-egraph!5 [21] 12.3% ---------------------------------------------------------------------- location-do [61] 100.0% [5] 1082(2.1%) 0(0.0%) approximate9 ...ck/herbie/src/core/taylor.rkt:11:0 loop [13] 81.3% f37 [88] 18.7% ---------------------------------------------------------------------- hash-ref! [73] 100.0% [6] 424(0.8%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:285:26 for-loop [16] 100.0% ---------------------------------------------------------------------- loop [48] 100.0% [7] 226(0.4%) 0(0.0%) completely-simplify-alt ...erbie/src/glue.rkt:87:0 simplify-expr [12] 100.0% ---------------------------------------------------------------------- hash-ref! [73] 100.0% [8] 222(0.4%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:295:23 for-loop [17] 100.0% ---------------------------------------------------------------------- profile-thunk14 [1] 99.6% [9] 51650(98.0%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:31:2 ??? [47] 100.0% ---------------------------------------------------------------------- run-improve58 [2] 7.4% ??? [47] 92.6% [10] 46896(89.0%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:122:2 loop [19] 59.9% make-exacts* [26] 25.6% loop [27] 14.1% for-loop [25] 0.4% ---------------------------------------------------------------------- run-improve58 [2] 100.0% [11] 4736(9.0%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:253:8 run-iter! [20] 100.0% ---------------------------------------------------------------------- completely-simplify-alt [7] 8.6% simplify [4] 91.4% [12] 2634(5.0%) 0(0.0%) simplify-expr ...herbie/src/core/simplify.rkt:68:0 iterate-egraph!5 [21] 92.4% loop [24] 7.6% ---------------------------------------------------------------------- approximate9 [5] 100.0% [13] 880(1.7%) 0(0.0%) loop ...e/ztatlock/herbie/src/core/taylor.rkt:82:4 hash-ref! [73] 100.0% ---------------------------------------------------------------------- run-improve58 [2] 100.0% [14] 650(1.2%) 0(0.0%) finalize-table! ...k/herbie/src/mainloop.rkt:264:0 post-process [22] 100.0% ---------------------------------------------------------------------- simplify [4] 100.0% [15] 622(1.2%) 0(0.0%) for-loop ...ock/herbie/src/core/simplify.rkt:61:12 iterate-egraph!5 [21] 100.0% ---------------------------------------------------------------------- ??? [6] 100.0% [16] 424(0.8%) 222(0.4%) for-loop ...lock/herbie/src/core/taylor.rkt:285:52 hash-ref! [73] 73.8% ---------------------------------------------------------------------- ??? [8] 100.0% [17] 222(0.4%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:298:27 hash-ref! [73] 100.0% ---------------------------------------------------------------------- run-improve58 [2] 100.0% [18] 220(0.4%) 0(0.0%) setup-prog /home/ztatlock/herbie/src/glue.rkt:46:0 simplify-alt [23] 100.0% ---------------------------------------------------------------------- loop [10] 100.0% [19] 28070(53.2%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:93:2 loop [27] 35.8% make-exacts* [26] 33.6% eval-prog [70] 30.6% ---------------------------------------------------------------------- for-loop [11] 100.0% [20] 4736(9.0%) 0(0.0%) run-iter! ...tatlock/herbie/src/mainloop.rkt:223:0 simplify! [29] 68.3% gen-series! [30] 13.9% finalize-iter! [31] 13.6% localize-error [34] 4.2% ---------------------------------------------------------------------- simplify [4] 12.2% for-loop [15] 17.9% simplify-expr [12] 69.9% [21] 3480(6.6%) 0(0.0%) iterate-egraph!5 ...bie/src/core/simplify.rkt:95:0 one-iter [28] 94.3% map-enodes [33] 5.7% ---------------------------------------------------------------------- finalize-table! [14] 100.0% [22] 650(1.2%) 0(0.0%) post-process .../ztatlock/herbie/src/glue.rkt:95:0 for-loop [32] 65.2% loop [48] 34.8% ---------------------------------------------------------------------- setup-prog [18] 100.0% [23] 220(0.4%) 0(0.0%) simplify-alt .../ztatlock/herbie/src/glue.rkt:84:0 simplify [4] 100.0% ---------------------------------------------------------------------- simplify-expr [12] 100.0% [24] 200(0.4%) 0(0.0%) loop ...tatlock/herbie/src/core/simplify.rkt:203:2 pass [35] 100.0% ---------------------------------------------------------------------- loop [10] 100.0% [25] 198(0.4%) 0(0.0%) for-loop .../ztatlock/herbie/src/points.rkt:128:18 for-loop [36] 100.0% ---------------------------------------------------------------------- loop [19] 44.0% loop [10] 56.0% [26] 21458(40.7%) 0(0.0%) make-exacts* ...tatlock/herbie/src/points.rkt:80:0 map [37] 42.2% loop [48] 38.1% eval-prog [70] 19.7% ---------------------------------------------------------------------- loop [10] 39.7% loop [19] 60.3% [27] 16648(31.6%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:83:4 map [37] 100.0% ---------------------------------------------------------------------- iterate-egraph!5 [21] 100.0% [28] 3280(6.2%) 0(0.0%) one-iter ...ock/herbie/src/core/simplify.rkt:106:0 for-loop [39] 69.5% apply-match [50] 12.3% loop [43] 12.2% loop [44] 6.1% ---------------------------------------------------------------------- run-iter! [20] 100.0% [29] 3234(6.1%) 0(0.0%) simplify! ...tatlock/herbie/src/mainloop.rkt:162:0 for-loop [38] 100.0% ---------------------------------------------------------------------- run-iter! [20] 100.0% [30] 658(1.2%) 0(0.0%) gen-series! ...tlock/herbie/src/mainloop.rkt:134:0 for-loop [40] 100.0% ---------------------------------------------------------------------- run-iter! [20] 100.0% [31] 644(1.2%) 0(0.0%) finalize-iter! ...ck/herbie/src/mainloop.rkt:177:0 ??? [41] 100.0% ---------------------------------------------------------------------- post-process [22] 100.0% [32] 424(0.8%) 0(0.0%) for-loop /home/ztatlock/herbie/src/glue.rkt:119:17 append-map [42] 100.0% ---------------------------------------------------------------------- iterate-egraph!5 [21] 100.0% [33] 200(0.4%) 0(0.0%) map-enodes ...ock/herbie/src/core/egraph.rkt:139:0 for-loop [45] 100.0% ---------------------------------------------------------------------- run-iter! [20] 100.0% [34] 200(0.4%) 0(0.0%) localize-error ...erbie/src/core/localize.rkt:47:0 hash-ref! [73] 100.0% ---------------------------------------------------------------------- loop [24] 100.0% [35] 200(0.4%) 0(0.0%) pass ...tatlock/herbie/src/core/simplify.rkt:193:2 for-loop [46] 100.0% ---------------------------------------------------------------------- for-loop [25] 100.0% [36] 198(0.4%) 198(0.4%) for-loop .../ztatlock/herbie/src/points.rkt:129:20 ---------------------------------------------------------------------- f37 [88] 1.6% make-exacts* [26] 34.7% loop [27] 63.7% [37] 26130(49.6%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:21:13 loop [48] 97.6% ??? [72] 0.8% f37 [88] 0.4% parse-loop50 [84] 0.4% ---------------------------------------------------------------------- simplify! [29] 100.0% [38] 3234(6.1%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:166:6 ??? [47] 100.0% ---------------------------------------------------------------------- for-loop [39] 50.0% one-iter [28] 50.0% [39] 2278(4.3%) 420(0.8%) for-loop ...ck/herbie/src/core/simplify.rkt:116:12 for-loop [39] 50.0% match-e [54] 40.8% ---------------------------------------------------------------------- gen-series! [30] 100.0% [40] 658(1.2%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:140:7 taylor-alt [49] 100.0% ---------------------------------------------------------------------- finalize-iter! [31] 100.0% [41] 644(1.2%) 0(0.0%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [51] 100.0% ---------------------------------------------------------------------- for-loop [32] 100.0% [42] 424(0.8%) 0(0.0%) append-map ...acket/collects/racket/list.rkt:565:2 taylor-alt [49] 100.0% ---------------------------------------------------------------------- one-iter [28] 100.0% [43] 400(0.8%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:53:19 apply-match [50] 100.0% ---------------------------------------------------------------------- one-iter [28] 100.0% [44] 200(0.4%) 200(0.4%) loop ...ket/collects/racket/private/list.rkt:264:4 ---------------------------------------------------------------------- map-enodes [33] 100.0% [45] 200(0.4%) 0(0.0%) for-loop ...ock/herbie/src/core/simplify.rkt:161:2 setfindf [52] 100.0% ---------------------------------------------------------------------- pass [35] 100.0% [46] 200(0.4%) 0(0.0%) for-loop ...ck/herbie/src/core/simplify.rkt:196:29 argmin [53] 100.0% ---------------------------------------------------------------------- for-loop [38] 2.1% run [9] 48.4% [47] 52502(99.6%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk14 [1] 48.0% loop [10] 42.1% run-improve58 [2] 7.8% simplify [4] 2.1% ---------------------------------------------------------------------- post-process [22] 0.1% loop! [64] 0.1% make-exacts* [26] 0.7% map [37] 2.0% ??? [3] 17.7% loop [48] 79.4% [48] 41674(79.1%) 242(0.5%) loop ...cket/collects/racket/private/map.rkt:26:19 loop [48] 79.4% hash-ref! [73] 17.7% ??? [72] 2.5% ->flonum [55] 0.2% loop! [64] 0.1% completely-simplify-alt [7] 0.1% ---------------------------------------------------------------------- append-map [42] 39.2% for-loop [40] 60.8% [49] 1082(2.1%) 0(0.0%) taylor-alt ...e/ztatlock/herbie/src/glue.rkt:142:0 for-loop [56] 100.0% ---------------------------------------------------------------------- loop [43] 49.9% one-iter [28] 50.1% [50] 802(1.5%) 0(0.0%) apply-match .../herbie/src/core/simplify.rkt:122:2 match-e [54] 50.1% for-loop [58] 24.9% merge-egraph-nodes! [59] 24.9% ---------------------------------------------------------------------- ??? [41] 100.0% [51] 644(1.2%) 0(0.0%) for-loop ...ock/herbie/src/core/alt-table.rkt:51:2 atab-add-altn [57] 100.0% ---------------------------------------------------------------------- for-loop [45] 100.0% [52] 200(0.4%) 200(0.4%) setfindf ...e/ztatlock/herbie/src/common.rkt:173:0 ---------------------------------------------------------------------- for-loop [46] 100.0% [53] 200(0.4%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 expression-cost [60] 100.0% ---------------------------------------------------------------------- for-loop [67] 8.9% apply-match [50] 17.8% for-loop [39] 73.3% [54] 2260(4.3%) 1454(2.8%) match-e ...tatlock/herbie/src/core/ematch.rkt:46:0 for-loop [62] 31.3% list-cartesian-product [68] 8.8% for-loop [67] 4.5% ---------------------------------------------------------------------- loop [48] 100.0% [55] 1322(2.5%) 246(0.5%) ->flonum ...ock/herbie/src/syntax/syntax.rkt:224:0 ??? [98] 48.6% ??? [96] 32.8% ---------------------------------------------------------------------- taylor-alt [49] 100.0% [56] 1082(2.1%) 0(0.0%) for-loop /home/ztatlock/herbie/src/glue.rkt:144:2 location-do [61] 100.0% ---------------------------------------------------------------------- for-loop [51] 100.0% [57] 644(1.2%) 0(0.0%) atab-add-altn ...rbie/src/core/alt-table.rkt:208:0 best-and-tied-at-points [63] 100.0% ---------------------------------------------------------------------- apply-match [50] 100.0% [58] 200(0.4%) 0(0.0%) for-loop ...ck/herbie/src/core/simplify.rkt:136:10 loop! [64] 100.0% ---------------------------------------------------------------------- merge-egraph-nodes! [59] 50.0% apply-match [50] 50.0% [59] 200(0.4%) 0(0.0%) merge-egraph-nodes! ...e/src/core/egraph.rkt:152:0 merge-egraph-nodes! [59] 50.0% loop! [64] 50.0% ---------------------------------------------------------------------- argmin [53] 100.0% [60] 200(0.4%) 0(0.0%) expression-cost ...k/herbie/src/programs.rkt:212:0 compile [65] 100.0% ---------------------------------------------------------------------- for-loop [56] 35.2% location-do [61] 64.8% [61] 1082(2.1%) 0(0.0%) location-do ...tlock/herbie/src/programs.rkt:129:0 location-do [61] 64.8% approximate9 [5] 35.2% ---------------------------------------------------------------------- match-e [54] 100.0% [62] 808(1.5%) 404(0.8%) for-loop ...tlock/herbie/src/core/ematch.rkt:59:11 list-cartesian-product [68] 25.0% for-loop [67] 25.0% ---------------------------------------------------------------------- atab-add-altn [57] 100.0% [63] 644(1.2%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 errors [66] 100.0% ---------------------------------------------------------------------- merge-egraph-nodes! [59] 25.0% for-loop [58] 25.0% loop [48] 50.0% [64] 400(0.8%) 0(0.0%) loop! .../ztatlock/herbie/src/core/enode.rkt:163:2 loop [48] 50.0% set [69] 50.0% ---------------------------------------------------------------------- expression-cost [60] 100.0% [65] 200(0.4%) 0(0.0%) compile .../ztatlock/herbie/src/programs.rkt:189:0 hash-ref! [73] 100.0% ---------------------------------------------------------------------- best-and-tied-at-points [63] 100.0% [66] 644(1.2%) 0(0.0%) errors /home/ztatlock/herbie/src/points.rkt:144:0 for-loop [71] 65.5% eval-prog [70] 34.5% ---------------------------------------------------------------------- for-loop [62] 50.0% match-e [54] 50.0% [67] 404(0.8%) 0(0.0%) for-loop ...tlock/herbie/src/core/ematch.rkt:65:37 match-e [54] 100.0% ---------------------------------------------------------------------- match-e [54] 49.8% for-loop [62] 50.2% [68] 402(0.8%) 402(0.8%) list-cartesian-product ...src/core/ematch.rkt:20:0 ---------------------------------------------------------------------- loop! [64] 100.0% [69] 400(0.8%) 400(0.8%) set ...collects/racket/private/set-types.rkt:982:0 ---------------------------------------------------------------------- errors [66] 1.7% make-exacts* [26] 32.4% loop [19] 65.9% [70] 13036(24.7%) 0(0.0%) eval-prog ...tatlock/herbie/src/programs.rkt:162:0 hash-ref! [73] 98.3% parse-app [74] 1.7% ---------------------------------------------------------------------- errors [66] 100.0% [71] 422(0.8%) 202(0.4%) for-loop ...e/ztatlock/herbie/src/points.rkt:147:4 ??? [72] 52.1% ---------------------------------------------------------------------- map [37] 0.6% for-loop [71] 0.7% loop [48] 98.7% [72] 32540(61.7%) 3002(5.7%) ??? /home/ztatlock/herbie/src/programs.rkt:168:4 ??? [75] 71.1% real->bigfloat [77] 16.2% ??? [92] 3.4% ---------------------------------------------------------------------- for-loop [17] 0.2% compile [65] 0.5% for-loop [16] 0.9% ??? [3] 0.9% localize-error [34] 1.4% loop [13] 1.9% loop [48] 33.6% eval-prog [70] 56.0% [73] 14296(27.1%) 414(0.8%) hash-ref! ...racket/private/more-scheme.rkt:373:13 bigfloat-hash [76] 54.5% ??? [3] 34.6% simplify [78] 2.4% parse-loop50 [84] 1.4% ??? [6] 1.2% ??? [8] 0.2% ---------------------------------------------------------------------- eval-prog [70] 100.0% [74] 222(0.4%) 0(0.0%) parse-app .../collects/racket/private/kw.rkt:903:2 loop [79] 100.0% ---------------------------------------------------------------------- ??? [72] 100.0% [75] 23142(43.9%) 1622(3.1%) ??? ...acket/collects/racket/private/kw.rkt:400:14 ??? [86] 46.0% bf* [80] 29.1% ...higher-order.rkt:373:33 [83] 16.9% ??? [98] 1.0% ---------------------------------------------------------------------- hash-ref! [73] 100.0% [76] 12600(23.9%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 sig+exp->bigfloat [81] 52.2% bfcanonicalize [82] 47.8% ---------------------------------------------------------------------- ??? [72] 100.0% [77] 5286(10.0%) 4116(7.8%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [97] 22.1% ---------------------------------------------------------------------- hash-ref! [73] 100.0% [78] 860(1.6%) 0(0.0%) simplify ...atlock/herbie/src/core/reduce.rkt:18:0 parse-loop50 [84] 48.8% debug7 [85] 25.6% f37 [88] 25.6% ---------------------------------------------------------------------- parse-app [74] 100.0% [79] 222(0.4%) 222(0.4%) loop .../collects/racket/private/stxcase.rkt:112:7 ---------------------------------------------------------------------- ??? [75] 100.0% [80] 6740(12.8%) 0(0.0%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [86] 100.0% ---------------------------------------------------------------------- bigfloat-hash [76] 100.0% [81] 6582(12.5%) 6582(12.5%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 ---------------------------------------------------------------------- bigfloat-hash [76] 100.0% [82] 6018(11.4%) 5780(11.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 bigfloat->sig+exp [89] 4.0% ---------------------------------------------------------------------- ??? [75] 100.0% [83] 3908(7.4%) 0(0.0%) ...higher-order.rkt:373:33 (unknown source) ??? [87] 93.9% ??? [92] 6.1% ---------------------------------------------------------------------- parse-loop50 [84] 13.0% hash-ref! [73] 23.8% map [37] 26.2% simplify [78] 37.0% [84] 840(1.6%) 422(0.8%) parse-loop50 ...s/racket/match/compiler.rkt:410:15 loop [90] 23.8% parse-loop50 [84] 13.0% f37 [88] 13.0% ---------------------------------------------------------------------- simplify [78] 100.0% [85] 220(0.4%) 220(0.4%) debug7 /home/ztatlock/herbie/src/debug.rkt:102:0 ---------------------------------------------------------------------- bf* [80] 38.8% ??? [75] 61.2% [86] 17392(33.0%) 1836(3.5%) ??? ...-racket/utils/simple-result-arrow.rkt:26:12 bfmul [91] 46.1% ??? [96] 23.3% bfsqrt [93] 20.1% ---------------------------------------------------------------------- ...higher-order.rkt:373:33 [83]100.0% [87] 3668(7.0%) 200(0.4%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [92] 94.5% ---------------------------------------------------------------------- map [37] 17.2% simplify [78] 17.2% approximate9 [5] 31.6% parse-loop50 [84] 34.1% [88] 640(1.2%) 218(0.4%) f37 ...t/collects/racket/match/compiler.rkt:499:40 map [37] 65.9% ---------------------------------------------------------------------- bfcanonicalize [82] 100.0% [89] 238(0.5%) 0(0.0%) bigfloat->sig+exp ...ivate/bigfloat/mpfr.rkt:370:0 size+limbs->integer [94] 100.0% ---------------------------------------------------------------------- parse-loop50 [84] 2.3% loop [90] 97.7% [90] 200(0.4%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:37:19 loop [90] 97.7% ulp-difference [95] 2.3% ---------------------------------------------------------------------- ??? [86] 100.0% [91] 8012(15.2%) 5886(11.2%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [97] 26.5% ---------------------------------------------------------------------- ...higher-order.rkt:373:33 [83] 5.0% ??? [72] 23.0% ??? [87] 72.0% [92] 4818(9.1%) 220(0.4%) ??? ...ects/racket/contract/private/guts.rkt:638:8 ??? [96] 95.4% ---------------------------------------------------------------------- ??? [86] 100.0% [93] 3492(6.6%) 2548(4.8%) bfsqrt ...lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [97] 27.0% ---------------------------------------------------------------------- bigfloat->sig+exp [89] 100.0% [94] 238(0.5%) 238(0.5%) size+limbs->integer ...vate/bigfloat/gmp.rkt:103:0 ---------------------------------------------------------------------- loop [90] 100.0% [95] 200(0.4%) 0(0.0%) ulp-difference ...atlock/herbie/src/float.rkt:19:0 ??? [98] 100.0% ---------------------------------------------------------------------- ->flonum [55] 4.8% ??? [86] 44.6% ??? [92] 50.6% [96] 9084(17.2%) 3084(5.8%) ??? ...tract/private/arrow-higher-order.rkt:373:33 ??? [99] 60.5% ??? [100] 5.6% ---------------------------------------------------------------------- bfsqrt [93] 22.3% real->bigfloat [77] 27.6% bfmul [91] 50.1% [97] 4240(8.0%) 4240(8.0%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ---------------------------------------------------------------------- ulp-difference [95] 18.8% ??? [75] 20.7% ->flonum [55] 60.5% [98] 1062(2.0%) 1062(2.0%) ??? /home/ztatlock/herbie/src/config.rkt:29:0 ---------------------------------------------------------------------- ??? [96] 100.0% [99] 5492(10.4%) 1804(3.4%) ??? ...llects/racket/contract/combinator.rkt:178:4 any-wrap/traverse [101] 67.2% ---------------------------------------------------------------------- ??? [96] 100.0% [100] 508(1.0%) 508(1.0%) ??? ...ects/racket/contract/private/prop.rkt:489:4 ---------------------------------------------------------------------- ??? [99] 100.0% [101] 3688(7.0%) 3688(7.0%) any-wrap/traverse ...cket/utils/any-wrap.rkt:106:2 ----------------------------------------------------------------------