Profiling results ----------------- Total cpu time observed: 86526ms (out of 87176ms) Number of samples taken: 263 (once every 329ms) (Hiding functions with self<1.0% and local<2.0%: 2 of 216 hidden) ========================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ========================================================================== ??? [21] 100.0% [1] 86526(100.0%) 0(0.0%) profile-thunk16 ...e/pkgs/profile-lib/main.rkt:9:0 run [12] 100.0% -------------------------------------------------------------------------- match-e [117] 100.0% [2] 2540(2.9%) 0(0.0%) variable? .../develop/src/syntax/syntax.rkt:1159:0 ??? [133] 100.0% -------------------------------------------------------------------------- matcher [96] 100.0% [3] 1624(1.9%) 0(0.0%) ??? .../herbie/develop/src/core/matcher.rkt:130:11 for-loop [13] 100.0% -------------------------------------------------------------------------- hash-ref! [146] 100.0% [4] 1288(1.5%) 0(0.0%) simplify ...erbie/develop/src/core/reduce.rkt:16:0 f46 [18] 51.1% parse-loop80 [14] 48.9% -------------------------------------------------------------------------- ??? [79] 100.0% [5] 1288(1.5%) 0(0.0%) approximate9 ...e/develop/src/core/taylor.rkt:12:0 loop [15] 100.0% -------------------------------------------------------------------------- for-loop [204] 32.5% loop [205] 67.5% [6] 1034(1.2%) 0(0.0%) dispatch-transformer41 (unknown source) apply-transformer52 [16] 100.0% -------------------------------------------------------------------------- hash-ref! [146] 100.0% [7] 658(0.8%) 0(0.0%) ??? ...es/herbie/develop/src/core/taylor.rkt:68:15 ??? [79] 100.0% -------------------------------------------------------------------------- for-loop [204] 47.3% loop [205] 52.7% [8] 638(0.7%) 0(0.0%) syntax-e (unknown source) syntax-e/no-taint [17] 100.0% -------------------------------------------------------------------------- hash-ref! [146] 100.0% [9] 362(0.4%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:407:23 for-loop [20] 100.0% -------------------------------------------------------------------------- hash-ref! [146] 100.0% [10] 362(0.4%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:291:26 for-loop [19] 100.0% -------------------------------------------------------------------------- copying-mergesort [89] 100.0% [11] 304(0.4%) 0(0.0%) loop ...7.0/collects/racket/private/sort.rkt:96:12 ??? [79] 100.0% -------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [12] 86526(100.0%) 0(0.0%) run ...et-7.0/share/pkgs/profile-lib/main.rkt:39:2 ??? [21] 100.0% -------------------------------------------------------------------------- ??? [3] 100.0% [13] 1624(1.9%) 0(0.0%) for-loop ...ie/develop/src/core/matcher.rkt:132:15 matcher [96] 100.0% -------------------------------------------------------------------------- simplify [4] 48.9% map [40] 51.1% [14] 1288(1.5%) 0(0.0%) parse-loop80 ...s/racket/match/compiler.rkt:418:15 eval-const-expr [22] 100.0% -------------------------------------------------------------------------- approximate9 [5] 100.0% [15] 1288(1.5%) 0(0.0%) loop ...es/herbie/develop/src/core/taylor.rkt:87:4 hash-ref! [146] 51.1% ??? [79] 48.9% -------------------------------------------------------------------------- dispatch-transformer41 [6] 100.0% [16] 1034(1.2%) 0(0.0%) apply-transformer52 (unknown source) apply-transformer-in-context [23] 65.0% loop [205] 35.0% -------------------------------------------------------------------------- expand-id-application-form17 [209] 34.2% syntax-e [8] 65.8% [17] 970(1.1%) 0(0.0%) syntax-e/no-taint (unknown source) loop [205] 100.0% -------------------------------------------------------------------------- map [40] 50.0% simplify [4] 50.0% [18] 658(0.8%) 0(0.0%) f46 ...0/collects/racket/match/compiler.rkt:507:40 map [40] 100.0% -------------------------------------------------------------------------- ??? [10] 100.0% [19] 362(0.4%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:291:52 hash-ref! [146] 100.0% -------------------------------------------------------------------------- ??? [9] 100.0% [20] 362(0.4%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:411:33 for-loop [24] 100.0% -------------------------------------------------------------------------- for-loop [109] 0.2% for-loop [177] 0.8% run [12] 49.5% [21] 86526(100.0%) 312(0.4%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 49.5% run-improve40 [25] 39.9% prepare-points-intervals [26] 8.1% get-final-combination [27] 0.5% ??? [44] 0.5% errors [169] 0.4% oracle-error [28] 0.4% eval-const-expr [22] 0.2% eval-errors [29] 0.2% ??? [79] 0.1% -------------------------------------------------------------------------- ??? [21] 33.0% parse-loop80 [14] 67.0% [22] 1922(2.2%) 0(0.0%) eval-const-expr .../develop/src/programs.rkt:149:0 eval-prog [176] 100.0% -------------------------------------------------------------------------- apply-transformer52 [16] 100.0% [23] 672(0.8%) 336(0.4%) apply-transformer-in-context (unknown source) ??? [30] 50.0% -------------------------------------------------------------------------- for-loop [20] 100.0% [24] 362(0.4%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:413:39 hash-ref! [146] 100.0% -------------------------------------------------------------------------- ??? [21] 100.0% [25] 69626(80.5%) 0(0.0%) run-improve40 ...ie/develop/src/mainloop.rkt:336:0 for-loop [31] 78.2% simplify! [43] 21.8% -------------------------------------------------------------------------- ??? [21] 100.0% [26] 13956(16.1%) 0(0.0%) prepare-points-intervals ...p/src/points.rkt:133:0 loop [32] 100.0% -------------------------------------------------------------------------- ??? [21] 100.0% [27] 942(1.1%) 0(0.0%) get-final-combination ...op/src/mainloop.rkt:357:0 infer-splitpoints [33] 100.0% -------------------------------------------------------------------------- ??? [21] 100.0% [28] 624(0.7%) 0(0.0%) oracle-error ...erbie/develop/src/points.rkt:212:0 for-loop [34] 100.0% -------------------------------------------------------------------------- ??? [21] 100.0% [29] 360(0.4%) 0(0.0%) eval-errors ...herbie/develop/src/points.rkt:203:0 for-loop [35] 100.0% -------------------------------------------------------------------------- apply-transformer-in-context [23] 100.0% [30] 336(0.4%) 0(0.0%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [36] 100.0% -------------------------------------------------------------------------- run-improve40 [25] 100.0% [31] 54418(62.9%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:351:4 run-iter! [37] 100.0% -------------------------------------------------------------------------- prepare-points-intervals [26] 100.0% [32] 13956(16.1%) 0(0.0%) loop ...htlies/herbie/develop/src/points.rkt:145:4 loop [38] 86.2% ??? [39] 13.8% -------------------------------------------------------------------------- get-final-combination [27] 100.0% [33] 942(1.1%) 0(0.0%) infer-splitpoints ...lop/src/core/regimes.rkt:34:0 for-loop [41] 100.0% -------------------------------------------------------------------------- oracle-error [28] 100.0% [34] 624(0.7%) 0(0.0%) for-loop ...es/herbie/develop/src/points.rkt:213:2 map [40] 51.9% loop [175] 48.1% -------------------------------------------------------------------------- eval-errors [29] 100.0% [35] 360(0.4%) 0(0.0%) for-loop ...es/herbie/develop/src/points.rkt:205:2 ??? [79] 100.0% -------------------------------------------------------------------------- ??? [30] 100.0% [36] 336(0.4%) 0(0.0%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 syntax->list [42] 100.0% -------------------------------------------------------------------------- for-loop [31] 100.0% [37] 54418(62.9%) 0(0.0%) run-iter! ...herbie/develop/src/mainloop.rkt:317:0 simplify! [43] 86.3% finalize-iter! [45] 7.7% gen-rewrites! [46] 3.0% gen-series! [47] 2.4% localize! [49] 0.7% -------------------------------------------------------------------------- loop [32] 100.0% [38] 12028(13.9%) 290(0.3%) loop ...htlies/herbie/develop/src/points.rkt:104:2 ??? [44] 95.1% ??? [133] 2.5% -------------------------------------------------------------------------- loop [32] 100.0% [39] 1928(2.2%) 336(0.4%) ??? ...ghtlies/herbie/develop/src/points.rkt:129:2 ??? [79] 51.5% ??? [62] 31.1% -------------------------------------------------------------------------- for-loop [34] 33.0% f46 [18] 67.0% [40] 982(1.1%) 0(0.0%) map ...t-7.0/collects/racket/private/map.rkt:35:13 f46 [18] 33.5% parse-loop80 [14] 33.5% ??? [50] 33.0% -------------------------------------------------------------------------- infer-splitpoints [33] 100.0% [41] 942(1.1%) 0(0.0%) for-loop ...rbie/develop/src/core/regimes.rkt:46:6 option-on-expr [48] 100.0% -------------------------------------------------------------------------- ??? [36] 100.0% [42] 336(0.4%) 0(0.0%) syntax->list (unknown source) loop [205] 100.0% -------------------------------------------------------------------------- run-improve40 [25] 24.5% run-iter! [37] 75.5% [43] 62190(71.9%) 0(0.0%) simplify! ...herbie/develop/src/mainloop.rkt:213:0 ??? [51] 99.5% for-loop [57] 0.5% -------------------------------------------------------------------------- loop [175] 2.2% ??? [50] 2.4% ??? [21] 9.8% loop [38] 85.5% [44] 13382(15.5%) 924(1.1%) ??? ...tlies/herbie/develop/src/programs.rkt:146:2 ??? [52] 73.3% ??? [79] 19.8% -------------------------------------------------------------------------- run-iter! [37] 100.0% [45] 4164(4.8%) 0(0.0%) finalize-iter! ...e/develop/src/mainloop.rkt:268:0 ??? [133] 100.0% -------------------------------------------------------------------------- run-iter! [37] 100.0% [46] 1624(1.9%) 0(0.0%) gen-rewrites! ...ie/develop/src/mainloop.rkt:172:0 for-loop [53] 100.0% -------------------------------------------------------------------------- run-iter! [37] 100.0% [47] 1288(1.5%) 0(0.0%) gen-series! ...rbie/develop/src/mainloop.rkt:149:0 for-loop [54] 100.0% -------------------------------------------------------------------------- for-loop [41] 100.0% [48] 942(1.1%) 0(0.0%) option-on-expr ...velop/src/core/regimes.rkt:150:0 err-lsts->split-indices [56] 35.0% for-loop [58] 32.7% sort-context-on-expr [59] 32.3% -------------------------------------------------------------------------- run-iter! [37] 100.0% [49] 360(0.4%) 0(0.0%) localize! ...herbie/develop/src/mainloop.rkt:116:0 localize-error [55] 100.0% -------------------------------------------------------------------------- map [40] 100.0% [50] 324(0.4%) 0(0.0%) ??? ...htlies/herbie/develop/src/points.rkt:214:26 ??? [44] 100.0% -------------------------------------------------------------------------- simplify! [43] 100.0% [51] 61864(71.5%) 0(0.0%) ??? ...s/herbie/develop/src/core/simplify.rkt:26:0 for-loop [60] 57.5% loop [61] 25.0% one-iter [69] 17.5% -------------------------------------------------------------------------- ??? [44] 100.0% [52] 9806(11.3%) 0(0.0%) ??? ...t-7.0/collects/racket/private/kw.rkt:592:14 ??? [62] 52.6% ??? [79] 44.4% ??? [68] 3.0% -------------------------------------------------------------------------- gen-rewrites! [46] 100.0% [53] 1624(1.9%) 0(0.0%) for-loop ...herbie/develop/src/mainloop.rkt:180:11 rewrite-expression-head20 [63] 100.0% -------------------------------------------------------------------------- gen-series! [47] 100.0% [54] 1288(1.5%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:156:7 taylor-alt [64] 100.0% -------------------------------------------------------------------------- localize! [49] 100.0% [55] 360(0.4%) 0(0.0%) localize-error ...velop/src/core/localize.rkt:52:0 ??? [65] 100.0% -------------------------------------------------------------------------- option-on-expr [48] 100.0% [56] 330(0.4%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:281:0 loop [66] 100.0% -------------------------------------------------------------------------- simplify! [43] 100.0% [57] 326(0.4%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:218:6 debug5 [67] 100.0% -------------------------------------------------------------------------- option-on-expr [48] 100.0% [58] 308(0.4%) 0(0.0%) for-loop ...bie/develop/src/core/regimes.rkt:158:4 errors [169] 100.0% -------------------------------------------------------------------------- option-on-expr [48] 100.0% [59] 304(0.4%) 0(0.0%) sort-context-on-expr ...src/core/regimes.rkt:145:0 ??? [65] 100.0% -------------------------------------------------------------------------- ??? [51] 100.0% [60] 35564(41.1%) 0(0.0%) for-loop ...bie/develop/src/core/simplify.rkt:33:2 one-iter [69] 100.0% -------------------------------------------------------------------------- ??? [51] 100.0% [61] 15452(17.9%) 0(0.0%) loop ...herbie/develop/src/core/simplify.rkt:143:2 for-loop [70] 100.0% -------------------------------------------------------------------------- ??? [39] 10.4% ??? [52] 89.6% [62] 5756(6.7%) 1916(2.2%) ??? ...tract/private/arrow-higher-order.rkt:361:33 ival-exp [71] 50.0% ival-sub [75] 11.5% ??? [154] 5.2% -------------------------------------------------------------------------- for-loop [53] 100.0% [63] 1624(1.9%) 0(0.0%) rewrite-expression-head20 ...core/matcher.rkt:87:0 rewriter [72] 100.0% -------------------------------------------------------------------------- for-loop [54] 100.0% [64] 1288(1.5%) 0(0.0%) taylor-alt ...erbie/develop/src/mainloop.rkt:135:0 for-loop [73] 100.0% -------------------------------------------------------------------------- sort-context-on-expr [59] 45.8% localize-error [55] 54.2% [65] 664(0.8%) 0(0.0%) ??? ...-7.0/collects/racket/private/sort.rkt:369:3 generic-sort/key [74] 100.0% -------------------------------------------------------------------------- err-lsts->split-indices [56] 100.0% [66] 330(0.4%) 0(0.0%) loop .../herbie/develop/src/core/regimes.rkt:332:4 for-loop [76] 100.0% -------------------------------------------------------------------------- for-loop [57] 100.0% [67] 326(0.4%) 326(0.4%) debug5 ...tlies/herbie/develop/src/debug.rkt:102:0 -------------------------------------------------------------------------- ??? [52] 100.0% [68] 292(0.3%) 292(0.3%) ??? ...herbie/develop/src/syntax/syntax.rkt:317:17 -------------------------------------------------------------------------- ??? [51] 23.4% for-loop [60] 76.6% [69] 46412(53.6%) 334(0.4%) one-iter ...bie/develop/src/core/simplify.rkt:86:0 for-loop [77] 50.9% find-matches [78] 44.1% for-loop [83] 4.3% -------------------------------------------------------------------------- loop [61] 100.0% [70] 15452(17.9%) 0(0.0%) for-loop ...ie/develop/src/core/simplify.rkt:149:4 loop [80] 42.7% argmin [81] 27.0% expression-cost [92] 12.3% for-loop [84] 12.0% for-loop [174] 4.1% make-sequence [129] 1.9% -------------------------------------------------------------------------- ??? [62] 100.0% [71] 2876(3.3%) 678(0.8%) ival-exp ...rbie/develop/src/biginterval.rkt:182:0 bfexp [82] 76.4% -------------------------------------------------------------------------- rewrite-expression-head20 [63] 33.4% matcher [96] 66.6% [72] 1624(1.9%) 0(0.0%) rewriter ...rbie/develop/src/core/matcher.rkt:89:2 for-loop [85] 88.5% *rules* [86] 11.5% -------------------------------------------------------------------------- taylor-alt [64] 100.0% [73] 1288(1.5%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:141:6 ??? [79] 100.0% -------------------------------------------------------------------------- ??? [65] 100.0% [74] 664(0.8%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:156:2 jloop [87] 54.2% copying-mergesort [89] 45.8% -------------------------------------------------------------------------- ??? [62] 100.0% [75] 662(0.8%) 326(0.4%) ival-sub ...rbie/develop/src/biginterval.rkt:102:0 bfmul [108] 50.8% -------------------------------------------------------------------------- loop [66] 100.0% [76] 330(0.4%) 0(0.0%) for-loop ...bie/develop/src/core/regimes.rkt:297:4 for-loop [88] 100.0% -------------------------------------------------------------------------- one-iter [69] 100.0% [77] 23618(27.3%) 600(0.7%) for-loop ...bie/develop/src/core/simplify.rkt:95:2 loop [90] 93.5% update-leader! [134] 2.7% reduce-to-single! [104] 1.3% -------------------------------------------------------------------------- one-iter [69] 100.0% [78] 20482(23.7%) 0(0.0%) find-matches ...develop/src/core/simplify.rkt:56:0 for-loop [91] 100.0% -------------------------------------------------------------------------- loop [15] 2.0% ??? [7] 2.1% loop [11] 3.0% ??? [21] 3.2% for-loop [35] 3.5% location-do [98] 4.2% for-loop [73] 4.2% ??? [39] 9.6% ??? [44] 25.8% ??? [52] 42.4% [79] 10280(11.9%) 654(0.8%) ??? ...tract/private/arrow-higher-order.rkt:357:33 ival-mult [93] 42.4% ->flonum [95] 16.2% mk-ival [97] 12.8% sample-multi-bounded [100] 6.8% location-do [98] 4.2% approximate9 [5] 4.2% hash-ref! [146] 4.2% ??? [105] 2.9% -------------------------------------------------------------------------- for-loop [70] 100.0% [80] 6604(7.6%) 0(0.0%) loop .../racket-7.0/collects/racket/list.rkt:751:4 expression-cost [92] 57.6% for-loop [174] 42.4% -------------------------------------------------------------------------- for-loop [70] 100.0% [81] 4166(4.8%) 0(0.0%) argmin ...acket-7.0/collects/racket/list.rkt:765:0 expression-cost [92] 62.2% for-loop [174] 37.8% -------------------------------------------------------------------------- ival-exp [71] 100.0% [82] 2198(2.5%) 0(0.0%) bfexp ...-lib/math/private/bigfloat/mpfr.rkt:618:4 new-mpfr [119] 100.0% -------------------------------------------------------------------------- one-iter [69] 100.0% [83] 1978(2.3%) 0(0.0%) for-loop ...ie/develop/src/core/simplify.rkt:111:2 set-precompute! [94] 100.0% -------------------------------------------------------------------------- for-loop [70] 100.0% [84] 1854(2.1%) 922(1.1%) for-loop ...e/develop/src/core/simplify.rkt:153:16 for-loop [99] 50.3% -------------------------------------------------------------------------- rewriter [72] 100.0% [85] 1624(1.9%) 0(0.0%) for-loop ...rbie/develop/src/core/matcher.rkt:91:4 matcher [96] 84.9% for-loop [101] 15.1% -------------------------------------------------------------------------- rewriter [72] 100.0% [86] 634(0.7%) 0(0.0%) *rules* ...rbie/develop/src/syntax/rules.rkt:783:0 for-loop [102] 100.0% -------------------------------------------------------------------------- generic-sort/key [74] 100.0% [87] 360(0.4%) 0(0.0%) jloop ...0/collects/racket/private/sort.rkt:120:23 errors-score [103] 100.0% -------------------------------------------------------------------------- for-loop [76] 100.0% [88] 330(0.4%) 0(0.0%) for-loop ...bie/develop/src/core/regimes.rkt:301:8 curried [139] 100.0% -------------------------------------------------------------------------- generic-sort/key [74] 33.3% copying-mergesort [89] 66.7% [89] 304(0.4%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:129:8 copying-mergesort [89] 66.7% loop [11] 33.3% -------------------------------------------------------------------------- for-loop [77] 100.0% [90] 22080(25.5%) 0(0.0%) loop ...herbie/develop/src/core/simplify.rkt:100:4 apply-match [106] 100.0% -------------------------------------------------------------------------- for-loop [91] 48.3% find-matches [78] 51.7% [91] 20482(23.7%) 3886(4.5%) for-loop ...bie/develop/src/core/simplify.rkt:58:8 for-loop [91] 48.3% match-e [117] 40.5% -------------------------------------------------------------------------- argmax [170] 4.2% for-loop [70] 22.0% argmin [81] 29.9% loop [80] 43.9% [92] 8664(10.0%) 600(0.7%) expression-cost .../develop/src/programs.rkt:204:0 compile [107] 93.1% -------------------------------------------------------------------------- ??? [79] 100.0% [93] 4358(5.0%) 610(0.7%) ival-mult ...bie/develop/src/biginterval.rkt:114:0 bfmul [108] 86.0% -------------------------------------------------------------------------- for-loop [83] 100.0% [94] 1978(2.3%) 0(0.0%) set-precompute! ...lop/src/core/simplify.rkt:117:0 for-loop [109] 100.0% -------------------------------------------------------------------------- ??? [79] 100.0% [95] 1670(1.9%) 1010(1.2%) ->flonum ...s/herbie/develop/src/programs.rkt:38:0 return/no-unsupplied [114] 21.6% ??? [111] 18.0% -------------------------------------------------------------------------- for-loop [13] 50.0% for-loop [85] 50.0% [96] 1624(1.9%) 332(0.4%) matcher ...rbie/develop/src/core/matcher.rkt:118:2 ??? [3] 50.0% rewriter [72] 46.6% -------------------------------------------------------------------------- ??? [79] 100.0% [97] 1318(1.5%) 0(0.0%) mk-ival ...herbie/develop/src/biginterval.rkt:59:0 bf [110] 100.0% -------------------------------------------------------------------------- location-do [98] 39.8% ??? [79] 60.2% [98] 1288(1.5%) 0(0.0%) location-do ...rbie/develop/src/programs.rkt:111:0 ??? [79] 60.2% location-do [98] 39.8% -------------------------------------------------------------------------- for-loop [84] 100.0% [99] 932(1.1%) 932(1.1%) for-loop ...e/develop/src/core/simplify.rkt:157:23 -------------------------------------------------------------------------- ??? [79] 100.0% [100] 696(0.8%) 310(0.4%) sample-multi-bounded ...evelop/src/points.rkt:16:0 ??? [111] 55.5% -------------------------------------------------------------------------- for-loop [85] 100.0% [101] 658(0.8%) 0(0.0%) for-loop ...rbie/develop/src/core/matcher.rkt:99:8 fix-up-variables [112] 100.0% -------------------------------------------------------------------------- *rules* [86] 100.0% [102] 634(0.7%) 0(0.0%) for-loop ...ies/herbie/develop/src/common.rkt:71:9 flag-set? [113] 100.0% -------------------------------------------------------------------------- jloop [87] 100.0% [103] 360(0.4%) 0(0.0%) errors-score ...erbie/develop/src/points.rkt:220:0 loop [115] 100.0% -------------------------------------------------------------------------- for-loop [77] 100.0% [104] 300(0.3%) 0(0.0%) reduce-to-single! ...lop/src/core/egraph.rkt:320:0 for-loop [116] 100.0% -------------------------------------------------------------------------- ??? [79] 100.0% [105] 296(0.3%) 296(0.3%) ??? ...cts/racket/contract/private/list.rkt:209:10 -------------------------------------------------------------------------- loop [90] 100.0% [106] 22080(25.5%) 350(0.4%) apply-match .../develop/src/core/simplify.rkt:65:0 for-loop [118] 77.0% match-e [117] 14.5% set [187] 4.2% custom-set-intersect [121] 2.8% -------------------------------------------------------------------------- expression-cost [92] 100.0% [107] 8064(9.3%) 986(1.1%) compile ...s/herbie/develop/src/programs.rkt:181:0 hash-ref! [146] 87.8% -------------------------------------------------------------------------- ival-sub [75] 8.2% ival-mult [93] 91.8% [108] 4084(4.7%) 0(0.0%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:821:4 new-mpfr [119] 68.6% ??? [120] 31.4% -------------------------------------------------------------------------- set-precompute! [94] 100.0% [109] 1978(2.3%) 0(0.0%) for-loop ...ie/develop/src/core/simplify.rkt:119:2 merge-egraph-nodes! [126] 52.9% ??? [21] 32.1% setfindf [124] 15.1% -------------------------------------------------------------------------- mk-ival [97] 100.0% [110] 1318(1.5%) 0(0.0%) bf ...ath-lib/math/private/bigfloat/mpfr.rkt:601:2 new-mpfr [119] 100.0% -------------------------------------------------------------------------- ->flonum [95] 43.7% sample-multi-bounded [100] 56.3% [111] 686(0.8%) 686(0.8%) ??? ...s/racket/contract/private/arr-i.rkt:1252:29 -------------------------------------------------------------------------- for-loop [101] 100.0% [112] 658(0.8%) 0(0.0%) fix-up-variables ...lop/src/core/matcher.rkt:111:2 for-loop [122] 50.8% pattern-match [123] 49.2% -------------------------------------------------------------------------- for-loop [102] 100.0% [113] 634(0.7%) 634(0.7%) flag-set? ...es/herbie/develop/src/config.rkt:28:0 -------------------------------------------------------------------------- ->flonum [95] 100.0% [114] 360(0.4%) 360(0.4%) return/no-unsupplied ...ct/private/arr-i.rkt:534:0 -------------------------------------------------------------------------- errors-score [103] 100.0% [115] 360(0.4%) 360(0.4%) loop .../racket-7.0/collects/racket/list.rkt:559:2 -------------------------------------------------------------------------- reduce-to-single! [104] 100.0% [116] 300(0.3%) 300(0.3%) for-loop ...rbie/develop/src/core/egraph.rkt:321:8 -------------------------------------------------------------------------- apply-match [106] 8.7% for-loop [132] 35.1% for-loop [91] 56.2% [117] 19790(22.9%) 2568(3.0%) match-e ...herbie/develop/src/core/ematch.rkt:39:0 for-loop [125] 77.3% ??? [133] 6.0% variable? [2] 4.8% make-sequence [129] 1.5% -------------------------------------------------------------------------- apply-match [106] 100.0% [118] 16994(19.6%) 0(0.0%) for-loop ...bie/develop/src/core/simplify.rkt:78:2 merge-egraph-nodes! [126] 79.3% dedup-children! [135] 11.5% substitute-e [127] 7.3% mk-enode! [153] 1.9% -------------------------------------------------------------------------- bf [110] 20.9% bfexp [82] 34.8% bfmul [108] 44.3% [119] 6318(7.3%) 6318(7.3%) new-mpfr ...b/math/private/bigfloat/mpfr.rkt:335:0 -------------------------------------------------------------------------- bfmul [108] 100.0% [120] 1282(1.5%) 1282(1.5%) ??? /opt/racket-7.0/collects/ffi/unsafe.rkt:898:4 -------------------------------------------------------------------------- apply-match [106] 100.0% [121] 614(0.7%) 290(0.3%) custom-set-intersect ...rivate/set-types.rkt:195:0 for-loop [130] 52.8% -------------------------------------------------------------------------- fix-up-variables [112] 100.0% [122] 334(0.4%) 0(0.0%) for-loop ...rbie/develop/src/core/matcher.rkt:42:9 for-loop [128] 100.0% -------------------------------------------------------------------------- fix-up-variables [112] 100.0% [123] 324(0.4%) 0(0.0%) pattern-match ...develop/src/core/matcher.rkt:30:0 for-loop [128] 100.0% -------------------------------------------------------------------------- for-loop [109] 100.0% [124] 298(0.3%) 0(0.0%) setfindf ...es/herbie/develop/src/common.rkt:139:0 for-loop [131] 100.0% -------------------------------------------------------------------------- match-e [117] 100.0% [125] 17888(20.7%) 6388(7.4%) for-loop ...rbie/develop/src/core/ematch.rkt:52:11 for-loop [132] 58.0% loop [175] 7.2% foldr [137] 5.4% foldl [182] 2.7% curry* [141] 1.8% curried [139] 0.9% -------------------------------------------------------------------------- for-loop [138] 3.3% for-loop [109] 6.0% merge-egraph-nodes! [126] 13.8% for-loop [118] 76.9% [126] 14518(16.8%) 298(0.3%) merge-egraph-nodes! ...p/src/core/egraph.rkt:145:0 update-leader! [134] 59.1% loop! [180] 18.1% merge-egraph-nodes! [126] 13.8% for-loop [138] 3.3% dedup-children! [135] 2.5% enode-merge! [143] 2.2% -------------------------------------------------------------------------- for-loop [136] 32.4% for-loop [118] 67.6% [127] 1240(1.4%) 0(0.0%) substitute-e ...e/develop/src/core/ematch.rkt:64:0 for-loop [136] 83.8% ??? [133] 16.2% -------------------------------------------------------------------------- pattern-match [123] 49.2% for-loop [122] 50.8% [128] 658(0.8%) 0(0.0%) for-loop ...rbie/develop/src/core/matcher.rkt:27:9 core651 [140] 100.0% -------------------------------------------------------------------------- for-loop [70] 49.8% match-e [117] 50.2% [129] 598(0.7%) 300(0.3%) make-sequence ...ects/racket/private/for.rkt:528:2 ??? [144] 49.8% -------------------------------------------------------------------------- custom-set-intersect [121] 100.0% [130] 324(0.4%) 0(0.0%) for-loop ...cts/racket/private/set-types.rkt:207:3 for-loop [142] 100.0% -------------------------------------------------------------------------- setfindf [124] 100.0% [131] 298(0.3%) 0(0.0%) for-loop ...es/herbie/develop/src/common.rkt:140:2 ??? [133] 100.0% -------------------------------------------------------------------------- for-loop [125] 100.0% [132] 12990(15.0%) 334(0.4%) for-loop ...rbie/develop/src/core/ematch.rkt:58:37 match-e [117] 93.6% ??? [150] 5.1% -------------------------------------------------------------------------- for-loop [131] 2.7% loop [38] 2.7% substitute-e [127] 5.5% variable? [2] 23.0% match-e [117] 28.4% finalize-iter! [45] 37.7% [133] 11036(12.8%) 6574(7.6%) ??? ...contract/private/arrow-val-first.rkt:388:18 for-loop [147] 37.7% ??? [154] 2.7% -------------------------------------------------------------------------- for-loop [77] 6.0% merge-egraph-nodes! [126] 94.0% [134] 10546(12.2%) 0(0.0%) update-leader! ...evelop/src/core/egraph.rkt:213:0 for-loop [145] 94.0% hash-ref! [146] 3.1% custom-set-union! [156] 2.8% -------------------------------------------------------------------------- merge-egraph-nodes! [126] 15.8% for-loop [118] 84.2% [135] 2326(2.7%) 0(0.0%) dedup-children! ...evelop/src/core/enode.rkt:199:0 loop [148] 54.3% loop [149] 45.7% -------------------------------------------------------------------------- substitute-e [127] 100.0% [136] 1240(1.4%) 336(0.4%) for-loop ...rbie/develop/src/core/ematch.rkt:73:24 substitute-e [127] 48.5% mk-enode! [153] 24.4% -------------------------------------------------------------------------- for-loop [125] 100.0% [137] 968(1.1%) 968(1.1%) foldr ....0/collects/racket/private/list.rkt:242:4 -------------------------------------------------------------------------- merge-egraph-nodes! [126] 100.0% [138] 958(1.1%) 0(0.0%) for-loop ...rbie/develop/src/core/egraph.rkt:199:4 merge-egraph-nodes! [126] 100.0% -------------------------------------------------------------------------- for-loop [88] 49.8% for-loop [125] 50.2% [139] 662(0.8%) 662(0.8%) curried ...-7.0/collects/racket/function.rkt:71:18 -------------------------------------------------------------------------- for-loop [128] 100.0% [140] 658(0.8%) 0(0.0%) core651 ...acket/contract/private/arr-i.rkt:918:19 un-dep/maybe-chaperone [151] 100.0% -------------------------------------------------------------------------- for-loop [125] 100.0% [141] 634(0.7%) 0(0.0%) curry* ...et-7.0/collects/racket/function.rkt:44:2 procedure-arity [152] 100.0% -------------------------------------------------------------------------- for-loop [130] 100.0% [142] 324(0.4%) 324(0.4%) for-loop ...cts/racket/private/set-types.rkt:201:4 -------------------------------------------------------------------------- merge-egraph-nodes! [126] 100.0% [143] 322(0.4%) 0(0.0%) enode-merge! ...e/develop/src/core/enode.rkt:128:0 adopt-enode! [155] 100.0% -------------------------------------------------------------------------- make-sequence [129] 100.0% [144] 298(0.3%) 0(0.0%) ??? ...t-7.0/collects/racket/private/for.rkt:448:7 custom-in-set [157] 100.0% -------------------------------------------------------------------------- update-leader! [134] 100.0% [145] 9914(11.5%) 938(1.1%) for-loop ...rbie/develop/src/core/egraph.rkt:218:6 for-loop [159] 45.9% hash-update! [168] 44.6% -------------------------------------------------------------------------- for-loop [24] 0.8% for-loop [19] 0.8% loop [15] 2.0% update-leader! [134] 3.8% ??? [161] 4.4% ??? [79] 4.4% compile [107] 35.4% ??? [158] 46.0% [146] 8698(10.1%) 7050(8.1%) hash-ref! .../racket/private/more-scheme.rkt:376:2 ??? [158] 47.1% ??? [161] 4.4% simplify [4] 4.4% ??? [7] 2.0% ??? [10] 0.8% ??? [9] 0.8% -------------------------------------------------------------------------- ??? [133] 100.0% [147] 4164(4.8%) 0(0.0%) for-loop ...ie/develop/src/core/alt-table.rkt:56:2 atab-add-altn [160] 83.5% loop [162] 16.5% -------------------------------------------------------------------------- dedup-children! [135] 9.4% loop [148] 90.6% [148] 1264(1.5%) 1264(1.5%) loop ...racket-7.0/collects/racket/list.rkt:434:17 loop [148] 90.6% -------------------------------------------------------------------------- dedup-children! [135] 28.1% loop [149] 71.9% [149] 1062(1.2%) 0(0.0%) loop ...racket-7.0/collects/racket/list.rkt:417:34 loop [149] 71.9% loop [205] 16.8% member [163] 11.3% -------------------------------------------------------------------------- for-loop [132] 100.0% [150] 664(0.8%) 664(0.8%) ??? ...ies/herbie/develop/src/core/ematch.rkt:43:5 -------------------------------------------------------------------------- core651 [140] 100.0% [151] 658(0.8%) 0(0.0%) un-dep/maybe-chaperone ...private/arr-i.rkt:1097:2 get/build-late-neg-projection [164] 50.8% ??? [165] 49.2% -------------------------------------------------------------------------- curry* [141] 100.0% [152] 634(0.7%) 634(0.7%) procedure-arity ...ket/private/norm-arity.rkt:7:27 -------------------------------------------------------------------------- for-loop [136] 48.2% for-loop [118] 51.8% [153] 626(0.7%) 302(0.3%) mk-enode! ...rbie/develop/src/core/egraph.rkt:99:0 new-enode [166] 51.8% -------------------------------------------------------------------------- ??? [133] 49.7% ??? [62] 50.3% [154] 600(0.7%) 0(0.0%) ??? ...ects/racket/contract/private/prop.rkt:519:4 ??? [190] 100.0% -------------------------------------------------------------------------- enode-merge! [143] 100.0% [155] 322(0.4%) 0(0.0%) adopt-enode! ...e/develop/src/core/enode.rkt:104:0 custom-set-union [186] 100.0% -------------------------------------------------------------------------- update-leader! [134] 100.0% [156] 300(0.3%) 0(0.0%) custom-set-union! ...t/private/set-types.rkt:245:0 for-loop [167] 100.0% -------------------------------------------------------------------------- ??? [144] 100.0% [157] 298(0.3%) 298(0.3%) custom-in-set ...acket/private/set-types.rkt:577:0 -------------------------------------------------------------------------- hash-ref! [146] 100.0% [158] 5742(6.6%) 360(0.4%) ??? ...tlies/herbie/develop/src/programs.rkt:189:5 hash-ref! [146] 98.4% -------------------------------------------------------------------------- for-loop [145] 100.0% [159] 4550(5.3%) 0(0.0%) for-loop ...rbie/develop/src/core/egraph.rkt:219:8 hash-update! [168] 100.0% -------------------------------------------------------------------------- for-loop [147] 100.0% [160] 3478(4.0%) 0(0.0%) atab-add-altn ...elop/src/core/alt-table.rkt:202:0 errors [169] 91.4% append-at-pnts [172] 8.6% -------------------------------------------------------------------------- hash-ref! [146] 100.0% [161] 1288(1.5%) 0(0.0%) ??? ...es/herbie/develop/src/core/taylor.rkt:45:15 hash-ref! [146] 100.0% -------------------------------------------------------------------------- for-loop [147] 100.0% [162] 686(0.8%) 0(0.0%) loop ...erbie/develop/src/core/alt-table.rkt:176:2 argmax [170] 100.0% -------------------------------------------------------------------------- loop [149] 100.0% [163] 360(0.4%) 360(0.4%) member (unknown source) -------------------------------------------------------------------------- un-dep/maybe-chaperone [151] 100.0% [164] 334(0.4%) 334(0.4%) get/build-late-neg-projection ...te/guts.rkt:793:0 -------------------------------------------------------------------------- un-dep/maybe-chaperone [151] 100.0% [165] 324(0.4%) 324(0.4%) ??? ...ntract/private/arrow-higher-order.rkt:554:2 -------------------------------------------------------------------------- mk-enode! [153] 100.0% [166] 324(0.4%) 0(0.0%) new-enode ...erbie/develop/src/core/enode.rkt:96:0 mutable-set [171] 100.0% -------------------------------------------------------------------------- custom-set-union! [156] 100.0% [167] 300(0.3%) 300(0.3%) for-loop ...cts/racket/private/set-types.rkt:253:4 -------------------------------------------------------------------------- for-loop [145] 49.3% for-loop [159] 50.7% [168] 8976(10.4%) 0(0.0%) hash-update! ...cket/private/more-scheme.rkt:365:4 ??? [173] 100.0% -------------------------------------------------------------------------- for-loop [58] 6.8% ??? [21] 22.6% atab-add-altn [160] 70.6% [169] 4504(5.2%) 0(0.0%) errors ...lies/herbie/develop/src/points.rkt:228:0 for-loop [177] 50.1% eval-prog [176] 49.9% -------------------------------------------------------------------------- loop [162] 100.0% [170] 686(0.8%) 0(0.0%) argmax ...acket-7.0/collects/racket/list.rkt:766:0 expression-cost [92] 52.8% for-loop [174] 47.2% -------------------------------------------------------------------------- new-enode [166] 100.0% [171] 324(0.4%) 324(0.4%) mutable-set .../racket/private/set-types.rkt:999:0 -------------------------------------------------------------------------- atab-add-altn [160] 100.0% [172] 300(0.3%) 0(0.0%) append-at-pnts ...lop/src/core/alt-table.rkt:146:0 loop [175] 100.0% -------------------------------------------------------------------------- hash-update! [168] 100.0% [173] 8976(10.4%) 0(0.0%) ??? ...s/herbie/develop/src/core/egraph.rkt:221:24 for-loop [178] 96.7% update-en-expr [189] 3.3% -------------------------------------------------------------------------- argmax [170] 6.1% for-loop [70] 11.8% argmin [81] 29.6% loop [80] 52.6% [174] 5322(6.2%) 934(1.1%) for-loop .../herbie/develop/src/programs.rkt:205:2 table-ref [179] 82.5% -------------------------------------------------------------------------- append-at-pnts [172] 0.1% for-loop [125] 3.2% for-loop [34] 7.1% loop! [180] 15.2% loop [175] 74.4% [175] 4224(4.9%) 932(1.1%) loop ...-7.0/collects/racket/private/map.rkt:40:19 loop [175] 74.4% loop! [180] 15.2% ??? [44] 7.1% foldl [182] 1.6% -------------------------------------------------------------------------- eval-const-expr [22] 46.1% errors [169] 53.9% [176] 4170(4.8%) 0(0.0%) eval-prog ...herbie/develop/src/programs.rkt:130:0 temp68_2 [181] 77.5% inductor [183] 15.4% eval [184] 7.1% -------------------------------------------------------------------------- errors [169] 100.0% [177] 2256(2.6%) 300(0.3%) for-loop ...es/herbie/develop/src/points.rkt:230:2 ??? [21] 86.7% -------------------------------------------------------------------------- ??? [173] 100.0% [178] 8678(10.0%) 7454(8.6%) for-loop ...bie/develop/src/core/egraph.rkt:222:26 update-en-expr [189] 14.1% -------------------------------------------------------------------------- for-loop [174] 100.0% [179] 4388(5.1%) 2526(2.9%) table-ref ...es/herbie/develop/src/common.rkt:42:0 for-loop [188] 35.4% dict? [192] 7.1% -------------------------------------------------------------------------- loop [175] 33.8% merge-egraph-nodes! [126] 66.2% [180] 3622(4.2%) 1000(1.2%) loop! ...s/herbie/develop/src/core/enode.rkt:191:2 custom-set-union [186] 38.7% loop [175] 33.8% set [187] 13.6% -------------------------------------------------------------------------- eval-prog [176] 100.0% [181] 3230(3.7%) 0(0.0%) temp68_2 (unknown source) compile16 [185] 100.0% -------------------------------------------------------------------------- for-loop [125] 49.2% loop [175] 50.8% [182] 1296(1.5%) 968(1.1%) foldl ....0/collects/racket/private/list.rkt:229:4 merge2 [191] 25.3% -------------------------------------------------------------------------- eval-prog [176] 17.0% inductor [183] 83.0% [183] 644(0.7%) 0(0.0%) inductor .../herbie/develop/src/programs.rkt:135:4 inductor [183] 83.0% ??? [190] 17.0% -------------------------------------------------------------------------- eval-prog [176] 100.0% [184] 296(0.3%) 0(0.0%) eval (unknown source) namespace-syntax-introduce3 [193] 100.0% -------------------------------------------------------------------------- temp68_2 [181] 100.0% [185] 3230(3.7%) 0(0.0%) compile16 (unknown source) temp74_0 [194] 100.0% -------------------------------------------------------------------------- adopt-enode! [155] 16.5% loop! [180] 83.5% [186] 1956(2.3%) 1334(1.5%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [196] 31.8% -------------------------------------------------------------------------- apply-match [106] 48.4% loop! [180] 51.6% [187] 1916(2.2%) 988(1.1%) set ...collects/racket/private/set-types.rkt:981:0 for-loop [195] 48.4% -------------------------------------------------------------------------- table-ref [179] 100.0% [188] 1552(1.8%) 1552(1.8%) for-loop ...ies/herbie/develop/src/common.rkt:44:4 -------------------------------------------------------------------------- ??? [173] 19.6% for-loop [178] 80.4% [189] 1522(1.8%) 1522(1.8%) update-en-expr ...evelop/src/core/egraph.rkt:207:0 -------------------------------------------------------------------------- ??? [154] 48.2% inductor [183] 51.8% [190] 1244(1.4%) 634(0.7%) ??? ...lects/racket/contract/private/orc.rkt:83:14 keyword-apply [197] 24.8% ??? [198] 24.3% -------------------------------------------------------------------------- foldl [182] 100.0% [191] 328(0.4%) 328(0.4%) merge2 .../herbie/develop/src/core/ematch.rkt:24:0 -------------------------------------------------------------------------- table-ref [179] 100.0% [192] 310(0.4%) 310(0.4%) dict? ...ollects/racket/private/generic.rkt:146:11 -------------------------------------------------------------------------- eval [184] 100.0% [193] 296(0.3%) 0(0.0%) namespace-syntax-introduce3 (unknown source) for-loop [204] 100.0% -------------------------------------------------------------------------- compile16 [185] 100.0% [194] 3230(3.7%) 0(0.0%) temp74_0 (unknown source) expand-single [199] 100.0% -------------------------------------------------------------------------- set [187] 100.0% [195] 928(1.1%) 928(1.1%) for-loop ...cts/racket/private/set-types.rkt:937:4 -------------------------------------------------------------------------- custom-set-union [186] 100.0% [196] 622(0.7%) 0(0.0%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [200] 100.0% -------------------------------------------------------------------------- ??? [190] 100.0% [197] 308(0.4%) 308(0.4%) keyword-apply ...lects/racket/private/kw.rkt:421:2 -------------------------------------------------------------------------- ??? [190] 100.0% [198] 302(0.3%) 302(0.3%) ??? ...ects/racket/contract/private/list.rkt:163:5 -------------------------------------------------------------------------- temp74_0 [194] 100.0% [199] 3230(3.7%) 0(0.0%) expand-single (unknown source) expand-capturing-lifts [201] 100.0% -------------------------------------------------------------------------- for-loop [196] 100.0% [200] 622(0.7%) 622(0.7%) for-loop ...cts/racket/private/set-types.rkt:178:5 -------------------------------------------------------------------------- expand-single [199] 100.0% [201] 3230(3.7%) 0(0.0%) expand-capturing-lifts (unknown source) lambda-clause-expander [202] 100.0% -------------------------------------------------------------------------- expand-capturing-lifts [201] 100.0% [202] 3230(3.7%) 0(0.0%) lambda-clause-expander (unknown source) finish-bodys [203] 69.2% loop [205] 30.8% -------------------------------------------------------------------------- lambda-clause-expander [202] 17.1% for-loop [204] 82.9% [203] 2234(2.6%) 0(0.0%) finish-bodys (unknown source) for-loop [204] 100.0% -------------------------------------------------------------------------- for-loop [204] 5.3% namespace-syntax-introduce3 [193] 11.7% finish-bodys [203] 83.0% [204] 2530(2.9%) 296(0.3%) for-loop (unknown source) finish-bodys [203] 68.4% loop [205] 9.2% for-loop [204] 5.3% expand-implicit [206] 2.0% dispatch-transformer41 [6] 1.2% syntax-e [8] 1.2% expand-identifier [207] 1.1% -------------------------------------------------------------------------- syntax->list [42] 4.3% apply-transformer52 [16] 6.9% for-loop [204] 17.6% syntax-e/no-taint [17] 22.1% lambda-clause-expander [202] 22.5% loop [149] 26.7% [205] 2630(3.0%) 1332(1.5%) loop (unknown source) expand-id-application-form17 [209] 17.6% gf [208] 15.7% dispatch-transformer41 [6] 11.1% core-form-sym [210] 6.9% syntax-e [8] 4.3% -------------------------------------------------------------------------- for-loop [204] 100.0% [206] 640(0.7%) 308(0.4%) expand-implicit (unknown source) resolve+shift28 [211] 51.9% -------------------------------------------------------------------------- for-loop [204] 100.0% [207] 326(0.4%) 0(0.0%) expand-identifier (unknown source) resolve+shift28 [211] 100.0% -------------------------------------------------------------------------- loop [205] 100.0% [208] 638(0.7%) 0(0.0%) gf (unknown source) cache-or-reuse-hash [212] 52.7% propagation-apply [213] 47.3% -------------------------------------------------------------------------- loop [205] 100.0% [209] 630(0.7%) 298(0.3%) expand-id-application-form17 (unknown source) syntax-e/no-taint [17] 52.7% -------------------------------------------------------------------------- loop [205] 100.0% [210] 362(0.4%) 0(0.0%) core-form-sym (unknown source) resolve+shift28 [211] 100.0% -------------------------------------------------------------------------- expand-identifier [207] 32.0% expand-implicit [206] 32.5% core-form-sym [210] 35.5% [211] 1020(1.2%) 0(0.0%) resolve+shift28 (unknown source) fallback-loop [214] 100.0% -------------------------------------------------------------------------- gf [208] 100.0% [212] 336(0.4%) 336(0.4%) cache-or-reuse-hash (unknown source) -------------------------------------------------------------------------- gf [208] 100.0% [213] 302(0.3%) 302(0.3%) propagation-apply (unknown source) -------------------------------------------------------------------------- resolve+shift28 [211] 100.0% [214] 1020(1.2%) 1020(1.2%) fallback-loop (unknown source) --------------------------------------------------------------------------