Profiling results ----------------- Total cpu time observed: 163298ms (out of 165100ms) Number of samples taken: 708 (once every 231ms) (Hiding functions with self<1.0% and local<2.0%: 11 of 208 hidden) ========================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ========================================================================== ??? [58] 100.0% [1] 141052(86.4%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [12] 100.0% -------------------------------------------------------------------------- ??? [58] 100.0% [2] 106226(65.1%) 0(0.0%) run-improve58 ...ock/herbie/src/mainloop.rkt:244:0 for-loop [13] 65.9% get-final-combination [15] 33.4% setup-prog [22] 0.4% loop [72] 0.2% -------------------------------------------------------------------------- simplify-alt [33] 0.7% loop [126] 6.4% ??? [58] 92.9% [3] 64258(39.4%) 646(0.4%) simplify ...lock/herbie/src/core/simplify.rkt:39:0 simplify-expr [14] 63.2% iterate-egraph!5 [26] 17.9% for-loop [16] 16.6% loop [31] 1.3% -------------------------------------------------------------------------- hash-ref! [145] 100.0% [4] 17850(10.9%) 0(0.0%) ??? /home/ztatlock/herbie/src/programs.rkt:294:5 loop [126] 96.3% hash-ref! [145] 3.7% -------------------------------------------------------------------------- copying-mergesort [98] 100.0% [5] 8642(5.3%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [120] 94.8% ->flonum [147] 2.7% ??? [133] 2.5% -------------------------------------------------------------------------- location-do [159] 100.0% [6] 5868(3.6%) 0(0.0%) approximate9 ...ck/herbie/src/core/taylor.rkt:12:0 loop [17] 89.7% f16 [37] 6.9% taylor-quotient [23] 3.5% -------------------------------------------------------------------------- hash-ref! [145] 100.0% [7] 4598(2.8%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:295:23 for-loop [18] 100.0% -------------------------------------------------------------------------- hash-ref! [145] 100.0% [8] 2928(1.8%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:338:33 hash-ref! [145] 64.9% for-loop [21] 35.1% -------------------------------------------------------------------------- hash-ref! [145] 100.0% [9] 2312(1.4%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:285:26 for-loop [19] 100.0% -------------------------------------------------------------------------- hash-ref! [145] 100.0% [10] 1868(1.1%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:392:23 for-loop [20] 100.0% -------------------------------------------------------------------------- hash-ref! [145] 100.0% [11] 400(0.2%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:483:23 for-loop [24] 100.0% -------------------------------------------------------------------------- profile-thunk16 [1] 100.0% [12] 141052(86.4%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [58] 100.0% -------------------------------------------------------------------------- run-improve58 [2] 100.0% [13] 70030(42.9%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:255:8 run-iter! [25] 100.0% -------------------------------------------------------------------------- simplify [3] 100.0% [14] 40626(24.9%) 0(0.0%) simplify-expr ...herbie/src/core/simplify.rkt:68:0 iterate-egraph!5 [26] 98.2% loop [31] 1.8% -------------------------------------------------------------------------- run-improve58 [2] 100.0% [15] 35522(21.8%) 0(0.0%) get-final-combination ...ie/src/mainloop.rkt:271:0 split-table [27] 87.8% extract-alt [29] 9.2% loop [126] 3.0% -------------------------------------------------------------------------- simplify [3] 100.0% [16] 10636(6.5%) 0(0.0%) for-loop ...ock/herbie/src/core/simplify.rkt:61:12 iterate-egraph!5 [26] 98.1% loop [31] 1.9% -------------------------------------------------------------------------- approximate9 [6] 100.0% [17] 5262(3.2%) 0(0.0%) loop ...e/ztatlock/herbie/src/core/taylor.rkt:83:4 hash-ref! [145] 100.0% -------------------------------------------------------------------------- ??? [7] 100.0% [18] 4598(2.8%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:298:27 hash-ref! [145] 95.7% simplify [28] 4.3% -------------------------------------------------------------------------- ??? [9] 100.0% [19] 2312(1.4%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:285:52 hash-ref! [145] 63.4% ??? [32] 36.6% -------------------------------------------------------------------------- ??? [10] 100.0% [20] 1868(1.1%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:396:33 for-loop [30] 100.0% -------------------------------------------------------------------------- ??? [8] 100.0% [21] 1028(0.6%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:341:46 hash-ref! [145] 100.0% -------------------------------------------------------------------------- run-improve58 [2] 100.0% [22] 434(0.3%) 0(0.0%) setup-prog /home/ztatlock/herbie/src/glue.rkt:46:0 simplify-alt [33] 100.0% -------------------------------------------------------------------------- f16 [37] 49.8% approximate9 [6] 50.2% [23] 406(0.2%) 0(0.0%) taylor-quotient ...erbie/src/core/taylor.rkt:328:0 simplify [28] 50.2% first-nonzero-exp [34] 49.8% -------------------------------------------------------------------------- ??? [11] 100.0% [24] 400(0.2%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:487:35 parse-loop12 [123] 100.0% -------------------------------------------------------------------------- for-loop [13] 100.0% [25] 70030(42.9%) 0(0.0%) run-iter! ...tatlock/herbie/src/mainloop.rkt:225:0 simplify! [35] 85.3% gen-series! [38] 8.4% finalize-iter! [39] 5.4% choose-best-alt! [42] 0.3% gen-rewrites! [46] 0.3% -------------------------------------------------------------------------- for-loop [16] 16.9% simplify [3] 18.6% simplify-expr [14] 64.5% [26] 61826(37.9%) 230(0.1%) iterate-egraph!5 ...bie/src/core/simplify.rkt:95:0 one-iter [36] 94.9% map-enodes [40] 4.4% *simplify-rules* [44] 0.3% -------------------------------------------------------------------------- get-final-combination [15] 100.0% [27] 31204(19.1%) 0(0.0%) split-table .../ztatlock/herbie/src/glue.rkt:171:0 f16 [37] 92.9% ??? [52] 7.1% -------------------------------------------------------------------------- for-loop [18] 3.5% taylor-quotient [23] 3.6% hash-ref! [145] 92.8% [28] 5646(3.5%) 0(0.0%) simplify ...atlock/herbie/src/core/reduce.rkt:15:0 f16 [37] 66.9% parse-loop12 [123] 26.0% debug-print [43] 3.6% debug7 [47] 3.5% -------------------------------------------------------------------------- loop [126] 24.7% get-final-combination [15] 75.3% [29] 4318(2.6%) 0(0.0%) extract-alt ...e/ztatlock/herbie/src/glue.rkt:57:0 loop [126] 95.3% argmins [45] 4.7% -------------------------------------------------------------------------- for-loop [20] 100.0% [30] 1868(1.1%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:398:39 hash-ref! [145] 100.0% -------------------------------------------------------------------------- for-loop [16] 11.2% simplify-expr [14] 40.4% simplify [3] 48.4% [31] 1786(1.1%) 0(0.0%) loop ...tatlock/herbie/src/core/simplify.rkt:203:2 pass [41] 100.0% -------------------------------------------------------------------------- for-loop [19] 100.0% [32] 846(0.5%) 0(0.0%) ??? .../ztatlock/herbie/src/core/taylor.rkt:288:19 hash-ref! [145] 100.0% -------------------------------------------------------------------------- setup-prog [22] 100.0% [33] 434(0.3%) 0(0.0%) simplify-alt .../ztatlock/herbie/src/glue.rkt:84:0 simplify [3] 100.0% -------------------------------------------------------------------------- taylor-quotient [23] 100.0% [34] 202(0.1%) 0(0.0%) first-nonzero-exp ...bie/src/core/taylor.rkt:260:0 hash-ref! [145] 100.0% -------------------------------------------------------------------------- run-iter! [25] 100.0% [35] 59708(36.6%) 0(0.0%) simplify! ...tatlock/herbie/src/mainloop.rkt:164:0 for-loop [48] 100.0% -------------------------------------------------------------------------- iterate-egraph!5 [26] 100.0% [36] 58668(35.9%) 2158(1.3%) one-iter ...ock/herbie/src/core/simplify.rkt:106:0 for-loop [49] 64.9% loop [51] 30.7% apply-match [60] 0.7% -------------------------------------------------------------------------- composed [115] 0.2% approximate9 [6] 0.2% hash-ref! [145] 0.8% f16 [37] 1.8% map [110] 3.4% simplify [28] 6.0% split-table [27] 86.8% [37] 33396(20.5%) 624(0.4%) f16 ...t/collects/racket/match/compiler.rkt:507:40 option-on-expr [50] 84.0% map [110] 8.9% loop [126] 2.8% f16 [37] 1.8% composed [115] 0.2% taylor-quotient [23] 0.1% -------------------------------------------------------------------------- run-iter! [25] 100.0% [38] 5868(3.6%) 0(0.0%) gen-series! ...tlock/herbie/src/mainloop.rkt:136:0 for-loop [53] 100.0% -------------------------------------------------------------------------- run-iter! [25] 100.0% [39] 3780(2.3%) 0(0.0%) finalize-iter! ...ck/herbie/src/mainloop.rkt:179:0 ??? [52] 100.0% -------------------------------------------------------------------------- iterate-egraph!5 [26] 100.0% [40] 2726(1.7%) 0(0.0%) map-enodes ...ock/herbie/src/core/egraph.rkt:139:0 loop [126] 91.9% for-loop [136] 8.1% -------------------------------------------------------------------------- loop [31] 100.0% [41] 1786(1.1%) 0(0.0%) pass ...tatlock/herbie/src/core/simplify.rkt:193:2 for-loop [54] 84.2% for-loop [55] 15.8% -------------------------------------------------------------------------- run-iter! [25] 100.0% [42] 222(0.1%) 0(0.0%) choose-best-alt! .../herbie/src/mainloop.rkt:122:0 ??? [52] 100.0% -------------------------------------------------------------------------- simplify [28] 100.0% [43] 202(0.1%) 202(0.1%) debug-print ...ztatlock/herbie/src/debug.rkt:107:0 -------------------------------------------------------------------------- iterate-egraph!5 [26] 100.0% [44] 202(0.1%) 0(0.0%) *simplify-rules* ...bie/src/syntax/rules.rkt:418:0 for-loop [56] 100.0% -------------------------------------------------------------------------- extract-alt [29] 100.0% [45] 202(0.1%) 0(0.0%) argmins /home/ztatlock/herbie/src/common.rkt:109:0 composed [115] 100.0% -------------------------------------------------------------------------- run-iter! [25] 100.0% [46] 202(0.1%) 0(0.0%) gen-rewrites! ...ock/herbie/src/mainloop.rkt:150:0 for-loop [57] 100.0% -------------------------------------------------------------------------- simplify [28] 100.0% [47] 200(0.1%) 0(0.0%) debug7 /home/ztatlock/herbie/src/debug.rkt:102:0 ??? [52] 100.0% -------------------------------------------------------------------------- simplify! [35] 100.0% [48] 59708(36.6%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:168:6 ??? [58] 100.0% -------------------------------------------------------------------------- for-loop [49] 48.8% one-iter [36] 51.2% [49] 38082(23.3%) 8182(5.0%) for-loop ...ck/herbie/src/core/simplify.rkt:116:12 for-loop [49] 48.8% match-e [73] 39.3% -------------------------------------------------------------------------- loop [126] 3.2% f16 [37] 96.8% [50] 28992(17.8%) 0(0.0%) option-on-expr ...erbie/src/core/regimes.rkt:110:0 sort-context-on-expr [59] 90.0% pick-errors [64] 6.1% loop [126] 2.4% err-lsts->split-indices [67] 1.5% -------------------------------------------------------------------------- one-iter [36] 100.0% [51] 18006(11.0%) 202(0.1%) loop ...cket/collects/racket/private/map.rkt:52:19 apply-match [60] 98.9% -------------------------------------------------------------------------- debug7 [47] 3.1% choose-best-alt! [42] 3.5% split-table [27] 34.5% finalize-iter! [39] 58.9% [52] 6414(3.9%) 200(0.1%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [62] 55.8% split-atab [63] 34.5% ??? [68] 3.5% atab-add-altns [70] 3.2% -------------------------------------------------------------------------- gen-series! [38] 100.0% [53] 5868(3.6%) 0(0.0%) for-loop ...ztatlock/herbie/src/mainloop.rkt:142:7 taylor-alt [61] 100.0% -------------------------------------------------------------------------- pass [41] 100.0% [54] 1504(0.9%) 0(0.0%) for-loop ...ck/herbie/src/core/simplify.rkt:196:29 argmin [65] 44.1% for-loop [66] 41.2% make-sequence [69] 14.6% -------------------------------------------------------------------------- pass [41] 100.0% [55] 282(0.2%) 282(0.2%) for-loop ...ock/herbie/src/core/simplify.rkt:176:2 -------------------------------------------------------------------------- *simplify-rules* [44] 100.0% [56] 202(0.1%) 202(0.1%) for-loop /home/ztatlock/herbie/src/common.rkt:68:9 -------------------------------------------------------------------------- gen-rewrites! [46] 100.0% [57] 202(0.1%) 0(0.0%) for-loop ...tatlock/herbie/src/mainloop.rkt:155:11 ??? [71] 100.0% -------------------------------------------------------------------------- for-loop [48] 13.9% run [12] 41.8% [58] 145706(89.2%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 41.8% run-improve58 [2] 30.3% loop [72] 14.0% simplify [3] 13.9% -------------------------------------------------------------------------- option-on-expr [50] 100.0% [59] 26084(16.0%) 0(0.0%) sort-context-on-expr ...herbie/src/points.rkt:47:0 ??? [74] 100.0% -------------------------------------------------------------------------- one-iter [36] 2.3% loop [51] 97.7% [60] 18226(11.2%) 648(0.4%) apply-match .../herbie/src/core/simplify.rkt:122:2 match-e [73] 28.2% merge-egraph-nodes! [87] 27.3% for-loop [78] 9.9% loop! [135] 9.5% update-leader! [101] 8.3% substitute-e [90] 5.9% mk-enode! [104] 4.9% reduce-to-single! [81] 2.6% -------------------------------------------------------------------------- for-loop [53] 100.0% [61] 5868(3.6%) 0(0.0%) taylor-alt ...e/ztatlock/herbie/src/glue.rkt:142:0 for-loop [75] 100.0% -------------------------------------------------------------------------- ??? [52] 100.0% [62] 3576(2.2%) 0(0.0%) for-loop ...ock/herbie/src/core/alt-table.rkt:51:2 atab-add-altn [76] 100.0% -------------------------------------------------------------------------- ??? [52] 100.0% [63] 2212(1.4%) 0(0.0%) split-atab ...k/herbie/src/core/alt-table.rkt:74:0 for-loop [77] 100.0% -------------------------------------------------------------------------- option-on-expr [50] 100.0% [64] 1782(1.1%) 0(0.0%) pick-errors ...k/herbie/src/core/regimes.rkt:177:0 for-loop [79] 100.0% -------------------------------------------------------------------------- for-loop [54] 100.0% [65] 664(0.4%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 expression-cost [80] 100.0% -------------------------------------------------------------------------- for-loop [54] 100.0% [66] 620(0.4%) 620(0.4%) for-loop ...ck/herbie/src/core/simplify.rkt:183:13 -------------------------------------------------------------------------- option-on-expr [50] 100.0% [67] 442(0.3%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:228:0 add-splitpoint [82] 100.0% -------------------------------------------------------------------------- ??? [52] 100.0% [68] 222(0.1%) 0(0.0%) ??? ...ztatlock/herbie/src/core/alt-table.rkt:54:0 ??? [83] 100.0% -------------------------------------------------------------------------- for-loop [54] 100.0% [69] 220(0.1%) 220(0.1%) make-sequence ...ects/racket/private/for.rkt:509:2 -------------------------------------------------------------------------- ??? [52] 100.0% [70] 204(0.1%) 0(0.0%) atab-add-altns ...rbie/src/core/alt-table.rkt:50:0 atab-add-altn [76] 100.0% -------------------------------------------------------------------------- for-loop [57] 100.0% [71] 202(0.1%) 0(0.0%) ??? /home/ztatlock/herbie/src/alternative.rkt:90:0 loop [126] 100.0% -------------------------------------------------------------------------- run-improve58 [2] 0.6% ??? [58] 99.4% [72] 39720(24.3%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:119:2 loop [85] 47.8% make-exacts* [97] 37.4% loop [99] 14.7% -------------------------------------------------------------------------- apply-match [60] 11.5% for-loop [100] 14.1% for-loop [49] 74.4% [73] 35038(21.5%) 19242(11.8%) match-e ...tatlock/herbie/src/core/ematch.rkt:46:0 for-loop [86] 40.0% for-loop [100] 5.8% list-cartesian-product [102] 3.3% constant? [169] 1.2% loop [126] 0.3% -------------------------------------------------------------------------- sort-context-on-expr [59] 100.0% [74] 26084(16.0%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [84] 86.9% loop [111] 13.1% -------------------------------------------------------------------------- taylor-alt [61] 100.0% [75] 5868(3.6%) 0(0.0%) for-loop /home/ztatlock/herbie/src/glue.rkt:144:2 location-do [159] 100.0% -------------------------------------------------------------------------- atab-add-altns [70] 5.4% for-loop [62] 94.6% [76] 3780(2.3%) 0(0.0%) atab-add-altn ...rbie/src/core/alt-table.rkt:208:0 best-and-tied-at-points [88] 89.3% override-at-pnts [95] 10.7% -------------------------------------------------------------------------- split-atab [63] 100.0% [77] 2212(1.4%) 0(0.0%) for-loop ...ock/herbie/src/core/alt-table.rkt:75:2 for-loop [89] 78.2% for-loop [92] 21.8% -------------------------------------------------------------------------- apply-match [60] 100.0% [78] 1798(1.1%) 0(0.0%) for-loop ...ck/herbie/src/core/simplify.rkt:136:10 merge-egraph-nodes! [87] 49.8% loop! [135] 36.7% substitute-e [90] 13.5% -------------------------------------------------------------------------- pick-errors [64] 100.0% [79] 1782(1.1%) 0(0.0%) for-loop ...lock/herbie/src/core/regimes.rkt:180:4 eval-prog [127] 100.0% -------------------------------------------------------------------------- argmin [65] 100.0% [80] 664(0.4%) 0(0.0%) expression-cost ...k/herbie/src/programs.rkt:309:0 compile [91] 100.0% -------------------------------------------------------------------------- apply-match [60] 100.0% [81] 466(0.3%) 0(0.0%) reduce-to-single! ...bie/src/core/egraph.rkt:324:0 for-loop [93] 100.0% -------------------------------------------------------------------------- err-lsts->split-indices [67] 100.0% [82] 442(0.3%) 0(0.0%) add-splitpoint ...erbie/src/core/regimes.rkt:241:2 for-loop [94] 100.0% -------------------------------------------------------------------------- ??? [68] 100.0% [83] 222(0.1%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:342:33 best-alt [96] 100.0% -------------------------------------------------------------------------- ??? [74] 100.0% [84] 22664(13.9%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [98] 83.3% loop [111] 15.8% ??? [120] 0.9% -------------------------------------------------------------------------- loop [72] 100.0% [85] 19000(11.6%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:90:2 loop [99] 48.7% make-exacts* [97] 39.4% eval-prog [127] 11.9% -------------------------------------------------------------------------- match-e [73] 100.0% [86] 16174(9.9%) 5722(3.5%) for-loop ...tlock/herbie/src/core/ematch.rkt:59:11 for-loop [100] 49.7% list-cartesian-product [102] 11.8% loop [126] 3.3% filter [191] 2.6% curry* [106] 1.3% foldl [142] 0.6% -------------------------------------------------------------------------- merge-egraph-nodes! [87] 7.0% for-loop [78] 15.3% apply-match [60] 75.7% [87] 5872(3.6%) 402(0.2%) merge-egraph-nodes! ...e/src/core/egraph.rkt:152:0 update-leader! [101] 48.8% loop! [135] 20.3% for-loop [105] 11.3% merge-egraph-nodes! [87] 7.0% enode-merge! [109] 3.7% -------------------------------------------------------------------------- atab-add-altn [76] 100.0% [88] 3376(2.1%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 errors [121] 100.0% -------------------------------------------------------------------------- for-loop [77] 100.0% [89] 1730(1.1%) 0(0.0%) for-loop ...ck/herbie/src/core/alt-table.rkt:80:53 loop [103] 100.0% -------------------------------------------------------------------------- substitute-e [90] 9.2% for-loop [78] 9.2% apply-match [60] 81.6% [90] 1318(0.8%) 674(0.4%) substitute-e ...ck/herbie/src/core/ematch.rkt:71:0 mk-enode! [104] 48.9% substitute-e [90] 9.2% -------------------------------------------------------------------------- expression-cost [80] 100.0% [91] 664(0.4%) 0(0.0%) compile .../ztatlock/herbie/src/programs.rkt:286:0 hash-ref! [145] 100.0% -------------------------------------------------------------------------- for-loop [77] 100.0% [92] 482(0.3%) 0(0.0%) for-loop ...ck/herbie/src/core/alt-table.rkt:86:30 ??? [113] 100.0% -------------------------------------------------------------------------- reduce-to-single! [81] 100.0% [93] 466(0.3%) 466(0.3%) for-loop ...tlock/herbie/src/core/egraph.rkt:325:8 -------------------------------------------------------------------------- add-splitpoint [82] 100.0% [94] 442(0.3%) 220(0.1%) for-loop ...lock/herbie/src/core/regimes.rkt:243:4 for-loop [107] 50.2% -------------------------------------------------------------------------- atab-add-altn [76] 100.0% [95] 404(0.2%) 0(0.0%) override-at-pnts ...e/src/core/alt-table.rkt:145:0 errors [121] 100.0% -------------------------------------------------------------------------- ??? [83] 100.0% [96] 222(0.1%) 0(0.0%) best-alt /home/ztatlock/herbie/src/glue.rkt:79:0 loop [108] 100.0% -------------------------------------------------------------------------- loop [85] 33.5% loop [72] 66.5% [97] 22350(13.7%) 0(0.0%) make-exacts* ...tatlock/herbie/src/points.rkt:77:0 map [110] 51.2% loop [126] 47.0% eval-prog [127] 1.8% -------------------------------------------------------------------------- generic-sort/key [84] 45.7% copying-mergesort [98] 54.3% [98] 18874(11.6%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [98] 54.3% loop [111] 34.3% jloop [5] 11.4% -------------------------------------------------------------------------- loop [72] 38.8% loop [85] 61.2% [99] 15104(9.2%) 0(0.0%) loop /home/ztatlock/herbie/src/points.rkt:80:4 map [110] 100.0% -------------------------------------------------------------------------- match-e [73] 24.2% for-loop [86] 75.8% [100] 12278(7.5%) 1968(1.2%) for-loop ...tlock/herbie/src/core/ematch.rkt:65:37 match-e [73] 75.9% ??? [114] 8.0% -------------------------------------------------------------------------- apply-match [60] 32.9% merge-egraph-nodes! [87] 67.1% [101] 4594(2.8%) 240(0.1%) update-leader! ...herbie/src/core/egraph.rkt:217:0 for-loop [112] 94.8% -------------------------------------------------------------------------- list-cartesian-product [102] 21.3% match-e [73] 31.2% for-loop [86] 47.5% [102] 4036(2.5%) 3596(2.2%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [102] 21.3% for-loop [116] 5.5% -------------------------------------------------------------------------- for-loop [89] 100.0% [103] 1730(1.1%) 0(0.0%) loop ...ket/collects/racket/private/list.rkt:264:4 ??? [113] 100.0% -------------------------------------------------------------------------- substitute-e [90] 42.1% apply-match [60] 57.9% [104] 1528(0.9%) 1328(0.8%) mk-enode! ...lock/herbie/src/core/egraph.rkt:101:0 new-enode [119] 13.1% -------------------------------------------------------------------------- merge-egraph-nodes! [87] 100.0% [105] 662(0.4%) 662(0.4%) for-loop ...tlock/herbie/src/core/egraph.rkt:232:6 -------------------------------------------------------------------------- for-loop [86] 100.0% [106] 420(0.3%) 202(0.1%) curry* ...racket/collects/racket/function.rkt:44:2 procedure-arity [118] 51.9% -------------------------------------------------------------------------- for-loop [94] 100.0% [107] 222(0.1%) 222(0.1%) for-loop ...lock/herbie/src/core/regimes.rkt:247:8 -------------------------------------------------------------------------- best-alt [96] 100.0% [108] 222(0.1%) 0(0.0%) loop /home/ztatlock/herbie/src/common.rkt:110:2 composed [115] 100.0% -------------------------------------------------------------------------- merge-egraph-nodes! [87] 100.0% [109] 220(0.1%) 0(0.0%) enode-merge! ...ck/herbie/src/core/enode.rkt:100:0 adopt-enode! [117] 100.0% -------------------------------------------------------------------------- parse-loop12 [123] 0.7% f16 [37] 11.7% make-exacts* [97] 37.8% loop [99] 49.8% [110] 30310(18.6%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 loop [126] 86.8% f16 [37] 5.0% parse-loop12 [123] 4.3% ??? [125] 1.6% ??? [133] 1.5% make-multiplication-node [140] 0.4% -------------------------------------------------------------------------- ??? [74] 19.8% generic-sort/key [84] 20.8% copying-mergesort [98] 59.4% [111] 17230(10.6%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [120] 97.2% ??? [133] 2.8% -------------------------------------------------------------------------- update-leader! [101] 100.0% [112] 4354(2.7%) 242(0.1%) for-loop ...tlock/herbie/src/core/egraph.rkt:222:6 for-loop [122] 94.4% -------------------------------------------------------------------------- for-loop [92] 21.8% loop [103] 78.2% [113] 2212(1.4%) 202(0.1%) ??? .../ztatlock/herbie/src/core/regimes.rkt:295:8 eval-prog [127] 90.9% -------------------------------------------------------------------------- for-loop [100] 100.0% [114] 1308(0.8%) 664(0.4%) ??? /home/ztatlock/herbie/src/core/ematch.rkt:50:5 for-loop [124] 49.2% -------------------------------------------------------------------------- argmins [45] 23.8% loop [108] 26.2% f16 [37] 50.0% [115] 848(0.5%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 errors [121] 50.0% f16 [37] 50.0% -------------------------------------------------------------------------- list-cartesian-product [102] 100.0% [116] 440(0.3%) 440(0.3%) for-loop ...atlock/herbie/src/core/ematch.rkt:24:8 -------------------------------------------------------------------------- enode-merge! [109] 100.0% [117] 220(0.1%) 0(0.0%) adopt-enode! ...ock/herbie/src/core/enode.rkt:76:0 custom-set-union [148] 100.0% -------------------------------------------------------------------------- curry* [106] 100.0% [118] 218(0.1%) 218(0.1%) procedure-arity ...ket/private/norm-arity.rkt:7:27 -------------------------------------------------------------------------- mk-enode! [104] 100.0% [119] 200(0.1%) 200(0.1%) new-enode ...atlock/herbie/src/core/enode.rkt:68:0 -------------------------------------------------------------------------- generic-sort/key [84] 0.8% jloop [5] 32.6% loop [111] 66.6% [120] 25160(15.4%) 440(0.3%) ??? /home/ztatlock/herbie/src/points.rkt:49:27 eval-prog [127] 96.4% ??? [133] 1.8% -------------------------------------------------------------------------- override-at-pnts [95] 8.3% composed [115] 8.7% loop [126] 14.0% best-and-tied-at-points [88] 69.1% [121] 4888(3.0%) 0(0.0%) errors /home/ztatlock/herbie/src/points.rkt:142:0 for-loop [129] 82.2% eval-prog [127] 13.7% ??? [162] 4.1% -------------------------------------------------------------------------- for-loop [112] 100.0% [122] 4112(2.5%) 0(0.0%) for-loop ...tlock/herbie/src/core/egraph.rkt:223:8 hash-update! [128] 100.0% -------------------------------------------------------------------------- hash-ref! [145] 6.5% for-loop [24] 6.5% loop [126] 7.7% simplify [28] 12.9% parse-loop12 [123] 23.8% map [110] 42.4% [123] 3822(2.3%) 2952(1.8%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 parse-loop12 [123] 23.8% loop [126] 16.6% for-loop [131] 6.5% map [110] 1.8% loop [132] 1.6% -------------------------------------------------------------------------- ??? [114] 100.0% [124] 644(0.4%) 644(0.4%) for-loop ...atlock/herbie/src/core/ematch.rkt:51:7 -------------------------------------------------------------------------- map [110] 100.0% [125] 604(0.4%) 200(0.1%) ??? /home/ztatlock/herbie/src/core/reduce.rkt:50:5 for-loop [130] 66.9% -------------------------------------------------------------------------- ??? [71] 0.1% match-e [73] 0.3% make-exacts* [97] 0.3% option-on-expr [50] 0.4% for-loop [86] 0.5% get-final-combination [15] 0.7% map-enodes [40] 1.0% map [110] 1.1% parse-loop12 [123] 1.1% f16 [37] 1.4% loop! [135] 1.9% extract-alt [29] 3.2% ??? [4] 25.0% loop [126] 63.1% [126] 66150(40.5%) 640(0.4%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [126] 63.1% hash-ref! [145] 25.0% simplify [3] 3.2% loop! [135] 1.9% option-on-expr [50] 1.4% ??? [133] 1.1% for-loop [136] 0.9% parse-loop12 [123] 0.7% extract-alt [29] 0.7% errors [121] 0.4% make-multiplication-node [140] 0.3% foldl [142] 0.1% ->flonum [147] 0.0% -------------------------------------------------------------------------- make-exacts* [97] 1.3% errors [121] 2.1% for-loop [79] 5.7% ??? [113] 6.4% loop [85] 7.2% ??? [120] 77.3% [127] 31378(19.2%) 10170(6.2%) eval-prog ...tatlock/herbie/src/programs.rkt:259:0 hash-ref! [145] 58.4% ??? [137] 3.9% inductor [165] 2.3% new-lambda [138] 1.5% go [139] 1.5% -------------------------------------------------------------------------- for-loop [122] 100.0% [128] 4112(2.5%) 202(0.1%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [134] 95.1% -------------------------------------------------------------------------- errors [121] 100.0% [129] 4018(2.5%) 566(0.3%) for-loop ...e/ztatlock/herbie/src/points.rkt:145:4 ??? [133] 68.9% ulp-difference [141] 11.0% ->flonum [147] 6.0% -------------------------------------------------------------------------- ??? [125] 100.0% [130] 404(0.2%) 200(0.1%) for-loop ...atlock/herbie/src/core/reduce.rkt:51:7 pattern-match [143] 50.5% -------------------------------------------------------------------------- parse-loop12 [123] 100.0% [131] 400(0.2%) 0(0.0%) for-loop ...lock/herbie/src/core/taylor.rkt:490:59 hash-ref! [145] 100.0% -------------------------------------------------------------------------- parse-loop12 [123] 5.3% loop [132] 94.7% [132] 250(0.2%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:36:19 loop [132] 94.7% ->flonum [147] 5.3% -------------------------------------------------------------------------- jloop [5] 0.5% map [110] 1.1% ??? [120] 1.1% loop [111] 1.2% for-loop [129] 6.9% loop [126] 89.1% [133] 40284(24.7%) 238(0.1%) ??? /home/ztatlock/herbie/src/programs.rkt:265:4 ??? [144] 81.7% ??? [176] 13.1% ->flonum [147] 4.0% ??? [156] 0.5% -------------------------------------------------------------------------- hash-update! [128] 100.0% [134] 3910(2.4%) 222(0.1%) ??? .../ztatlock/herbie/src/core/egraph.rkt:225:24 for-loop [146] 94.3% -------------------------------------------------------------------------- for-loop [78] 11.3% merge-egraph-nodes! [87] 25.2% apply-match [60] 27.9% loop [126] 35.7% [135] 3894(2.4%) 424(0.3%) loop! .../ztatlock/herbie/src/core/enode.rkt:163:2 loop [126] 35.7% custom-set-union [148] 34.6% set [150] 16.3% update-en-expr [168] 8.0% -------------------------------------------------------------------------- map-enodes [40] 9.7% loop [126] 90.3% [136] 2290(1.4%) 664(0.4%) for-loop ...ock/herbie/src/core/simplify.rkt:161:2 setfindf [149] 61.3% eval-const-expr [155] 9.7% -------------------------------------------------------------------------- eval-prog [127] 100.0% [137] 1230(0.8%) 212(0.1%) ??? ...collects/racket/private/qq-and-or.rkt:155:9 ??? [151] 82.8% -------------------------------------------------------------------------- eval-prog [127] 100.0% [138] 460(0.3%) 222(0.1%) new-lambda ...ollects/racket/private/kw.rkt:679:11 loop [154] 51.7% -------------------------------------------------------------------------- eval-prog [127] 100.0% [139] 458(0.3%) 214(0.1%) go .../collects/racket/private/qq-and-or.rkt:50:20 loop [153] 53.3% -------------------------------------------------------------------------- loop [126] 49.8% map [110] 50.2% [140] 442(0.3%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:219:0 make-multiplication-subnode [152]100.0% -------------------------------------------------------------------------- for-loop [129] 100.0% [141] 442(0.3%) 0(0.0%) ulp-difference ...atlock/herbie/src/float.rkt:19:0 ??? [162] 100.0% -------------------------------------------------------------------------- loop [126] 50.0% for-loop [86] 50.0% [142] 404(0.2%) 202(0.1%) foldl ...et/collects/racket/private/list.rkt:229:4 ??? [157] 50.0% -------------------------------------------------------------------------- for-loop [130] 100.0% [143] 204(0.1%) 204(0.1%) pattern-match .../herbie/src/core/matcher.rkt:47:0 -------------------------------------------------------------------------- ??? [133] 100.0% [144] 32932(20.2%) 1918(1.2%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [186] 54.0% bf* [175] 26.1% ...higher-order.rkt:346:33 [163] 4.6% bfcube [164] 3.7% ??? [162] 2.9% for-loop [166] 2.8% -------------------------------------------------------------------------- for-loop [131] 0.2% first-nonzero-exp [34] 0.4% for-loop [21] 0.6% ??? [32] 0.7% for-loop [19] 0.7% compile [91] 0.8% ??? [8] 0.9% for-loop [30] 0.9% ??? [4] 1.9% ??? [161] 3.0% loop [17] 3.7% ??? [160] 4.7% for-loop [18] 5.7% eval-prog [127] 24.3% loop [126] 49.3% [145] 24906(15.3%) 1342(0.8%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [4] 51.2% bigfloat-hash [158] 22.9% ??? [7] 5.9% ??? [160] 4.7% simplify [28] 4.5% ??? [161] 3.0% ??? [8] 1.5% ??? [9] 1.4% parse-loop12 [123] 1.0% ??? [10] 0.9% f16 [37] 0.8% ??? [11] 0.2% -------------------------------------------------------------------------- ??? [134] 100.0% [146] 3688(2.3%) 3468(2.1%) for-loop ...lock/herbie/src/core/egraph.rkt:226:26 update-en-expr [168] 6.0% -------------------------------------------------------------------------- jloop [5] 7.6% for-loop [129] 8.0% loop [132] 8.3% loop [126] 23.1% ??? [133] 53.0% [147] 3026(1.9%) 230(0.1%) ->flonum ...ock/herbie/src/syntax/syntax.rkt:230:0 ??? [162] 92.4% -------------------------------------------------------------------------- adopt-enode! [117] 12.2% loop! [135] 87.8% [148] 1798(1.1%) 462(0.3%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [167] 49.8% for-loop [170] 24.5% -------------------------------------------------------------------------- for-loop [136] 100.0% [149] 1404(0.9%) 1002(0.6%) setfindf ...e/ztatlock/herbie/src/common.rkt:143:0 constant? [169] 14.4% for-loop [173] 14.2% -------------------------------------------------------------------------- loop! [135] 100.0% [150] 1268(0.8%) 1268(0.8%) set ...collects/racket/private/set-types.rkt:981:0 -------------------------------------------------------------------------- ??? [137] 100.0% [151] 1018(0.6%) 1018(0.6%) ??? ...ollects/racket/private/qq-and-or.rkt:164:21 -------------------------------------------------------------------------- make-multiplication-node [140] 100.0% [152] 442(0.3%) 0(0.0%) make-multiplication-subnode ...re/reduce.rkt:229:0 group-by68 [171] 50.2% for-loop [172] 49.8% -------------------------------------------------------------------------- go [139] 20.0% loop [153] 80.0% [153] 244(0.1%) 244(0.1%) loop ...llects/racket/private/qq-and-or.rkt:101:61 loop [153] 80.0% -------------------------------------------------------------------------- new-lambda [138] 100.0% [154] 238(0.1%) 238(0.1%) loop .../collects/racket/private/stxcase.rkt:112:7 -------------------------------------------------------------------------- for-loop [136] 100.0% [155] 222(0.1%) 0(0.0%) eval-const-expr ...k/herbie/src/programs.rkt:277:0 inductor [165] 100.0% -------------------------------------------------------------------------- ??? [133] 100.0% [156] 214(0.1%) 0(0.0%) ??? ...tract/private/arrow-higher-order.rkt:145:21 ??? [190] 100.0% -------------------------------------------------------------------------- foldl [142] 100.0% [157] 202(0.1%) 0(0.0%) ??? /home/ztatlock/herbie/src/alternative.rkt:64:9 location-do [159] 100.0% -------------------------------------------------------------------------- hash-ref! [145] 100.0% [158] 17650(10.8%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bfcanonicalize [174] 84.8% sig+exp->bigfloat [177] 12.8% bigfloat->sig+exp [192] 2.4% -------------------------------------------------------------------------- ??? [157] 0.7% for-loop [75] 31.2% location-do [159] 68.2% [159] 6070(3.7%) 0(0.0%) location-do ...tlock/herbie/src/programs.rkt:226:0 location-do [159] 68.2% approximate9 [6] 31.2% pattern-substitute [185] 0.7% -------------------------------------------------------------------------- hash-ref! [145] 100.0% [160] 4822(3.0%) 0(0.0%) ??? ...e/ztatlock/herbie/src/core/taylor.rkt:64:15 hash-ref! [145] 100.0% -------------------------------------------------------------------------- hash-ref! [145] 100.0% [161] 4416(2.7%) 0(0.0%) ??? ...e/ztatlock/herbie/src/core/taylor.rkt:43:15 hash-ref! [145] 100.0% -------------------------------------------------------------------------- errors [121] 4.6% ulp-difference [141] 10.0% ??? [144] 21.9% ->flonum [147] 63.5% [162] 4406(2.7%) 1926(1.2%) ??? /home/ztatlock/herbie/src/config.rkt:48:0 ??? [178] 31.3% return/no-unsupplied [182] 15.5% list-member? [183] 9.5% -------------------------------------------------------------------------- ??? [144] 100.0% [163] 1510(0.9%) 762(0.5%) ...higher-order.rkt:346:33 (unknown source) ??? [180] 49.5% -------------------------------------------------------------------------- ??? [144] 100.0% [164] 1230(0.8%) 0(0.0%) bfcube ...tlock/herbie/src/syntax/syntax.rkt:116:0 bf* [175] 100.0% -------------------------------------------------------------------------- eval-const-expr [155] 11.6% eval-prog [127] 21.1% inductor [165] 67.2% [165] 954(0.6%) 478(0.3%) inductor .../ztatlock/herbie/src/programs.rkt:71:2 inductor [165] 67.2% ??? [176] 16.1% -------------------------------------------------------------------------- ??? [144] 100.0% [166] 926(0.6%) 0(0.0%) for-loop ...ock/herbie/src/syntax/syntax.rkt:139:2 bf<= [181] 76.7% ...higher-order.rkt:342:33 [184] 23.3% -------------------------------------------------------------------------- custom-set-union [148] 100.0% [167] 896(0.5%) 0(0.0%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [179] 100.0% -------------------------------------------------------------------------- for-loop [146] 26.1% loop! [135] 73.9% [168] 844(0.5%) 844(0.5%) update-en-expr ...herbie/src/core/egraph.rkt:211:0 -------------------------------------------------------------------------- setfindf [149] 31.9% match-e [73] 68.1% [169] 634(0.4%) 634(0.4%) constant? ...ck/herbie/src/syntax/syntax.rkt:227:0 -------------------------------------------------------------------------- custom-set-union [148] 100.0% [170] 440(0.3%) 440(0.3%) for-loop ...cts/racket/private/set-types.rkt:152:2 -------------------------------------------------------------------------- make-multiplication-subnode [152]100.0% [171] 222(0.1%) 222(0.1%) group-by68 ...acket/collects/racket/list.rkt:749:0 -------------------------------------------------------------------------- make-multiplication-subnode [152]100.0% [172] 220(0.1%) 220(0.1%) for-loop ...tlock/herbie/src/core/reduce.rkt:231:3 -------------------------------------------------------------------------- setfindf [149] 100.0% [173] 200(0.1%) 200(0.1%) for-loop ...e/ztatlock/herbie/src/common.rkt:144:2 -------------------------------------------------------------------------- bigfloat-hash [158] 100.0% [174] 14976(9.2%) 14776(9.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 bigfloat->sig+exp [192] 1.3% -------------------------------------------------------------------------- bfcube [164] 12.5% ??? [144] 87.5% [175] 9822(6.0%) 768(0.5%) bf* ...ath/private/bigfloat/bigfloat-mpfr.rkt:95:0 ??? [186] 92.2% -------------------------------------------------------------------------- inductor [165] 8.2% ??? [133] 91.8% [176] 5772(3.5%) 0(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [187] 91.8% integer->bigfloat [193] 8.2% -------------------------------------------------------------------------- bigfloat-hash [158] 100.0% [177] 2258(1.4%) 1810(1.1%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 integer->mpz [194] 19.8% -------------------------------------------------------------------------- ??? [162] 100.0% [178] 1378(0.8%) 202(0.1%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [188] 85.3% -------------------------------------------------------------------------- for-loop [167] 100.0% [179] 896(0.5%) 896(0.5%) for-loop ...cts/racket/private/set-types.rkt:178:5 -------------------------------------------------------------------------- ...higher-order.rkt:346:33 [163] 100.0% [180] 748(0.5%) 492(0.3%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [190] 34.2% -------------------------------------------------------------------------- for-loop [166] 100.0% [181] 710(0.4%) 0(0.0%) bf<= ...h/private/bigfloat/bigfloat-mpfr.rkt:127:4 ??? [189] 100.0% -------------------------------------------------------------------------- ??? [162] 100.0% [182] 684(0.4%) 462(0.3%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [191] 32.5% -------------------------------------------------------------------------- ??? [162] 100.0% [183] 418(0.3%) 418(0.3%) list-member? ...llects/racket/private/set.rkt:24:0 -------------------------------------------------------------------------- for-loop [166] 100.0% [184] 216(0.1%) 0(0.0%) ...higher-order.rkt:342:33 (unknown source) ??? [190] 100.0% -------------------------------------------------------------------------- pattern-substitute [185] 50.0% location-do [159] 50.0% [185] 202(0.1%) 202(0.1%) pattern-substitute ...ie/src/core/matcher.rkt:72:0 pattern-substitute [185] 50.0% -------------------------------------------------------------------------- bf* [175] 33.7% ??? [144] 66.3% [186] 26844(16.4%) 5848(3.6%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfmul [195] 45.7% bfcbrt [196] 32.5% -------------------------------------------------------------------------- ??? [176] 100.0% [187] 5296(3.2%) 4342(2.7%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [197] 18.0% -------------------------------------------------------------------------- ??? [178] 100.0% [188] 1176(0.7%) 1176(0.7%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 -------------------------------------------------------------------------- bf<= [181] 100.0% [189] 710(0.4%) 710(0.4%) ??? ...tract/private/arrow-higher-order.rkt:346:33 -------------------------------------------------------------------------- ??? [156] 31.2% ...higher-order.rkt:342:33 [184] 31.5% ??? [180] 37.3% [190] 686(0.4%) 686(0.4%) ??? ...ects/racket/contract/private/guts.rkt:644:8 -------------------------------------------------------------------------- return/no-unsupplied [182] 34.4% for-loop [86] 65.6% [191] 646(0.4%) 646(0.4%) filter ...t/collects/racket/private/list.rkt:256:2 -------------------------------------------------------------------------- bfcanonicalize [174] 32.5% bigfloat-hash [158] 67.5% [192] 616(0.4%) 616(0.4%) bigfloat->sig+exp ...ivate/bigfloat/mpfr.rkt:370:0 -------------------------------------------------------------------------- ??? [176] 100.0% [193] 476(0.3%) 254(0.2%) integer->bigfloat ...ivate/bigfloat/mpfr.rkt:399:0 ??? [197] 46.6% -------------------------------------------------------------------------- sig+exp->bigfloat [177] 100.0% [194] 448(0.3%) 448(0.3%) integer->mpz ...math/private/bigfloat/gmp.rkt:87:0 -------------------------------------------------------------------------- ??? [186] 100.0% [195] 12270(7.5%) 7810(4.8%) bfmul ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [197] 36.3% -------------------------------------------------------------------------- ??? [186] 100.0% [196] 8726(5.3%) 5796(3.5%) bfcbrt ...lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [197] 33.6% -------------------------------------------------------------------------- integer->bigfloat [193] 2.6% real->bigfloat [187] 11.1% bfcbrt [196] 34.2% bfmul [195] 52.1% [197] 8566(5.2%) 8566(5.2%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 --------------------------------------------------------------------------