Profiling results ----------------- Total cpu time observed: 210092ms (out of 210952ms) Number of samples taken: 651 (once every 323ms) (Hiding functions with self<1.0% and local<2.0%: 12 of 207 hidden) ============================================================================ Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee ============================================================================ ??? [48] 100.0% [1] 192552(91.7%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [11] 100.0% ---------------------------------------------------------------------------- ??? [48] 100.0% [2] 144928(69.0%) 0(0.0%) run-improve50 ...ie/develop/src/mainloop.rkt:234:0 for-loop [13] 51.8% get-final-combination [14] 45.8% loop [57] 2.2% setup-alt-simplified [19] 0.2% ---------------------------------------------------------------------------- ??? [80] 100.0% [3] 5852(2.8%) 0(0.0%) loop ...herbie/develop/src/core/simplify.rkt:215:2 pass [15] 100.0% ---------------------------------------------------------------------------- copying-mergesort [152] 100.0% [4] 2860(1.4%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [12] 77.8% ??? [78] 22.2% ---------------------------------------------------------------------------- ??? [78] 14.3% hash-ref! [108] 85.7% [5] 2334(1.1%) 0(0.0%) simplify ...erbie/develop/src/core/reduce.rkt:16:0 f6 [30] 82.6% parse-loop12 [119] 17.4% ---------------------------------------------------------------------------- ??? [78] 100.0% [6] 2330(1.1%) 0(0.0%) approximate9 ...e/develop/src/core/taylor.rkt:12:0 loop [16] 85.8% debug-print [20] 14.2% ---------------------------------------------------------------------------- match-e [107] 100.0% [7] 1406(0.7%) 0(0.0%) variable? ...e/develop/src/syntax/syntax.rkt:660:0 ??? [42] 100.0% ---------------------------------------------------------------------------- hash-ref! [108] 100.0% [8] 1386(0.7%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:285:26 for-loop [17] 100.0% ---------------------------------------------------------------------------- hash-ref! [108] 100.0% [9] 1380(0.7%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:295:23 for-loop [18] 100.0% ---------------------------------------------------------------------------- hash-ref! [108] 100.0% [10] 302(0.1%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:483:23 for-loop [21] 100.0% ---------------------------------------------------------------------------- profile-thunk16 [1] 99.9% [11] 192816(91.8%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [48] 100.0% ---------------------------------------------------------------------------- ??? [145] 0.6% jloop [4] 2.0% loop [69] 2.2% loop [162] 3.0% for-loop [75] 12.6% loop [94] 79.6% [12] 108794(51.8%) 1570(0.7%) ??? ...tlies/herbie/develop/src/programs.rkt:154:4 ??? [22] 92.2% ??? [26] 3.4% ??? [78] 3.0% ---------------------------------------------------------------------------- run-improve50 [2] 100.0% [13] 75084(35.7%) 0(0.0%) for-loop ...herbie/develop/src/mainloop.rkt:249:10 run-iter! [23] 100.0% ---------------------------------------------------------------------------- run-improve50 [2] 100.0% [14] 66380(31.6%) 0(0.0%) get-final-combination ...op/src/mainloop.rkt:264:0 split-table [24] 99.5% extract-alt [29] 0.5% ---------------------------------------------------------------------------- loop [3] 100.0% [15] 5852(2.8%) 0(0.0%) pass ...herbie/develop/src/core/simplify.rkt:205:2 for-loop [25] 100.0% ---------------------------------------------------------------------------- approximate9 [6] 100.0% [16] 2000(1.0%) 0(0.0%) loop ...es/herbie/develop/src/core/taylor.rkt:86:4 ??? [78] 52.5% hash-ref! [108] 47.5% ---------------------------------------------------------------------------- ??? [8] 100.0% [17] 1386(0.7%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:285:52 hash-ref! [108] 85.4% ??? [141] 14.6% ---------------------------------------------------------------------------- ??? [9] 100.0% [18] 1380(0.7%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:298:27 hash-ref! [108] 100.0% ---------------------------------------------------------------------------- run-improve50 [2] 100.0% [19] 332(0.2%) 0(0.0%) setup-alt-simplified .../develop/src/glue.rkt:49:0 simplify-alt [27] 100.0% ---------------------------------------------------------------------------- approximate9 [6] 100.0% [20] 330(0.2%) 0(0.0%) debug-print .../herbie/develop/src/debug.rkt:107:0 for-loop [28] 100.0% ---------------------------------------------------------------------------- ??? [10] 100.0% [21] 302(0.1%) 0(0.0%) for-loop ...bie/develop/src/core/taylor.rkt:487:35 parse-loop12 [119] 100.0% ---------------------------------------------------------------------------- ??? [12] 100.0% [22] 100276(47.7%) 10400(5.0%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [114] 81.7% ??? [101] 5.6% ...higher-order.rkt:346:33 [40] 0.3% ??? [182] 0.3% parse-loop12 [119] 0.3% ---------------------------------------------------------------------------- for-loop [13] 100.0% [23] 75084(35.7%) 0(0.0%) run-iter! ...herbie/develop/src/mainloop.rkt:215:0 simplify! [31] 74.1% finalize-iter! [32] 17.1% gen-series! [35] 3.5% localize-error [36] 3.1% choose-best-alt! [38] 1.3% gen-rewrites! [39] 0.8% ---------------------------------------------------------------------------- get-final-combination [14] 100.0% [24] 66080(31.5%) 0(0.0%) split-table ...s/herbie/develop/src/glue.rkt:162:0 f6 [30] 100.0% ---------------------------------------------------------------------------- pass [15] 100.0% [25] 5852(2.8%) 0(0.0%) for-loop ...e/develop/src/core/simplify.rkt:208:29 argmin [33] 66.8% loop [37] 33.2% ---------------------------------------------------------------------------- ??? [12] 100.0% [26] 3722(1.8%) 0(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [34] 100.0% ---------------------------------------------------------------------------- setup-alt-simplified [19] 100.0% [27] 332(0.2%) 0(0.0%) simplify-alt ...s/herbie/develop/src/glue.rkt:76:0 ??? [80] 100.0% ---------------------------------------------------------------------------- debug-print [20] 100.0% [28] 330(0.2%) 330(0.2%) for-loop ...ies/herbie/develop/src/debug.rkt:113:2 ---------------------------------------------------------------------------- get-final-combination [14] 100.0% [29] 300(0.1%) 0(0.0%) extract-alt ...es/herbie/develop/src/glue.rkt:55:0 loop [87] 100.0% ---------------------------------------------------------------------------- for-loop [61] 0.1% simplify-node [55] 0.2% map [44] 0.2% loop [94] 0.2% eval-prog [76] 1.3% simplify [5] 1.8% f6 [30] 1.8% hash-ref! [108] 2.8% split-table [24] 91.6% [30] 70942(33.8%) 0(0.0%) f6 ...et/collects/racket/match/compiler.rkt:507:40 loop [94] 74.8% option-on-expr [99] 16.8% map [44] 4.9% f6 [30] 1.8% ??? [78] 1.3% parse-loop12 [119] 0.2% loop [47] 0.1% ...velop/src/common.rkt:47:2 [171] 0.1% ---------------------------------------------------------------------------- run-iter! [23] 100.0% [31] 55652(26.5%) 0(0.0%) simplify! ...herbie/develop/src/mainloop.rkt:155:0 for-loop [41] 100.0% ---------------------------------------------------------------------------- run-iter! [23] 100.0% [32] 12848(6.1%) 0(0.0%) finalize-iter! ...e/develop/src/mainloop.rkt:169:0 ??? [42] 100.0% ---------------------------------------------------------------------------- for-loop [25] 100.0% [33] 3908(1.9%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [43] 100.0% ---------------------------------------------------------------------------- ??? [26] 100.0% [34] 3722(1.8%) 2430(1.2%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 ??? [154] 34.7% ---------------------------------------------------------------------------- run-iter! [23] 100.0% [35] 2664(1.3%) 0(0.0%) gen-series! ...rbie/develop/src/mainloop.rkt:129:0 for-loop [45] 100.0% ---------------------------------------------------------------------------- run-iter! [23] 100.0% [36] 2316(1.1%) 0(0.0%) localize-error ...velop/src/core/localize.rkt:47:0 hash-ref! [108] 100.0% ---------------------------------------------------------------------------- for-loop [25] 100.0% [37] 1944(0.9%) 308(0.1%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [43] 84.2% ---------------------------------------------------------------------------- run-iter! [23] 100.0% [38] 968(0.5%) 0(0.0%) choose-best-alt! ...develop/src/mainloop.rkt:115:0 ??? [42] 100.0% ---------------------------------------------------------------------------- run-iter! [23] 100.0% [39] 636(0.3%) 0(0.0%) gen-rewrites! ...ie/develop/src/mainloop.rkt:142:0 for-loop [46] 100.0% ---------------------------------------------------------------------------- ??? [22] 100.0% [40] 304(0.1%) 0(0.0%) ...higher-order.rkt:346:33 (unknown source) ??? [178] 100.0% ---------------------------------------------------------------------------- simplify! [31] 97.3% [41] 57220(27.2%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:159:6 ??? [48] 100.0% ---------------------------------------------------------------------------- gather-additive-terms6 [147] 1.5% choose-best-alt! [38] 4.5% ??? [187] 6.0% variable? [7] 6.5% get-sigs [165] 7.7% match-e [107] 14.0% finalize-iter! [32] 58.1% [42] 21564(10.3%) 4072(1.9%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [49] 54.8% hash-has-key? [50] 17.0% ??? [52] 4.5% atab-add-altns [53] 3.4% ---------------------------------------------------------------------------- loop [37] 29.5% argmin [33] 70.5% [43] 5544(2.6%) 0(0.0%) for-loop .../herbie/develop/src/programs.rkt:199:2 ??? [80] 81.5% ...velop/src/common.rkt:47:2 [171] 18.5% ---------------------------------------------------------------------------- f6 [30] 100.0% [44] 3596(1.7%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 loop [94] 42.4% parse-loop12 [119] 35.2% ??? [102] 13.2% f6 [30] 4.6% simplify-node [55] 4.6% ---------------------------------------------------------------------------- gen-series! [35] 100.0% [45] 2664(1.3%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:135:7 taylor-alt [51] 100.0% ---------------------------------------------------------------------------- gen-rewrites! [39] 100.0% [46] 636(0.3%) 0(0.0%) for-loop ...herbie/develop/src/mainloop.rkt:147:11 ??? [54] 100.0% ---------------------------------------------------------------------------- f6 [30] 100.0% [47] 330(0.2%) 0(0.0%) loop ...es/herbie/develop/src/core/reduce.rkt:18:2 expression->type [56] 100.0% ---------------------------------------------------------------------------- for-loop [41] 9.7% run [11] 42.1% [48] 207324(98.7%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 42.0% run-improve50 [2] 30.7% ??? [80] 15.5% loop [57] 11.8% ---------------------------------------------------------------------------- ??? [42] 100.0% [49] 12124(5.8%) 0(0.0%) for-loop ...ie/develop/src/core/alt-table.rkt:51:2 atab-add-altn [58] 100.0% ---------------------------------------------------------------------------- ??? [42] 100.0% [50] 3976(1.9%) 336(0.2%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [85] 91.5% ---------------------------------------------------------------------------- for-loop [45] 100.0% [51] 2664(1.3%) 0(0.0%) taylor-alt ...es/herbie/develop/src/glue.rkt:134:0 for-loop [59] 100.0% ---------------------------------------------------------------------------- ??? [42] 100.0% [52] 968(0.5%) 0(0.0%) ??? .../herbie/develop/src/core/alt-table.rkt:54:0 ??? [78] 100.0% ---------------------------------------------------------------------------- ??? [42] 100.0% [53] 724(0.3%) 0(0.0%) atab-add-altns ...elop/src/core/alt-table.rkt:50:0 atab-add-altn [58] 100.0% ---------------------------------------------------------------------------- for-loop [46] 100.0% [54] 636(0.3%) 0(0.0%) ??? ...ies/herbie/develop/src/alternative.rkt:88:0 rewriter [60] 100.0% ---------------------------------------------------------------------------- map [44] 100.0% [55] 334(0.2%) 0(0.0%) simplify-node .../develop/src/core/reduce.rkt:50:0 f6 [30] 100.0% ---------------------------------------------------------------------------- loop [47] 25.0% for-loop [61] 75.0% [56] 330(0.2%) 0(0.0%) expression->type ...evelop/src/type-check.rkt:45:0 for-loop [61] 100.0% ---------------------------------------------------------------------------- run-improve50 [2] 3.3% pred [164] 46.0% ??? [48] 50.7% [57] 96082(45.7%) 360(0.2%) loop ...htlies/herbie/develop/src/points.rkt:205:2 loop [69] 33.3% make-exacts* [68] 32.9% loop [62] 32.5% for-loop [65] 0.7% ---------------------------------------------------------------------------- atab-add-altns [53] 5.6% for-loop [49] 94.4% [58] 12848(6.1%) 0(0.0%) atab-add-altn ...elop/src/core/alt-table.rkt:208:0 best-and-tied-at-points [63] 91.8% override-at-pnts [64] 8.2% ---------------------------------------------------------------------------- taylor-alt [51] 100.0% [59] 2664(1.3%) 0(0.0%) for-loop ...lies/herbie/develop/src/glue.rkt:139:6 ??? [78] 100.0% ---------------------------------------------------------------------------- ??? [54] 41.4% matcher [72] 58.6% [60] 636(0.3%) 0(0.0%) rewriter ...bie/develop/src/core/matcher.rkt:131:2 for-loop [66] 82.8% *rules* [67] 17.2% ---------------------------------------------------------------------------- expression->type [56] 100.0% [61] 330(0.2%) 0(0.0%) for-loop ...herbie/develop/src/type-check.rkt:52:5 expression->type [56] 75.0% f6 [30] 25.0% ---------------------------------------------------------------------------- loop [57] 100.0% [62] 31272(14.9%) 324(0.2%) loop ...htlies/herbie/develop/src/points.rkt:158:2 make-exacts* [68] 51.3% loop [69] 47.7% ---------------------------------------------------------------------------- atab-add-altn [58] 100.0% [63] 11794(5.6%) 0(0.0%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 errors [70] 96.9% for-loop [73] 3.1% ---------------------------------------------------------------------------- atab-add-altn [58] 100.0% [64] 1054(0.5%) 0(0.0%) override-at-pnts ...p/src/core/alt-table.rkt:145:0 errors [70] 100.0% ---------------------------------------------------------------------------- loop [57] 100.0% [65] 640(0.3%) 0(0.0%) for-loop ...s/herbie/develop/src/points.rkt:222:26 for-loop [71] 100.0% ---------------------------------------------------------------------------- rewriter [60] 100.0% [66] 636(0.3%) 0(0.0%) for-loop ...ie/develop/src/core/matcher.rkt:134:10 matcher [72] 100.0% ---------------------------------------------------------------------------- rewriter [60] 100.0% [67] 328(0.2%) 0(0.0%) *rules* ...rbie/develop/src/syntax/rules.rkt:514:0 for-loop [74] 100.0% ---------------------------------------------------------------------------- loop [62] 33.7% loop [57] 66.3% [68] 47620(22.7%) 0(0.0%) make-exacts* ...erbie/develop/src/points.rkt:138:0 loop [94] 92.2% eval-prog [76] 7.8% ---------------------------------------------------------------------------- loop [62] 31.8% loop [57] 68.2% [69] 46874(22.3%) 0(0.0%) loop ...htlies/herbie/develop/src/points.rkt:141:4 loop [94] 94.8% ??? [12] 5.2% ---------------------------------------------------------------------------- override-at-pnts [64] 4.5% composed [92] 5.4% pred [164] 9.2% option-on-expr [99] 14.3% loop [94] 17.9% best-and-tied-at-points [63] 48.7% [70] 23486(11.2%) 0(0.0%) errors ...lies/herbie/develop/src/points.rkt:241:0 for-loop [75] 83.3% eval-prog [76] 16.7% ---------------------------------------------------------------------------- for-loop [65] 100.0% [71] 640(0.3%) 0(0.0%) for-loop ...s/herbie/develop/src/points.rkt:223:28 ??? [78] 100.0% ---------------------------------------------------------------------------- for-loop [77] 16.1% matcher [72] 25.8% for-loop [66] 58.1% [72] 636(0.3%) 308(0.1%) matcher ...rbie/develop/src/core/matcher.rkt:167:2 rewriter [60] 41.9% matcher [72] 25.8% for-loop [77] 16.1% ---------------------------------------------------------------------------- best-and-tied-at-points [63] 100.0% [73] 360(0.2%) 360(0.2%) for-loop .../develop/src/core/alt-table.rkt:124:16 ---------------------------------------------------------------------------- *rules* [67] 100.0% [74] 328(0.2%) 328(0.2%) for-loop ...ies/herbie/develop/src/common.rkt:99:9 ---------------------------------------------------------------------------- errors [70] 100.0% [75] 19564(9.3%) 2684(1.3%) for-loop ...es/herbie/develop/src/points.rkt:244:4 ??? [12] 69.8% ulp-difference [79] 8.3% ??? [78] 6.4% ---------------------------------------------------------------------------- make-exacts* [68] 48.7% errors [70] 51.3% [76] 7648(3.6%) 2134(1.0%) eval-prog ...herbie/develop/src/programs.rkt:148:0 hash-ref! [108] 35.6% f6 [30] 32.5% ??? [78] 3.9% ---------------------------------------------------------------------------- matcher [72] 100.0% [77] 308(0.1%) 0(0.0%) for-loop ...ie/develop/src/core/matcher.rkt:183:21 matcher [72] 100.0% ---------------------------------------------------------------------------- eval-prog [76] 2.2% ??? [125] 2.3% loop [128] 2.3% loop [16] 2.5% loop [162] 4.0% jloop [4] 4.6% for-loop [71] 4.6% ??? [52] 4.8% ??? [80] 7.2% for-loop [59] 7.2% for-loop [75] 9.0% loop [94] 10.6% f6 [30] 16.8% ??? [12] 22.1% [78] 13930(6.6%) 1232(0.6%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [80] 56.6% ??? [187] 11.6% approximate9 [6] 6.0% best-alt [81] 4.8% hash-ref! [108] 4.8% ...velop/src/common.rkt:47:2 [171] 2.3% ->bf [82] 2.2% ??? [169] 1.8% simplify [5] 1.2% ---------------------------------------------------------------------------- for-loop [75] 100.0% [79] 1626(0.8%) 1080(0.5%) ulp-difference ...erbie/develop/src/float.rkt:19:0 ??? [179] 33.6% ---------------------------------------------------------------------------- simplify-alt [27] 0.2% for-loop [43] 1.9% get-sigs [165] 2.4% ??? [78] 10.6% ??? [80] 19.1% for-loop [84] 24.4% ??? [48] 41.5% [80] 79476(37.8%) 6332(3.0%) ??? ...llects/racket/private/norm-define.rkt:53:83 iterate-egraph!13 [83] 37.7% for-loop [84] 24.4% ??? [80] 19.1% ??? [85] 2.7% loop [3] 2.7% return/no-unsupplied [181] 2.2% ??? [179] 1.9% ??? [78] 1.6% mk-egraph [86] 1.1% loop [88] 0.5% ---------------------------------------------------------------------------- ??? [78] 100.0% [81] 968(0.5%) 0(0.0%) best-alt ...tlies/herbie/develop/src/glue.rkt:71:0 loop [87] 100.0% ---------------------------------------------------------------------------- ??? [78] 100.0% [82] 302(0.1%) 0(0.0%) ->bf ...tlies/herbie/develop/src/programs.rkt:51:0 ...velop/src/common.rkt:47:2 [171] 100.0% ---------------------------------------------------------------------------- ??? [80] 100.0% [83] 61734(29.4%) 0(0.0%) iterate-egraph!13 ...p/src/core/simplify.rkt:102:0 one-iter [89] 98.4% ---------------------------------------------------------------------------- ??? [80] 100.0% [84] 40384(19.2%) 0(0.0%) for-loop ...ie/develop/src/core/simplify.rkt:63:12 ??? [80] 100.0% ---------------------------------------------------------------------------- hash-has-key? [50] 35.7% ??? [80] 64.3% [85] 10186(4.8%) 4582(2.2%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [90] 35.0% ??? [97] 16.7% arrow-higher-order:lnp [98] 3.3% ---------------------------------------------------------------------------- ??? [80] 100.0% [86] 1712(0.8%) 368(0.2%) mk-egraph ...bie/develop/src/core/egraph.rkt:123:0 expr->enode [91] 78.5% ---------------------------------------------------------------------------- extract-alt [29] 23.7% best-alt [81] 76.3% [87] 1268(0.6%) 0(0.0%) loop ...htlies/herbie/develop/src/common.rkt:151:2 composed [92] 100.0% ---------------------------------------------------------------------------- ??? [80] 100.0% [88] 362(0.2%) 0(0.0%) loop ...ghtlies/herbie/develop/src/points.rkt:66:6 random-exp [93] 100.0% ---------------------------------------------------------------------------- iterate-egraph!13 [83] 100.0% [89] 60734(28.9%) 694(0.3%) one-iter ...ie/develop/src/core/simplify.rkt:113:0 loop [95] 58.2% for-loop [96] 33.5% apply-match [100] 6.7% ---------------------------------------------------------------------------- ??? [85] 100.0% [90] 3566(1.7%) 1250(0.6%) for-loop ...acket/contract/private/list.rkt:743:12 for-loop [174] 37.0% ??? [97] 18.7% arrow-higher-order:lnp [98] 9.3% ---------------------------------------------------------------------------- expr->enode [91] 27.4% mk-egraph [86] 72.6% [91] 1344(0.6%) 0(0.0%) expr->enode ...e/develop/src/core/egraph.rkt:124:2 mk-enode! [129] 72.6% expr->enode [91] 27.4% ---------------------------------------------------------------------------- loop [87] 100.0% [92] 1268(0.6%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 errors [70] 100.0% ---------------------------------------------------------------------------- loop [88] 100.0% [93] 362(0.2%) 362(0.2%) random-exp .../herbie/develop/src/common.rkt:251:0 ---------------------------------------------------------------------------- map [44] 0.2% match-e [107] 0.6% for-loop [116] 0.6% loop! [150] 0.6% parse-loop12 [119] 0.9% ??? [124] 1.1% option-on-expr [99] 1.5% make-exacts* [68] 2.8% loop [69] 4.5% f6 [30] 19.0% loop [94] 68.1% [94] 120338(57.3%) 1612(0.8%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [94] 68.1% option-on-expr [99] 19.0% ??? [12] 7.3% errors [70] 1.5% hash-ref! [108] 1.1% loop! [150] 0.6% ??? [102] 0.6% parse-loop12 [119] 0.3% f6 [30] 0.1% ??? [114] 0.1% for-loop [104] 0.1% ??? [101] 0.1% curried [140] 0.0% ??? [78] 0.0% ---------------------------------------------------------------------------- one-iter [89] 100.0% [95] 35324(16.8%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:52:19 apply-match [100] 100.0% ---------------------------------------------------------------------------- for-loop [96] 50.0% one-iter [89] 50.0% [96] 20334(9.7%) 4120(2.0%) for-loop ...e/develop/src/core/simplify.rkt:123:12 for-loop [96] 50.0% match-e [107] 39.9% ---------------------------------------------------------------------------- for-loop [90] 28.2% ??? [85] 71.8% [97] 2372(1.1%) 690(0.3%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [103] 70.9% ---------------------------------------------------------------------------- for-loop [90] 49.7% ??? [85] 50.3% [98] 664(0.3%) 664(0.3%) arrow-higher-order:lnp ...w-higher-order.rkt:597:7 ---------------------------------------------------------------------------- f6 [30] 18.5% loop [94] 81.5% [99] 66080(31.5%) 0(0.0%) option-on-expr ...velop/src/core/regimes.rkt:103:0 sindices->spoints [105] 70.2% sort-context-on-expr [109] 10.1% err-lsts->split-indices [110] 7.3% loop [94] 6.4% errors [70] 5.1% pick-errors [111] 1.0% ---------------------------------------------------------------------------- one-iter [89] 10.3% loop [95] 89.7% [100] 39372(18.7%) 0(0.0%) apply-match ...develop/src/core/simplify.rkt:130:2 for-loop [106] 88.0% match-e [107] 9.3% update-leader! [132] 2.7% ---------------------------------------------------------------------------- loop [94] 5.1% ??? [22] 94.9% [101] 5896(2.8%) 3616(1.7%) ??? ...herbie/develop/src/syntax/syntax.rkt:153:17 ??? [179] 34.0% return/no-unsupplied [181] 4.7% ---------------------------------------------------------------------------- map [44] 8.7% loop [94] 91.3% [102] 1998(1.0%) 0(0.0%) ??? ...ket/collects/racket/private/list.rkt:323:18 hash-ref! [108] 100.0% ---------------------------------------------------------------------------- ??? [97] 100.0% [103] 1682(0.8%) 1682(0.8%) make-keyword-procedure ...ket/private/kw.rkt:260:4 ---------------------------------------------------------------------------- loop [94] 100.0% [104] 674(0.3%) 0(0.0%) for-loop ...ie/develop/src/core/simplify.rkt:173:2 setfindf [112] 51.6% eval-const-expr [113] 48.4% ---------------------------------------------------------------------------- option-on-expr [99] 100.0% [105] 46366(22.1%) 0(0.0%) sindices->spoints ...op/src/core/regimes.rkt:116:0 loop [128] 100.0% ---------------------------------------------------------------------------- apply-match [100] 100.0% [106] 34646(16.5%) 0(0.0%) for-loop ...e/develop/src/core/simplify.rkt:145:10 mk-enode! [129] 33.1% merge-egraph-nodes! [115] 28.8% loop! [150] 16.7% substitute-e [118] 16.5% list-member? [123] 5.0% ---------------------------------------------------------------------------- apply-match [100] 10.4% for-loop [130] 22.6% for-loop [96] 67.0% [107] 19878(9.5%) 10762(5.1%) match-e ...herbie/develop/src/core/ematch.rkt:46:0 for-loop [116] 26.1% for-loop [130] 9.1% ??? [42] 7.9% variable? [7] 2.9% loop [94] 2.4% filter [143] 0.9% ---------------------------------------------------------------------------- ??? [141] 2.6% loop [16] 3.1% for-loop [17] 4.4% for-loop [18] 4.7% ??? [122] 5.5% ??? [78] 6.9% loop [94] 11.4% localize-error [36] 14.6% ??? [102] 18.3% eval-prog [76] 27.3% [108] 7042(3.4%) 352(0.2%) hash-ref! ...racket/private/more-scheme.rkt:373:13 bigfloat-hash [121] 22.3% parse-loop12 [119] 21.6% ??? [124] 11.4% f6 [30] 11.3% ??? [122] 6.9% simplify [5] 6.9% ??? [8] 5.6% ??? [9] 4.7% ??? [125] 3.1% ??? [10] 1.1% ---------------------------------------------------------------------------- option-on-expr [99] 100.0% [109] 6674(3.2%) 0(0.0%) sort-context-on-expr ...velop/src/points.rkt:115:0 ??? [117] 100.0% ---------------------------------------------------------------------------- option-on-expr [99] 100.0% [110] 4838(2.3%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:222:0 add-splitpoint [120] 93.8% for-loop [127] 6.2% ---------------------------------------------------------------------------- option-on-expr [99] 100.0% [111] 636(0.3%) 0(0.0%) pick-errors .../develop/src/core/regimes.rkt:184:0 for-loop [126] 100.0% ---------------------------------------------------------------------------- for-loop [104] 100.0% [112] 348(0.2%) 348(0.2%) setfindf ...es/herbie/develop/src/common.rkt:184:0 ---------------------------------------------------------------------------- for-loop [104] 100.0% [113] 326(0.2%) 0(0.0%) eval-const-expr .../develop/src/programs.rkt:166:0 ??? [114] 100.0% ---------------------------------------------------------------------------- eval-const-expr [113] 0.4% loop [94] 1.7% ??? [22] 97.9% [114] 83690(39.8%) 77628(36.9%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfsub [134] 5.4% bfsin [136] 1.9% ---------------------------------------------------------------------------- for-loop [138] 3.3% merge-egraph-nodes! [115] 8.5% for-loop [106] 88.2% [115] 9966(4.7%) 0(0.0%) merge-egraph-nodes! ...p/src/core/egraph.rkt:152:0 update-leader! [132] 49.6% loop! [150] 15.1% for-loop [138] 10.1% enode-merge! [139] 9.7% merge-egraph-nodes! [115] 8.5% for-loop [142] 7.0% ---------------------------------------------------------------------------- match-e [107] 100.0% [116] 7312(3.5%) 1346(0.6%) for-loop ...rbie/develop/src/core/ematch.rkt:59:11 for-loop [130] 63.6% list-cartesian-product [144] 6.8% loop [94] 4.6% curried [140] 4.3% filter [143] 2.3% ---------------------------------------------------------------------------- sort-context-on-expr [109] 100.0% [117] 6674(3.2%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [131] 100.0% ---------------------------------------------------------------------------- for-loop [106] 100.0% [118] 5724(2.7%) 0(0.0%) substitute-e ...e/develop/src/core/ematch.rkt:71:0 mk-enode! [129] 100.0% ---------------------------------------------------------------------------- loop [94] 1.6% for-loop [21] 1.6% parse-loop12 [119] 5.0% ??? [22] 6.3% f6 [30] 7.2% simplify [5] 8.8% map [44] 19.1% hash-ref! [108] 50.2% [119] 4612(2.2%) 1962(0.9%) parse-loop12 ...s/racket/match/compiler.rkt:418:15 loop [94] 47.1% loop [128] 8.2% gather-additive-terms6 [147] 7.2% parse-loop12 [119] 5.0% ---------------------------------------------------------------------------- err-lsts->split-indices [110] 100.0% [120] 4540(2.2%) 0(0.0%) add-splitpoint ...velop/src/core/regimes.rkt:235:2 for-loop [133] 100.0% ---------------------------------------------------------------------------- hash-ref! [108] 100.0% [121] 2374(1.1%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 bfcanonicalize [135] 100.0% ---------------------------------------------------------------------------- hash-ref! [108] 100.0% [122] 2000(1.0%) 0(0.0%) ??? ...es/herbie/develop/src/core/taylor.rkt:44:15 hash-ref! [108] 84.4% ??? [141] 15.6% ---------------------------------------------------------------------------- for-loop [106] 100.0% [123] 1728(0.8%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 loop [137] 80.1% member [146] 19.9% ---------------------------------------------------------------------------- hash-ref! [108] 100.0% [124] 1320(0.6%) 0(0.0%) ??? ...tlies/herbie/develop/src/programs.rkt:183:5 loop [94] 100.0% ---------------------------------------------------------------------------- hash-ref! [108] 100.0% [125] 950(0.5%) 0(0.0%) ??? ...es/herbie/develop/src/core/taylor.rkt:67:15 ??? [78] 100.0% ---------------------------------------------------------------------------- pick-errors [111] 100.0% [126] 636(0.3%) 0(0.0%) for-loop ...bie/develop/src/core/regimes.rkt:186:2 ??? [145] 100.0% ---------------------------------------------------------------------------- err-lsts->split-indices [110] 100.0% [127] 298(0.1%) 298(0.1%) for-loop ...bie/develop/src/core/regimes.rkt:260:4 ---------------------------------------------------------------------------- parse-loop12 [119] 0.0% loop [128] 6.9% sindices->spoints [105] 93.1% [128] 46990(22.4%) 306(0.1%) loop ...cket/collects/racket/private/map.rkt:36:19 sidx->spoint [148] 93.1% loop [128] 6.9% ??? [78] 0.0% ---------------------------------------------------------------------------- expr->enode [91] 7.3% substitute-e [118] 30.9% for-loop [106] 61.8% [129] 18524(8.8%) 1024(0.5%) mk-enode! ...bie/develop/src/core/egraph.rkt:101:0 new-enode [149] 94.5% ---------------------------------------------------------------------------- match-e [107] 38.9% for-loop [116] 61.1% [130] 8080(3.8%) 0(0.0%) for-loop ...rbie/develop/src/core/ematch.rkt:65:37 match-e [107] 100.0% ---------------------------------------------------------------------------- ??? [117] 100.0% [131] 6674(3.2%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [152] 80.2% loop [162] 19.8% ---------------------------------------------------------------------------- apply-match [100] 16.7% merge-egraph-nodes! [115] 83.3% [132] 6346(3.0%) 332(0.2%) update-leader! ...evelop/src/core/egraph.rkt:217:0 for-loop [151] 90.0% custom-set-union! [156] 4.7% ---------------------------------------------------------------------------- add-splitpoint [120] 100.0% [133] 4540(2.2%) 1516(0.7%) for-loop ...bie/develop/src/core/regimes.rkt:237:4 for-loop [153] 66.6% ---------------------------------------------------------------------------- ??? [114] 100.0% [134] 4496(2.1%) 3918(1.9%) bfsub ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [154] 12.9% ---------------------------------------------------------------------------- bigfloat-hash [121] 100.0% [135] 2374(1.1%) 2374(1.1%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 ---------------------------------------------------------------------------- ??? [114] 100.0% [136] 1566(0.7%) 904(0.4%) bfsin ...-lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [154] 42.3% ---------------------------------------------------------------------------- list-member? [123] 100.0% [137] 1384(0.7%) 1384(0.7%) loop (unknown source) ---------------------------------------------------------------------------- merge-egraph-nodes! [115] 100.0% [138] 1334(0.6%) 0(0.0%) for-loop ...bie/develop/src/core/egraph.rkt:200:10 loop! [150] 50.8% merge-egraph-nodes! [115] 49.2% ---------------------------------------------------------------------------- merge-egraph-nodes! [115] 100.0% [139] 966(0.5%) 326(0.2%) enode-merge! ...e/develop/src/core/enode.rkt:129:0 adopt-enode! [155] 66.3% ---------------------------------------------------------------------------- loop [94] 33.9% for-loop [116] 66.1% [140] 962(0.5%) 962(0.5%) curried ...cket/collects/racket/function.rkt:71:18 ---------------------------------------------------------------------------- ??? [122] 43.5% for-loop [17] 56.5% [141] 718(0.3%) 0(0.0%) ??? ...s/herbie/develop/src/core/taylor.rkt:288:19 hash-ref! [108] 100.0% ---------------------------------------------------------------------------- merge-egraph-nodes! [115] 100.0% [142] 702(0.3%) 702(0.3%) for-loop ...rbie/develop/src/core/egraph.rkt:232:6 ---------------------------------------------------------------------------- for-loop [116] 47.6% match-e [107] 52.4% [143] 698(0.3%) 698(0.3%) filter ...t/collects/racket/private/list.rkt:256:2 ---------------------------------------------------------------------------- list-cartesian-product [144] 25.7% for-loop [116] 74.3% [144] 668(0.3%) 668(0.3%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [144] 25.7% ---------------------------------------------------------------------------- for-loop [126] 100.0% [145] 636(0.3%) 0(0.0%) ??? ...s/herbie/develop/src/core/regimes.rkt:177:2 ??? [12] 100.0% ---------------------------------------------------------------------------- list-member? [123] 100.0% [146] 344(0.2%) 344(0.2%) member (unknown source) ---------------------------------------------------------------------------- parse-loop12 [119] 100.0% [147] 334(0.2%) 0(0.0%) gather-additive-terms6 ...src/core/reduce.rkt:72:0 ??? [42] 100.0% ---------------------------------------------------------------------------- loop [128] 100.0% [148] 46366(22.1%) 0(0.0%) sidx->spoint ...develop/src/core/regimes.rkt:126:2 binary-search [157] 53.3% binary-search-floats [158] 46.7% ---------------------------------------------------------------------------- mk-enode! [129] 100.0% [149] 17500(8.3%) 0(0.0%) new-enode ...erbie/develop/src/core/enode.rkt:97:0 type-of-enode-expr [159] 97.9% set [163] 2.1% ---------------------------------------------------------------------------- for-loop [138] 7.7% loop [94] 15.5% merge-egraph-nodes! [115] 22.7% for-loop [106] 54.2% [150] 8786(4.2%) 696(0.3%) loop! ...s/herbie/develop/src/core/enode.rkt:192:2 custom-set-union [160] 65.3% loop [94] 15.5% set [163] 11.4% ---------------------------------------------------------------------------- update-leader! [132] 100.0% [151] 5714(2.7%) 324(0.2%) for-loop ...rbie/develop/src/core/egraph.rkt:222:6 for-loop [161] 94.3% ---------------------------------------------------------------------------- generic-sort/key [131] 37.2% copying-mergesort [152] 62.8% [152] 5354(2.5%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [152] 62.8% loop [162] 23.8% jloop [4] 13.4% ---------------------------------------------------------------------------- for-loop [133] 100.0% [153] 3024(1.4%) 3024(1.4%) for-loop ...bie/develop/src/core/regimes.rkt:241:8 ---------------------------------------------------------------------------- bfsub [134] 22.8% bfsin [136] 26.1% real->bigfloat [34] 51.0% [154] 2532(1.2%) 2532(1.2%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 ---------------------------------------------------------------------------- enode-merge! [139] 100.0% [155] 640(0.3%) 304(0.1%) adopt-enode! ...e/develop/src/core/enode.rkt:105:0 custom-set-union [160] 52.5% ---------------------------------------------------------------------------- update-leader! [132] 100.0% [156] 300(0.1%) 300(0.1%) custom-set-union! ...t/private/set-types.rkt:245:0 ---------------------------------------------------------------------------- sidx->spoint [148] 100.0% [157] 24730(11.8%) 0(0.0%) binary-search ...rbie/develop/src/common.rkt:226:0 pred [164] 100.0% ---------------------------------------------------------------------------- sidx->spoint [148] 100.0% [158] 21636(10.3%) 0(0.0%) binary-search-floats ...velop/src/common.rkt:241:0 pred [164] 100.0% ---------------------------------------------------------------------------- new-enode [149] 100.0% [159] 17140(8.2%) 664(0.3%) type-of-enode-expr ...elop/src/core/enode.rkt:68:0 get-sigs [165] 96.1% ---------------------------------------------------------------------------- adopt-enode! [155] 5.5% loop! [150] 94.5% [160] 6072(2.9%) 2394(1.1%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [167] 50.5% for-loop [168] 10.0% ---------------------------------------------------------------------------- for-loop [151] 100.0% [161] 5390(2.6%) 0(0.0%) for-loop ...rbie/develop/src/core/egraph.rkt:223:8 hash-update! [166] 100.0% ---------------------------------------------------------------------------- generic-sort/key [131] 34.6% copying-mergesort [152] 65.4% [162] 3814(1.8%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [12] 85.5% ??? [78] 14.5% ---------------------------------------------------------------------------- new-enode [149] 15.2% loop! [150] 84.8% [163] 2364(1.1%) 2364(1.1%) set ...collects/racket/private/set-types.rkt:981:0 ---------------------------------------------------------------------------- binary-search-floats [158] 46.7% binary-search [157] 53.3% [164] 46366(22.1%) 0(0.0%) pred ...herbie/develop/src/core/regimes.rkt:132:17 loop [57] 95.3% errors [70] 4.7% ---------------------------------------------------------------------------- type-of-enode-expr [159] 100.0% [165] 16476(7.8%) 0(0.0%) get-sigs .../herbie/develop/src/type-check.rkt:5:0 ??? [169] 37.5% ??? [80] 34.3% ...velop/src/common.rkt:47:2 [171] 18.1% ??? [42] 10.1% ---------------------------------------------------------------------------- for-loop [161] 100.0% [166] 5390(2.6%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [170] 100.0% ---------------------------------------------------------------------------- custom-set-union [160] 100.0% [167] 3068(1.5%) 1006(0.5%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [172] 67.2% ---------------------------------------------------------------------------- custom-set-union [160] 100.0% [168] 610(0.3%) 610(0.3%) for-loop ...cts/racket/private/set-types.rkt:152:2 ---------------------------------------------------------------------------- ??? [78] 3.9% get-sigs [165] 96.1% [169] 6432(3.1%) 250(0.1%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 for-loop [174] 48.4% ??? [175] 47.7% ---------------------------------------------------------------------------- hash-update! [166] 100.0% [170] 5390(2.6%) 0(0.0%) ??? ...s/herbie/develop/src/core/egraph.rkt:225:24 for-loop [173] 100.0% ---------------------------------------------------------------------------- ->bf [82] 6.1% ??? [78] 6.5% f6 [30] 6.7% for-loop [43] 20.6% get-sigs [165] 60.1% [171] 4960(2.4%) 2336(1.1%) ...velop/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [176] 33.9% ??? [177] 19.0% ---------------------------------------------------------------------------- for-loop [167] 100.0% [172] 2062(1.0%) 2062(1.0%) for-loop ...cts/racket/private/set-types.rkt:178:5 ---------------------------------------------------------------------------- ??? [170] 100.0% [173] 5390(2.6%) 5390(2.6%) for-loop ...bie/develop/src/core/egraph.rkt:226:26 ---------------------------------------------------------------------------- for-loop [90] 29.7% ??? [169] 70.3% [174] 4432(2.1%) 322(0.2%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [178] 84.6% ??? [182] 8.1% ---------------------------------------------------------------------------- ??? [169] 100.0% [175] 3068(1.5%) 302(0.1%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [180] 90.2% ---------------------------------------------------------------------------- ??? [178] 9.0% for-loop [186] 20.6% ...velop/src/common.rkt:47:2 [171] 70.4% [176] 1680(0.8%) 692(0.3%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [178] 70.4% ??? [187] 9.0% ---------------------------------------------------------------------------- ...velop/src/common.rkt:47:2 [171] 100.0% [177] 944(0.4%) 310(0.1%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 return/no-unsupplied [181] 34.1% ??? [179] 33.1% ---------------------------------------------------------------------------- ...higher-order.rkt:346:33 [40] 5.3% ??? [176] 29.3% for-loop [174] 65.4% [178] 5734(2.7%) 628(0.3%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [183] 65.4% for-loop [186] 18.4% ??? [176] 5.3% ---------------------------------------------------------------------------- ??? [177] 6.8% ulp-difference [79] 11.9% ??? [80] 37.7% ??? [101] 43.6% [179] 4588(2.2%) 1204(0.6%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [184] 73.8% ---------------------------------------------------------------------------- ??? [175] 100.0% [180] 2766(1.3%) 706(0.3%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [185] 74.5% ---------------------------------------------------------------------------- ??? [101] 11.7% ??? [177] 13.5% ??? [80] 74.8% [181] 2378(1.1%) 2378(1.1%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 ---------------------------------------------------------------------------- ??? [22] 45.3% for-loop [174] 54.7% [182] 658(0.3%) 658(0.3%) ??? ...ects/racket/contract/private/prop.rkt:493:4 ---------------------------------------------------------------------------- ??? [178] 100.0% [183] 3750(1.8%) 1356(0.6%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [187] 63.8% ---------------------------------------------------------------------------- ??? [179] 100.0% [184] 3384(1.6%) 3384(1.6%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 ---------------------------------------------------------------------------- ??? [180] 100.0% [185] 2060(1.0%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [188] 100.0% ---------------------------------------------------------------------------- ??? [178] 100.0% [186] 1054(0.5%) 362(0.2%) for-loop ...acket/contract/private/list.rkt:190:15 ??? [176] 65.7% ---------------------------------------------------------------------------- ??? [176] 7.0% ??? [78] 37.4% ??? [183] 55.6% [187] 4308(2.1%) 2394(1.1%) ??? ...ects/racket/contract/private/guts.rkt:644:8 ??? [42] 37.4% contract? [191] 7.0% ---------------------------------------------------------------------------- ??? [185] 100.0% [188] 2060(1.0%) 662(0.3%) for-loop ...racket/contract/private/list.rkt:680:9 get/build-late-neg-projection [189] 50.4% add-list-context [190] 17.5% ---------------------------------------------------------------------------- for-loop [188] 100.0% [189] 1038(0.5%) 0(0.0%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [192] 100.0% ---------------------------------------------------------------------------- for-loop [188] 100.0% [190] 360(0.2%) 360(0.2%) add-list-context ...ontract/private/list.rkt:752:0 ---------------------------------------------------------------------------- ??? [187] 100.0% [191] 302(0.1%) 0(0.0%) contract? ...acket/contract/private/guts.rkt:109:0 coerce-contract/f4 [193] 100.0% ---------------------------------------------------------------------------- get/build-late-neg-projection [189]100.0% [192] 1038(0.5%) 0(0.0%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [194] 100.0% ---------------------------------------------------------------------------- contract? [191] 100.0% [193] 302(0.1%) 302(0.1%) coerce-contract/f4 ...tract/private/guts.rkt:299:0 ---------------------------------------------------------------------------- contract-struct-name [195] 17.1% ??? [192] 82.9% [194] 1038(0.5%) 380(0.2%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [195] 63.4% ---------------------------------------------------------------------------- build-compound-type-name [194] 100.0% [195] 658(0.3%) 658(0.3%) contract-struct-name ...ract/private/prop.rkt:89:0 build-compound-type-name [194] 27.1% ----------------------------------------------------------------------------