Profiling results ----------------- Total cpu time observed: 99966ms (out of 100920ms) Number of samples taken: 279 (once every 358ms) (Hiding functions with self<1.0% and local<2.0%: 3 of 204 hidden) =========================================================================== Caller Idx Total Self Name+src Local% ms(pct) ms(pct) Callee =========================================================================== ??? [21] 100.0% [1] 90458(90.5%) 0(0.0%) profile-thunk16 ...t/pkgs/profile-lib/main.rkt:9:0 run [4] 100.0% --------------------------------------------------------------------------- ??? [21] 100.0% [2] 75734(75.8%) 0(0.0%) run-improve50 ...ie/develop/src/mainloop.rkt:234:0 for-loop [5] 77.8% get-final-combination [6] 21.3% setup-alt-simplified [7] 0.5% loop [28] 0.5% --------------------------------------------------------------------------- copying-mergesort [146] 100.0% [3] 1682(1.7%) 0(0.0%) jloop ...t/collects/racket/private/sort.rkt:121:23 ??? [52] 58.5% ??? [59] 41.5% --------------------------------------------------------------------------- profile-thunk16 [1] 99.6% [4] 90784(90.8%) 0(0.0%) run ...share/racket/pkgs/profile-lib/main.rkt:39:2 ??? [21] 100.0% --------------------------------------------------------------------------- run-improve50 [2] 100.0% [5] 58896(58.9%) 0(0.0%) for-loop ...herbie/develop/src/mainloop.rkt:249:10 run-iter! [8] 100.0% --------------------------------------------------------------------------- run-improve50 [2] 100.0% [6] 16122(16.1%) 0(0.0%) get-final-combination ...op/src/mainloop.rkt:264:0 split-table [9] 97.8% extract-alt [10] 2.2% --------------------------------------------------------------------------- run-improve50 [2] 100.0% [7] 360(0.4%) 0(0.0%) setup-alt-simplified .../develop/src/glue.rkt:49:0 simplify-alt [11] 100.0% --------------------------------------------------------------------------- for-loop [5] 100.0% [8] 58896(58.9%) 0(0.0%) run-iter! ...herbie/develop/src/mainloop.rkt:215:0 simplify! [12] 70.8% finalize-iter! [13] 20.6% gen-rewrites! [14] 3.5% gen-series! [15] 3.3% choose-best-alt! [16] 1.8% --------------------------------------------------------------------------- get-final-combination [6] 100.0% [9] 15762(15.8%) 0(0.0%) split-table ...s/herbie/develop/src/glue.rkt:162:0 f137 [32] 100.0% --------------------------------------------------------------------------- get-final-combination [6] 100.0% [10] 360(0.4%) 0(0.0%) extract-alt ...es/herbie/develop/src/glue.rkt:55:0 loop [76] 100.0% --------------------------------------------------------------------------- setup-alt-simplified [7] 100.0% [11] 360(0.4%) 0(0.0%) simplify-alt ...s/herbie/develop/src/glue.rkt:76:0 ??? [62] 100.0% --------------------------------------------------------------------------- run-iter! [8] 100.0% [12] 41714(41.7%) 0(0.0%) simplify! ...herbie/develop/src/mainloop.rkt:155:0 for-loop [17] 100.0% --------------------------------------------------------------------------- run-iter! [8] 100.0% [13] 12126(12.1%) 0(0.0%) finalize-iter! ...e/develop/src/mainloop.rkt:169:0 ??? [18] 100.0% --------------------------------------------------------------------------- run-iter! [8] 100.0% [14] 2040(2.0%) 0(0.0%) gen-rewrites! ...ie/develop/src/mainloop.rkt:142:0 for-loop [19] 100.0% --------------------------------------------------------------------------- run-iter! [8] 100.0% [15] 1964(2.0%) 0(0.0%) gen-series! ...rbie/develop/src/mainloop.rkt:129:0 for-loop [20] 100.0% --------------------------------------------------------------------------- run-iter! [8] 100.0% [16] 1052(1.1%) 0(0.0%) choose-best-alt! ...develop/src/mainloop.rkt:115:0 ??? [18] 100.0% --------------------------------------------------------------------------- simplify! [12] 100.0% [17] 41714(41.7%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:159:6 ??? [21] 99.2% debug-print [162] 0.8% --------------------------------------------------------------------------- debug7 [91] 4.2% choose-best-alt! [16] 6.2% get-sigs [164] 6.2% ??? [193] 6.2% match-e [112] 8.3% finalize-iter! [13] 68.9% [18] 17092(17.1%) 1050(1.1%) ??? ...contract/private/arrow-val-first.rkt:357:18 for-loop [22] 68.9% hash-has-key? [23] 16.6% ??? [26] 6.2% assoc-has-key? [27] 2.2% --------------------------------------------------------------------------- gen-rewrites! [14] 100.0% [19] 2040(2.0%) 0(0.0%) for-loop ...herbie/develop/src/mainloop.rkt:147:11 ??? [25] 82.3% debug-print [162] 17.7% --------------------------------------------------------------------------- gen-series! [15] 100.0% [20] 1964(2.0%) 0(0.0%) for-loop .../herbie/develop/src/mainloop.rkt:135:7 taylor-alt [24] 100.0% --------------------------------------------------------------------------- for-loop [17] 13.9% run [4] 39.1% [21] 98958(99.0%) 0(0.0%) ??? ...lects/racket/private/more-scheme.rkt:261:28 profile-thunk16 [1] 38.7% run-improve50 [2] 32.0% ??? [62] 20.9% loop [28] 8.4% --------------------------------------------------------------------------- ??? [18] 100.0% [22] 12126(12.1%) 0(0.0%) for-loop ...ie/develop/src/core/alt-table.rkt:51:2 atab-add-altn [29] 100.0% --------------------------------------------------------------------------- ??? [18] 100.0% [23] 3190(3.2%) 0(0.0%) hash-has-key? ...et/private/more-scheme.rkt:368:13 ??? [71] 100.0% --------------------------------------------------------------------------- for-loop [20] 100.0% [24] 1964(2.0%) 0(0.0%) taylor-alt ...es/herbie/develop/src/glue.rkt:134:0 for-loop [30] 100.0% --------------------------------------------------------------------------- for-loop [19] 100.0% [25] 1678(1.7%) 0(0.0%) ??? ...ies/herbie/develop/src/alternative.rkt:88:0 rewriter [31] 100.0% --------------------------------------------------------------------------- ??? [18] 100.0% [26] 1052(1.1%) 0(0.0%) ??? .../herbie/develop/src/core/alt-table.rkt:54:0 ??? [59] 100.0% --------------------------------------------------------------------------- ??? [18] 100.0% [27] 368(0.4%) 368(0.4%) assoc-has-key? ...ts/racket/private/dict.rkt:236:0 --------------------------------------------------------------------------- run-improve50 [2] 2.1% ??? [21] 97.9% [28] 16698(16.7%) 0(0.0%) loop ...htlies/herbie/develop/src/points.rkt:193:2 loop [34] 44.8% make-exacts* [41] 31.4% loop [42] 21.8% for-loop [38] 2.0% --------------------------------------------------------------------------- for-loop [22] 100.0% [29] 12126(12.1%) 0(0.0%) atab-add-altn ...elop/src/core/alt-table.rkt:208:0 best-and-tied-at-points [33] 91.9% loop [37] 5.4% override-at-pnts [39] 2.7% --------------------------------------------------------------------------- taylor-alt [24] 100.0% [30] 1964(2.0%) 0(0.0%) for-loop ...lies/herbie/develop/src/glue.rkt:139:6 ??? [59] 100.0% --------------------------------------------------------------------------- ??? [25] 38.6% matcher [43] 61.4% [31] 1678(1.7%) 0(0.0%) rewriter ...bie/develop/src/core/matcher.rkt:131:2 for-loop [35] 61.4% *rules* [36] 16.5% f137 [32] 11.4% expression->type [194] 10.7% --------------------------------------------------------------------------- map [49] 1.3% simplify [149] 1.6% eval-const-expr [108] 1.7% for-loop [197] 1.7% approximate9 [67] 2.2% rewriter [31] 3.3% eval-prog [50] 5.0% f137 [32] 8.3% split-table [9] 74.9% [32] 19772(19.8%) 0(0.0%) f137 .../collects/racket/match/compiler.rkt:507:40 loop [95] 62.8% option-on-expr [103] 12.0% f137 [32] 8.3% ??? [59] 6.7% map [49] 2.9% ??? [62] 2.6% taylor-sqrt [44] 2.2% ...velop/src/common.rkt:47:2 [171] 1.6% ??? [170] 0.8% --------------------------------------------------------------------------- atab-add-altn [29] 100.0% [33] 11146(11.1%) 324(0.3%) best-and-tied-at-points ...ore/alt-table.rkt:122:0 errors [40] 93.9% for-loop [45] 3.2% --------------------------------------------------------------------------- loop [28] 100.0% [34] 7480(7.5%) 0(0.0%) loop ...htlies/herbie/develop/src/points.rkt:151:2 make-exacts* [41] 59.4% loop [42] 31.3% eval-prog [50] 9.4% --------------------------------------------------------------------------- rewriter [31] 100.0% [35] 1678(1.7%) 0(0.0%) for-loop ...ie/develop/src/core/matcher.rkt:134:10 matcher [43] 100.0% --------------------------------------------------------------------------- rewriter [31] 100.0% [36] 666(0.7%) 0(0.0%) *rules* ...rbie/develop/src/syntax/rules.rkt:484:0 for-loop [92] 100.0% --------------------------------------------------------------------------- atab-add-altn [29] 100.0% [37] 658(0.7%) 0(0.0%) loop ...erbie/develop/src/core/alt-table.rkt:182:2 loop [46] 54.4% loop [95] 45.6% --------------------------------------------------------------------------- loop [28] 100.0% [38] 326(0.3%) 0(0.0%) for-loop ...s/herbie/develop/src/points.rkt:200:24 for-loop [47] 100.0% --------------------------------------------------------------------------- atab-add-altn [29] 100.0% [39] 322(0.3%) 0(0.0%) override-at-pnts ...p/src/core/alt-table.rkt:145:0 errors [40] 100.0% --------------------------------------------------------------------------- override-at-pnts [39] 1.6% composed [89] 7.1% option-on-expr [103] 8.1% loop [95] 31.0% best-and-tied-at-points [33] 52.3% [40] 20016(20.0%) 0(0.0%) errors ...lies/herbie/develop/src/points.rkt:218:0 for-loop [48] 74.3% eval-prog [50] 25.7% --------------------------------------------------------------------------- loop [34] 45.9% loop [28] 54.1% [41] 9686(9.7%) 0(0.0%) make-exacts* ...erbie/develop/src/points.rkt:138:0 map [49] 40.4% loop [95] 39.0% eval-prog [50] 20.6% --------------------------------------------------------------------------- loop [34] 39.1% loop [28] 60.9% [42] 5986(6.0%) 0(0.0%) loop ...htlies/herbie/develop/src/points.rkt:141:4 map [49] 100.0% --------------------------------------------------------------------------- matcher [43] 23.4% for-loop [51] 30.2% for-loop [35] 46.4% [43] 1678(1.7%) 0(0.0%) matcher ...rbie/develop/src/core/matcher.rkt:167:2 rewriter [31] 46.4% for-loop [51] 30.2% matcher [43] 23.4% --------------------------------------------------------------------------- f137 [32] 100.0% [44] 652(0.7%) 0(0.0%) taylor-sqrt ...e/develop/src/core/taylor.rkt:346:0 hash-ref! [134] 50.9% simplify [149] 49.1% --------------------------------------------------------------------------- best-and-tied-at-points [33] 100.0% [45] 360(0.4%) 360(0.4%) for-loop .../develop/src/core/alt-table.rkt:124:16 --------------------------------------------------------------------------- loop [37] 100.0% [46] 358(0.4%) 358(0.4%) loop ...cket/collects/racket/private/hash.rkt:20:4 --------------------------------------------------------------------------- for-loop [38] 100.0% [47] 326(0.3%) 326(0.3%) for-loop ...s/herbie/develop/src/points.rkt:201:26 --------------------------------------------------------------------------- errors [40] 100.0% [48] 14870(14.9%) 1022(1.0%) for-loop ...es/herbie/develop/src/points.rkt:221:4 ??? [52] 74.8% ??? [59] 11.7% ulp-difference [53] 6.7% --------------------------------------------------------------------------- for-loop [130] 2.9% f137 [32] 8.5% make-exacts* [41] 35.0% loop [42] 53.6% [49] 11176(11.2%) 0(0.0%) map ...acket/collects/racket/private/map.rkt:20:13 loop [95] 85.6% f137 [32] 4.3% ??? [59] 3.0% simplify-node [55] 2.9% loop [56] 2.9% parse-loop79 [158] 1.3% --------------------------------------------------------------------------- loop [34] 8.9% make-exacts* [41] 25.4% errors [40] 65.6% [50] 7840(7.8%) 2024(2.0%) eval-prog ...herbie/develop/src/programs.rkt:148:0 f137 [32] 35.7% hash-ref! [134] 29.8% go [54] 4.5% ??? [57] 4.1% --------------------------------------------------------------------------- matcher [43] 100.0% [51] 1678(1.7%) 0(0.0%) for-loop ...ie/develop/src/core/matcher.rkt:183:21 matcher [43] 100.0% --------------------------------------------------------------------------- ??? [140] 1.3% jloop [3] 3.4% loop [155] 15.9% for-loop [48] 38.8% loop [95] 40.6% [52] 28686(28.7%) 338(0.3%) ??? ...tlies/herbie/develop/src/programs.rkt:154:4 ??? [58] 84.3% ??? [65] 7.6% ??? [59] 7.0% --------------------------------------------------------------------------- for-loop [48] 100.0% [53] 996(1.0%) 0(0.0%) ulp-difference ...erbie/develop/src/float.rkt:19:0 ??? [114] 66.5% return/no-unsupplied [183] 33.5% --------------------------------------------------------------------------- eval-prog [50] 100.0% [54] 352(0.4%) 352(0.4%) go .../collects/racket/private/qq-and-or.rkt:50:20 --------------------------------------------------------------------------- map [49] 100.0% [55] 326(0.3%) 0(0.0%) simplify-node .../develop/src/core/reduce.rkt:50:0 append-map [60] 100.0% --------------------------------------------------------------------------- map [49] 100.0% [56] 324(0.3%) 324(0.3%) loop ...cket/collects/racket/private/map.rkt:36:19 --------------------------------------------------------------------------- eval-prog [50] 100.0% [57] 324(0.3%) 0(0.0%) ??? ...cket/collects/racket/private/kw.rkt:1633:36 unpack245 [61] 100.0% --------------------------------------------------------------------------- ??? [52] 100.0% [58] 24174(24.2%) 11792(11.8%) ??? ...acket/collects/racket/private/kw.rkt:444:14 ??? [63] 21.5% ??? [64] 18.7% ??? [66] 8.3% parse-loop79 [158] 1.2% --------------------------------------------------------------------------- loop [78] 1.9% map [49] 2.7% jloop [3] 5.7% ??? [62] 7.1% for-loop [30] 7.1% ??? [26] 7.1% for-loop [48] 12.7% loop [95] 13.7% ??? [52] 16.3% f137 [32] 25.6% [59] 12252(12.3%) 1778(1.8%) ??? ...tract/private/arrow-higher-order.rkt:342:33 ??? [62] 52.4% ??? [193] 11.5% best-alt [68] 7.1% approximate9 [67] 5.9% ??? [65] 2.8% ??? [170] 2.7% hash-ref! [134] 1.9% simplify [149] 1.2% --------------------------------------------------------------------------- simplify-node [55] 100.0% [60] 326(0.3%) 0(0.0%) append-map ...acket/collects/racket/list.rkt:565:2 parse-loop79 [158] 100.0% --------------------------------------------------------------------------- ??? [57] 100.0% [61] 324(0.3%) 324(0.3%) unpack245 ...private/arrow-higher-order.rkt:354:44 --------------------------------------------------------------------------- simplify-alt [11] 0.3% for-loop [115] 0.6% f137 [32] 1.2% get-sigs [164] 1.7% ??? [62] 11.0% ??? [59] 12.5% for-loop [70] 31.1% ??? [21] 41.0% [62] 57680(57.7%) 4090(4.1%) ??? ...llects/racket/private/norm-define.rkt:53:83 iterate-egraph!13 [69] 36.5% for-loop [70] 31.1% ??? [62] 11.0% ??? [71] 3.4% ??? [114] 3.0% loop [72] 2.6% ??? [59] 2.6% mk-egraph [77] 0.9% debug7 [91] 0.6% *simplify-rules* [80] 0.6% return/no-unsupplied [183] 0.6% ??? [84] 0.5% extract-smallest [81] 0.3% --------------------------------------------------------------------------- ??? [58] 100.0% [63] 5192(5.2%) 1170(1.2%) ??? ...-racket/utils/simple-result-arrow.rkt:39:12 bfsqrt [73] 42.6% bfadd [75] 34.9% --------------------------------------------------------------------------- ??? [58] 100.0% [64] 4516(4.5%) 3434(3.4%) ??? ...herbie/develop/src/syntax/syntax.rkt:122:17 return/no-unsupplied [183] 16.0% ??? [114] 8.0% --------------------------------------------------------------------------- ??? [59] 13.5% ??? [52] 86.5% [65] 2514(2.5%) 0(0.0%) ??? ...contract/private/../../private/kw.rkt:761:9 real->bigfloat [74] 86.5% integer->bigfloat [82] 13.5% --------------------------------------------------------------------------- ??? [58] 100.0% [66] 2018(2.0%) 2018(2.0%) ??? ...rivate/unconstrained-domain-arrow.rkt:40:13 --------------------------------------------------------------------------- ??? [59] 100.0% [67] 1670(1.7%) 0(0.0%) approximate9 ...e/develop/src/core/taylor.rkt:12:0 loop [78] 41.0% f137 [32] 39.0% taylor-invert [83] 20.0% --------------------------------------------------------------------------- ??? [59] 100.0% [68] 1052(1.1%) 0(0.0%) best-alt ...tlies/herbie/develop/src/glue.rkt:71:0 loop [76] 66.0% argmins [79] 34.0% --------------------------------------------------------------------------- ??? [62] 100.0% [69] 43078(43.1%) 0(0.0%) iterate-egraph!13 ...p/src/core/simplify.rkt:102:0 one-iter [85] 97.0% map-enodes [93] 2.3% debug7 [91] 0.7% --------------------------------------------------------------------------- ??? [62] 100.0% [70] 37242(37.3%) 0(0.0%) for-loop ...ie/develop/src/core/simplify.rkt:63:12 ??? [62] 100.0% --------------------------------------------------------------------------- hash-has-key? [23] 46.4% ??? [62] 53.6% [71] 6872(6.9%) 2520(2.5%) ??? ...ects/racket/contract/private/list.rkt:737:4 for-loop [88] 39.9% ??? [99] 23.5% --------------------------------------------------------------------------- ??? [62] 100.0% [72] 3382(3.4%) 308(0.3%) loop ...herbie/develop/src/core/simplify.rkt:215:2 pass [86] 90.9% --------------------------------------------------------------------------- ??? [63] 100.0% [73] 2210(2.2%) 756(0.8%) bfsqrt ...lib/math/private/bigfloat/mpfr.rkt:616:4 ??? [87] 65.8% --------------------------------------------------------------------------- ??? [65] 100.0% [74] 2174(2.2%) 2174(2.2%) real->bigfloat .../private/bigfloat/mpfr.rkt:451:0 --------------------------------------------------------------------------- ??? [63] 100.0% [75] 1812(1.8%) 714(0.7%) bfadd ...-lib/math/private/bigfloat/mpfr.rkt:819:4 ??? [87] 60.6% --------------------------------------------------------------------------- extract-alt [10] 34.2% best-alt [68] 65.8% [76] 1054(1.1%) 0(0.0%) loop ...htlies/herbie/develop/src/common.rkt:146:2 composed [89] 100.0% --------------------------------------------------------------------------- ??? [62] 100.0% [77] 1044(1.0%) 0(0.0%) mk-egraph ...bie/develop/src/core/egraph.rkt:123:0 expr->enode [90] 100.0% --------------------------------------------------------------------------- approximate9 [67] 100.0% [78] 684(0.7%) 0(0.0%) loop ...es/herbie/develop/src/core/taylor.rkt:86:4 ??? [59] 100.0% --------------------------------------------------------------------------- best-alt [68] 100.0% [79] 358(0.4%) 0(0.0%) argmins ...ies/herbie/develop/src/common.rkt:145:0 composed [89] 100.0% --------------------------------------------------------------------------- ??? [62] 100.0% [80] 352(0.4%) 0(0.0%) *simplify-rules* ...lop/src/syntax/rules.rkt:488:0 for-loop [92] 100.0% --------------------------------------------------------------------------- ??? [62] 100.0% [81] 346(0.3%) 0(0.0%) extract-smallest ...op/src/core/simplify.rkt:191:0 hash-keys [94] 100.0% --------------------------------------------------------------------------- ??? [65] 100.0% [82] 340(0.3%) 340(0.3%) integer->bigfloat ...ivate/bigfloat/mpfr.rkt:399:0 --------------------------------------------------------------------------- approximate9 [67] 100.0% [83] 334(0.3%) 0(0.0%) taylor-invert ...develop/src/core/taylor.rkt:312:0 simplify [149] 100.0% --------------------------------------------------------------------------- ??? [62] 100.0% [84] 316(0.3%) 0(0.0%) ??? ...-racket/utils/simple-result-arrow.rkt:60:15 ??? [87] 100.0% --------------------------------------------------------------------------- iterate-egraph!13 [69] 100.0% [85] 41770(41.8%) 1050(1.1%) one-iter ...ie/develop/src/core/simplify.rkt:113:0 loop [96] 53.9% for-loop [97] 36.5% apply-match [102] 7.1% --------------------------------------------------------------------------- loop [72] 100.0% [86] 3074(3.1%) 0(0.0%) pass ...herbie/develop/src/core/simplify.rkt:205:2 for-loop [98] 100.0% --------------------------------------------------------------------------- ??? [84] 11.0% bfadd [75] 38.3% bfsqrt [73] 50.7% [87] 2868(2.9%) 2868(2.9%) ??? .../share/racket/collects/ffi/unsafe.rkt:861:4 --------------------------------------------------------------------------- ??? [71] 100.0% [88] 2740(2.7%) 1384(1.4%) for-loop ...acket/contract/private/list.rkt:743:12 ??? [99] 49.5% --------------------------------------------------------------------------- argmins [79] 25.4% loop [76] 74.6% [89] 1412(1.4%) 0(0.0%) composed ...ollects/racket/private/list.rkt:321:16 errors [40] 100.0% --------------------------------------------------------------------------- expr->enode [90] 46.5% mk-egraph [77] 53.5% [90] 1044(1.0%) 0(0.0%) expr->enode ...e/develop/src/core/egraph.rkt:124:2 mk-enode! [131] 53.5% expr->enode [90] 46.5% --------------------------------------------------------------------------- iterate-egraph!13 [69] 30.1% ??? [62] 69.9% [91] 1036(1.0%) 0(0.0%) debug7 ...tlies/herbie/develop/src/debug.rkt:102:0 ??? [18] 69.9% ??? [114] 30.1% --------------------------------------------------------------------------- *simplify-rules* [80] 34.6% *rules* [36] 65.4% [92] 1018(1.0%) 332(0.3%) for-loop ...ies/herbie/develop/src/common.rkt:94:9 ormap [100] 67.4% --------------------------------------------------------------------------- iterate-egraph!13 [69] 100.0% [93] 996(1.0%) 0(0.0%) map-enodes ...ie/develop/src/core/egraph.rkt:139:0 for-loop [101] 66.9% loop [95] 33.1% --------------------------------------------------------------------------- extract-smallest [81] 100.0% [94] 346(0.3%) 346(0.3%) hash-keys .../collects/racket/private/hash.rkt:2:2 --------------------------------------------------------------------------- make-exacts* [41] 0.1% map-enodes [93] 0.1% map [49] 0.4% loop [37] 0.8% parse-loop79 [158] 0.9% loop! [145] 1.6% ??? [148] 5.6% option-on-expr [103] 6.9% f137 [32] 21.1% loop [95] 62.4% [95] 36102(36.1%) 626(0.6%) loop ...cket/collects/racket/private/map.rkt:25:19 loop [95] 62.4% option-on-expr [103] 21.1% errors [40] 6.9% hash-ref! [134] 5.6% loop! [145] 1.6% parse-loop79 [158] 0.9% ??? [52] 0.4% ??? [59] 0.1% --------------------------------------------------------------------------- one-iter [85] 100.0% [96] 22520(22.5%) 0(0.0%) loop ...cket/collects/racket/private/map.rkt:52:19 apply-match [102] 100.0% --------------------------------------------------------------------------- for-loop [97] 50.0% one-iter [85] 50.0% [97] 15234(15.2%) 3028(3.0%) for-loop ...e/develop/src/core/simplify.rkt:123:12 for-loop [97] 50.0% match-e [112] 40.1% --------------------------------------------------------------------------- pass [86] 100.0% [98] 3074(3.1%) 0(0.0%) for-loop ...e/develop/src/core/simplify.rkt:208:29 argmin [104] 77.5% loop [107] 11.7% for-loop [109] 10.8% --------------------------------------------------------------------------- for-loop [88] 45.7% ??? [71] 54.3% [99] 2968(3.0%) 2274(2.3%) ??? ...private/unconstrained-domain-arrow.rkt:74:4 make-keyword-procedure [105] 23.4% --------------------------------------------------------------------------- for-loop [92] 100.0% [100] 686(0.7%) 0(0.0%) ormap ...et/collects/racket/private/map.rkt:105:13 flag-set? [106] 100.0% --------------------------------------------------------------------------- map-enodes [93] 100.0% [101] 666(0.7%) 0(0.0%) for-loop ...ie/develop/src/core/simplify.rkt:173:2 eval-const-expr [108] 51.1% compose [110] 48.9% --------------------------------------------------------------------------- one-iter [85] 11.6% loop [96] 88.4% [102] 25486(25.5%) 0(0.0%) apply-match ...develop/src/core/simplify.rkt:130:2 for-loop [111] 93.1% match-e [112] 4.1% reduce-to-single! [117] 1.4% update-leader! [135] 1.4% --------------------------------------------------------------------------- f137 [32] 15.1% loop [95] 84.9% [103] 15762(15.8%) 0(0.0%) option-on-expr ...velop/src/core/regimes.rkt:103:0 sort-context-on-expr [113] 39.6% loop [95] 39.4% errors [40] 10.2% err-lsts->split-indices [116] 8.5% pick-errors [118] 2.3% --------------------------------------------------------------------------- for-loop [98] 100.0% [104] 2382(2.4%) 0(0.0%) argmin ...re/racket/collects/racket/list.rkt:743:0 for-loop [115] 85.2% expression-cost [119] 14.8% --------------------------------------------------------------------------- ??? [99] 100.0% [105] 694(0.7%) 694(0.7%) make-keyword-procedure ...ket/private/kw.rkt:260:4 --------------------------------------------------------------------------- ormap [100] 100.0% [106] 686(0.7%) 334(0.3%) flag-set? ...es/herbie/develop/src/config.rkt:32:0 ??? [114] 51.3% --------------------------------------------------------------------------- for-loop [98] 100.0% [107] 360(0.4%) 0(0.0%) loop ...hare/racket/collects/racket/list.rkt:729:4 for-loop [115] 100.0% --------------------------------------------------------------------------- for-loop [101] 100.0% [108] 340(0.3%) 0(0.0%) eval-const-expr .../develop/src/programs.rkt:166:0 f137 [32] 100.0% --------------------------------------------------------------------------- for-loop [98] 100.0% [109] 332(0.3%) 332(0.3%) for-loop ...e/develop/src/core/simplify.rkt:195:13 --------------------------------------------------------------------------- for-loop [101] 100.0% [110] 326(0.3%) 326(0.3%) compose ...collects/racket/private/list.rkt:385:12 --------------------------------------------------------------------------- apply-match [102] 100.0% [111] 23724(23.7%) 642(0.6%) for-loop ...e/develop/src/core/simplify.rkt:145:10 mk-enode! [131] 33.4% merge-egraph-nodes! [121] 24.7% loop! [145] 24.7% substitute-e [124] 11.8% list-member? [126] 2.7% --------------------------------------------------------------------------- apply-match [102] 6.2% for-loop [133] 10.6% for-loop [97] 83.2% [112] 13242(13.2%) 5296(5.3%) match-e ...herbie/develop/src/core/ematch.rkt:46:0 for-loop [122] 35.7% for-loop [133] 10.3% list-cartesian-product [136] 9.0% ??? [18] 7.7% --------------------------------------------------------------------------- option-on-expr [103] 100.0% [113] 6246(6.2%) 0(0.0%) sort-context-on-expr ...velop/src/points.rkt:115:0 ??? [120] 100.0% --------------------------------------------------------------------------- debug7 [91] 8.6% flag-set? [106] 9.7% ??? [64] 10.0% ulp-difference [53] 18.3% ??? [62] 53.3% [114] 3614(3.6%) 642(0.6%) ??? ...racket/collects/racket/private/kw.rkt:761:9 ??? [123] 82.2% --------------------------------------------------------------------------- loop [107] 15.1% argmin [104] 84.9% [115] 2390(2.4%) 0(0.0%) for-loop .../herbie/develop/src/programs.rkt:199:2 ...velop/src/common.rkt:47:2 [171] 57.9% ??? [62] 42.1% --------------------------------------------------------------------------- option-on-expr [103] 100.0% [116] 1334(1.3%) 0(0.0%) err-lsts->split-indices .../core/regimes.rkt:222:0 add-splitpoint [125] 75.7% for-loop [130] 24.3% --------------------------------------------------------------------------- apply-match [102] 100.0% [117] 368(0.4%) 0(0.0%) reduce-to-single! ...lop/src/core/egraph.rkt:324:0 make-sequence [127] 100.0% --------------------------------------------------------------------------- option-on-expr [103] 100.0% [118] 362(0.4%) 0(0.0%) pick-errors .../develop/src/core/regimes.rkt:184:0 for-loop [128] 100.0% --------------------------------------------------------------------------- argmin [104] 100.0% [119] 352(0.4%) 0(0.0%) expression-cost .../develop/src/programs.rkt:198:0 compile [129] 100.0% --------------------------------------------------------------------------- sort-context-on-expr [113] 100.0% [120] 6246(6.2%) 0(0.0%) ??? ...cket/collects/racket/private/sort.rkt:403:3 generic-sort/key [132] 82.9% loop [155] 17.1% --------------------------------------------------------------------------- for-loop [139] 7.7% merge-egraph-nodes! [121] 7.7% for-loop [111] 84.6% [121] 5864(5.9%) 318(0.3%) merge-egraph-nodes! ...p/src/core/egraph.rkt:152:0 loop! [145] 30.9% update-leader! [135] 26.8% for-loop [137] 18.4% for-loop [139] 10.8% merge-egraph-nodes! [121] 7.7% --------------------------------------------------------------------------- match-e [112] 100.0% [122] 5186(5.2%) 3490(3.5%) for-loop ...rbie/develop/src/core/ematch.rkt:59:11 for-loop [133] 35.8% list-cartesian-product [136] 3.2% --------------------------------------------------------------------------- ??? [114] 100.0% [123] 2972(3.0%) 2972(3.0%) ??? ...s/racket/contract/private/arr-i.rkt:1233:27 --------------------------------------------------------------------------- substitute-e [124] 6.4% for-loop [111] 93.6% [124] 2802(2.8%) 0(0.0%) substitute-e ...e/develop/src/core/ematch.rkt:71:0 mk-enode! [131] 87.3% substitute-e [124] 6.4% variable? [141] 6.4% --------------------------------------------------------------------------- err-lsts->split-indices [116] 100.0% [125] 1010(1.0%) 0(0.0%) add-splitpoint ...velop/src/core/regimes.rkt:235:2 for-loop [138] 100.0% --------------------------------------------------------------------------- for-loop [111] 100.0% [126] 640(0.6%) 0(0.0%) list-member? ...llects/racket/private/set.rkt:24:0 loop [142] 51.9% member [143] 48.1% --------------------------------------------------------------------------- reduce-to-single! [117] 100.0% [127] 368(0.4%) 368(0.4%) make-sequence ...ects/racket/private/for.rkt:509:2 --------------------------------------------------------------------------- pick-errors [118] 100.0% [128] 362(0.4%) 0(0.0%) for-loop ...bie/develop/src/core/regimes.rkt:186:2 ??? [140] 100.0% --------------------------------------------------------------------------- expression-cost [119] 100.0% [129] 352(0.4%) 0(0.0%) compile ...s/herbie/develop/src/programs.rkt:175:0 hash-ref! [134] 100.0% --------------------------------------------------------------------------- err-lsts->split-indices [116] 100.0% [130] 324(0.3%) 0(0.0%) for-loop ...bie/develop/src/core/regimes.rkt:260:4 map [49] 100.0% --------------------------------------------------------------------------- expr->enode [90] 9.1% substitute-e [124] 21.4% for-loop [111] 69.4% [131] 11418(11.4%) 328(0.3%) mk-enode! ...bie/develop/src/core/egraph.rkt:101:0 new-enode [144] 97.1% --------------------------------------------------------------------------- ??? [120] 100.0% [132] 5178(5.2%) 0(0.0%) generic-sort/key .../racket/private/sort.rkt:185:2 copying-mergesort [146] 87.2% loop [155] 12.8% --------------------------------------------------------------------------- match-e [112] 42.0% for-loop [122] 58.0% [133] 4060(4.1%) 1036(1.0%) for-loop ...rbie/develop/src/core/ematch.rkt:65:37 match-e [112] 66.5% ??? [152] 8.0% --------------------------------------------------------------------------- ??? [153] 4.4% taylor-sqrt [44] 9.0% compile [129] 9.5% ??? [59] 14.1% eval-prog [50] 22.5% loop [95] 40.6% [134] 3706(3.7%) 352(0.4%) hash-ref! ...racket/private/more-scheme.rkt:373:13 ??? [148] 40.6% simplify [149] 23.0% bigfloat-hash [147] 22.5% ??? [153] 4.4% --------------------------------------------------------------------------- apply-match [102] 17.0% merge-egraph-nodes! [121] 83.0% [135] 2108(2.1%) 352(0.4%) update-leader! ...evelop/src/core/egraph.rkt:217:0 for-loop [150] 66.3% update-en-expr [184] 17.0% --------------------------------------------------------------------------- for-loop [122] 9.9% list-cartesian-product [136] 20.1% match-e [112] 70.0% [136] 1678(1.7%) 1678(1.7%) list-cartesian-product ...src/core/ematch.rkt:20:0 list-cartesian-product [136] 20.1% --------------------------------------------------------------------------- merge-egraph-nodes! [121] 100.0% [137] 1078(1.1%) 1078(1.1%) for-loop ...rbie/develop/src/core/egraph.rkt:232:6 --------------------------------------------------------------------------- add-splitpoint [125] 100.0% [138] 1010(1.0%) 332(0.3%) for-loop ...bie/develop/src/core/regimes.rkt:237:4 for-loop [151] 67.1% --------------------------------------------------------------------------- merge-egraph-nodes! [121] 100.0% [139] 1010(1.0%) 0(0.0%) for-loop ...bie/develop/src/core/egraph.rkt:200:10 merge-egraph-nodes! [121] 82.0% loop! [145] 18.0% --------------------------------------------------------------------------- for-loop [128] 100.0% [140] 362(0.4%) 0(0.0%) ??? ...s/herbie/develop/src/core/regimes.rkt:177:2 ??? [52] 100.0% --------------------------------------------------------------------------- substitute-e [124] 100.0% [141] 356(0.4%) 356(0.4%) variable? ...e/develop/src/syntax/syntax.rkt:567:0 --------------------------------------------------------------------------- list-member? [126] 100.0% [142] 332(0.3%) 332(0.3%) loop (unknown source) --------------------------------------------------------------------------- list-member? [126] 100.0% [143] 308(0.3%) 308(0.3%) member (unknown source) --------------------------------------------------------------------------- mk-enode! [131] 100.0% [144] 11090(11.1%) 720(0.7%) new-enode ...erbie/develop/src/core/enode.rkt:97:0 type-of-enode-expr [154] 93.5% --------------------------------------------------------------------------- for-loop [139] 4.2% merge-egraph-nodes! [121] 19.7% loop [95] 31.0% for-loop [111] 45.1% [145] 8566(8.6%) 1762(1.8%) loop! ...s/herbie/develop/src/core/enode.rkt:192:2 custom-set-union [156] 37.1% loop [95] 34.8% set [157] 13.0% update-en-expr [184] 5.6% --------------------------------------------------------------------------- generic-sort/key [132] 49.6% copying-mergesort [146] 50.4% [146] 4516(4.5%) 0(0.0%) copying-mergesort ...racket/private/sort.rkt:130:8 copying-mergesort [146] 50.4% loop [155] 40.3% jloop [3] 9.3% --------------------------------------------------------------------------- hash-ref! [134] 100.0% [147] 2338(2.3%) 0(0.0%) bigfloat-hash ...h/private/bigfloat/mpfr.rkt:165:0 sig+exp->bigfloat [159] 55.5% bfcanonicalize [160] 44.5% --------------------------------------------------------------------------- hash-ref! [134] 100.0% [148] 2006(2.0%) 0(0.0%) ??? ...tlies/herbie/develop/src/programs.rkt:183:5 loop [95] 100.0% --------------------------------------------------------------------------- ??? [59] 15.0% taylor-sqrt [44] 16.3% taylor-invert [83] 17.0% hash-ref! [134] 51.7% [149] 1964(2.0%) 0(0.0%) simplify ...erbie/develop/src/core/reduce.rkt:16:0 parse-loop79 [158] 52.1% f137 [32] 31.6% debug-print [162] 16.3% --------------------------------------------------------------------------- update-leader! [135] 100.0% [150] 1398(1.4%) 0(0.0%) for-loop ...rbie/develop/src/core/egraph.rkt:222:6 for-loop [161] 74.4% update-en-expr [184] 25.6% --------------------------------------------------------------------------- for-loop [138] 100.0% [151] 678(0.7%) 678(0.7%) for-loop ...bie/develop/src/core/regimes.rkt:241:8 --------------------------------------------------------------------------- for-loop [133] 100.0% [152] 326(0.3%) 0(0.0%) ??? ...ies/herbie/develop/src/core/ematch.rkt:50:5 for-loop [163] 100.0% --------------------------------------------------------------------------- hash-ref! [134] 100.0% [153] 326(0.3%) 0(0.0%) ??? ...es/herbie/develop/src/core/taylor.rkt:44:15 hash-ref! [134] 100.0% --------------------------------------------------------------------------- new-enode [144] 100.0% [154] 10370(10.4%) 0(0.0%) type-of-enode-expr ...elop/src/core/enode.rkt:68:0 get-sigs [164] 100.0% --------------------------------------------------------------------------- generic-sort/key [132] 14.5% ??? [120] 23.4% copying-mergesort [146] 62.1% [155] 4564(4.6%) 0(0.0%) loop ...ket/collects/racket/private/sort.rkt:97:12 ??? [52] 100.0% --------------------------------------------------------------------------- loop! [145] 100.0% [156] 3176(3.2%) 716(0.7%) custom-set-union ...et/private/set-types.rkt:168:0 for-loop [165] 67.1% for-loop [168] 10.4% --------------------------------------------------------------------------- loop! [145] 100.0% [157] 2340(2.3%) 2340(2.3%) set ...collects/racket/private/set-types.rkt:981:0 --------------------------------------------------------------------------- loop [95] 5.7% append-map [60] 8.4% parse-loop79 [158] 14.1% map [49] 15.2% ??? [58] 15.3% simplify [149] 41.4% [158] 1940(1.9%) 1256(1.3%) parse-loop79 ...s/racket/match/compiler.rkt:418:15 make-multiplication-node [174] 18.5% parse-loop79 [158] 14.1% for-loop [169] 8.4% loop [95] 5.7% --------------------------------------------------------------------------- bigfloat-hash [147] 100.0% [159] 1298(1.3%) 1298(1.3%) sig+exp->bigfloat ...ivate/bigfloat/mpfr.rkt:385:0 --------------------------------------------------------------------------- bigfloat-hash [147] 100.0% [160] 1040(1.0%) 1040(1.0%) bfcanonicalize .../private/bigfloat/mpfr.rkt:155:0 --------------------------------------------------------------------------- for-loop [150] 100.0% [161] 1040(1.0%) 0(0.0%) for-loop ...rbie/develop/src/core/egraph.rkt:223:8 hash-update! [166] 100.0% --------------------------------------------------------------------------- simplify [149] 31.1% for-loop [17] 33.8% for-loop [19] 35.1% [162] 1030(1.0%) 682(0.7%) debug-print .../herbie/develop/src/debug.rkt:107:0 for-loop [167] 33.8% --------------------------------------------------------------------------- ??? [152] 100.0% [163] 326(0.3%) 326(0.3%) for-loop ...erbie/develop/src/core/ematch.rkt:51:7 --------------------------------------------------------------------------- type-of-enode-expr [154] 100.0% [164] 10370(10.4%) 684(0.7%) get-sigs .../herbie/develop/src/type-check.rkt:5:0 ??? [170] 45.1% ??? [62] 28.2% ??? [18] 10.2% ...velop/src/common.rkt:47:2 [171] 10.0% --------------------------------------------------------------------------- custom-set-union [156] 100.0% [165] 2130(2.1%) 722(0.7%) for-loop ...cts/racket/private/set-types.rkt:174:3 for-loop [172] 66.1% --------------------------------------------------------------------------- for-loop [161] 100.0% [166] 1040(1.0%) 0(0.0%) hash-update! ...ket/private/more-scheme.rkt:362:13 ??? [173] 100.0% --------------------------------------------------------------------------- debug-print [162] 100.0% [167] 348(0.3%) 348(0.3%) for-loop ...ies/herbie/develop/src/debug.rkt:113:2 --------------------------------------------------------------------------- custom-set-union [156] 100.0% [168] 330(0.3%) 330(0.3%) for-loop ...cts/racket/private/set-types.rkt:152:2 --------------------------------------------------------------------------- parse-loop79 [158] 100.0% [169] 326(0.3%) 0(0.0%) for-loop ...rbie/develop/src/core/reduce.rkt:99:13 make-multiplication-node [174] 100.0% --------------------------------------------------------------------------- f137 [32] 6.1% ??? [59] 6.2% get-sigs [164] 87.7% [170] 5332(5.3%) 330(0.3%) ??? ...ts/racket/contract/private/arr-i.rkt:804:10 ??? [175] 76.1% for-loop [180] 11.9% coerce-contract [181] 5.8% --------------------------------------------------------------------------- f137 [32] 11.7% get-sigs [164] 37.8% for-loop [115] 50.5% [171] 2738(2.7%) 0(0.0%) ...velop/src/common.rkt:47:2 ...e/arr-i.rkt:906:19 ??? [176] 62.0% ??? [178] 38.0% --------------------------------------------------------------------------- for-loop [165] 100.0% [172] 1408(1.4%) 1408(1.4%) for-loop ...cts/racket/private/set-types.rkt:178:5 --------------------------------------------------------------------------- hash-update! [166] 100.0% [173] 1040(1.0%) 0(0.0%) ??? ...s/herbie/develop/src/core/egraph.rkt:225:24 for-loop [177] 100.0% --------------------------------------------------------------------------- for-loop [169] 47.7% parse-loop79 [158] 52.3% [174] 684(0.7%) 0(0.0%) make-multiplication-node .../core/reduce.rkt:230:0 make-multiplication-subnode [179] 100.0% --------------------------------------------------------------------------- ??? [170] 100.0% [175] 4060(4.1%) 0(0.0%) ??? ...ects/racket/contract/private/hash.rkt:217:4 ??? [182] 100.0% --------------------------------------------------------------------------- ...velop/src/common.rkt:47:2 [171] 100.0% [176] 1698(1.7%) 362(0.4%) ??? ...s/racket/contract/private/arr-i.rkt:1268:39 return/no-unsupplied [183] 57.8% assoc-ref [186] 20.8% --------------------------------------------------------------------------- ??? [173] 100.0% [177] 1040(1.0%) 682(0.7%) for-loop ...bie/develop/src/core/egraph.rkt:226:26 update-en-expr [184] 34.4% --------------------------------------------------------------------------- ??? [185] 17.3% ...velop/src/common.rkt:47:2 [171] 82.7% [178] 1040(1.0%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:342:4 ??? [185] 82.7% ??? [193] 17.3% --------------------------------------------------------------------------- make-multiplication-node [174] 100.0% [179] 684(0.7%) 358(0.4%) make-multiplication-subnode ...re/reduce.rkt:240:0 for-loop [187] 47.7% --------------------------------------------------------------------------- ??? [170] 100.0% [180] 632(0.6%) 0(0.0%) for-loop ...racket/contract/private/hash.rkt:239:6 ??? [185] 100.0% --------------------------------------------------------------------------- ??? [170] 100.0% [181] 310(0.3%) 310(0.3%) coerce-contract ...contract/private/guts.rkt:257:0 --------------------------------------------------------------------------- ??? [175] 100.0% [182] 4060(4.1%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:169:2 ??? [188] 100.0% --------------------------------------------------------------------------- ulp-difference [53] 14.1% ??? [62] 14.2% ??? [64] 30.4% ??? [176] 41.4% [183] 2374(2.4%) 1694(1.7%) return/no-unsupplied ...ct/private/arr-i.rkt:533:0 filter [189] 28.6% --------------------------------------------------------------------------- for-loop [177] 17.6% for-loop [150] 17.6% update-leader! [135] 17.6% loop! [145] 47.2% [184] 2036(2.0%) 2036(2.0%) update-en-expr ...evelop/src/core/egraph.rkt:211:0 --------------------------------------------------------------------------- for-loop [180] 37.8% ??? [178] 62.2% [185] 1672(1.7%) 680(0.7%) ??? ...cts/racket/contract/private/list.rkt:187:10 ??? [190] 37.8% ??? [178] 21.5% --------------------------------------------------------------------------- ??? [176] 100.0% [186] 354(0.4%) 354(0.4%) assoc-ref ...collects/racket/private/dict.rkt:56:0 --------------------------------------------------------------------------- make-multiplication-subnode [179] 100.0% [187] 326(0.3%) 0(0.0%) for-loop ...rbie/develop/src/core/reduce.rkt:242:3 mterm->expr [191] 100.0% --------------------------------------------------------------------------- ??? [182] 100.0% [188] 4060(4.1%) 0(0.0%) ??? ...ects/racket/contract/private/list.rkt:678:5 for-loop [192] 100.0% --------------------------------------------------------------------------- return/no-unsupplied [183] 100.0% [189] 680(0.7%) 680(0.7%) filter ...t/collects/racket/private/list.rkt:256:2 --------------------------------------------------------------------------- ??? [185] 100.0% [190] 632(0.6%) 330(0.3%) ??? ...ects/racket/contract/private/list.rkt:686:7 ??? [193] 47.8% --------------------------------------------------------------------------- for-loop [187] 100.0% [191] 326(0.3%) 0(0.0%) mterm->expr ...e/develop/src/core/reduce.rkt:270:0 expression->type [194] 100.0% --------------------------------------------------------------------------- ??? [188] 100.0% [192] 4060(4.1%) 0(0.0%) for-loop ...racket/contract/private/list.rkt:680:9 get/build-late-neg-projection [195] 57.5% add-list-context [196] 42.5% --------------------------------------------------------------------------- ??? [190] 14.5% ??? [178] 17.3% ??? [59] 68.1% [193] 2076(2.1%) 302(0.3%) ??? ...ects/racket/contract/private/guts.rkt:644:8 ??? [18] 68.1% contract? [198] 17.3% --------------------------------------------------------------------------- mterm->expr [191] 47.7% rewriter [31] 52.3% [194] 684(0.7%) 0(0.0%) expression->type ...evelop/src/type-check.rkt:45:0 for-loop [197] 100.0% --------------------------------------------------------------------------- for-loop [192] 100.0% [195] 2334(2.3%) 360(0.4%) get/build-late-neg-projection ...te/guts.rkt:691:0 ??? [199] 84.6% --------------------------------------------------------------------------- for-loop [192] 100.0% [196] 1726(1.7%) 1726(1.7%) add-list-context ...ontract/private/list.rkt:752:0 --------------------------------------------------------------------------- expression->type [194] 100.0% [197] 684(0.7%) 0(0.0%) for-loop ...herbie/develop/src/type-check.rkt:52:5 f137 [32] 100.0% --------------------------------------------------------------------------- ??? [193] 100.0% [198] 360(0.4%) 360(0.4%) contract? ...acket/contract/private/guts.rkt:109:0 --------------------------------------------------------------------------- get/build-late-neg-projection [195]100.0% [199] 1974(2.0%) 1296(1.3%) ??? ...cts/racket/contract/private/prop.rkt:314:12 build-compound-type-name [200] 34.3% --------------------------------------------------------------------------- ??? [199] 100.0% [200] 678(0.7%) 326(0.3%) build-compound-type-name ...private/guts.rkt:448:0 contract-struct-name [201] 51.9% --------------------------------------------------------------------------- build-compound-type-name [200] 100.0% [201] 352(0.4%) 352(0.4%) contract-struct-name ...ract/private/prop.rkt:89:0 ---------------------------------------------------------------------------